2024-09-13T18:10:34.054 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T18:10:34.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:10:34.185 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903974 branch: wip-rishabh-testing-20240910.100730-reef description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: null first_in_suite: false job_id: '7903974' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/reef ' name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 targets: smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPK+SbJZPHqaca8CDe7Rp+CWftGXOfUytbpaceNo9xsmndsZNnqk2Pi49fK+L/oO1qGK9XSZ3wdMffgfAybIF3M= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGoy0wxE3NqBIE2RNZ+DxBjoLk6sEbtbtmI6KGiqnqcLTgnUzI7gYVmtOI2Nk1F2nnf7DoIuBKqpp1NWeEHXP3E= tasks: - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef roleless: true - print: '**** done end installing reef cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/rishabh/src/git.ceph.com_ceph-c_wip-rishabh-testing-20240910.100730-reef/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-13T18:10:34.185 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T18:10:34.186 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T18:10:34.186 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T18:10:34.188 INFO:teuthology.task.internal:Checking packages... 2024-09-13T18:10:34.208 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T18:10:34.209 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:10:34.209 INFO:teuthology.packaging:ref: None 2024-09-13T18:10:34.209 INFO:teuthology.packaging:tag: None 2024-09-13T18:10:34.209 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:10:34.209 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:10:34.209 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:10:34.354 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860.g6c6b083f 2024-09-13T18:10:34.356 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T18:10:34.367 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T18:10:34.368 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T18:10:34.373 INFO:teuthology.task.internal:Saving configuration 2024-09-13T18:10:34.396 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T18:10:34.402 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T18:10:34.434 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903974', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:05:35.273749', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPK+SbJZPHqaca8CDe7Rp+CWftGXOfUytbpaceNo9xsmndsZNnqk2Pi49fK+L/oO1qGK9XSZ3wdMffgfAybIF3M='} 2024-09-13T18:10:34.469 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903974', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:05:35.272237', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGoy0wxE3NqBIE2RNZ+DxBjoLk6sEbtbtmI6KGiqnqcLTgnUzI7gYVmtOI2Nk1F2nnf7DoIuBKqpp1NWeEHXP3E='} 2024-09-13T18:10:34.469 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T18:10:34.474 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-13T18:10:34.474 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-13T18:10:34.475 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T18:10:34.554 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fedcb84bbe0>, signals=[15]) 2024-09-13T18:10:34.554 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T18:10:34.559 INFO:teuthology.task.internal:Opening connections... 2024-09-13T18:10:34.559 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:10:34.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:10:34.660 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-09-13T18:10:34.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:10:34.744 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T18:10:34.751 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-09-13T18:10:34.769 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-09-13T18:10:34.770 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-09-13T18:10:34.827 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-09-13T18:10:34.827 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2024-09-13T18:10:34.827 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-09-13T18:10:34.827 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-09-13T18:10:34.827 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2024-09-13T18:10:34.827 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2024-09-13T18:10:34.827 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T18:10:34.827 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-09-13T18:10:34.827 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2024-09-13T18:10:34.828 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T18:10:34.828 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-09-13T18:10:34.828 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T18:10:34.828 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T18:10:34.828 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T18:10:34.829 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-09-13T18:10:34.860 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-09-13T18:10:34.878 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-09-13T18:10:34.878 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-09-13T18:10:34.936 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-09-13T18:10:34.937 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-09-13T18:10:34.937 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-09-13T18:10:34.937 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-09-13T18:10:34.937 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-09-13T18:10:34.937 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-09-13T18:10:34.937 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T18:10:34.937 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-09-13T18:10:34.937 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-09-13T18:10:34.937 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T18:10:34.937 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-09-13T18:10:34.938 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T18:10:34.938 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T18:10:34.938 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T18:10:34.938 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-09-13T18:10:34.968 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T18:10:34.977 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T18:10:34.987 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T18:10:34.987 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:10:34.990 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:10:35.006 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T18:10:35.012 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T18:10:35.012 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:10:35.047 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:10:35.075 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T18:10:35.148 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T18:10:35.162 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T18:10:35.162 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T18:10:35.162 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:10:35.163 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:10:35.180 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:10:35.181 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-13T18:10:35.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:10:35.182 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-13T18:10:35.238 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-503.el9.x86_64 2024-09-13T18:10:35.238 INFO:teuthology.task.kernel:Running kernel on smithi038: 5.14.0-503.el9.x86_64 2024-09-13T18:10:35.238 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum install -y kernel 2024-09-13T18:10:35.240 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-503.el9.x86_64 2024-09-13T18:10:35.240 INFO:teuthology.task.kernel:Running kernel on smithi149: 5.14.0-503.el9.x86_64 2024-09-13T18:10:35.240 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y kernel 2024-09-13T18:10:38.998 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-09-13T18:10:40.067 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-09-13T18:10:42.916 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-13T18:10:43.424 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 20 MB 00:03 2024-09-13T18:10:47.234 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-13T18:10:47.775 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-13T18:10:48.877 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-13T18:10:50.026 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-13T18:10:50.364 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-13T18:10:51.189 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-13T18:10:55.911 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-13T18:10:56.895 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T18:10:57.096 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:01 ago on Fri 13 Sep 2024 06:10:56 PM UTC. 2024-09-13T18:10:57.876 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T18:10:57.877 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T18:10:57.969 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:10:57.974 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:10:57.974 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-13T18:10:57.975 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:10:57.975 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:10:57.975 INFO:teuthology.orchestra.run.smithi149.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T18:10:57.975 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-13T18:10:57.975 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T18:10:57.975 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T18:10:57.975 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T18:10:57.975 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:10:57.975 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:10:57.975 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:10:57.975 INFO:teuthology.orchestra.run.smithi149.stdout:Install 4 Packages 2024-09-13T18:10:57.975 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:10:57.976 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 79 M 2024-09-13T18:10:57.976 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 126 M 2024-09-13T18:10:57.976 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:10:58.188 INFO:teuthology.orchestra.run.smithi149.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 267 kB/s | 23 kB 00:00 2024-09-13T18:10:58.546 INFO:teuthology.orchestra.run.smithi149.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-13T18:10:58.946 INFO:teuthology.orchestra.run.smithi149.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 41 MB/s | 35 MB 00:00 2024-09-13T18:10:59.001 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T18:10:59.001 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T18:10:59.094 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:10:59.101 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:10:59.101 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2024-09-13T18:10:59.101 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:10:59.102 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:10:59.102 INFO:teuthology.orchestra.run.smithi038.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T18:10:59.102 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-13T18:10:59.102 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T18:10:59.102 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T18:10:59.102 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T18:10:59.102 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:10:59.102 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:10:59.102 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:10:59.102 INFO:teuthology.orchestra.run.smithi038.stdout:Install 4 Packages 2024-09-13T18:10:59.102 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:10:59.103 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 79 M 2024-09-13T18:10:59.103 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 126 M 2024-09-13T18:10:59.103 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:10:59.388 INFO:teuthology.orchestra.run.smithi149.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-13T18:10:59.389 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:10:59.389 INFO:teuthology.orchestra.run.smithi149.stdout:Total 56 MB/s | 79 MB 00:01 2024-09-13T18:10:59.688 INFO:teuthology.orchestra.run.smithi038.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 75 kB/s | 23 kB 00:00 2024-09-13T18:11:00.076 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:11:00.436 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:11:00.436 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:11:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:11:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:11:03.862 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:11:04.601 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:11:04.680 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:11:07.470 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:11:07.609 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:11:08.304 INFO:teuthology.orchestra.run.smithi038.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.9 MB/s | 35 MB 00:08 2024-09-13T18:11:10.104 INFO:teuthology.orchestra.run.smithi038.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.7 MB/s | 29 MB 00:10 2024-09-13T18:11:12.424 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:11:12.501 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:11:16.196 INFO:teuthology.orchestra.run.smithi038.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 953 kB/s | 16 MB 00:16 2024-09-13T18:11:16.196 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:11:16.196 INFO:teuthology.orchestra.run.smithi038.stdout:Total 4.6 MB/s | 79 MB 00:17 2024-09-13T18:11:16.911 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:11:17.305 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:11:17.305 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:11:17.366 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:11:18.278 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:11:18.278 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:11:20.872 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:11:21.551 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:11:21.649 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:11:24.446 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:11:24.577 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:11:29.697 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:11:29.744 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:11:34.880 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:11:55.422 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:11:55.461 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:11:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:11:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:11:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:11:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:11:56.598 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:11:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:11:56.599 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:11:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T18:11:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T18:11:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T18:11:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T18:11:56.599 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:11:56.599 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:11:56.958 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:11:57.052 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:11:57.054 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:11:57.054 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T18:11:57.054 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:11:57.054 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:11:57.054 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-13T18:11:57.054 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:11:57.054 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:11:57.113 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:11:57.114 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:11:57.114 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2024-09-13T18:11:57.149 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2024-09-13T18:11:57.149 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2024-09-13T18:11:57.149 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2024-09-13T18:11:57.149 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 82.el9 2024-09-13T18:11:57.149 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8274670 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2024-09-13T18:11:57.150 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:11:57.151 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T18:11:57.151 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T18:11:57.151 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T18:11:57.151 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2024-09-13T18:11:57.151 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:11:57.151 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T18:11:57.152 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T18:11:57.152 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 5.14.0-505.el9.x86_64 2024-09-13T18:11:57.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T18:11:57.810 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-09-13T18:11:59.218 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[47183]) leaked on vgs invocation. Parent PID 22695: grub2-probe 2024-09-13T18:11:59.218 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[46179]) leaked on vgs invocation. Parent PID 22695: grub2-probe 2024-09-13T18:11:59.249 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[47183]) leaked on vgs invocation. Parent PID 22695: grub2-probe 2024-09-13T18:11:59.249 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[46179]) leaked on vgs invocation. Parent PID 22695: grub2-probe 2024-09-13T18:11:59.523 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[47183]) leaked on vgs invocation. Parent PID 22743: grub2-probe 2024-09-13T18:11:59.523 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[46179]) leaked on vgs invocation. Parent PID 22743: grub2-probe 2024-09-13T18:11:59.551 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[47183]) leaked on vgs invocation. Parent PID 22743: grub2-probe 2024-09-13T18:11:59.551 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[46179]) leaked on vgs invocation. Parent PID 22743: grub2-probe 2024-09-13T18:11:59.714 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[47183]) leaked on vgs invocation. Parent PID 22791: grub2-probe 2024-09-13T18:11:59.714 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[46179]) leaked on vgs invocation. Parent PID 22791: grub2-probe 2024-09-13T18:11:59.744 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[47183]) leaked on vgs invocation. Parent PID 22791: grub2-probe 2024-09-13T18:11:59.744 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[46179]) leaked on vgs invocation. Parent PID 22791: grub2-probe 2024-09-13T18:11:59.896 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[47183]) leaked on vgs invocation. Parent PID 22839: grub2-probe 2024-09-13T18:11:59.896 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[46179]) leaked on vgs invocation. Parent PID 22839: grub2-probe 2024-09-13T18:11:59.927 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[47183]) leaked on vgs invocation. Parent PID 22839: grub2-probe 2024-09-13T18:11:59.927 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[46179]) leaked on vgs invocation. Parent PID 22839: grub2-probe 2024-09-13T18:12:00.087 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[47183]) leaked on vgs invocation. Parent PID 22887: grub2-probe 2024-09-13T18:12:00.087 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[46179]) leaked on vgs invocation. Parent PID 22887: grub2-probe 2024-09-13T18:12:00.260 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[47183]) leaked on vgs invocation. Parent PID 22887: grub2-probe 2024-09-13T18:12:00.260 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[46179]) leaked on vgs invocation. Parent PID 22887: grub2-probe 2024-09-13T18:12:00.260 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T18:12:00.274 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-09-13T18:12:00.276 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-13T18:12:00.297 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.ISEqF2sgOP 2024-09-13T18:12:00.298 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ISEqF2sgOP 2024-09-13T18:12:00.369 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.ISEqF2sgOP 2024-09-13T18:12:00.512 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.ISEqF2sgOP is 6KB 2024-09-13T18:12:00.562 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.ISEqF2sgOP 2024-09-13T18:12:00.577 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T18:12:00.641 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T18:12:00.641 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T18:12:00.641 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T18:12:00.641 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T18:12:00.642 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T18:12:00.785 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2024-09-13T18:12:13.865 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:12:13.906 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:12:14.247 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:12:14.247 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T18:12:14.248 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T18:12:14.248 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T18:12:15.127 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T18:12:15.127 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:12:15.127 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:12:15.127 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T18:12:15.127 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T18:12:15.127 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T18:12:15.127 INFO:teuthology.orchestra.run.smithi038.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T18:12:15.127 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:12:15.127 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:12:15.459 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:12:15.542 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:12:15.542 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:12:15.542 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T18:12:15.542 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:12:15.543 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:12:15.543 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-13T18:12:15.543 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:12:15.543 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T18:12:15.601 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T18:12:15.602 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T18:12:15.602 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -qi grub2-tools 2024-09-13T18:12:15.642 INFO:teuthology.orchestra.run.smithi038.stdout:Name : grub2-tools 2024-09-13T18:12:15.642 INFO:teuthology.orchestra.run.smithi038.stdout:Epoch : 1 2024-09-13T18:12:15.642 INFO:teuthology.orchestra.run.smithi038.stdout:Version : 2.06 2024-09-13T18:12:15.642 INFO:teuthology.orchestra.run.smithi038.stdout:Release : 82.el9 2024-09-13T18:12:15.642 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: x86_64 2024-09-13T18:12:15.642 INFO:teuthology.orchestra.run.smithi038.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T18:12:15.642 INFO:teuthology.orchestra.run.smithi038.stdout:Group : Unspecified 2024-09-13T18:12:15.642 INFO:teuthology.orchestra.run.smithi038.stdout:Size : 8274670 2024-09-13T18:12:15.642 INFO:teuthology.orchestra.run.smithi038.stdout:License : GPLv3+ 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:Packager : builder@centos.org 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:Vendor : CentOS 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:Summary : Support tools for GRUB. 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:Description : 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T18:12:15.643 INFO:teuthology.orchestra.run.smithi038.stdout:hardware devices. 2024-09-13T18:12:15.644 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:12:15.644 INFO:teuthology.orchestra.run.smithi038.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T18:12:15.644 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T18:12:15.645 INFO:teuthology.task.kernel:Updating grub on smithi038 to boot 5.14.0-505.el9.x86_64 2024-09-13T18:12:15.645 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T18:12:16.301 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2024-09-13T18:12:17.662 INFO:teuthology.orchestra.run.smithi038.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T18:12:17.698 INFO:teuthology.orchestra.run.smithi038.stderr:done 2024-09-13T18:12:17.705 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-09-13T18:12:17.720 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.ik0tQmkA0W 2024-09-13T18:12:17.720 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ik0tQmkA0W 2024-09-13T18:12:17.786 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.ik0tQmkA0W 2024-09-13T18:12:17.928 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.ik0tQmkA0W is 6KB 2024-09-13T18:12:17.978 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.ik0tQmkA0W 2024-09-13T18:12:17.993 DEBUG:teuthology.orchestra.run.smithi038:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T18:12:18.055 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T18:12:18.055 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T18:12:18.055 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T18:12:18.055 INFO:teuthology.orchestra.run.smithi038.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T18:12:18.056 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T18:12:18.213 DEBUG:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2024-09-13T18:12:30.798 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-13T18:12:30.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-13T18:12:30.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:12:48.233 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-13T18:12:48.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-13T18:12:48.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:13:05.469 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-13T18:13:14.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-13T18:13:14.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:13:32.861 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-13T18:13:44.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-13T18:13:44.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:13:45.412 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-13T18:13:45.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-13T18:13:45.804 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T18:13:45.804 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-13T18:13:45.819 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-505.el9.x86_64 2024-09-13T18:13:45.819 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T18:13:45.819 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:13:45.820 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T18:13:46.821 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-13T18:13:46.821 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:13:46.900 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2024-09-13T18:13:46.918 DEBUG:teuthology.parallel:result is None 2024-09-13T18:13:48.245 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T18:13:57.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-13T18:13:57.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:14:04.865 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-13T18:14:05.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-13T18:14:05.249 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T18:14:05.250 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-09-13T18:14:05.265 INFO:teuthology.orchestra.run.smithi038.stdout:5.14.0-505.el9.x86_64 2024-09-13T18:14:05.265 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T18:14:05.265 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:14:05.265 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T18:14:06.266 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-13T18:14:06.266 DEBUG:teuthology.orchestra.run.smithi038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:14:06.361 INFO:teuthology.orchestra.run.smithi038.stdout:ttyS1 2024-09-13T18:14:06.388 DEBUG:teuthology.parallel:result is None 2024-09-13T18:14:06.389 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T18:14:06.396 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T18:14:06.397 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:14:06.399 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:14:06.419 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T18:14:06.426 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T18:14:06.435 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T18:14:06.436 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:14:06.458 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:14:06.595 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T18:14:06.601 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T18:14:06.602 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:14:06.604 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:14:06.632 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:14:06.636 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:14:06.643 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:14:06.648 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:14:06.650 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T18:14:06.656 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T18:14:06.657 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:14:06.690 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:14:06.718 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T18:14:06.728 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T18:14:06.728 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:14:06.760 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:14:06.777 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:14:06.867 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:14:06.910 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:14:07.005 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:14:07.042 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:14:07.042 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:14:07.111 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:14:07.165 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:14:07.214 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:14:07.307 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:14:07.341 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:14:07.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:14:07.409 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2024-09-13T18:14:07.411 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-09-13T18:14:07.497 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:14:07.506 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:14:08.010 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T18:14:08.017 INFO:teuthology.task.internal:Starting timer... 2024-09-13T18:14:08.017 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T18:14:08.039 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T18:14:08.048 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-13T18:14:08.048 DEBUG:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2024-09-13T18:14:08.205 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: 2024-09-13T18:14:08.207 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-09-13T18:14:08.283 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-09-13T18:14:08.285 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T18:14:08.285 DEBUG:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2024-09-13T18:14:08.310 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2024-09-13T18:14:08.311 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-09-13T18:14:08.333 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-09-13T18:14:08.334 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi038.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive'} 2024-09-13T18:14:08.334 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:14:08.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:14:08.429 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:14:08.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:14:08.458 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T18:14:08.458 DEBUG:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2024-09-13T18:14:08.750 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-09-13T18:14:08.785 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T18:14:08.794 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T18:14:08.805 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T18:14:08.806 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T18:18:00.233 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2024-09-13T18:18:00.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-13T18:18:00.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:18:00.324 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-09-13T18:18:00.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-09-13T18:18:00.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-13T18:18:00.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:18:00.483 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-13T18:18:00.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-13T18:18:00.566 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T18:18:00.578 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T18:18:00.578 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:18:00.579 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:18:00.582 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:18:00.582 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:18:00.610 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:18:00.625 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:18:00.638 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:18:00.651 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2024-09-13T18:18:00.653 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:18:00.663 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2024-09-13T18:18:00.677 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:18:00.679 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-09-13T18:18:00.690 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-09-13T18:18:00.693 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:18:00.705 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:18:00.719 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:18:00.752 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:18:00.756 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:18:00.756 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-09-13T18:18:00.756 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:18:00.756 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:18:00.757 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:18:00.757 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:18:00.776 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:18:00.779 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:18:00.779 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-13T18:18:00.779 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:18:00.779 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:18:00.779 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:18:00.779 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:18:00.780 INFO:teuthology.run_tasks:Running task install... 2024-09-13T18:18:00.788 DEBUG:teuthology.task.install:project ceph 2024-09-13T18:18:00.788 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:18:00.788 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:18:00.789 INFO:teuthology.task.install:Using flavor: default 2024-09-13T18:18:00.795 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:18:00.795 INFO:teuthology.task.install:extra packages: [] 2024-09-13T18:18:00.796 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:18:00.796 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:18:00.796 INFO:teuthology.packaging:ref: None 2024-09-13T18:18:00.796 INFO:teuthology.packaging:tag: None 2024-09-13T18:18:00.796 INFO:teuthology.packaging:branch: reef 2024-09-13T18:18:00.796 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:18:00.797 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-13T18:18:00.799 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:18:00.799 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:18:00.799 INFO:teuthology.packaging:ref: None 2024-09-13T18:18:00.799 INFO:teuthology.packaging:tag: None 2024-09-13T18:18:00.799 INFO:teuthology.packaging:branch: reef 2024-09-13T18:18:00.799 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:18:00.799 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-13T18:18:01.075 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/ 2024-09-13T18:18:01.076 INFO:teuthology.task.install.rpm:Package version is 18.2.4-845.ge4e227b3 2024-09-13T18:18:01.109 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/ 2024-09-13T18:18:01.109 INFO:teuthology.task.install.rpm:Package version is 18.2.4-845.ge4e227b3 2024-09-13T18:18:01.213 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:18:01.214 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:18:01.214 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:18:01.238 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:18:01.239 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:18:01.239 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:18:01.242 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T18:18:01.242 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:18:01.242 INFO:teuthology.packaging:ref: None 2024-09-13T18:18:01.242 INFO:teuthology.packaging:tag: None 2024-09-13T18:18:01.243 INFO:teuthology.packaging:branch: reef 2024-09-13T18:18:01.243 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:18:01.243 DEBUG:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:18:01.265 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T18:18:01.265 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:18:01.265 INFO:teuthology.packaging:ref: None 2024-09-13T18:18:01.266 INFO:teuthology.packaging:tag: None 2024-09-13T18:18:01.266 INFO:teuthology.packaging:branch: reef 2024-09-13T18:18:01.266 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:18:01.266 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:18:01.312 DEBUG:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:18:01.332 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:18:01.391 DEBUG:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:18:01.409 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:18:01.458 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2024-09-13T18:18:01.459 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum clean all 2024-09-13T18:18:01.473 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-09-13T18:18:01.475 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-09-13T18:18:01.702 INFO:teuthology.orchestra.run.smithi149.stdout:45 files removed 2024-09-13T18:18:01.709 INFO:teuthology.orchestra.run.smithi038.stdout:45 files removed 2024-09-13T18:18:01.729 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw 2024-09-13T18:18:01.736 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw 2024-09-13T18:18:02.297 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 280 kB/s | 77 kB 00:00 2024-09-13T18:18:02.308 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 284 kB/s | 77 kB 00:00 2024-09-13T18:18:02.582 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T18:18:02.592 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T18:18:02.857 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-13T18:18:02.868 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-13T18:18:03.452 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-13T18:18:04.782 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-13T18:18:05.570 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-13T18:18:06.441 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-13T18:18:10.196 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-13T18:18:10.917 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-13T18:18:11.788 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-13T18:18:12.301 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 120 kB/s | 19 kB 00:00 2024-09-13T18:18:12.851 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-13T18:18:13.422 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-13T18:18:18.565 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-13T18:18:18.878 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-13T18:18:21.036 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:18:21.051 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:18:21.051 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-13T18:18:21.051 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:18:21.052 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:18:21.052 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 7.7 M 2024-09-13T18:18:21.052 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2024-09-13T18:18:21.052 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 3.3 M 2024-09-13T18:18:21.052 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 3.0 M 2024-09-13T18:18:21.052 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-13T18:18:21.052 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:18:21.053 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 5.1 M 2024-09-13T18:18:21.053 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 18 M 2024-09-13T18:18:21.053 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 25 k 2024-09-13T18:18:21.053 INFO:teuthology.orchestra.run.smithi038.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:18:21.053 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:18:21.053 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:18:21.054 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:18:21.054 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 712 k 2024-09-13T18:18:21.054 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:18:21.054 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:18:21.054 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:18:21.054 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 478 k 2024-09-13T18:18:21.054 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:18:21.054 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 4.5 M 2024-09-13T18:18:21.054 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:18:21.054 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:18:21.054 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:18:21.054 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 45 k 2024-09-13T18:18:21.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 129 k 2024-09-13T18:18:21.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 162 k 2024-09-13T18:18:21.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:18:21.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 321 k 2024-09-13T18:18:21.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 300 k 2024-09-13T18:18:21.055 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 99 k 2024-09-13T18:18:21.055 INFO:teuthology.orchestra.run.smithi038.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:18:21.055 INFO:teuthology.orchestra.run.smithi038.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:18:21.055 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:21.055 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:18:21.055 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:18:21.056 INFO:teuthology.orchestra.run.smithi038.stdout:Install 28 Packages 2024-09-13T18:18:21.056 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 2 Packages 2024-09-13T18:18:21.056 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:21.056 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 53 M 2024-09-13T18:18:21.056 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:18:21.246 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:18:21.264 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:18:21.264 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-13T18:18:21.264 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:18:21.264 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:18:21.264 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 7.7 M 2024-09-13T18:18:21.264 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-09-13T18:18:21.264 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 3.3 M 2024-09-13T18:18:21.264 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 3.0 M 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 5.1 M 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 18 M 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 25 k 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 712 k 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:18:21.265 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 478 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 4.5 M 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 45 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 129 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 162 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 321 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 300 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 99 k 2024-09-13T18:18:21.266 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:18:21.267 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:18:21.267 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:21.267 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:18:21.267 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:18:21.267 INFO:teuthology.orchestra.run.smithi149.stdout:Install 28 Packages 2024-09-13T18:18:21.267 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 2 Packages 2024-09-13T18:18:21.267 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:21.267 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 53 M 2024-09-13T18:18:21.267 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:18:21.933 INFO:teuthology.orchestra.run.smithi038.stdout:(1/30): ceph-base-18.2.4-845.ge4e227b3.el9.x86_ 12 MB/s | 5.1 MB 00:00 2024-09-13T18:18:21.992 INFO:teuthology.orchestra.run.smithi038.stdout:(2/30): ceph-selinux-18.2.4-845.ge4e227b3.el9.x 433 kB/s | 25 kB 00:00 2024-09-13T18:18:22.084 INFO:teuthology.orchestra.run.smithi038.stdout:(3/30): libcephfs2-18.2.4-845.ge4e227b3.el9.x86 7.6 MB/s | 712 kB 00:00 2024-09-13T18:18:22.184 INFO:teuthology.orchestra.run.smithi038.stdout:(4/30): libradosstriper1-18.2.4-845.ge4e227b3.e 4.7 MB/s | 478 kB 00:00 2024-09-13T18:18:22.434 INFO:teuthology.orchestra.run.smithi038.stdout:(5/30): ceph-radosgw-18.2.4-845.ge4e227b3.el9.x 8.4 MB/s | 7.7 MB 00:00 2024-09-13T18:18:22.629 INFO:teuthology.orchestra.run.smithi038.stdout:(6/30): ceph-common-18.2.4-845.ge4e227b3.el9.x8 16 MB/s | 18 MB 00:01 2024-09-13T18:18:22.651 INFO:teuthology.orchestra.run.smithi038.stdout:(7/30): python3-ceph-argparse-18.2.4-845.ge4e22 207 kB/s | 45 kB 00:00 2024-09-13T18:18:22.677 INFO:teuthology.orchestra.run.smithi038.stdout:(8/30): python3-ceph-common-18.2.4-845.ge4e227b 2.5 MB/s | 129 kB 00:00 2024-09-13T18:18:22.702 INFO:teuthology.orchestra.run.smithi038.stdout:(9/30): python3-cephfs-18.2.4-845.ge4e227b3.el9 3.2 MB/s | 162 kB 00:00 2024-09-13T18:18:22.727 INFO:teuthology.orchestra.run.smithi038.stdout:(10/30): python3-rados-18.2.4-845.ge4e227b3.el9 6.3 MB/s | 321 kB 00:00 2024-09-13T18:18:22.753 INFO:teuthology.orchestra.run.smithi038.stdout:(11/30): python3-rbd-18.2.4-845.ge4e227b3.el9.x 5.8 MB/s | 300 kB 00:00 2024-09-13T18:18:22.828 INFO:teuthology.orchestra.run.smithi038.stdout:(12/30): librgw2-18.2.4-845.ge4e227b3.el9.x86_6 6.9 MB/s | 4.5 MB 00:00 2024-09-13T18:18:22.891 INFO:teuthology.orchestra.run.smithi038.stdout:(13/30): python3-rgw-18.2.4-845.ge4e227b3.el9.x 607 kB/s | 99 kB 00:00 2024-09-13T18:18:22.978 INFO:teuthology.orchestra.run.smithi038.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 474 kB/s | 107 kB 00:00 2024-09-13T18:18:23.004 INFO:teuthology.orchestra.run.smithi038.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 404 kB/s | 45 kB 00:00 2024-09-13T18:18:23.029 INFO:teuthology.orchestra.run.smithi038.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 799 kB/s | 160 kB 00:00 2024-09-13T18:18:23.071 INFO:teuthology.orchestra.run.smithi038.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-13T18:18:23.104 INFO:teuthology.orchestra.run.smithi038.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-13T18:18:23.138 INFO:teuthology.orchestra.run.smithi038.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-13T18:18:23.188 INFO:teuthology.orchestra.run.smithi038.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 946 kB/s | 111 kB 00:00 2024-09-13T18:18:23.213 INFO:teuthology.orchestra.run.smithi038.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-13T18:18:23.256 INFO:teuthology.orchestra.run.smithi038.stdout:(22/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.1 MB/s | 308 kB 00:00 2024-09-13T18:18:23.271 INFO:teuthology.orchestra.run.smithi149.stdout:(1/30): ceph-base-18.2.4-845.ge4e227b3.el9.x86_ 3.4 MB/s | 5.1 MB 00:01 2024-09-13T18:18:23.281 INFO:teuthology.orchestra.run.smithi038.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 725 kB/s | 49 kB 00:00 2024-09-13T18:18:23.306 INFO:teuthology.orchestra.run.smithi038.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T18:18:23.312 INFO:teuthology.orchestra.run.smithi149.stdout:(2/30): ceph-selinux-18.2.4-845.ge4e227b3.el9.x 608 kB/s | 25 kB 00:00 2024-09-13T18:18:23.340 INFO:teuthology.orchestra.run.smithi038.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T18:18:23.373 INFO:teuthology.orchestra.run.smithi038.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-13T18:18:23.465 INFO:teuthology.orchestra.run.smithi038.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-13T18:18:23.471 INFO:teuthology.orchestra.run.smithi149.stdout:(3/30): libcephfs2-18.2.4-845.ge4e227b3.el9.x86 4.4 MB/s | 712 kB 00:00 2024-09-13T18:18:23.574 INFO:teuthology.orchestra.run.smithi038.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-13T18:18:23.597 INFO:teuthology.orchestra.run.smithi149.stdout:(4/30): libradosstriper1-18.2.4-845.ge4e227b3.e 3.7 MB/s | 478 kB 00:00 2024-09-13T18:18:23.696 INFO:teuthology.orchestra.run.smithi038.stdout:(29/30): librados2-18.2.4-845.ge4e227b3.el9.x86 10 MB/s | 3.3 MB 00:00 2024-09-13T18:18:23.766 INFO:teuthology.orchestra.run.smithi038.stdout:(30/30): librbd1-18.2.4-845.ge4e227b3.el9.x86_6 10 MB/s | 3.0 MB 00:00 2024-09-13T18:18:23.772 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:18:23.773 INFO:teuthology.orchestra.run.smithi038.stdout:Total 20 MB/s | 53 MB 00:02 2024-09-13T18:18:23.850 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:18:23.892 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:18:23.892 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:18:24.072 INFO:teuthology.orchestra.run.smithi149.stdout:(5/30): ceph-radosgw-18.2.4-845.ge4e227b3.el9.x 3.3 MB/s | 7.7 MB 00:02 2024-09-13T18:18:24.114 INFO:teuthology.orchestra.run.smithi149.stdout:(6/30): python3-ceph-argparse-18.2.4-845.ge4e22 1.1 MB/s | 45 kB 00:00 2024-09-13T18:18:24.181 INFO:teuthology.orchestra.run.smithi149.stdout:(7/30): python3-ceph-common-18.2.4-845.ge4e227b 1.9 MB/s | 129 kB 00:00 2024-09-13T18:18:24.248 INFO:teuthology.orchestra.run.smithi149.stdout:(8/30): python3-cephfs-18.2.4-845.ge4e227b3.el9 2.4 MB/s | 162 kB 00:00 2024-09-13T18:18:24.339 INFO:teuthology.orchestra.run.smithi149.stdout:(9/30): python3-rados-18.2.4-845.ge4e227b3.el9. 3.4 MB/s | 321 kB 00:00 2024-09-13T18:18:24.440 INFO:teuthology.orchestra.run.smithi149.stdout:(10/30): librgw2-18.2.4-845.ge4e227b3.el9.x86_6 5.3 MB/s | 4.5 MB 00:00 2024-09-13T18:18:24.465 INFO:teuthology.orchestra.run.smithi149.stdout:(11/30): python3-rbd-18.2.4-845.ge4e227b3.el9.x 2.3 MB/s | 300 kB 00:00 2024-09-13T18:18:24.490 INFO:teuthology.orchestra.run.smithi149.stdout:(12/30): python3-rgw-18.2.4-845.ge4e227b3.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-13T18:18:24.570 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:18:24.570 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:18:24.599 INFO:teuthology.orchestra.run.smithi149.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 799 kB/s | 107 kB 00:00 2024-09-13T18:18:24.625 INFO:teuthology.orchestra.run.smithi149.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-13T18:18:24.691 INFO:teuthology.orchestra.run.smithi149.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-09-13T18:18:24.733 INFO:teuthology.orchestra.run.smithi149.stdout:(16/30): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-09-13T18:18:24.792 INFO:teuthology.orchestra.run.smithi149.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2024-09-13T18:18:24.818 INFO:teuthology.orchestra.run.smithi149.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 506 kB/s | 42 kB 00:00 2024-09-13T18:18:24.859 INFO:teuthology.orchestra.run.smithi149.stdout:(19/30): fmt-8.1.1-5.el9.x86_64.rpm 1.6 MB/s | 111 kB 00:00 2024-09-13T18:18:24.910 INFO:teuthology.orchestra.run.smithi149.stdout:(20/30): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.3 MB/s | 308 kB 00:00 2024-09-13T18:18:24.935 INFO:teuthology.orchestra.run.smithi149.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T18:18:24.960 INFO:teuthology.orchestra.run.smithi149.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T18:18:24.985 INFO:teuthology.orchestra.run.smithi149.stdout:(23/30): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-13T18:18:25.061 INFO:teuthology.orchestra.run.smithi149.stdout:(24/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-13T18:18:25.094 INFO:teuthology.orchestra.run.smithi149.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T18:18:25.153 INFO:teuthology.orchestra.run.smithi149.stdout:(26/30): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-13T18:18:25.212 INFO:teuthology.orchestra.run.smithi149.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-13T18:18:25.705 INFO:teuthology.orchestra.run.smithi149.stdout:(28/30): librados2-18.2.4-845.ge4e227b3.el9.x86 6.0 MB/s | 3.3 MB 00:00 2024-09-13T18:18:25.820 INFO:teuthology.orchestra.run.smithi149.stdout:(29/30): librbd1-18.2.4-845.ge4e227b3.el9.x86_6 5.0 MB/s | 3.0 MB 00:00 2024-09-13T18:18:25.973 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:18:26.051 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-13T18:18:26.088 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-13T18:18:26.154 INFO:teuthology.orchestra.run.smithi149.stdout:(30/30): ceph-common-18.2.4-845.ge4e227b3.el9.x 4.2 MB/s | 18 MB 00:04 2024-09-13T18:18:26.155 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-13T18:18:26.160 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:18:26.160 INFO:teuthology.orchestra.run.smithi149.stdout:Total 11 MB/s | 53 MB 00:04 2024-09-13T18:18:26.235 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:18:26.273 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:18:26.274 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:18:26.559 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-13T18:18:26.620 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 5/32 2024-09-13T18:18:26.713 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 5/32 2024-09-13T18:18:26.816 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 6/32 2024-09-13T18:18:26.847 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 7/32 2024-09-13T18:18:26.894 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:18:26.894 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:18:26.910 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 7/32 2024-09-13T18:18:26.947 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-13T18:18:26.991 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:18.2.4-845.ge4e227b3.el9.x 9/32 2024-09-13T18:18:27.067 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 10/32 2024-09-13T18:18:27.091 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 11/32 2024-09-13T18:18:27.141 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 11/32 2024-09-13T18:18:27.249 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-13T18:18:27.282 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-13T18:18:27.333 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-13T18:18:27.363 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-13T18:18:27.390 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-13T18:18:27.427 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-13T18:18:27.468 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-13T18:18:27.791 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-13T18:18:27.838 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 20/32 2024-09-13T18:18:27.930 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 20/32 2024-09-13T18:18:27.960 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 21/32 2024-09-13T18:18:27.997 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-13T18:18:28.266 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:18:28.371 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-13T18:18:28.401 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-13T18:18:28.423 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-13T18:18:28.449 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 24/32 2024-09-13T18:18:28.459 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-13T18:18:28.521 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 24/32 2024-09-13T18:18:28.600 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 25/32 2024-09-13T18:18:28.635 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:18.2.4-845.ge4e227b3.el9.x86 26/32 2024-09-13T18:18:28.844 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-13T18:18:28.900 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 5/32 2024-09-13T18:18:28.975 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 5/32 2024-09-13T18:18:29.068 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 6/32 2024-09-13T18:18:29.093 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 7/32 2024-09-13T18:18:29.156 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 7/32 2024-09-13T18:18:29.193 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-13T18:18:29.236 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:18.2.4-845.ge4e227b3.el9.x 9/32 2024-09-13T18:18:29.302 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 10/32 2024-09-13T18:18:29.328 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 11/32 2024-09-13T18:18:29.394 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 11/32 2024-09-13T18:18:29.501 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-13T18:18:29.536 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-13T18:18:29.593 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-13T18:18:29.626 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/32 2024-09-13T18:18:29.653 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-13T18:18:29.697 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-13T18:18:29.731 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-13T18:18:30.030 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-13T18:18:30.068 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 20/32 2024-09-13T18:18:30.158 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 20/32 2024-09-13T18:18:30.190 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 21/32 2024-09-13T18:18:30.225 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-13T18:18:30.623 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-13T18:18:30.653 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 24/32 2024-09-13T18:18:30.725 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 24/32 2024-09-13T18:18:30.795 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 25/32 2024-09-13T18:18:30.822 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:18.2.4-845.ge4e227b3.el9.x86 26/32 2024-09-13T18:18:31.036 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 27/32 2024-09-13T18:18:31.073 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 27/32 2024-09-13T18:18:31.638 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 27/32 2024-09-13T18:18:31.677 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 28/32 2024-09-13T18:18:31.772 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 28/32 2024-09-13T18:18:31.772 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:18:31.772 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:18:31.772 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:31.820 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 29/32 2024-09-13T18:18:33.150 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 27/32 2024-09-13T18:18:33.195 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 27/32 2024-09-13T18:18:33.733 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 27/32 2024-09-13T18:18:33.781 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 28/32 2024-09-13T18:18:33.869 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 28/32 2024-09-13T18:18:33.870 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:18:33.870 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:18:33.870 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:33.908 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 29/32 2024-09-13T18:18:42.380 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 29/32 2024-09-13T18:18:42.381 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2024-09-13T18:18:42.381 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2024-09-13T18:18:42.381 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2024-09-13T18:18:42.381 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2024-09-13T18:18:42.381 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2024-09-13T18:18:42.381 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /root 2024-09-13T18:18:42.381 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2024-09-13T18:18:42.381 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:43.195 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 30/32 2024-09-13T18:18:43.223 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 30/32 2024-09-13T18:18:43.223 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:18:43.223 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:18:43.223 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:18:43.223 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:18:43.223 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:43.225 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T18:18:43.314 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T18:18:43.314 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T18:18:43.788 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 29/32 2024-09-13T18:18:43.788 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-09-13T18:18:43.788 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-09-13T18:18:43.788 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-09-13T18:18:43.788 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-09-13T18:18:43.788 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-09-13T18:18:43.788 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-09-13T18:18:43.788 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-09-13T18:18:43.788 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:44.420 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T18:18:44.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 1/32 2024-09-13T18:18:44.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 2/32 2024-09-13T18:18:44.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 3/32 2024-09-13T18:18:44.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 4/32 2024-09-13T18:18:44.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 5/32 2024-09-13T18:18:44.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 6/32 2024-09-13T18:18:44.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 7/32 2024-09-13T18:18:44.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:18.2.4-845.ge4e227b3.el9.x 8/32 2024-09-13T18:18:44.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:18.2.4-845.ge4e227b3.el9.x86 9/32 2024-09-13T18:18:44.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 10/32 2024-09-13T18:18:44.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 11/32 2024-09-13T18:18:44.421 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 12/32 2024-09-13T18:18:44.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 13/32 2024-09-13T18:18:44.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-13T18:18:44.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-13T18:18:44.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-13T18:18:44.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-13T18:18:44.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-13T18:18:44.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-13T18:18:44.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-13T18:18:44.422 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-13T18:18:44.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-13T18:18:44.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-13T18:18:44.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-13T18:18:44.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-13T18:18:44.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-13T18:18:44.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-13T18:18:44.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-13T18:18:44.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 29/32 2024-09-13T18:18:44.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-13T18:18:44.423 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 31/32 2024-09-13T18:18:44.551 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 30/32 2024-09-13T18:18:44.576 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 30/32 2024-09-13T18:18:44.576 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:18:44.576 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:18:44.577 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:18:44.577 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:18:44.577 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:44.578 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T18:18:44.644 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-13T18:18:44.645 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T18:18:45.396 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T18:18:45.396 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:45.397 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2024-09-13T18:18:45.397 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.397 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.397 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:18:45.397 INFO:teuthology.orchestra.run.smithi038.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:18:45.397 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.397 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.398 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.398 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.398 INFO:teuthology.orchestra.run.smithi038.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:18:45.398 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:18:45.398 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:18:45.398 INFO:teuthology.orchestra.run.smithi038.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:18:45.398 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.399 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:18:45.399 INFO:teuthology.orchestra.run.smithi038.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:18:45.399 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:18:45.399 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.399 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:18:45.399 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.400 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:18:45.400 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:18:45.400 INFO:teuthology.orchestra.run.smithi038.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:18:45.400 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.400 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.400 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.400 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:18:45.401 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.401 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.401 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:45.401 INFO:teuthology.orchestra.run.smithi038.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:18:45.401 INFO:teuthology.orchestra.run.smithi038.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:18:45.401 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:45.401 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:18:45.735 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-test 2024-09-13T18:18:45.809 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T18:18:45.810 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 1/32 2024-09-13T18:18:45.810 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 2/32 2024-09-13T18:18:45.810 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 3/32 2024-09-13T18:18:45.810 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 4/32 2024-09-13T18:18:45.810 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 5/32 2024-09-13T18:18:45.810 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 6/32 2024-09-13T18:18:45.810 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 7/32 2024-09-13T18:18:45.810 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:18.2.4-845.ge4e227b3.el9.x 8/32 2024-09-13T18:18:45.810 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:18.2.4-845.ge4e227b3.el9.x86 9/32 2024-09-13T18:18:45.811 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 10/32 2024-09-13T18:18:45.811 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 11/32 2024-09-13T18:18:45.811 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 12/32 2024-09-13T18:18:45.811 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 13/32 2024-09-13T18:18:45.811 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-13T18:18:45.811 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-13T18:18:45.811 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-13T18:18:45.811 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 21/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 29/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-13T18:18:45.812 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 31/32 2024-09-13T18:18:46.325 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:28 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:18:46.463 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:18:46.464 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:18:46.464 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-13T18:18:46.464 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:18:46.464 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:18:46.464 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 40 M 2024-09-13T18:18:46.464 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-13T18:18:46.464 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 166 k 2024-09-13T18:18:46.464 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:18:46.464 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:18:46.464 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:46.464 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:18:46.465 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:18:46.465 INFO:teuthology.orchestra.run.smithi038.stdout:Install 4 Packages 2024-09-13T18:18:46.465 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:46.465 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 40 M 2024-09-13T18:18:46.466 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 164 M 2024-09-13T18:18:46.466 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:18:46.796 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-13T18:18:46.796 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:46.796 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-09-13T18:18:46.796 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.797 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.797 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:18:46.797 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:18:46.797 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.797 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.797 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.797 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.797 INFO:teuthology.orchestra.run.smithi149.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:18:46.797 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:18:46.797 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:18:46.797 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:18:46.797 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.798 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:18:46.799 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.799 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.799 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:46.799 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:18:46.799 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:18:46.799 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:46.799 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:18:46.937 INFO:teuthology.orchestra.run.smithi038.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-13T18:18:46.970 INFO:teuthology.orchestra.run.smithi038.stdout:(2/4): libcephsqlite-18.2.4-845.ge4e227b3.el9.x 736 kB/s | 166 kB 00:00 2024-09-13T18:18:46.995 INFO:teuthology.orchestra.run.smithi038.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-13T18:18:47.155 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-test 2024-09-13T18:18:47.733 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:29 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:18:47.875 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:18:47.875 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:18:47.875 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-13T18:18:47.875 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:18:47.876 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:18:47.876 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 40 M 2024-09-13T18:18:47.876 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-13T18:18:47.876 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 166 k 2024-09-13T18:18:47.876 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:18:47.876 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:18:47.876 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:47.876 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:18:47.876 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:18:47.876 INFO:teuthology.orchestra.run.smithi149.stdout:Install 4 Packages 2024-09-13T18:18:47.876 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:47.877 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 40 M 2024-09-13T18:18:47.877 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 164 M 2024-09-13T18:18:47.877 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:18:48.236 INFO:teuthology.orchestra.run.smithi149.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-13T18:18:48.270 INFO:teuthology.orchestra.run.smithi149.stdout:(2/4): libcephsqlite-18.2.4-845.ge4e227b3.el9.x 632 kB/s | 166 kB 00:00 2024-09-13T18:18:48.303 INFO:teuthology.orchestra.run.smithi149.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-09-13T18:18:48.629 INFO:teuthology.orchestra.run.smithi038.stdout:(4/4): ceph-test-18.2.4-845.ge4e227b3.el9.x86_6 21 MB/s | 40 MB 00:01 2024-09-13T18:18:48.631 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:18:48.631 INFO:teuthology.orchestra.run.smithi038.stdout:Total 19 MB/s | 40 MB 00:02 2024-09-13T18:18:48.661 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:18:48.682 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:18:48.683 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:18:49.027 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:18:49.027 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:18:49.533 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:18:49.623 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T18:18:49.673 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T18:18:49.697 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 3/4 2024-09-13T18:18:50.128 INFO:teuthology.orchestra.run.smithi149.stdout:(4/4): ceph-test-18.2.4-845.ge4e227b3.el9.x86_6 19 MB/s | 40 MB 00:02 2024-09-13T18:18:50.130 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:18:50.131 INFO:teuthology.orchestra.run.smithi149.stdout:Total 18 MB/s | 40 MB 00:02 2024-09-13T18:18:50.159 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:18:50.178 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:18:50.507 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:18:50.507 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:18:50.985 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:18:51.081 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T18:18:51.120 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T18:18:51.147 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 3/4 2024-09-13T18:18:53.623 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 3/4 2024-09-13T18:18:53.707 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 4/4 2024-09-13T18:18:54.850 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 3/4 2024-09-13T18:18:54.928 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 4/4 2024-09-13T18:18:55.770 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 4/4 2024-09-13T18:18:55.771 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 1/4 2024-09-13T18:18:55.771 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 2/4 2024-09-13T18:18:55.771 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T18:18:56.110 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T18:18:56.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:56.110 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:18:56.110 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:56.110 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:56.110 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:18:56.110 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:18:56.110 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:56.110 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:18:56.422 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph 2024-09-13T18:18:56.926 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 4/4 2024-09-13T18:18:56.926 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 1/4 2024-09-13T18:18:56.926 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 2/4 2024-09-13T18:18:56.926 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T18:18:57.007 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:39 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:18:57.149 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:18:57.152 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:18:57.152 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-13T18:18:57.152 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:18:57.152 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:18:57.152 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 6.5 k 2024-09-13T18:18:57.152 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-13T18:18:57.152 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 2.1 M 2024-09-13T18:18:57.152 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 1.5 M 2024-09-13T18:18:57.152 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 246 k 2024-09-13T18:18:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 4.7 M 2024-09-13T18:18:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 17 M 2024-09-13T18:18:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:18:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:18:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:18:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:18:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:18:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:18:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:18:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:18:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:18:57.153 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:18:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:18:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:18:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:18:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:18:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:18:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:18:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:18:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:18:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:18:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:18:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:18:57.154 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:18:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:18:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:18:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:18:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:18:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:18:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:18:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:18:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:Install 33 Packages 2024-09-13T18:18:57.155 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:18:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 29 M 2024-09-13T18:18:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 104 M 2024-09-13T18:18:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:18:57.260 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T18:18:57.260 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:57.260 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:18:57.260 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:57.260 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:18:57.260 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:18:57.260 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:18:57.260 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:57.260 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:18:57.434 INFO:teuthology.orchestra.run.smithi038.stdout:(1/33): ceph-18.2.4-845.ge4e227b3.el9.x86_64.rp 50 kB/s | 6.5 kB 00:00 2024-09-13T18:18:57.582 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph 2024-09-13T18:18:57.642 INFO:teuthology.orchestra.run.smithi038.stdout:(2/33): ceph-mds-18.2.4-845.ge4e227b3.el9.x86_6 6.2 MB/s | 2.1 MB 00:00 2024-09-13T18:18:57.684 INFO:teuthology.orchestra.run.smithi038.stdout:(3/33): ceph-mgr-18.2.4-845.ge4e227b3.el9.x86_6 3.8 MB/s | 1.5 MB 00:00 2024-09-13T18:18:57.768 INFO:teuthology.orchestra.run.smithi038.stdout:(4/33): ceph-mgr-modules-core-18.2.4-845.ge4e22 2.9 MB/s | 246 kB 00:00 2024-09-13T18:18:57.910 INFO:teuthology.orchestra.run.smithi038.stdout:(5/33): ceph-mon-18.2.4-845.ge4e227b3.el9.x86_6 9.8 MB/s | 4.7 MB 00:00 2024-09-13T18:18:58.018 INFO:teuthology.orchestra.run.smithi038.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-13T18:18:58.163 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:40 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:18:58.202 INFO:teuthology.orchestra.run.smithi038.stdout:(7/33): ceph-osd-18.2.4-845.ge4e227b3.el9.x86_6 30 MB/s | 17 MB 00:00 2024-09-13T18:18:58.227 INFO:teuthology.orchestra.run.smithi038.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 511 kB/s | 106 kB 00:00 2024-09-13T18:18:58.281 INFO:teuthology.orchestra.run.smithi038.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-13T18:18:58.301 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:18:58.304 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:18:58.304 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-13T18:18:58.304 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:18:58.304 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:18:58.304 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 6.5 k 2024-09-13T18:18:58.304 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-13T18:18:58.304 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 2.1 M 2024-09-13T18:18:58.304 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 1.5 M 2024-09-13T18:18:58.304 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 246 k 2024-09-13T18:18:58.304 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 4.7 M 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 17 M 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:18:58.305 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:18:58.306 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:18:58.307 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:58.307 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:18:58.307 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:18:58.307 INFO:teuthology.orchestra.run.smithi149.stdout:Install 33 Packages 2024-09-13T18:18:58.307 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:18:58.307 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 29 M 2024-09-13T18:18:58.307 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 104 M 2024-09-13T18:18:58.307 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:18:58.361 INFO:teuthology.orchestra.run.smithi038.stdout:(10/33): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-13T18:18:58.386 INFO:teuthology.orchestra.run.smithi038.stdout:(11/33): python3-pycparser-2.20-6.el9.noarch.rp 734 kB/s | 135 kB 00:00 2024-09-13T18:18:58.428 INFO:teuthology.orchestra.run.smithi038.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 2.4 MB/s | 1.2 MB 00:00 2024-09-13T18:18:58.470 INFO:teuthology.orchestra.run.smithi038.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 416 kB/s | 35 kB 00:00 2024-09-13T18:18:58.496 INFO:teuthology.orchestra.run.smithi038.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2024-09-13T18:18:58.521 INFO:teuthology.orchestra.run.smithi038.stdout:(15/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-13T18:18:58.546 INFO:teuthology.orchestra.run.smithi038.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-09-13T18:18:58.596 INFO:teuthology.orchestra.run.smithi038.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 432 kB/s | 43 kB 00:00 2024-09-13T18:18:58.622 INFO:teuthology.orchestra.run.smithi038.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 463 kB/s | 11 kB 00:00 2024-09-13T18:18:58.647 INFO:teuthology.orchestra.run.smithi038.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 710 kB/s | 18 kB 00:00 2024-09-13T18:18:58.672 INFO:teuthology.orchestra.run.smithi038.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-13T18:18:58.697 INFO:teuthology.orchestra.run.smithi038.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-13T18:18:58.723 INFO:teuthology.orchestra.run.smithi038.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-13T18:18:58.748 INFO:teuthology.orchestra.run.smithi038.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 389 kB/s | 20 kB 00:00 2024-09-13T18:18:58.773 INFO:teuthology.orchestra.run.smithi038.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 919 kB/s | 46 kB 00:00 2024-09-13T18:18:58.799 INFO:teuthology.orchestra.run.smithi038.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T18:18:58.833 INFO:teuthology.orchestra.run.smithi038.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-13T18:18:58.858 INFO:teuthology.orchestra.run.smithi038.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 281 kB/s | 16 kB 00:00 2024-09-13T18:18:58.883 INFO:teuthology.orchestra.run.smithi038.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-13T18:18:58.908 INFO:teuthology.orchestra.run.smithi038.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-13T18:18:58.934 INFO:teuthology.orchestra.run.smithi038.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-13T18:18:58.950 INFO:teuthology.orchestra.run.smithi149.stdout:(1/33): ceph-18.2.4-845.ge4e227b3.el9.x86_64.rp 47 kB/s | 6.5 kB 00:00 2024-09-13T18:18:58.959 INFO:teuthology.orchestra.run.smithi038.stdout:(31/33): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T18:18:58.984 INFO:teuthology.orchestra.run.smithi038.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 397 kB/s | 20 kB 00:00 2024-09-13T18:18:59.009 INFO:teuthology.orchestra.run.smithi038.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-13T18:18:59.014 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:18:59.014 INFO:teuthology.orchestra.run.smithi038.stdout:Total 16 MB/s | 29 MB 00:01 2024-09-13T18:18:59.092 INFO:teuthology.orchestra.run.smithi149.stdout:(2/33): ceph-mgr-18.2.4-845.ge4e227b3.el9.x86_6 5.2 MB/s | 1.5 MB 00:00 2024-09-13T18:18:59.141 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:18:59.142 INFO:teuthology.orchestra.run.smithi149.stdout:(3/33): ceph-mds-18.2.4-845.ge4e227b3.el9.x86_6 6.4 MB/s | 2.1 MB 00:00 2024-09-13T18:18:59.182 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:18:59.183 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:18:59.226 INFO:teuthology.orchestra.run.smithi149.stdout:(4/33): ceph-mgr-modules-core-18.2.4-845.ge4e22 2.9 MB/s | 246 kB 00:00 2024-09-13T18:18:59.343 INFO:teuthology.orchestra.run.smithi149.stdout:(5/33): ceph-mon-18.2.4-845.ge4e227b3.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-13T18:18:59.485 INFO:teuthology.orchestra.run.smithi149.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 980 kB/s | 253 kB 00:00 2024-09-13T18:18:59.616 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:18:59.616 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:18:59.677 INFO:teuthology.orchestra.run.smithi149.stdout:(7/33): ceph-osd-18.2.4-845.ge4e227b3.el9.x86_6 28 MB/s | 17 MB 00:00 2024-09-13T18:18:59.702 INFO:teuthology.orchestra.run.smithi149.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 491 kB/s | 106 kB 00:00 2024-09-13T18:18:59.753 INFO:teuthology.orchestra.run.smithi149.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-13T18:18:59.811 INFO:teuthology.orchestra.run.smithi149.stdout:(10/33): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-13T18:18:59.845 INFO:teuthology.orchestra.run.smithi149.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 2.4 MB/s | 1.2 MB 00:00 2024-09-13T18:18:59.870 INFO:teuthology.orchestra.run.smithi149.stdout:(12/33): python3-pycparser-2.20-6.el9.noarch.rp 702 kB/s | 135 kB 00:00 2024-09-13T18:18:59.920 INFO:teuthology.orchestra.run.smithi149.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 461 kB/s | 35 kB 00:00 2024-09-13T18:18:59.954 INFO:teuthology.orchestra.run.smithi149.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 610 kB/s | 51 kB 00:00 2024-09-13T18:18:59.979 INFO:teuthology.orchestra.run.smithi149.stdout:(15/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-13T18:19:00.004 INFO:teuthology.orchestra.run.smithi149.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 497 kB/s | 42 kB 00:00 2024-09-13T18:19:00.055 INFO:teuthology.orchestra.run.smithi149.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-09-13T18:19:00.080 INFO:teuthology.orchestra.run.smithi149.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 460 kB/s | 11 kB 00:00 2024-09-13T18:19:00.105 INFO:teuthology.orchestra.run.smithi149.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 706 kB/s | 18 kB 00:00 2024-09-13T18:19:00.130 INFO:teuthology.orchestra.run.smithi149.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-13T18:19:00.156 INFO:teuthology.orchestra.run.smithi149.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-13T18:19:00.181 INFO:teuthology.orchestra.run.smithi149.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-13T18:19:00.216 INFO:teuthology.orchestra.run.smithi149.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 335 kB/s | 20 kB 00:00 2024-09-13T18:19:00.240 INFO:teuthology.orchestra.run.smithi149.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 786 kB/s | 46 kB 00:00 2024-09-13T18:19:00.265 INFO:teuthology.orchestra.run.smithi149.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T18:19:00.291 INFO:teuthology.orchestra.run.smithi149.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-13T18:19:00.316 INFO:teuthology.orchestra.run.smithi149.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-13T18:19:00.333 INFO:teuthology.orchestra.run.smithi149.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-13T18:19:00.350 INFO:teuthology.orchestra.run.smithi149.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2024-09-13T18:19:00.375 INFO:teuthology.orchestra.run.smithi149.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-13T18:19:00.392 INFO:teuthology.orchestra.run.smithi149.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-13T18:19:00.417 INFO:teuthology.orchestra.run.smithi149.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-13T18:19:00.451 INFO:teuthology.orchestra.run.smithi149.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-13T18:19:00.455 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:00.455 INFO:teuthology.orchestra.run.smithi149.stdout:Total 14 MB/s | 29 MB 00:02 2024-09-13T18:19:00.570 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:19:00.608 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:19:00.608 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:19:00.857 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:19:00.921 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-13T18:19:00.954 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-13T18:19:00.995 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-13T18:19:01.014 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:19:01.014 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:19:01.100 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-13T18:19:01.184 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-13T18:19:01.231 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-13T18:19:01.274 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-13T18:19:01.313 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-13T18:19:01.357 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-13T18:19:01.397 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-13T18:19:01.438 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-13T18:19:01.481 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-13T18:19:01.524 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-13T18:19:01.570 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-13T18:19:01.679 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-13T18:19:01.834 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-13T18:19:01.915 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-13T18:19:01.967 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-13T18:19:02.006 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-13T18:19:02.073 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-13T18:19:02.137 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-13T18:19:02.231 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:19:02.279 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-13T18:19:02.311 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-13T18:19:02.340 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-13T18:19:02.343 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-13T18:19:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-13T18:19:02.435 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-13T18:19:02.475 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-13T18:19:02.522 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-13T18:19:02.564 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-13T18:19:02.564 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-13T18:19:02.598 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-13T18:19:02.609 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-13T18:19:02.628 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-13T18:19:02.662 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-13T18:19:02.696 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-13T18:19:02.736 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-13T18:19:02.739 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-13T18:19:02.771 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-13T18:19:02.806 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-13T18:19:02.844 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-13T18:19:02.908 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-845.ge4e227b3.el9.n 28/33 2024-09-13T18:19:02.917 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-13T18:19:02.936 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 29/33 2024-09-13T18:19:02.963 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 29/33 2024-09-13T18:19:02.964 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:19:02.964 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:19:02.964 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:19:02.964 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:19:02.964 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-13T18:19:03.149 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-13T18:19:03.200 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-13T18:19:03.238 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-13T18:19:03.287 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-13T18:19:03.343 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-13T18:19:03.528 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-13T18:19:03.584 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-13T18:19:03.662 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-13T18:19:03.750 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-13T18:19:03.791 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-13T18:19:03.907 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-13T18:19:04.067 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-845.ge4e227b3.el9.n 28/33 2024-09-13T18:19:04.093 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 29/33 2024-09-13T18:19:04.118 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 29/33 2024-09-13T18:19:04.118 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:19:04.118 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:19:04.119 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:19:04.119 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:19:04.119 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:04.461 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 30/33 2024-09-13T18:19:04.490 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 30/33 2024-09-13T18:19:04.490 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:19:04.490 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:19:04.490 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:19:04.490 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:19:04.490 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:04.971 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 31/33 2024-09-13T18:19:04.996 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 31/33 2024-09-13T18:19:04.996 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:19:04.996 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:19:04.996 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:19:04.996 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:19:04.996 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:05.205 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 32/33 2024-09-13T18:19:05.230 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 32/33 2024-09-13T18:19:05.230 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:19:05.230 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:19:05.230 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:19:05.230 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:19:05.230 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:05.295 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 33/33 2024-09-13T18:19:05.595 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 30/33 2024-09-13T18:19:05.630 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 30/33 2024-09-13T18:19:05.631 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:19:05.631 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:19:05.631 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:19:05.631 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:19:05.631 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:06.087 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 31/33 2024-09-13T18:19:06.112 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 31/33 2024-09-13T18:19:06.112 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:19:06.112 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:19:06.112 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:19:06.112 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:19:06.112 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:06.313 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 32/33 2024-09-13T18:19:06.337 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 32/33 2024-09-13T18:19:06.337 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:19:06.337 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:19:06.337 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:19:06.337 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:19:06.337 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 33/33 2024-09-13T18:19:07.078 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 33/33 2024-09-13T18:19:07.078 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 1/33 2024-09-13T18:19:07.078 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 2/33 2024-09-13T18:19:07.078 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 3/33 2024-09-13T18:19:07.078 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 4/33 2024-09-13T18:19:07.078 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 5/33 2024-09-13T18:19:07.078 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-845.ge4e227b3.el9.n 6/33 2024-09-13T18:19:07.078 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-13T18:19:07.078 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-13T18:19:07.078 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-13T18:19:07.078 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-13T18:19:07.079 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-13T18:19:07.080 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-13T18:19:07.080 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-13T18:19:07.081 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-13T18:19:07.081 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-13T18:19:07.081 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-13T18:19:07.081 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-13T18:19:07.081 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-13T18:19:07.081 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-13T18:19:07.081 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-13T18:19:08.123 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-13T18:19:08.123 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:08.124 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:19:08.124 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:08.124 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:08.124 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:08.124 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:08.124 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:08.124 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:08.124 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:19:08.124 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:19:08.124 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:19:08.124 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:19:08.124 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:19:08.125 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:19:08.126 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:19:08.126 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:19:08.126 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:19:08.126 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:19:08.126 INFO:teuthology.orchestra.run.smithi038.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:19:08.126 INFO:teuthology.orchestra.run.smithi038.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:19:08.126 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:19:08.126 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:19:08.126 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:19:08.127 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:08.127 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:08.130 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 33/33 2024-09-13T18:19:08.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 1/33 2024-09-13T18:19:08.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 2/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 3/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 4/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 5/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-845.ge4e227b3.el9.n 6/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-13T18:19:08.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-13T18:19:08.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-13T18:19:08.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-13T18:19:08.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-13T18:19:08.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-13T18:19:08.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-13T18:19:08.487 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-base 2024-09-13T18:19:09.074 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-13T18:19:09.074 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:09.074 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:19:09.074 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:09.074 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:09.074 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:09.074 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:19:09.075 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:19:09.076 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:19:09.077 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:19:09.077 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:19:09.077 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:09.077 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:09.079 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:09.172 INFO:teuthology.orchestra.run.smithi038.stdout:Package ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:09.216 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:09.217 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-13T18:19:09.217 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:09.286 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install cephadm 2024-09-13T18:19:09.469 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-base 2024-09-13T18:19:09.877 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:10.014 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:10.015 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:10.015 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-13T18:19:10.015 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:10.015 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:19:10.015 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 226 k 2024-09-13T18:19:10.015 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:10.015 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:19:10.015 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:10.015 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-13T18:19:10.016 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:10.016 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 226 k 2024-09-13T18:19:10.016 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 217 k 2024-09-13T18:19:10.016 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:19:10.054 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:52 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:10.146 INFO:teuthology.orchestra.run.smithi149.stdout:Package ceph-base-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:10.188 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:10.189 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-13T18:19:10.189 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:10.262 INFO:teuthology.orchestra.run.smithi038.stdout:cephadm-18.2.4-845.ge4e227b3.el9.noarch.rpm 920 kB/s | 226 kB 00:00 2024-09-13T18:19:10.262 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:10.263 INFO:teuthology.orchestra.run.smithi038.stdout:Total 914 kB/s | 226 kB 00:00 2024-09-13T18:19:10.263 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:19:10.265 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install cephadm 2024-09-13T18:19:10.268 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:19:10.268 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:19:10.271 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:19:10.272 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:19:10.344 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:19:10.819 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T18:19:10.837 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:52 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:10.910 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T18:19:10.969 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:10.973 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-13T18:19:10.973 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:10.973 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:19:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 226 k 2024-09-13T18:19:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:10.973 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:19:10.973 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:10.973 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-13T18:19:10.973 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:10.974 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 226 k 2024-09-13T18:19:10.974 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 217 k 2024-09-13T18:19:10.974 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:19:11.188 INFO:teuthology.orchestra.run.smithi149.stdout:cephadm-18.2.4-845.ge4e227b3.el9.noarch.rpm 1.0 MB/s | 226 kB 00:00 2024-09-13T18:19:11.188 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:11.188 INFO:teuthology.orchestra.run.smithi149.stdout:Total 1.0 MB/s | 226 kB 00:00 2024-09-13T18:19:11.188 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:19:11.194 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:19:11.194 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:19:11.196 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:19:11.197 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:19:11.244 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T18:19:11.267 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:19:11.590 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T18:19:11.590 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:11.590 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:19:11.590 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:11.590 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:11.591 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:11.728 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T18:19:11.810 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T18:19:11.816 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T18:19:12.165 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T18:19:12.409 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/1 2024-09-13T18:19:12.409 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:12.409 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:19:12.409 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:12.409 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:12.409 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:12.415 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:12.553 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:12.554 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:12.554 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-09-13T18:19:12.554 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:12.554 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:19:12.554 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 143 k 2024-09-13T18:19:12.554 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:12.554 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:19:12.554 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:12.554 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-13T18:19:12.554 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:12.555 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 143 k 2024-09-13T18:19:12.555 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 395 k 2024-09-13T18:19:12.555 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:19:12.645 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T18:19:12.751 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-immutable-object-cache-18.2.4-845.ge4e227b 727 kB/s | 143 kB 00:00 2024-09-13T18:19:12.752 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:12.752 INFO:teuthology.orchestra.run.smithi038.stdout:Total 721 kB/s | 143 kB 00:00 2024-09-13T18:19:12.752 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:19:12.760 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:19:12.760 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:19:12.821 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:19:12.822 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:19:12.977 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:19:13.044 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.e 1/1 2024-09-13T18:19:13.071 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.e 1/1 2024-09-13T18:19:13.071 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:19:13.071 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:19:13.071 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:13.226 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:55 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:13.364 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:13.365 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:13.365 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-09-13T18:19:13.365 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:13.365 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:19:13.365 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 143 k 2024-09-13T18:19:13.365 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:13.365 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:19:13.365 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:13.365 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-13T18:19:13.365 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:13.365 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 143 k 2024-09-13T18:19:13.365 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 395 k 2024-09-13T18:19:13.366 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:19:13.588 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-immutable-object-cache-18.2.4-845.ge4e227b 643 kB/s | 143 kB 00:00 2024-09-13T18:19:13.588 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:13.588 INFO:teuthology.orchestra.run.smithi149.stdout:Total 639 kB/s | 143 kB 00:00 2024-09-13T18:19:13.588 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:19:13.596 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:19:13.596 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:19:13.653 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:19:13.654 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:19:13.802 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:19:13.872 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.e 1/1 2024-09-13T18:19:13.897 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.e 1/1 2024-09-13T18:19:13.897 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:19:13.897 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:19:13.897 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:14.036 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.e 1/1 2024-09-13T18:19:14.036 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:14.036 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:19:14.036 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:14.036 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:14.037 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:14.257 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr 2024-09-13T18:19:14.844 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:56 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:14.887 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.e 1/1 2024-09-13T18:19:14.888 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:14.888 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:19:14.888 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:14.888 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:14.888 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:14.938 INFO:teuthology.orchestra.run.smithi038.stdout:Package ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:14.982 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:14.983 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-13T18:19:14.983 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:15.044 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T18:19:15.108 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr 2024-09-13T18:19:15.627 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:57 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:15.701 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:57 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:15.767 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:15.767 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:15.767 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 3.5 M 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 24 k 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 16 k 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout:Install 5 Packages 2024-09-13T18:19:15.768 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:15.769 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 3.8 M 2024-09-13T18:19:15.769 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 87 M 2024-09-13T18:19:15.769 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:19:15.802 INFO:teuthology.orchestra.run.smithi149.stdout:Package ceph-mgr-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:15.847 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:15.848 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-13T18:19:15.848 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:15.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T18:19:15.971 INFO:teuthology.orchestra.run.smithi038.stdout:(1/5): ceph-grafana-dashboards-18.2.4-845.ge4e2 167 kB/s | 24 kB 00:00 2024-09-13T18:19:15.997 INFO:teuthology.orchestra.run.smithi038.stdout:(2/5): ceph-prometheus-alerts-18.2.4-845.ge4e22 96 kB/s | 16 kB 00:00 2024-09-13T18:19:16.039 INFO:teuthology.orchestra.run.smithi038.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 459 kB/s | 31 kB 00:00 2024-09-13T18:19:16.072 INFO:teuthology.orchestra.run.smithi038.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-09-13T18:19:16.231 INFO:teuthology.orchestra.run.smithi038.stdout:(5/5): ceph-mgr-dashboard-18.2.4-845.ge4e227b3. 8.7 MB/s | 3.5 MB 00:00 2024-09-13T18:19:16.234 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:16.234 INFO:teuthology.orchestra.run.smithi038.stdout:Total 8.1 MB/s | 3.8 MB 00:00 2024-09-13T18:19:16.235 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:19:16.242 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:19:16.242 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:19:16.327 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:19:16.328 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:19:16.487 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:58 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:16.587 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:19:16.619 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:16.620 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:16.620 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-13T18:19:16.620 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:16.620 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:19:16.620 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 3.5 M 2024-09-13T18:19:16.620 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-13T18:19:16.620 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 24 k 2024-09-13T18:19:16.620 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 16 k 2024-09-13T18:19:16.620 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:19:16.620 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:19:16.620 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:16.621 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:19:16.621 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:16.621 INFO:teuthology.orchestra.run.smithi149.stdout:Install 5 Packages 2024-09-13T18:19:16.621 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:16.621 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 3.8 M 2024-09-13T18:19:16.621 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 87 M 2024-09-13T18:19:16.621 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:19:16.681 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-09-13T18:19:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-09-13T18:19:16.740 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-845.ge4e227b3.el9.no 3/5 2024-09-13T18:19:16.825 INFO:teuthology.orchestra.run.smithi149.stdout:(1/5): ceph-prometheus-alerts-18.2.4-845.ge4e22 113 kB/s | 16 kB 00:00 2024-09-13T18:19:16.850 INFO:teuthology.orchestra.run.smithi149.stdout:(2/5): ceph-grafana-dashboards-18.2.4-845.ge4e2 143 kB/s | 24 kB 00:00 2024-09-13T18:19:16.900 INFO:teuthology.orchestra.run.smithi149.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 409 kB/s | 31 kB 00:00 2024-09-13T18:19:16.951 INFO:teuthology.orchestra.run.smithi149.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 1.8 MB/s | 188 kB 00:00 2024-09-13T18:19:17.126 INFO:teuthology.orchestra.run.smithi149.stdout:(5/5): ceph-mgr-dashboard-18.2.4-845.ge4e227b3. 7.9 MB/s | 3.5 MB 00:00 2024-09-13T18:19:17.130 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:17.130 INFO:teuthology.orchestra.run.smithi149.stdout:Total 7.4 MB/s | 3.8 MB 00:00 2024-09-13T18:19:17.130 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:19:17.137 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:19:17.137 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:19:17.225 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:19:17.226 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:19:17.475 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:19:17.566 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-09-13T18:19:17.606 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-09-13T18:19:17.635 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-845.ge4e227b3.el9.no 3/5 2024-09-13T18:19:17.868 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-845.ge4e227b3.el9.n 4/5 2024-09-13T18:19:17.910 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 5/5 2024-09-13T18:19:18.693 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-845.ge4e227b3.el9.n 4/5 2024-09-13T18:19:18.722 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 5/5 2024-09-13T18:19:19.049 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 5/5 2024-09-13T18:19:19.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-845.ge4e227b3.el9.n 1/5 2024-09-13T18:19:19.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 2/5 2024-09-13T18:19:19.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-845.ge4e227b3.el9.no 3/5 2024-09-13T18:19:19.049 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-09-13T18:19:19.306 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-09-13T18:19:19.306 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:19.306 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:19:19.306 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:19.307 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:19.307 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:19.307 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:19:19.307 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:19:19.307 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:19.307 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:19.516 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T18:19:19.813 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 5/5 2024-09-13T18:19:19.814 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-845.ge4e227b3.el9.n 1/5 2024-09-13T18:19:19.814 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 2/5 2024-09-13T18:19:19.814 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-845.ge4e227b3.el9.no 3/5 2024-09-13T18:19:19.814 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-09-13T18:19:20.072 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-09-13T18:19:20.072 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:20.072 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:19:20.072 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:20.072 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:20.072 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:20.073 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:19:20.073 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:19:20.073 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:20.073 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:20.105 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:02 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:20.243 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:20.244 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================== 2024-09-13T18:19:20.244 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-13T18:19:20.245 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================== 2024-09-13T18:19:20.245 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:19:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 7.4 M 2024-09-13T18:19:20.245 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-13T18:19:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:19:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:19:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:19:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:19:20.245 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:19:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:19:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:19:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:19:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:19:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:19:20.246 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:19:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:20.247 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:19:20.247 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================== 2024-09-13T18:19:20.247 INFO:teuthology.orchestra.run.smithi038.stdout:Install 12 Packages 2024-09-13T18:19:20.247 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:20.248 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 38 M 2024-09-13T18:19:20.248 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 212 M 2024-09-13T18:19:20.249 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:19:20.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T18:19:20.455 INFO:teuthology.orchestra.run.smithi038.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-13T18:19:20.513 INFO:teuthology.orchestra.run.smithi038.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-13T18:19:20.547 INFO:teuthology.orchestra.run.smithi038.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-13T18:19:20.606 INFO:teuthology.orchestra.run.smithi038.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 311 kB/s | 18 kB 00:00 2024-09-13T18:19:20.673 INFO:teuthology.orchestra.run.smithi038.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 19 MB/s | 3.0 MB 00:00 2024-09-13T18:19:20.690 INFO:teuthology.orchestra.run.smithi038.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-13T18:19:20.815 INFO:teuthology.orchestra.run.smithi038.stdout:(7/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 35 MB/s | 4.9 MB 00:00 2024-09-13T18:19:20.840 INFO:teuthology.orchestra.run.smithi038.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-13T18:19:20.847 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:02 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:20.949 INFO:teuthology.orchestra.run.smithi038.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-09-13T18:19:20.974 INFO:teuthology.orchestra.run.smithi038.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.8 MB/s | 250 kB 00:00 2024-09-13T18:19:20.981 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:20.982 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-09-13T18:19:20.982 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-13T18:19:20.982 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-09-13T18:19:20.982 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:19:20.982 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 7.4 M 2024-09-13T18:19:20.982 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-13T18:19:20.982 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:19:20.982 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:19:20.982 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout:Install 12 Packages 2024-09-13T18:19:20.983 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:20.984 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 38 M 2024-09-13T18:19:20.984 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 212 M 2024-09-13T18:19:20.984 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:19:21.074 INFO:teuthology.orchestra.run.smithi038.stdout:(11/12): ceph-mgr-diskprediction-local-18.2.4-8 9.7 MB/s | 7.4 MB 00:00 2024-09-13T18:19:21.250 INFO:teuthology.orchestra.run.smithi149.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-13T18:19:21.309 INFO:teuthology.orchestra.run.smithi149.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-13T18:19:21.366 INFO:teuthology.orchestra.run.smithi038.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-09-13T18:19:21.367 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:21.367 INFO:teuthology.orchestra.run.smithi149.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 279 kB/s | 33 kB 00:00 2024-09-13T18:19:21.368 INFO:teuthology.orchestra.run.smithi038.stdout:Total 34 MB/s | 38 MB 00:01 2024-09-13T18:19:21.418 INFO:teuthology.orchestra.run.smithi149.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-13T18:19:21.468 INFO:teuthology.orchestra.run.smithi149.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-13T18:19:21.731 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:19:21.759 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:19:21.759 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:19:22.293 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:19:22.293 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:19:22.402 INFO:teuthology.orchestra.run.smithi149.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.7 MB/s | 3.0 MB 00:01 2024-09-13T18:19:22.502 INFO:teuthology.orchestra.run.smithi149.stdout:(7/12): ceph-mgr-diskprediction-local-18.2.4-84 5.4 MB/s | 7.4 MB 00:01 2024-09-13T18:19:22.552 INFO:teuthology.orchestra.run.smithi149.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-13T18:19:22.661 INFO:teuthology.orchestra.run.smithi149.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.3 MB/s | 250 kB 00:00 2024-09-13T18:19:22.745 INFO:teuthology.orchestra.run.smithi149.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.9 MB/s | 4.9 MB 00:01 2024-09-13T18:19:23.104 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:19:23.177 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T18:19:23.215 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T18:19:23.327 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T18:19:23.375 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T18:19:23.568 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T18:19:23.607 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T18:19:23.695 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T18:19:24.128 INFO:teuthology.orchestra.run.smithi149.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.1 MB/s | 5.1 MB 00:01 2024-09-13T18:19:24.400 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T18:19:24.532 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T18:19:25.861 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T18:19:25.869 INFO:teuthology.orchestra.run.smithi149.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.1 MB/s | 16 MB 00:03 2024-09-13T18:19:25.870 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:25.871 INFO:teuthology.orchestra.run.smithi149.stdout:Total 7.8 MB/s | 38 MB 00:04 2024-09-13T18:19:26.228 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:19:26.254 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:19:26.254 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:19:26.765 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:19:26.765 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:19:26.948 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T18:19:26.972 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227 12/12 2024-09-13T18:19:27.532 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:19:27.611 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T18:19:27.651 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T18:19:27.751 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T18:19:27.794 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T18:19:27.983 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T18:19:28.018 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T18:19:28.095 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T18:19:28.758 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T18:19:28.882 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T18:19:29.504 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227 12/12 2024-09-13T18:19:29.504 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227 1/12 2024-09-13T18:19:29.504 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T18:19:29.504 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T18:19:29.504 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T18:19:29.504 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T18:19:29.504 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T18:19:29.504 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T18:19:29.504 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T18:19:29.505 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T18:19:29.505 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T18:19:29.505 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T18:19:29.969 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T18:19:29.969 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:29.969 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:19:29.969 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:29.969 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:19:29.969 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:19:29.969 INFO:teuthology.orchestra.run.smithi038.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:19:29.969 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:19:29.970 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:19:29.970 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:19:29.970 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:19:29.970 INFO:teuthology.orchestra.run.smithi038.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:19:29.970 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:19:29.970 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:19:29.970 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:19:29.970 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:29.970 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:30.156 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T18:19:30.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-rook 2024-09-13T18:19:30.925 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:12 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:31.072 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:31.073 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:31.073 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-13T18:19:31.073 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:31.073 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:19:31.073 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 49 k 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:19:31.074 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:31.075 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:19:31.075 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:31.075 INFO:teuthology.orchestra.run.smithi038.stdout:Install 13 Packages 2024-09-13T18:19:31.075 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:31.075 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 2.2 M 2024-09-13T18:19:31.075 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 26 M 2024-09-13T18:19:31.075 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:19:31.212 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T18:19:31.242 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227 12/12 2024-09-13T18:19:31.373 INFO:teuthology.orchestra.run.smithi038.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 261 kB/s | 19 kB 00:00 2024-09-13T18:19:31.398 INFO:teuthology.orchestra.run.smithi038.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 259 kB/s | 26 kB 00:00 2024-09-13T18:19:31.457 INFO:teuthology.orchestra.run.smithi038.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 222 kB 00:00 2024-09-13T18:19:31.482 INFO:teuthology.orchestra.run.smithi038.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-13T18:19:31.507 INFO:teuthology.orchestra.run.smithi038.stdout:(5/13): ceph-mgr-rook-18.2.4-845.ge4e227b3.el9. 237 kB/s | 49 kB 00:00 2024-09-13T18:19:31.533 INFO:teuthology.orchestra.run.smithi038.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-13T18:19:31.566 INFO:teuthology.orchestra.run.smithi038.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.5 MB/s | 279 kB 00:00 2024-09-13T18:19:31.617 INFO:teuthology.orchestra.run.smithi038.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 295 kB/s | 32 kB 00:00 2024-09-13T18:19:31.642 INFO:teuthology.orchestra.run.smithi038.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 129 kB/s | 14 kB 00:00 2024-09-13T18:19:31.667 INFO:teuthology.orchestra.run.smithi038.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T18:19:31.701 INFO:teuthology.orchestra.run.smithi038.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.8 MB/s | 220 kB 00:00 2024-09-13T18:19:31.734 INFO:teuthology.orchestra.run.smithi038.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-09-13T18:19:31.776 INFO:teuthology.orchestra.run.smithi038.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.5 MB/s | 1.0 MB 00:00 2024-09-13T18:19:31.779 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:31.779 INFO:teuthology.orchestra.run.smithi038.stdout:Total 3.1 MB/s | 2.2 MB 00:00 2024-09-13T18:19:31.847 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:19:31.864 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:19:31.864 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:19:31.959 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:19:31.961 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:19:32.476 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:19:32.650 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T18:19:32.713 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T18:19:32.777 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T18:19:32.812 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T18:19:32.854 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T18:19:32.960 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T18:19:33.071 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T18:19:33.139 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T18:19:33.804 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227 12/12 2024-09-13T18:19:33.804 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227 1/12 2024-09-13T18:19:33.804 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T18:19:33.804 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T18:19:33.804 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T18:19:33.804 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T18:19:33.804 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T18:19:33.804 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T18:19:33.804 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T18:19:33.805 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T18:19:33.805 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T18:19:33.805 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T18:19:33.913 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T18:19:33.953 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T18:19:33.987 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T18:19:34.036 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T18:19:34.064 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 13/13 2024-09-13T18:19:34.242 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T18:19:34.242 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:34.242 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:19:34.242 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:34.242 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:19:34.242 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:19:34.243 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:19:34.243 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:19:34.243 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:19:34.243 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:19:34.243 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:19:34.243 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:19:34.243 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:19:34.243 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:19:34.243 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:19:34.243 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:34.243 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:34.623 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-rook 2024-09-13T18:19:34.828 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 13/13 2024-09-13T18:19:34.828 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 1/13 2024-09-13T18:19:34.828 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T18:19:34.828 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T18:19:34.828 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T18:19:34.828 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T18:19:34.829 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T18:19:34.829 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T18:19:34.829 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T18:19:34.829 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T18:19:34.829 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T18:19:34.829 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T18:19:34.829 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T18:19:35.164 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T18:19:35.164 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:35.164 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:19:35.164 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:35.164 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:19:35.164 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:19:35.164 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:19:35.165 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:19:35.165 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:19:35.165 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:19:35.165 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:19:35.165 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:19:35.165 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:19:35.165 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:19:35.165 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:19:35.165 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:19:35.165 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:35.165 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:35.220 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:17 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:35.365 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:35.366 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 49 k 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:19:35.367 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:19:35.368 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:19:35.368 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:19:35.368 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:19:35.368 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:19:35.368 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:35.368 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:19:35.368 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:35.368 INFO:teuthology.orchestra.run.smithi149.stdout:Install 13 Packages 2024-09-13T18:19:35.368 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:35.369 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 2.2 M 2024-09-13T18:19:35.369 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 26 M 2024-09-13T18:19:35.369 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:19:35.430 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T18:19:35.901 INFO:teuthology.orchestra.run.smithi149.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 269 kB/s | 26 kB 00:00 2024-09-13T18:19:35.926 INFO:teuthology.orchestra.run.smithi149.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 159 kB/s | 19 kB 00:00 2024-09-13T18:19:35.985 INFO:teuthology.orchestra.run.smithi149.stdout:(3/13): ceph-mgr-rook-18.2.4-845.ge4e227b3.el9. 275 kB/s | 49 kB 00:00 2024-09-13T18:19:36.010 INFO:teuthology.orchestra.run.smithi149.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-13T18:19:36.021 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:18 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:36.036 INFO:teuthology.orchestra.run.smithi149.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-13T18:19:36.078 INFO:teuthology.orchestra.run.smithi149.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 772 kB/s | 32 kB 00:00 2024-09-13T18:19:36.103 INFO:teuthology.orchestra.run.smithi149.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 581 kB/s | 54 kB 00:00 2024-09-13T18:19:36.128 INFO:teuthology.orchestra.run.smithi149.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 280 kB/s | 14 kB 00:00 2024-09-13T18:19:36.159 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:36.160 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-13T18:19:36.160 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:36.160 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:19:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 139 k 2024-09-13T18:19:36.160 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-13T18:19:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:19:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:19:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:19:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:19:36.160 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:19:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:36.161 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:19:36.161 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:36.161 INFO:teuthology.orchestra.run.smithi038.stdout:Install 6 Packages 2024-09-13T18:19:36.161 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:36.161 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 7.0 M 2024-09-13T18:19:36.161 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 33 M 2024-09-13T18:19:36.162 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:19:36.170 INFO:teuthology.orchestra.run.smithi149.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-13T18:19:36.212 INFO:teuthology.orchestra.run.smithi149.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-13T18:19:36.254 INFO:teuthology.orchestra.run.smithi149.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 8.6 MB/s | 1.0 MB 00:00 2024-09-13T18:19:36.279 INFO:teuthology.orchestra.run.smithi149.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-09-13T18:19:36.304 INFO:teuthology.orchestra.run.smithi149.stdout:(13/13): python3-rsa-4.9-2.el9.noarch.rpm 447 kB/s | 59 kB 00:00 2024-09-13T18:19:36.307 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:36.307 INFO:teuthology.orchestra.run.smithi149.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-13T18:19:36.374 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:19:36.389 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:19:36.389 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:19:36.478 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:19:36.480 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:19:36.545 INFO:teuthology.orchestra.run.smithi038.stdout:(1/6): ceph-mgr-cephadm-18.2.4-845.ge4e227b3.el 690 kB/s | 139 kB 00:00 2024-09-13T18:19:36.637 INFO:teuthology.orchestra.run.smithi038.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.9 MB/s | 548 kB 00:00 2024-09-13T18:19:36.663 INFO:teuthology.orchestra.run.smithi038.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-13T18:19:36.688 INFO:teuthology.orchestra.run.smithi038.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-13T18:19:36.771 INFO:teuthology.orchestra.run.smithi038.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 580 kB/s | 248 kB 00:00 2024-09-13T18:19:36.980 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:19:37.150 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T18:19:37.205 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T18:19:37.260 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T18:19:37.299 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T18:19:37.340 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T18:19:37.440 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T18:19:37.544 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T18:19:37.608 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T18:19:38.326 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T18:19:38.381 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T18:19:38.414 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T18:19:38.463 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T18:19:38.493 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 13/13 2024-09-13T18:19:38.780 INFO:teuthology.orchestra.run.smithi038.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-09-13T18:19:38.782 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:38.782 INFO:teuthology.orchestra.run.smithi038.stdout:Total 2.7 MB/s | 7.0 MB 00:02 2024-09-13T18:19:38.859 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:19:38.871 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:19:38.871 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:19:38.976 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:19:38.977 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:19:39.293 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:19:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 13/13 2024-09-13T18:19:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 1/13 2024-09-13T18:19:39.355 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T18:19:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T18:19:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T18:19:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T18:19:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T18:19:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T18:19:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T18:19:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T18:19:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T18:19:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T18:19:39.356 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T18:19:39.478 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T18:19:39.524 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T18:19:39.688 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T18:19:39.688 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:19:39.689 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:19:39.690 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:19:39.690 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:39.690 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:39.962 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T18:19:40.076 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T18:19:40.171 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T18:19:40.240 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T18:19:40.269 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 6/6 2024-09-13T18:19:40.537 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:22 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:40.670 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:40.671 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:40.671 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-13T18:19:40.671 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:40.671 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:19:40.671 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:18.2.4-845.ge4e227b3.el9 ceph-noarch 139 k 2024-09-13T18:19:40.671 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-13T18:19:40.671 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:19:40.672 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:19:40.672 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:19:40.672 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:19:40.672 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:19:40.672 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:40.672 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:19:40.672 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:40.672 INFO:teuthology.orchestra.run.smithi149.stdout:Install 6 Packages 2024-09-13T18:19:40.672 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:40.673 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 7.0 M 2024-09-13T18:19:40.673 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 33 M 2024-09-13T18:19:40.673 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:19:41.049 INFO:teuthology.orchestra.run.smithi149.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-13T18:19:41.074 INFO:teuthology.orchestra.run.smithi149.stdout:(2/6): ceph-mgr-cephadm-18.2.4-845.ge4e227b3.el 611 kB/s | 139 kB 00:00 2024-09-13T18:19:41.124 INFO:teuthology.orchestra.run.smithi149.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T18:19:41.158 INFO:teuthology.orchestra.run.smithi149.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-13T18:19:41.175 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 6/6 2024-09-13T18:19:41.175 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/6 2024-09-13T18:19:41.175 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T18:19:41.175 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T18:19:41.175 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T18:19:41.175 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T18:19:41.200 INFO:teuthology.orchestra.run.smithi149.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.5 MB/s | 548 kB 00:00 2024-09-13T18:19:41.284 INFO:teuthology.orchestra.run.smithi149.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-13T18:19:41.289 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:41.289 INFO:teuthology.orchestra.run.smithi149.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-13T18:19:41.357 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:19:41.368 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:19:41.368 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:19:41.455 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T18:19:41.455 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:41.455 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:19:41.455 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:41.455 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:19:41.455 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:19:41.455 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:19:41.456 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:19:41.456 INFO:teuthology.orchestra.run.smithi038.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:19:41.456 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:41.456 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:41.466 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:19:41.468 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:19:41.704 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-fuse 2024-09-13T18:19:41.777 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:19:41.952 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T18:19:42.002 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T18:19:42.301 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:24 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:42.439 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:42.439 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:42.440 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-09-13T18:19:42.440 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:42.440 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:19:42.440 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 852 k 2024-09-13T18:19:42.440 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-09-13T18:19:42.440 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:19:42.440 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:42.440 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:19:42.440 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:42.440 INFO:teuthology.orchestra.run.smithi038.stdout:Install 2 Packages 2024-09-13T18:19:42.440 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:42.441 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 932 k 2024-09-13T18:19:42.441 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 2.7 M 2024-09-13T18:19:42.441 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:19:42.533 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T18:19:42.614 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T18:19:42.676 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T18:19:42.706 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 6/6 2024-09-13T18:19:42.848 INFO:teuthology.orchestra.run.smithi038.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 614 kB/s | 80 kB 00:00 2024-09-13T18:19:42.990 INFO:teuthology.orchestra.run.smithi038.stdout:(2/2): ceph-fuse-18.2.4-845.ge4e227b3.el9.x86_6 3.1 MB/s | 852 kB 00:00 2024-09-13T18:19:42.991 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:42.991 INFO:teuthology.orchestra.run.smithi038.stdout:Total 1.7 MB/s | 932 kB 00:00 2024-09-13T18:19:43.004 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:19:43.029 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:19:43.029 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:19:43.116 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:19:43.116 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:19:43.307 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:19:43.459 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T18:19:43.479 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 6/6 2024-09-13T18:19:43.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 1/6 2024-09-13T18:19:43.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T18:19:43.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T18:19:43.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T18:19:43.480 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T18:19:43.534 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 2/2 2024-09-13T18:19:43.754 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T18:19:43.754 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:43.754 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:19:43.754 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:18.2.4-845.ge4e227b3.el9.noarch 2024-09-13T18:19:43.754 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:19:43.755 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:19:43.755 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:19:43.755 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:19:43.755 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:19:43.755 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:43.755 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:43.998 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-fuse 2024-09-13T18:19:44.223 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 2/2 2024-09-13T18:19:44.223 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/2 2024-09-13T18:19:44.478 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T18:19:44.478 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:44.478 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:19:44.478 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T18:19:44.478 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:44.478 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:44.578 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:44.712 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:44.713 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:44.713 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-13T18:19:44.713 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:44.713 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:19:44.713 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 852 k 2024-09-13T18:19:44.713 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-13T18:19:44.713 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:19:44.713 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:44.713 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:19:44.713 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:44.714 INFO:teuthology.orchestra.run.smithi149.stdout:Install 2 Packages 2024-09-13T18:19:44.714 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:44.714 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 932 k 2024-09-13T18:19:44.714 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 2.7 M 2024-09-13T18:19:44.714 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:19:44.774 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librados-devel 2024-09-13T18:19:44.911 INFO:teuthology.orchestra.run.smithi149.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 536 kB/s | 80 kB 00:00 2024-09-13T18:19:45.052 INFO:teuthology.orchestra.run.smithi149.stdout:(2/2): ceph-fuse-18.2.4-845.ge4e227b3.el9.x86_6 2.9 MB/s | 852 kB 00:00 2024-09-13T18:19:45.053 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:45.053 INFO:teuthology.orchestra.run.smithi149.stdout:Total 2.7 MB/s | 932 kB 00:00 2024-09-13T18:19:45.065 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:19:45.087 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:19:45.087 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:19:45.166 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:19:45.167 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:19:45.350 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:19:45.367 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:27 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:45.493 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T18:19:45.507 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:45.507 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:45.507 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-09-13T18:19:45.507 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:45.508 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:19:45.508 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 127 k 2024-09-13T18:19:45.508 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:45.508 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:19:45.508 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:45.508 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-13T18:19:45.508 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:45.508 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 127 k 2024-09-13T18:19:45.508 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 456 k 2024-09-13T18:19:45.508 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:19:45.560 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 2/2 2024-09-13T18:19:45.704 INFO:teuthology.orchestra.run.smithi038.stdout:librados-devel-18.2.4-845.ge4e227b3.el9.x86_64. 649 kB/s | 127 kB 00:00 2024-09-13T18:19:45.704 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:45.705 INFO:teuthology.orchestra.run.smithi038.stdout:Total 644 kB/s | 127 kB 00:00 2024-09-13T18:19:45.705 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:19:45.710 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:19:45.711 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:19:45.779 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:19:45.779 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:19:45.940 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:19:46.053 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:46.229 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 2/2 2024-09-13T18:19:46.229 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/2 2024-09-13T18:19:46.480 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T18:19:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:46.495 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:19:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T18:19:46.495 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:46.495 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:46.770 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:46.770 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:46.770 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:19:46.770 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:46.770 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:46.770 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:46.806 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librados-devel 2024-09-13T18:19:47.010 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install libcephfs2 2024-09-13T18:19:47.389 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:47.529 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:47.531 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:47.531 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-09-13T18:19:47.531 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:47.531 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:19:47.531 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 127 k 2024-09-13T18:19:47.532 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:47.532 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:19:47.532 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:47.532 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-13T18:19:47.532 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:47.533 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 127 k 2024-09-13T18:19:47.533 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 456 k 2024-09-13T18:19:47.533 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:19:47.601 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:29 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:47.694 INFO:teuthology.orchestra.run.smithi038.stdout:Package libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:47.724 INFO:teuthology.orchestra.run.smithi149.stdout:librados-devel-18.2.4-845.ge4e227b3.el9.x86_64. 655 kB/s | 127 kB 00:00 2024-09-13T18:19:47.725 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:47.725 INFO:teuthology.orchestra.run.smithi149.stdout:Total 651 kB/s | 127 kB 00:00 2024-09-13T18:19:47.726 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:19:47.731 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:19:47.731 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:19:47.739 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:47.741 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-13T18:19:47.741 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:47.794 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:19:47.795 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:19:47.814 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install libcephfs-devel 2024-09-13T18:19:47.944 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:19:48.046 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:48.403 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:48.469 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:48.542 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:48.542 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:48.543 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-09-13T18:19:48.543 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:48.543 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:19:48.543 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 31 k 2024-09-13T18:19:48.543 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:48.543 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:19:48.543 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:48.543 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-13T18:19:48.543 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:48.543 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 31 k 2024-09-13T18:19:48.543 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 139 k 2024-09-13T18:19:48.543 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:19:48.690 INFO:teuthology.orchestra.run.smithi038.stdout:libcephfs-devel-18.2.4-845.ge4e227b3.el9.x86_64 212 kB/s | 31 kB 00:00 2024-09-13T18:19:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:Total 210 kB/s | 31 kB 00:00 2024-09-13T18:19:48.691 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:19:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:19:48.695 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:19:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:19:48.717 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:19:48.731 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:48.731 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:48.731 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:19:48.731 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:48.732 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:48.732 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:48.810 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:19:48.924 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:48.994 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install libcephfs2 2024-09-13T18:19:49.324 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:49.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:49.562 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:49.562 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:19:49.562 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:49.562 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:49.562 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:49.573 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:49.664 INFO:teuthology.orchestra.run.smithi149.stdout:Package libcephfs2-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:49.710 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:49.711 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-13T18:19:49.711 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:49.739 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librados2 2024-09-13T18:19:49.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install libcephfs-devel 2024-09-13T18:19:50.329 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:50.354 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:50.423 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:50.468 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:50.470 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-13T18:19:50.470 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:50.488 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:50.488 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:50.489 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-09-13T18:19:50.489 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:50.489 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:19:50.489 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 31 k 2024-09-13T18:19:50.489 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:50.489 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:19:50.489 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:50.489 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-13T18:19:50.489 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:50.489 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 31 k 2024-09-13T18:19:50.489 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 139 k 2024-09-13T18:19:50.489 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:19:50.541 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install librbd1 2024-09-13T18:19:50.644 INFO:teuthology.orchestra.run.smithi149.stdout:libcephfs-devel-18.2.4-845.ge4e227b3.el9.x86_64 200 kB/s | 31 kB 00:00 2024-09-13T18:19:50.645 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:50.645 INFO:teuthology.orchestra.run.smithi149.stdout:Total 198 kB/s | 31 kB 00:00 2024-09-13T18:19:50.645 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:19:50.649 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:19:50.649 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:19:50.667 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:19:50.667 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:19:50.748 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:19:50.858 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:51.129 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:51.217 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:51.221 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:51.267 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:51.268 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-13T18:19:51.269 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:51.339 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rados 2024-09-13T18:19:51.441 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:51.441 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:51.441 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:19:51.442 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:51.442 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:51.442 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:51.675 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librados2 2024-09-13T18:19:51.930 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:52.024 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:52.069 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:52.070 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-13T18:19:52.070 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:52.139 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rgw 2024-09-13T18:19:52.249 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:52.338 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:52.380 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:52.381 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-13T18:19:52.381 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:52.457 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librbd1 2024-09-13T18:19:52.721 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:52.815 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:52.859 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:52.860 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-13T18:19:52.860 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:52.927 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-cephfs 2024-09-13T18:19:53.030 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:53.119 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:53.162 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:53.163 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-13T18:19:53.163 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:53.232 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rados 2024-09-13T18:19:53.522 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:53.615 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:53.661 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:53.662 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-13T18:19:53.663 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:53.731 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install python3-rbd 2024-09-13T18:19:53.812 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:53.903 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rados-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:53.946 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:53.947 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-13T18:19:53.947 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:54.015 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rgw 2024-09-13T18:19:54.326 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:54.422 INFO:teuthology.orchestra.run.smithi038.stdout:Package python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:54.466 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:54.467 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-09-13T18:19:54.468 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:54.541 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-fuse 2024-09-13T18:19:54.583 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:54.673 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rgw-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:54.716 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:54.717 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-13T18:19:54.717 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:54.790 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-cephfs 2024-09-13T18:19:55.135 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:55.273 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:55.273 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:55.273 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2024-09-13T18:19:55.273 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:55.274 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:19:55.274 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 87 k 2024-09-13T18:19:55.274 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:55.274 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:19:55.274 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:55.274 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-13T18:19:55.274 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:55.274 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 87 k 2024-09-13T18:19:55.274 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 227 k 2024-09-13T18:19:55.275 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:19:55.362 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:55.453 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-cephfs-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:55.477 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-fuse-18.2.4-845.ge4e227b3.el9.x86_64.rpm 429 kB/s | 87 kB 00:00 2024-09-13T18:19:55.477 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:55.478 INFO:teuthology.orchestra.run.smithi038.stdout:Total 426 kB/s | 87 kB 00:00 2024-09-13T18:19:55.478 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:19:55.485 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:19:55.485 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:19:55.496 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:55.497 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-13T18:19:55.497 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:55.557 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:19:55.557 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:19:55.567 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rbd 2024-09-13T18:19:55.728 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:19:55.827 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:56.141 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:56.211 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:56.231 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rbd-2:18.2.4-845.ge4e227b3.el9.x86_64 is already installed. 2024-09-13T18:19:56.274 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:56.275 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-09-13T18:19:56.275 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:56.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-fuse 2024-09-13T18:19:56.484 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:56.484 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:56.484 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:19:56.485 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:56.485 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:56.485 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:56.721 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-mirror 2024-09-13T18:19:56.922 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:57.054 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:57.054 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:57.055 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-13T18:19:57.055 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:57.055 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:19:57.055 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 87 k 2024-09-13T18:19:57.055 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:57.055 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:19:57.055 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:57.055 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-13T18:19:57.055 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:57.055 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 87 k 2024-09-13T18:19:57.055 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 227 k 2024-09-13T18:19:57.055 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:19:57.256 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-fuse-18.2.4-845.ge4e227b3.el9.x86_64.rpm 433 kB/s | 87 kB 00:00 2024-09-13T18:19:57.256 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:57.257 INFO:teuthology.orchestra.run.smithi149.stdout:Total 430 kB/s | 87 kB 00:00 2024-09-13T18:19:57.257 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:19:57.264 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:19:57.264 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:19:57.313 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:39 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:57.332 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:19:57.332 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:19:57.451 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:19:57.451 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:57.451 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repo Size 2024-09-13T18:19:57.451 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:57.451 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:19:57.452 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 3.0 M 2024-09-13T18:19:57.452 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:57.452 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:19:57.452 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:19:57.452 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-13T18:19:57.452 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:57.453 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 3.0 M 2024-09-13T18:19:57.453 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 12 M 2024-09-13T18:19:57.453 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:19:57.487 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:19:57.595 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:57.789 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-mirror-18.2.4-845.ge4e227b3.el9.x86_64.rpm 8.9 MB/s | 3.0 MB 00:00 2024-09-13T18:19:57.789 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:57.790 INFO:teuthology.orchestra.run.smithi038.stdout:Total 8.9 MB/s | 3.0 MB 00:00 2024-09-13T18:19:57.790 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:19:57.800 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:19:57.800 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:19:57.885 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:19:57.885 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:19:57.953 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:58.198 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:58.198 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:58.198 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:19:58.199 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:58.199 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:58.199 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:19:58.333 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:19:58.416 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:58.443 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:58.443 INFO:teuthology.orchestra.run.smithi038.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:19:58.443 INFO:teuthology.orchestra.run.smithi038.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:19:58.443 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:19:58.443 INFO:teuthology.orchestra.run.smithi038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:19:58.443 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:58.493 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-mirror 2024-09-13T18:19:59.088 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:19:59.227 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:19:59.228 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:59.228 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-09-13T18:19:59.228 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:59.228 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:19:59.228 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 3.0 M 2024-09-13T18:19:59.228 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:59.228 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:19:59.228 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:19:59.228 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-13T18:19:59.229 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:19:59.229 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 3.0 M 2024-09-13T18:19:59.229 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 12 M 2024-09-13T18:19:59.229 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:19:59.559 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:19:59.559 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:59.559 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:19:59.559 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:19:59.559 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:19:59.560 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:19:59.568 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-mirror-18.2.4-845.ge4e227b3.el9.x86_64.rpm 8.8 MB/s | 3.0 MB 00:00 2024-09-13T18:19:59.569 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:19:59.569 INFO:teuthology.orchestra.run.smithi149.stdout:Total 8.8 MB/s | 3.0 MB 00:00 2024-09-13T18:19:59.569 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:19:59.578 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:19:59.578 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:19:59.658 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:19:59.659 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:19:59.828 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-nbd 2024-09-13T18:20:00.077 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:20:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:20:00.180 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:20:00.180 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:20:00.180 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:20:00.180 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:20:00.181 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:20:00.181 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:20:00.427 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:42 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:20:00.565 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-09-13T18:20:00.565 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:20:00.565 INFO:teuthology.orchestra.run.smithi038.stdout: Package Architecture Version Repository Size 2024-09-13T18:20:00.566 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:20:00.566 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-09-13T18:20:00.566 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 172 k 2024-09-13T18:20:00.566 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:20:00.566 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-09-13T18:20:00.566 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2024-09-13T18:20:00.566 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2024-09-13T18:20:00.566 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:20:00.566 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 172 k 2024-09-13T18:20:00.566 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 494 k 2024-09-13T18:20:00.566 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-09-13T18:20:00.777 INFO:teuthology.orchestra.run.smithi038.stdout:rbd-nbd-18.2.4-845.ge4e227b3.el9.x86_64.rpm 817 kB/s | 172 kB 00:00 2024-09-13T18:20:00.778 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:20:00.778 INFO:teuthology.orchestra.run.smithi038.stdout:Total 810 kB/s | 172 kB 00:00 2024-09-13T18:20:00.778 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-09-13T18:20:00.786 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-09-13T18:20:00.786 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-09-13T18:20:00.859 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-09-13T18:20:00.859 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-09-13T18:20:01.029 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-09-13T18:20:01.127 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:20:01.244 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:20:01.244 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:20:01.244 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:20:01.245 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:20:01.245 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:20:01.245 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:20:01.525 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-nbd 2024-09-13T18:20:01.639 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:20:01.915 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:20:01.915 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:20:01.915 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-09-13T18:20:01.915 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:20:01.915 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:20:01.916 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-09-13T18:20:02.122 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:44 ago on Fri 13 Sep 2024 06:18:18 PM UTC. 2024-09-13T18:20:02.135 DEBUG:teuthology.parallel:result is None 2024-09-13T18:20:02.258 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-13T18:20:02.259 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:20:02.259 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-13T18:20:02.259 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:20:02.259 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-13T18:20:02.260 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:18.2.4-845.ge4e227b3.el9 ceph 172 k 2024-09-13T18:20:02.260 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:20:02.260 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-13T18:20:02.260 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-13T18:20:02.260 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-09-13T18:20:02.260 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:20:02.260 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 172 k 2024-09-13T18:20:02.260 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 494 k 2024-09-13T18:20:02.260 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-13T18:20:02.481 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-nbd-18.2.4-845.ge4e227b3.el9.x86_64.rpm 781 kB/s | 172 kB 00:00 2024-09-13T18:20:02.481 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:20:02.481 INFO:teuthology.orchestra.run.smithi149.stdout:Total 776 kB/s | 172 kB 00:00 2024-09-13T18:20:02.482 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-13T18:20:02.489 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-13T18:20:02.489 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-13T18:20:02.558 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-13T18:20:02.558 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-13T18:20:02.720 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-13T18:20:02.868 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:20:03.309 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:20:03.569 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 1/1 2024-09-13T18:20:03.570 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:20:03.570 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-13T18:20:03.570 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:18.2.4-845.ge4e227b3.el9.x86_64 2024-09-13T18:20:03.570 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:20:03.570 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-13T18:20:03.836 DEBUG:teuthology.parallel:result is None 2024-09-13T18:20:03.837 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:20:03.837 INFO:teuthology.packaging:ref: None 2024-09-13T18:20:03.837 INFO:teuthology.packaging:tag: None 2024-09-13T18:20:03.837 INFO:teuthology.packaging:branch: reef 2024-09-13T18:20:03.837 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:20:03.838 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-13T18:20:04.084 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:20:04.111 INFO:teuthology.orchestra.run.smithi038.stdout:18.2.4-845.ge4e227b3.el9 2024-09-13T18:20:04.111 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-845.ge4e227b3.el9 2024-09-13T18:20:04.112 INFO:teuthology.task.install:The correct ceph version 18.2.4-845.ge4e227b3 is installed. 2024-09-13T18:20:04.114 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:20:04.114 INFO:teuthology.packaging:ref: None 2024-09-13T18:20:04.114 INFO:teuthology.packaging:tag: None 2024-09-13T18:20:04.114 INFO:teuthology.packaging:branch: reef 2024-09-13T18:20:04.114 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:20:04.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-13T18:20:04.408 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:20:04.431 INFO:teuthology.orchestra.run.smithi149.stdout:18.2.4-845.ge4e227b3.el9 2024-09-13T18:20:04.431 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-845.ge4e227b3.el9 2024-09-13T18:20:04.432 INFO:teuthology.task.install:The correct ceph version 18.2.4-845.ge4e227b3 is installed. 2024-09-13T18:20:04.434 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T18:20:04.434 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:20:04.435 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:20:04.468 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:20:04.468 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:20:04.499 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T18:20:04.499 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:20:04.499 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:20:04.539 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:20:04.609 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:20:04.609 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:20:04.634 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:20:04.699 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T18:20:04.700 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:20:04.700 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:20:04.729 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:20:04.800 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:20:04.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:20:04.826 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:20:04.891 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T18:20:04.891 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:20:04.891 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:20:04.920 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:20:04.990 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:20:04.990 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:20:05.014 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:20:05.079 INFO:teuthology.run_tasks:Running task print... 2024-09-13T18:20:05.090 INFO:teuthology.task.print:**** done install task... 2024-09-13T18:20:05.090 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T18:20:05.202 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:20:05.202 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-09-13T18:20:05.203 INFO:tasks.cephadm:Cluster fsid is ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:20:05.203 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T18:20:05.203 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-13T18:20:05.203 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi038': '172.21.15.38', 'mon.smithi149': '172.21.15.149'} 2024-09-13T18:20:05.203 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T18:20:05.204 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname $(hostname -s) 2024-09-13T18:20:05.235 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname $(hostname -s) 2024-09-13T18:20:05.261 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-13T18:20:05.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:20:05.412 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82954/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-860-g6c6b083f', 'node_name': '172.21.4.58+omani008', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-860.g6c6b083f'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 17:57:22.919627', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.100730-reef', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'archs': ['arm64', 'x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82954/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-860-g6c6b083f', 'node_name': '172.21.5.40+adami10', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-860.g6c6b083f'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 13:55:29.568955', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.100730-reef', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-13T18:20:05.568 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240910.100730-reef, sha1 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:20:05.570 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm 2024-09-13T18:20:05.570 DEBUG:teuthology.orchestra.run.smithi038:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T18:20:05.913 INFO:teuthology.orchestra.run.smithi038.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 18:20 /home/ubuntu/cephtest/cephadm 2024-09-13T18:20:05.914 DEBUG:teuthology.orchestra.run.smithi149:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T18:20:06.249 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 18:20 /home/ubuntu/cephtest/cephadm 2024-09-13T18:20:06.249 DEBUG:teuthology.orchestra.run.smithi038:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T18:20:06.270 DEBUG:teuthology.orchestra.run.smithi149:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T18:20:06.298 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-09-13T18:20:06.299 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-13T18:20:06.312 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-09-13T18:20:07.862 INFO:teuthology.orchestra.run.smithi149.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-13T18:20:07.925 INFO:teuthology.orchestra.run.smithi038.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-13T18:20:34.191 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-09-13T18:20:34.191 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_version": "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)", 2024-09-13T18:20:34.191 INFO:teuthology.orchestra.run.smithi149.stdout: "image_id": "67ddd33fa72f26a51c969a9043e7a3ddf784506b3d1949ad815ae4dd791beec1", 2024-09-13T18:20:34.191 INFO:teuthology.orchestra.run.smithi149.stdout: "repo_digests": [ 2024-09-13T18:20:34.191 INFO:teuthology.orchestra.run.smithi149.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322" 2024-09-13T18:20:34.192 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-09-13T18:20:34.192 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-09-13T18:20:37.016 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:20:37.017 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_version": "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)", 2024-09-13T18:20:37.017 INFO:teuthology.orchestra.run.smithi038.stdout: "image_id": "67ddd33fa72f26a51c969a9043e7a3ddf784506b3d1949ad815ae4dd791beec1", 2024-09-13T18:20:37.017 INFO:teuthology.orchestra.run.smithi038.stdout: "repo_digests": [ 2024-09-13T18:20:37.017 INFO:teuthology.orchestra.run.smithi038.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322" 2024-09-13T18:20:37.017 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-09-13T18:20:37.017 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:20:37.037 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph 2024-09-13T18:20:37.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph 2024-09-13T18:20:37.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /etc/ceph 2024-09-13T18:20:37.158 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /etc/ceph 2024-09-13T18:20:37.199 INFO:tasks.cephadm:Writing seed config... 2024-09-13T18:20:37.201 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-13T18:20:37.201 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-13T18:20:37.201 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-13T18:20:37.201 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-13T18:20:37.201 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-13T18:20:37.201 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T18:20:37.201 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T18:20:37.201 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-13T18:20:37.201 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-13T18:20:37.201 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T18:20:37.201 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T18:20:37.202 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T18:20:37.203 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T18:20:37.204 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T18:20:37.204 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T18:20:37.204 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T18:20:37.204 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T18:20:37.204 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:20:37.205 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T18:20:37.222 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ccb73e88-71fc-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T18:20:37.222 DEBUG:teuthology.orchestra.run.smithi038:mon.smithi038> sudo journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi038.service 2024-09-13T18:20:37.265 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T18:20:37.265 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.38 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:20:37.424 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:20:37.424 INFO:teuthology.orchestra.run.smithi038.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', 'ccb73e88-71fc-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.38', '--skip-admin-label'] 2024-09-13T18:20:37.448 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 5.2.2 2024-09-13T18:20:37.449 INFO:teuthology.orchestra.run.smithi038.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T18:20:37.450 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying podman|docker is present... 2024-09-13T18:20:37.472 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 5.2.2 2024-09-13T18:20:37.472 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying lvm2 is present... 2024-09-13T18:20:37.472 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying time synchronization is in place... 2024-09-13T18:20:37.480 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T18:20:37.480 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T18:20:37.486 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T18:20:37.486 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-13T18:20:37.493 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout enabled 2024-09-13T18:20:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout active 2024-09-13T18:20:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:Unit chronyd.service is enabled and running 2024-09-13T18:20:37.500 INFO:teuthology.orchestra.run.smithi038.stdout:Repeating the final host check... 2024-09-13T18:20:37.521 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 5.2.2 2024-09-13T18:20:37.521 INFO:teuthology.orchestra.run.smithi038.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T18:20:37.522 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl is present 2024-09-13T18:20:37.522 INFO:teuthology.orchestra.run.smithi038.stdout:lvcreate is present 2024-09-13T18:20:37.528 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T18:20:37.528 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T18:20:37.534 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T18:20:37.534 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-13T18:20:37.541 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout enabled 2024-09-13T18:20:37.550 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout active 2024-09-13T18:20:37.550 INFO:teuthology.orchestra.run.smithi038.stdout:Unit chronyd.service is enabled and running 2024-09-13T18:20:37.550 INFO:teuthology.orchestra.run.smithi038.stdout:Host looks OK 2024-09-13T18:20:37.550 INFO:teuthology.orchestra.run.smithi038.stdout:Cluster fsid: ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:20:37.550 INFO:teuthology.orchestra.run.smithi038.stdout:Acquiring lock 140475335300432 on /run/cephadm/ccb73e88-71fc-11ef-bceb-c7b262605968.lock 2024-09-13T18:20:37.550 INFO:teuthology.orchestra.run.smithi038.stdout:Lock 140475335300432 acquired on /run/cephadm/ccb73e88-71fc-11ef-bceb-c7b262605968.lock 2024-09-13T18:20:37.551 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying IP 172.21.15.38 port 3300 ... 2024-09-13T18:20:37.551 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying IP 172.21.15.38 port 6789 ... 2024-09-13T18:20:37.551 INFO:teuthology.orchestra.run.smithi038.stdout:Base mon IP(s) is [172.21.15.38:3300, 172.21.15.38:6789], mon addrv is [v2:172.21.15.38:3300,v1:172.21.15.38:6789] 2024-09-13T18:20:37.552 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.38 metric 100 2024-09-13T18:20:37.552 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.38 metric 100 2024-09-13T18:20:37.556 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T18:20:37.556 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-13T18:20:37.556 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1796sec hoplimit 64 pref medium 2024-09-13T18:20:37.558 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T18:20:37.558 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T18:20:37.558 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T18:20:37.558 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-13T18:20:37.558 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15fc/64 scope link 2024-09-13T18:20:37.558 INFO:teuthology.orchestra.run.smithi038.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T18:20:37.558 INFO:teuthology.orchestra.run.smithi038.stdout:Mon IP `172.21.15.38` is in CIDR network `172.21.0.0/20` 2024-09-13T18:20:37.558 INFO:teuthology.orchestra.run.smithi038.stdout:Mon IP `172.21.15.38` is in CIDR network `172.21.0.0/20` 2024-09-13T18:20:37.558 INFO:teuthology.orchestra.run.smithi038.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T18:20:37.559 INFO:teuthology.orchestra.run.smithi038.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T18:20:37.559 INFO:teuthology.orchestra.run.smithi038.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-09-13T18:20:38.035 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stdout 67ddd33fa72f26a51c969a9043e7a3ddf784506b3d1949ad815ae4dd791beec1 2024-09-13T18:20:38.035 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-09-13T18:20:38.036 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T18:20:38.036 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Copying blob sha256:71878612010b3dfa9e3e456d432a49e20ac26634831a8a6522f4d782181c5840 2024-09-13T18:20:38.036 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T18:20:38.036 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Copying config sha256:67ddd33fa72f26a51c969a9043e7a3ddf784506b3d1949ad815ae4dd791beec1 2024-09-13T18:20:38.036 INFO:teuthology.orchestra.run.smithi038.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T18:20:38.889 INFO:teuthology.orchestra.run.smithi038.stdout:ceph: stdout ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable) 2024-09-13T18:20:38.889 INFO:teuthology.orchestra.run.smithi038.stdout:Ceph version: ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable) 2024-09-13T18:20:38.890 INFO:teuthology.orchestra.run.smithi038.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T18:20:39.755 INFO:teuthology.orchestra.run.smithi038.stdout:stat: stdout 167 167 2024-09-13T18:20:39.755 INFO:teuthology.orchestra.run.smithi038.stdout:Creating initial keys... 2024-09-13T18:20:40.660 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph-authtool: stdout AQB4guRmFA24AhAAiWY5SsUyt54CfCkBh/4gzQ== 2024-09-13T18:20:41.599 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph-authtool: stdout AQB5guRm1fYbARAAxnYU2hPo5RsQQ7N6oEIUjQ== 2024-09-13T18:20:42.638 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph-authtool: stdout AQB5guRmur0YOBAAyjm1FI1RlAOh/1QabRYCkA== 2024-09-13T18:20:42.639 INFO:teuthology.orchestra.run.smithi038.stdout:Creating initial monmap... 2024-09-13T18:20:43.529 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T18:20:43.529 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-13T18:20:43.529 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:20:43.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T18:20:43.530 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool for smithi038 [v2:172.21.15.38:3300,v1:172.21.15.38:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T18:20:43.530 INFO:teuthology.orchestra.run.smithi038.stdout:setting min_mon_release = pacific 2024-09-13T18:20:43.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: set fsid to ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:20:43.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T18:20:43.530 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:20:43.530 INFO:teuthology.orchestra.run.smithi038.stdout:Creating mon... 2024-09-13T18:20:44.460 INFO:teuthology.orchestra.run.smithi038.stdout:create mon.smithi038 on 2024-09-13T18:20:44.682 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T18:20:44.836 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T18:20:45.041 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ccb73e88-71fc-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-ccb73e88-71fc-11ef-bceb-c7b262605968.target. 2024-09-13T18:20:45.041 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ccb73e88-71fc-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-ccb73e88-71fc-11ef-bceb-c7b262605968.target. 2024-09-13T18:20:45.292 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi038 2024-09-13T18:20:45.292 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi038.service: Unit ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi038.service not loaded. 2024-09-13T18:20:45.471 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ccb73e88-71fc-11ef-bceb-c7b262605968.target.wants/ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi038.service → /etc/systemd/system/ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@.service. 2024-09-13T18:20:46.021 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T18:20:46.021 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2024-09-13T18:20:46.029 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T18:20:46.029 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-13T18:20:46.029 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2024-09-13T18:20:46.030 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T18:20:46.030 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mon to start... 2024-09-13T18:20:46.030 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mon... 2024-09-13T18:20:47.094 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T18:20:47.094 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout id: ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:20:47.094 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T18:20:47.094 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-13T18:20:47.094 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout services: 2024-09-13T18:20:47.094 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi038 (age 0.533894s) 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout data: 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.434+0000 7f138c6de640 1 Processor -- start 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.434+0000 7f138c6de640 1 -- start start 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.435+0000 7f138c6de640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 0x7f13841082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.435+0000 7f138c6de640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1384073b10 con 0x7f1384105ef0 2024-09-13T18:20:47.095 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.435+0000 7f138a47a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 0x7f13841082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.435+0000 7f138a47a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 0x7f13841082e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45556/0 (socket says 172.21.15.38:45556) 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.435+0000 7f138a47a640 1 -- 172.21.15.38:0/1348708932 learned_addr learned my addr 172.21.15.38:0/1348708932 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.435+0000 7f138a47a640 1 -- 172.21.15.38:0/1348708932 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1384108820 con 0x7f1384105ef0 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.437+0000 7f138a47a640 1 --2- 172.21.15.38:0/1348708932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 0x7f13841082e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1374009e80 tx=0x7f137402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be1f00f2d29be6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.438+0000 7f1389478640 1 -- 172.21.15.38:0/1348708932 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1374031400 con 0x7f1384105ef0 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.438+0000 7f1389478640 1 -- 172.21.15.38:0/1348708932 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137402d050 con 0x7f1384105ef0 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.438+0000 7f1389478640 1 -- 172.21.15.38:0/1348708932 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13740316d0 con 0x7f1384105ef0 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.438+0000 7f138c6de640 1 -- 172.21.15.38:0/1348708932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 msgr2=0x7f13841082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.438+0000 7f138c6de640 1 --2- 172.21.15.38:0/1348708932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 0x7f13841082e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1374009e80 tx=0x7f137402a7a0 comp rx=0 tx=0).stop 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.438+0000 7f138c6de640 1 -- 172.21.15.38:0/1348708932 shutdown_connections 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.438+0000 7f138c6de640 1 --2- 172.21.15.38:0/1348708932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 0x7f13841082e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.438+0000 7f138c6de640 1 -- 172.21.15.38:0/1348708932 >> 172.21.15.38:0/1348708932 conn(0x7f13840ffb50 msgr2=0x7f1384101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:20:47.096 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.438+0000 7f138c6de640 1 -- 172.21.15.38:0/1348708932 shutdown_connections 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.438+0000 7f138c6de640 1 -- 172.21.15.38:0/1348708932 wait complete. 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.439+0000 7f138c6de640 1 Processor -- start 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.439+0000 7f138c6de640 1 -- start start 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.439+0000 7f138c6de640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 0x7f1384198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.439+0000 7f138c6de640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1384198ec0 con 0x7f1384105ef0 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.439+0000 7f138a47a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 0x7f1384198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.439+0000 7f138a47a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 0x7f1384198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45566/0 (socket says 172.21.15.38:45566) 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.439+0000 7f138a47a640 1 -- 172.21.15.38:0/2911072659 learned_addr learned my addr 172.21.15.38:0/2911072659 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.440+0000 7f138a47a640 1 -- 172.21.15.38:0/2911072659 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374009b30 con 0x7f1384105ef0 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.440+0000 7f138a47a640 1 --2- 172.21.15.38:0/2911072659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 0x7f1384198980 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f137402acc0 tx=0x7f1374004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.440+0000 7f13837fe640 1 -- 172.21.15.38:0/2911072659 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f137403b7d0 con 0x7f1384105ef0 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.440+0000 7f13837fe640 1 -- 172.21.15.38:0/2911072659 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137403b930 con 0x7f1384105ef0 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.440+0000 7f138c6de640 1 -- 172.21.15.38:0/2911072659 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13841990c0 con 0x7f1384105ef0 2024-09-13T18:20:47.097 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.440+0000 7f13837fe640 1 -- 172.21.15.38:0/2911072659 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f137403bc30 con 0x7f1384105ef0 2024-09-13T18:20:47.098 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.440+0000 7f138c6de640 1 -- 172.21.15.38:0/2911072659 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1384199560 con 0x7f1384105ef0 2024-09-13T18:20:47.098 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.440+0000 7f13837fe640 1 -- 172.21.15.38:0/2911072659 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f1374038040 con 0x7f1384105ef0 2024-09-13T18:20:47.098 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.440+0000 7f13837fe640 1 -- 172.21.15.38:0/2911072659 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f137403a3d0 con 0x7f1384105ef0 2024-09-13T18:20:47.098 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.441+0000 7f138c6de640 1 -- 172.21.15.38:0/2911072659 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1384192720 con 0x7f1384105ef0 2024-09-13T18:20:47.098 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.443+0000 7f13837fe640 1 -- 172.21.15.38:0/2911072659 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f137404b060 con 0x7f1384105ef0 2024-09-13T18:20:47.098 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.504+0000 7f138c6de640 1 -- 172.21.15.38:0/2911072659 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f138402c480 con 0x7f1384105ef0 2024-09-13T18:20:47.098 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.504+0000 7f13837fe640 1 -- 172.21.15.38:0/2911072659 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f1374053070 con 0x7f1384105ef0 2024-09-13T18:20:47.098 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.505+0000 7f138c6de640 1 -- 172.21.15.38:0/2911072659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 msgr2=0x7f1384198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:20:47.098 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.505+0000 7f138c6de640 1 --2- 172.21.15.38:0/2911072659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 0x7f1384198980 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f137402acc0 tx=0x7f1374004a40 comp rx=0 tx=0).stop 2024-09-13T18:20:47.099 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.505+0000 7f138c6de640 1 -- 172.21.15.38:0/2911072659 shutdown_connections 2024-09-13T18:20:47.099 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.505+0000 7f138c6de640 1 --2- 172.21.15.38:0/2911072659 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1384105ef0 0x7f1384198980 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:20:47.099 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.505+0000 7f138c6de640 1 -- 172.21.15.38:0/2911072659 >> 172.21.15.38:0/2911072659 conn(0x7f13840ffb50 msgr2=0x7f1384100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:20:47.099 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.505+0000 7f138c6de640 1 -- 172.21.15.38:0/2911072659 shutdown_connections 2024-09-13T18:20:47.099 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:46.505+0000 7f138c6de640 1 -- 172.21.15.38:0/2911072659 wait complete. 2024-09-13T18:20:47.099 INFO:teuthology.orchestra.run.smithi038.stdout:mon is available 2024-09-13T18:20:47.099 INFO:teuthology.orchestra.run.smithi038.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T18:20:48.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-13T18:20:48.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T18:20:48.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout fsid = ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:20:48.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.38:3300,v1:172.21.15.38:6789] 2024-09-13T18:20:48.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T18:20:48.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T18:20:48.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T18:20:48.085 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.468+0000 7fb49d8c5640 1 Processor -- start 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.469+0000 7fb49d8c5640 1 -- start start 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.469+0000 7fb49d8c5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 0x7fb498108290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:20:48.086 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.469+0000 7fb49d8c5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb498079de0 con 0x7fb498105ea0 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.469+0000 7fb496ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 0x7fb498108290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.469+0000 7fb496ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 0x7fb498108290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45578/0 (socket says 172.21.15.38:45578) 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.469+0000 7fb496ffd640 1 -- 172.21.15.38:0/470662639 learned_addr learned my addr 172.21.15.38:0/470662639 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.469+0000 7fb496ffd640 1 -- 172.21.15.38:0/470662639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4981087d0 con 0x7fb498105ea0 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.470+0000 7fb496ffd640 1 --2- 172.21.15.38:0/470662639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 0x7fb498108290 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb488009e80 tx=0x7fb48802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f000631592f7d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.470+0000 7fb495ffb640 1 -- 172.21.15.38:0/470662639 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb488031400 con 0x7fb498105ea0 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.470+0000 7fb495ffb640 1 -- 172.21.15.38:0/470662639 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48802d050 con 0x7fb498105ea0 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.470+0000 7fb495ffb640 1 -- 172.21.15.38:0/470662639 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb4880316d0 con 0x7fb498105ea0 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.471+0000 7fb49d8c5640 1 -- 172.21.15.38:0/470662639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 msgr2=0x7fb498108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.471+0000 7fb49d8c5640 1 --2- 172.21.15.38:0/470662639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 0x7fb498108290 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb488009e80 tx=0x7fb48802a7a0 comp rx=0 tx=0).stop 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.471+0000 7fb49d8c5640 1 -- 172.21.15.38:0/470662639 shutdown_connections 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.471+0000 7fb49d8c5640 1 --2- 172.21.15.38:0/470662639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 0x7fb498108290 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:20:48.087 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.471+0000 7fb49d8c5640 1 -- 172.21.15.38:0/470662639 >> 172.21.15.38:0/470662639 conn(0x7fb4980ffb20 msgr2=0x7fb498101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.471+0000 7fb49d8c5640 1 -- 172.21.15.38:0/470662639 shutdown_connections 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.471+0000 7fb49d8c5640 1 -- 172.21.15.38:0/470662639 wait complete. 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.471+0000 7fb49d8c5640 1 Processor -- start 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.472+0000 7fb49d8c5640 1 -- start start 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.472+0000 7fb49d8c5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 0x7fb498105720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.472+0000 7fb49d8c5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb498105c60 con 0x7fb498105ea0 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.472+0000 7fb496ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 0x7fb498105720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.472+0000 7fb496ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 0x7fb498105720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45584/0 (socket says 172.21.15.38:45584) 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.472+0000 7fb496ffd640 1 -- 172.21.15.38:0/1449768512 learned_addr learned my addr 172.21.15.38:0/1449768512 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.472+0000 7fb496ffd640 1 -- 172.21.15.38:0/1449768512 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb488009b30 con 0x7fb498105ea0 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.472+0000 7fb496ffd640 1 --2- 172.21.15.38:0/1449768512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 0x7fb498105720 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb48802acc0 tx=0x7fb488004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.473+0000 7fb49c8c3640 1 -- 172.21.15.38:0/1449768512 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb48803b7d0 con 0x7fb498105ea0 2024-09-13T18:20:48.088 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.473+0000 7fb49c8c3640 1 -- 172.21.15.38:0/1449768512 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48803b930 con 0x7fb498105ea0 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.473+0000 7fb49d8c5640 1 -- 172.21.15.38:0/1449768512 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb498103e50 con 0x7fb498105ea0 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.473+0000 7fb49c8c3640 1 -- 172.21.15.38:0/1449768512 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb48803bc30 con 0x7fb498105ea0 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.473+0000 7fb49d8c5640 1 -- 172.21.15.38:0/1449768512 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4981042f0 con 0x7fb498105ea0 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.473+0000 7fb49c8c3640 1 -- 172.21.15.38:0/1449768512 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb488038040 con 0x7fb498105ea0 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.473+0000 7fb49c8c3640 1 -- 172.21.15.38:0/1449768512 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb48803a3d0 con 0x7fb498105ea0 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.474+0000 7fb49d8c5640 1 -- 172.21.15.38:0/1449768512 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb498106300 con 0x7fb498105ea0 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.476+0000 7fb49c8c3640 1 -- 172.21.15.38:0/1449768512 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb48804b060 con 0x7fb498105ea0 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.535+0000 7fb49d8c5640 1 -- 172.21.15.38:0/1449768512 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fb498108a20 con 0x7fb498105ea0 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.539+0000 7fb49c8c3640 1 -- 172.21.15.38:0/1449768512 <== mon.0 v2:172.21.15.38:3300/0 7 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fb48803aa30 con 0x7fb498105ea0 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.539+0000 7fb49c8c3640 1 -- 172.21.15.38:0/1449768512 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fb488042070 con 0x7fb498105ea0 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.540+0000 7fb49d8c5640 1 -- 172.21.15.38:0/1449768512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 msgr2=0x7fb498105720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.540+0000 7fb49d8c5640 1 --2- 172.21.15.38:0/1449768512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 0x7fb498105720 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb48802acc0 tx=0x7fb488004a40 comp rx=0 tx=0).stop 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.540+0000 7fb49d8c5640 1 -- 172.21.15.38:0/1449768512 shutdown_connections 2024-09-13T18:20:48.089 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.540+0000 7fb49d8c5640 1 --2- 172.21.15.38:0/1449768512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb498105ea0 0x7fb498105720 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:20:48.090 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.540+0000 7fb49d8c5640 1 -- 172.21.15.38:0/1449768512 >> 172.21.15.38:0/1449768512 conn(0x7fb4980ffb20 msgr2=0x7fb498100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:20:48.090 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.540+0000 7fb49d8c5640 1 -- 172.21.15.38:0/1449768512 shutdown_connections 2024-09-13T18:20:48.090 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:47.540+0000 7fb49d8c5640 1 -- 172.21.15.38:0/1449768512 wait complete. 2024-09-13T18:20:48.090 INFO:teuthology.orchestra.run.smithi038.stdout:Generating new minimal ceph.conf... 2024-09-13T18:20:49.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.491+0000 7fe3ee04f640 1 Processor -- start 2024-09-13T18:20:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.491+0000 7fe3ee04f640 1 -- start start 2024-09-13T18:20:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.491+0000 7fe3ee04f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 0x7fe3e81082f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:20:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.491+0000 7fe3ee04f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e8079d80 con 0x7fe3e8105f00 2024-09-13T18:20:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.491+0000 7fe3e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 0x7fe3e81082f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:20:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.491+0000 7fe3e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 0x7fe3e81082f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45594/0 (socket says 172.21.15.38:45594) 2024-09-13T18:20:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.491+0000 7fe3e77fe640 1 -- 172.21.15.38:0/3204876144 learned_addr learned my addr 172.21.15.38:0/3204876144 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:20:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.491+0000 7fe3e77fe640 1 -- 172.21.15.38:0/3204876144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8079ec0 con 0x7fe3e8105f00 2024-09-13T18:20:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.492+0000 7fe3e77fe640 1 --2- 172.21.15.38:0/3204876144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 0x7fe3e81082f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009820 tx=0x7fe3d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5920fb0da4bac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:20:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.492+0000 7fe3e67fc640 1 -- 172.21.15.38:0/3204876144 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3d802ad40 con 0x7fe3e8105f00 2024-09-13T18:20:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.492+0000 7fe3e67fc640 1 -- 172.21.15.38:0/3204876144 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fe3d8032890 con 0x7fe3e8105f00 2024-09-13T18:20:49.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.492+0000 7fe3e67fc640 1 -- 172.21.15.38:0/3204876144 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3d80307d0 con 0x7fe3e8105f00 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.493+0000 7fe3ee04f640 1 -- 172.21.15.38:0/3204876144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 msgr2=0x7fe3e81082f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.493+0000 7fe3ee04f640 1 --2- 172.21.15.38:0/3204876144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 0x7fe3e81082f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009820 tx=0x7fe3d802a270 comp rx=0 tx=0).stop 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.493+0000 7fe3ee04f640 1 -- 172.21.15.38:0/3204876144 shutdown_connections 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.493+0000 7fe3ee04f640 1 --2- 172.21.15.38:0/3204876144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 0x7fe3e81082f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.493+0000 7fe3ee04f640 1 -- 172.21.15.38:0/3204876144 >> 172.21.15.38:0/3204876144 conn(0x7fe3e80ffb20 msgr2=0x7fe3e8101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.493+0000 7fe3ee04f640 1 -- 172.21.15.38:0/3204876144 shutdown_connections 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.493+0000 7fe3ee04f640 1 -- 172.21.15.38:0/3204876144 wait complete. 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.494+0000 7fe3ee04f640 1 Processor -- start 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.494+0000 7fe3ee04f640 1 -- start start 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.494+0000 7fe3ee04f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 0x7fe3e8199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.494+0000 7fe3ee04f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e8199660 con 0x7fe3e8105f00 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.494+0000 7fe3e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 0x7fe3e8199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.494+0000 7fe3e77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 0x7fe3e8199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45604/0 (socket says 172.21.15.38:45604) 2024-09-13T18:20:49.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.494+0000 7fe3e77fe640 1 -- 172.21.15.38:0/2299175806 learned_addr learned my addr 172.21.15.38:0/2299175806 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.494+0000 7fe3e77fe640 1 -- 172.21.15.38:0/2299175806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d80094d0 con 0x7fe3e8105f00 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.495+0000 7fe3e77fe640 1 --2- 172.21.15.38:0/2299175806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 0x7fe3e8199120 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8030380 tx=0x7fe3d8030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.495+0000 7fe3e4ff9640 1 -- 172.21.15.38:0/2299175806 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3d8030ed0 con 0x7fe3e8105f00 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.495+0000 7fe3e4ff9640 1 -- 172.21.15.38:0/2299175806 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fe3d8032c10 con 0x7fe3e8105f00 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.495+0000 7fe3ee04f640 1 -- 172.21.15.38:0/2299175806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e8199860 con 0x7fe3e8105f00 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.495+0000 7fe3e4ff9640 1 -- 172.21.15.38:0/2299175806 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3d803a560 con 0x7fe3e8105f00 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.495+0000 7fe3ee04f640 1 -- 172.21.15.38:0/2299175806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e8199d00 con 0x7fe3e8105f00 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.495+0000 7fe3e4ff9640 1 -- 172.21.15.38:0/2299175806 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe3d803ab20 con 0x7fe3e8105f00 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.495+0000 7fe3e4ff9640 1 -- 172.21.15.38:0/2299175806 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe3d8046d00 con 0x7fe3e8105f00 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.496+0000 7fe3ee04f640 1 -- 172.21.15.38:0/2299175806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e81094b0 con 0x7fe3e8105f00 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.498+0000 7fe3e4ff9640 1 -- 172.21.15.38:0/2299175806 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe3e8079ec0 con 0x7fe3e8105f00 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.556+0000 7fe3ee04f640 1 -- 172.21.15.38:0/2299175806 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fe3e81096a0 con 0x7fe3e8105f00 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.557+0000 7fe3e4ff9640 1 -- 172.21.15.38:0/2299175806 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fe3d8037070 con 0x7fe3e8105f00 2024-09-13T18:20:49.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.557+0000 7fe3ee04f640 1 -- 172.21.15.38:0/2299175806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 msgr2=0x7fe3e8199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:20:49.113 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.557+0000 7fe3ee04f640 1 --2- 172.21.15.38:0/2299175806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 0x7fe3e8199120 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8030380 tx=0x7fe3d8030cc0 comp rx=0 tx=0).stop 2024-09-13T18:20:49.113 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.558+0000 7fe3ee04f640 1 -- 172.21.15.38:0/2299175806 shutdown_connections 2024-09-13T18:20:49.113 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.558+0000 7fe3ee04f640 1 --2- 172.21.15.38:0/2299175806 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3e8105f00 0x7fe3e8199120 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:20:49.113 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.558+0000 7fe3ee04f640 1 -- 172.21.15.38:0/2299175806 >> 172.21.15.38:0/2299175806 conn(0x7fe3e80ffb20 msgr2=0x7fe3e8100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:20:49.113 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.558+0000 7fe3ee04f640 1 -- 172.21.15.38:0/2299175806 shutdown_connections 2024-09-13T18:20:49.113 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:48.558+0000 7fe3ee04f640 1 -- 172.21.15.38:0/2299175806 wait complete. 2024-09-13T18:20:49.113 INFO:teuthology.orchestra.run.smithi038.stdout:Restarting the monitor... 2024-09-13T18:20:49.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:49 smithi038 systemd[1]: Stopping Ceph mon.smithi038 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:20:49.735 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:49 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038[27318]: 2024-09-13T18:20:49.357+0000 7f017e444640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi038 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:20:49.735 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:49 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038[27318]: 2024-09-13T18:20:49.357+0000 7f017e444640 -1 mon.smithi038@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T18:20:49.735 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:49 smithi038 podman[27564]: 2024-09-13 18:20:49.553011552 +0000 UTC m=+0.283376469 container died aaa2560068ab8b0c8400a89b9ed91ba46d776cd79a656a8bba05add39e37444b (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=reef-e4e227b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T18:20:50.069 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:49 smithi038 podman[27564]: 2024-09-13 18:20:49.824016616 +0000 UTC m=+0.554381523 container cleanup aaa2560068ab8b0c8400a89b9ed91ba46d776cd79a656a8bba05add39e37444b (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-e4e227b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T18:20:50.069 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:49 smithi038 bash[27564]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038 2024-09-13T18:20:50.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 podman[27576]: 2024-09-13 18:20:50.066673272 +0000 UTC m=+0.514571412 container remove aaa2560068ab8b0c8400a89b9ed91ba46d776cd79a656a8bba05add39e37444b (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=reef-e4e227b, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-13T18:20:50.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi038.service: Deactivated successfully. 2024-09-13T18:20:50.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 systemd[1]: Stopped Ceph mon.smithi038 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:20:50.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 systemd[1]: Starting Ceph mon.smithi038 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:20:50.670 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 podman[27670]: 2024-09-13 18:20:50.300932529 +0000 UTC m=+0.016708940 image pull 67ddd33fa72f26a51c969a9043e7a3ddf784506b3d1949ad815ae4dd791beec1 quay.ceph.io/ceph-ci/ceph:reef 2024-09-13T18:20:50.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 podman[27670]: 2024-09-13 18:20:50.409138827 +0000 UTC m=+0.124915223 container create b654a36a9082ebd6a1e52701c0a775e0e2f67663814b3ebbe57edbf6c1136212 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-e4e227b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T18:20:50.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 podman[27670]: 2024-09-13 18:20:50.644964856 +0000 UTC m=+0.360741253 container init b654a36a9082ebd6a1e52701c0a775e0e2f67663814b3ebbe57edbf6c1136212 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=reef-e4e227b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T18:20:50.671 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 podman[27670]: 2024-09-13 18:20:50.648081673 +0000 UTC m=+0.363858072 container start b654a36a9082ebd6a1e52701c0a775e0e2f67663814b3ebbe57edbf6c1136212 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T18:20:50.759 INFO:teuthology.orchestra.run.smithi038.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T18:20:50.975 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable), process ceph-mon, pid 2 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: pidfile_write: ignore empty --pid-file 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: load: jerasure load: lrc 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: RocksDB version: 7.9.2 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Git sha 0 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Compile date 2024-09-13 16:45:57 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: DB SUMMARY 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: DB Session ID: 4T86U8D0MH8FTQMSOS9I 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: CURRENT file: CURRENT 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi038/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T18:20:50.976 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi038/store.db: 000009.log size: 98006 ; 2024-09-13T18:20:50.977 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.error_if_exists: 0 2024-09-13T18:20:50.977 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.create_if_missing: 0 2024-09-13T18:20:50.977 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.paranoid_checks: 1 2024-09-13T18:20:50.977 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T18:20:50.977 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T18:20:50.977 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T18:20:50.977 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.env: 0x563235c9cbc0 2024-09-13T18:20:50.977 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T18:20:50.977 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.info_log: 0x5632377e4dc0 2024-09-13T18:20:50.977 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T18:20:50.977 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.statistics: (nil) 2024-09-13T18:20:50.977 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.use_fsync: 0 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_log_file_size: 0 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.allow_fallocate: 1 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.use_direct_reads: 0 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.db_log_dir: 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.wal_dir: 2024-09-13T18:20:50.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T18:20:50.980 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T18:20:50.980 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T18:20:50.980 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T18:20:50.980 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T18:20:50.980 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T18:20:50.980 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T18:20:50.980 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T18:20:50.980 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.write_buffer_manager: 0x5632377f2320 2024-09-13T18:20:50.980 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T18:20:50.980 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.unordered_write: 0 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.row_cache: None 2024-09-13T18:20:50.981 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.wal_filter: None 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.two_write_queues: 0 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.wal_compression: 0 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.atomic_flush: 0 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.log_readahead_size: 0 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T18:20:50.982 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T18:20:50.983 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T18:20:50.983 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T18:20:50.983 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T18:20:50.983 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_background_jobs: 2 2024-09-13T18:20:50.983 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_background_compactions: -1 2024-09-13T18:20:50.983 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_subcompactions: 1 2024-09-13T18:20:50.983 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T18:20:50.983 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T18:20:50.983 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T18:20:50.983 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T18:20:50.983 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_open_files: -1 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_background_flushes: -1 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Compression algorithms supported: 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: kZSTD supported: 0 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: kXpressCompression supported: 0 2024-09-13T18:20:50.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: kBZip2Compression supported: 0 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: kLZ4Compression supported: 1 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: kZlibCompression supported: 1 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: kSnappyCompression supported: 1 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi038/store.db/MANIFEST-000010 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.merge_operator: 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_filter: None 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T18:20:50.985 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5632377e4a20) 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: cache_index_and_filter_blocks: 1 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: pin_top_level_index_and_filter: 1 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: index_type: 0 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: data_block_index_type: 0 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: index_shortening: 1 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: checksum: 4 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: no_block_cache: 0 2024-09-13T18:20:50.986 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache: 0x5632377d9350 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache_name: BinnedLRUCache 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache_options: 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: capacity : 536870912 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: num_shard_bits : 4 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: strict_capacity_limit : 0 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: high_pri_pool_ratio: 0.000 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache_compressed: (nil) 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: persistent_cache: (nil) 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_size: 4096 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_size_deviation: 10 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_restart_interval: 16 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: index_block_restart_interval: 1 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: metadata_block_size: 4096 2024-09-13T18:20:50.987 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: partition_filters: 0 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: use_delta_encoding: 1 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: filter_policy: bloomfilter 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: whole_key_filtering: 1 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: verify_compression: 0 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: read_amp_bytes_per_bit: 0 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: format_version: 5 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: enable_index_compression: 1 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_align: 0 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: max_auto_readahead_size: 262144 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: prepopulate_block_cache: 0 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: initial_auto_readahead_size: 8192 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T18:20:50.988 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compression: NoCompression 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.num_levels: 7 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T18:20:50.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T18:20:50.990 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T18:20:50.991 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T18:20:50.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.inplace_update_support: 0 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.bloom_locality: 0 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.max_successive_merges: 0 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T18:20:50.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.ttl: 2592000 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.enable_blob_files: false 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.min_blob_size: 0 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T18:20:50.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi038/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 394bf0cb-bfd2-49da-84eb-664a4c4f7be8 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726251650674824, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726251650675964, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93338, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 312, "table_properties": {"data_size": 91329, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13453, "raw_average_key_size": 49, "raw_value_size": 84001, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 271, "num_filter_entries": 271, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726251650, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "394bf0cb-bfd2-49da-84eb-664a4c4f7be8", "db_session_id": "4T86U8D0MH8FTQMSOS9I", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726251650676061, "job": 1, "event": "recovery_finished"} 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi038/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563237804e00 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: DB pointer 0x5632378f8000 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T18:20:50.995 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T18:20:50.996 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** DB Stats ** 2024-09-13T18:20:50.996 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T18:20:50.996 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T18:20:50.996 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T18:20:50.996 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T18:20:50.996 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T18:20:50.996 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T18:20:50.996 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T18:20:50.996 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:20:50.996 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** Compaction Stats [default] ** 2024-09-13T18:20:50.996 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T18:20:50.996 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: L0 2/0 93.05 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Sum 2/0 93.05 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** Compaction Stats [default] ** 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 118.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T18:20:50.997 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative compaction: 0.00 GB write, 15.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval compaction: 0.00 GB write, 15.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Block cache BinnedLRUCache@0x5632377d9350#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: starting mon.smithi038 rank 0 at public addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] at bind addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi038 fsid ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: mon.smithi038@-1(???) e1 preinit fsid ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: mon.smithi038@-1(???).mds e1 new map 2024-09-13T18:20:50.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: mon.smithi038@-1(???).mds e1 print_map 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: e1 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: legacy client fscid: -1 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: No filesystems configured 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: mon.smithi038@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: mon.smithi038@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: mon.smithi038@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: mon.smithi038@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: mon.smithi038@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: mon.smithi038 is new leader, mons smithi038 in quorum (ranks 0) 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: monmap e1: 1 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: fsmap 2024-09-13T18:20:50.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T18:20:51.000 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 ceph-mon[27689]: mgrmap e1: no daemons active 2024-09-13T18:20:51.000 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 bash[27670]: b654a36a9082ebd6a1e52701c0a775e0e2f67663814b3ebbe57edbf6c1136212 2024-09-13T18:20:51.000 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:50 smithi038 systemd[1]: Started Ceph mon.smithi038 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:20:51.839 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.205+0000 7f14f45fe640 1 Processor -- start 2024-09-13T18:20:51.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.206+0000 7f14f45fe640 1 -- start start 2024-09-13T18:20:51.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.206+0000 7f14f45fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 0x7f14ec108300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:20:51.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.206+0000 7f14f45fe640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec079da0 con 0x7f14ec105f10 2024-09-13T18:20:51.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.206+0000 7f14f239a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 0x7f14ec108300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:20:51.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.206+0000 7f14f239a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 0x7f14ec108300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45616/0 (socket says 172.21.15.38:45616) 2024-09-13T18:20:51.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.206+0000 7f14f239a640 1 -- 172.21.15.38:0/2597362527 learned_addr learned my addr 172.21.15.38:0/2597362527 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:20:51.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.207+0000 7f14f239a640 1 -- 172.21.15.38:0/2597362527 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec108840 con 0x7f14ec105f10 2024-09-13T18:20:51.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.209+0000 7f14f239a640 1 --2- 172.21.15.38:0/2597362527 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 0x7f14ec108300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009820 tx=0x7f14e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6e051aa26e22f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:20:51.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.209+0000 7f14f1398640 1 -- 172.21.15.38:0/2597362527 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14e802ad40 con 0x7f14ec105f10 2024-09-13T18:20:51.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.209+0000 7f14f1398640 1 -- 172.21.15.38:0/2597362527 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f14e8032890 con 0x7f14ec105f10 2024-09-13T18:20:51.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.209+0000 7f14f1398640 1 -- 172.21.15.38:0/2597362527 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14e80307d0 con 0x7f14ec105f10 2024-09-13T18:20:51.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.209+0000 7f14f45fe640 1 -- 172.21.15.38:0/2597362527 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 msgr2=0x7f14ec108300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:20:51.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.209+0000 7f14f45fe640 1 --2- 172.21.15.38:0/2597362527 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 0x7f14ec108300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009820 tx=0x7f14e802a270 comp rx=0 tx=0).stop 2024-09-13T18:20:51.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.209+0000 7f14f45fe640 1 -- 172.21.15.38:0/2597362527 shutdown_connections 2024-09-13T18:20:51.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.209+0000 7f14f45fe640 1 --2- 172.21.15.38:0/2597362527 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 0x7f14ec108300 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:20:51.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.209+0000 7f14f45fe640 1 -- 172.21.15.38:0/2597362527 >> 172.21.15.38:0/2597362527 conn(0x7f14ec0ffb50 msgr2=0x7f14ec101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:20:51.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.210+0000 7f14f45fe640 1 -- 172.21.15.38:0/2597362527 shutdown_connections 2024-09-13T18:20:51.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.210+0000 7f14f45fe640 1 -- 172.21.15.38:0/2597362527 wait complete. 2024-09-13T18:20:51.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.210+0000 7f14f45fe640 1 Processor -- start 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.210+0000 7f14f45fe640 1 -- start start 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.210+0000 7f14f45fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 0x7f14ec105790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.210+0000 7f14f45fe640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec105cd0 con 0x7f14ec105f10 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.210+0000 7f14f239a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 0x7f14ec105790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.211+0000 7f14f239a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 0x7f14ec105790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45628/0 (socket says 172.21.15.38:45628) 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.211+0000 7f14f239a640 1 -- 172.21.15.38:0/4609173 learned_addr learned my addr 172.21.15.38:0/4609173 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.211+0000 7f14f239a640 1 -- 172.21.15.38:0/4609173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e80094d0 con 0x7f14ec105f10 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.211+0000 7f14f239a640 1 --2- 172.21.15.38:0/4609173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 0x7f14ec105790 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f14e8030d40 tx=0x7f14e8030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.211+0000 7f14e37fe640 1 -- 172.21.15.38:0/4609173 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14e8032c10 con 0x7f14ec105f10 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.211+0000 7f14e37fe640 1 -- 172.21.15.38:0/4609173 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f14e8032d70 con 0x7f14ec105f10 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.211+0000 7f14f45fe640 1 -- 172.21.15.38:0/4609173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec103ec0 con 0x7f14ec105f10 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.211+0000 7f14e37fe640 1 -- 172.21.15.38:0/4609173 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14e803a560 con 0x7f14ec105f10 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.211+0000 7f14f45fe640 1 -- 172.21.15.38:0/4609173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec104360 con 0x7f14ec105f10 2024-09-13T18:20:51.846 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.211+0000 7f14e37fe640 1 -- 172.21.15.38:0/4609173 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f14e803ab20 con 0x7f14ec105f10 2024-09-13T18:20:51.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.212+0000 7f14e37fe640 1 -- 172.21.15.38:0/4609173 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f14e8046db0 con 0x7f14ec105f10 2024-09-13T18:20:51.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.212+0000 7f14f45fe640 1 -- 172.21.15.38:0/4609173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ec1094d0 con 0x7f14ec105f10 2024-09-13T18:20:51.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.214+0000 7f14e37fe640 1 -- 172.21.15.38:0/4609173 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f14e8037070 con 0x7f14ec105f10 2024-09-13T18:20:51.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.272+0000 7f14f45fe640 1 -- 172.21.15.38:0/4609173 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f14ec1047a0 con 0x7f14ec105f10 2024-09-13T18:20:51.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.275+0000 7f14e37fe640 1 -- 172.21.15.38:0/4609173 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f14e8046460 con 0x7f14ec105f10 2024-09-13T18:20:51.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.276+0000 7f14f45fe640 1 -- 172.21.15.38:0/4609173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 msgr2=0x7f14ec105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:20:51.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.276+0000 7f14f45fe640 1 --2- 172.21.15.38:0/4609173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 0x7f14ec105790 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f14e8030d40 tx=0x7f14e8030d70 comp rx=0 tx=0).stop 2024-09-13T18:20:51.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.276+0000 7f14f45fe640 1 -- 172.21.15.38:0/4609173 shutdown_connections 2024-09-13T18:20:51.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.276+0000 7f14f45fe640 1 --2- 172.21.15.38:0/4609173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f14ec105f10 0x7f14ec105790 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:20:51.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.276+0000 7f14f45fe640 1 -- 172.21.15.38:0/4609173 >> 172.21.15.38:0/4609173 conn(0x7f14ec0ffb50 msgr2=0x7f14ec100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:20:51.847 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.276+0000 7f14f45fe640 1 -- 172.21.15.38:0/4609173 shutdown_connections 2024-09-13T18:20:51.848 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:51.276+0000 7f14f45fe640 1 -- 172.21.15.38:0/4609173 wait complete. 2024-09-13T18:20:51.848 INFO:teuthology.orchestra.run.smithi038.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T18:20:51.870 INFO:teuthology.orchestra.run.smithi038.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:20:51.870 INFO:teuthology.orchestra.run.smithi038.stdout:Creating mgr... 2024-09-13T18:20:51.870 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T18:20:51.870 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T18:20:51.871 INFO:teuthology.orchestra.run.smithi038.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-13T18:20:52.137 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mgr.smithi038.jeygoq 2024-09-13T18:20:52.137 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mgr.smithi038.jeygoq.service: Unit ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mgr.smithi038.jeygoq.service not loaded. 2024-09-13T18:20:52.288 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ccb73e88-71fc-11ef-bceb-c7b262605968.target.wants/ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mgr.smithi038.jeygoq.service → /etc/systemd/system/ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@.service. 2024-09-13T18:20:52.525 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:52 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/4609173' entity='client.admin' 2024-09-13T18:20:52.811 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T18:20:52.811 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2024-09-13T18:20:52.818 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T18:20:52.818 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-13T18:20:52.819 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2024-09-13T18:20:52.819 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T18:20:52.827 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T18:20:52.827 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2024-09-13T18:20:52.835 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T18:20:52.836 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-13T18:20:52.836 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2024-09-13T18:20:52.836 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-13T18:20:52.836 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr to start... 2024-09-13T18:20:52.837 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr... 2024-09-13T18:20:53.647 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:53 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3600747484' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T18:20:53.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-13T18:20:54.009 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:20:54.009 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "ccb73e88-71fc-11ef-bceb-c7b262605968", 2024-09-13T18:20:54.009 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T18:20:54.009 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T18:20:54.009 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T18:20:54.009 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T18:20:54.009 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "smithi038" 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T18:20:54.010 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:54.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T18:20:54.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:20:54.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T18:20:54.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T18:20:54.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T18:20:54.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T18:20:54.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T18:20:54.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T18:20:54.011 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:54.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T18:20:54.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T18:20:54.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T18:20:54.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T18:20:54.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T18:20:54.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T18:20:54.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T18:20:54.012 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T18:20:54.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T18:20:45.976317+0000", 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.272+0000 7f0769bcc640 1 Processor -- start 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.272+0000 7f0769bcc640 1 -- start start 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.272+0000 7f0769bcc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 0x7f07641046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:20:54.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.272+0000 7f0769bcc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0764104ca0 con 0x7f07641042d0 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.272+0000 7f07637fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 0x7f07641046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.272+0000 7f07637fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 0x7f07641046d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41240/0 (socket says 172.21.15.38:41240) 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.272+0000 7f07637fe640 1 -- 172.21.15.38:0/3546143703 learned_addr learned my addr 172.21.15.38:0/3546143703 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.273+0000 7f07637fe640 1 -- 172.21.15.38:0/3546143703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07641054d0 con 0x7f07641042d0 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.274+0000 7f07637fe640 1 --2- 172.21.15.38:0/3546143703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 0x7f07641046d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0754009820 tx=0x7f075402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc74af702f851d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.274+0000 7f07627fc640 1 -- 172.21.15.38:0/3546143703 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f075402ad40 con 0x7f07641042d0 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.274+0000 7f07627fc640 1 -- 172.21.15.38:0/3546143703 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f0754032890 con 0x7f07641042d0 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.274+0000 7f07627fc640 1 -- 172.21.15.38:0/3546143703 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07540307d0 con 0x7f07641042d0 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.274+0000 7f0769bcc640 1 -- 172.21.15.38:0/3546143703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 msgr2=0x7f07641046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.274+0000 7f0769bcc640 1 --2- 172.21.15.38:0/3546143703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 0x7f07641046d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0754009820 tx=0x7f075402a270 comp rx=0 tx=0).stop 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.275+0000 7f0769bcc640 1 -- 172.21.15.38:0/3546143703 shutdown_connections 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.275+0000 7f0769bcc640 1 --2- 172.21.15.38:0/3546143703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 0x7f07641046d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.275+0000 7f0769bcc640 1 -- 172.21.15.38:0/3546143703 >> 172.21.15.38:0/3546143703 conn(0x7f07640ffb00 msgr2=0x7f0764101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:20:54.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.275+0000 7f0769bcc640 1 -- 172.21.15.38:0/3546143703 shutdown_connections 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.275+0000 7f0769bcc640 1 -- 172.21.15.38:0/3546143703 wait complete. 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.275+0000 7f0769bcc640 1 Processor -- start 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.276+0000 7f0769bcc640 1 -- start start 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.276+0000 7f0769bcc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 0x7f076418f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.276+0000 7f0769bcc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076418f960 con 0x7f07641042d0 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.276+0000 7f07637fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 0x7f076418f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.276+0000 7f07637fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 0x7f076418f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41248/0 (socket says 172.21.15.38:41248) 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.276+0000 7f07637fe640 1 -- 172.21.15.38:0/3600747484 learned_addr learned my addr 172.21.15.38:0/3600747484 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.276+0000 7f07637fe640 1 -- 172.21.15.38:0/3600747484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540094d0 con 0x7f07641042d0 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.276+0000 7f07637fe640 1 --2- 172.21.15.38:0/3600747484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 0x7f076418f420 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0754009940 tx=0x7f0754030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.277+0000 7f0760ff9640 1 -- 172.21.15.38:0/3600747484 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0754040070 con 0x7f07641042d0 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.277+0000 7f0769bcc640 1 -- 172.21.15.38:0/3600747484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076418db50 con 0x7f07641042d0 2024-09-13T18:20:54.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.277+0000 7f0760ff9640 1 -- 172.21.15.38:0/3600747484 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f0754032c10 con 0x7f07641042d0 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.277+0000 7f0760ff9640 1 -- 172.21.15.38:0/3600747484 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f075403a560 con 0x7f07641042d0 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.277+0000 7f0769bcc640 1 -- 172.21.15.38:0/3600747484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076418dff0 con 0x7f07641042d0 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.277+0000 7f0760ff9640 1 -- 172.21.15.38:0/3600747484 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f075403a9c0 con 0x7f07641042d0 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.277+0000 7f0760ff9640 1 -- 172.21.15.38:0/3600747484 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0754045c70 con 0x7f07641042d0 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.278+0000 7f0769bcc640 1 -- 172.21.15.38:0/3600747484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076418e9f0 con 0x7f07641042d0 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.280+0000 7f0760ff9640 1 -- 172.21.15.38:0/3600747484 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f0754037070 con 0x7f07641042d0 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.343+0000 7f0769bcc640 1 -- 172.21.15.38:0/3600747484 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0764104750 con 0x7f07641042d0 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.343+0000 7f0760ff9640 1 -- 172.21.15.38:0/3600747484 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f0754032d80 con 0x7f07641042d0 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.344+0000 7f0769bcc640 1 -- 172.21.15.38:0/3600747484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 msgr2=0x7f076418f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.344+0000 7f0769bcc640 1 --2- 172.21.15.38:0/3600747484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 0x7f076418f420 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0754009940 tx=0x7f0754030cc0 comp rx=0 tx=0).stop 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.344+0000 7f0769bcc640 1 -- 172.21.15.38:0/3600747484 shutdown_connections 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.344+0000 7f0769bcc640 1 --2- 172.21.15.38:0/3600747484 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07641042d0 0x7f076418f420 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.344+0000 7f0769bcc640 1 -- 172.21.15.38:0/3600747484 >> 172.21.15.38:0/3600747484 conn(0x7f07640ffb00 msgr2=0x7f0764100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:20:54.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.345+0000 7f0769bcc640 1 -- 172.21.15.38:0/3600747484 shutdown_connections 2024-09-13T18:20:54.018 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:53.345+0000 7f0769bcc640 1 -- 172.21.15.38:0/3600747484 wait complete. 2024-09-13T18:20:54.018 INFO:teuthology.orchestra.run.smithi038.stdout:mgr not available, waiting (1/15)... 2024-09-13T18:20:56.580 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:56 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3862003394' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T18:20:57.143 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "ccb73e88-71fc-11ef-bceb-c7b262605968", 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T18:20:57.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "smithi038" 2024-09-13T18:20:57.145 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:20:57.145 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-13T18:20:57.145 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T18:20:57.145 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:20:57.145 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T18:20:57.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T18:20:57.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:57.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T18:20:57.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:20:57.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T18:20:57.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T18:20:57.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T18:20:57.154 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T18:20:57.154 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T18:20:57.154 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T18:20:57.154 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:57.154 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T18:20:57.154 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T18:20:57.154 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T18:20:57.154 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T18:20:57.155 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T18:20:45.976317+0000", 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:20:57.156 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.404+0000 7f1946f0c640 1 Processor -- start 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.404+0000 7f1946f0c640 1 -- start start 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.404+0000 7f1946f0c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 0x7f1940108320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.404+0000 7f1946f0c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1940073ad0 con 0x7f1940105f30 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.404+0000 7f1944ca8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 0x7f1940108320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.404+0000 7f1944ca8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 0x7f1940108320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41264/0 (socket says 172.21.15.38:41264) 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.404+0000 7f1944ca8640 1 -- 172.21.15.38:0/3407736149 learned_addr learned my addr 172.21.15.38:0/3407736149 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.405+0000 7f1944ca8640 1 -- 172.21.15.38:0/3407736149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1940108860 con 0x7f1940105f30 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.405+0000 7f1944ca8640 1 --2- 172.21.15.38:0/3407736149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 0x7f1940108320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1934009820 tx=0x7f193402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ca0c9038d8b119 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.406+0000 7f193f7fe640 1 -- 172.21.15.38:0/3407736149 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f193402ad40 con 0x7f1940105f30 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.406+0000 7f193f7fe640 1 -- 172.21.15.38:0/3407736149 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f1934032890 con 0x7f1940105f30 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.406+0000 7f193f7fe640 1 -- 172.21.15.38:0/3407736149 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19340307d0 con 0x7f1940105f30 2024-09-13T18:20:57.157 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.407+0000 7f1946f0c640 1 -- 172.21.15.38:0/3407736149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 msgr2=0x7f1940108320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.407+0000 7f1946f0c640 1 --2- 172.21.15.38:0/3407736149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 0x7f1940108320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1934009820 tx=0x7f193402a270 comp rx=0 tx=0).stop 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.407+0000 7f1946f0c640 1 -- 172.21.15.38:0/3407736149 shutdown_connections 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.407+0000 7f1946f0c640 1 --2- 172.21.15.38:0/3407736149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 0x7f1940108320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.407+0000 7f1946f0c640 1 -- 172.21.15.38:0/3407736149 >> 172.21.15.38:0/3407736149 conn(0x7f19400ffb50 msgr2=0x7f1940101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.407+0000 7f1946f0c640 1 -- 172.21.15.38:0/3407736149 shutdown_connections 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.407+0000 7f1946f0c640 1 -- 172.21.15.38:0/3407736149 wait complete. 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.408+0000 7f1946f0c640 1 Processor -- start 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.408+0000 7f1946f0c640 1 -- start start 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.408+0000 7f1946f0c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 0x7f1940199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.408+0000 7f1946f0c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19401996b0 con 0x7f1940105f30 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.408+0000 7f1944ca8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 0x7f1940199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.408+0000 7f1944ca8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 0x7f1940199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41268/0 (socket says 172.21.15.38:41268) 2024-09-13T18:20:57.158 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.408+0000 7f1944ca8640 1 -- 172.21.15.38:0/3862003394 learned_addr learned my addr 172.21.15.38:0/3862003394 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.409+0000 7f1944ca8640 1 -- 172.21.15.38:0/3862003394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340094d0 con 0x7f1940105f30 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.409+0000 7f1944ca8640 1 --2- 172.21.15.38:0/3862003394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 0x7f1940199170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1934030380 tx=0x7f1934030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.409+0000 7f193dffb640 1 -- 172.21.15.38:0/3862003394 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1934030ed0 con 0x7f1940105f30 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.409+0000 7f193dffb640 1 -- 172.21.15.38:0/3862003394 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f1934032c10 con 0x7f1940105f30 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.409+0000 7f193dffb640 1 -- 172.21.15.38:0/3862003394 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f193403a560 con 0x7f1940105f30 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.409+0000 7f1946f0c640 1 -- 172.21.15.38:0/3862003394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19401998b0 con 0x7f1940105f30 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.409+0000 7f1946f0c640 1 -- 172.21.15.38:0/3862003394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1940199d50 con 0x7f1940105f30 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.410+0000 7f193dffb640 1 -- 172.21.15.38:0/3862003394 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f193403aad0 con 0x7f1940105f30 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.410+0000 7f193dffb640 1 -- 172.21.15.38:0/3862003394 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1934046c70 con 0x7f1940105f30 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.410+0000 7f1946f0c640 1 -- 172.21.15.38:0/3862003394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1940109520 con 0x7f1940105f30 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.413+0000 7f193dffb640 1 -- 172.21.15.38:0/3862003394 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f1934037070 con 0x7f1940105f30 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.475+0000 7f1946f0c640 1 -- 172.21.15.38:0/3862003394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f194019c8f0 con 0x7f1940105f30 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.475+0000 7f193dffb640 1 -- 172.21.15.38:0/3862003394 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f1934032d80 con 0x7f1940105f30 2024-09-13T18:20:57.159 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.476+0000 7f1946f0c640 1 -- 172.21.15.38:0/3862003394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 msgr2=0x7f1940199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:20:57.160 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.476+0000 7f1946f0c640 1 --2- 172.21.15.38:0/3862003394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 0x7f1940199170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1934030380 tx=0x7f1934030cc0 comp rx=0 tx=0).stop 2024-09-13T18:20:57.160 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.476+0000 7f1946f0c640 1 -- 172.21.15.38:0/3862003394 shutdown_connections 2024-09-13T18:20:57.160 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.476+0000 7f1946f0c640 1 --2- 172.21.15.38:0/3862003394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1940105f30 0x7f1940199170 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:20:57.160 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.476+0000 7f1946f0c640 1 -- 172.21.15.38:0/3862003394 >> 172.21.15.38:0/3862003394 conn(0x7f19400ffb50 msgr2=0x7f1940100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:20:57.160 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.476+0000 7f1946f0c640 1 -- 172.21.15.38:0/3862003394 shutdown_connections 2024-09-13T18:20:57.160 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:56.476+0000 7f1946f0c640 1 -- 172.21.15.38:0/3862003394 wait complete. 2024-09-13T18:20:57.160 INFO:teuthology.orchestra.run.smithi038.stdout:mgr not available, waiting (2/15)... 2024-09-13T18:20:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: Activating manager daemon smithi038.jeygoq 2024-09-13T18:20:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: mgrmap e2: smithi038.jeygoq(active, starting, since 0.0047541s) 2024-09-13T18:20:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: from='mgr.14100 172.21.15.38:0/4158376784' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T18:20:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: from='mgr.14100 172.21.15.38:0/4158376784' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T18:20:58.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: from='mgr.14100 172.21.15.38:0/4158376784' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T18:20:58.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: from='mgr.14100 172.21.15.38:0/4158376784' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:20:58.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: from='mgr.14100 172.21.15.38:0/4158376784' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr metadata", "who": "smithi038.jeygoq", "id": "smithi038.jeygoq"}]: dispatch 2024-09-13T18:20:58.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: Manager daemon smithi038.jeygoq is now available 2024-09-13T18:20:58.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: from='mgr.14100 172.21.15.38:0/4158376784' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:20:58.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: from='mgr.14100 172.21.15.38:0/4158376784' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/trash_purge_schedule"}]: dispatch 2024-09-13T18:20:58.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: from='mgr.14100 172.21.15.38:0/4158376784' entity='mgr.smithi038.jeygoq' 2024-09-13T18:20:58.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: from='mgr.14100 172.21.15.38:0/4158376784' entity='mgr.smithi038.jeygoq' 2024-09-13T18:20:58.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:57 smithi038 ceph-mon[27689]: from='mgr.14100 172.21.15.38:0/4158376784' entity='mgr.smithi038.jeygoq' 2024-09-13T18:20:59.779 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:20:59 smithi038 ceph-mon[27689]: mgrmap e3: smithi038.jeygoq(active, since 1.00914s) 2024-09-13T18:21:00.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-13T18:21:00.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:21:00.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsid": "ccb73e88-71fc-11ef-bceb-c7b262605968", 2024-09-13T18:21:00.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T18:21:00.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T18:21:00.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T18:21:00.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T18:21:00.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:21:00.316 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 0 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "smithi038" 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:21:00.317 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T18:21:00.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T18:21:00.318 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T18:21:00.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T18:21:00.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T18:21:00.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T18:21:00.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:21:00.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T18:21:00.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T18:21:00.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T18:21:00.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T18:21:00.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T18:21:00.326 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T18:21:00.327 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ], 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T18:20:45.976317+0000", 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout }, 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.525+0000 7f616d393640 1 Processor -- start 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.525+0000 7f616d393640 1 -- start start 2024-09-13T18:21:00.328 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.525+0000 7f616d393640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 0x7f6168104110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.525+0000 7f616d393640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6168079d60 con 0x7f6168103d10 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.526+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 0x7f6168104110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.526+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 0x7f6168104110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41326/0 (socket says 172.21.15.38:41326) 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.526+0000 7f6166ffd640 1 -- 172.21.15.38:0/3037647328 learned_addr learned my addr 172.21.15.38:0/3037647328 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.526+0000 7f6166ffd640 1 -- 172.21.15.38:0/3037647328 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6168079ea0 con 0x7f6168103d10 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.527+0000 7f6166ffd640 1 --2- 172.21.15.38:0/3037647328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 0x7f6168104110 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6158009820 tx=0x7f615802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae14654ac1bd26c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.527+0000 7f61667fc640 1 -- 172.21.15.38:0/3037647328 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f615802ad40 con 0x7f6168103d10 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.527+0000 7f61667fc640 1 -- 172.21.15.38:0/3037647328 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f6158032890 con 0x7f6168103d10 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.527+0000 7f61667fc640 1 -- 172.21.15.38:0/3037647328 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61580307d0 con 0x7f6168103d10 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.528+0000 7f616d393640 1 -- 172.21.15.38:0/3037647328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 msgr2=0x7f6168104110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.528+0000 7f616d393640 1 --2- 172.21.15.38:0/3037647328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 0x7f6168104110 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6158009820 tx=0x7f615802a270 comp rx=0 tx=0).stop 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.528+0000 7f616d393640 1 -- 172.21.15.38:0/3037647328 shutdown_connections 2024-09-13T18:21:00.329 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.528+0000 7f616d393640 1 --2- 172.21.15.38:0/3037647328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 0x7f6168104110 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:00.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.528+0000 7f616d393640 1 -- 172.21.15.38:0/3037647328 >> 172.21.15.38:0/3037647328 conn(0x7f61680ffb20 msgr2=0x7f6168101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:00.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.528+0000 7f616d393640 1 -- 172.21.15.38:0/3037647328 shutdown_connections 2024-09-13T18:21:00.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.528+0000 7f616d393640 1 -- 172.21.15.38:0/3037647328 wait complete. 2024-09-13T18:21:00.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.529+0000 7f616d393640 1 Processor -- start 2024-09-13T18:21:00.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.529+0000 7f616d393640 1 -- start start 2024-09-13T18:21:00.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.529+0000 7f616d393640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 0x7f616819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:00.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.529+0000 7f616d393640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616819b830 con 0x7f6168103d10 2024-09-13T18:21:00.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.529+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 0x7f616819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:00.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.529+0000 7f6166ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 0x7f616819b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41334/0 (socket says 172.21.15.38:41334) 2024-09-13T18:21:00.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.529+0000 7f6166ffd640 1 -- 172.21.15.38:0/880140314 learned_addr learned my addr 172.21.15.38:0/880140314 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:00.330 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.529+0000 7f6166ffd640 1 -- 172.21.15.38:0/880140314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61580094d0 con 0x7f6168103d10 2024-09-13T18:21:00.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.530+0000 7f6166ffd640 1 --2- 172.21.15.38:0/880140314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 0x7f616819b2f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6158030380 tx=0x7f6158030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:00.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.530+0000 7f6164ff9640 1 -- 172.21.15.38:0/880140314 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6158030ed0 con 0x7f6168103d10 2024-09-13T18:21:00.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.530+0000 7f6164ff9640 1 -- 172.21.15.38:0/880140314 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f6158032c10 con 0x7f6168103d10 2024-09-13T18:21:00.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.530+0000 7f616d393640 1 -- 172.21.15.38:0/880140314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616819ba30 con 0x7f6168103d10 2024-09-13T18:21:00.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.530+0000 7f6164ff9640 1 -- 172.21.15.38:0/880140314 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f615803a560 con 0x7f6168103d10 2024-09-13T18:21:00.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.530+0000 7f616d393640 1 -- 172.21.15.38:0/880140314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616819bed0 con 0x7f6168103d10 2024-09-13T18:21:00.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.531+0000 7f6164ff9640 1 -- 172.21.15.38:0/880140314 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 3) v1 ==== 45439+0+0 (secure 0 0 0) 0x7f615803a7d0 con 0x7f6168103d10 2024-09-13T18:21:00.331 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.531+0000 7f6164ff9640 1 --2- 172.21.15.38:0/880140314 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7f6154038530 0x7f615403a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:00.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.531+0000 7f616d393640 1 -- 172.21.15.38:0/880140314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6168195000 con 0x7f6168103d10 2024-09-13T18:21:00.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.531+0000 7f6164ff9640 1 -- 172.21.15.38:0/880140314 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f615806b510 con 0x7f6168103d10 2024-09-13T18:21:00.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.531+0000 7f615ffff640 1 --2- 172.21.15.38:0/880140314 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7f6154038530 0x7f615403a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:00.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.532+0000 7f615ffff640 1 --2- 172.21.15.38:0/880140314 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7f6154038530 0x7f615403a9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f61500098c0 tx=0x7f6150006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:00.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.536+0000 7f6164ff9640 1 -- 172.21.15.38:0/880140314 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6158046460 con 0x7f6168103d10 2024-09-13T18:21:00.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.754+0000 7f6164ff9640 1 -- 172.21.15.38:0/880140314 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f615803c9e0 con 0x7f6168103d10 2024-09-13T18:21:00.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.774+0000 7f616d393640 1 -- 172.21.15.38:0/880140314 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6168105280 con 0x7f6168103d10 2024-09-13T18:21:00.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.774+0000 7f6164ff9640 1 -- 172.21.15.38:0/880140314 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1245 (secure 0 0 0) 0x7f6158039b40 con 0x7f6168103d10 2024-09-13T18:21:00.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.778+0000 7f616d393640 1 -- 172.21.15.38:0/880140314 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7f6154038530 msgr2=0x7f615403a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:00.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.778+0000 7f616d393640 1 --2- 172.21.15.38:0/880140314 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7f6154038530 0x7f615403a9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f61500098c0 tx=0x7f6150006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:00.332 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.778+0000 7f616d393640 1 -- 172.21.15.38:0/880140314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 msgr2=0x7f616819b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:00.333 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.778+0000 7f616d393640 1 --2- 172.21.15.38:0/880140314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 0x7f616819b2f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6158030380 tx=0x7f6158030cc0 comp rx=0 tx=0).stop 2024-09-13T18:21:00.333 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.778+0000 7f616d393640 1 -- 172.21.15.38:0/880140314 shutdown_connections 2024-09-13T18:21:00.333 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.778+0000 7f616d393640 1 --2- 172.21.15.38:0/880140314 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7f6154038530 0x7f615403a9f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:00.333 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.778+0000 7f616d393640 1 --2- 172.21.15.38:0/880140314 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6168103d10 0x7f616819b2f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:00.333 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.778+0000 7f616d393640 1 -- 172.21.15.38:0/880140314 >> 172.21.15.38:0/880140314 conn(0x7f61680ffb20 msgr2=0x7f61681921d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:00.333 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.778+0000 7f616d393640 1 -- 172.21.15.38:0/880140314 shutdown_connections 2024-09-13T18:21:00.333 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:20:59.778+0000 7f616d393640 1 -- 172.21.15.38:0/880140314 wait complete. 2024-09-13T18:21:00.333 INFO:teuthology.orchestra.run.smithi038.stdout:mgr is available 2024-09-13T18:21:00.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:00 smithi038 ceph-mon[27689]: mgrmap e4: smithi038.jeygoq(active, since 2s) 2024-09-13T18:21:00.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:00 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/880140314' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T18:21:01.514 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-13T18:21:01.514 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T18:21:01.514 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout fsid = ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:21:01.514 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T18:21:01.514 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T18:21:01.514 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T18:21:01.514 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T18:21:01.514 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-13T18:21:01.514 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T18:21:01.514 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.740+0000 7fe4bf5e7640 1 Processor -- start 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.740+0000 7fe4bf5e7640 1 -- start start 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.740+0000 7fe4bf5e7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 0x7fe4b81058c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.740+0000 7fe4bf5e7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b8105e90 con 0x7fe4b81054c0 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.740+0000 7fe4bd383640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 0x7fe4b81058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.740+0000 7fe4bd383640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 0x7fe4b81058c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41350/0 (socket says 172.21.15.38:41350) 2024-09-13T18:21:01.515 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.740+0000 7fe4bd383640 1 -- 172.21.15.38:0/3001643424 learned_addr learned my addr 172.21.15.38:0/3001643424 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.741+0000 7fe4bd383640 1 -- 172.21.15.38:0/3001643424 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b8106620 con 0x7fe4b81054c0 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.741+0000 7fe4bd383640 1 --2- 172.21.15.38:0/3001643424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 0x7fe4b81058c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009820 tx=0x7fe4b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3804d77a2baab5ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.742+0000 7fe4affff640 1 -- 172.21.15.38:0/3001643424 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4b402ad40 con 0x7fe4b81054c0 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.742+0000 7fe4affff640 1 -- 172.21.15.38:0/3001643424 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fe4b4032890 con 0x7fe4b81054c0 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.742+0000 7fe4affff640 1 -- 172.21.15.38:0/3001643424 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4b40307d0 con 0x7fe4b81054c0 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.742+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/3001643424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 msgr2=0x7fe4b81058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.742+0000 7fe4bf5e7640 1 --2- 172.21.15.38:0/3001643424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 0x7fe4b81058c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009820 tx=0x7fe4b402a270 comp rx=0 tx=0).stop 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.742+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/3001643424 shutdown_connections 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.742+0000 7fe4bf5e7640 1 --2- 172.21.15.38:0/3001643424 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 0x7fe4b81058c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.742+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/3001643424 >> 172.21.15.38:0/3001643424 conn(0x7fe4b8100c70 msgr2=0x7fe4b8103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.742+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/3001643424 shutdown_connections 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.742+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/3001643424 wait complete. 2024-09-13T18:21:01.516 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.743+0000 7fe4bf5e7640 1 Processor -- start 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.743+0000 7fe4bf5e7640 1 -- start start 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.743+0000 7fe4bf5e7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 0x7fe4b807baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.743+0000 7fe4bf5e7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b807c030 con 0x7fe4b81054c0 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.743+0000 7fe4bd383640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 0x7fe4b807baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.743+0000 7fe4bd383640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 0x7fe4b807baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41362/0 (socket says 172.21.15.38:41362) 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.743+0000 7fe4bd383640 1 -- 172.21.15.38:0/369459325 learned_addr learned my addr 172.21.15.38:0/369459325 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.743+0000 7fe4bd383640 1 -- 172.21.15.38:0/369459325 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b40094d0 con 0x7fe4b81054c0 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.744+0000 7fe4bd383640 1 --2- 172.21.15.38:0/369459325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 0x7fe4b807baf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40304c0 tx=0x7fe4b4030d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.744+0000 7fe4ae7fc640 1 -- 172.21.15.38:0/369459325 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4b4032c10 con 0x7fe4b81054c0 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.744+0000 7fe4ae7fc640 1 -- 172.21.15.38:0/369459325 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fe4b4032d70 con 0x7fe4b81054c0 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.744+0000 7fe4ae7fc640 1 -- 172.21.15.38:0/369459325 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4b403a560 con 0x7fe4b81054c0 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.744+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/369459325 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b807a220 con 0x7fe4b81054c0 2024-09-13T18:21:01.517 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.744+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/369459325 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b807a6c0 con 0x7fe4b81054c0 2024-09-13T18:21:01.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.745+0000 7fe4ae7fc640 1 -- 172.21.15.38:0/369459325 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7fe4b403c400 con 0x7fe4b81054c0 2024-09-13T18:21:01.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.745+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/369459325 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b8105940 con 0x7fe4b81054c0 2024-09-13T18:21:01.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.745+0000 7fe4ae7fc640 1 --2- 172.21.15.38:0/369459325 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fe4a4038650 0x7fe4a403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:01.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.745+0000 7fe4ae7fc640 1 -- 172.21.15.38:0/369459325 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe4b406b460 con 0x7fe4b81054c0 2024-09-13T18:21:01.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.745+0000 7fe4bcb82640 1 --2- 172.21.15.38:0/369459325 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fe4a4038650 0x7fe4a403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:01.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.746+0000 7fe4bcb82640 1 --2- 172.21.15.38:0/369459325 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fe4a4038650 0x7fe4a403ab10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80098c0 tx=0x7fe4a8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:01.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.750+0000 7fe4ae7fc640 1 -- 172.21.15.38:0/369459325 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe4b4031d70 con 0x7fe4b81054c0 2024-09-13T18:21:01.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.921+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/369459325 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fe4b807abb0 con 0x7fe4b81054c0 2024-09-13T18:21:01.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.922+0000 7fe4ae7fc640 1 -- 172.21.15.38:0/369459325 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fe4b4031b90 con 0x7fe4b81054c0 2024-09-13T18:21:01.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.924+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/369459325 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fe4a4038650 msgr2=0x7fe4a403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:01.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.924+0000 7fe4bf5e7640 1 --2- 172.21.15.38:0/369459325 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fe4a4038650 0x7fe4a403ab10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80098c0 tx=0x7fe4a8006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:01.518 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.924+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/369459325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 msgr2=0x7fe4b807baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:01.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.924+0000 7fe4bf5e7640 1 --2- 172.21.15.38:0/369459325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 0x7fe4b807baf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40304c0 tx=0x7fe4b4030d10 comp rx=0 tx=0).stop 2024-09-13T18:21:01.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.924+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/369459325 shutdown_connections 2024-09-13T18:21:01.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.924+0000 7fe4bf5e7640 1 --2- 172.21.15.38:0/369459325 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fe4a4038650 0x7fe4a403ab10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:01.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.924+0000 7fe4bf5e7640 1 --2- 172.21.15.38:0/369459325 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe4b81054c0 0x7fe4b807baf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:01.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.924+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/369459325 >> 172.21.15.38:0/369459325 conn(0x7fe4b8100c70 msgr2=0x7fe4b8101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:01.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.924+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/369459325 shutdown_connections 2024-09-13T18:21:01.519 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:00.924+0000 7fe4bf5e7640 1 -- 172.21.15.38:0/369459325 wait complete. 2024-09-13T18:21:01.519 INFO:teuthology.orchestra.run.smithi038.stdout:Enabling cephadm module... 2024-09-13T18:21:01.879 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:01 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/369459325' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T18:21:03.066 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:02 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/510500803' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T18:21:03.307 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.893+0000 7f275fa1d640 1 Processor -- start 2024-09-13T18:21:03.308 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.894+0000 7f275fa1d640 1 -- start start 2024-09-13T18:21:03.308 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.894+0000 7f275fa1d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 0x7f275807a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:03.308 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.894+0000 7f275fa1d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275807bfb0 con 0x7f275807a280 2024-09-13T18:21:03.308 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.894+0000 7f275d7b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 0x7f275807a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:03.308 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.894+0000 7f275d7b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 0x7f275807a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41378/0 (socket says 172.21.15.38:41378) 2024-09-13T18:21:03.308 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.894+0000 7f275d7b9640 1 -- 172.21.15.38:0/576022520 learned_addr learned my addr 172.21.15.38:0/576022520 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:03.308 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.894+0000 7f275d7b9640 1 -- 172.21.15.38:0/576022520 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275807abc0 con 0x7f275807a280 2024-09-13T18:21:03.308 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.895+0000 7f275d7b9640 1 --2- 172.21.15.38:0/576022520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 0x7f275807a680 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2754009820 tx=0x7f275402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fe5b9422664160 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:03.308 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.895+0000 7f274ffff640 1 -- 172.21.15.38:0/576022520 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f275402ad40 con 0x7f275807a280 2024-09-13T18:21:03.308 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.895+0000 7f274ffff640 1 -- 172.21.15.38:0/576022520 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f2754032890 con 0x7f275807a280 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.895+0000 7f274ffff640 1 -- 172.21.15.38:0/576022520 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27540307d0 con 0x7f275807a280 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.896+0000 7f275fa1d640 1 -- 172.21.15.38:0/576022520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 msgr2=0x7f275807a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.896+0000 7f275fa1d640 1 --2- 172.21.15.38:0/576022520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 0x7f275807a680 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2754009820 tx=0x7f275402a270 comp rx=0 tx=0).stop 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.896+0000 7f275fa1d640 1 -- 172.21.15.38:0/576022520 shutdown_connections 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.896+0000 7f275fa1d640 1 --2- 172.21.15.38:0/576022520 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 0x7f275807a680 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.896+0000 7f275fa1d640 1 -- 172.21.15.38:0/576022520 >> 172.21.15.38:0/576022520 conn(0x7f2758100c20 msgr2=0x7f2758103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.896+0000 7f275fa1d640 1 -- 172.21.15.38:0/576022520 shutdown_connections 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.896+0000 7f275fa1d640 1 -- 172.21.15.38:0/576022520 wait complete. 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.897+0000 7f275fa1d640 1 Processor -- start 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.897+0000 7f275fa1d640 1 -- start start 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.897+0000 7f275fa1d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 0x7f275819b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.897+0000 7f275fa1d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275819b960 con 0x7f275807a280 2024-09-13T18:21:03.309 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.897+0000 7f275d7b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 0x7f275819b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.897+0000 7f275d7b9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 0x7f275819b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41386/0 (socket says 172.21.15.38:41386) 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.897+0000 7f275d7b9640 1 -- 172.21.15.38:0/510500803 learned_addr learned my addr 172.21.15.38:0/510500803 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.897+0000 7f275d7b9640 1 -- 172.21.15.38:0/510500803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27540094d0 con 0x7f275807a280 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.897+0000 7f275d7b9640 1 --2- 172.21.15.38:0/510500803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 0x7f275819b420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2754030380 tx=0x7f2754030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.898+0000 7f274e7fc640 1 -- 172.21.15.38:0/510500803 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2754030ed0 con 0x7f275807a280 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.898+0000 7f274e7fc640 1 -- 172.21.15.38:0/510500803 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f2754032c10 con 0x7f275807a280 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.898+0000 7f275fa1d640 1 -- 172.21.15.38:0/510500803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275819bb60 con 0x7f275807a280 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.898+0000 7f274e7fc640 1 -- 172.21.15.38:0/510500803 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f275403a560 con 0x7f275807a280 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.898+0000 7f275fa1d640 1 -- 172.21.15.38:0/510500803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275819c000 con 0x7f275807a280 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.899+0000 7f274e7fc640 1 -- 172.21.15.38:0/510500803 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f275403a7d0 con 0x7f275807a280 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.899+0000 7f274e7fc640 1 --2- 172.21.15.38:0/510500803 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7f2744038650 0x7f274403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.899+0000 7f275fa1d640 1 -- 172.21.15.38:0/510500803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275810b7d0 con 0x7f275807a280 2024-09-13T18:21:03.310 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.899+0000 7f274e7fc640 1 -- 172.21.15.38:0/510500803 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f275406b590 con 0x7f275807a280 2024-09-13T18:21:03.311 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.899+0000 7f275cfb8640 1 --2- 172.21.15.38:0/510500803 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7f2744038650 0x7f274403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:03.311 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.899+0000 7f275cfb8640 1 --2- 172.21.15.38:0/510500803 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7f2744038650 0x7f274403ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27480098c0 tx=0x7f2748006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:03.311 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:01.904+0000 7f274e7fc640 1 -- 172.21.15.38:0/510500803 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2754039d50 con 0x7f275807a280 2024-09-13T18:21:03.311 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.119+0000 7f275fa1d640 1 -- 172.21.15.38:0/510500803 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f275810ba10 con 0x7f275807a280 2024-09-13T18:21:03.311 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.768+0000 7f274e7fc640 1 -- 172.21.15.38:0/510500803 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f275403c9e0 con 0x7f275807a280 2024-09-13T18:21:03.311 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.770+0000 7f274e7fc640 1 -- 172.21.15.38:0/510500803 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f2754044bf0 con 0x7f275807a280 2024-09-13T18:21:03.311 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.773+0000 7f275fa1d640 1 -- 172.21.15.38:0/510500803 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7f2744038650 msgr2=0x7f274403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:03.311 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.773+0000 7f275fa1d640 1 --2- 172.21.15.38:0/510500803 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7f2744038650 0x7f274403ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27480098c0 tx=0x7f2748006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:03.311 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.773+0000 7f275fa1d640 1 -- 172.21.15.38:0/510500803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 msgr2=0x7f275819b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:03.311 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.773+0000 7f275fa1d640 1 --2- 172.21.15.38:0/510500803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 0x7f275819b420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2754030380 tx=0x7f2754030cc0 comp rx=0 tx=0).stop 2024-09-13T18:21:03.311 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.773+0000 7f275fa1d640 1 -- 172.21.15.38:0/510500803 shutdown_connections 2024-09-13T18:21:03.312 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.773+0000 7f275fa1d640 1 --2- 172.21.15.38:0/510500803 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7f2744038650 0x7f274403ab10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:03.312 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.773+0000 7f275fa1d640 1 --2- 172.21.15.38:0/510500803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f275807a280 0x7f275819b420 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:03.312 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.773+0000 7f275fa1d640 1 -- 172.21.15.38:0/510500803 >> 172.21.15.38:0/510500803 conn(0x7f2758100c20 msgr2=0x7f2758101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:03.312 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.773+0000 7f275fa1d640 1 -- 172.21.15.38:0/510500803 shutdown_connections 2024-09-13T18:21:03.312 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:02.773+0000 7f275fa1d640 1 -- 172.21.15.38:0/510500803 wait complete. 2024-09-13T18:21:04.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:03 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/510500803' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T18:21:04.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:03 smithi038 ceph-mon[27689]: mgrmap e5: smithi038.jeygoq(active, since 5s) 2024-09-13T18:21:06.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:06 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/730031793' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T18:21:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: Active manager daemon smithi038.jeygoq restarted 2024-09-13T18:21:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: Activating manager daemon smithi038.jeygoq 2024-09-13T18:21:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T18:21:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: mgrmap e6: smithi038.jeygoq(active, starting, since 0.00567835s) 2024-09-13T18:21:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:21:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr metadata", "who": "smithi038.jeygoq", "id": "smithi038.jeygoq"}]: dispatch 2024-09-13T18:21:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T18:21:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T18:21:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T18:21:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: Manager daemon smithi038.jeygoq is now available 2024-09-13T18:21:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:21:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:21:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:21:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:07 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/trash_purge_schedule"}]: dispatch 2024-09-13T18:21:10.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:09 smithi038 ceph-mon[27689]: Found migration_current of "None". Setting to last migration. 2024-09-13T18:21:10.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:09 smithi038 ceph-mon[27689]: mgrmap e7: smithi038.jeygoq(active, since 1.00769s) 2024-09-13T18:21:10.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:09 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:10.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:09 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:11.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:11 smithi038 ceph-mon[27689]: mgrmap e8: smithi038.jeygoq(active, since 2s) 2024-09-13T18:21:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:11 smithi038 ceph-mon[27689]: [13/Sep/2024:18:21:10] ENGINE Bus STARTING 2024-09-13T18:21:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:11 smithi038 ceph-mon[27689]: [13/Sep/2024:18:21:10] ENGINE Serving on https://172.21.15.38:7150 2024-09-13T18:21:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:11 smithi038 ceph-mon[27689]: [13/Sep/2024:18:21:10] ENGINE Error in HTTPServer.serve 2024-09-13T18:21:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Traceback (most recent call last): 2024-09-13T18:21:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T18:21:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._connections.run(self.expiration_interval) 2024-09-13T18:21:11.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T18:21:11.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._run(expiration_interval) 2024-09-13T18:21:11.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T18:21:11.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T18:21:11.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T18:21:11.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T18:21:11.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T18:21:11.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: s = self.context.wrap_socket( 2024-09-13T18:21:11.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T18:21:11.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: return self.sslsocket_class._create( 2024-09-13T18:21:11.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T18:21:11.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self.do_handshake() 2024-09-13T18:21:11.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T18:21:11.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._sslobj.do_handshake() 2024-09-13T18:21:11.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T18:21:11.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:11 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:21:12.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:12 smithi038 ceph-mon[27689]: [13/Sep/2024:18:21:10] ENGINE Serving on http://172.21.15.38:8765 2024-09-13T18:21:12.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:12 smithi038 ceph-mon[27689]: [13/Sep/2024:18:21:10] ENGINE Bus STARTED 2024-09-13T18:21:12.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:21:12.980 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T18:21:12.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T18:21:12.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "active_name": "smithi038.jeygoq", 2024-09-13T18:21:12.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T18:21:12.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:21:12.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.139+0000 7fa151e21640 1 Processor -- start 2024-09-13T18:21:12.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.139+0000 7fa151e21640 1 -- start start 2024-09-13T18:21:12.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.140+0000 7fa151e21640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 0x7fa14c1082a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:12.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.140+0000 7fa151e21640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c073b50 con 0x7fa14c105eb0 2024-09-13T18:21:12.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.140+0000 7fa14b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 0x7fa14c1082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:12.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.140+0000 7fa14b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 0x7fa14c1082a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32782/0 (socket says 172.21.15.38:32782) 2024-09-13T18:21:12.981 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.140+0000 7fa14b7fe640 1 -- 172.21.15.38:0/3638277190 learned_addr learned my addr 172.21.15.38:0/3638277190 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.140+0000 7fa14b7fe640 1 -- 172.21.15.38:0/3638277190 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c1087e0 con 0x7fa14c105eb0 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.141+0000 7fa14b7fe640 1 --2- 172.21.15.38:0/3638277190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 0x7fa14c1082a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa13c009820 tx=0x7fa13c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2875b825ef6ff8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.141+0000 7fa14a7fc640 1 -- 172.21.15.38:0/3638277190 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa13c02ad40 con 0x7fa14c105eb0 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.141+0000 7fa14a7fc640 1 -- 172.21.15.38:0/3638277190 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fa13c032890 con 0x7fa14c105eb0 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.141+0000 7fa14a7fc640 1 -- 172.21.15.38:0/3638277190 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa13c0307d0 con 0x7fa14c105eb0 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.142+0000 7fa151e21640 1 -- 172.21.15.38:0/3638277190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 msgr2=0x7fa14c1082a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.142+0000 7fa151e21640 1 --2- 172.21.15.38:0/3638277190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 0x7fa14c1082a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa13c009820 tx=0x7fa13c02a270 comp rx=0 tx=0).stop 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.142+0000 7fa151e21640 1 -- 172.21.15.38:0/3638277190 shutdown_connections 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.142+0000 7fa151e21640 1 --2- 172.21.15.38:0/3638277190 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 0x7fa14c1082a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.142+0000 7fa151e21640 1 -- 172.21.15.38:0/3638277190 >> 172.21.15.38:0/3638277190 conn(0x7fa14c0ffb50 msgr2=0x7fa14c101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.142+0000 7fa151e21640 1 -- 172.21.15.38:0/3638277190 shutdown_connections 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.142+0000 7fa151e21640 1 -- 172.21.15.38:0/3638277190 wait complete. 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.142+0000 7fa151e21640 1 Processor -- start 2024-09-13T18:21:12.982 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.143+0000 7fa151e21640 1 -- start start 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.143+0000 7fa151e21640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 0x7fa14c105730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.143+0000 7fa151e21640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c105c70 con 0x7fa14c105eb0 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.143+0000 7fa14b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 0x7fa14c105730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.143+0000 7fa14b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 0x7fa14c105730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:32796/0 (socket says 172.21.15.38:32796) 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.143+0000 7fa14b7fe640 1 -- 172.21.15.38:0/730031793 learned_addr learned my addr 172.21.15.38:0/730031793 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.143+0000 7fa14b7fe640 1 -- 172.21.15.38:0/730031793 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c0094d0 con 0x7fa14c105eb0 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.144+0000 7fa14b7fe640 1 --2- 172.21.15.38:0/730031793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 0x7fa14c105730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa13c030d40 tx=0x7fa13c030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.144+0000 7fa148ff9640 1 -- 172.21.15.38:0/730031793 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa13c032c10 con 0x7fa14c105eb0 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.144+0000 7fa151e21640 1 -- 172.21.15.38:0/730031793 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14c103e60 con 0x7fa14c105eb0 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.144+0000 7fa148ff9640 1 -- 172.21.15.38:0/730031793 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fa13c032d70 con 0x7fa14c105eb0 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.144+0000 7fa148ff9640 1 -- 172.21.15.38:0/730031793 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa13c03a560 con 0x7fa14c105eb0 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.144+0000 7fa151e21640 1 -- 172.21.15.38:0/730031793 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14c104300 con 0x7fa14c105eb0 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.145+0000 7fa148ff9640 1 -- 172.21.15.38:0/730031793 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fa13c03a7d0 con 0x7fa14c105eb0 2024-09-13T18:21:12.983 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.145+0000 7fa148ff9640 1 --2- 172.21.15.38:0/730031793 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fa134038650 0x7fa13403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.145+0000 7fa148ff9640 1 -- 172.21.15.38:0/730031793 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa13c06b580 con 0x7fa14c105eb0 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.145+0000 7fa14affd640 1 -- 172.21.15.38:0/730031793 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fa134038650 msgr2=0x7fa13403ab10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3745740953 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.145+0000 7fa14affd640 1 --2- 172.21.15.38:0/730031793 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fa134038650 0x7fa13403ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.145+0000 7fa151e21640 1 -- 172.21.15.38:0/730031793 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14c106310 con 0x7fa14c105eb0 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.150+0000 7fa148ff9640 1 -- 172.21.15.38:0/730031793 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa13c046460 con 0x7fa14c105eb0 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.346+0000 7fa14affd640 1 -- 172.21.15.38:0/730031793 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fa134038650 msgr2=0x7fa13403ab10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/3745740953 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.346+0000 7fa14affd640 1 --2- 172.21.15.38:0/730031793 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fa134038650 0x7fa13403ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.384+0000 7fa151e21640 1 -- 172.21.15.38:0/730031793 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fa14c109500 con 0x7fa14c105eb0 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.384+0000 7fa148ff9640 1 -- 172.21.15.38:0/730031793 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fa13c039780 con 0x7fa14c105eb0 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.388+0000 7fa151e21640 1 -- 172.21.15.38:0/730031793 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fa134038650 msgr2=0x7fa13403ab10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.388+0000 7fa151e21640 1 --2- 172.21.15.38:0/730031793 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fa134038650 0x7fa13403ab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.388+0000 7fa151e21640 1 -- 172.21.15.38:0/730031793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 msgr2=0x7fa14c105730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:12.984 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.388+0000 7fa151e21640 1 --2- 172.21.15.38:0/730031793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 0x7fa14c105730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa13c030d40 tx=0x7fa13c030d70 comp rx=0 tx=0).stop 2024-09-13T18:21:12.985 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.388+0000 7fa151e21640 1 -- 172.21.15.38:0/730031793 shutdown_connections 2024-09-13T18:21:12.985 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.388+0000 7fa151e21640 1 --2- 172.21.15.38:0/730031793 >> [v2:172.21.15.38:6800/3745740953,v1:172.21.15.38:6801/3745740953] conn(0x7fa134038650 0x7fa13403ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:12.985 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.388+0000 7fa151e21640 1 --2- 172.21.15.38:0/730031793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa14c105eb0 0x7fa14c105730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:12.985 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.388+0000 7fa151e21640 1 -- 172.21.15.38:0/730031793 >> 172.21.15.38:0/730031793 conn(0x7fa14c0ffb50 msgr2=0x7fa14c100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:12.985 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.388+0000 7fa151e21640 1 -- 172.21.15.38:0/730031793 shutdown_connections 2024-09-13T18:21:12.985 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:06.388+0000 7fa151e21640 1 -- 172.21.15.38:0/730031793 wait complete. 2024-09-13T18:21:12.985 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for the mgr to restart... 2024-09-13T18:21:12.985 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr epoch 5... 2024-09-13T18:21:15.711 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 8, 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.089+0000 7f0a1d265640 1 Processor -- start 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.089+0000 7f0a1d265640 1 -- start start 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.089+0000 7f0a1d265640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 0x7f0a18104730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.089+0000 7f0a1d265640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18104d00 con 0x7f0a18104330 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.090+0000 7f0a16ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 0x7f0a18104730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.090+0000 7f0a16ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 0x7f0a18104730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48680/0 (socket says 172.21.15.38:48680) 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.090+0000 7f0a16ffd640 1 -- 172.21.15.38:0/1370584186 learned_addr learned my addr 172.21.15.38:0/1370584186 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.090+0000 7f0a16ffd640 1 -- 172.21.15.38:0/1370584186 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a181054e0 con 0x7f0a18104330 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.091+0000 7f0a16ffd640 1 --2- 172.21.15.38:0/1370584186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 0x7f0a18104730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009820 tx=0x7f0a0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65adcec7d50f8cb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:15.712 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.091+0000 7f0a167fc640 1 -- 172.21.15.38:0/1370584186 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a0802ad40 con 0x7f0a18104330 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.091+0000 7f0a167fc640 1 -- 172.21.15.38:0/1370584186 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f0a08032890 con 0x7f0a18104330 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.091+0000 7f0a167fc640 1 -- 172.21.15.38:0/1370584186 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a080307d0 con 0x7f0a18104330 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.091+0000 7f0a1d265640 1 -- 172.21.15.38:0/1370584186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 msgr2=0x7f0a18104730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.091+0000 7f0a1d265640 1 --2- 172.21.15.38:0/1370584186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 0x7f0a18104730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009820 tx=0x7f0a0802a270 comp rx=0 tx=0).stop 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.092+0000 7f0a1d265640 1 -- 172.21.15.38:0/1370584186 shutdown_connections 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.092+0000 7f0a1d265640 1 --2- 172.21.15.38:0/1370584186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 0x7f0a18104730 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.092+0000 7f0a1d265640 1 -- 172.21.15.38:0/1370584186 >> 172.21.15.38:0/1370584186 conn(0x7f0a180ffb20 msgr2=0x7f0a18101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.092+0000 7f0a1d265640 1 -- 172.21.15.38:0/1370584186 shutdown_connections 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.092+0000 7f0a1d265640 1 -- 172.21.15.38:0/1370584186 wait complete. 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.092+0000 7f0a1d265640 1 Processor -- start 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.092+0000 7f0a1d265640 1 -- start start 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.092+0000 7f0a1d265640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 0x7f0a1818f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:15.713 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.092+0000 7f0a1d265640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1818f970 con 0x7f0a18104330 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.093+0000 7f0a16ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 0x7f0a1818f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.093+0000 7f0a16ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 0x7f0a1818f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48686/0 (socket says 172.21.15.38:48686) 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.093+0000 7f0a16ffd640 1 -- 172.21.15.38:0/1984952247 learned_addr learned my addr 172.21.15.38:0/1984952247 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.093+0000 7f0a16ffd640 1 -- 172.21.15.38:0/1984952247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a080094d0 con 0x7f0a18104330 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.093+0000 7f0a16ffd640 1 --2- 172.21.15.38:0/1984952247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 0x7f0a1818f430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a080304c0 tx=0x7f0a08030d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.093+0000 7f0a14ff9640 1 -- 172.21.15.38:0/1984952247 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a08032c10 con 0x7f0a18104330 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.093+0000 7f0a14ff9640 1 -- 172.21.15.38:0/1984952247 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f0a08032d70 con 0x7f0a18104330 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.093+0000 7f0a1d265640 1 -- 172.21.15.38:0/1984952247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1818db60 con 0x7f0a18104330 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.093+0000 7f0a14ff9640 1 -- 172.21.15.38:0/1984952247 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a0803a560 con 0x7f0a18104330 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.093+0000 7f0a1d265640 1 -- 172.21.15.38:0/1984952247 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1818e000 con 0x7f0a18104330 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.094+0000 7f0a14ff9640 1 -- 172.21.15.38:0/1984952247 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f0a0803a790 con 0x7f0a18104330 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.094+0000 7f0a14ff9640 1 --2- 172.21.15.38:0/1984952247 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f0a04038650 0x7f0a0403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.094+0000 7f0a1d265640 1 -- 172.21.15.38:0/1984952247 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a181062d0 con 0x7f0a04038650 2024-09-13T18:21:15.714 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.094+0000 7f0a14ff9640 1 -- 172.21.15.38:0/1984952247 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f0a0806b850 con 0x7f0a18104330 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.095+0000 7f0a0ffff640 1 --2- 172.21.15.38:0/1984952247 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f0a04038650 0x7f0a0403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.095+0000 7f0a0ffff640 1 --2- 172.21.15.38:0/1984952247 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f0a04038650 0x7f0a0403ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0a000098c0 tx=0x7f0a00006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.095+0000 7f0a14ff9640 1 -- 172.21.15.38:0/1984952247 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f0a000094d0 con 0x7f0a04038650 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.101+0000 7f0a1d265640 1 -- 172.21.15.38:0/1984952247 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f0a181047b0 con 0x7f0a04038650 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.101+0000 7f0a14ff9640 1 -- 172.21.15.38:0/1984952247 <== mgr.14118 v2:172.21.15.38:6800/818807657 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0a181047b0 con 0x7f0a04038650 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.101+0000 7f0a1d265640 1 -- 172.21.15.38:0/1984952247 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f0a04038650 msgr2=0x7f0a0403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.101+0000 7f0a1d265640 1 --2- 172.21.15.38:0/1984952247 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f0a04038650 0x7f0a0403ab10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0a000098c0 tx=0x7f0a00006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.101+0000 7f0a1d265640 1 -- 172.21.15.38:0/1984952247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 msgr2=0x7f0a1818f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.101+0000 7f0a1d265640 1 --2- 172.21.15.38:0/1984952247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 0x7f0a1818f430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a080304c0 tx=0x7f0a08030d10 comp rx=0 tx=0).stop 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.101+0000 7f0a1d265640 1 -- 172.21.15.38:0/1984952247 shutdown_connections 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.101+0000 7f0a1d265640 1 --2- 172.21.15.38:0/1984952247 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f0a04038650 0x7f0a0403ab10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.101+0000 7f0a1d265640 1 --2- 172.21.15.38:0/1984952247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0a18104330 0x7f0a1818f430 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:15.715 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.101+0000 7f0a1d265640 1 -- 172.21.15.38:0/1984952247 >> 172.21.15.38:0/1984952247 conn(0x7f0a180ffb20 msgr2=0x7f0a18100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:15.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.102+0000 7f0a1d265640 1 -- 172.21.15.38:0/1984952247 shutdown_connections 2024-09-13T18:21:15.716 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:15.102+0000 7f0a1d265640 1 -- 172.21.15.38:0/1984952247 wait complete. 2024-09-13T18:21:15.716 INFO:teuthology.orchestra.run.smithi038.stdout:mgr epoch 5 is available 2024-09-13T18:21:15.716 INFO:teuthology.orchestra.run.smithi038.stdout:Setting orchestrator backend to cephadm... 2024-09-13T18:21:16.014 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:15 smithi038 ceph-mon[27689]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T18:21:16.014 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:15 smithi038 ceph-mon[27689]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T18:21:16.841 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.103+0000 7f5d142a6640 1 Processor -- start 2024-09-13T18:21:16.841 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.103+0000 7f5d142a6640 1 -- start start 2024-09-13T18:21:16.841 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.103+0000 7f5d142a6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 0x7f5d0c106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:16.841 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.103+0000 7f5d142a6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c1074c0 con 0x7f5d0c106af0 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.104+0000 7f5d12042640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 0x7f5d0c106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.104+0000 7f5d12042640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 0x7f5d0c106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48698/0 (socket says 172.21.15.38:48698) 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.104+0000 7f5d12042640 1 -- 172.21.15.38:0/2508200652 learned_addr learned my addr 172.21.15.38:0/2508200652 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.104+0000 7f5d12042640 1 -- 172.21.15.38:0/2508200652 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c105030 con 0x7f5d0c106af0 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.105+0000 7f5d12042640 1 --2- 172.21.15.38:0/2508200652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 0x7f5d0c106ef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009820 tx=0x7f5d0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3207f30087a63643 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.105+0000 7f5d11040640 1 -- 172.21.15.38:0/2508200652 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d0802ad40 con 0x7f5d0c106af0 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.105+0000 7f5d11040640 1 -- 172.21.15.38:0/2508200652 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f5d08032890 con 0x7f5d0c106af0 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.105+0000 7f5d11040640 1 -- 172.21.15.38:0/2508200652 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d080307d0 con 0x7f5d0c106af0 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.105+0000 7f5d142a6640 1 -- 172.21.15.38:0/2508200652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 msgr2=0x7f5d0c106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.106+0000 7f5d142a6640 1 --2- 172.21.15.38:0/2508200652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 0x7f5d0c106ef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009820 tx=0x7f5d0802a270 comp rx=0 tx=0).stop 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.106+0000 7f5d142a6640 1 -- 172.21.15.38:0/2508200652 shutdown_connections 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.106+0000 7f5d142a6640 1 --2- 172.21.15.38:0/2508200652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 0x7f5d0c106ef0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:16.842 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.106+0000 7f5d142a6640 1 -- 172.21.15.38:0/2508200652 >> 172.21.15.38:0/2508200652 conn(0x7f5d0c100c20 msgr2=0x7f5d0c103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.106+0000 7f5d142a6640 1 -- 172.21.15.38:0/2508200652 shutdown_connections 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.106+0000 7f5d142a6640 1 -- 172.21.15.38:0/2508200652 wait complete. 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.106+0000 7f5d142a6640 1 Processor -- start 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.106+0000 7f5d142a6640 1 -- start start 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.107+0000 7f5d142a6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 0x7f5d0c07baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.107+0000 7f5d142a6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c07c030 con 0x7f5d0c106af0 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.107+0000 7f5d12042640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 0x7f5d0c07baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.107+0000 7f5d12042640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 0x7f5d0c07baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48714/0 (socket says 172.21.15.38:48714) 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.107+0000 7f5d12042640 1 -- 172.21.15.38:0/1099664045 learned_addr learned my addr 172.21.15.38:0/1099664045 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.107+0000 7f5d12042640 1 -- 172.21.15.38:0/1099664045 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d080094d0 con 0x7f5d0c106af0 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.107+0000 7f5d12042640 1 --2- 172.21.15.38:0/1099664045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 0x7f5d0c07baf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009940 tx=0x7f5d08030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.107+0000 7f5d037fe640 1 -- 172.21.15.38:0/1099664045 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d08040070 con 0x7f5d0c106af0 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.108+0000 7f5d142a6640 1 -- 172.21.15.38:0/1099664045 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0c07a220 con 0x7f5d0c106af0 2024-09-13T18:21:16.843 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.108+0000 7f5d037fe640 1 -- 172.21.15.38:0/1099664045 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f5d08032c10 con 0x7f5d0c106af0 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.108+0000 7f5d037fe640 1 -- 172.21.15.38:0/1099664045 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d0803a560 con 0x7f5d0c106af0 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.108+0000 7f5d142a6640 1 -- 172.21.15.38:0/1099664045 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c07a6c0 con 0x7f5d0c106af0 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.108+0000 7f5d037fe640 1 -- 172.21.15.38:0/1099664045 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f5d0803c400 con 0x7f5d0c106af0 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.109+0000 7f5d142a6640 1 -- 172.21.15.38:0/1099664045 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0c106f70 con 0x7f5d0c106af0 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.109+0000 7f5d037fe640 1 --2- 172.21.15.38:0/1099664045 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f5cf8038650 0x7f5cf803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.109+0000 7f5d037fe640 1 -- 172.21.15.38:0/1099664045 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5d0806b4b0 con 0x7f5d0c106af0 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.109+0000 7f5d11841640 1 --2- 172.21.15.38:0/1099664045 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f5cf8038650 0x7f5cf803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.109+0000 7f5d11841640 1 --2- 172.21.15.38:0/1099664045 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f5cf8038650 0x7f5cf803ab10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0098c0 tx=0x7f5cfc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.114+0000 7f5d037fe640 1 -- 172.21.15.38:0/1099664045 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5d0803c9e0 con 0x7f5d0c106af0 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.299+0000 7f5d142a6640 1 -- 172.21.15.38:0/1099664045 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d0c07abe0 con 0x7f5cf8038650 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.307+0000 7f5d037fe640 1 -- 172.21.15.38:0/1099664045 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5d0c07abe0 con 0x7f5cf8038650 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.309+0000 7f5d142a6640 1 -- 172.21.15.38:0/1099664045 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f5cf8038650 msgr2=0x7f5cf803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:16.844 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.309+0000 7f5d142a6640 1 --2- 172.21.15.38:0/1099664045 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f5cf8038650 0x7f5cf803ab10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0098c0 tx=0x7f5cfc006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:16.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.309+0000 7f5d142a6640 1 -- 172.21.15.38:0/1099664045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 msgr2=0x7f5d0c07baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:16.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.309+0000 7f5d142a6640 1 --2- 172.21.15.38:0/1099664045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 0x7f5d0c07baf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009940 tx=0x7f5d08030cc0 comp rx=0 tx=0).stop 2024-09-13T18:21:16.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.309+0000 7f5d142a6640 1 -- 172.21.15.38:0/1099664045 shutdown_connections 2024-09-13T18:21:16.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.309+0000 7f5d142a6640 1 --2- 172.21.15.38:0/1099664045 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f5cf8038650 0x7f5cf803ab10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:16.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.309+0000 7f5d142a6640 1 --2- 172.21.15.38:0/1099664045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d0c106af0 0x7f5d0c07baf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:16.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.309+0000 7f5d142a6640 1 -- 172.21.15.38:0/1099664045 >> 172.21.15.38:0/1099664045 conn(0x7f5d0c100c20 msgr2=0x7f5d0c101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:16.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.309+0000 7f5d142a6640 1 -- 172.21.15.38:0/1099664045 shutdown_connections 2024-09-13T18:21:16.845 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:16.309+0000 7f5d142a6640 1 -- 172.21.15.38:0/1099664045 wait complete. 2024-09-13T18:21:17.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:17 smithi038 ceph-mon[27689]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:17.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:17 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:17.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:17 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:21:18.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:18 smithi038 ceph-mon[27689]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:18.992 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T18:21:18.992 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.226+0000 7f4498fcb640 1 Processor -- start 2024-09-13T18:21:18.992 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.226+0000 7f4498fcb640 1 -- start start 2024-09-13T18:21:18.992 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.226+0000 7f4498fcb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 0x7f4494105da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.226+0000 7f4498fcb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494106370 con 0x7f44941059a0 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.226+0000 7f449259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 0x7f4494105da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.226+0000 7f449259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 0x7f4494105da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48724/0 (socket says 172.21.15.38:48724) 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.226+0000 7f449259c640 1 -- 172.21.15.38:0/2759948722 learned_addr learned my addr 172.21.15.38:0/2759948722 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.226+0000 7f449259c640 1 -- 172.21.15.38:0/2759948722 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494104570 con 0x7f44941059a0 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.227+0000 7f449259c640 1 --2- 172.21.15.38:0/2759948722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 0x7f4494105da0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4484009820 tx=0x7f448402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f214d7c4a473b6c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.227+0000 7f4491d9b640 1 -- 172.21.15.38:0/2759948722 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f448402ad40 con 0x7f44941059a0 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.227+0000 7f4491d9b640 1 -- 172.21.15.38:0/2759948722 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f4484032890 con 0x7f44941059a0 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.227+0000 7f4491d9b640 1 -- 172.21.15.38:0/2759948722 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44840307d0 con 0x7f44941059a0 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.228+0000 7f4498fcb640 1 -- 172.21.15.38:0/2759948722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 msgr2=0x7f4494105da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.228+0000 7f4498fcb640 1 --2- 172.21.15.38:0/2759948722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 0x7f4494105da0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4484009820 tx=0x7f448402a270 comp rx=0 tx=0).stop 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.228+0000 7f4498fcb640 1 -- 172.21.15.38:0/2759948722 shutdown_connections 2024-09-13T18:21:18.993 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.228+0000 7f4498fcb640 1 --2- 172.21.15.38:0/2759948722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 0x7f4494105da0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.228+0000 7f4498fcb640 1 -- 172.21.15.38:0/2759948722 >> 172.21.15.38:0/2759948722 conn(0x7f44940ff270 msgr2=0x7f4494101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.228+0000 7f4498fcb640 1 -- 172.21.15.38:0/2759948722 shutdown_connections 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.228+0000 7f4498fcb640 1 -- 172.21.15.38:0/2759948722 wait complete. 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.229+0000 7f4498fcb640 1 Processor -- start 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.229+0000 7f4498fcb640 1 -- start start 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.229+0000 7f4498fcb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 0x7f44941991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.229+0000 7f4498fcb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494199720 con 0x7f44941059a0 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.229+0000 7f449259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 0x7f44941991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.229+0000 7f449259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 0x7f44941991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48734/0 (socket says 172.21.15.38:48734) 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.229+0000 7f449259c640 1 -- 172.21.15.38:0/36338971 learned_addr learned my addr 172.21.15.38:0/36338971 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.229+0000 7f449259c640 1 -- 172.21.15.38:0/36338971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44840094d0 con 0x7f44941059a0 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.229+0000 7f449259c640 1 --2- 172.21.15.38:0/36338971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 0x7f44941991e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4484030380 tx=0x7f4484030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:18.994 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.229+0000 7f448b7fe640 1 -- 172.21.15.38:0/36338971 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4484030ed0 con 0x7f44941059a0 2024-09-13T18:21:18.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.230+0000 7f448b7fe640 1 -- 172.21.15.38:0/36338971 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f4484032c10 con 0x7f44941059a0 2024-09-13T18:21:18.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.230+0000 7f4498fcb640 1 -- 172.21.15.38:0/36338971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4494199920 con 0x7f44941059a0 2024-09-13T18:21:18.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.230+0000 7f448b7fe640 1 -- 172.21.15.38:0/36338971 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f448403a560 con 0x7f44941059a0 2024-09-13T18:21:18.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.230+0000 7f4498fcb640 1 -- 172.21.15.38:0/36338971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4494199dc0 con 0x7f44941059a0 2024-09-13T18:21:18.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.230+0000 7f448b7fe640 1 -- 172.21.15.38:0/36338971 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f448403a820 con 0x7f44941059a0 2024-09-13T18:21:18.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.231+0000 7f448b7fe640 1 --2- 172.21.15.38:0/36338971 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f4480038650 0x7f448003ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:18.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.231+0000 7f448b7fe640 1 -- 172.21.15.38:0/36338971 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f448406b820 con 0x7f44941059a0 2024-09-13T18:21:18.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.231+0000 7f4498fcb640 1 -- 172.21.15.38:0/36338971 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4494193350 con 0x7f44941059a0 2024-09-13T18:21:18.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.231+0000 7f448bfff640 1 --2- 172.21.15.38:0/36338971 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f4480038650 0x7f448003ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:18.995 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.231+0000 7f448bfff640 1 --2- 172.21.15.38:0/36338971 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f4480038650 0x7f448003ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f447c0098c0 tx=0x7f447c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.235+0000 7f448b7fe640 1 -- 172.21.15.38:0/36338971 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4484043310 con 0x7f44941059a0 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.408+0000 7f4498fcb640 1 -- 172.21.15.38:0/36338971 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f449402c4f0 con 0x7f4480038650 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.409+0000 7f448b7fe640 1 -- 172.21.15.38:0/36338971 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f449402c4f0 con 0x7f4480038650 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.411+0000 7f4498fcb640 1 -- 172.21.15.38:0/36338971 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f4480038650 msgr2=0x7f448003ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.411+0000 7f4498fcb640 1 --2- 172.21.15.38:0/36338971 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f4480038650 0x7f448003ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f447c0098c0 tx=0x7f447c006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.411+0000 7f4498fcb640 1 -- 172.21.15.38:0/36338971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 msgr2=0x7f44941991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.411+0000 7f4498fcb640 1 --2- 172.21.15.38:0/36338971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 0x7f44941991e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4484030380 tx=0x7f4484030cc0 comp rx=0 tx=0).stop 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.411+0000 7f4498fcb640 1 -- 172.21.15.38:0/36338971 shutdown_connections 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.411+0000 7f4498fcb640 1 --2- 172.21.15.38:0/36338971 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f4480038650 0x7f448003ab10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.411+0000 7f4498fcb640 1 --2- 172.21.15.38:0/36338971 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44941059a0 0x7f44941991e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.411+0000 7f4498fcb640 1 -- 172.21.15.38:0/36338971 >> 172.21.15.38:0/36338971 conn(0x7f44940ff270 msgr2=0x7f44941001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.411+0000 7f4498fcb640 1 -- 172.21.15.38:0/36338971 shutdown_connections 2024-09-13T18:21:18.996 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:17.411+0000 7f4498fcb640 1 -- 172.21.15.38:0/36338971 wait complete. 2024-09-13T18:21:18.997 INFO:teuthology.orchestra.run.smithi038.stdout:Generating ssh key... 2024-09-13T18:21:20.340 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.403+0000 7f783d46f640 1 Processor -- start 2024-09-13T18:21:20.340 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.403+0000 7f783d46f640 1 -- start start 2024-09-13T18:21:20.340 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.404+0000 7f783d46f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 0x7f78381082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:20.340 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.404+0000 7f783d46f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7838079da0 con 0x7f7838105ee0 2024-09-13T18:21:20.340 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.404+0000 7f7836ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 0x7f78381082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:20.340 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.404+0000 7f7836ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 0x7f78381082d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48750/0 (socket says 172.21.15.38:48750) 2024-09-13T18:21:20.340 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.404+0000 7f7836ffd640 1 -- 172.21.15.38:0/4280176678 learned_addr learned my addr 172.21.15.38:0/4280176678 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:20.340 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.404+0000 7f7836ffd640 1 -- 172.21.15.38:0/4280176678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7838108810 con 0x7f7838105ee0 2024-09-13T18:21:20.340 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.405+0000 7f7836ffd640 1 --2- 172.21.15.38:0/4280176678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 0x7f78381082d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7828009820 tx=0x7f782802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba85115602b93e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:20.340 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.405+0000 7f7835ffb640 1 -- 172.21.15.38:0/4280176678 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f782802ad40 con 0x7f7838105ee0 2024-09-13T18:21:20.340 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.405+0000 7f7835ffb640 1 -- 172.21.15.38:0/4280176678 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f7828032890 con 0x7f7838105ee0 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.405+0000 7f7835ffb640 1 -- 172.21.15.38:0/4280176678 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78280307d0 con 0x7f7838105ee0 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.406+0000 7f783d46f640 1 -- 172.21.15.38:0/4280176678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 msgr2=0x7f78381082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.406+0000 7f783d46f640 1 --2- 172.21.15.38:0/4280176678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 0x7f78381082d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7828009820 tx=0x7f782802a270 comp rx=0 tx=0).stop 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.406+0000 7f783d46f640 1 -- 172.21.15.38:0/4280176678 shutdown_connections 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.406+0000 7f783d46f640 1 --2- 172.21.15.38:0/4280176678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 0x7f78381082d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.406+0000 7f783d46f640 1 -- 172.21.15.38:0/4280176678 >> 172.21.15.38:0/4280176678 conn(0x7f78380ffb20 msgr2=0x7f7838101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.406+0000 7f783d46f640 1 -- 172.21.15.38:0/4280176678 shutdown_connections 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.406+0000 7f783d46f640 1 -- 172.21.15.38:0/4280176678 wait complete. 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.406+0000 7f783d46f640 1 Processor -- start 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.407+0000 7f783d46f640 1 -- start start 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.407+0000 7f783d46f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 0x7f7838199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.407+0000 7f783d46f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7838199650 con 0x7f7838105ee0 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.407+0000 7f7836ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 0x7f7838199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:20.341 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.407+0000 7f7836ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 0x7f7838199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48764/0 (socket says 172.21.15.38:48764) 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.407+0000 7f7836ffd640 1 -- 172.21.15.38:0/2669293885 learned_addr learned my addr 172.21.15.38:0/2669293885 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.407+0000 7f7836ffd640 1 -- 172.21.15.38:0/2669293885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78280094d0 con 0x7f7838105ee0 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.407+0000 7f7836ffd640 1 --2- 172.21.15.38:0/2669293885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 0x7f7838199110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7828030380 tx=0x7f7828030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.408+0000 7f781ffff640 1 -- 172.21.15.38:0/2669293885 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7828030ed0 con 0x7f7838105ee0 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.408+0000 7f781ffff640 1 -- 172.21.15.38:0/2669293885 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f7828032c10 con 0x7f7838105ee0 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.408+0000 7f783d46f640 1 -- 172.21.15.38:0/2669293885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7838199850 con 0x7f7838105ee0 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.408+0000 7f781ffff640 1 -- 172.21.15.38:0/2669293885 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f782803a560 con 0x7f7838105ee0 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.408+0000 7f783d46f640 1 -- 172.21.15.38:0/2669293885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7838199cf0 con 0x7f7838105ee0 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.409+0000 7f781ffff640 1 -- 172.21.15.38:0/2669293885 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f782803c400 con 0x7f7838105ee0 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.409+0000 7f783d46f640 1 -- 172.21.15.38:0/2669293885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78381094a0 con 0x7f7838105ee0 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.409+0000 7f781ffff640 1 --2- 172.21.15.38:0/2669293885 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f78200386a0 0x7f782003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.409+0000 7f781ffff640 1 -- 172.21.15.38:0/2669293885 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f782806b830 con 0x7f7838105ee0 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.409+0000 7f78367fc640 1 --2- 172.21.15.38:0/2669293885 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f78200386a0 0x7f782003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:20.342 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.410+0000 7f78367fc640 1 --2- 172.21.15.38:0/2669293885 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f78200386a0 0x7f782003ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f782c00ad30 tx=0x7f782c0093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.414+0000 7f781ffff640 1 -- 172.21.15.38:0/2669293885 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f782803c9e0 con 0x7f7838105ee0 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.590+0000 7f783d46f640 1 -- 172.21.15.38:0/2669293885 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7838100ec0 con 0x7f78200386a0 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.759+0000 7f781ffff640 1 -- 172.21.15.38:0/2669293885 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7838100ec0 con 0x7f78200386a0 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.761+0000 7f783d46f640 1 -- 172.21.15.38:0/2669293885 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f78200386a0 msgr2=0x7f782003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.761+0000 7f783d46f640 1 --2- 172.21.15.38:0/2669293885 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f78200386a0 0x7f782003ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f782c00ad30 tx=0x7f782c0093f0 comp rx=0 tx=0).stop 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.761+0000 7f783d46f640 1 -- 172.21.15.38:0/2669293885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 msgr2=0x7f7838199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.761+0000 7f783d46f640 1 --2- 172.21.15.38:0/2669293885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 0x7f7838199110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7828030380 tx=0x7f7828030cc0 comp rx=0 tx=0).stop 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.761+0000 7f783d46f640 1 -- 172.21.15.38:0/2669293885 shutdown_connections 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.761+0000 7f783d46f640 1 --2- 172.21.15.38:0/2669293885 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f78200386a0 0x7f782003ab60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.761+0000 7f783d46f640 1 --2- 172.21.15.38:0/2669293885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7838105ee0 0x7f7838199110 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.761+0000 7f783d46f640 1 -- 172.21.15.38:0/2669293885 >> 172.21.15.38:0/2669293885 conn(0x7f78380ffb20 msgr2=0x7f78381007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.761+0000 7f783d46f640 1 -- 172.21.15.38:0/2669293885 shutdown_connections 2024-09-13T18:21:20.343 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:19.761+0000 7f783d46f640 1 -- 172.21.15.38:0/2669293885 wait complete. 2024-09-13T18:21:20.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:20 smithi038 ceph-mon[27689]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:20.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:20 smithi038 ceph-mon[27689]: Generating ssh key... 2024-09-13T18:21:20.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:20 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:20.894 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:20 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:21.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCk544mVqY0dMiATSDjL/VewovNGHBg4xqHpbbhgwREIdDRSBRCUepOe7zWUBKoNLoNex0BoRf7BbzbQL8HdcE1niLKriIecbsVXEBMVOnyiooRKIY/0rWk3xzzx1FT0DqZyZfeb+4nIFhvnpshM1tKj5Fa5SvfVCAopPo+EOZJO8ZbLuC1yHeA3QQNxkYNpmQqty9GMAaW0kom2UQni+JYLEwrGXcadM/y7TVoXr2dtFDYHzxWkEL40xOlBOQ2AgexIskLPiVJBcYZ0CPLrkDEQZTFEbbud/YTpVjCfvmACXpxFKJaANpI+fKEkeG3KPO3C1q4wYwF+yJ5dt3JbZX4DpB1LuxQ/O9PGtGEg838I7lk1XK0XbsWk9pWaZzY/o0BMihKxxJKVD/bvYwZIsLHTrmj5xYLVFOD/8AGnmly1OrP9k0Zww7PTuRdNQWwRRISh04BU20RhAYKVbxvE80HmhZNl69aQ3DDnyEXyTRTtAhhnlSe4Ug2YXJn3uUY/NE= ceph-ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:21:21.414 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.706+0000 7f7c19991640 1 Processor -- start 2024-09-13T18:21:21.414 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.706+0000 7f7c19991640 1 -- start start 2024-09-13T18:21:21.414 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.707+0000 7f7c19991640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 0x7f7c141082a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:21.414 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.707+0000 7f7c19991640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14073b50 con 0x7f7c14105eb0 2024-09-13T18:21:21.414 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.707+0000 7f7c12ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 0x7f7c141082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:21.414 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.707+0000 7f7c12ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 0x7f7c141082a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48766/0 (socket says 172.21.15.38:48766) 2024-09-13T18:21:21.414 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.707+0000 7f7c12ffd640 1 -- 172.21.15.38:0/3184352707 learned_addr learned my addr 172.21.15.38:0/3184352707 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.707+0000 7f7c12ffd640 1 -- 172.21.15.38:0/3184352707 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c141087e0 con 0x7f7c14105eb0 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.708+0000 7f7c12ffd640 1 --2- 172.21.15.38:0/3184352707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 0x7f7c141082a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009e80 tx=0x7f7c0402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21aa302bd1daa08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.708+0000 7f7c11ffb640 1 -- 172.21.15.38:0/3184352707 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c04031400 con 0x7f7c14105eb0 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.708+0000 7f7c11ffb640 1 -- 172.21.15.38:0/3184352707 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f7c0402d050 con 0x7f7c14105eb0 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.708+0000 7f7c11ffb640 1 -- 172.21.15.38:0/3184352707 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c040077a0 con 0x7f7c14105eb0 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.708+0000 7f7c19991640 1 -- 172.21.15.38:0/3184352707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 msgr2=0x7f7c141082a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.708+0000 7f7c19991640 1 --2- 172.21.15.38:0/3184352707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 0x7f7c141082a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009e80 tx=0x7f7c0402a7a0 comp rx=0 tx=0).stop 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.709+0000 7f7c19991640 1 -- 172.21.15.38:0/3184352707 shutdown_connections 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.709+0000 7f7c19991640 1 --2- 172.21.15.38:0/3184352707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 0x7f7c141082a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.709+0000 7f7c19991640 1 -- 172.21.15.38:0/3184352707 >> 172.21.15.38:0/3184352707 conn(0x7f7c140ffb50 msgr2=0x7f7c14101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.709+0000 7f7c19991640 1 -- 172.21.15.38:0/3184352707 shutdown_connections 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.709+0000 7f7c19991640 1 -- 172.21.15.38:0/3184352707 wait complete. 2024-09-13T18:21:21.415 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.709+0000 7f7c19991640 1 Processor -- start 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.709+0000 7f7c19991640 1 -- start start 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.710+0000 7f7c19991640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 0x7f7c14199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.710+0000 7f7c19991640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14199680 con 0x7f7c14105eb0 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.710+0000 7f7c12ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 0x7f7c14199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.710+0000 7f7c12ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 0x7f7c14199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48778/0 (socket says 172.21.15.38:48778) 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.710+0000 7f7c12ffd640 1 -- 172.21.15.38:0/3911172051 learned_addr learned my addr 172.21.15.38:0/3911172051 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.710+0000 7f7c12ffd640 1 -- 172.21.15.38:0/3911172051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c04009b30 con 0x7f7c14105eb0 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.710+0000 7f7c12ffd640 1 --2- 172.21.15.38:0/3911172051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 0x7f7c14199140 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7c04031630 tx=0x7f7c04031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.710+0000 7f7c1898f640 1 -- 172.21.15.38:0/3911172051 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c04031ab0 con 0x7f7c14105eb0 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.710+0000 7f7c1898f640 1 -- 172.21.15.38:0/3911172051 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f7c04031c10 con 0x7f7c14105eb0 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.710+0000 7f7c19991640 1 -- 172.21.15.38:0/3911172051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c14199880 con 0x7f7c14105eb0 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.710+0000 7f7c1898f640 1 -- 172.21.15.38:0/3911172051 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c04044620 con 0x7f7c14105eb0 2024-09-13T18:21:21.416 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.710+0000 7f7c19991640 1 -- 172.21.15.38:0/3911172051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c14199d20 con 0x7f7c14105eb0 2024-09-13T18:21:21.417 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.711+0000 7f7c1898f640 1 -- 172.21.15.38:0/3911172051 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f7c04038040 con 0x7f7c14105eb0 2024-09-13T18:21:21.417 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.711+0000 7f7c19991640 1 -- 172.21.15.38:0/3911172051 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c14109500 con 0x7f7c14105eb0 2024-09-13T18:21:21.417 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.711+0000 7f7c1898f640 1 --2- 172.21.15.38:0/3911172051 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f7bfc0386a0 0x7f7bfc03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:21.417 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.711+0000 7f7c1898f640 1 -- 172.21.15.38:0/3911172051 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7c0406b9d0 con 0x7f7c14105eb0 2024-09-13T18:21:21.417 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.712+0000 7f7c127fc640 1 --2- 172.21.15.38:0/3911172051 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f7bfc0386a0 0x7f7bfc03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:21.417 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.712+0000 7f7c127fc640 1 --2- 172.21.15.38:0/3911172051 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f7bfc0386a0 0x7f7bfc03ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c080098c0 tx=0x7f7c08006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:21.417 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.717+0000 7f7c1898f640 1 -- 172.21.15.38:0/3911172051 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7c0403a400 con 0x7f7c14105eb0 2024-09-13T18:21:21.417 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.892+0000 7f7c19991640 1 -- 172.21.15.38:0/3911172051 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c14100e80 con 0x7f7bfc0386a0 2024-09-13T18:21:21.417 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.892+0000 7f7c1898f640 1 -- 172.21.15.38:0/3911172051 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f7c14100e80 con 0x7f7bfc0386a0 2024-09-13T18:21:21.417 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.895+0000 7f7c19991640 1 -- 172.21.15.38:0/3911172051 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f7bfc0386a0 msgr2=0x7f7bfc03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:21.418 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.895+0000 7f7c19991640 1 --2- 172.21.15.38:0/3911172051 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f7bfc0386a0 0x7f7bfc03ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c080098c0 tx=0x7f7c08006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:21.418 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.895+0000 7f7c19991640 1 -- 172.21.15.38:0/3911172051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 msgr2=0x7f7c14199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:21.418 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.895+0000 7f7c19991640 1 --2- 172.21.15.38:0/3911172051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 0x7f7c14199140 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7c04031630 tx=0x7f7c04031660 comp rx=0 tx=0).stop 2024-09-13T18:21:21.418 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.895+0000 7f7c19991640 1 -- 172.21.15.38:0/3911172051 shutdown_connections 2024-09-13T18:21:21.418 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.895+0000 7f7c19991640 1 --2- 172.21.15.38:0/3911172051 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f7bfc0386a0 0x7f7bfc03ab60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:21.418 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.895+0000 7f7c19991640 1 --2- 172.21.15.38:0/3911172051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c14105eb0 0x7f7c14199140 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:21.418 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.895+0000 7f7c19991640 1 -- 172.21.15.38:0/3911172051 >> 172.21.15.38:0/3911172051 conn(0x7f7c140ffb50 msgr2=0x7f7c14100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:21.418 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.896+0000 7f7c19991640 1 -- 172.21.15.38:0/3911172051 shutdown_connections 2024-09-13T18:21:21.418 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:20.896+0000 7f7c19991640 1 -- 172.21.15.38:0/3911172051 wait complete. 2024-09-13T18:21:21.418 INFO:teuthology.orchestra.run.smithi038.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T18:21:21.418 INFO:teuthology.orchestra.run.smithi038.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T18:21:21.421 INFO:teuthology.orchestra.run.smithi038.stdout:Adding host smithi038... 2024-09-13T18:21:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:21 smithi038 ceph-mon[27689]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:23.014 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:22 smithi038 ceph-mon[27689]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi038", "addr": "172.21.15.38", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:24.233 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:23 smithi038 ceph-mon[27689]: Deploying cephadm binary to smithi038 2024-09-13T18:21:25.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Added host 'smithi038' with addr '172.21.15.38' 2024-09-13T18:21:25.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.800+0000 7f49435c7640 1 Processor -- start 2024-09-13T18:21:25.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.800+0000 7f49435c7640 1 -- start start 2024-09-13T18:21:25.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.800+0000 7f49435c7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 0x7f493c1082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:25.889 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.800+0000 7f49435c7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c079de0 con 0x7f493c105ed0 2024-09-13T18:21:25.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.801+0000 7f4941363640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 0x7f493c1082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:25.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.801+0000 7f4941363640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 0x7f493c1082c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48784/0 (socket says 172.21.15.38:48784) 2024-09-13T18:21:25.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.801+0000 7f4941363640 1 -- 172.21.15.38:0/2502366898 learned_addr learned my addr 172.21.15.38:0/2502366898 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:25.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.801+0000 7f4941363640 1 -- 172.21.15.38:0/2502366898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c108800 con 0x7f493c105ed0 2024-09-13T18:21:25.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.802+0000 7f4941363640 1 --2- 172.21.15.38:0/2502366898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 0x7f493c1082c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4938009820 tx=0x7f493802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ba779ed51d45d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:25.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.802+0000 7f4933fff640 1 -- 172.21.15.38:0/2502366898 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f493802ad40 con 0x7f493c105ed0 2024-09-13T18:21:25.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.802+0000 7f4933fff640 1 -- 172.21.15.38:0/2502366898 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f4938032890 con 0x7f493c105ed0 2024-09-13T18:21:25.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.802+0000 7f4933fff640 1 -- 172.21.15.38:0/2502366898 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49380307d0 con 0x7f493c105ed0 2024-09-13T18:21:25.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.802+0000 7f49435c7640 1 -- 172.21.15.38:0/2502366898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 msgr2=0x7f493c1082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:25.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.802+0000 7f49435c7640 1 --2- 172.21.15.38:0/2502366898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 0x7f493c1082c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4938009820 tx=0x7f493802a270 comp rx=0 tx=0).stop 2024-09-13T18:21:25.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.803+0000 7f49435c7640 1 -- 172.21.15.38:0/2502366898 shutdown_connections 2024-09-13T18:21:25.890 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.803+0000 7f49435c7640 1 --2- 172.21.15.38:0/2502366898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 0x7f493c1082c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.803+0000 7f49435c7640 1 -- 172.21.15.38:0/2502366898 >> 172.21.15.38:0/2502366898 conn(0x7f493c0ffb50 msgr2=0x7f493c101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.803+0000 7f49435c7640 1 -- 172.21.15.38:0/2502366898 shutdown_connections 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.803+0000 7f49435c7640 1 -- 172.21.15.38:0/2502366898 wait complete. 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.803+0000 7f49435c7640 1 Processor -- start 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.803+0000 7f49435c7640 1 -- start start 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.803+0000 7f49435c7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 0x7f493c105750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.803+0000 7f49435c7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c105c90 con 0x7f493c105ed0 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.804+0000 7f4941363640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 0x7f493c105750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.804+0000 7f4941363640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 0x7f493c105750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48788/0 (socket says 172.21.15.38:48788) 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.804+0000 7f4941363640 1 -- 172.21.15.38:0/2032936624 learned_addr learned my addr 172.21.15.38:0/2032936624 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.804+0000 7f4941363640 1 -- 172.21.15.38:0/2032936624 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380094d0 con 0x7f493c105ed0 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.804+0000 7f4941363640 1 --2- 172.21.15.38:0/2032936624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 0x7f493c105750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4938030d40 tx=0x7f4938030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.804+0000 7f49327fc640 1 -- 172.21.15.38:0/2032936624 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4938032c10 con 0x7f493c105ed0 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.804+0000 7f49327fc640 1 -- 172.21.15.38:0/2032936624 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f4938032d70 con 0x7f493c105ed0 2024-09-13T18:21:25.891 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.804+0000 7f49435c7640 1 -- 172.21.15.38:0/2032936624 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c103e80 con 0x7f493c105ed0 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.804+0000 7f49327fc640 1 -- 172.21.15.38:0/2032936624 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f493803a560 con 0x7f493c105ed0 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.804+0000 7f49435c7640 1 -- 172.21.15.38:0/2032936624 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c104320 con 0x7f493c105ed0 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.805+0000 7f49327fc640 1 -- 172.21.15.38:0/2032936624 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f493803a7d0 con 0x7f493c105ed0 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.805+0000 7f49327fc640 1 --2- 172.21.15.38:0/2032936624 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f4928038650 0x7f492803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.805+0000 7f49327fc640 1 -- 172.21.15.38:0/2032936624 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f493806b900 con 0x7f493c105ed0 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.805+0000 7f49435c7640 1 -- 172.21.15.38:0/2032936624 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c1094f0 con 0x7f493c105ed0 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.805+0000 7f4940b62640 1 --2- 172.21.15.38:0/2032936624 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f4928038650 0x7f492803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.806+0000 7f4940b62640 1 --2- 172.21.15.38:0/2032936624 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f4928038650 0x7f492803ab10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098c0 tx=0x7f492c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.810+0000 7f49327fc640 1 -- 172.21.15.38:0/2032936624 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f493803c400 con 0x7f493c105ed0 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:21.987+0000 7f49435c7640 1 -- 172.21.15.38:0/2032936624 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi038", "addr": "172.21.15.38", "target": ["mon-mgr", ""]}) v1 -- 0x7f493c104ad0 con 0x7f4928038650 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:25.304+0000 7f49327fc640 1 -- 172.21.15.38:0/2032936624 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f493c104ad0 con 0x7f4928038650 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:25.307+0000 7f49435c7640 1 -- 172.21.15.38:0/2032936624 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f4928038650 msgr2=0x7f492803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:25.892 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:25.307+0000 7f49435c7640 1 --2- 172.21.15.38:0/2032936624 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f4928038650 0x7f492803ab10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f492c0098c0 tx=0x7f492c006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:25.893 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:25.307+0000 7f49435c7640 1 -- 172.21.15.38:0/2032936624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 msgr2=0x7f493c105750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:25.893 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:25.307+0000 7f49435c7640 1 --2- 172.21.15.38:0/2032936624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 0x7f493c105750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4938030d40 tx=0x7f4938030d70 comp rx=0 tx=0).stop 2024-09-13T18:21:25.893 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:25.307+0000 7f49435c7640 1 -- 172.21.15.38:0/2032936624 shutdown_connections 2024-09-13T18:21:25.893 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:25.307+0000 7f49435c7640 1 --2- 172.21.15.38:0/2032936624 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f4928038650 0x7f492803ab10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:25.893 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:25.307+0000 7f49435c7640 1 --2- 172.21.15.38:0/2032936624 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f493c105ed0 0x7f493c105750 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:25.893 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:25.307+0000 7f49435c7640 1 -- 172.21.15.38:0/2032936624 >> 172.21.15.38:0/2032936624 conn(0x7f493c0ffb50 msgr2=0x7f493c1007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:25.893 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:25.307+0000 7f49435c7640 1 -- 172.21.15.38:0/2032936624 shutdown_connections 2024-09-13T18:21:25.893 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:25.307+0000 7f49435c7640 1 -- 172.21.15.38:0/2032936624 wait complete. 2024-09-13T18:21:25.893 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying mon service with default placement... 2024-09-13T18:21:26.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:26 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:26.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:26 smithi038 ceph-mon[27689]: Added host smithi038 2024-09-13T18:21:26.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:26 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:21:27.418 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T18:21:27.421 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.307+0000 7f31221e1640 1 Processor -- start 2024-09-13T18:21:27.421 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.307+0000 7f31221e1640 1 -- start start 2024-09-13T18:21:27.421 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.307+0000 7f31221e1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 0x7f311c108290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:27.421 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.307+0000 7f31221e1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c079de0 con 0x7f311c105ea0 2024-09-13T18:21:27.421 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.308+0000 7f311b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 0x7f311c108290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:27.421 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.308+0000 7f311b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 0x7f311c108290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43050/0 (socket says 172.21.15.38:43050) 2024-09-13T18:21:27.421 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.308+0000 7f311b7fe640 1 -- 172.21.15.38:0/2561812050 learned_addr learned my addr 172.21.15.38:0/2561812050 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:27.421 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.308+0000 7f311b7fe640 1 -- 172.21.15.38:0/2561812050 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c1087d0 con 0x7f311c105ea0 2024-09-13T18:21:27.421 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.309+0000 7f311b7fe640 1 --2- 172.21.15.38:0/2561812050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 0x7f311c108290 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f310c009820 tx=0x7f310c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76b83e34994f7b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:27.421 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.310+0000 7f311a7fc640 1 -- 172.21.15.38:0/2561812050 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f310c02ad40 con 0x7f311c105ea0 2024-09-13T18:21:27.422 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.310+0000 7f311a7fc640 1 -- 172.21.15.38:0/2561812050 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f310c032890 con 0x7f311c105ea0 2024-09-13T18:21:27.422 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.310+0000 7f311a7fc640 1 -- 172.21.15.38:0/2561812050 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f310c0307d0 con 0x7f311c105ea0 2024-09-13T18:21:27.422 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.310+0000 7f31221e1640 1 -- 172.21.15.38:0/2561812050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 msgr2=0x7f311c108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:27.422 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.310+0000 7f31221e1640 1 --2- 172.21.15.38:0/2561812050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 0x7f311c108290 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f310c009820 tx=0x7f310c02a270 comp rx=0 tx=0).stop 2024-09-13T18:21:27.422 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.311+0000 7f31221e1640 1 -- 172.21.15.38:0/2561812050 shutdown_connections 2024-09-13T18:21:27.422 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.311+0000 7f31221e1640 1 --2- 172.21.15.38:0/2561812050 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 0x7f311c108290 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:27.422 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.311+0000 7f31221e1640 1 -- 172.21.15.38:0/2561812050 >> 172.21.15.38:0/2561812050 conn(0x7f311c0ffb20 msgr2=0x7f311c101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:27.422 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.311+0000 7f31221e1640 1 -- 172.21.15.38:0/2561812050 shutdown_connections 2024-09-13T18:21:27.422 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.311+0000 7f31221e1640 1 -- 172.21.15.38:0/2561812050 wait complete. 2024-09-13T18:21:27.422 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.311+0000 7f31221e1640 1 Processor -- start 2024-09-13T18:21:27.422 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.312+0000 7f31221e1640 1 -- start start 2024-09-13T18:21:27.422 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.312+0000 7f31221e1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 0x7f311c199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:27.423 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.312+0000 7f31221e1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c199650 con 0x7f311c105ea0 2024-09-13T18:21:27.423 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.312+0000 7f311b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 0x7f311c199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:27.423 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.312+0000 7f311b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 0x7f311c199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43056/0 (socket says 172.21.15.38:43056) 2024-09-13T18:21:27.423 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.312+0000 7f311b7fe640 1 -- 172.21.15.38:0/2478478139 learned_addr learned my addr 172.21.15.38:0/2478478139 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:27.423 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.312+0000 7f311b7fe640 1 -- 172.21.15.38:0/2478478139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c0094d0 con 0x7f311c105ea0 2024-09-13T18:21:27.423 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.312+0000 7f311b7fe640 1 --2- 172.21.15.38:0/2478478139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 0x7f311c199110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f310c030d40 tx=0x7f310c030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:27.423 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.312+0000 7f3118ff9640 1 -- 172.21.15.38:0/2478478139 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f310c032c10 con 0x7f311c105ea0 2024-09-13T18:21:27.423 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.312+0000 7f3118ff9640 1 -- 172.21.15.38:0/2478478139 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7f310c032d70 con 0x7f311c105ea0 2024-09-13T18:21:27.423 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.313+0000 7f31221e1640 1 -- 172.21.15.38:0/2478478139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311c199850 con 0x7f311c105ea0 2024-09-13T18:21:27.423 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.313+0000 7f3118ff9640 1 -- 172.21.15.38:0/2478478139 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f310c03a560 con 0x7f311c105ea0 2024-09-13T18:21:27.423 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.313+0000 7f31221e1640 1 -- 172.21.15.38:0/2478478139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c199cf0 con 0x7f311c105ea0 2024-09-13T18:21:27.423 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.313+0000 7f3118ff9640 1 -- 172.21.15.38:0/2478478139 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f310c03a820 con 0x7f311c105ea0 2024-09-13T18:21:27.424 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.314+0000 7f31221e1640 1 -- 172.21.15.38:0/2478478139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311c109610 con 0x7f311c105ea0 2024-09-13T18:21:27.424 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.314+0000 7f3118ff9640 1 --2- 172.21.15.38:0/2478478139 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f3104038600 0x7f310403aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:27.424 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.314+0000 7f3118ff9640 1 -- 172.21.15.38:0/2478478139 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f310c06b8f0 con 0x7f311c105ea0 2024-09-13T18:21:27.424 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.314+0000 7f311affd640 1 --2- 172.21.15.38:0/2478478139 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f3104038600 0x7f310403aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:27.424 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.314+0000 7f311affd640 1 --2- 172.21.15.38:0/2478478139 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f3104038600 0x7f310403aac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f31100098c0 tx=0x7f3110006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:27.424 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.319+0000 7f3118ff9640 1 -- 172.21.15.38:0/2478478139 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f310c043310 con 0x7f311c105ea0 2024-09-13T18:21:27.424 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.502+0000 7f31221e1640 1 -- 172.21.15.38:0/2478478139 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f311c19c630 con 0x7f3104038600 2024-09-13T18:21:27.424 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.512+0000 7f3118ff9640 1 -- 172.21.15.38:0/2478478139 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f311c19c630 con 0x7f3104038600 2024-09-13T18:21:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.513+0000 7f31221e1640 1 -- 172.21.15.38:0/2478478139 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f3104038600 msgr2=0x7f310403aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.513+0000 7f31221e1640 1 --2- 172.21.15.38:0/2478478139 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f3104038600 0x7f310403aac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f31100098c0 tx=0x7f3110006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.513+0000 7f31221e1640 1 -- 172.21.15.38:0/2478478139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 msgr2=0x7f311c199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.513+0000 7f31221e1640 1 --2- 172.21.15.38:0/2478478139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 0x7f311c199110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f310c030d40 tx=0x7f310c030d70 comp rx=0 tx=0).stop 2024-09-13T18:21:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.514+0000 7f31221e1640 1 -- 172.21.15.38:0/2478478139 shutdown_connections 2024-09-13T18:21:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.514+0000 7f31221e1640 1 --2- 172.21.15.38:0/2478478139 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f3104038600 0x7f310403aac0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.514+0000 7f31221e1640 1 --2- 172.21.15.38:0/2478478139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f311c105ea0 0x7f311c199110 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.514+0000 7f31221e1640 1 -- 172.21.15.38:0/2478478139 >> 172.21.15.38:0/2478478139 conn(0x7f311c0ffb20 msgr2=0x7f311c100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.514+0000 7f31221e1640 1 -- 172.21.15.38:0/2478478139 shutdown_connections 2024-09-13T18:21:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:26.514+0000 7f31221e1640 1 -- 172.21.15.38:0/2478478139 wait complete. 2024-09-13T18:21:27.425 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying mgr service with default placement... 2024-09-13T18:21:27.803 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:27 smithi038 ceph-mon[27689]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:27.803 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:27 smithi038 ceph-mon[27689]: Saving service mon spec with placement count:5 2024-09-13T18:21:27.803 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:27 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:28.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T18:21:28.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.809+0000 7fbb0400e640 1 Processor -- start 2024-09-13T18:21:28.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.809+0000 7fbb0400e640 1 -- start start 2024-09-13T18:21:28.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.809+0000 7fbb0400e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 0x7fbafc1058c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:28.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.810+0000 7fbb0400e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc105e90 con 0x7fbafc1054c0 2024-09-13T18:21:28.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.810+0000 7fbb01daa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 0x7fbafc1058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:28.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.810+0000 7fbb01daa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 0x7fbafc1058c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43062/0 (socket says 172.21.15.38:43062) 2024-09-13T18:21:28.818 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.810+0000 7fbb01daa640 1 -- 172.21.15.38:0/1034022545 learned_addr learned my addr 172.21.15.38:0/1034022545 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.810+0000 7fbb01daa640 1 -- 172.21.15.38:0/1034022545 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc106620 con 0x7fbafc1054c0 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.811+0000 7fbb01daa640 1 --2- 172.21.15.38:0/1034022545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 0x7fbafc1058c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbaec009e80 tx=0x7fbaec02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc3278fb7a9e8df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.811+0000 7fbb00da8640 1 -- 172.21.15.38:0/1034022545 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaec031400 con 0x7fbafc1054c0 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.811+0000 7fbb00da8640 1 -- 172.21.15.38:0/1034022545 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fbaec02d050 con 0x7fbafc1054c0 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.811+0000 7fbb00da8640 1 -- 172.21.15.38:0/1034022545 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaec0077a0 con 0x7fbafc1054c0 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.811+0000 7fbb0400e640 1 -- 172.21.15.38:0/1034022545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 msgr2=0x7fbafc1058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.811+0000 7fbb0400e640 1 --2- 172.21.15.38:0/1034022545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 0x7fbafc1058c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbaec009e80 tx=0x7fbaec02a7a0 comp rx=0 tx=0).stop 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.812+0000 7fbb0400e640 1 -- 172.21.15.38:0/1034022545 shutdown_connections 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.812+0000 7fbb0400e640 1 --2- 172.21.15.38:0/1034022545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 0x7fbafc1058c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.812+0000 7fbb0400e640 1 -- 172.21.15.38:0/1034022545 >> 172.21.15.38:0/1034022545 conn(0x7fbafc100c70 msgr2=0x7fbafc103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.812+0000 7fbb0400e640 1 -- 172.21.15.38:0/1034022545 shutdown_connections 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.812+0000 7fbb0400e640 1 -- 172.21.15.38:0/1034022545 wait complete. 2024-09-13T18:21:28.819 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.812+0000 7fbb0400e640 1 Processor -- start 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.812+0000 7fbb0400e640 1 -- start start 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.813+0000 7fbb0400e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 0x7fbafc1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.813+0000 7fbb0400e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc1996e0 con 0x7fbafc1054c0 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.813+0000 7fbb01daa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 0x7fbafc1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.813+0000 7fbb01daa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 0x7fbafc1991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43070/0 (socket says 172.21.15.38:43070) 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.813+0000 7fbb01daa640 1 -- 172.21.15.38:0/4257205933 learned_addr learned my addr 172.21.15.38:0/4257205933 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.813+0000 7fbb01daa640 1 -- 172.21.15.38:0/4257205933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec009b30 con 0x7fbafc1054c0 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.813+0000 7fbb01daa640 1 --2- 172.21.15.38:0/4257205933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 0x7fbafc1991a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbaec031660 tx=0x7fbaec031690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.813+0000 7fbafaffd640 1 -- 172.21.15.38:0/4257205933 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaec031c30 con 0x7fbafc1054c0 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.813+0000 7fbafaffd640 1 -- 172.21.15.38:0/4257205933 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1007+0+0 (secure 0 0 0) 0x7fbaec031d90 con 0x7fbafc1054c0 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.813+0000 7fbb0400e640 1 -- 172.21.15.38:0/4257205933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbafc1998e0 con 0x7fbafc1054c0 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.813+0000 7fbafaffd640 1 -- 172.21.15.38:0/4257205933 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbaec039630 con 0x7fbafc1054c0 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.813+0000 7fbb0400e640 1 -- 172.21.15.38:0/4257205933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbafc199d80 con 0x7fbafc1054c0 2024-09-13T18:21:28.820 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.814+0000 7fbafaffd640 1 -- 172.21.15.38:0/4257205933 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fbaec038040 con 0x7fbafc1054c0 2024-09-13T18:21:28.821 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.814+0000 7fbafaffd640 1 --2- 172.21.15.38:0/4257205933 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fbae40386a0 0x7fbae403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:28.821 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.815+0000 7fbafaffd640 1 -- 172.21.15.38:0/4257205933 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbaec06b570 con 0x7fbafc1054c0 2024-09-13T18:21:28.821 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.815+0000 7fbb0400e640 1 -- 172.21.15.38:0/4257205933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbafc109850 con 0x7fbafc1054c0 2024-09-13T18:21:28.821 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.815+0000 7fbb015a9640 1 --2- 172.21.15.38:0/4257205933 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fbae40386a0 0x7fbae403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:28.821 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.815+0000 7fbb015a9640 1 --2- 172.21.15.38:0/4257205933 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fbae40386a0 0x7fbae403ab60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00098c0 tx=0x7fbaf0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:28.821 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:27.819+0000 7fbafaffd640 1 -- 172.21.15.38:0/4257205933 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbaec041070 con 0x7fbafc1054c0 2024-09-13T18:21:28.821 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:28.005+0000 7fbb0400e640 1 -- 172.21.15.38:0/4257205933 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fbafc101f80 con 0x7fbae40386a0 2024-09-13T18:21:28.821 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:28.009+0000 7fbafaffd640 1 -- 172.21.15.38:0/4257205933 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fbafc101f80 con 0x7fbae40386a0 2024-09-13T18:21:28.821 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:28.012+0000 7fbb0400e640 1 -- 172.21.15.38:0/4257205933 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fbae40386a0 msgr2=0x7fbae403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:28.821 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:28.012+0000 7fbb0400e640 1 --2- 172.21.15.38:0/4257205933 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fbae40386a0 0x7fbae403ab60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00098c0 tx=0x7fbaf0006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:28.821 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:28.012+0000 7fbb0400e640 1 -- 172.21.15.38:0/4257205933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 msgr2=0x7fbafc1991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:28.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:28.012+0000 7fbb0400e640 1 --2- 172.21.15.38:0/4257205933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 0x7fbafc1991a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbaec031660 tx=0x7fbaec031690 comp rx=0 tx=0).stop 2024-09-13T18:21:28.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:28.012+0000 7fbb0400e640 1 -- 172.21.15.38:0/4257205933 shutdown_connections 2024-09-13T18:21:28.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:28.012+0000 7fbb0400e640 1 --2- 172.21.15.38:0/4257205933 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fbae40386a0 0x7fbae403ab60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:28.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:28.012+0000 7fbb0400e640 1 --2- 172.21.15.38:0/4257205933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc1054c0 0x7fbafc1991a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:28.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:28.012+0000 7fbb0400e640 1 -- 172.21.15.38:0/4257205933 >> 172.21.15.38:0/4257205933 conn(0x7fbafc100c70 msgr2=0x7fbafc101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:28.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:28.012+0000 7fbb0400e640 1 -- 172.21.15.38:0/4257205933 shutdown_connections 2024-09-13T18:21:28.822 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:28.012+0000 7fbb0400e640 1 -- 172.21.15.38:0/4257205933 wait complete. 2024-09-13T18:21:28.822 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying crash service with default placement... 2024-09-13T18:21:29.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:28 smithi038 ceph-mon[27689]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:21:29.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:28 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:29.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:28 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:29.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:28 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:30.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:29 smithi038 ceph-mon[27689]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:30.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:29 smithi038 ceph-mon[27689]: Saving service mgr spec with placement count:2 2024-09-13T18:21:30.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:29 smithi038 ceph-mon[27689]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:30.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:29 smithi038 ceph-mon[27689]: Saving service crash spec with placement * 2024-09-13T18:21:30.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:29 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:30.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:29 smithi038 ceph-mon[27689]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:21:30.107 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-13T18:21:30.107 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.207+0000 7fc34b78a640 1 Processor -- start 2024-09-13T18:21:30.107 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.208+0000 7fc34b78a640 1 -- start start 2024-09-13T18:21:30.107 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.208+0000 7fc34b78a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 0x7fc344104120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:30.107 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.208+0000 7fc34b78a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc344073ad0 con 0x7fc344103d20 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.208+0000 7fc349526640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 0x7fc344104120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.208+0000 7fc349526640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 0x7fc344104120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43084/0 (socket says 172.21.15.38:43084) 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.208+0000 7fc349526640 1 -- 172.21.15.38:0/2401124144 learned_addr learned my addr 172.21.15.38:0/2401124144 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.208+0000 7fc349526640 1 -- 172.21.15.38:0/2401124144 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc344104660 con 0x7fc344103d20 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.209+0000 7fc349526640 1 --2- 172.21.15.38:0/2401124144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 0x7fc344104120 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc340009820 tx=0x7fc34002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9032965793fcae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.209+0000 7fc33bfff640 1 -- 172.21.15.38:0/2401124144 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc34002ad40 con 0x7fc344103d20 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.209+0000 7fc33bfff640 1 -- 172.21.15.38:0/2401124144 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc3400328e0 con 0x7fc344103d20 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.209+0000 7fc33bfff640 1 -- 172.21.15.38:0/2401124144 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3400307d0 con 0x7fc344103d20 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.210+0000 7fc34b78a640 1 -- 172.21.15.38:0/2401124144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 msgr2=0x7fc344104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.210+0000 7fc34b78a640 1 --2- 172.21.15.38:0/2401124144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 0x7fc344104120 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc340009820 tx=0x7fc34002a270 comp rx=0 tx=0).stop 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.210+0000 7fc34b78a640 1 -- 172.21.15.38:0/2401124144 shutdown_connections 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.210+0000 7fc34b78a640 1 --2- 172.21.15.38:0/2401124144 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 0x7fc344104120 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:30.108 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.210+0000 7fc34b78a640 1 -- 172.21.15.38:0/2401124144 >> 172.21.15.38:0/2401124144 conn(0x7fc3440ffb50 msgr2=0x7fc344101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.210+0000 7fc34b78a640 1 -- 172.21.15.38:0/2401124144 shutdown_connections 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.210+0000 7fc34b78a640 1 -- 172.21.15.38:0/2401124144 wait complete. 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.210+0000 7fc34b78a640 1 Processor -- start 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.210+0000 7fc34b78a640 1 -- start start 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.211+0000 7fc34b78a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 0x7fc34419b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.211+0000 7fc34b78a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34419baa0 con 0x7fc344103d20 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.211+0000 7fc349526640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 0x7fc34419b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.211+0000 7fc349526640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 0x7fc34419b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43092/0 (socket says 172.21.15.38:43092) 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.211+0000 7fc349526640 1 -- 172.21.15.38:0/361112493 learned_addr learned my addr 172.21.15.38:0/361112493 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.211+0000 7fc349526640 1 -- 172.21.15.38:0/361112493 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400094d0 con 0x7fc344103d20 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.211+0000 7fc349526640 1 --2- 172.21.15.38:0/361112493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 0x7fc34419b560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc340032670 tx=0x7fc3400326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.211+0000 7fc33a7fc640 1 -- 172.21.15.38:0/361112493 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc340030e40 con 0x7fc344103d20 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.211+0000 7fc33a7fc640 1 -- 172.21.15.38:0/361112493 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc34003b8b0 con 0x7fc344103d20 2024-09-13T18:21:30.109 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.211+0000 7fc33a7fc640 1 -- 172.21.15.38:0/361112493 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc34003a650 con 0x7fc344103d20 2024-09-13T18:21:30.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.211+0000 7fc34b78a640 1 -- 172.21.15.38:0/361112493 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34419bca0 con 0x7fc344103d20 2024-09-13T18:21:30.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.212+0000 7fc34b78a640 1 -- 172.21.15.38:0/361112493 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34419c0c0 con 0x7fc344103d20 2024-09-13T18:21:30.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.213+0000 7fc34b78a640 1 -- 172.21.15.38:0/361112493 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc344105d10 con 0x7fc344103d20 2024-09-13T18:21:30.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.213+0000 7fc33a7fc640 1 -- 172.21.15.38:0/361112493 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fc340039040 con 0x7fc344103d20 2024-09-13T18:21:30.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.213+0000 7fc33a7fc640 1 --2- 172.21.15.38:0/361112493 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fc330038650 0x7fc33003ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:30.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.213+0000 7fc33a7fc640 1 -- 172.21.15.38:0/361112493 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc34006b7b0 con 0x7fc344103d20 2024-09-13T18:21:30.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.214+0000 7fc348d25640 1 --2- 172.21.15.38:0/361112493 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fc330038650 0x7fc33003ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:30.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.214+0000 7fc348d25640 1 --2- 172.21.15.38:0/361112493 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fc330038650 0x7fc33003ab10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc3340098c0 tx=0x7fc334006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:30.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.218+0000 7fc33a7fc640 1 -- 172.21.15.38:0/361112493 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc340042b90 con 0x7fc344103d20 2024-09-13T18:21:30.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.413+0000 7fc34b78a640 1 -- 172.21.15.38:0/361112493 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3440608f0 con 0x7fc330038650 2024-09-13T18:21:30.110 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.423+0000 7fc33a7fc640 1 -- 172.21.15.38:0/361112493 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fc3440608f0 con 0x7fc330038650 2024-09-13T18:21:30.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.425+0000 7fc34b78a640 1 -- 172.21.15.38:0/361112493 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fc330038650 msgr2=0x7fc33003ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:30.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.425+0000 7fc34b78a640 1 --2- 172.21.15.38:0/361112493 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fc330038650 0x7fc33003ab10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc3340098c0 tx=0x7fc334006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:30.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.425+0000 7fc34b78a640 1 -- 172.21.15.38:0/361112493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 msgr2=0x7fc34419b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:30.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.425+0000 7fc34b78a640 1 --2- 172.21.15.38:0/361112493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 0x7fc34419b560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc340032670 tx=0x7fc3400326a0 comp rx=0 tx=0).stop 2024-09-13T18:21:30.111 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.425+0000 7fc34b78a640 1 -- 172.21.15.38:0/361112493 shutdown_connections 2024-09-13T18:21:30.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.425+0000 7fc34b78a640 1 --2- 172.21.15.38:0/361112493 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fc330038650 0x7fc33003ab10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:30.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.425+0000 7fc34b78a640 1 --2- 172.21.15.38:0/361112493 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc344103d20 0x7fc34419b560 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:30.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.425+0000 7fc34b78a640 1 -- 172.21.15.38:0/361112493 >> 172.21.15.38:0/361112493 conn(0x7fc3440ffb50 msgr2=0x7fc344192230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:30.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.425+0000 7fc34b78a640 1 -- 172.21.15.38:0/361112493 shutdown_connections 2024-09-13T18:21:30.112 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:29.425+0000 7fc34b78a640 1 -- 172.21.15.38:0/361112493 wait complete. 2024-09-13T18:21:30.112 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying ceph-exporter service with default placement... 2024-09-13T18:21:31.444 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-13T18:21:31.445 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.460+0000 7fd365f91640 1 Processor -- start 2024-09-13T18:21:31.445 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.460+0000 7fd365f91640 1 -- start start 2024-09-13T18:21:31.445 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.460+0000 7fd365f91640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 0x7fd36007a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:31.445 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.460+0000 7fd365f91640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36007a7a0 con 0x7fd36007bd60 2024-09-13T18:21:31.445 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.461+0000 7fd35f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 0x7fd36007a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:31.445 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.461+0000 7fd35f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 0x7fd36007a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43098/0 (socket says 172.21.15.38:43098) 2024-09-13T18:21:31.445 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.461+0000 7fd35f7fe640 1 -- 172.21.15.38:0/931984800 learned_addr learned my addr 172.21.15.38:0/931984800 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:31.445 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.461+0000 7fd35f7fe640 1 -- 172.21.15.38:0/931984800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36007a8e0 con 0x7fd36007bd60 2024-09-13T18:21:31.445 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.462+0000 7fd35f7fe640 1 --2- 172.21.15.38:0/931984800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 0x7fd36007a260 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd350009820 tx=0x7fd35002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c38de38a23132b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:31.445 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.462+0000 7fd35e7fc640 1 -- 172.21.15.38:0/931984800 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd35002ad40 con 0x7fd36007bd60 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.462+0000 7fd35e7fc640 1 -- 172.21.15.38:0/931984800 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd3500328e0 con 0x7fd36007bd60 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.462+0000 7fd35e7fc640 1 -- 172.21.15.38:0/931984800 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3500307d0 con 0x7fd36007bd60 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.462+0000 7fd365f91640 1 -- 172.21.15.38:0/931984800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 msgr2=0x7fd36007a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.462+0000 7fd365f91640 1 --2- 172.21.15.38:0/931984800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 0x7fd36007a260 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd350009820 tx=0x7fd35002a270 comp rx=0 tx=0).stop 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.463+0000 7fd365f91640 1 -- 172.21.15.38:0/931984800 shutdown_connections 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.463+0000 7fd365f91640 1 --2- 172.21.15.38:0/931984800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 0x7fd36007a260 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.463+0000 7fd365f91640 1 -- 172.21.15.38:0/931984800 >> 172.21.15.38:0/931984800 conn(0x7fd360100c70 msgr2=0x7fd360103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.463+0000 7fd365f91640 1 -- 172.21.15.38:0/931984800 shutdown_connections 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.463+0000 7fd365f91640 1 -- 172.21.15.38:0/931984800 wait complete. 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.463+0000 7fd365f91640 1 Processor -- start 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.463+0000 7fd365f91640 1 -- start start 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.464+0000 7fd365f91640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 0x7fd36019b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.464+0000 7fd365f91640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36019b810 con 0x7fd36007bd60 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.464+0000 7fd35f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 0x7fd36019b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.464+0000 7fd35f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 0x7fd36019b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43110/0 (socket says 172.21.15.38:43110) 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.464+0000 7fd35f7fe640 1 -- 172.21.15.38:0/3283116780 learned_addr learned my addr 172.21.15.38:0/3283116780 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.464+0000 7fd35f7fe640 1 -- 172.21.15.38:0/3283116780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3500094d0 con 0x7fd36007bd60 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.464+0000 7fd35f7fe640 1 --2- 172.21.15.38:0/3283116780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 0x7fd36019b2d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd350032670 tx=0x7fd3500326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.464+0000 7fd35cff9640 1 -- 172.21.15.38:0/3283116780 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd350030e40 con 0x7fd36007bd60 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.464+0000 7fd35cff9640 1 -- 172.21.15.38:0/3283116780 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd35003b8b0 con 0x7fd36007bd60 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.464+0000 7fd35cff9640 1 -- 172.21.15.38:0/3283116780 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd35003a650 con 0x7fd36007bd60 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.464+0000 7fd365f91640 1 -- 172.21.15.38:0/3283116780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36019ba10 con 0x7fd36007bd60 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.464+0000 7fd365f91640 1 -- 172.21.15.38:0/3283116780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36019be30 con 0x7fd36007bd60 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.465+0000 7fd35cff9640 1 -- 172.21.15.38:0/3283116780 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fd350039040 con 0x7fd36007bd60 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.466+0000 7fd35cff9640 1 --2- 172.21.15.38:0/3283116780 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fd3480386a0 0x7fd34803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.466+0000 7fd365f91640 1 -- 172.21.15.38:0/3283116780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36010b780 con 0x7fd36007bd60 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.466+0000 7fd35cff9640 1 -- 172.21.15.38:0/3283116780 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd35006b830 con 0x7fd36007bd60 2024-09-13T18:21:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.466+0000 7fd35effd640 1 --2- 172.21.15.38:0/3283116780 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fd3480386a0 0x7fd34803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.466+0000 7fd35effd640 1 --2- 172.21.15.38:0/3283116780 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fd3480386a0 0x7fd34803ab60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd3540098c0 tx=0x7fd354006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.470+0000 7fd35cff9640 1 -- 172.21.15.38:0/3283116780 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd350042360 con 0x7fd36007bd60 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.653+0000 7fd365f91640 1 -- 172.21.15.38:0/3283116780 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fd360101ef0 con 0x7fd3480386a0 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.657+0000 7fd35cff9640 1 -- 172.21.15.38:0/3283116780 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fd360101ef0 con 0x7fd3480386a0 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.659+0000 7fd365f91640 1 -- 172.21.15.38:0/3283116780 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fd3480386a0 msgr2=0x7fd34803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.659+0000 7fd365f91640 1 --2- 172.21.15.38:0/3283116780 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fd3480386a0 0x7fd34803ab60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd3540098c0 tx=0x7fd354006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.659+0000 7fd365f91640 1 -- 172.21.15.38:0/3283116780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 msgr2=0x7fd36019b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.659+0000 7fd365f91640 1 --2- 172.21.15.38:0/3283116780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 0x7fd36019b2d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd350032670 tx=0x7fd3500326a0 comp rx=0 tx=0).stop 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.659+0000 7fd365f91640 1 -- 172.21.15.38:0/3283116780 shutdown_connections 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.659+0000 7fd365f91640 1 --2- 172.21.15.38:0/3283116780 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fd3480386a0 0x7fd34803ab60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.659+0000 7fd365f91640 1 --2- 172.21.15.38:0/3283116780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd36007bd60 0x7fd36019b2d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.659+0000 7fd365f91640 1 -- 172.21.15.38:0/3283116780 >> 172.21.15.38:0/3283116780 conn(0x7fd360100c70 msgr2=0x7fd3601017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.659+0000 7fd365f91640 1 -- 172.21.15.38:0/3283116780 shutdown_connections 2024-09-13T18:21:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:30.659+0000 7fd365f91640 1 -- 172.21.15.38:0/3283116780 wait complete. 2024-09-13T18:21:31.449 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying prometheus service with default placement... 2024-09-13T18:21:31.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:31 smithi038 ceph-mon[27689]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:31.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:31 smithi038 ceph-mon[27689]: Saving service ceph-exporter spec with placement * 2024-09-13T18:21:31.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:31 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:31.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:31 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:32.652 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-13T18:21:32.652 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.828+0000 7f5b92829640 1 Processor -- start 2024-09-13T18:21:32.652 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.829+0000 7f5b92829640 1 -- start start 2024-09-13T18:21:32.652 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.829+0000 7f5b92829640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 0x7f5b8c104740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:32.652 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.829+0000 7f5b92829640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c104d10 con 0x7f5b8c104340 2024-09-13T18:21:32.652 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.829+0000 7f5b8bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 0x7f5b8c104740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:32.652 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.829+0000 7f5b8bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 0x7f5b8c104740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43122/0 (socket says 172.21.15.38:43122) 2024-09-13T18:21:32.652 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.829+0000 7f5b8bfff640 1 -- 172.21.15.38:0/249163993 learned_addr learned my addr 172.21.15.38:0/249163993 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.829+0000 7f5b8bfff640 1 -- 172.21.15.38:0/249163993 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c105540 con 0x7f5b8c104340 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.830+0000 7f5b8bfff640 1 --2- 172.21.15.38:0/249163993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 0x7f5b8c104740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009820 tx=0x7f5b7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1426ba83a80235 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.830+0000 7f5b8affd640 1 -- 172.21.15.38:0/249163993 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b7c02ad40 con 0x7f5b8c104340 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.831+0000 7f5b8affd640 1 -- 172.21.15.38:0/249163993 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5b7c0328e0 con 0x7f5b8c104340 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.831+0000 7f5b8affd640 1 -- 172.21.15.38:0/249163993 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b7c0307d0 con 0x7f5b8c104340 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.831+0000 7f5b92829640 1 -- 172.21.15.38:0/249163993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 msgr2=0x7f5b8c104740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.831+0000 7f5b92829640 1 --2- 172.21.15.38:0/249163993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 0x7f5b8c104740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009820 tx=0x7f5b7c02a270 comp rx=0 tx=0).stop 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.831+0000 7f5b92829640 1 -- 172.21.15.38:0/249163993 shutdown_connections 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.831+0000 7f5b92829640 1 --2- 172.21.15.38:0/249163993 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 0x7f5b8c104740 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.831+0000 7f5b92829640 1 -- 172.21.15.38:0/249163993 >> 172.21.15.38:0/249163993 conn(0x7f5b8c0ffb50 msgr2=0x7f5b8c101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.831+0000 7f5b92829640 1 -- 172.21.15.38:0/249163993 shutdown_connections 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.831+0000 7f5b92829640 1 -- 172.21.15.38:0/249163993 wait complete. 2024-09-13T18:21:32.653 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.832+0000 7f5b92829640 1 Processor -- start 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.832+0000 7f5b92829640 1 -- start start 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.832+0000 7f5b92829640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 0x7f5b8c0736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.832+0000 7f5b92829640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c073c30 con 0x7f5b8c104340 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.833+0000 7f5b8bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 0x7f5b8c0736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.833+0000 7f5b8bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 0x7f5b8c0736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43126/0 (socket says 172.21.15.38:43126) 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.833+0000 7f5b8bfff640 1 -- 172.21.15.38:0/3600329507 learned_addr learned my addr 172.21.15.38:0/3600329507 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.833+0000 7f5b8bfff640 1 -- 172.21.15.38:0/3600329507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0094d0 con 0x7f5b8c104340 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.833+0000 7f5b8bfff640 1 --2- 172.21.15.38:0/3600329507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 0x7f5b8c0736f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009940 tx=0x7f5b7c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.833+0000 7f5b897fa640 1 -- 172.21.15.38:0/3600329507 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b7c030cf0 con 0x7f5b8c104340 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.833+0000 7f5b897fa640 1 -- 172.21.15.38:0/3600329507 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5b7c030e50 con 0x7f5b8c104340 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.833+0000 7f5b92829640 1 -- 172.21.15.38:0/3600329507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8c19bf00 con 0x7f5b8c104340 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.833+0000 7f5b897fa640 1 -- 172.21.15.38:0/3600329507 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b7c03a540 con 0x7f5b8c104340 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.833+0000 7f5b92829640 1 -- 172.21.15.38:0/3600329507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8c19c320 con 0x7f5b8c104340 2024-09-13T18:21:32.654 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.834+0000 7f5b897fa640 1 -- 172.21.15.38:0/3600329507 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f5b7c039040 con 0x7f5b8c104340 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.834+0000 7f5b92829640 1 -- 172.21.15.38:0/3600329507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b8c108770 con 0x7f5b8c104340 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.834+0000 7f5b897fa640 1 --2- 172.21.15.38:0/3600329507 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f5b74038650 0x7f5b7403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.834+0000 7f5b897fa640 1 -- 172.21.15.38:0/3600329507 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5b7c06b760 con 0x7f5b8c104340 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.834+0000 7f5b8b7fe640 1 --2- 172.21.15.38:0/3600329507 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f5b74038650 0x7f5b7403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.835+0000 7f5b8b7fe640 1 --2- 172.21.15.38:0/3600329507 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f5b74038650 0x7f5b7403ab10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b800098c0 tx=0x7f5b80006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:31.839+0000 7f5b897fa640 1 -- 172.21.15.38:0/3600329507 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5b7c04b300 con 0x7f5b8c104340 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:32.023+0000 7f5b92829640 1 -- 172.21.15.38:0/3600329507 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b8c19c620 con 0x7f5b74038650 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:32.037+0000 7f5b897fa640 1 -- 172.21.15.38:0/3600329507 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f5b8c19c620 con 0x7f5b74038650 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:32.039+0000 7f5b92829640 1 -- 172.21.15.38:0/3600329507 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f5b74038650 msgr2=0x7f5b7403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:32.039+0000 7f5b92829640 1 --2- 172.21.15.38:0/3600329507 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f5b74038650 0x7f5b7403ab10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b800098c0 tx=0x7f5b80006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:32.039+0000 7f5b92829640 1 -- 172.21.15.38:0/3600329507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 msgr2=0x7f5b8c0736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:32.039+0000 7f5b92829640 1 --2- 172.21.15.38:0/3600329507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 0x7f5b8c0736f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009940 tx=0x7f5b7c032670 comp rx=0 tx=0).stop 2024-09-13T18:21:32.655 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:32.040+0000 7f5b92829640 1 -- 172.21.15.38:0/3600329507 shutdown_connections 2024-09-13T18:21:32.656 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:32.040+0000 7f5b92829640 1 --2- 172.21.15.38:0/3600329507 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f5b74038650 0x7f5b7403ab10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:32.656 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:32.040+0000 7f5b92829640 1 --2- 172.21.15.38:0/3600329507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b8c104340 0x7f5b8c0736f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:32.656 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:32.040+0000 7f5b92829640 1 -- 172.21.15.38:0/3600329507 >> 172.21.15.38:0/3600329507 conn(0x7f5b8c0ffb50 msgr2=0x7f5b8c1006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:32.656 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:32.040+0000 7f5b92829640 1 -- 172.21.15.38:0/3600329507 shutdown_connections 2024-09-13T18:21:32.656 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:32.040+0000 7f5b92829640 1 -- 172.21.15.38:0/3600329507 wait complete. 2024-09-13T18:21:32.656 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying grafana service with default placement... 2024-09-13T18:21:32.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:32 smithi038 ceph-mon[27689]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:21:32.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:32 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:32.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:32 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:33.962 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:33 smithi038 ceph-mon[27689]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:33.962 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:33 smithi038 ceph-mon[27689]: Saving service prometheus spec with placement count:1 2024-09-13T18:21:33.962 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:33 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:33.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-13T18:21:33.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.033+0000 7f4864f29640 1 Processor -- start 2024-09-13T18:21:33.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.033+0000 7f4864f29640 1 -- start start 2024-09-13T18:21:33.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.033+0000 7f4864f29640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 0x7f48601082a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:33.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.033+0000 7f4864f29640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4860073b50 con 0x7f4860105eb0 2024-09-13T18:21:33.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.034+0000 7f485e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 0x7f48601082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:33.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.034+0000 7f485e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 0x7f48601082a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36252/0 (socket says 172.21.15.38:36252) 2024-09-13T18:21:33.971 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.034+0000 7f485e59c640 1 -- 172.21.15.38:0/3024907027 learned_addr learned my addr 172.21.15.38:0/3024907027 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.034+0000 7f485e59c640 1 -- 172.21.15.38:0/3024907027 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48601087e0 con 0x7f4860105eb0 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.035+0000 7f485e59c640 1 --2- 172.21.15.38:0/3024907027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 0x7f48601082a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4858009820 tx=0x7f485802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19b778de520fc6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.035+0000 7f485d59a640 1 -- 172.21.15.38:0/3024907027 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f485802ad40 con 0x7f4860105eb0 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.035+0000 7f485d59a640 1 -- 172.21.15.38:0/3024907027 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f48580328e0 con 0x7f4860105eb0 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.035+0000 7f485d59a640 1 -- 172.21.15.38:0/3024907027 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48580307d0 con 0x7f4860105eb0 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.035+0000 7f4864f29640 1 -- 172.21.15.38:0/3024907027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 msgr2=0x7f48601082a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.035+0000 7f4864f29640 1 --2- 172.21.15.38:0/3024907027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 0x7f48601082a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4858009820 tx=0x7f485802a270 comp rx=0 tx=0).stop 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.035+0000 7f4864f29640 1 -- 172.21.15.38:0/3024907027 shutdown_connections 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.035+0000 7f4864f29640 1 --2- 172.21.15.38:0/3024907027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 0x7f48601082a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.035+0000 7f4864f29640 1 -- 172.21.15.38:0/3024907027 >> 172.21.15.38:0/3024907027 conn(0x7f48600ffb50 msgr2=0x7f4860101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.036+0000 7f4864f29640 1 -- 172.21.15.38:0/3024907027 shutdown_connections 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.036+0000 7f4864f29640 1 -- 172.21.15.38:0/3024907027 wait complete. 2024-09-13T18:21:33.972 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.036+0000 7f4864f29640 1 Processor -- start 2024-09-13T18:21:33.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.036+0000 7f4864f29640 1 -- start start 2024-09-13T18:21:33.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.036+0000 7f4864f29640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 0x7f486019b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:33.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.036+0000 7f4864f29640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486019b880 con 0x7f4860105eb0 2024-09-13T18:21:33.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.037+0000 7f485e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 0x7f486019b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:33.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.037+0000 7f485e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 0x7f486019b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36268/0 (socket says 172.21.15.38:36268) 2024-09-13T18:21:33.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.037+0000 7f485e59c640 1 -- 172.21.15.38:0/3080987350 learned_addr learned my addr 172.21.15.38:0/3080987350 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:33.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.037+0000 7f485e59c640 1 -- 172.21.15.38:0/3080987350 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48580094d0 con 0x7f4860105eb0 2024-09-13T18:21:33.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.037+0000 7f485e59c640 1 --2- 172.21.15.38:0/3080987350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 0x7f486019b340 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4858030380 tx=0x7f4858032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:33.973 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.037+0000 7f48577fe640 1 -- 172.21.15.38:0/3080987350 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4858030df0 con 0x7f4860105eb0 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.037+0000 7f48577fe640 1 -- 172.21.15.38:0/3080987350 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f485803b8c0 con 0x7f4860105eb0 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.037+0000 7f4864f29640 1 -- 172.21.15.38:0/3080987350 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486019ba80 con 0x7f4860105eb0 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.037+0000 7f48577fe640 1 -- 172.21.15.38:0/3080987350 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f485803a760 con 0x7f4860105eb0 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.037+0000 7f4864f29640 1 -- 172.21.15.38:0/3080987350 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486019bea0 con 0x7f4860105eb0 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.038+0000 7f48577fe640 1 -- 172.21.15.38:0/3080987350 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f4858039070 con 0x7f4860105eb0 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.038+0000 7f48577fe640 1 --2- 172.21.15.38:0/3080987350 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f484c038650 0x7f484c03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.038+0000 7f48577fe640 1 -- 172.21.15.38:0/3080987350 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f485806b980 con 0x7f4860105eb0 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.038+0000 7f4864f29640 1 -- 172.21.15.38:0/3080987350 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4860109590 con 0x7f4860105eb0 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.039+0000 7f485dd9b640 1 --2- 172.21.15.38:0/3080987350 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f484c038650 0x7f484c03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.039+0000 7f485dd9b640 1 --2- 172.21.15.38:0/3080987350 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f484c038650 0x7f484c03ab10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f48480098c0 tx=0x7f4848006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.043+0000 7f48577fe640 1 -- 172.21.15.38:0/3080987350 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f485803f030 con 0x7f4860105eb0 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.235+0000 7f4864f29640 1 -- 172.21.15.38:0/3080987350 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f486019e800 con 0x7f484c038650 2024-09-13T18:21:33.974 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.239+0000 7f48577fe640 1 -- 172.21.15.38:0/3080987350 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f486019e800 con 0x7f484c038650 2024-09-13T18:21:33.975 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.242+0000 7f4864f29640 1 -- 172.21.15.38:0/3080987350 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f484c038650 msgr2=0x7f484c03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:33.975 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.242+0000 7f4864f29640 1 --2- 172.21.15.38:0/3080987350 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f484c038650 0x7f484c03ab10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f48480098c0 tx=0x7f4848006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:33.975 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.242+0000 7f4864f29640 1 -- 172.21.15.38:0/3080987350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 msgr2=0x7f486019b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:33.975 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.242+0000 7f4864f29640 1 --2- 172.21.15.38:0/3080987350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 0x7f486019b340 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4858030380 tx=0x7f4858032670 comp rx=0 tx=0).stop 2024-09-13T18:21:33.975 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.242+0000 7f4864f29640 1 -- 172.21.15.38:0/3080987350 shutdown_connections 2024-09-13T18:21:33.975 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.242+0000 7f4864f29640 1 --2- 172.21.15.38:0/3080987350 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f484c038650 0x7f484c03ab10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:33.975 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.242+0000 7f4864f29640 1 --2- 172.21.15.38:0/3080987350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4860105eb0 0x7f486019b340 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:33.975 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.242+0000 7f4864f29640 1 -- 172.21.15.38:0/3080987350 >> 172.21.15.38:0/3080987350 conn(0x7f48600ffb50 msgr2=0x7f4860100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:33.975 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.242+0000 7f4864f29640 1 -- 172.21.15.38:0/3080987350 shutdown_connections 2024-09-13T18:21:33.975 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:33.242+0000 7f4864f29640 1 -- 172.21.15.38:0/3080987350 wait complete. 2024-09-13T18:21:33.975 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying node-exporter service with default placement... 2024-09-13T18:21:34.829 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:34 smithi038 ceph-mon[27689]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:34.829 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:34 smithi038 ceph-mon[27689]: Saving service grafana spec with placement count:1 2024-09-13T18:21:34.829 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:34 smithi038 ceph-mon[27689]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:21:35.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-13T18:21:35.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.634+0000 7f23dc0d4640 1 Processor -- start 2024-09-13T18:21:35.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.634+0000 7f23dc0d4640 1 -- start start 2024-09-13T18:21:35.530 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.634+0000 7f23dc0d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 0x7f23d407a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.634+0000 7f23dc0d4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d407a7c0 con 0x7f23d407bd80 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.635+0000 7f23d9e70640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 0x7f23d407a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.635+0000 7f23d9e70640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 0x7f23d407a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36280/0 (socket says 172.21.15.38:36280) 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.635+0000 7f23d9e70640 1 -- 172.21.15.38:0/3762321586 learned_addr learned my addr 172.21.15.38:0/3762321586 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.635+0000 7f23d9e70640 1 -- 172.21.15.38:0/3762321586 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d407a900 con 0x7f23d407bd80 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.636+0000 7f23d9e70640 1 --2- 172.21.15.38:0/3762321586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 0x7f23d407a280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009820 tx=0x7f23d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942c139be2c8e2a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.636+0000 7f23d8e6e640 1 -- 172.21.15.38:0/3762321586 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23d002ad40 con 0x7f23d407bd80 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.636+0000 7f23d8e6e640 1 -- 172.21.15.38:0/3762321586 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23d00328e0 con 0x7f23d407bd80 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.636+0000 7f23d8e6e640 1 -- 172.21.15.38:0/3762321586 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23d00307d0 con 0x7f23d407bd80 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.636+0000 7f23dc0d4640 1 -- 172.21.15.38:0/3762321586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 msgr2=0x7f23d407a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.636+0000 7f23dc0d4640 1 --2- 172.21.15.38:0/3762321586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 0x7f23d407a280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009820 tx=0x7f23d002a270 comp rx=0 tx=0).stop 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.636+0000 7f23dc0d4640 1 -- 172.21.15.38:0/3762321586 shutdown_connections 2024-09-13T18:21:35.531 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.636+0000 7f23dc0d4640 1 --2- 172.21.15.38:0/3762321586 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 0x7f23d407a280 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.636+0000 7f23dc0d4640 1 -- 172.21.15.38:0/3762321586 >> 172.21.15.38:0/3762321586 conn(0x7f23d4100c70 msgr2=0x7f23d4103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.636+0000 7f23dc0d4640 1 -- 172.21.15.38:0/3762321586 shutdown_connections 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.636+0000 7f23dc0d4640 1 -- 172.21.15.38:0/3762321586 wait complete. 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.637+0000 7f23dc0d4640 1 Processor -- start 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.637+0000 7f23dc0d4640 1 -- start start 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.637+0000 7f23dc0d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 0x7f23d419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.637+0000 7f23dc0d4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d419b810 con 0x7f23d407bd80 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.637+0000 7f23d9e70640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 0x7f23d419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.637+0000 7f23d9e70640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 0x7f23d419b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36292/0 (socket says 172.21.15.38:36292) 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.637+0000 7f23d9e70640 1 -- 172.21.15.38:0/2364751579 learned_addr learned my addr 172.21.15.38:0/2364751579 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.638+0000 7f23d9e70640 1 -- 172.21.15.38:0/2364751579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d00094d0 con 0x7f23d407bd80 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.638+0000 7f23d9e70640 1 --2- 172.21.15.38:0/2364751579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 0x7f23d419b2d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f23d0032670 tx=0x7f23d00326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.638+0000 7f23caffd640 1 -- 172.21.15.38:0/2364751579 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23d0030e40 con 0x7f23d407bd80 2024-09-13T18:21:35.532 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.638+0000 7f23caffd640 1 -- 172.21.15.38:0/2364751579 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23d003b8b0 con 0x7f23d407bd80 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.638+0000 7f23caffd640 1 -- 172.21.15.38:0/2364751579 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23d003a650 con 0x7f23d407bd80 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.638+0000 7f23dc0d4640 1 -- 172.21.15.38:0/2364751579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d419ba10 con 0x7f23d407bd80 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.638+0000 7f23dc0d4640 1 -- 172.21.15.38:0/2364751579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d419be30 con 0x7f23d407bd80 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.639+0000 7f23caffd640 1 -- 172.21.15.38:0/2364751579 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f23d0039040 con 0x7f23d407bd80 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.639+0000 7f23dc0d4640 1 -- 172.21.15.38:0/2364751579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d410b760 con 0x7f23d407bd80 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.639+0000 7f23caffd640 1 --2- 172.21.15.38:0/2364751579 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f23c00386a0 0x7f23c003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.640+0000 7f23caffd640 1 -- 172.21.15.38:0/2364751579 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f23d006b6d0 con 0x7f23d407bd80 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.640+0000 7f23d966f640 1 --2- 172.21.15.38:0/2364751579 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f23c00386a0 0x7f23c003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.640+0000 7f23d966f640 1 --2- 172.21.15.38:0/2364751579 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f23c00386a0 0x7f23c003ab60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f23c40098c0 tx=0x7f23c4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.644+0000 7f23caffd640 1 -- 172.21.15.38:0/2364751579 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f23d0031580 con 0x7f23d407bd80 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.827+0000 7f23dc0d4640 1 -- 172.21.15.38:0/2364751579 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f23d4101ef0 con 0x7f23c00386a0 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.831+0000 7f23caffd640 1 -- 172.21.15.38:0/2364751579 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f23d4101ef0 con 0x7f23c00386a0 2024-09-13T18:21:35.533 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.833+0000 7f23dc0d4640 1 -- 172.21.15.38:0/2364751579 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f23c00386a0 msgr2=0x7f23c003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:35.534 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.833+0000 7f23dc0d4640 1 --2- 172.21.15.38:0/2364751579 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f23c00386a0 0x7f23c003ab60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f23c40098c0 tx=0x7f23c4006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:35.534 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.833+0000 7f23dc0d4640 1 -- 172.21.15.38:0/2364751579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 msgr2=0x7f23d419b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:35.534 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.833+0000 7f23dc0d4640 1 --2- 172.21.15.38:0/2364751579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 0x7f23d419b2d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f23d0032670 tx=0x7f23d00326a0 comp rx=0 tx=0).stop 2024-09-13T18:21:35.534 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.833+0000 7f23dc0d4640 1 -- 172.21.15.38:0/2364751579 shutdown_connections 2024-09-13T18:21:35.534 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.833+0000 7f23dc0d4640 1 --2- 172.21.15.38:0/2364751579 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f23c00386a0 0x7f23c003ab60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:35.534 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.833+0000 7f23dc0d4640 1 --2- 172.21.15.38:0/2364751579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f23d407bd80 0x7f23d419b2d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:35.534 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.833+0000 7f23dc0d4640 1 -- 172.21.15.38:0/2364751579 >> 172.21.15.38:0/2364751579 conn(0x7f23d4100c70 msgr2=0x7f23d41017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:35.534 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.833+0000 7f23dc0d4640 1 -- 172.21.15.38:0/2364751579 shutdown_connections 2024-09-13T18:21:35.534 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:34.833+0000 7f23dc0d4640 1 -- 172.21.15.38:0/2364751579 wait complete. 2024-09-13T18:21:35.534 INFO:teuthology.orchestra.run.smithi038.stdout:Deploying alertmanager service with default placement... 2024-09-13T18:21:35.958 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:35 smithi038 ceph-mon[27689]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:35.958 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:35 smithi038 ceph-mon[27689]: Saving service node-exporter spec with placement * 2024-09-13T18:21:35.958 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:35 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:35.958 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:35 smithi038 ceph-mon[27689]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:21:36.680 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-13T18:21:36.680 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.955+0000 7fbe61982640 1 Processor -- start 2024-09-13T18:21:36.680 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.955+0000 7fbe61982640 1 -- start start 2024-09-13T18:21:36.680 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.955+0000 7fbe61982640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 0x7fbe5c1058c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:36.680 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.955+0000 7fbe61982640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c105e90 con 0x7fbe5c1054c0 2024-09-13T18:21:36.680 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.955+0000 7fbe5affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 0x7fbe5c1058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:36.680 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.956+0000 7fbe5affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 0x7fbe5c1058c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36306/0 (socket says 172.21.15.38:36306) 2024-09-13T18:21:36.680 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.956+0000 7fbe5affd640 1 -- 172.21.15.38:0/568985676 learned_addr learned my addr 172.21.15.38:0/568985676 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:36.680 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.956+0000 7fbe5affd640 1 -- 172.21.15.38:0/568985676 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c106620 con 0x7fbe5c1054c0 2024-09-13T18:21:36.680 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.957+0000 7fbe5affd640 1 --2- 172.21.15.38:0/568985676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 0x7fbe5c1058c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009820 tx=0x7fbe4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8872d738355635b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:36.680 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.957+0000 7fbe5a7fc640 1 -- 172.21.15.38:0/568985676 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe4c02ad40 con 0x7fbe5c1054c0 2024-09-13T18:21:36.680 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.957+0000 7fbe5a7fc640 1 -- 172.21.15.38:0/568985676 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbe4c0328e0 con 0x7fbe5c1054c0 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.957+0000 7fbe5a7fc640 1 -- 172.21.15.38:0/568985676 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe4c0307d0 con 0x7fbe5c1054c0 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.958+0000 7fbe61982640 1 -- 172.21.15.38:0/568985676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 msgr2=0x7fbe5c1058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.958+0000 7fbe61982640 1 --2- 172.21.15.38:0/568985676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 0x7fbe5c1058c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009820 tx=0x7fbe4c02a270 comp rx=0 tx=0).stop 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.958+0000 7fbe61982640 1 -- 172.21.15.38:0/568985676 shutdown_connections 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.958+0000 7fbe61982640 1 --2- 172.21.15.38:0/568985676 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 0x7fbe5c1058c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.958+0000 7fbe61982640 1 -- 172.21.15.38:0/568985676 >> 172.21.15.38:0/568985676 conn(0x7fbe5c100c70 msgr2=0x7fbe5c103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.958+0000 7fbe61982640 1 -- 172.21.15.38:0/568985676 shutdown_connections 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.958+0000 7fbe61982640 1 -- 172.21.15.38:0/568985676 wait complete. 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.958+0000 7fbe61982640 1 Processor -- start 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.958+0000 7fbe61982640 1 -- start start 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.958+0000 7fbe61982640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 0x7fbe5c199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.958+0000 7fbe61982640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c1996d0 con 0x7fbe5c1054c0 2024-09-13T18:21:36.681 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.959+0000 7fbe5affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 0x7fbe5c199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:36.682 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.959+0000 7fbe5affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 0x7fbe5c199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36312/0 (socket says 172.21.15.38:36312) 2024-09-13T18:21:36.682 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.959+0000 7fbe5affd640 1 -- 172.21.15.38:0/3183184018 learned_addr learned my addr 172.21.15.38:0/3183184018 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:36.682 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.959+0000 7fbe5affd640 1 -- 172.21.15.38:0/3183184018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c0094d0 con 0x7fbe5c1054c0 2024-09-13T18:21:36.682 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.959+0000 7fbe5affd640 1 --2- 172.21.15.38:0/3183184018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 0x7fbe5c199190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c030380 tx=0x7fbe4c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:36.682 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.959+0000 7fbe60980640 1 -- 172.21.15.38:0/3183184018 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe4c030df0 con 0x7fbe5c1054c0 2024-09-13T18:21:36.682 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.959+0000 7fbe60980640 1 -- 172.21.15.38:0/3183184018 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbe4c03b8c0 con 0x7fbe5c1054c0 2024-09-13T18:21:36.682 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.959+0000 7fbe61982640 1 -- 172.21.15.38:0/3183184018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c1998d0 con 0x7fbe5c1054c0 2024-09-13T18:21:36.682 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.959+0000 7fbe60980640 1 -- 172.21.15.38:0/3183184018 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe4c03a6f0 con 0x7fbe5c1054c0 2024-09-13T18:21:36.682 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.959+0000 7fbe61982640 1 -- 172.21.15.38:0/3183184018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c199cf0 con 0x7fbe5c1054c0 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.960+0000 7fbe60980640 1 -- 172.21.15.38:0/3183184018 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fbe4c039070 con 0x7fbe5c1054c0 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.960+0000 7fbe61982640 1 -- 172.21.15.38:0/3183184018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c109850 con 0x7fbe5c1054c0 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.960+0000 7fbe60980640 1 --2- 172.21.15.38:0/3183184018 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fbe480386a0 0x7fbe4803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.960+0000 7fbe60980640 1 -- 172.21.15.38:0/3183184018 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbe4c06bba0 con 0x7fbe5c1054c0 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.961+0000 7fbe53fff640 1 --2- 172.21.15.38:0/3183184018 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fbe480386a0 0x7fbe4803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.961+0000 7fbe53fff640 1 --2- 172.21.15.38:0/3183184018 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fbe480386a0 0x7fbe4803ab60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbe440098c0 tx=0x7fbe44006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:35.965+0000 7fbe60980640 1 -- 172.21.15.38:0/3183184018 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbe4c0396e0 con 0x7fbe5c1054c0 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:36.147+0000 7fbe61982640 1 -- 172.21.15.38:0/3183184018 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe5c101ef0 con 0x7fbe480386a0 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:36.151+0000 7fbe60980640 1 -- 172.21.15.38:0/3183184018 <== mgr.14118 v2:172.21.15.38:6800/818807657 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fbe5c101ef0 con 0x7fbe480386a0 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:36.153+0000 7fbe61982640 1 -- 172.21.15.38:0/3183184018 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fbe480386a0 msgr2=0x7fbe4803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:36.153+0000 7fbe61982640 1 --2- 172.21.15.38:0/3183184018 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fbe480386a0 0x7fbe4803ab60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbe440098c0 tx=0x7fbe44006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:36.153+0000 7fbe61982640 1 -- 172.21.15.38:0/3183184018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 msgr2=0x7fbe5c199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:36.683 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:36.153+0000 7fbe61982640 1 --2- 172.21.15.38:0/3183184018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 0x7fbe5c199190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c030380 tx=0x7fbe4c032670 comp rx=0 tx=0).stop 2024-09-13T18:21:36.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:36.153+0000 7fbe61982640 1 -- 172.21.15.38:0/3183184018 shutdown_connections 2024-09-13T18:21:36.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:36.153+0000 7fbe61982640 1 --2- 172.21.15.38:0/3183184018 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7fbe480386a0 0x7fbe4803ab60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:36.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:36.153+0000 7fbe61982640 1 --2- 172.21.15.38:0/3183184018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe5c1054c0 0x7fbe5c199190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:36.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:36.153+0000 7fbe61982640 1 -- 172.21.15.38:0/3183184018 >> 172.21.15.38:0/3183184018 conn(0x7fbe5c100c70 msgr2=0x7fbe5c1017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:36.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:36.153+0000 7fbe61982640 1 -- 172.21.15.38:0/3183184018 shutdown_connections 2024-09-13T18:21:36.684 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:36.153+0000 7fbe61982640 1 -- 172.21.15.38:0/3183184018 wait complete. 2024-09-13T18:21:37.257 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:37 smithi038 ceph-mon[27689]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:37.257 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:37 smithi038 ceph-mon[27689]: Saving service alertmanager spec with placement count:1 2024-09-13T18:21:37.257 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:37 smithi038 ceph-mon[27689]: from='mgr.14118 172.21.15.38:0/4116252377' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:37.882 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.075+0000 7ffb8a474640 1 Processor -- start 2024-09-13T18:21:37.882 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.075+0000 7ffb8a474640 1 -- start start 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.075+0000 7ffb8a474640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 0x7ffb841058c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.075+0000 7ffb8a474640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84105e90 con 0x7ffb841054c0 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.075+0000 7ffb83fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 0x7ffb841058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.075+0000 7ffb83fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 0x7ffb841058c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36318/0 (socket says 172.21.15.38:36318) 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.075+0000 7ffb83fff640 1 -- 172.21.15.38:0/2722099309 learned_addr learned my addr 172.21.15.38:0/2722099309 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.075+0000 7ffb83fff640 1 -- 172.21.15.38:0/2722099309 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb84106620 con 0x7ffb841054c0 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.076+0000 7ffb83fff640 1 --2- 172.21.15.38:0/2722099309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 0x7ffb841058c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009820 tx=0x7ffb7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac5761b88b8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.076+0000 7ffb82ffd640 1 -- 172.21.15.38:0/2722099309 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb7402ad40 con 0x7ffb841054c0 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.076+0000 7ffb82ffd640 1 -- 172.21.15.38:0/2722099309 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb740328e0 con 0x7ffb841054c0 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.076+0000 7ffb82ffd640 1 -- 172.21.15.38:0/2722099309 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb740307d0 con 0x7ffb841054c0 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.077+0000 7ffb8a474640 1 -- 172.21.15.38:0/2722099309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 msgr2=0x7ffb841058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.077+0000 7ffb8a474640 1 --2- 172.21.15.38:0/2722099309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 0x7ffb841058c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009820 tx=0x7ffb7402a270 comp rx=0 tx=0).stop 2024-09-13T18:21:37.883 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.077+0000 7ffb8a474640 1 -- 172.21.15.38:0/2722099309 shutdown_connections 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.077+0000 7ffb8a474640 1 --2- 172.21.15.38:0/2722099309 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 0x7ffb841058c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.077+0000 7ffb8a474640 1 -- 172.21.15.38:0/2722099309 >> 172.21.15.38:0/2722099309 conn(0x7ffb84100c70 msgr2=0x7ffb84103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.077+0000 7ffb8a474640 1 -- 172.21.15.38:0/2722099309 shutdown_connections 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.077+0000 7ffb8a474640 1 -- 172.21.15.38:0/2722099309 wait complete. 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.077+0000 7ffb8a474640 1 Processor -- start 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.077+0000 7ffb8a474640 1 -- start start 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.078+0000 7ffb8a474640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 0x7ffb8407baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.078+0000 7ffb8a474640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8407c030 con 0x7ffb841054c0 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.078+0000 7ffb83fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 0x7ffb8407baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.078+0000 7ffb83fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 0x7ffb8407baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36324/0 (socket says 172.21.15.38:36324) 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.078+0000 7ffb83fff640 1 -- 172.21.15.38:0/4059152933 learned_addr learned my addr 172.21.15.38:0/4059152933 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.078+0000 7ffb83fff640 1 -- 172.21.15.38:0/4059152933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb740094d0 con 0x7ffb841054c0 2024-09-13T18:21:37.884 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.078+0000 7ffb83fff640 1 --2- 172.21.15.38:0/4059152933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 0x7ffb8407baf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb74030380 tx=0x7ffb74032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.078+0000 7ffb817fa640 1 -- 172.21.15.38:0/4059152933 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb74030df0 con 0x7ffb841054c0 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.078+0000 7ffb8a474640 1 -- 172.21.15.38:0/4059152933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8407a220 con 0x7ffb841054c0 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.078+0000 7ffb817fa640 1 -- 172.21.15.38:0/4059152933 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb7403b8c0 con 0x7ffb841054c0 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.079+0000 7ffb817fa640 1 -- 172.21.15.38:0/4059152933 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb7403a6f0 con 0x7ffb841054c0 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.079+0000 7ffb8a474640 1 -- 172.21.15.38:0/4059152933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8407a640 con 0x7ffb841054c0 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.079+0000 7ffb817fa640 1 -- 172.21.15.38:0/4059152933 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7ffb74039070 con 0x7ffb841054c0 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.080+0000 7ffb8a474640 1 -- 172.21.15.38:0/4059152933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb841058c0 con 0x7ffb841054c0 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.080+0000 7ffb817fa640 1 --2- 172.21.15.38:0/4059152933 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7ffb6c038650 0x7ffb6c03ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.080+0000 7ffb817fa640 1 -- 172.21.15.38:0/4059152933 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ffb7406ba70 con 0x7ffb841054c0 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.080+0000 7ffb837fe640 1 --2- 172.21.15.38:0/4059152933 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7ffb6c038650 0x7ffb6c03ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.080+0000 7ffb837fe640 1 --2- 172.21.15.38:0/4059152933 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7ffb6c038650 0x7ffb6c03ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffb780098c0 tx=0x7ffb78006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.084+0000 7ffb817fa640 1 -- 172.21.15.38:0/4059152933 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffb74031b90 con 0x7ffb841054c0 2024-09-13T18:21:37.885 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.254+0000 7ffb8a474640 1 -- 172.21.15.38:0/4059152933 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7ffb8407a970 con 0x7ffb841054c0 2024-09-13T18:21:37.886 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.259+0000 7ffb817fa640 1 -- 172.21.15.38:0/4059152933 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7ffb7403f020 con 0x7ffb841054c0 2024-09-13T18:21:37.886 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.261+0000 7ffb8a474640 1 -- 172.21.15.38:0/4059152933 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7ffb6c038650 msgr2=0x7ffb6c03ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:37.886 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.261+0000 7ffb8a474640 1 --2- 172.21.15.38:0/4059152933 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7ffb6c038650 0x7ffb6c03ab10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffb780098c0 tx=0x7ffb78006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:37.886 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.261+0000 7ffb8a474640 1 -- 172.21.15.38:0/4059152933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 msgr2=0x7ffb8407baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:37.886 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.261+0000 7ffb8a474640 1 --2- 172.21.15.38:0/4059152933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 0x7ffb8407baf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb74030380 tx=0x7ffb74032670 comp rx=0 tx=0).stop 2024-09-13T18:21:37.886 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.262+0000 7ffb8a474640 1 -- 172.21.15.38:0/4059152933 shutdown_connections 2024-09-13T18:21:37.886 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.262+0000 7ffb8a474640 1 --2- 172.21.15.38:0/4059152933 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7ffb6c038650 0x7ffb6c03ab10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:37.886 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.262+0000 7ffb8a474640 1 --2- 172.21.15.38:0/4059152933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb841054c0 0x7ffb8407baf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:37.886 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.262+0000 7ffb8a474640 1 -- 172.21.15.38:0/4059152933 >> 172.21.15.38:0/4059152933 conn(0x7ffb84100c70 msgr2=0x7ffb841017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:37.886 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.262+0000 7ffb8a474640 1 -- 172.21.15.38:0/4059152933 shutdown_connections 2024-09-13T18:21:37.886 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:37.262+0000 7ffb8a474640 1 -- 172.21.15.38:0/4059152933 wait complete. 2024-09-13T18:21:38.402 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:38 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/4059152933' entity='client.admin' 2024-09-13T18:21:38.403 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:38 smithi038 ceph-mon[27689]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:21:39.058 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.297+0000 7ff9be9d7640 1 Processor -- start 2024-09-13T18:21:39.059 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.297+0000 7ff9be9d7640 1 -- start start 2024-09-13T18:21:39.059 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.297+0000 7ff9be9d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 0x7ff9b8108360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:39.059 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.297+0000 7ff9be9d7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b8073a70 con 0x7ff9b8105f70 2024-09-13T18:21:39.059 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.297+0000 7ff9b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 0x7ff9b8108360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:39.059 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.297+0000 7ff9b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 0x7ff9b8108360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36326/0 (socket says 172.21.15.38:36326) 2024-09-13T18:21:39.059 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.297+0000 7ff9b7fff640 1 -- 172.21.15.38:0/4018018319 learned_addr learned my addr 172.21.15.38:0/4018018319 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:39.059 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.297+0000 7ff9b7fff640 1 -- 172.21.15.38:0/4018018319 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8073bb0 con 0x7ff9b8105f70 2024-09-13T18:21:39.059 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.298+0000 7ff9b7fff640 1 --2- 172.21.15.38:0/4018018319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 0x7ff9b8108360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009820 tx=0x7ff9a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c10528e96f77930 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:39.059 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.298+0000 7ff9b6ffd640 1 -- 172.21.15.38:0/4018018319 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9a802ad40 con 0x7ff9b8105f70 2024-09-13T18:21:39.059 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.298+0000 7ff9b6ffd640 1 -- 172.21.15.38:0/4018018319 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff9a80328e0 con 0x7ff9b8105f70 2024-09-13T18:21:39.059 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.298+0000 7ff9b6ffd640 1 -- 172.21.15.38:0/4018018319 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9a80307d0 con 0x7ff9b8105f70 2024-09-13T18:21:39.059 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.299+0000 7ff9be9d7640 1 -- 172.21.15.38:0/4018018319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 msgr2=0x7ff9b8108360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.299+0000 7ff9be9d7640 1 --2- 172.21.15.38:0/4018018319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 0x7ff9b8108360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009820 tx=0x7ff9a802a270 comp rx=0 tx=0).stop 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.299+0000 7ff9be9d7640 1 -- 172.21.15.38:0/4018018319 shutdown_connections 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.299+0000 7ff9be9d7640 1 --2- 172.21.15.38:0/4018018319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 0x7ff9b8108360 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.299+0000 7ff9be9d7640 1 -- 172.21.15.38:0/4018018319 >> 172.21.15.38:0/4018018319 conn(0x7ff9b80ffb50 msgr2=0x7ff9b8101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.299+0000 7ff9be9d7640 1 -- 172.21.15.38:0/4018018319 shutdown_connections 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.299+0000 7ff9be9d7640 1 -- 172.21.15.38:0/4018018319 wait complete. 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.300+0000 7ff9be9d7640 1 Processor -- start 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.300+0000 7ff9be9d7640 1 -- start start 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.300+0000 7ff9be9d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 0x7ff9b81990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.300+0000 7ff9be9d7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b8199610 con 0x7ff9b8105f70 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.300+0000 7ff9b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 0x7ff9b81990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.300+0000 7ff9b7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 0x7ff9b81990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36338/0 (socket says 172.21.15.38:36338) 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.300+0000 7ff9b7fff640 1 -- 172.21.15.38:0/2532873149 learned_addr learned my addr 172.21.15.38:0/2532873149 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:39.060 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.301+0000 7ff9b7fff640 1 -- 172.21.15.38:0/2532873149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80094d0 con 0x7ff9b8105f70 2024-09-13T18:21:39.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.301+0000 7ff9b7fff640 1 --2- 172.21.15.38:0/2532873149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 0x7ff9b81990d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8032670 tx=0x7ff9a80326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:39.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.301+0000 7ff9b57fa640 1 -- 172.21.15.38:0/2532873149 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9a8030e40 con 0x7ff9b8105f70 2024-09-13T18:21:39.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.301+0000 7ff9be9d7640 1 -- 172.21.15.38:0/2532873149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b8199810 con 0x7ff9b8105f70 2024-09-13T18:21:39.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.301+0000 7ff9b57fa640 1 -- 172.21.15.38:0/2532873149 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff9a803b8b0 con 0x7ff9b8105f70 2024-09-13T18:21:39.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.301+0000 7ff9b57fa640 1 -- 172.21.15.38:0/2532873149 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9a803a650 con 0x7ff9b8105f70 2024-09-13T18:21:39.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.301+0000 7ff9be9d7640 1 -- 172.21.15.38:0/2532873149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b8199c30 con 0x7ff9b8105f70 2024-09-13T18:21:39.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.302+0000 7ff9be9d7640 1 -- 172.21.15.38:0/2532873149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b8109580 con 0x7ff9b8105f70 2024-09-13T18:21:39.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.302+0000 7ff9b57fa640 1 -- 172.21.15.38:0/2532873149 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7ff9a8039040 con 0x7ff9b8105f70 2024-09-13T18:21:39.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.302+0000 7ff9b57fa640 1 --2- 172.21.15.38:0/2532873149 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7ff9a0038650 0x7ff9a003ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:39.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.302+0000 7ff9b57fa640 1 -- 172.21.15.38:0/2532873149 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff9a806b990 con 0x7ff9b8105f70 2024-09-13T18:21:39.061 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.303+0000 7ff9b77fe640 1 --2- 172.21.15.38:0/2532873149 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7ff9a0038650 0x7ff9a003ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:39.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.303+0000 7ff9b77fe640 1 --2- 172.21.15.38:0/2532873149 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7ff9a0038650 0x7ff9a003ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0098c0 tx=0x7ff9ac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:39.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.308+0000 7ff9b57fa640 1 -- 172.21.15.38:0/2532873149 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff9a804b710 con 0x7ff9b8105f70 2024-09-13T18:21:39.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.481+0000 7ff9be9d7640 1 -- 172.21.15.38:0/2532873149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7ff9b819c590 con 0x7ff9b8105f70 2024-09-13T18:21:39.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.485+0000 7ff9b57fa640 1 -- 172.21.15.38:0/2532873149 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7ff9a80433b0 con 0x7ff9b8105f70 2024-09-13T18:21:39.062 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.487+0000 7ff9be9d7640 1 -- 172.21.15.38:0/2532873149 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7ff9a0038650 msgr2=0x7ff9a003ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:39.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.487+0000 7ff9be9d7640 1 --2- 172.21.15.38:0/2532873149 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7ff9a0038650 0x7ff9a003ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0098c0 tx=0x7ff9ac006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:39.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.487+0000 7ff9be9d7640 1 -- 172.21.15.38:0/2532873149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 msgr2=0x7ff9b81990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:39.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.487+0000 7ff9be9d7640 1 --2- 172.21.15.38:0/2532873149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 0x7ff9b81990d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8032670 tx=0x7ff9a80326a0 comp rx=0 tx=0).stop 2024-09-13T18:21:39.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.487+0000 7ff9be9d7640 1 -- 172.21.15.38:0/2532873149 shutdown_connections 2024-09-13T18:21:39.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.487+0000 7ff9be9d7640 1 --2- 172.21.15.38:0/2532873149 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7ff9a0038650 0x7ff9a003ab10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:39.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.487+0000 7ff9be9d7640 1 --2- 172.21.15.38:0/2532873149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9b8105f70 0x7ff9b81990d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:39.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.487+0000 7ff9be9d7640 1 -- 172.21.15.38:0/2532873149 >> 172.21.15.38:0/2532873149 conn(0x7ff9b80ffb50 msgr2=0x7ff9b8100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:39.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.487+0000 7ff9be9d7640 1 -- 172.21.15.38:0/2532873149 shutdown_connections 2024-09-13T18:21:39.063 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:38.488+0000 7ff9be9d7640 1 -- 172.21.15.38:0/2532873149 wait complete. 2024-09-13T18:21:39.063 INFO:teuthology.orchestra.run.smithi038.stdout:Enabling the dashboard module... 2024-09-13T18:21:39.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:39 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2532873149' entity='client.admin' 2024-09-13T18:21:40.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:40 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/205138987' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T18:21:40.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:40 smithi038 ceph-mon[27689]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:21:41.144 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.466+0000 7f54416c3640 1 Processor -- start 2024-09-13T18:21:41.145 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.466+0000 7f54416c3640 1 -- start start 2024-09-13T18:21:41.145 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.466+0000 7f54416c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 0x7f543c108340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:41.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.466+0000 7f54416c3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c073a90 con 0x7f543c105f50 2024-09-13T18:21:41.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.467+0000 7f543affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 0x7f543c108340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:41.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.467+0000 7f543affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 0x7f543c108340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36342/0 (socket says 172.21.15.38:36342) 2024-09-13T18:21:41.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.467+0000 7f543affd640 1 -- 172.21.15.38:0/1882603978 learned_addr learned my addr 172.21.15.38:0/1882603978 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:41.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.467+0000 7f543affd640 1 -- 172.21.15.38:0/1882603978 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c073bd0 con 0x7f543c105f50 2024-09-13T18:21:41.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.468+0000 7f543affd640 1 --2- 172.21.15.38:0/1882603978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 0x7f543c108340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5434009820 tx=0x7f543402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84003ee74844b6b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:41.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.468+0000 7f5439ffb640 1 -- 172.21.15.38:0/1882603978 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f543402ad40 con 0x7f543c105f50 2024-09-13T18:21:41.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.468+0000 7f5439ffb640 1 -- 172.21.15.38:0/1882603978 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54340328e0 con 0x7f543c105f50 2024-09-13T18:21:41.146 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.468+0000 7f5439ffb640 1 -- 172.21.15.38:0/1882603978 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54340307d0 con 0x7f543c105f50 2024-09-13T18:21:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.468+0000 7f54416c3640 1 -- 172.21.15.38:0/1882603978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 msgr2=0x7f543c108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.468+0000 7f54416c3640 1 --2- 172.21.15.38:0/1882603978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 0x7f543c108340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5434009820 tx=0x7f543402a270 comp rx=0 tx=0).stop 2024-09-13T18:21:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.469+0000 7f54416c3640 1 -- 172.21.15.38:0/1882603978 shutdown_connections 2024-09-13T18:21:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.469+0000 7f54416c3640 1 --2- 172.21.15.38:0/1882603978 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 0x7f543c108340 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.469+0000 7f54416c3640 1 -- 172.21.15.38:0/1882603978 >> 172.21.15.38:0/1882603978 conn(0x7f543c0ffb50 msgr2=0x7f543c101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.469+0000 7f54416c3640 1 -- 172.21.15.38:0/1882603978 shutdown_connections 2024-09-13T18:21:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.469+0000 7f54416c3640 1 -- 172.21.15.38:0/1882603978 wait complete. 2024-09-13T18:21:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.469+0000 7f54416c3640 1 Processor -- start 2024-09-13T18:21:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.469+0000 7f54416c3640 1 -- start start 2024-09-13T18:21:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.470+0000 7f54416c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 0x7f543c1990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.470+0000 7f54416c3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c199610 con 0x7f543c105f50 2024-09-13T18:21:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.470+0000 7f543affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 0x7f543c1990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.470+0000 7f543affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 0x7f543c1990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36344/0 (socket says 172.21.15.38:36344) 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.470+0000 7f543affd640 1 -- 172.21.15.38:0/205138987 learned_addr learned my addr 172.21.15.38:0/205138987 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.470+0000 7f543affd640 1 -- 172.21.15.38:0/205138987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54340094d0 con 0x7f543c105f50 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.470+0000 7f543affd640 1 --2- 172.21.15.38:0/205138987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 0x7f543c1990d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5434032670 tx=0x7f54340326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.470+0000 7f5423fff640 1 -- 172.21.15.38:0/205138987 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5434030e40 con 0x7f543c105f50 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.470+0000 7f5423fff640 1 -- 172.21.15.38:0/205138987 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f543403b8b0 con 0x7f543c105f50 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.470+0000 7f54416c3640 1 -- 172.21.15.38:0/205138987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c199810 con 0x7f543c105f50 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.470+0000 7f5423fff640 1 -- 172.21.15.38:0/205138987 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f543403a650 con 0x7f543c105f50 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.470+0000 7f54416c3640 1 -- 172.21.15.38:0/205138987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c199c30 con 0x7f543c105f50 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.471+0000 7f5423fff640 1 -- 172.21.15.38:0/205138987 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f5434039040 con 0x7f543c105f50 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.471+0000 7f54416c3640 1 -- 172.21.15.38:0/205138987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c109560 con 0x7f543c105f50 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.471+0000 7f5423fff640 1 --2- 172.21.15.38:0/205138987 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f54240386a0 0x7f542403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:41.148 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.471+0000 7f5423fff640 1 -- 172.21.15.38:0/205138987 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f543406b6d0 con 0x7f543c105f50 2024-09-13T18:21:41.149 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.472+0000 7f543a7fc640 1 --2- 172.21.15.38:0/205138987 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f54240386a0 0x7f542403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:41.149 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.472+0000 7f543a7fc640 1 --2- 172.21.15.38:0/205138987 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f54240386a0 0x7f542403ab60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f54300098c0 tx=0x7f5430006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:41.149 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.476+0000 7f5423fff640 1 -- 172.21.15.38:0/205138987 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f543404b710 con 0x7f543c105f50 2024-09-13T18:21:41.149 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:39.699+0000 7f54416c3640 1 -- 172.21.15.38:0/205138987 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f543c19c590 con 0x7f543c105f50 2024-09-13T18:21:41.149 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:40.496+0000 7f5423fff640 1 -- 172.21.15.38:0/205138987 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f543403a7f0 con 0x7f543c105f50 2024-09-13T18:21:41.149 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:40.498+0000 7f5423fff640 1 -- 172.21.15.38:0/205138987 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f543403ad80 con 0x7f543c105f50 2024-09-13T18:21:41.149 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:40.500+0000 7f54416c3640 1 -- 172.21.15.38:0/205138987 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f54240386a0 msgr2=0x7f542403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:41.149 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:40.501+0000 7f54416c3640 1 --2- 172.21.15.38:0/205138987 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f54240386a0 0x7f542403ab60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f54300098c0 tx=0x7f5430006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:41.149 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:40.501+0000 7f54416c3640 1 -- 172.21.15.38:0/205138987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 msgr2=0x7f543c1990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:41.149 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:40.501+0000 7f54416c3640 1 --2- 172.21.15.38:0/205138987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 0x7f543c1990d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5434032670 tx=0x7f54340326a0 comp rx=0 tx=0).stop 2024-09-13T18:21:41.149 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:40.501+0000 7f54416c3640 1 -- 172.21.15.38:0/205138987 shutdown_connections 2024-09-13T18:21:41.149 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:40.501+0000 7f54416c3640 1 --2- 172.21.15.38:0/205138987 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f54240386a0 0x7f542403ab60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:41.150 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:40.501+0000 7f54416c3640 1 --2- 172.21.15.38:0/205138987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f543c105f50 0x7f543c1990d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:41.150 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:40.501+0000 7f54416c3640 1 -- 172.21.15.38:0/205138987 >> 172.21.15.38:0/205138987 conn(0x7f543c0ffb50 msgr2=0x7f543c1006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:41.150 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:40.501+0000 7f54416c3640 1 -- 172.21.15.38:0/205138987 shutdown_connections 2024-09-13T18:21:41.150 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:40.501+0000 7f54416c3640 1 -- 172.21.15.38:0/205138987 wait complete. 2024-09-13T18:21:41.647 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:41 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/205138987' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T18:21:41.647 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:41 smithi038 ceph-mon[27689]: mgrmap e9: smithi038.jeygoq(active, since 32s) 2024-09-13T18:21:42.375 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:21:42.376 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T18:21:42.376 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T18:21:42.376 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "active_name": "smithi038.jeygoq", 2024-09-13T18:21:42.376 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T18:21:42.376 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:21:42.376 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.557+0000 7f63cd439640 1 Processor -- start 2024-09-13T18:21:42.376 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.557+0000 7f63cd439640 1 -- start start 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.557+0000 7f63cd439640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 0x7f63c8108290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.557+0000 7f63cd439640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c8079de0 con 0x7f63c8105ea0 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.557+0000 7f63c6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 0x7f63c8108290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.557+0000 7f63c6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 0x7f63c8108290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36360/0 (socket says 172.21.15.38:36360) 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.557+0000 7f63c6ffd640 1 -- 172.21.15.38:0/2175227734 learned_addr learned my addr 172.21.15.38:0/2175227734 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.557+0000 7f63c6ffd640 1 -- 172.21.15.38:0/2175227734 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c81087d0 con 0x7f63c8105ea0 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.558+0000 7f63c6ffd640 1 --2- 172.21.15.38:0/2175227734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 0x7f63c8108290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009820 tx=0x7f63b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e94dd564467f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.558+0000 7f63c67fc640 1 -- 172.21.15.38:0/2175227734 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f63b802ad40 con 0x7f63c8105ea0 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.558+0000 7f63c67fc640 1 -- 172.21.15.38:0/2175227734 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f63b80328e0 con 0x7f63c8105ea0 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.558+0000 7f63c67fc640 1 -- 172.21.15.38:0/2175227734 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f63b80307d0 con 0x7f63c8105ea0 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.559+0000 7f63cd439640 1 -- 172.21.15.38:0/2175227734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 msgr2=0x7f63c8108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.559+0000 7f63cd439640 1 --2- 172.21.15.38:0/2175227734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 0x7f63c8108290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009820 tx=0x7f63b802a270 comp rx=0 tx=0).stop 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.559+0000 7f63cd439640 1 -- 172.21.15.38:0/2175227734 shutdown_connections 2024-09-13T18:21:42.377 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.559+0000 7f63cd439640 1 --2- 172.21.15.38:0/2175227734 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 0x7f63c8108290 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.559+0000 7f63cd439640 1 -- 172.21.15.38:0/2175227734 >> 172.21.15.38:0/2175227734 conn(0x7f63c80ffb20 msgr2=0x7f63c8101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.559+0000 7f63cd439640 1 -- 172.21.15.38:0/2175227734 shutdown_connections 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.560+0000 7f63cd439640 1 -- 172.21.15.38:0/2175227734 wait complete. 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.560+0000 7f63cd439640 1 Processor -- start 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.560+0000 7f63cd439640 1 -- start start 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.560+0000 7f63cd439640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 0x7f63c81990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.560+0000 7f63cd439640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c8199600 con 0x7f63c8105ea0 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.560+0000 7f63c6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 0x7f63c81990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.561+0000 7f63c6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 0x7f63c81990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36362/0 (socket says 172.21.15.38:36362) 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.561+0000 7f63c6ffd640 1 -- 172.21.15.38:0/2615994847 learned_addr learned my addr 172.21.15.38:0/2615994847 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.561+0000 7f63c6ffd640 1 -- 172.21.15.38:0/2615994847 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b80094d0 con 0x7f63c8105ea0 2024-09-13T18:21:42.378 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.561+0000 7f63c6ffd640 1 --2- 172.21.15.38:0/2615994847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 0x7f63c81990c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f63b8032670 tx=0x7f63b80326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:42.379 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.561+0000 7f63c4ff9640 1 -- 172.21.15.38:0/2615994847 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f63b8030e40 con 0x7f63c8105ea0 2024-09-13T18:21:42.379 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.561+0000 7f63cd439640 1 -- 172.21.15.38:0/2615994847 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c8199800 con 0x7f63c8105ea0 2024-09-13T18:21:42.379 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.561+0000 7f63c4ff9640 1 -- 172.21.15.38:0/2615994847 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f63b803b8b0 con 0x7f63c8105ea0 2024-09-13T18:21:42.379 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.561+0000 7f63c4ff9640 1 -- 172.21.15.38:0/2615994847 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f63b803a650 con 0x7f63c8105ea0 2024-09-13T18:21:42.379 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.561+0000 7f63cd439640 1 -- 172.21.15.38:0/2615994847 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c8199c20 con 0x7f63c8105ea0 2024-09-13T18:21:42.379 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.562+0000 7f63cd439640 1 -- 172.21.15.38:0/2615994847 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c8109520 con 0x7f63c8105ea0 2024-09-13T18:21:42.379 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.562+0000 7f63c4ff9640 1 -- 172.21.15.38:0/2615994847 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f63b8039040 con 0x7f63c8105ea0 2024-09-13T18:21:42.379 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.563+0000 7f63c4ff9640 1 --2- 172.21.15.38:0/2615994847 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f63b40386a0 0x7f63b403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:42.379 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.563+0000 7f63c4ff9640 1 -- 172.21.15.38:0/2615994847 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f63b806b7a0 con 0x7f63c8105ea0 2024-09-13T18:21:42.379 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.563+0000 7f63bffff640 1 -- 172.21.15.38:0/2615994847 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f63b40386a0 msgr2=0x7f63b403ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/818807657 2024-09-13T18:21:42.379 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.563+0000 7f63bffff640 1 --2- 172.21.15.38:0/2615994847 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f63b40386a0 0x7f63b403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.571+0000 7f63c4ff9640 1 -- 172.21.15.38:0/2615994847 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f63b8031580 con 0x7f63c8105ea0 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.764+0000 7f63bffff640 1 -- 172.21.15.38:0/2615994847 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f63b40386a0 msgr2=0x7f63b403ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/818807657 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.764+0000 7f63bffff640 1 --2- 172.21.15.38:0/2615994847 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f63b40386a0 0x7f63b403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.789+0000 7f63cd439640 1 -- 172.21.15.38:0/2615994847 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f63c819c580 con 0x7f63c8105ea0 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.790+0000 7f63c4ff9640 1 -- 172.21.15.38:0/2615994847 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f63b803f070 con 0x7f63c8105ea0 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.793+0000 7f63cd439640 1 -- 172.21.15.38:0/2615994847 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f63b40386a0 msgr2=0x7f63b403ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.793+0000 7f63cd439640 1 --2- 172.21.15.38:0/2615994847 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f63b40386a0 0x7f63b403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.793+0000 7f63cd439640 1 -- 172.21.15.38:0/2615994847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 msgr2=0x7f63c81990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.793+0000 7f63cd439640 1 --2- 172.21.15.38:0/2615994847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 0x7f63c81990c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f63b8032670 tx=0x7f63b80326a0 comp rx=0 tx=0).stop 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.793+0000 7f63cd439640 1 -- 172.21.15.38:0/2615994847 shutdown_connections 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.793+0000 7f63cd439640 1 --2- 172.21.15.38:0/2615994847 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f63b40386a0 0x7f63b403ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.793+0000 7f63cd439640 1 --2- 172.21.15.38:0/2615994847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63c8105ea0 0x7f63c81990c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.793+0000 7f63cd439640 1 -- 172.21.15.38:0/2615994847 >> 172.21.15.38:0/2615994847 conn(0x7f63c80ffb20 msgr2=0x7f63c81006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:42.380 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.793+0000 7f63cd439640 1 -- 172.21.15.38:0/2615994847 shutdown_connections 2024-09-13T18:21:42.381 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:41.793+0000 7f63cd439640 1 -- 172.21.15.38:0/2615994847 wait complete. 2024-09-13T18:21:42.381 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for the mgr to restart... 2024-09-13T18:21:42.381 INFO:teuthology.orchestra.run.smithi038.stdout:Waiting for mgr epoch 9... 2024-09-13T18:21:42.702 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:42 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2615994847' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T18:21:45.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: Active manager daemon smithi038.jeygoq restarted 2024-09-13T18:21:45.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: Activating manager daemon smithi038.jeygoq 2024-09-13T18:21:45.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T18:21:45.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: mgrmap e10: smithi038.jeygoq(active, starting, since 0.00347618s) 2024-09-13T18:21:45.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:21:45.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr metadata", "who": "smithi038.jeygoq", "id": "smithi038.jeygoq"}]: dispatch 2024-09-13T18:21:45.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T18:21:45.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T18:21:45.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T18:21:45.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: Manager daemon smithi038.jeygoq is now available 2024-09-13T18:21:45.789 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:21:45.789 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:21:45.789 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:45 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/trash_purge_schedule"}]: dispatch 2024-09-13T18:21:47.277 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout { 2024-09-13T18:21:47.278 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T18:21:47.278 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T18:21:47.278 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout } 2024-09-13T18:21:47.278 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.780+0000 7f859c217640 1 Processor -- start 2024-09-13T18:21:47.278 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.780+0000 7f859c217640 1 -- start start 2024-09-13T18:21:47.278 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.781+0000 7f859c217640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 0x7f8594104740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:47.278 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.781+0000 7f859c217640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8594104d10 con 0x7f8594104340 2024-09-13T18:21:47.278 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.781+0000 7f8599fb3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 0x7f8594104740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:47.278 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.781+0000 7f8599fb3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 0x7f8594104740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40874/0 (socket says 172.21.15.38:40874) 2024-09-13T18:21:47.278 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.781+0000 7f8599fb3640 1 -- 172.21.15.38:0/4109414397 learned_addr learned my addr 172.21.15.38:0/4109414397 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.781+0000 7f8599fb3640 1 -- 172.21.15.38:0/4109414397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8594105540 con 0x7f8594104340 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.782+0000 7f8599fb3640 1 --2- 172.21.15.38:0/4109414397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 0x7f8594104740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8590009820 tx=0x7f859002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39517f6b45f17cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.782+0000 7f8598fb1640 1 -- 172.21.15.38:0/4109414397 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f859002ad40 con 0x7f8594104340 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.782+0000 7f8598fb1640 1 -- 172.21.15.38:0/4109414397 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85900328e0 con 0x7f8594104340 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.782+0000 7f8598fb1640 1 -- 172.21.15.38:0/4109414397 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f85900307d0 con 0x7f8594104340 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.783+0000 7f859c217640 1 -- 172.21.15.38:0/4109414397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 msgr2=0x7f8594104740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.783+0000 7f859c217640 1 --2- 172.21.15.38:0/4109414397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 0x7f8594104740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8590009820 tx=0x7f859002a270 comp rx=0 tx=0).stop 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.783+0000 7f859c217640 1 -- 172.21.15.38:0/4109414397 shutdown_connections 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.783+0000 7f859c217640 1 --2- 172.21.15.38:0/4109414397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 0x7f8594104740 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.783+0000 7f859c217640 1 -- 172.21.15.38:0/4109414397 >> 172.21.15.38:0/4109414397 conn(0x7f85940ffb50 msgr2=0x7f8594101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.783+0000 7f859c217640 1 -- 172.21.15.38:0/4109414397 shutdown_connections 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.783+0000 7f859c217640 1 -- 172.21.15.38:0/4109414397 wait complete. 2024-09-13T18:21:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.783+0000 7f859c217640 1 Processor -- start 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.783+0000 7f859c217640 1 -- start start 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.784+0000 7f859c217640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 0x7f859418f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.784+0000 7f859c217640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859418f9e0 con 0x7f8594104340 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.784+0000 7f8599fb3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 0x7f859418f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.784+0000 7f8599fb3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 0x7f859418f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40886/0 (socket says 172.21.15.38:40886) 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.784+0000 7f8599fb3640 1 -- 172.21.15.38:0/2601198032 learned_addr learned my addr 172.21.15.38:0/2601198032 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.784+0000 7f8599fb3640 1 -- 172.21.15.38:0/2601198032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85900094d0 con 0x7f8594104340 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.784+0000 7f8599fb3640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 0x7f859418f4a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8590030380 tx=0x7f8590032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.784+0000 7f8586ffd640 1 -- 172.21.15.38:0/2601198032 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8590030df0 con 0x7f8594104340 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.784+0000 7f8586ffd640 1 -- 172.21.15.38:0/2601198032 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f859003b8c0 con 0x7f8594104340 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.784+0000 7f8586ffd640 1 -- 172.21.15.38:0/2601198032 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f859003a6f0 con 0x7f8594104340 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.784+0000 7f859c217640 1 -- 172.21.15.38:0/2601198032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859418dc20 con 0x7f8594104340 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.784+0000 7f859c217640 1 -- 172.21.15.38:0/2601198032 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859418e040 con 0x7f8594104340 2024-09-13T18:21:47.280 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.785+0000 7f8586ffd640 1 -- 172.21.15.38:0/2601198032 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f8590039070 con 0x7f8594104340 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.785+0000 7f8586ffd640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f85800386a0 0x7f858003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.785+0000 7f8586ffd640 1 -- 172.21.15.38:0/2601198032 --> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f858003b270 con 0x7f85800386a0 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.786+0000 7f8586ffd640 1 -- 172.21.15.38:0/2601198032 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f859006ba10 con 0x7f8594104340 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.786+0000 7f85997b2640 1 -- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f85800386a0 msgr2=0x7f858003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/818807657 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.786+0000 7f85997b2640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f85800386a0 0x7f858003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.987+0000 7f85997b2640 1 -- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f85800386a0 msgr2=0x7f858003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/818807657 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:42.987+0000 7f85997b2640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f85800386a0 0x7f858003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:43.388+0000 7f85997b2640 1 -- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f85800386a0 msgr2=0x7f858003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/818807657 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:43.388+0000 7f85997b2640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f85800386a0 0x7f858003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:44.189+0000 7f85997b2640 1 -- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f85800386a0 msgr2=0x7f858003ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/818807657 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:44.189+0000 7f85997b2640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f85800386a0 0x7f858003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:45.528+0000 7f8586ffd640 1 -- 172.21.15.38:0/2601198032 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mgrmap(e 10) v1 ==== 45336+0+0 (secure 0 0 0) 0x7f859006a840 con 0x7f8594104340 2024-09-13T18:21:47.281 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:45.528+0000 7f8586ffd640 1 -- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f85800386a0 msgr2=0x7f858003ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:45.528+0000 7f8586ffd640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f85800386a0 0x7f858003ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.531+0000 7f8586ffd640 1 -- 172.21.15.38:0/2601198032 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7f8590039320 con 0x7f8594104340 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.532+0000 7f8586ffd640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f858003bfe0 0x7f858003e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.532+0000 7f8586ffd640 1 -- 172.21.15.38:0/2601198032 --> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f858003b270 con 0x7f858003bfe0 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.532+0000 7f85997b2640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f858003bfe0 0x7f858003e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.533+0000 7f85997b2640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f858003bfe0 0x7f858003e3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8588003980 tx=0x7f8588006e10 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.534+0000 7f8586ffd640 1 -- 172.21.15.38:0/2601198032 <== mgr.14162 v2:172.21.15.38:6800/1869434741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f858003b270 con 0x7f858003bfe0 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.539+0000 7f859c217640 1 -- 172.21.15.38:0/2601198032 --> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f85941063b0 con 0x7f858003bfe0 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.539+0000 7f8586ffd640 1 -- 172.21.15.38:0/2601198032 <== mgr.14162 v2:172.21.15.38:6800/1869434741 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f858800a040 con 0x7f858003bfe0 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.540+0000 7f859c217640 1 -- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f858003bfe0 msgr2=0x7f858003e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.540+0000 7f859c217640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f858003bfe0 0x7f858003e3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8588003980 tx=0x7f8588006e10 comp rx=0 tx=0).stop 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.540+0000 7f859c217640 1 -- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 msgr2=0x7f859418f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:47.282 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.540+0000 7f859c217640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 0x7f859418f4a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8590030380 tx=0x7f8590032670 comp rx=0 tx=0).stop 2024-09-13T18:21:47.283 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.540+0000 7f859c217640 1 -- 172.21.15.38:0/2601198032 shutdown_connections 2024-09-13T18:21:47.283 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.540+0000 7f859c217640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f858003bfe0 0x7f858003e3d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:47.283 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.540+0000 7f859c217640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:6800/818807657,v1:172.21.15.38:6801/818807657] conn(0x7f85800386a0 0x7f858003ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:47.283 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.540+0000 7f859c217640 1 --2- 172.21.15.38:0/2601198032 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8594104340 0x7f859418f4a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:47.283 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.540+0000 7f859c217640 1 -- 172.21.15.38:0/2601198032 >> 172.21.15.38:0/2601198032 conn(0x7f85940ffb50 msgr2=0x7f8594100a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:47.283 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.540+0000 7f859c217640 1 -- 172.21.15.38:0/2601198032 shutdown_connections 2024-09-13T18:21:47.283 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:46.540+0000 7f859c217640 1 -- 172.21.15.38:0/2601198032 wait complete. 2024-09-13T18:21:47.283 INFO:teuthology.orchestra.run.smithi038.stdout:mgr epoch 9 is available 2024-09-13T18:21:47.283 INFO:teuthology.orchestra.run.smithi038.stdout:Generating a dashboard self-signed certificate... 2024-09-13T18:21:47.679 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:47 smithi038 ceph-mon[27689]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T18:21:47.679 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:47 smithi038 ceph-mon[27689]: mgrmap e11: smithi038.jeygoq(active, since 1.008s) 2024-09-13T18:21:47.680 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:47 smithi038 ceph-mon[27689]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T18:21:48.550 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T18:21:48.550 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.681+0000 7fca7d702640 1 Processor -- start 2024-09-13T18:21:48.550 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.681+0000 7fca7d702640 1 -- start start 2024-09-13T18:21:48.550 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.681+0000 7fca7d702640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 0x7fca781058c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:48.550 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.681+0000 7fca7d702640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca78105e90 con 0x7fca781054c0 2024-09-13T18:21:48.550 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.681+0000 7fca76ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 0x7fca781058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:48.551 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.681+0000 7fca76ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 0x7fca781058c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40966/0 (socket says 172.21.15.38:40966) 2024-09-13T18:21:48.551 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.681+0000 7fca76ffd640 1 -- 172.21.15.38:0/2139163979 learned_addr learned my addr 172.21.15.38:0/2139163979 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:48.551 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.682+0000 7fca76ffd640 1 -- 172.21.15.38:0/2139163979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78106620 con 0x7fca781054c0 2024-09-13T18:21:48.551 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.682+0000 7fca76ffd640 1 --2- 172.21.15.38:0/2139163979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 0x7fca781058c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca70009820 tx=0x7fca7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344b184a0b239c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:48.551 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.683+0000 7fca75ffb640 1 -- 172.21.15.38:0/2139163979 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca7002ad40 con 0x7fca781054c0 2024-09-13T18:21:48.551 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.683+0000 7fca75ffb640 1 -- 172.21.15.38:0/2139163979 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca700328e0 con 0x7fca781054c0 2024-09-13T18:21:48.551 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.683+0000 7fca75ffb640 1 -- 172.21.15.38:0/2139163979 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca700307d0 con 0x7fca781054c0 2024-09-13T18:21:48.551 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.683+0000 7fca7d702640 1 -- 172.21.15.38:0/2139163979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 msgr2=0x7fca781058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:48.551 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.683+0000 7fca7d702640 1 --2- 172.21.15.38:0/2139163979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 0x7fca781058c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca70009820 tx=0x7fca7002a270 comp rx=0 tx=0).stop 2024-09-13T18:21:48.551 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.683+0000 7fca7d702640 1 -- 172.21.15.38:0/2139163979 shutdown_connections 2024-09-13T18:21:48.551 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.683+0000 7fca7d702640 1 --2- 172.21.15.38:0/2139163979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 0x7fca781058c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:48.551 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.683+0000 7fca7d702640 1 -- 172.21.15.38:0/2139163979 >> 172.21.15.38:0/2139163979 conn(0x7fca78100c70 msgr2=0x7fca78103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.683+0000 7fca7d702640 1 -- 172.21.15.38:0/2139163979 shutdown_connections 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.683+0000 7fca7d702640 1 -- 172.21.15.38:0/2139163979 wait complete. 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.684+0000 7fca7d702640 1 Processor -- start 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.684+0000 7fca7d702640 1 -- start start 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.684+0000 7fca7d702640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 0x7fca78199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.684+0000 7fca7d702640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca781996d0 con 0x7fca781054c0 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.684+0000 7fca76ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 0x7fca78199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.684+0000 7fca76ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 0x7fca78199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40980/0 (socket says 172.21.15.38:40980) 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.684+0000 7fca76ffd640 1 -- 172.21.15.38:0/2724396005 learned_addr learned my addr 172.21.15.38:0/2724396005 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.684+0000 7fca76ffd640 1 -- 172.21.15.38:0/2724396005 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca700094d0 con 0x7fca781054c0 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.685+0000 7fca76ffd640 1 --2- 172.21.15.38:0/2724396005 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 0x7fca78199190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fca70009940 tx=0x7fca70032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.685+0000 7fca6ffff640 1 -- 172.21.15.38:0/2724396005 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca70030e40 con 0x7fca781054c0 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.685+0000 7fca6ffff640 1 -- 172.21.15.38:0/2724396005 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca7003b8b0 con 0x7fca781054c0 2024-09-13T18:21:48.552 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.685+0000 7fca7d702640 1 -- 172.21.15.38:0/2724396005 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca781998d0 con 0x7fca781054c0 2024-09-13T18:21:48.553 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.685+0000 7fca6ffff640 1 -- 172.21.15.38:0/2724396005 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fca7003a620 con 0x7fca781054c0 2024-09-13T18:21:48.553 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.685+0000 7fca7d702640 1 -- 172.21.15.38:0/2724396005 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca78199cf0 con 0x7fca781054c0 2024-09-13T18:21:48.553 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.686+0000 7fca6ffff640 1 -- 172.21.15.38:0/2724396005 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fca70039040 con 0x7fca781054c0 2024-09-13T18:21:48.553 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.686+0000 7fca7d702640 1 -- 172.21.15.38:0/2724396005 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca78109850 con 0x7fca781054c0 2024-09-13T18:21:48.553 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.686+0000 7fca6ffff640 1 --2- 172.21.15.38:0/2724396005 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fca640386f0 0x7fca6403abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:48.553 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.686+0000 7fca6ffff640 1 -- 172.21.15.38:0/2724396005 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fca7006b7f0 con 0x7fca781054c0 2024-09-13T18:21:48.553 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.686+0000 7fca767fc640 1 --2- 172.21.15.38:0/2724396005 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fca640386f0 0x7fca6403abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:48.553 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.687+0000 7fca767fc640 1 --2- 172.21.15.38:0/2724396005 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fca640386f0 0x7fca6403abb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fca600098c0 tx=0x7fca60006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:48.553 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.691+0000 7fca6ffff640 1 -- 172.21.15.38:0/2724396005 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fca700313a0 con 0x7fca781054c0 2024-09-13T18:21:48.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.868+0000 7fca7d702640 1 -- 172.21.15.38:0/2724396005 --> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fca78101ef0 con 0x7fca640386f0 2024-09-13T18:21:48.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.970+0000 7fca6ffff640 1 -- 172.21.15.38:0/2724396005 <== mgr.14162 v2:172.21.15.38:6800/1869434741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fca78101ef0 con 0x7fca640386f0 2024-09-13T18:21:48.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.973+0000 7fca7d702640 1 -- 172.21.15.38:0/2724396005 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fca640386f0 msgr2=0x7fca6403abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:48.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.973+0000 7fca7d702640 1 --2- 172.21.15.38:0/2724396005 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fca640386f0 0x7fca6403abb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fca600098c0 tx=0x7fca60006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:48.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.973+0000 7fca7d702640 1 -- 172.21.15.38:0/2724396005 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 msgr2=0x7fca78199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:48.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.973+0000 7fca7d702640 1 --2- 172.21.15.38:0/2724396005 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 0x7fca78199190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fca70009940 tx=0x7fca70032670 comp rx=0 tx=0).stop 2024-09-13T18:21:48.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.973+0000 7fca7d702640 1 -- 172.21.15.38:0/2724396005 shutdown_connections 2024-09-13T18:21:48.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.973+0000 7fca7d702640 1 --2- 172.21.15.38:0/2724396005 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fca640386f0 0x7fca6403abb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:48.554 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.973+0000 7fca7d702640 1 --2- 172.21.15.38:0/2724396005 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca781054c0 0x7fca78199190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:48.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.973+0000 7fca7d702640 1 -- 172.21.15.38:0/2724396005 >> 172.21.15.38:0/2724396005 conn(0x7fca78100c70 msgr2=0x7fca781017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:48.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.974+0000 7fca7d702640 1 -- 172.21.15.38:0/2724396005 shutdown_connections 2024-09-13T18:21:48.555 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:47.974+0000 7fca7d702640 1 -- 172.21.15.38:0/2724396005 wait complete. 2024-09-13T18:21:48.555 INFO:teuthology.orchestra.run.smithi038.stdout:Creating initial admin user... 2024-09-13T18:21:48.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:48 smithi038 ceph-mon[27689]: [13/Sep/2024:18:21:47] ENGINE Bus STARTING 2024-09-13T18:21:48.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:48 smithi038 ceph-mon[27689]: [13/Sep/2024:18:21:47] ENGINE Serving on http://172.21.15.38:8765 2024-09-13T18:21:48.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:48 smithi038 ceph-mon[27689]: [13/Sep/2024:18:21:47] ENGINE Serving on https://172.21.15.38:7150 2024-09-13T18:21:48.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:48 smithi038 ceph-mon[27689]: [13/Sep/2024:18:21:47] ENGINE Bus STARTED 2024-09-13T18:21:48.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:48 smithi038 ceph-mon[27689]: [13/Sep/2024:18:21:47] ENGINE Error in HTTPServer.serve 2024-09-13T18:21:48.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Traceback (most recent call last): 2024-09-13T18:21:48.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T18:21:48.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._connections.run(self.expiration_interval) 2024-09-13T18:21:48.651 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._run(expiration_interval) 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: s = self.context.wrap_socket( 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: return self.sslsocket_class._create( 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self.do_handshake() 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T18:21:48.652 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._sslobj.do_handshake() 2024-09-13T18:21:48.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T18:21:48.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:48 smithi038 ceph-mon[27689]: mgrmap e12: smithi038.jeygoq(active, since 2s) 2024-09-13T18:21:48.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:48 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:48.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:48 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:48.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:48 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:49.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:49 smithi038 ceph-mon[27689]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:49.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:49 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:49.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:49 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:50.035 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$jjNo3aLk6T7Ei7Cjrk9Wo.NoZuFnia25uTy8iRSVDbmjEWgJCtw52", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726251709, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T18:21:50.036 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.911+0000 7f4a5e6ee640 1 Processor -- start 2024-09-13T18:21:50.036 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.912+0000 7f4a5e6ee640 1 -- start start 2024-09-13T18:21:50.036 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.912+0000 7f4a5e6ee640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 0x7f4a581082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:50.036 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.912+0000 7f4a5e6ee640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58073b10 con 0x7f4a58105ef0 2024-09-13T18:21:50.036 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.913+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 0x7f4a581082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:50.036 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.913+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 0x7f4a581082e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40994/0 (socket says 172.21.15.38:40994) 2024-09-13T18:21:50.036 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.913+0000 7f4a57fff640 1 -- 172.21.15.38:0/3587725048 learned_addr learned my addr 172.21.15.38:0/3587725048 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:50.036 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.913+0000 7f4a57fff640 1 -- 172.21.15.38:0/3587725048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a58108820 con 0x7f4a58105ef0 2024-09-13T18:21:50.036 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.914+0000 7f4a57fff640 1 --2- 172.21.15.38:0/3587725048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 0x7f4a581082e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009820 tx=0x7f4a4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2a93d32df6c3d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:50.037 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.914+0000 7f4a577fe640 1 -- 172.21.15.38:0/3587725048 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a4802ad40 con 0x7f4a58105ef0 2024-09-13T18:21:50.037 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.914+0000 7f4a577fe640 1 -- 172.21.15.38:0/3587725048 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a480328e0 con 0x7f4a58105ef0 2024-09-13T18:21:50.037 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.914+0000 7f4a577fe640 1 -- 172.21.15.38:0/3587725048 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a480307d0 con 0x7f4a58105ef0 2024-09-13T18:21:50.037 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.915+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3587725048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 msgr2=0x7f4a581082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:50.037 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.915+0000 7f4a5e6ee640 1 --2- 172.21.15.38:0/3587725048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 0x7f4a581082e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009820 tx=0x7f4a4802a270 comp rx=0 tx=0).stop 2024-09-13T18:21:50.037 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.915+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3587725048 shutdown_connections 2024-09-13T18:21:50.037 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.915+0000 7f4a5e6ee640 1 --2- 172.21.15.38:0/3587725048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 0x7f4a581082e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:50.037 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.915+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3587725048 >> 172.21.15.38:0/3587725048 conn(0x7f4a580ffb50 msgr2=0x7f4a58101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:50.037 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.915+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3587725048 shutdown_connections 2024-09-13T18:21:50.038 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.915+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3587725048 wait complete. 2024-09-13T18:21:50.038 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.915+0000 7f4a5e6ee640 1 Processor -- start 2024-09-13T18:21:50.038 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.915+0000 7f4a5e6ee640 1 -- start start 2024-09-13T18:21:50.038 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.916+0000 7f4a5e6ee640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 0x7f4a58105770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:50.038 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.916+0000 7f4a5e6ee640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58105cb0 con 0x7f4a58105ef0 2024-09-13T18:21:50.038 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.916+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 0x7f4a58105770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:50.038 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.916+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 0x7f4a58105770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41004/0 (socket says 172.21.15.38:41004) 2024-09-13T18:21:50.038 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.916+0000 7f4a57fff640 1 -- 172.21.15.38:0/3809565530 learned_addr learned my addr 172.21.15.38:0/3809565530 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:50.038 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.916+0000 7f4a57fff640 1 -- 172.21.15.38:0/3809565530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a480094d0 con 0x7f4a58105ef0 2024-09-13T18:21:50.038 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.916+0000 7f4a57fff640 1 --2- 172.21.15.38:0/3809565530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 0x7f4a58105770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a48030380 tx=0x7f4a48032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:50.038 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.917+0000 7f4a55ffb640 1 -- 172.21.15.38:0/3809565530 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a48030df0 con 0x7f4a58105ef0 2024-09-13T18:21:50.039 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.917+0000 7f4a55ffb640 1 -- 172.21.15.38:0/3809565530 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a4803b8c0 con 0x7f4a58105ef0 2024-09-13T18:21:50.039 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.917+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3809565530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a58103ea0 con 0x7f4a58105ef0 2024-09-13T18:21:50.039 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.917+0000 7f4a55ffb640 1 -- 172.21.15.38:0/3809565530 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a4803a760 con 0x7f4a58105ef0 2024-09-13T18:21:50.039 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.917+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3809565530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a581042c0 con 0x7f4a58105ef0 2024-09-13T18:21:50.039 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.918+0000 7f4a55ffb640 1 -- 172.21.15.38:0/3809565530 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f4a48039070 con 0x7f4a58105ef0 2024-09-13T18:21:50.039 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.918+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3809565530 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a58109570 con 0x7f4a58105ef0 2024-09-13T18:21:50.039 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.918+0000 7f4a55ffb640 1 --2- 172.21.15.38:0/3809565530 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f4a440386a0 0x7f4a4403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:50.039 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.918+0000 7f4a55ffb640 1 -- 172.21.15.38:0/3809565530 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4a4806bb20 con 0x7f4a58105ef0 2024-09-13T18:21:50.040 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.918+0000 7f4a4ffff640 1 --2- 172.21.15.38:0/3809565530 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f4a440386a0 0x7f4a4403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:50.040 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.919+0000 7f4a4ffff640 1 --2- 172.21.15.38:0/3809565530 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f4a440386a0 0x7f4a4403ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a400098c0 tx=0x7f4a40006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:50.040 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:48.926+0000 7f4a55ffb640 1 -- 172.21.15.38:0/3809565530 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4a480396e0 con 0x7f4a58105ef0 2024-09-13T18:21:50.040 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:49.119+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3809565530 --> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4a58061900 con 0x7f4a440386a0 2024-09-13T18:21:50.040 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:49.369+0000 7f4a55ffb640 1 -- 172.21.15.38:0/3809565530 <== mgr.14162 v2:172.21.15.38:6800/1869434741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f4a58061900 con 0x7f4a440386a0 2024-09-13T18:21:50.040 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:49.371+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3809565530 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f4a440386a0 msgr2=0x7f4a4403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:50.040 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:49.371+0000 7f4a5e6ee640 1 --2- 172.21.15.38:0/3809565530 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f4a440386a0 0x7f4a4403ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a400098c0 tx=0x7f4a40006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:50.040 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:49.371+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3809565530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 msgr2=0x7f4a58105770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:50.040 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:49.371+0000 7f4a5e6ee640 1 --2- 172.21.15.38:0/3809565530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 0x7f4a58105770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a48030380 tx=0x7f4a48032670 comp rx=0 tx=0).stop 2024-09-13T18:21:50.040 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:49.371+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3809565530 shutdown_connections 2024-09-13T18:21:50.040 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:49.371+0000 7f4a5e6ee640 1 --2- 172.21.15.38:0/3809565530 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f4a440386a0 0x7f4a4403ab60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:50.040 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:49.371+0000 7f4a5e6ee640 1 --2- 172.21.15.38:0/3809565530 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a58105ef0 0x7f4a58105770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:50.041 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:49.371+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3809565530 >> 172.21.15.38:0/3809565530 conn(0x7f4a580ffb50 msgr2=0x7f4a581006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:50.041 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:49.371+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3809565530 shutdown_connections 2024-09-13T18:21:50.041 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:49.371+0000 7f4a5e6ee640 1 -- 172.21.15.38:0/3809565530 wait complete. 2024-09-13T18:21:50.041 INFO:teuthology.orchestra.run.smithi038.stdout:Fetching dashboard port number... 2024-09-13T18:21:50.624 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:50 smithi038 ceph-mon[27689]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:21:51.762 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:51 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2467044923' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T18:21:52.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T18:21:52.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.432+0000 7f77a210f640 1 Processor -- start 2024-09-13T18:21:52.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.432+0000 7f77a210f640 1 -- start start 2024-09-13T18:21:52.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.432+0000 7f77a210f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 0x7f779c106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:52.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.432+0000 7f77a210f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c1074c0 con 0x7f779c106af0 2024-09-13T18:21:52.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.432+0000 7f779b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 0x7f779c106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:52.013 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.432+0000 7f779b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 0x7f779c106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41012/0 (socket says 172.21.15.38:41012) 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.432+0000 7f779b7fe640 1 -- 172.21.15.38:0/2362176197 learned_addr learned my addr 172.21.15.38:0/2362176197 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.433+0000 7f779b7fe640 1 -- 172.21.15.38:0/2362176197 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c105030 con 0x7f779c106af0 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.433+0000 7f779b7fe640 1 --2- 172.21.15.38:0/2362176197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 0x7f779c106ef0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f778c009820 tx=0x7f778c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4557316da9acfd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.434+0000 7f779a7fc640 1 -- 172.21.15.38:0/2362176197 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f778c02ad40 con 0x7f779c106af0 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.434+0000 7f779a7fc640 1 -- 172.21.15.38:0/2362176197 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f778c0328e0 con 0x7f779c106af0 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.434+0000 7f779a7fc640 1 -- 172.21.15.38:0/2362176197 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f778c0307d0 con 0x7f779c106af0 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.434+0000 7f77a210f640 1 -- 172.21.15.38:0/2362176197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 msgr2=0x7f779c106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.434+0000 7f77a210f640 1 --2- 172.21.15.38:0/2362176197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 0x7f779c106ef0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f778c009820 tx=0x7f778c02a270 comp rx=0 tx=0).stop 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.434+0000 7f77a210f640 1 -- 172.21.15.38:0/2362176197 shutdown_connections 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.434+0000 7f77a210f640 1 --2- 172.21.15.38:0/2362176197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 0x7f779c106ef0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.434+0000 7f77a210f640 1 -- 172.21.15.38:0/2362176197 >> 172.21.15.38:0/2362176197 conn(0x7f779c100c20 msgr2=0x7f779c103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.434+0000 7f77a210f640 1 -- 172.21.15.38:0/2362176197 shutdown_connections 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.434+0000 7f77a210f640 1 -- 172.21.15.38:0/2362176197 wait complete. 2024-09-13T18:21:52.014 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.435+0000 7f77a210f640 1 Processor -- start 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.435+0000 7f77a210f640 1 -- start start 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.436+0000 7f77a210f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 0x7f779c1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.436+0000 7f77a210f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c199710 con 0x7f779c106af0 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.436+0000 7f779b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 0x7f779c1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.436+0000 7f779b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 0x7f779c1991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41020/0 (socket says 172.21.15.38:41020) 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.436+0000 7f779b7fe640 1 -- 172.21.15.38:0/2467044923 learned_addr learned my addr 172.21.15.38:0/2467044923 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.436+0000 7f779b7fe640 1 -- 172.21.15.38:0/2467044923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c0094d0 con 0x7f779c106af0 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.436+0000 7f779b7fe640 1 --2- 172.21.15.38:0/2467044923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 0x7f779c1991d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f778c009940 tx=0x7f778c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.436+0000 7f7798ff9640 1 -- 172.21.15.38:0/2467044923 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f778c030e40 con 0x7f779c106af0 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.436+0000 7f7798ff9640 1 -- 172.21.15.38:0/2467044923 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f778c03b8b0 con 0x7f779c106af0 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.436+0000 7f77a210f640 1 -- 172.21.15.38:0/2467044923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c199910 con 0x7f779c106af0 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.436+0000 7f7798ff9640 1 -- 172.21.15.38:0/2467044923 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f778c03a620 con 0x7f779c106af0 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.437+0000 7f77a210f640 1 -- 172.21.15.38:0/2467044923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c199d30 con 0x7f779c106af0 2024-09-13T18:21:52.015 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.437+0000 7f7798ff9640 1 -- 172.21.15.38:0/2467044923 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f778c039040 con 0x7f779c106af0 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.438+0000 7f77a210f640 1 -- 172.21.15.38:0/2467044923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c106ef0 con 0x7f779c106af0 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.438+0000 7f7798ff9640 1 --2- 172.21.15.38:0/2467044923 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f77840386a0 0x7f778403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.438+0000 7f7798ff9640 1 -- 172.21.15.38:0/2467044923 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f778c06b9a0 con 0x7f779c106af0 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.438+0000 7f779affd640 1 --2- 172.21.15.38:0/2467044923 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f77840386a0 0x7f778403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.438+0000 7f779affd640 1 --2- 172.21.15.38:0/2467044923 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f77840386a0 0x7f778403ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f77900098c0 tx=0x7f7790006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.442+0000 7f7798ff9640 1 -- 172.21.15.38:0/2467044923 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f778c04b710 con 0x7f779c106af0 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.621+0000 7f77a210f640 1 -- 172.21.15.38:0/2467044923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f779c109840 con 0x7f779c106af0 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.621+0000 7f7798ff9640 1 -- 172.21.15.38:0/2467044923 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f778c0433b0 con 0x7f779c106af0 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.623+0000 7f77a210f640 1 -- 172.21.15.38:0/2467044923 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f77840386a0 msgr2=0x7f778403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.623+0000 7f77a210f640 1 --2- 172.21.15.38:0/2467044923 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f77840386a0 0x7f778403ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f77900098c0 tx=0x7f7790006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.623+0000 7f77a210f640 1 -- 172.21.15.38:0/2467044923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 msgr2=0x7f779c1991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.623+0000 7f77a210f640 1 --2- 172.21.15.38:0/2467044923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 0x7f779c1991d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f778c009940 tx=0x7f778c032670 comp rx=0 tx=0).stop 2024-09-13T18:21:52.016 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.623+0000 7f77a210f640 1 -- 172.21.15.38:0/2467044923 shutdown_connections 2024-09-13T18:21:52.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.623+0000 7f77a210f640 1 --2- 172.21.15.38:0/2467044923 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f77840386a0 0x7f778403ab60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:52.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.623+0000 7f77a210f640 1 --2- 172.21.15.38:0/2467044923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f779c106af0 0x7f779c1991d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:52.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.623+0000 7f77a210f640 1 -- 172.21.15.38:0/2467044923 >> 172.21.15.38:0/2467044923 conn(0x7f779c100c20 msgr2=0x7f779c101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:52.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.624+0000 7f77a210f640 1 -- 172.21.15.38:0/2467044923 shutdown_connections 2024-09-13T18:21:52.017 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:50.624+0000 7f77a210f640 1 -- 172.21.15.38:0/2467044923 wait complete. 2024-09-13T18:21:52.023 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T18:21:52.023 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout disabled 2024-09-13T18:21:52.032 INFO:teuthology.orchestra.run.smithi038.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T18:21:52.032 INFO:teuthology.orchestra.run.smithi038.stdout:systemctl: stdout inactive 2024-09-13T18:21:52.032 INFO:teuthology.orchestra.run.smithi038.stdout:firewalld.service is not enabled 2024-09-13T18:21:52.032 INFO:teuthology.orchestra.run.smithi038.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T18:21:52.034 INFO:teuthology.orchestra.run.smithi038.stdout:Ceph Dashboard is now available at: 2024-09-13T18:21:52.034 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:21:52.034 INFO:teuthology.orchestra.run.smithi038.stdout: URL: https://smithi038.front.sepia.ceph.com:8443/ 2024-09-13T18:21:52.034 INFO:teuthology.orchestra.run.smithi038.stdout: User: admin 2024-09-13T18:21:52.034 INFO:teuthology.orchestra.run.smithi038.stdout: Password: q5vihzrcr0 2024-09-13T18:21:52.034 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:21:52.035 INFO:teuthology.orchestra.run.smithi038.stdout:Saving cluster configuration to /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config directory 2024-09-13T18:21:52.035 INFO:teuthology.orchestra.run.smithi038.stdout:Enabling autotune for osd_memory_target 2024-09-13T18:21:52.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:52 smithi038 ceph-mon[27689]: mgrmap e13: smithi038.jeygoq(active, since 6s) 2024-09-13T18:21:53.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.477+0000 7f433ce93640 1 Processor -- start 2024-09-13T18:21:53.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.478+0000 7f433ce93640 1 -- start start 2024-09-13T18:21:53.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.478+0000 7f433ce93640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 0x7f433807a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:53.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.478+0000 7f433ce93640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433807bfb0 con 0x7f433807a280 2024-09-13T18:21:53.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.478+0000 7f433659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 0x7f433807a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:53.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.478+0000 7f433659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 0x7f433807a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52132/0 (socket says 172.21.15.38:52132) 2024-09-13T18:21:53.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.478+0000 7f433659c640 1 -- 172.21.15.38:0/2288517510 learned_addr learned my addr 172.21.15.38:0/2288517510 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:53.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.478+0000 7f433659c640 1 -- 172.21.15.38:0/2288517510 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433807abc0 con 0x7f433807a280 2024-09-13T18:21:53.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.479+0000 7f433659c640 1 --2- 172.21.15.38:0/2288517510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 0x7f433807a680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4328009820 tx=0x7f432802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32709e3635b5d48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:53.203 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.479+0000 7f433559a640 1 -- 172.21.15.38:0/2288517510 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f432802ad40 con 0x7f433807a280 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.479+0000 7f433559a640 1 -- 172.21.15.38:0/2288517510 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43280328e0 con 0x7f433807a280 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.479+0000 7f433559a640 1 -- 172.21.15.38:0/2288517510 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43280307d0 con 0x7f433807a280 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.480+0000 7f433ce93640 1 -- 172.21.15.38:0/2288517510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 msgr2=0x7f433807a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.480+0000 7f433ce93640 1 --2- 172.21.15.38:0/2288517510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 0x7f433807a680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4328009820 tx=0x7f432802a270 comp rx=0 tx=0).stop 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.480+0000 7f433ce93640 1 -- 172.21.15.38:0/2288517510 shutdown_connections 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.480+0000 7f433ce93640 1 --2- 172.21.15.38:0/2288517510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 0x7f433807a680 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.480+0000 7f433ce93640 1 -- 172.21.15.38:0/2288517510 >> 172.21.15.38:0/2288517510 conn(0x7f4338100c20 msgr2=0x7f4338103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.480+0000 7f433ce93640 1 -- 172.21.15.38:0/2288517510 shutdown_connections 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.480+0000 7f433ce93640 1 -- 172.21.15.38:0/2288517510 wait complete. 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.481+0000 7f433ce93640 1 Processor -- start 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.481+0000 7f433ce93640 1 -- start start 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.481+0000 7f433ce93640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 0x7f433819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:53.204 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.481+0000 7f433ce93640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433819b900 con 0x7f433807a280 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.481+0000 7f433659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 0x7f433819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.481+0000 7f433659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 0x7f433819b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52136/0 (socket says 172.21.15.38:52136) 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.481+0000 7f433659c640 1 -- 172.21.15.38:0/4158541864 learned_addr learned my addr 172.21.15.38:0/4158541864 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.482+0000 7f433659c640 1 -- 172.21.15.38:0/4158541864 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43280094d0 con 0x7f433807a280 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.482+0000 7f433659c640 1 --2- 172.21.15.38:0/4158541864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 0x7f433819b3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4328030380 tx=0x7f4328032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.482+0000 7f43277fe640 1 -- 172.21.15.38:0/4158541864 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4328030df0 con 0x7f433807a280 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.482+0000 7f43277fe640 1 -- 172.21.15.38:0/4158541864 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f432803b8c0 con 0x7f433807a280 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.482+0000 7f433ce93640 1 -- 172.21.15.38:0/4158541864 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433819bb00 con 0x7f433807a280 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.482+0000 7f43277fe640 1 -- 172.21.15.38:0/4158541864 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f432803a760 con 0x7f433807a280 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.482+0000 7f433ce93640 1 -- 172.21.15.38:0/4158541864 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433819bf20 con 0x7f433807a280 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.483+0000 7f43277fe640 1 -- 172.21.15.38:0/4158541864 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f4328039070 con 0x7f433807a280 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.483+0000 7f43277fe640 1 --2- 172.21.15.38:0/4158541864 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f4320038790 0x7f432003ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:53.205 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.483+0000 7f433ce93640 1 -- 172.21.15.38:0/4158541864 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433810b890 con 0x7f433807a280 2024-09-13T18:21:53.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.483+0000 7f43277fe640 1 -- 172.21.15.38:0/4158541864 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f432806bc70 con 0x7f433807a280 2024-09-13T18:21:53.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.483+0000 7f4335d9b640 1 --2- 172.21.15.38:0/4158541864 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f4320038790 0x7f432003ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:53.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.484+0000 7f4335d9b640 1 --2- 172.21.15.38:0/4158541864 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f4320038790 0x7f432003ac50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f432c00ad30 tx=0x7f432c0093f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:53.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.488+0000 7f43277fe640 1 -- 172.21.15.38:0/4158541864 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f432803f030 con 0x7f433807a280 2024-09-13T18:21:53.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.658+0000 7f433ce93640 1 -- 172.21.15.38:0/4158541864 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f433810ba70 con 0x7f433807a280 2024-09-13T18:21:53.206 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.658+0000 7f43277fe640 1 -- 172.21.15.38:0/4158541864 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f4328031b50 con 0x7f433807a280 2024-09-13T18:21:53.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.661+0000 7f433ce93640 1 -- 172.21.15.38:0/4158541864 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f4320038790 msgr2=0x7f432003ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:53.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.661+0000 7f433ce93640 1 --2- 172.21.15.38:0/4158541864 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f4320038790 0x7f432003ac50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f432c00ad30 tx=0x7f432c0093f0 comp rx=0 tx=0).stop 2024-09-13T18:21:53.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.661+0000 7f433ce93640 1 -- 172.21.15.38:0/4158541864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 msgr2=0x7f433819b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:53.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.661+0000 7f433ce93640 1 --2- 172.21.15.38:0/4158541864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 0x7f433819b3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4328030380 tx=0x7f4328032670 comp rx=0 tx=0).stop 2024-09-13T18:21:53.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.661+0000 7f433ce93640 1 -- 172.21.15.38:0/4158541864 shutdown_connections 2024-09-13T18:21:53.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.661+0000 7f433ce93640 1 --2- 172.21.15.38:0/4158541864 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f4320038790 0x7f432003ac50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:53.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.661+0000 7f433ce93640 1 --2- 172.21.15.38:0/4158541864 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f433807a280 0x7f433819b3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:53.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.661+0000 7f433ce93640 1 -- 172.21.15.38:0/4158541864 >> 172.21.15.38:0/4158541864 conn(0x7f4338100c20 msgr2=0x7f4338101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:53.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.661+0000 7f433ce93640 1 -- 172.21.15.38:0/4158541864 shutdown_connections 2024-09-13T18:21:53.207 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:52.661+0000 7f433ce93640 1 -- 172.21.15.38:0/4158541864 wait complete. 2024-09-13T18:21:54.409 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.562+0000 7fac86269640 1 Processor -- start 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.562+0000 7fac86269640 1 -- start start 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.563+0000 7fac86269640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 0x7fac80108e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.563+0000 7fac86269640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac80109420 con 0x7fac80108a50 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.563+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 0x7fac80108e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.563+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 0x7fac80108e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52144/0 (socket says 172.21.15.38:52144) 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.563+0000 7fac7ffff640 1 -- 172.21.15.38:0/3977417531 learned_addr learned my addr 172.21.15.38:0/3977417531 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.563+0000 7fac7ffff640 1 -- 172.21.15.38:0/3977417531 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac80109560 con 0x7fac80108a50 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.564+0000 7fac7ffff640 1 --2- 172.21.15.38:0/3977417531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 0x7fac80108e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fac70009820 tx=0x7fac7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c54984e3a64f360 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.564+0000 7fac7effd640 1 -- 172.21.15.38:0/3977417531 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac7002ad40 con 0x7fac80108a50 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.564+0000 7fac7effd640 1 -- 172.21.15.38:0/3977417531 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fac700328e0 con 0x7fac80108a50 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.564+0000 7fac7effd640 1 -- 172.21.15.38:0/3977417531 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac700307d0 con 0x7fac80108a50 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.565+0000 7fac86269640 1 -- 172.21.15.38:0/3977417531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 msgr2=0x7fac80108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:54.410 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.565+0000 7fac86269640 1 --2- 172.21.15.38:0/3977417531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 0x7fac80108e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fac70009820 tx=0x7fac7002a270 comp rx=0 tx=0).stop 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.565+0000 7fac86269640 1 -- 172.21.15.38:0/3977417531 shutdown_connections 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.565+0000 7fac86269640 1 --2- 172.21.15.38:0/3977417531 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 0x7fac80108e50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.565+0000 7fac86269640 1 -- 172.21.15.38:0/3977417531 >> 172.21.15.38:0/3977417531 conn(0x7fac8007ad20 msgr2=0x7fac8007b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.565+0000 7fac86269640 1 -- 172.21.15.38:0/3977417531 shutdown_connections 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.565+0000 7fac86269640 1 -- 172.21.15.38:0/3977417531 wait complete. 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.565+0000 7fac86269640 1 Processor -- start 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.565+0000 7fac86269640 1 -- start start 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.566+0000 7fac86269640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 0x7fac8019b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.566+0000 7fac86269640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8019b810 con 0x7fac80108a50 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.566+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 0x7fac8019b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.566+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 0x7fac8019b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52160/0 (socket says 172.21.15.38:52160) 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.566+0000 7fac7ffff640 1 -- 172.21.15.38:0/1607633306 learned_addr learned my addr 172.21.15.38:0/1607633306 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.566+0000 7fac7ffff640 1 -- 172.21.15.38:0/1607633306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac700094d0 con 0x7fac80108a50 2024-09-13T18:21:54.411 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.566+0000 7fac7ffff640 1 --2- 172.21.15.38:0/1607633306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 0x7fac8019b2d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fac70032670 tx=0x7fac700326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.567+0000 7fac7d7fa640 1 -- 172.21.15.38:0/1607633306 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac70030e40 con 0x7fac80108a50 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.567+0000 7fac7d7fa640 1 -- 172.21.15.38:0/1607633306 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fac7003b8b0 con 0x7fac80108a50 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.567+0000 7fac86269640 1 -- 172.21.15.38:0/1607633306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8019ba10 con 0x7fac80108a50 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.567+0000 7fac7d7fa640 1 -- 172.21.15.38:0/1607633306 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac7003a650 con 0x7fac80108a50 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.567+0000 7fac86269640 1 -- 172.21.15.38:0/1607633306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8019be30 con 0x7fac80108a50 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.568+0000 7fac7d7fa640 1 -- 172.21.15.38:0/1607633306 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fac70039040 con 0x7fac80108a50 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.568+0000 7fac7d7fa640 1 --2- 172.21.15.38:0/1607633306 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fac68038790 0x7fac6803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.568+0000 7fac86269640 1 -- 172.21.15.38:0/1607633306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac80108e50 con 0x7fac80108a50 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.568+0000 7fac7d7fa640 1 -- 172.21.15.38:0/1607633306 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fac7006bab0 con 0x7fac80108a50 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.568+0000 7fac7f7fe640 1 --2- 172.21.15.38:0/1607633306 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fac68038790 0x7fac6803ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.569+0000 7fac7f7fe640 1 --2- 172.21.15.38:0/1607633306 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fac68038790 0x7fac6803ac50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fac740098c0 tx=0x7fac74006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.575+0000 7fac7d7fa640 1 -- 172.21.15.38:0/1607633306 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fac70042360 con 0x7fac80108a50 2024-09-13T18:21:54.412 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.831+0000 7fac86269640 1 -- 172.21.15.38:0/1607633306 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fac8019e790 con 0x7fac80108a50 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.834+0000 7fac7d7fa640 1 -- 172.21.15.38:0/1607633306 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7fac700433b0 con 0x7fac80108a50 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.835+0000 7fac86269640 1 -- 172.21.15.38:0/1607633306 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fac68038790 msgr2=0x7fac6803ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.835+0000 7fac86269640 1 --2- 172.21.15.38:0/1607633306 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fac68038790 0x7fac6803ac50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fac740098c0 tx=0x7fac74006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.835+0000 7fac86269640 1 -- 172.21.15.38:0/1607633306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 msgr2=0x7fac8019b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.835+0000 7fac86269640 1 --2- 172.21.15.38:0/1607633306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 0x7fac8019b2d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fac70032670 tx=0x7fac700326a0 comp rx=0 tx=0).stop 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.836+0000 7fac86269640 1 -- 172.21.15.38:0/1607633306 shutdown_connections 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.836+0000 7fac86269640 1 --2- 172.21.15.38:0/1607633306 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fac68038790 0x7fac6803ac50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.836+0000 7fac86269640 1 --2- 172.21.15.38:0/1607633306 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fac80108a50 0x7fac8019b2d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.836+0000 7fac86269640 1 -- 172.21.15.38:0/1607633306 >> 172.21.15.38:0/1607633306 conn(0x7fac8007ad20 msgr2=0x7fac80105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.836+0000 7fac86269640 1 -- 172.21.15.38:0/1607633306 shutdown_connections 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/ceph: stderr 2024-09-13T18:21:53.836+0000 7fac86269640 1 -- 172.21.15.38:0/1607633306 wait complete. 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T18:21:54.413 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout: ceph telemetry on 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout:For more information see: 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T18:21:54.414 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:21:54.415 INFO:teuthology.orchestra.run.smithi038.stdout:Bootstrap complete. 2024-09-13T18:21:54.441 INFO:tasks.cephadm:Fetching config... 2024-09-13T18:21:54.442 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:21:54.442 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T18:21:54.459 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T18:21:54.459 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:21:54.459 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T18:21:54.518 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T18:21:54.519 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:21:54.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/keyring of=/dev/stdout 2024-09-13T18:21:54.585 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T18:21:54.585 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:21:54.585 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T18:21:54.641 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T18:21:54.641 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCk544mVqY0dMiATSDjL/VewovNGHBg4xqHpbbhgwREIdDRSBRCUepOe7zWUBKoNLoNex0BoRf7BbzbQL8HdcE1niLKriIecbsVXEBMVOnyiooRKIY/0rWk3xzzx1FT0DqZyZfeb+4nIFhvnpshM1tKj5Fa5SvfVCAopPo+EOZJO8ZbLuC1yHeA3QQNxkYNpmQqty9GMAaW0kom2UQni+JYLEwrGXcadM/y7TVoXr2dtFDYHzxWkEL40xOlBOQ2AgexIskLPiVJBcYZ0CPLrkDEQZTFEbbud/YTpVjCfvmACXpxFKJaANpI+fKEkeG3KPO3C1q4wYwF+yJ5dt3JbZX4DpB1LuxQ/O9PGtGEg838I7lk1XK0XbsWk9pWaZzY/o0BMihKxxJKVD/bvYwZIsLHTrmj5xYLVFOD/8AGnmly1OrP9k0Zww7PTuRdNQWwRRISh04BU20RhAYKVbxvE80HmhZNl69aQ3DDnyEXyTRTtAhhnlSe4Ug2YXJn3uUY/NE= ceph-ccb73e88-71fc-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T18:21:54.719 INFO:teuthology.orchestra.run.smithi038.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCk544mVqY0dMiATSDjL/VewovNGHBg4xqHpbbhgwREIdDRSBRCUepOe7zWUBKoNLoNex0BoRf7BbzbQL8HdcE1niLKriIecbsVXEBMVOnyiooRKIY/0rWk3xzzx1FT0DqZyZfeb+4nIFhvnpshM1tKj5Fa5SvfVCAopPo+EOZJO8ZbLuC1yHeA3QQNxkYNpmQqty9GMAaW0kom2UQni+JYLEwrGXcadM/y7TVoXr2dtFDYHzxWkEL40xOlBOQ2AgexIskLPiVJBcYZ0CPLrkDEQZTFEbbud/YTpVjCfvmACXpxFKJaANpI+fKEkeG3KPO3C1q4wYwF+yJ5dt3JbZX4DpB1LuxQ/O9PGtGEg838I7lk1XK0XbsWk9pWaZzY/o0BMihKxxJKVD/bvYwZIsLHTrmj5xYLVFOD/8AGnmly1OrP9k0Zww7PTuRdNQWwRRISh04BU20RhAYKVbxvE80HmhZNl69aQ3DDnyEXyTRTtAhhnlSe4Ug2YXJn3uUY/NE= ceph-ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:21:54.731 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCk544mVqY0dMiATSDjL/VewovNGHBg4xqHpbbhgwREIdDRSBRCUepOe7zWUBKoNLoNex0BoRf7BbzbQL8HdcE1niLKriIecbsVXEBMVOnyiooRKIY/0rWk3xzzx1FT0DqZyZfeb+4nIFhvnpshM1tKj5Fa5SvfVCAopPo+EOZJO8ZbLuC1yHeA3QQNxkYNpmQqty9GMAaW0kom2UQni+JYLEwrGXcadM/y7TVoXr2dtFDYHzxWkEL40xOlBOQ2AgexIskLPiVJBcYZ0CPLrkDEQZTFEbbud/YTpVjCfvmACXpxFKJaANpI+fKEkeG3KPO3C1q4wYwF+yJ5dt3JbZX4DpB1LuxQ/O9PGtGEg838I7lk1XK0XbsWk9pWaZzY/o0BMihKxxJKVD/bvYwZIsLHTrmj5xYLVFOD/8AGnmly1OrP9k0Zww7PTuRdNQWwRRISh04BU20RhAYKVbxvE80HmhZNl69aQ3DDnyEXyTRTtAhhnlSe4Ug2YXJn3uUY/NE= ceph-ccb73e88-71fc-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T18:21:54.785 INFO:teuthology.orchestra.run.smithi149.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCk544mVqY0dMiATSDjL/VewovNGHBg4xqHpbbhgwREIdDRSBRCUepOe7zWUBKoNLoNex0BoRf7BbzbQL8HdcE1niLKriIecbsVXEBMVOnyiooRKIY/0rWk3xzzx1FT0DqZyZfeb+4nIFhvnpshM1tKj5Fa5SvfVCAopPo+EOZJO8ZbLuC1yHeA3QQNxkYNpmQqty9GMAaW0kom2UQni+JYLEwrGXcadM/y7TVoXr2dtFDYHzxWkEL40xOlBOQ2AgexIskLPiVJBcYZ0CPLrkDEQZTFEbbud/YTpVjCfvmACXpxFKJaANpI+fKEkeG3KPO3C1q4wYwF+yJ5dt3JbZX4DpB1LuxQ/O9PGtGEg838I7lk1XK0XbsWk9pWaZzY/o0BMihKxxJKVD/bvYwZIsLHTrmj5xYLVFOD/8AGnmly1OrP9k0Zww7PTuRdNQWwRRISh04BU20RhAYKVbxvE80HmhZNl69aQ3DDnyEXyTRTtAhhnlSe4Ug2YXJn3uUY/NE= ceph-ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:21:54.798 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T18:21:54.997 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:21:55.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:54 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1607633306' entity='client.admin' 2024-09-13T18:21:57.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:57 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:57.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:57 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:57.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:57 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:21:57.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:57 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:21:57.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:57 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi038", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T18:21:57.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:57 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi038", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T18:21:57.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:57 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:21:57.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:57 smithi038 ceph-mon[27689]: Deploying daemon ceph-exporter.smithi038 on smithi038 2024-09-13T18:21:57.565 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.557+0000 7f700de7c640 1 -- 172.21.15.38:0/3800828859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70080fe6e0 msgr2=0x7f70080feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.557+0000 7f700de7c640 1 --2- 172.21.15.38:0/3800828859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70080fe6e0 0x7f70080feae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009880 tx=0x7f6ff802a5d0 comp rx=0 tx=0).stop 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.557+0000 7f700de7c640 1 -- 172.21.15.38:0/3800828859 shutdown_connections 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.557+0000 7f700de7c640 1 --2- 172.21.15.38:0/3800828859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70080fe6e0 0x7f70080feae0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.557+0000 7f700de7c640 1 -- 172.21.15.38:0/3800828859 >> 172.21.15.38:0/3800828859 conn(0x7f70080f9e90 msgr2=0x7f70080fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.557+0000 7f700de7c640 1 -- 172.21.15.38:0/3800828859 shutdown_connections 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.558+0000 7f700de7c640 1 -- 172.21.15.38:0/3800828859 wait complete. 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.558+0000 7f700de7c640 1 Processor -- start 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.558+0000 7f700de7c640 1 -- start start 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.558+0000 7f700de7c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70080fe6e0 0x7f7008194c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.558+0000 7f700de7c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7008195140 con 0x7f70080fe6e0 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.559+0000 7f70077fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70080fe6e0 0x7f7008194c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.559+0000 7f70077fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70080fe6e0 0x7f7008194c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52168/0 (socket says 172.21.15.38:52168) 2024-09-13T18:21:57.566 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.559+0000 7f70077fe640 1 -- 172.21.15.38:0/646858535 learned_addr learned my addr 172.21.15.38:0/646858535 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.559+0000 7f70077fe640 1 -- 172.21.15.38:0/646858535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff8009560 con 0x7f70080fe6e0 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.559+0000 7f70077fe640 1 --2- 172.21.15.38:0/646858535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70080fe6e0 0x7f7008194c00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8004cf0 tx=0x7f6ff8004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.559+0000 7f7004ff9640 1 -- 172.21.15.38:0/646858535 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ff80053f0 con 0x7f70080fe6e0 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.559+0000 7f7004ff9640 1 -- 172.21.15.38:0/646858535 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ff8005550 con 0x7f70080fe6e0 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.559+0000 7f7004ff9640 1 -- 172.21.15.38:0/646858535 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ff80319c0 con 0x7f70080fe6e0 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.559+0000 7f700de7c640 1 -- 172.21.15.38:0/646858535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7008195340 con 0x7f70080fe6e0 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.559+0000 7f700de7c640 1 -- 172.21.15.38:0/646858535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70081957e0 con 0x7f70080fe6e0 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.560+0000 7f7004ff9640 1 -- 172.21.15.38:0/646858535 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f6ff8031c30 con 0x7f70080fe6e0 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.560+0000 7f700de7c640 1 -- 172.21.15.38:0/646858535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70080feae0 con 0x7f70080fe6e0 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.560+0000 7f7004ff9640 1 --2- 172.21.15.38:0/646858535 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f6ff0038740 0x7f6ff003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.561+0000 7f7004ff9640 1 -- 172.21.15.38:0/646858535 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6ff806c450 con 0x7f70080fe6e0 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.561+0000 7f7006ffd640 1 --2- 172.21.15.38:0/646858535 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f6ff0038740 0x7f6ff003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:21:57.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.561+0000 7f7006ffd640 1 --2- 172.21.15.38:0/646858535 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f6ff0038740 0x7f6ff003ac00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0098c0 tx=0x7f6ffc006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:21:57.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.566+0000 7f7004ff9640 1 -- 172.21.15.38:0/646858535 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6ff803c840 con 0x7f70080fe6e0 2024-09-13T18:21:57.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.740+0000 7f700de7c640 1 -- 172.21.15.38:0/646858535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f70081046b0 con 0x7f70080fe6e0 2024-09-13T18:21:57.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.745+0000 7f7004ff9640 1 -- 172.21.15.38:0/646858535 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6ff80350c0 con 0x7f70080fe6e0 2024-09-13T18:21:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.747+0000 7f700de7c640 1 -- 172.21.15.38:0/646858535 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f6ff0038740 msgr2=0x7f6ff003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.747+0000 7f700de7c640 1 --2- 172.21.15.38:0/646858535 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f6ff0038740 0x7f6ff003ac00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0098c0 tx=0x7f6ffc006db0 comp rx=0 tx=0).stop 2024-09-13T18:21:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.747+0000 7f700de7c640 1 -- 172.21.15.38:0/646858535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70080fe6e0 msgr2=0x7f7008194c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:21:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.747+0000 7f700de7c640 1 --2- 172.21.15.38:0/646858535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70080fe6e0 0x7f7008194c00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8004cf0 tx=0x7f6ff8004d20 comp rx=0 tx=0).stop 2024-09-13T18:21:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.748+0000 7f700de7c640 1 -- 172.21.15.38:0/646858535 shutdown_connections 2024-09-13T18:21:57.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.748+0000 7f700de7c640 1 --2- 172.21.15.38:0/646858535 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f6ff0038740 0x7f6ff003ac00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.748+0000 7f700de7c640 1 --2- 172.21.15.38:0/646858535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70080fe6e0 0x7f7008194c00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:21:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.748+0000 7f700de7c640 1 -- 172.21.15.38:0/646858535 >> 172.21.15.38:0/646858535 conn(0x7f70080f9e90 msgr2=0x7f7008068620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:21:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.748+0000 7f700de7c640 1 -- 172.21.15.38:0/646858535 shutdown_connections 2024-09-13T18:21:57.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:21:57.748+0000 7f700de7c640 1 -- 172.21.15.38:0/646858535 wait complete. 2024-09-13T18:21:58.337 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T18:21:58.337 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T18:21:58.876 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:21:58.999 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:21:58 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/646858535' entity='client.admin' 2024-09-13T18:22:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.395+0000 7fa751335640 1 -- 172.21.15.38:0/2381427540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0fe050 msgr2=0x7fa74c100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.395+0000 7fa751335640 1 --2- 172.21.15.38:0/2381427540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0fe050 0x7fa74c100460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009880 tx=0x7fa73c02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.395+0000 7fa751335640 1 -- 172.21.15.38:0/2381427540 shutdown_connections 2024-09-13T18:22:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.395+0000 7fa751335640 1 --2- 172.21.15.38:0/2381427540 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0fe050 0x7fa74c100460 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.395+0000 7fa751335640 1 -- 172.21.15.38:0/2381427540 >> 172.21.15.38:0/2381427540 conn(0x7fa74c0f9e80 msgr2=0x7fa74c0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.395+0000 7fa751335640 1 -- 172.21.15.38:0/2381427540 shutdown_connections 2024-09-13T18:22:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.395+0000 7fa751335640 1 -- 172.21.15.38:0/2381427540 wait complete. 2024-09-13T18:22:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.396+0000 7fa751335640 1 Processor -- start 2024-09-13T18:22:01.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.396+0000 7fa751335640 1 -- start start 2024-09-13T18:22:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.396+0000 7fa751335640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0fe050 0x7fa74c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.396+0000 7fa751335640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c19b7f0 con 0x7fa74c0fe050 2024-09-13T18:22:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.397+0000 7fa74affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0fe050 0x7fa74c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.397+0000 7fa74affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0fe050 0x7fa74c19b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52196/0 (socket says 172.21.15.38:52196) 2024-09-13T18:22:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.397+0000 7fa74affd640 1 -- 172.21.15.38:0/1242451389 learned_addr learned my addr 172.21.15.38:0/1242451389 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:22:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.397+0000 7fa74affd640 1 -- 172.21.15.38:0/1242451389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c009560 con 0x7fa74c0fe050 2024-09-13T18:22:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.397+0000 7fa74affd640 1 --2- 172.21.15.38:0/1242451389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0fe050 0x7fa74c19b2b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0099a0 tx=0x7fa73c005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.397+0000 7fa733fff640 1 -- 172.21.15.38:0/1242451389 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa73c004c00 con 0x7fa74c0fe050 2024-09-13T18:22:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.397+0000 7fa733fff640 1 -- 172.21.15.38:0/1242451389 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa73c004d60 con 0x7fa74c0fe050 2024-09-13T18:22:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.397+0000 7fa751335640 1 -- 172.21.15.38:0/1242451389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c19b9f0 con 0x7fa74c0fe050 2024-09-13T18:22:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.397+0000 7fa733fff640 1 -- 172.21.15.38:0/1242451389 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa73c031980 con 0x7fa74c0fe050 2024-09-13T18:22:01.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.397+0000 7fa751335640 1 -- 172.21.15.38:0/1242451389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c19be90 con 0x7fa74c0fe050 2024-09-13T18:22:01.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.398+0000 7fa733fff640 1 -- 172.21.15.38:0/1242451389 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fa73c031c00 con 0x7fa74c0fe050 2024-09-13T18:22:01.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.398+0000 7fa733fff640 1 --2- 172.21.15.38:0/1242451389 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fa734038740 0x7fa73403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:01.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.398+0000 7fa751335640 1 -- 172.21.15.38:0/1242451389 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74c0fe450 con 0x7fa74c0fe050 2024-09-13T18:22:01.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.399+0000 7fa733fff640 1 -- 172.21.15.38:0/1242451389 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa73c06c610 con 0x7fa74c0fe050 2024-09-13T18:22:01.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.399+0000 7fa74a7fc640 1 --2- 172.21.15.38:0/1242451389 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fa734038740 0x7fa73403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:01.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.399+0000 7fa74a7fc640 1 --2- 172.21.15.38:0/1242451389 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fa734038740 0x7fa73403ac00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa7400098c0 tx=0x7fa740006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:01.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.403+0000 7fa733fff640 1 -- 172.21.15.38:0/1242451389 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa73c04d350 con 0x7fa74c0fe050 2024-09-13T18:22:01.592 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.589+0000 7fa751335640 1 -- 172.21.15.38:0/1242451389 --> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fa74c02c450 con 0x7fa734038740 2024-09-13T18:22:01.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.593+0000 7fa733fff640 1 -- 172.21.15.38:0/1242451389 <== mgr.14162 v2:172.21.15.38:6800/1869434741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa74c02c450 con 0x7fa734038740 2024-09-13T18:22:01.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.595+0000 7fa751335640 1 -- 172.21.15.38:0/1242451389 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fa734038740 msgr2=0x7fa73403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.595+0000 7fa751335640 1 --2- 172.21.15.38:0/1242451389 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fa734038740 0x7fa73403ac00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa7400098c0 tx=0x7fa740006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.595+0000 7fa751335640 1 -- 172.21.15.38:0/1242451389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0fe050 msgr2=0x7fa74c19b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.595+0000 7fa751335640 1 --2- 172.21.15.38:0/1242451389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0fe050 0x7fa74c19b2b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0099a0 tx=0x7fa73c005690 comp rx=0 tx=0).stop 2024-09-13T18:22:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.595+0000 7fa751335640 1 -- 172.21.15.38:0/1242451389 shutdown_connections 2024-09-13T18:22:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.595+0000 7fa751335640 1 --2- 172.21.15.38:0/1242451389 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fa734038740 0x7fa73403ac00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.595+0000 7fa751335640 1 --2- 172.21.15.38:0/1242451389 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa74c0fe050 0x7fa74c19b2b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.595+0000 7fa751335640 1 -- 172.21.15.38:0/1242451389 >> 172.21.15.38:0/1242451389 conn(0x7fa74c0f9e80 msgr2=0x7fa74c0fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.595+0000 7fa751335640 1 -- 172.21.15.38:0/1242451389 shutdown_connections 2024-09-13T18:22:01.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:01.595+0000 7fa751335640 1 -- 172.21.15.38:0/1242451389 wait complete. 2024-09-13T18:22:02.336 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi149 2024-09-13T18:22:02.336 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:22:02.336 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/etc/ceph/ceph.conf 2024-09-13T18:22:02.356 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:22:02.356 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:22:02.417 INFO:tasks.cephadm:Adding host smithi149 to orchestrator... 2024-09-13T18:22:02.417 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph orch host add smithi149 2024-09-13T18:22:02.634 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:22:02.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:02 smithi038 ceph-mon[27689]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:22:02.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:02 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:02.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:02 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:02.867 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:02 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:03.700 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:03 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:03.700 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:03 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:03.700 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:03 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T18:22:03.700 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:03 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T18:22:03.700 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:03 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:22:03.701 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:03 smithi038 ceph-mon[27689]: Deploying daemon crash.smithi038 on smithi038 2024-09-13T18:22:05.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.186+0000 7f5a1e027640 1 -- 172.21.15.38:0/2275086324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a18100300 msgr2=0x7f5a181026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.186+0000 7f5a1e027640 1 --2- 172.21.15.38:0/2275086324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a18100300 0x7f5a181026f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009880 tx=0x7f5a0802a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.186+0000 7f5a1e027640 1 -- 172.21.15.38:0/2275086324 shutdown_connections 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.186+0000 7f5a1e027640 1 --2- 172.21.15.38:0/2275086324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a18100300 0x7f5a181026f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.186+0000 7f5a1e027640 1 -- 172.21.15.38:0/2275086324 >> 172.21.15.38:0/2275086324 conn(0x7f5a180f9e80 msgr2=0x7f5a180fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.186+0000 7f5a1e027640 1 -- 172.21.15.38:0/2275086324 shutdown_connections 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.186+0000 7f5a1e027640 1 -- 172.21.15.38:0/2275086324 wait complete. 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.187+0000 7f5a1e027640 1 Processor -- start 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.187+0000 7f5a1e027640 1 -- start start 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.187+0000 7f5a1e027640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a18100300 0x7f5a180ffb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.187+0000 7f5a1e027640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a181000c0 con 0x7f5a18100300 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.187+0000 7f5a177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a18100300 0x7f5a180ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.187+0000 7f5a177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a18100300 0x7f5a180ffb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36630/0 (socket says 172.21.15.38:36630) 2024-09-13T18:22:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.187+0000 7f5a177fe640 1 -- 172.21.15.38:0/1828040590 learned_addr learned my addr 172.21.15.38:0/1828040590 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:22:05.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.188+0000 7f5a177fe640 1 -- 172.21.15.38:0/1828040590 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a08009560 con 0x7f5a18100300 2024-09-13T18:22:05.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.188+0000 7f5a177fe640 1 --2- 172.21.15.38:0/1828040590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a18100300 0x7f5a180ffb80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5a080099a0 tx=0x7f5a08005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:05.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.188+0000 7f5a14ff9640 1 -- 172.21.15.38:0/1828040590 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a08004c00 con 0x7f5a18100300 2024-09-13T18:22:05.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.188+0000 7f5a1e027640 1 -- 172.21.15.38:0/1828040590 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a180fe2b0 con 0x7f5a18100300 2024-09-13T18:22:05.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.188+0000 7f5a1e027640 1 -- 172.21.15.38:0/1828040590 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a180fe750 con 0x7f5a18100300 2024-09-13T18:22:05.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.188+0000 7f5a14ff9640 1 -- 172.21.15.38:0/1828040590 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5a08004d60 con 0x7f5a18100300 2024-09-13T18:22:05.192 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.188+0000 7f5a14ff9640 1 -- 172.21.15.38:0/1828040590 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a08031980 con 0x7f5a18100300 2024-09-13T18:22:05.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.190+0000 7f5a1e027640 1 -- 172.21.15.38:0/1828040590 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a04005280 con 0x7f5a18100300 2024-09-13T18:22:05.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.190+0000 7f5a14ff9640 1 -- 172.21.15.38:0/1828040590 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f5a08031bd0 con 0x7f5a18100300 2024-09-13T18:22:05.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.190+0000 7f5a14ff9640 1 --2- 172.21.15.38:0/1828040590 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f5a00038790 0x7f5a0003ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:05.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.190+0000 7f5a14ff9640 1 -- 172.21.15.38:0/1828040590 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5a0806c520 con 0x7f5a18100300 2024-09-13T18:22:05.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.190+0000 7f5a16ffd640 1 --2- 172.21.15.38:0/1828040590 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f5a00038790 0x7f5a0003ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:05.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.191+0000 7f5a16ffd640 1 --2- 172.21.15.38:0/1828040590 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f5a00038790 0x7f5a0003ac50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0098c0 tx=0x7f5a0c006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:05.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.197+0000 7f5a14ff9640 1 -- 172.21.15.38:0/1828040590 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5a0804d350 con 0x7f5a18100300 2024-09-13T18:22:05.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:05.379+0000 7f5a1e027640 1 -- 172.21.15.38:0/1828040590 --> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi149", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a04000bf0 con 0x7f5a00038790 2024-09-13T18:22:05.680 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:05 smithi038 ceph-mon[27689]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi149", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:22:05.681 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:05 smithi038 ceph-mon[27689]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:05.681 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:05 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:07.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:06 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:07.695 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:06 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:07.695 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:06 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:07.695 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:06 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:07.695 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:06 smithi038 ceph-mon[27689]: Deploying daemon node-exporter.smithi038 on smithi038 2024-09-13T18:22:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:07 smithi038 ceph-mon[27689]: Deploying cephadm binary to smithi149 2024-09-13T18:22:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:07 smithi038 ceph-mon[27689]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:08.953 INFO:teuthology.orchestra.run.smithi038.stdout:Added host 'smithi149' with addr '172.21.15.149' 2024-09-13T18:22:08.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:08.949+0000 7f5a14ff9640 1 -- 172.21.15.38:0/1828040590 <== mgr.14162 v2:172.21.15.38:6800/1869434741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5a04000bf0 con 0x7f5a00038790 2024-09-13T18:22:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:08.951+0000 7f5a1e027640 1 -- 172.21.15.38:0/1828040590 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f5a00038790 msgr2=0x7f5a0003ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:08.951+0000 7f5a1e027640 1 --2- 172.21.15.38:0/1828040590 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f5a00038790 0x7f5a0003ac50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0098c0 tx=0x7f5a0c006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:08.952+0000 7f5a1e027640 1 -- 172.21.15.38:0/1828040590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a18100300 msgr2=0x7f5a180ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:08.952+0000 7f5a1e027640 1 --2- 172.21.15.38:0/1828040590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a18100300 0x7f5a180ffb80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5a080099a0 tx=0x7f5a08005690 comp rx=0 tx=0).stop 2024-09-13T18:22:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:08.952+0000 7f5a1e027640 1 -- 172.21.15.38:0/1828040590 shutdown_connections 2024-09-13T18:22:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:08.952+0000 7f5a1e027640 1 --2- 172.21.15.38:0/1828040590 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f5a00038790 0x7f5a0003ac50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:08.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:08.952+0000 7f5a1e027640 1 --2- 172.21.15.38:0/1828040590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a18100300 0x7f5a180ffb80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:08.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:08.952+0000 7f5a1e027640 1 -- 172.21.15.38:0/1828040590 >> 172.21.15.38:0/1828040590 conn(0x7f5a180f9e80 msgr2=0x7f5a180fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:08.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:08.952+0000 7f5a1e027640 1 -- 172.21.15.38:0/1828040590 shutdown_connections 2024-09-13T18:22:08.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:08.952+0000 7f5a1e027640 1 -- 172.21.15.38:0/1828040590 wait complete. 2024-09-13T18:22:09.972 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T18:22:10.186 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:22:10.308 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:09 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:10.308 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:09 smithi038 ceph-mon[27689]: Added host smithi149 2024-09-13T18:22:10.308 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:09 smithi038 ceph-mon[27689]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:10.308 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:09 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:10.308 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:09 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:10.308 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:09 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:10.308 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:09 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:11.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:10 smithi038 ceph-mon[27689]: Deploying daemon alertmanager.smithi038 on smithi038 2024-09-13T18:22:11.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:10 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:12.235 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:11 smithi038 ceph-mon[27689]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:12.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.233+0000 7f790b5d8640 1 -- 172.21.15.38:0/2251311361 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79040fe6d0 msgr2=0x7f79040fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:12.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.233+0000 7f790b5d8640 1 --2- 172.21.15.38:0/2251311361 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79040fe6d0 0x7f79040fead0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7900009880 tx=0x7f790002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:12.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.233+0000 7f790b5d8640 1 -- 172.21.15.38:0/2251311361 shutdown_connections 2024-09-13T18:22:12.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.233+0000 7f790b5d8640 1 --2- 172.21.15.38:0/2251311361 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79040fe6d0 0x7f79040fead0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:12.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.233+0000 7f790b5d8640 1 -- 172.21.15.38:0/2251311361 >> 172.21.15.38:0/2251311361 conn(0x7f79040f9e80 msgr2=0x7f79040fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:12.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.233+0000 7f790b5d8640 1 -- 172.21.15.38:0/2251311361 shutdown_connections 2024-09-13T18:22:12.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.233+0000 7f790b5d8640 1 -- 172.21.15.38:0/2251311361 wait complete. 2024-09-13T18:22:12.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.234+0000 7f790b5d8640 1 Processor -- start 2024-09-13T18:22:12.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.234+0000 7f790b5d8640 1 -- start start 2024-09-13T18:22:12.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.234+0000 7f790b5d8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79040fe6d0 0x7f7904196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:12.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.234+0000 7f790b5d8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79041973c0 con 0x7f79040fe6d0 2024-09-13T18:22:12.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.234+0000 7f7909374640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79040fe6d0 0x7f7904196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:12.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.234+0000 7f7909374640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79040fe6d0 0x7f7904196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42734/0 (socket says 172.21.15.38:42734) 2024-09-13T18:22:12.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.234+0000 7f7909374640 1 -- 172.21.15.38:0/1623737802 learned_addr learned my addr 172.21.15.38:0/1623737802 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.234+0000 7f7909374640 1 -- 172.21.15.38:0/1623737802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900009560 con 0x7f79040fe6d0 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.234+0000 7f7909374640 1 --2- 172.21.15.38:0/1623737802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79040fe6d0 0x7f7904196e80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f79000055c0 tx=0x7f79000055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.235+0000 7f78fa7fc640 1 -- 172.21.15.38:0/1623737802 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7900004b20 con 0x7f79040fe6d0 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.235+0000 7f78fa7fc640 1 -- 172.21.15.38:0/1623737802 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7900004c80 con 0x7f79040fe6d0 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.235+0000 7f790b5d8640 1 -- 172.21.15.38:0/1623737802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79041975c0 con 0x7f79040fe6d0 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.235+0000 7f78fa7fc640 1 -- 172.21.15.38:0/1623737802 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79000318a0 con 0x7f79040fe6d0 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.235+0000 7f790b5d8640 1 -- 172.21.15.38:0/1623737802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7904197a60 con 0x7f79040fe6d0 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.236+0000 7f78fa7fc640 1 -- 172.21.15.38:0/1623737802 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f7900031b60 con 0x7f79040fe6d0 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.236+0000 7f790b5d8640 1 -- 172.21.15.38:0/1623737802 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79040fead0 con 0x7f79040fe6d0 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.236+0000 7f78fa7fc640 1 --2- 172.21.15.38:0/1623737802 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f78f0038740 0x7f78f003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.236+0000 7f78fa7fc640 1 -- 172.21.15.38:0/1623737802 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f790006c400 con 0x7f79040fe6d0 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.236+0000 7f7908b73640 1 --2- 172.21.15.38:0/1623737802 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f78f0038740 0x7f78f003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.236+0000 7f7908b73640 1 --2- 172.21.15.38:0/1623737802 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f78f0038740 0x7f78f003ac00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f78f40098c0 tx=0x7f78f4006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:12.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.241+0000 7f78fa7fc640 1 -- 172.21.15.38:0/1623737802 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f790004d530 con 0x7f79040fe6d0 2024-09-13T18:22:12.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.455+0000 7f790b5d8640 1 -- 172.21.15.38:0/1623737802 --> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f790402c450 con 0x7f78f0038740 2024-09-13T18:22:12.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.457+0000 7f78fa7fc640 1 -- 172.21.15.38:0/1623737802 <== mgr.14162 v2:172.21.15.38:6800/1869434741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f790402c450 con 0x7f78f0038740 2024-09-13T18:22:12.459 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:22:12.459 INFO:teuthology.orchestra.run.smithi038.stdout:[{"addr": "172.21.15.38", "hostname": "smithi038", "labels": [], "status": ""}, {"addr": "172.21.15.149", "hostname": "smithi149", "labels": [], "status": ""}] 2024-09-13T18:22:12.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.459+0000 7f790b5d8640 1 -- 172.21.15.38:0/1623737802 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f78f0038740 msgr2=0x7f78f003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:12.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.459+0000 7f790b5d8640 1 --2- 172.21.15.38:0/1623737802 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f78f0038740 0x7f78f003ac00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f78f40098c0 tx=0x7f78f4006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:12.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.459+0000 7f790b5d8640 1 -- 172.21.15.38:0/1623737802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79040fe6d0 msgr2=0x7f7904196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:12.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.459+0000 7f790b5d8640 1 --2- 172.21.15.38:0/1623737802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79040fe6d0 0x7f7904196e80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f79000055c0 tx=0x7f79000055f0 comp rx=0 tx=0).stop 2024-09-13T18:22:12.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.459+0000 7f790b5d8640 1 -- 172.21.15.38:0/1623737802 shutdown_connections 2024-09-13T18:22:12.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.459+0000 7f790b5d8640 1 --2- 172.21.15.38:0/1623737802 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f78f0038740 0x7f78f003ac00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:12.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.459+0000 7f790b5d8640 1 --2- 172.21.15.38:0/1623737802 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f79040fe6d0 0x7f7904196e80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:12.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.459+0000 7f790b5d8640 1 -- 172.21.15.38:0/1623737802 >> 172.21.15.38:0/1623737802 conn(0x7f79040f9e80 msgr2=0x7f7904067fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:12.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.459+0000 7f790b5d8640 1 -- 172.21.15.38:0/1623737802 shutdown_connections 2024-09-13T18:22:12.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:12.459+0000 7f790b5d8640 1 -- 172.21.15.38:0/1623737802 wait complete. 2024-09-13T18:22:13.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:12 smithi038 ceph-mon[27689]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:22:13.918 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T18:22:13.918 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T18:22:14.120 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:22:14.241 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:13 smithi038 ceph-mon[27689]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:16.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:15 smithi038 ceph-mon[27689]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:17.717 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:17 smithi038 ceph-mon[27689]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:18.744 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:18 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3312323407' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T18:22:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.367+0000 7f7117481640 1 -- 172.21.15.38:0/1771911859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71100ff7e0 msgr2=0x7f71100ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.367+0000 7f7117481640 1 --2- 172.21.15.38:0/1771911859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71100ff7e0 0x7f71100ffbe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f710c009880 tx=0x7f710c02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.367+0000 7f7117481640 1 -- 172.21.15.38:0/1771911859 shutdown_connections 2024-09-13T18:22:18.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.367+0000 7f7117481640 1 --2- 172.21.15.38:0/1771911859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71100ff7e0 0x7f71100ffbe0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.367+0000 7f7117481640 1 -- 172.21.15.38:0/1771911859 >> 172.21.15.38:0/1771911859 conn(0x7f71100faf90 msgr2=0x7f71100fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.367+0000 7f7117481640 1 -- 172.21.15.38:0/1771911859 shutdown_connections 2024-09-13T18:22:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.367+0000 7f7117481640 1 -- 172.21.15.38:0/1771911859 wait complete. 2024-09-13T18:22:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.368+0000 7f7117481640 1 Processor -- start 2024-09-13T18:22:18.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.368+0000 7f7117481640 1 -- start start 2024-09-13T18:22:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.368+0000 7f7117481640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71100ff7e0 0x7f7110194be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.369+0000 7f7117481640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7110195120 con 0x7f71100ff7e0 2024-09-13T18:22:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.369+0000 7f711521d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71100ff7e0 0x7f7110194be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.369+0000 7f711521d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71100ff7e0 0x7f7110194be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42740/0 (socket says 172.21.15.38:42740) 2024-09-13T18:22:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.369+0000 7f711521d640 1 -- 172.21.15.38:0/3312323407 learned_addr learned my addr 172.21.15.38:0/3312323407 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:22:18.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.369+0000 7f711521d640 1 -- 172.21.15.38:0/3312323407 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c009560 con 0x7f71100ff7e0 2024-09-13T18:22:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.369+0000 7f711521d640 1 --2- 172.21.15.38:0/3312323407 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71100ff7e0 0x7f7110194be0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f710c004cf0 tx=0x7f710c004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.369+0000 7f71067fc640 1 -- 172.21.15.38:0/3312323407 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f710c0053f0 con 0x7f71100ff7e0 2024-09-13T18:22:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.369+0000 7f7117481640 1 -- 172.21.15.38:0/3312323407 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7110195320 con 0x7f71100ff7e0 2024-09-13T18:22:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.369+0000 7f71067fc640 1 -- 172.21.15.38:0/3312323407 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f710c005550 con 0x7f71100ff7e0 2024-09-13T18:22:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.369+0000 7f71067fc640 1 -- 172.21.15.38:0/3312323407 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f710c0319c0 con 0x7f71100ff7e0 2024-09-13T18:22:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.369+0000 7f7117481640 1 -- 172.21.15.38:0/3312323407 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71101957c0 con 0x7f71100ff7e0 2024-09-13T18:22:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.370+0000 7f71067fc640 1 -- 172.21.15.38:0/3312323407 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f710c031c30 con 0x7f71100ff7e0 2024-09-13T18:22:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.370+0000 7f7117481640 1 -- 172.21.15.38:0/3312323407 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71100ffbe0 con 0x7f71100ff7e0 2024-09-13T18:22:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.370+0000 7f71067fc640 1 --2- 172.21.15.38:0/3312323407 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f70fc038740 0x7f70fc03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.370+0000 7f71067fc640 1 -- 172.21.15.38:0/3312323407 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f710c06c500 con 0x7f71100ff7e0 2024-09-13T18:22:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.371+0000 7f7114a1c640 1 --2- 172.21.15.38:0/3312323407 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f70fc038740 0x7f70fc03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.371+0000 7f7114a1c640 1 --2- 172.21.15.38:0/3312323407 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f70fc038740 0x7f70fc03ac00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f71000098c0 tx=0x7f7100006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.375+0000 7f71067fc640 1 -- 172.21.15.38:0/3312323407 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f710c04dc90 con 0x7f71100ff7e0 2024-09-13T18:22:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.553+0000 7f7117481640 1 -- 172.21.15.38:0/3312323407 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f711002c3e0 con 0x7f71100ff7e0 2024-09-13T18:22:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.630+0000 7f71067fc640 1 -- 172.21.15.38:0/3312323407 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f710c035020 con 0x7f71100ff7e0 2024-09-13T18:22:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2024-09-13T18:22:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.632+0000 7f7117481640 1 -- 172.21.15.38:0/3312323407 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f70fc038740 msgr2=0x7f70fc03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.632+0000 7f7117481640 1 --2- 172.21.15.38:0/3312323407 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f70fc038740 0x7f70fc03ac00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f71000098c0 tx=0x7f7100006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:18.927 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.632+0000 7f7117481640 1 -- 172.21.15.38:0/3312323407 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71100ff7e0 msgr2=0x7f7110194be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:18.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.632+0000 7f7117481640 1 --2- 172.21.15.38:0/3312323407 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71100ff7e0 0x7f7110194be0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f710c004cf0 tx=0x7f710c004d20 comp rx=0 tx=0).stop 2024-09-13T18:22:18.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.632+0000 7f7117481640 1 -- 172.21.15.38:0/3312323407 shutdown_connections 2024-09-13T18:22:18.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.632+0000 7f7117481640 1 --2- 172.21.15.38:0/3312323407 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f70fc038740 0x7f70fc03ac00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:18.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.632+0000 7f7117481640 1 --2- 172.21.15.38:0/3312323407 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f71100ff7e0 0x7f7110194be0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:18.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.632+0000 7f7117481640 1 -- 172.21.15.38:0/3312323407 >> 172.21.15.38:0/3312323407 conn(0x7f71100faf90 msgr2=0x7f71100fb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:18.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.632+0000 7f7117481640 1 -- 172.21.15.38:0/3312323407 shutdown_connections 2024-09-13T18:22:18.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:22:18.632+0000 7f7117481640 1 -- 172.21.15.38:0/3312323407 wait complete. 2024-09-13T18:22:19.614 INFO:tasks.cephadm:Adding mon.smithi038 on smithi038 2024-09-13T18:22:19.614 INFO:tasks.cephadm:Adding mon.smithi149 on smithi149 2024-09-13T18:22:19.614 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi038:172.21.15.38=smithi038;smithi149:172.21.15.149=smithi149' 2024-09-13T18:22:19.809 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:19.852 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:19.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:19 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3312323407' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T18:22:19.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:19 smithi038 ceph-mon[27689]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T18:22:19.902 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:19 smithi038 ceph-mon[27689]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:21.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.389+0000 7fbdef89d640 1 -- 172.21.15.149:0/2352513766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbde80744e0 msgr2=0x7fbde8072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:21.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.389+0000 7fbdef89d640 1 --2- 172.21.15.149:0/2352513766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbde80744e0 0x7fbde8072940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbde4009880 tx=0x7fbde402a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:21.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.389+0000 7fbdef89d640 1 -- 172.21.15.149:0/2352513766 shutdown_connections 2024-09-13T18:22:21.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.389+0000 7fbdef89d640 1 --2- 172.21.15.149:0/2352513766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbde80744e0 0x7fbde8072940 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:21.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.389+0000 7fbdef89d640 1 -- 172.21.15.149:0/2352513766 >> 172.21.15.149:0/2352513766 conn(0x7fbde80faf90 msgr2=0x7fbde80fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:21.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.389+0000 7fbdef89d640 1 -- 172.21.15.149:0/2352513766 shutdown_connections 2024-09-13T18:22:21.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.389+0000 7fbdef89d640 1 -- 172.21.15.149:0/2352513766 wait complete. 2024-09-13T18:22:21.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.390+0000 7fbdef89d640 1 Processor -- start 2024-09-13T18:22:21.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.390+0000 7fbdef89d640 1 -- start start 2024-09-13T18:22:21.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.390+0000 7fbdef89d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbde80744e0 0x7fbde819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:21.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.390+0000 7fbdef89d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde819b6f0 con 0x7fbde80744e0 2024-09-13T18:22:21.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.390+0000 7fbded639640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbde80744e0 0x7fbde819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.390+0000 7fbded639640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbde80744e0 0x7fbde819b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:44904/0 (socket says 172.21.15.149:44904) 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.390+0000 7fbded639640 1 -- 172.21.15.149:0/3421046832 learned_addr learned my addr 172.21.15.149:0/3421046832 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.391+0000 7fbded639640 1 -- 172.21.15.149:0/3421046832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde4009560 con 0x7fbde80744e0 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.391+0000 7fbded639640 1 --2- 172.21.15.149:0/3421046832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbde80744e0 0x7fbde819b1b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbde402aaf0 tx=0x7fbde4004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.391+0000 7fbdde7fc640 1 -- 172.21.15.149:0/3421046832 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbde4005440 con 0x7fbde80744e0 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.391+0000 7fbdde7fc640 1 -- 172.21.15.149:0/3421046832 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbde40055a0 con 0x7fbde80744e0 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.391+0000 7fbdef89d640 1 -- 172.21.15.149:0/3421046832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde819b8f0 con 0x7fbde80744e0 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.391+0000 7fbdde7fc640 1 -- 172.21.15.149:0/3421046832 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbde4031ac0 con 0x7fbde80744e0 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.391+0000 7fbdef89d640 1 -- 172.21.15.149:0/3421046832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde819bd90 con 0x7fbde80744e0 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.392+0000 7fbdde7fc640 1 -- 172.21.15.149:0/3421046832 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fbde4031cc0 con 0x7fbde80744e0 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.392+0000 7fbdef89d640 1 -- 172.21.15.149:0/3421046832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde8072940 con 0x7fbde80744e0 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.392+0000 7fbdde7fc640 1 --2- 172.21.15.149:0/3421046832 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fbdd4038740 0x7fbdd403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:21.395 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.392+0000 7fbdde7fc640 1 -- 172.21.15.149:0/3421046832 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbde406c490 con 0x7fbde80744e0 2024-09-13T18:22:21.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.392+0000 7fbdece38640 1 --2- 172.21.15.149:0/3421046832 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fbdd4038740 0x7fbdd403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:21.396 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.393+0000 7fbdece38640 1 --2- 172.21.15.149:0/3421046832 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fbdd4038740 0x7fbdd403ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80098c0 tx=0x7fbdd8006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:21.399 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.397+0000 7fbdde7fc640 1 -- 172.21.15.149:0/3421046832 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbde403a7d0 con 0x7fbde80744e0 2024-09-13T18:22:21.573 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.571+0000 7fbdef89d640 1 -- 172.21.15.149:0/3421046832 --> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi038:172.21.15.38=smithi038;smithi149:172.21.15.149=smithi149", "target": ["mon-mgr", ""]}) v1 -- 0x7fbde802c500 con 0x7fbdd4038740 2024-09-13T18:22:21.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.579+0000 7fbdde7fc640 1 -- 172.21.15.149:0/3421046832 <== mgr.14162 v2:172.21.15.38:6800/1869434741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fbde802c500 con 0x7fbdd4038740 2024-09-13T18:22:21.581 INFO:teuthology.orchestra.run.smithi149.stdout:Scheduled mon update... 2024-09-13T18:22:21.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.580+0000 7fbdef89d640 1 -- 172.21.15.149:0/3421046832 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fbdd4038740 msgr2=0x7fbdd403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:21.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.580+0000 7fbdef89d640 1 --2- 172.21.15.149:0/3421046832 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fbdd4038740 0x7fbdd403ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80098c0 tx=0x7fbdd8006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:21.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.580+0000 7fbdef89d640 1 -- 172.21.15.149:0/3421046832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbde80744e0 msgr2=0x7fbde819b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:21.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.580+0000 7fbdef89d640 1 --2- 172.21.15.149:0/3421046832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbde80744e0 0x7fbde819b1b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbde402aaf0 tx=0x7fbde4004da0 comp rx=0 tx=0).stop 2024-09-13T18:22:21.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.581+0000 7fbdef89d640 1 -- 172.21.15.149:0/3421046832 shutdown_connections 2024-09-13T18:22:21.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.581+0000 7fbdef89d640 1 --2- 172.21.15.149:0/3421046832 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fbdd4038740 0x7fbdd403ac00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:21.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.581+0000 7fbdef89d640 1 --2- 172.21.15.149:0/3421046832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbde80744e0 0x7fbde819b1b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:21.583 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.581+0000 7fbdef89d640 1 -- 172.21.15.149:0/3421046832 >> 172.21.15.149:0/3421046832 conn(0x7fbde80faf90 msgr2=0x7fbde80fb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:21.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.581+0000 7fbdef89d640 1 -- 172.21.15.149:0/3421046832 shutdown_connections 2024-09-13T18:22:21.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:21.581+0000 7fbdef89d640 1 -- 172.21.15.149:0/3421046832 wait complete. 2024-09-13T18:22:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-13T18:22:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T18:22:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T18:22:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: Deploying daemon grafana.smithi038 on smithi038 2024-09-13T18:22:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:21 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:22.156 DEBUG:teuthology.orchestra.run.smithi149:mon.smithi149> sudo journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi149.service 2024-09-13T18:22:22.158 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:22:22.159 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:22:22.389 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:22.433 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:22.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:22 smithi038 ceph-mon[27689]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi038:172.21.15.38=smithi038;smithi149:172.21.15.149=smithi149", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:22:22.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:22 smithi038 ceph-mon[27689]: Saving service mon spec with placement smithi038:172.21.15.38=smithi038;smithi149:172.21.15.149=smithi149;count:2 2024-09-13T18:22:23.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.911+0000 7fb22c85c640 1 -- 172.21.15.149:0/3323247377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2280fe6d0 msgr2=0x7fb2280fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:23.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.911+0000 7fb22c85c640 1 --2- 172.21.15.149:0/3323247377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2280fe6d0 0x7fb2280fead0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb218009880 tx=0x7fb21802a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:23.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.911+0000 7fb22c85c640 1 -- 172.21.15.149:0/3323247377 shutdown_connections 2024-09-13T18:22:23.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.911+0000 7fb22c85c640 1 --2- 172.21.15.149:0/3323247377 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2280fe6d0 0x7fb2280fead0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:23.918 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.911+0000 7fb22c85c640 1 -- 172.21.15.149:0/3323247377 >> 172.21.15.149:0/3323247377 conn(0x7fb2280f9e80 msgr2=0x7fb2280fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.911+0000 7fb22c85c640 1 -- 172.21.15.149:0/3323247377 shutdown_connections 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.911+0000 7fb22c85c640 1 -- 172.21.15.149:0/3323247377 wait complete. 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.911+0000 7fb22c85c640 1 Processor -- start 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.912+0000 7fb22c85c640 1 -- start start 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.912+0000 7fb22c85c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2280fe6d0 0x7fb228194c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.912+0000 7fb22c85c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2281951c0 con 0x7fb2280fe6d0 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.912+0000 7fb22659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2280fe6d0 0x7fb228194c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.912+0000 7fb22659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2280fe6d0 0x7fb228194c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:44934/0 (socket says 172.21.15.149:44934) 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.912+0000 7fb22659c640 1 -- 172.21.15.149:0/3169322582 learned_addr learned my addr 172.21.15.149:0/3169322582 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.912+0000 7fb22659c640 1 -- 172.21.15.149:0/3169322582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb218009560 con 0x7fb2280fe6d0 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.912+0000 7fb22659c640 1 --2- 172.21.15.149:0/3169322582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2280fe6d0 0x7fb228194c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb2180055c0 tx=0x7fb2180055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.913+0000 7fb21f7fe640 1 -- 172.21.15.149:0/3169322582 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb218004b20 con 0x7fb2280fe6d0 2024-09-13T18:22:23.919 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.913+0000 7fb21f7fe640 1 -- 172.21.15.149:0/3169322582 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb218004c80 con 0x7fb2280fe6d0 2024-09-13T18:22:23.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.913+0000 7fb22c85c640 1 -- 172.21.15.149:0/3169322582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2281953c0 con 0x7fb2280fe6d0 2024-09-13T18:22:23.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.913+0000 7fb21f7fe640 1 -- 172.21.15.149:0/3169322582 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2180318a0 con 0x7fb2280fe6d0 2024-09-13T18:22:23.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.913+0000 7fb22c85c640 1 -- 172.21.15.149:0/3169322582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb228195860 con 0x7fb2280fe6d0 2024-09-13T18:22:23.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.913+0000 7fb21f7fe640 1 -- 172.21.15.149:0/3169322582 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fb2180035f0 con 0x7fb2280fe6d0 2024-09-13T18:22:23.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.914+0000 7fb21d7fa640 1 -- 172.21.15.149:0/3169322582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2280fead0 con 0x7fb2280fe6d0 2024-09-13T18:22:23.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.914+0000 7fb21f7fe640 1 --2- 172.21.15.149:0/3169322582 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fb214038790 0x7fb21403ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:23.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.914+0000 7fb21f7fe640 1 -- 172.21.15.149:0/3169322582 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb21806c430 con 0x7fb2280fe6d0 2024-09-13T18:22:23.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.914+0000 7fb21ffff640 1 --2- 172.21.15.149:0/3169322582 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fb214038790 0x7fb21403ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:23.920 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.915+0000 7fb21ffff640 1 --2- 172.21.15.149:0/3169322582 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fb214038790 0x7fb21403ac50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb2100098c0 tx=0x7fb210006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:23.922 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:23.920+0000 7fb21f7fe640 1 -- 172.21.15.149:0/3169322582 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb21804dc90 con 0x7fb2280fe6d0 2024-09-13T18:22:24.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:23 smithi038 ceph-mon[27689]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:24.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:24.145+0000 7fb21d7fa640 1 -- 172.21.15.149:0/3169322582 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb2281046d0 con 0x7fb2280fe6d0 2024-09-13T18:22:24.148 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:24.146+0000 7fb21f7fe640 1 -- 172.21.15.149:0/3169322582 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb218035020 con 0x7fb2280fe6d0 2024-09-13T18:22:24.148 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:22:24.148 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:22:24.149 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:22:24.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:24.148+0000 7fb21d7fa640 1 -- 172.21.15.149:0/3169322582 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fb214038790 msgr2=0x7fb21403ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:24.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:24.148+0000 7fb21d7fa640 1 --2- 172.21.15.149:0/3169322582 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fb214038790 0x7fb21403ac50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb2100098c0 tx=0x7fb210006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:24.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:24.148+0000 7fb21d7fa640 1 -- 172.21.15.149:0/3169322582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2280fe6d0 msgr2=0x7fb228194c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:24.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:24.148+0000 7fb21d7fa640 1 --2- 172.21.15.149:0/3169322582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2280fe6d0 0x7fb228194c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb2180055c0 tx=0x7fb2180055f0 comp rx=0 tx=0).stop 2024-09-13T18:22:24.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:24.148+0000 7fb21d7fa640 1 -- 172.21.15.149:0/3169322582 shutdown_connections 2024-09-13T18:22:24.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:24.148+0000 7fb21d7fa640 1 --2- 172.21.15.149:0/3169322582 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fb214038790 0x7fb21403ac50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:24.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:24.148+0000 7fb21d7fa640 1 --2- 172.21.15.149:0/3169322582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2280fe6d0 0x7fb228194c80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:24.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:24.148+0000 7fb21d7fa640 1 -- 172.21.15.149:0/3169322582 >> 172.21.15.149:0/3169322582 conn(0x7fb2280f9e80 msgr2=0x7fb228067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:24.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:24.148+0000 7fb21d7fa640 1 -- 172.21.15.149:0/3169322582 shutdown_connections 2024-09-13T18:22:24.151 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:24.148+0000 7fb21d7fa640 1 -- 172.21.15.149:0/3169322582 wait complete. 2024-09-13T18:22:25.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:24 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/3169322582' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:22:25.730 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:22:25.730 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:22:25.925 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:25.968 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:26.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:25 smithi038 ceph-mon[27689]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:26.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:25 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:27.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.525+0000 7f7530c49640 1 -- 172.21.15.149:0/3181980718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f752c0fe6f0 msgr2=0x7f752c0feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:27.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.525+0000 7f7530c49640 1 --2- 172.21.15.149:0/3181980718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f752c0fe6f0 0x7f752c0feaf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f751c009880 tx=0x7f751c02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:27.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.525+0000 7f7530c49640 1 -- 172.21.15.149:0/3181980718 shutdown_connections 2024-09-13T18:22:27.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.525+0000 7f7530c49640 1 --2- 172.21.15.149:0/3181980718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f752c0fe6f0 0x7f752c0feaf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:27.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.525+0000 7f7530c49640 1 -- 172.21.15.149:0/3181980718 >> 172.21.15.149:0/3181980718 conn(0x7f752c0f9e80 msgr2=0x7f752c0fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:27.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.525+0000 7f7530c49640 1 -- 172.21.15.149:0/3181980718 shutdown_connections 2024-09-13T18:22:27.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.525+0000 7f7530c49640 1 -- 172.21.15.149:0/3181980718 wait complete. 2024-09-13T18:22:27.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.525+0000 7f7530c49640 1 Processor -- start 2024-09-13T18:22:27.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.526+0000 7f7530c49640 1 -- start start 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.526+0000 7f7530c49640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f752c0fe6f0 0x7f752c193af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.526+0000 7f7530c49640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c194030 con 0x7f752c0fe6f0 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.526+0000 7f752a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f752c0fe6f0 0x7f752c193af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.526+0000 7f752a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f752c0fe6f0 0x7f752c193af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:45932/0 (socket says 172.21.15.149:45932) 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.526+0000 7f752a59c640 1 -- 172.21.15.149:0/2858546889 learned_addr learned my addr 172.21.15.149:0/2858546889 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.526+0000 7f752a59c640 1 -- 172.21.15.149:0/2858546889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c009560 con 0x7f752c0fe6f0 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.526+0000 7f752a59c640 1 --2- 172.21.15.149:0/2858546889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f752c0fe6f0 0x7f752c193af0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f751c02aaf0 tx=0x7f751c004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.527+0000 7f75237fe640 1 -- 172.21.15.149:0/2858546889 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f751c005440 con 0x7f752c0fe6f0 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.527+0000 7f7530c49640 1 -- 172.21.15.149:0/2858546889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c194230 con 0x7f752c0fe6f0 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.527+0000 7f75237fe640 1 -- 172.21.15.149:0/2858546889 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f751c0055a0 con 0x7f752c0fe6f0 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.527+0000 7f7530c49640 1 -- 172.21.15.149:0/2858546889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c1946d0 con 0x7f752c0fe6f0 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.527+0000 7f75237fe640 1 -- 172.21.15.149:0/2858546889 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f751c031960 con 0x7f752c0fe6f0 2024-09-13T18:22:27.532 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.528+0000 7f75237fe640 1 -- 172.21.15.149:0/2858546889 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f751c0035f0 con 0x7f752c0fe6f0 2024-09-13T18:22:27.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.528+0000 7f7530c49640 1 -- 172.21.15.149:0/2858546889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c0feaf0 con 0x7f752c0fe6f0 2024-09-13T18:22:27.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.528+0000 7f75237fe640 1 --2- 172.21.15.149:0/2858546889 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f7518038740 0x7f751803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:27.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.528+0000 7f75237fe640 1 -- 172.21.15.149:0/2858546889 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f751c06c770 con 0x7f752c0fe6f0 2024-09-13T18:22:27.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.528+0000 7f7523fff640 1 --2- 172.21.15.149:0/2858546889 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f7518038740 0x7f751803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:27.533 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.529+0000 7f7523fff640 1 --2- 172.21.15.149:0/2858546889 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f7518038740 0x7f751803ac00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f75140098c0 tx=0x7f7514006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:27.536 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.534+0000 7f75237fe640 1 -- 172.21.15.149:0/2858546889 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f751c03b840 con 0x7f752c0fe6f0 2024-09-13T18:22:27.762 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.760+0000 7f7530c49640 1 -- 172.21.15.149:0/2858546889 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f752c02c3e0 con 0x7f752c0fe6f0 2024-09-13T18:22:27.763 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.760+0000 7f75237fe640 1 -- 172.21.15.149:0/2858546889 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f751c035070 con 0x7f752c0fe6f0 2024-09-13T18:22:27.763 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:22:27.763 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:22:27.763 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:22:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.762+0000 7f7530c49640 1 -- 172.21.15.149:0/2858546889 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f7518038740 msgr2=0x7f751803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.762+0000 7f7530c49640 1 --2- 172.21.15.149:0/2858546889 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f7518038740 0x7f751803ac00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f75140098c0 tx=0x7f7514006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.762+0000 7f7530c49640 1 -- 172.21.15.149:0/2858546889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f752c0fe6f0 msgr2=0x7f752c193af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.762+0000 7f7530c49640 1 --2- 172.21.15.149:0/2858546889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f752c0fe6f0 0x7f752c193af0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f751c02aaf0 tx=0x7f751c004da0 comp rx=0 tx=0).stop 2024-09-13T18:22:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.763+0000 7f7530c49640 1 -- 172.21.15.149:0/2858546889 shutdown_connections 2024-09-13T18:22:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.763+0000 7f7530c49640 1 --2- 172.21.15.149:0/2858546889 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f7518038740 0x7f751803ac00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.763+0000 7f7530c49640 1 --2- 172.21.15.149:0/2858546889 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f752c0fe6f0 0x7f752c193af0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.763+0000 7f7530c49640 1 -- 172.21.15.149:0/2858546889 >> 172.21.15.149:0/2858546889 conn(0x7f752c0f9e80 msgr2=0x7f752c0fa8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.763+0000 7f7530c49640 1 -- 172.21.15.149:0/2858546889 shutdown_connections 2024-09-13T18:22:27.765 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:27.763+0000 7f7530c49640 1 -- 172.21.15.149:0/2858546889 wait complete. 2024-09-13T18:22:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:27 smithi038 ceph-mon[27689]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:29.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:28 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/2858546889' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:22:29.309 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:22:29.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:22:29.504 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:29.548 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:30.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:29 smithi038 ceph-mon[27689]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:31.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.996+0000 7fe9a2978640 1 -- 172.21.15.149:0/2467343477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe99c0ff7e0 msgr2=0x7fe99c0ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:31.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.996+0000 7fe9a2978640 1 --2- 172.21.15.149:0/2467343477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe99c0ff7e0 0x7fe99c0ffbe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009880 tx=0x7fe98c02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:31.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.996+0000 7fe9a2978640 1 -- 172.21.15.149:0/2467343477 shutdown_connections 2024-09-13T18:22:31.026 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.996+0000 7fe9a2978640 1 --2- 172.21.15.149:0/2467343477 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe99c0ff7e0 0x7fe99c0ffbe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:31.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.996+0000 7fe9a2978640 1 -- 172.21.15.149:0/2467343477 >> 172.21.15.149:0/2467343477 conn(0x7fe99c0faf90 msgr2=0x7fe99c0fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:31.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.996+0000 7fe9a2978640 1 -- 172.21.15.149:0/2467343477 shutdown_connections 2024-09-13T18:22:31.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.996+0000 7fe9a2978640 1 -- 172.21.15.149:0/2467343477 wait complete. 2024-09-13T18:22:31.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.997+0000 7fe9a2978640 1 Processor -- start 2024-09-13T18:22:31.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.997+0000 7fe9a2978640 1 -- start start 2024-09-13T18:22:31.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.997+0000 7fe9a2978640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe99c0ff7e0 0x7fe99c074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:31.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.997+0000 7fe9a2978640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c0746b0 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.997+0000 7fe99bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe99c0ff7e0 0x7fe99c074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:31.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.998+0000 7fe99bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe99c0ff7e0 0x7fe99c074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:45956/0 (socket says 172.21.15.149:45956) 2024-09-13T18:22:31.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.998+0000 7fe99bfff640 1 -- 172.21.15.149:0/3516681832 learned_addr learned my addr 172.21.15.149:0/3516681832 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:22:31.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.998+0000 7fe99bfff640 1 -- 172.21.15.149:0/3516681832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c009560 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.998+0000 7fe99bfff640 1 --2- 172.21.15.149:0/3516681832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe99c0ff7e0 0x7fe99c074170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe98c02aaf0 tx=0x7fe98c004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:31.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.998+0000 7fe9997fa640 1 -- 172.21.15.149:0/3516681832 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe98c005440 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.998+0000 7fe9a2978640 1 -- 172.21.15.149:0/3516681832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c0728a0 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.998+0000 7fe9997fa640 1 -- 172.21.15.149:0/3516681832 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe98c0055a0 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.998+0000 7fe9997fa640 1 -- 172.21.15.149:0/3516681832 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe98c031ac0 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.998+0000 7fe9a2978640 1 -- 172.21.15.149:0/3516681832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c072d40 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.999+0000 7fe9a2978640 1 -- 172.21.15.149:0/3516681832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c105e90 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:30.999+0000 7fe9997fa640 1 -- 172.21.15.149:0/3516681832 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fe98c031cc0 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.000+0000 7fe9997fa640 1 --2- 172.21.15.149:0/3516681832 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fe988038740 0x7fe98803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:31.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.000+0000 7fe9997fa640 1 -- 172.21.15.149:0/3516681832 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe98c06c460 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.028 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.000+0000 7fe99b7fe640 1 --2- 172.21.15.149:0/3516681832 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fe988038740 0x7fe98803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:31.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.000+0000 7fe99b7fe640 1 --2- 172.21.15.149:0/3516681832 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fe988038740 0x7fe98803ac00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe9840098c0 tx=0x7fe984006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:31.029 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.005+0000 7fe9997fa640 1 -- 172.21.15.149:0/3516681832 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe98c03a5e0 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.230+0000 7fe9a2978640 1 -- 172.21.15.149:0/3516681832 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe99c0ffbe0 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.233 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.231+0000 7fe9997fa640 1 -- 172.21.15.149:0/3516681832 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fe98c035090 con 0x7fe99c0ff7e0 2024-09-13T18:22:31.233 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:22:31.233 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:22:31.234 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:22:31.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.233+0000 7fe9a2978640 1 -- 172.21.15.149:0/3516681832 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fe988038740 msgr2=0x7fe98803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:31.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.233+0000 7fe9a2978640 1 --2- 172.21.15.149:0/3516681832 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fe988038740 0x7fe98803ac00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe9840098c0 tx=0x7fe984006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:31.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.233+0000 7fe9a2978640 1 -- 172.21.15.149:0/3516681832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe99c0ff7e0 msgr2=0x7fe99c074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:31.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.233+0000 7fe9a2978640 1 --2- 172.21.15.149:0/3516681832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe99c0ff7e0 0x7fe99c074170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe98c02aaf0 tx=0x7fe98c004da0 comp rx=0 tx=0).stop 2024-09-13T18:22:31.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.233+0000 7fe9a2978640 1 -- 172.21.15.149:0/3516681832 shutdown_connections 2024-09-13T18:22:31.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.233+0000 7fe9a2978640 1 --2- 172.21.15.149:0/3516681832 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fe988038740 0x7fe98803ac00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:31.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.233+0000 7fe9a2978640 1 --2- 172.21.15.149:0/3516681832 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe99c0ff7e0 0x7fe99c074170 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:31.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.233+0000 7fe9a2978640 1 -- 172.21.15.149:0/3516681832 >> 172.21.15.149:0/3516681832 conn(0x7fe99c0faf90 msgr2=0x7fe99c0fb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:31.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.233+0000 7fe9a2978640 1 -- 172.21.15.149:0/3516681832 shutdown_connections 2024-09-13T18:22:31.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:31.233+0000 7fe9a2978640 1 -- 172.21.15.149:0/3516681832 wait complete. 2024-09-13T18:22:31.558 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:31 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/3516681832' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:22:32.569 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:32 smithi038 ceph-mon[27689]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:32.885 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:22:32.885 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:22:33.083 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:33.129 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:33 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:33 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:33 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:33 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:33 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:33 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:33 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:33.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:33 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:34.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.606+0000 7fb106419640 1 -- 172.21.15.149:0/3930091693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1000ff7e0 msgr2=0x7fb1000ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:34.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.606+0000 7fb106419640 1 --2- 172.21.15.149:0/3930091693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1000ff7e0 0x7fb1000ffbe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009880 tx=0x7fb0f002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:34.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.606+0000 7fb106419640 1 -- 172.21.15.149:0/3930091693 shutdown_connections 2024-09-13T18:22:34.610 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.606+0000 7fb106419640 1 --2- 172.21.15.149:0/3930091693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1000ff7e0 0x7fb1000ffbe0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:34.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.607+0000 7fb106419640 1 -- 172.21.15.149:0/3930091693 >> 172.21.15.149:0/3930091693 conn(0x7fb1000faf90 msgr2=0x7fb1000fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:34.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.607+0000 7fb106419640 1 -- 172.21.15.149:0/3930091693 shutdown_connections 2024-09-13T18:22:34.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.607+0000 7fb106419640 1 -- 172.21.15.149:0/3930091693 wait complete. 2024-09-13T18:22:34.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.607+0000 7fb106419640 1 Processor -- start 2024-09-13T18:22:34.611 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.607+0000 7fb106419640 1 -- start start 2024-09-13T18:22:34.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.607+0000 7fb106419640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1000ff7e0 0x7fb100194be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:34.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.607+0000 7fb106419640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb100195120 con 0x7fb1000ff7e0 2024-09-13T18:22:34.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.608+0000 7fb0fffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1000ff7e0 0x7fb100194be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:34.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.608+0000 7fb0fffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1000ff7e0 0x7fb100194be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:45984/0 (socket says 172.21.15.149:45984) 2024-09-13T18:22:34.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.608+0000 7fb0fffff640 1 -- 172.21.15.149:0/1837394439 learned_addr learned my addr 172.21.15.149:0/1837394439 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:22:34.612 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.608+0000 7fb0fffff640 1 -- 172.21.15.149:0/1837394439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f0009560 con 0x7fb1000ff7e0 2024-09-13T18:22:34.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.608+0000 7fb0fffff640 1 --2- 172.21.15.149:0/1837394439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1000ff7e0 0x7fb100194be0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009850 tx=0x7fb0f0004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:34.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.608+0000 7fb0fd7fa640 1 -- 172.21.15.149:0/1837394439 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0f0005480 con 0x7fb1000ff7e0 2024-09-13T18:22:34.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.608+0000 7fb106419640 1 -- 172.21.15.149:0/1837394439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb100195320 con 0x7fb1000ff7e0 2024-09-13T18:22:34.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.609+0000 7fb106419640 1 -- 172.21.15.149:0/1837394439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1001957c0 con 0x7fb1000ff7e0 2024-09-13T18:22:34.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.609+0000 7fb0fd7fa640 1 -- 172.21.15.149:0/1837394439 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb0f00055e0 con 0x7fb1000ff7e0 2024-09-13T18:22:34.613 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.609+0000 7fb0fd7fa640 1 -- 172.21.15.149:0/1837394439 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0f0031820 con 0x7fb1000ff7e0 2024-09-13T18:22:34.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.609+0000 7fb106419640 1 -- 172.21.15.149:0/1837394439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1000ffbe0 con 0x7fb1000ff7e0 2024-09-13T18:22:34.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.609+0000 7fb0fd7fa640 1 -- 172.21.15.149:0/1837394439 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fb0f0031980 con 0x7fb1000ff7e0 2024-09-13T18:22:34.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.610+0000 7fb0fd7fa640 1 --2- 172.21.15.149:0/1837394439 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fb0e8038780 0x7fb0e803ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:34.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.610+0000 7fb0fd7fa640 1 -- 172.21.15.149:0/1837394439 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb0f006c430 con 0x7fb1000ff7e0 2024-09-13T18:22:34.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.610+0000 7fb0ff7fe640 1 --2- 172.21.15.149:0/1837394439 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fb0e8038780 0x7fb0e803ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:34.614 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.610+0000 7fb0ff7fe640 1 --2- 172.21.15.149:0/1837394439 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fb0e8038780 0x7fb0e803ac40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40098c0 tx=0x7fb0f4006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:34.618 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.615+0000 7fb0fd7fa640 1 -- 172.21.15.149:0/1837394439 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb0f0031e60 con 0x7fb1000ff7e0 2024-09-13T18:22:34.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:34 smithi038 ceph-mon[27689]: Deploying daemon prometheus.smithi038 on smithi038 2024-09-13T18:22:34.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:34 smithi038 ceph-mon[27689]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:34.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.836+0000 7fb106419640 1 -- 172.21.15.149:0/1837394439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb10018e4d0 con 0x7fb1000ff7e0 2024-09-13T18:22:34.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.836+0000 7fb0fd7fa640 1 -- 172.21.15.149:0/1837394439 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb10018e4d0 con 0x7fb1000ff7e0 2024-09-13T18:22:34.840 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:22:34.840 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:22:34.840 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:22:34.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.838+0000 7fb106419640 1 -- 172.21.15.149:0/1837394439 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fb0e8038780 msgr2=0x7fb0e803ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:34.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.838+0000 7fb106419640 1 --2- 172.21.15.149:0/1837394439 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fb0e8038780 0x7fb0e803ac40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40098c0 tx=0x7fb0f4006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:34.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.838+0000 7fb106419640 1 -- 172.21.15.149:0/1837394439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1000ff7e0 msgr2=0x7fb100194be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:34.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.838+0000 7fb106419640 1 --2- 172.21.15.149:0/1837394439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1000ff7e0 0x7fb100194be0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009850 tx=0x7fb0f0004d80 comp rx=0 tx=0).stop 2024-09-13T18:22:34.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.838+0000 7fb106419640 1 -- 172.21.15.149:0/1837394439 shutdown_connections 2024-09-13T18:22:34.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.838+0000 7fb106419640 1 --2- 172.21.15.149:0/1837394439 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fb0e8038780 0x7fb0e803ac40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:34.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.838+0000 7fb106419640 1 --2- 172.21.15.149:0/1837394439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1000ff7e0 0x7fb100194be0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:34.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.838+0000 7fb106419640 1 -- 172.21.15.149:0/1837394439 >> 172.21.15.149:0/1837394439 conn(0x7fb1000faf90 msgr2=0x7fb1000fb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:34.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.838+0000 7fb106419640 1 -- 172.21.15.149:0/1837394439 shutdown_connections 2024-09-13T18:22:34.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:34.838+0000 7fb106419640 1 -- 172.21.15.149:0/1837394439 wait complete. 2024-09-13T18:22:35.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:35 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/1837394439' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:22:36.380 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:22:36.380 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:22:36.589 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:36.634 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:36.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:36 smithi038 ceph-mon[27689]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:36.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:36 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:38.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.103+0000 7fbac3964640 1 -- 172.21.15.149:0/372197564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbabc0fe6e0 msgr2=0x7fbabc0feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:38.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.103+0000 7fbac3964640 1 --2- 172.21.15.149:0/372197564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbabc0fe6e0 0x7fbabc0feae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009880 tx=0x7fbab802a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:38.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.103+0000 7fbac3964640 1 -- 172.21.15.149:0/372197564 shutdown_connections 2024-09-13T18:22:38.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.103+0000 7fbac3964640 1 --2- 172.21.15.149:0/372197564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbabc0fe6e0 0x7fbabc0feae0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:38.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.103+0000 7fbac3964640 1 -- 172.21.15.149:0/372197564 >> 172.21.15.149:0/372197564 conn(0x7fbabc0f9e90 msgr2=0x7fbabc0fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:38.109 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.104+0000 7fbac3964640 1 -- 172.21.15.149:0/372197564 shutdown_connections 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.104+0000 7fbac3964640 1 -- 172.21.15.149:0/372197564 wait complete. 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.104+0000 7fbac3964640 1 Processor -- start 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.104+0000 7fbac3964640 1 -- start start 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.104+0000 7fbac3964640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbabc0fe6e0 0x7fbabc194c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.104+0000 7fbac3964640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc195170 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.105+0000 7fbac1700640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbabc0fe6e0 0x7fbabc194c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.105+0000 7fbac1700640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbabc0fe6e0 0x7fbabc194c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:47638/0 (socket says 172.21.15.149:47638) 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.105+0000 7fbac1700640 1 -- 172.21.15.149:0/3244463783 learned_addr learned my addr 172.21.15.149:0/3244463783 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.105+0000 7fbac1700640 1 -- 172.21.15.149:0/3244463783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8009560 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.105+0000 7fbac1700640 1 --2- 172.21.15.149:0/3244463783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbabc0fe6e0 0x7fbabc194c30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbab8004cf0 tx=0x7fbab8004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.105+0000 7fbab27fc640 1 -- 172.21.15.149:0/3244463783 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbab80053f0 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.105+0000 7fbab27fc640 1 -- 172.21.15.149:0/3244463783 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbab8005550 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.110 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.105+0000 7fbac3964640 1 -- 172.21.15.149:0/3244463783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbabc195370 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.105+0000 7fbab27fc640 1 -- 172.21.15.149:0/3244463783 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbab80319c0 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.111 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.105+0000 7fbac3964640 1 -- 172.21.15.149:0/3244463783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbabc195810 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.106+0000 7fbab27fc640 1 -- 172.21.15.149:0/3244463783 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fbab8031c30 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.106+0000 7fbac3964640 1 -- 172.21.15.149:0/3244463783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbabc0feae0 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.106+0000 7fbab27fc640 1 --2- 172.21.15.149:0/3244463783 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fbaa8038740 0x7fbaa803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:38.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.106+0000 7fbab27fc640 1 -- 172.21.15.149:0/3244463783 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbab806c4d0 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.106+0000 7fbac0eff640 1 --2- 172.21.15.149:0/3244463783 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fbaa8038740 0x7fbaa803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:38.112 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.107+0000 7fbac0eff640 1 --2- 172.21.15.149:0/3244463783 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fbaa8038740 0x7fbaa803ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0098c0 tx=0x7fbaac006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:38.114 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.111+0000 7fbab27fc640 1 -- 172.21.15.149:0/3244463783 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbab804dce0 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.335 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.332+0000 7fbac3964640 1 -- 172.21.15.149:0/3244463783 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbabc18e3e0 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.336 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.332+0000 7fbab27fc640 1 -- 172.21.15.149:0/3244463783 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fbab8035070 con 0x7fbabc0fe6e0 2024-09-13T18:22:38.341 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:22:38.341 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:22:38.342 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:22:38.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.334+0000 7fbac3964640 1 -- 172.21.15.149:0/3244463783 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fbaa8038740 msgr2=0x7fbaa803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:38.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.334+0000 7fbac3964640 1 --2- 172.21.15.149:0/3244463783 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fbaa8038740 0x7fbaa803ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0098c0 tx=0x7fbaac006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:38.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.334+0000 7fbac3964640 1 -- 172.21.15.149:0/3244463783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbabc0fe6e0 msgr2=0x7fbabc194c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:38.342 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.334+0000 7fbac3964640 1 --2- 172.21.15.149:0/3244463783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbabc0fe6e0 0x7fbabc194c30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbab8004cf0 tx=0x7fbab8004d20 comp rx=0 tx=0).stop 2024-09-13T18:22:38.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.334+0000 7fbac3964640 1 -- 172.21.15.149:0/3244463783 shutdown_connections 2024-09-13T18:22:38.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.334+0000 7fbac3964640 1 --2- 172.21.15.149:0/3244463783 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fbaa8038740 0x7fbaa803ac00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:38.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.334+0000 7fbac3964640 1 --2- 172.21.15.149:0/3244463783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbabc0fe6e0 0x7fbabc194c30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:38.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.334+0000 7fbac3964640 1 -- 172.21.15.149:0/3244463783 >> 172.21.15.149:0/3244463783 conn(0x7fbabc0f9e90 msgr2=0x7fbabc068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:38.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.335+0000 7fbac3964640 1 -- 172.21.15.149:0/3244463783 shutdown_connections 2024-09-13T18:22:38.343 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:38.335+0000 7fbac3964640 1 -- 172.21.15.149:0/3244463783 wait complete. 2024-09-13T18:22:38.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:38 smithi038 ceph-mon[27689]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:38.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:38 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/3244463783' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:22:39.843 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:22:39.844 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:22:40.041 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:40.085 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:40.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:40 smithi038 ceph-mon[27689]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:41.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.574+0000 7f6827582640 1 -- 172.21.15.149:0/3632178456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68200fe6f0 msgr2=0x7f68200feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:41.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.574+0000 7f6827582640 1 --2- 172.21.15.149:0/3632178456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68200fe6f0 0x7f68200feaf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f681c009880 tx=0x7f681c02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:41.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.574+0000 7f6827582640 1 -- 172.21.15.149:0/3632178456 shutdown_connections 2024-09-13T18:22:41.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.574+0000 7f6827582640 1 --2- 172.21.15.149:0/3632178456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68200fe6f0 0x7f68200feaf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:41.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.574+0000 7f6827582640 1 -- 172.21.15.149:0/3632178456 >> 172.21.15.149:0/3632178456 conn(0x7f68200f9e80 msgr2=0x7f68200fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:41.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.574+0000 7f6827582640 1 -- 172.21.15.149:0/3632178456 shutdown_connections 2024-09-13T18:22:41.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.574+0000 7f6827582640 1 -- 172.21.15.149:0/3632178456 wait complete. 2024-09-13T18:22:41.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.574+0000 7f6827582640 1 Processor -- start 2024-09-13T18:22:41.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.574+0000 7f6827582640 1 -- start start 2024-09-13T18:22:41.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.575+0000 7f6827582640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68200fe6f0 0x7f68200fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:41.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.575+0000 7f6827582640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68200fc280 con 0x7f68200fe6f0 2024-09-13T18:22:41.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.575+0000 7f682531e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68200fe6f0 0x7f68200fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:41.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.575+0000 7f682531e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68200fe6f0 0x7f68200fbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:47646/0 (socket says 172.21.15.149:47646) 2024-09-13T18:22:41.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.575+0000 7f682531e640 1 -- 172.21.15.149:0/2682040340 learned_addr learned my addr 172.21.15.149:0/2682040340 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:22:41.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.575+0000 7f682531e640 1 -- 172.21.15.149:0/2682040340 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c009560 con 0x7f68200fe6f0 2024-09-13T18:22:41.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.575+0000 7f682531e640 1 --2- 172.21.15.149:0/2682040340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68200fe6f0 0x7f68200fbd40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f681c02aaf0 tx=0x7f681c004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:41.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.576+0000 7f68167fc640 1 -- 172.21.15.149:0/2682040340 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f681c005440 con 0x7f68200fe6f0 2024-09-13T18:22:41.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.576+0000 7f6827582640 1 -- 172.21.15.149:0/2682040340 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68200fa470 con 0x7f68200fe6f0 2024-09-13T18:22:41.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.576+0000 7f68167fc640 1 -- 172.21.15.149:0/2682040340 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f681c0055a0 con 0x7f68200fe6f0 2024-09-13T18:22:41.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.576+0000 7f68167fc640 1 -- 172.21.15.149:0/2682040340 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f681c031ac0 con 0x7f68200fe6f0 2024-09-13T18:22:41.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.576+0000 7f6827582640 1 -- 172.21.15.149:0/2682040340 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68200fa910 con 0x7f68200fe6f0 2024-09-13T18:22:41.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.577+0000 7f68167fc640 1 -- 172.21.15.149:0/2682040340 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f681c031cc0 con 0x7f68200fe6f0 2024-09-13T18:22:41.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.577+0000 7f6827582640 1 -- 172.21.15.149:0/2682040340 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6820104da0 con 0x7f68200fe6f0 2024-09-13T18:22:41.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.577+0000 7f68167fc640 1 --2- 172.21.15.149:0/2682040340 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f680c038740 0x7f680c03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:41.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.577+0000 7f68167fc640 1 -- 172.21.15.149:0/2682040340 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f681c06c460 con 0x7f68200fe6f0 2024-09-13T18:22:41.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.577+0000 7f6824b1d640 1 --2- 172.21.15.149:0/2682040340 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f680c038740 0x7f680c03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:41.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.578+0000 7f6824b1d640 1 --2- 172.21.15.149:0/2682040340 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f680c038740 0x7f680c03ac00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f68100098c0 tx=0x7f6810006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:41.584 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.582+0000 7f68167fc640 1 -- 172.21.15.149:0/2682040340 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f681c03a5e0 con 0x7f68200fe6f0 2024-09-13T18:22:41.742 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:41 smithi038 ceph-mon[27689]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:41.809 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.807+0000 7f6827582640 1 -- 172.21.15.149:0/2682040340 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f68200feaf0 con 0x7f68200fe6f0 2024-09-13T18:22:41.810 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.808+0000 7f68167fc640 1 -- 172.21.15.149:0/2682040340 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f681c04a090 con 0x7f68200fe6f0 2024-09-13T18:22:41.811 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:22:41.811 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:22:41.811 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:22:41.812 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.810+0000 7f6827582640 1 -- 172.21.15.149:0/2682040340 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f680c038740 msgr2=0x7f680c03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.810+0000 7f6827582640 1 --2- 172.21.15.149:0/2682040340 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f680c038740 0x7f680c03ac00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f68100098c0 tx=0x7f6810006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.810+0000 7f6827582640 1 -- 172.21.15.149:0/2682040340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68200fe6f0 msgr2=0x7f68200fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.810+0000 7f6827582640 1 --2- 172.21.15.149:0/2682040340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68200fe6f0 0x7f68200fbd40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f681c02aaf0 tx=0x7f681c004da0 comp rx=0 tx=0).stop 2024-09-13T18:22:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.810+0000 7f6827582640 1 -- 172.21.15.149:0/2682040340 shutdown_connections 2024-09-13T18:22:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.810+0000 7f6827582640 1 --2- 172.21.15.149:0/2682040340 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f680c038740 0x7f680c03ac00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.810+0000 7f6827582640 1 --2- 172.21.15.149:0/2682040340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f68200fe6f0 0x7f68200fbd40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.810+0000 7f6827582640 1 -- 172.21.15.149:0/2682040340 >> 172.21.15.149:0/2682040340 conn(0x7f68200f9e80 msgr2=0x7f6820068360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.810+0000 7f6827582640 1 -- 172.21.15.149:0/2682040340 shutdown_connections 2024-09-13T18:22:41.813 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:41.810+0000 7f6827582640 1 -- 172.21.15.149:0/2682040340 wait complete. 2024-09-13T18:22:42.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:42 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/2682040340' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:22:43.496 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:22:43.496 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:22:43.692 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:43.736 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:44.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:43 smithi038 ceph-mon[27689]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:45.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.200+0000 7fc98893b640 1 -- 172.21.15.149:0/4292907884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9840fe6d0 msgr2=0x7fc9840fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:45.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.200+0000 7fc98893b640 1 --2- 172.21.15.149:0/4292907884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9840fe6d0 0x7fc9840fead0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc974009880 tx=0x7fc97402a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:45.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.200+0000 7fc98893b640 1 -- 172.21.15.149:0/4292907884 shutdown_connections 2024-09-13T18:22:45.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.200+0000 7fc98893b640 1 --2- 172.21.15.149:0/4292907884 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9840fe6d0 0x7fc9840fead0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:45.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.200+0000 7fc98893b640 1 -- 172.21.15.149:0/4292907884 >> 172.21.15.149:0/4292907884 conn(0x7fc9840f9e80 msgr2=0x7fc9840fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:45.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.200+0000 7fc98893b640 1 -- 172.21.15.149:0/4292907884 shutdown_connections 2024-09-13T18:22:45.204 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.200+0000 7fc98893b640 1 -- 172.21.15.149:0/4292907884 wait complete. 2024-09-13T18:22:45.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.201+0000 7fc98893b640 1 Processor -- start 2024-09-13T18:22:45.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.201+0000 7fc98893b640 1 -- start start 2024-09-13T18:22:45.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.201+0000 7fc98893b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9840fe6d0 0x7fc984193b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:45.205 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.201+0000 7fc98893b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9841940d0 con 0x7fc9840fe6d0 2024-09-13T18:22:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.202+0000 7fc98259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9840fe6d0 0x7fc984193b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.202+0000 7fc98259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9840fe6d0 0x7fc984193b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:47676/0 (socket says 172.21.15.149:47676) 2024-09-13T18:22:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.202+0000 7fc98259c640 1 -- 172.21.15.149:0/1238244154 learned_addr learned my addr 172.21.15.149:0/1238244154 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:22:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.202+0000 7fc98259c640 1 -- 172.21.15.149:0/1238244154 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974009560 con 0x7fc9840fe6d0 2024-09-13T18:22:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.202+0000 7fc98259c640 1 --2- 172.21.15.149:0/1238244154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9840fe6d0 0x7fc984193b90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc9740055c0 tx=0x7fc9740055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.202+0000 7fc9737fe640 1 -- 172.21.15.149:0/1238244154 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc974004b20 con 0x7fc9840fe6d0 2024-09-13T18:22:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.202+0000 7fc98893b640 1 -- 172.21.15.149:0/1238244154 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9841942d0 con 0x7fc9840fe6d0 2024-09-13T18:22:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.202+0000 7fc9737fe640 1 -- 172.21.15.149:0/1238244154 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc974004c80 con 0x7fc9840fe6d0 2024-09-13T18:22:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.203+0000 7fc9737fe640 1 -- 172.21.15.149:0/1238244154 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9740318a0 con 0x7fc9840fe6d0 2024-09-13T18:22:45.206 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.203+0000 7fc98893b640 1 -- 172.21.15.149:0/1238244154 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc984194770 con 0x7fc9840fe6d0 2024-09-13T18:22:45.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.204+0000 7fc9737fe640 1 -- 172.21.15.149:0/1238244154 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fc9740035f0 con 0x7fc9840fe6d0 2024-09-13T18:22:45.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.204+0000 7fc98893b640 1 -- 172.21.15.149:0/1238244154 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9840fead0 con 0x7fc9840fe6d0 2024-09-13T18:22:45.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.204+0000 7fc9737fe640 1 --2- 172.21.15.149:0/1238244154 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fc96c038740 0x7fc96c03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:45.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.204+0000 7fc9737fe640 1 -- 172.21.15.149:0/1238244154 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc97406c4b0 con 0x7fc9840fe6d0 2024-09-13T18:22:45.207 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.204+0000 7fc981d9b640 1 --2- 172.21.15.149:0/1238244154 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fc96c038740 0x7fc96c03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:45.208 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.205+0000 7fc981d9b640 1 --2- 172.21.15.149:0/1238244154 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fc96c038740 0x7fc96c03ac00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9780098c0 tx=0x7fc978006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:45.211 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.209+0000 7fc9737fe640 1 -- 172.21.15.149:0/1238244154 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc97403aca0 con 0x7fc9840fe6d0 2024-09-13T18:22:45.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.430+0000 7fc98893b640 1 -- 172.21.15.149:0/1238244154 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc98418d3c0 con 0x7fc9840fe6d0 2024-09-13T18:22:45.433 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.431+0000 7fc9737fe640 1 -- 172.21.15.149:0/1238244154 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc974035020 con 0x7fc9840fe6d0 2024-09-13T18:22:45.434 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:22:45.434 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:22:45.435 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:22:45.435 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.433+0000 7fc98893b640 1 -- 172.21.15.149:0/1238244154 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fc96c038740 msgr2=0x7fc96c03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:45.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.433+0000 7fc98893b640 1 --2- 172.21.15.149:0/1238244154 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fc96c038740 0x7fc96c03ac00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9780098c0 tx=0x7fc978006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:45.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.433+0000 7fc98893b640 1 -- 172.21.15.149:0/1238244154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9840fe6d0 msgr2=0x7fc984193b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:45.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.433+0000 7fc98893b640 1 --2- 172.21.15.149:0/1238244154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9840fe6d0 0x7fc984193b90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc9740055c0 tx=0x7fc9740055f0 comp rx=0 tx=0).stop 2024-09-13T18:22:45.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.433+0000 7fc98893b640 1 -- 172.21.15.149:0/1238244154 shutdown_connections 2024-09-13T18:22:45.436 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.433+0000 7fc98893b640 1 --2- 172.21.15.149:0/1238244154 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fc96c038740 0x7fc96c03ac00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:45.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.433+0000 7fc98893b640 1 --2- 172.21.15.149:0/1238244154 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9840fe6d0 0x7fc984193b90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:45.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.433+0000 7fc98893b640 1 -- 172.21.15.149:0/1238244154 >> 172.21.15.149:0/1238244154 conn(0x7fc9840f9e80 msgr2=0x7fc9840fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:45.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.433+0000 7fc98893b640 1 -- 172.21.15.149:0/1238244154 shutdown_connections 2024-09-13T18:22:45.437 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:45.433+0000 7fc98893b640 1 -- 172.21.15.149:0/1238244154 wait complete. 2024-09-13T18:22:45.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:45 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/1238244154' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:22:46.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:46 smithi038 ceph-mon[27689]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:47.041 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:22:47.042 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:22:47.239 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:47.283 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:47.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:47 smithi038 ceph-mon[27689]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:48.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.704+0000 7fe37834e640 1 -- 172.21.15.149:0/475895278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701002a0 msgr2=0x7fe370102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:48.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.704+0000 7fe37834e640 1 --2- 172.21.15.149:0/475895278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701002a0 0x7fe370102690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe360009c20 tx=0x7fe36002aa90 comp rx=0 tx=0).stop 2024-09-13T18:22:48.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.704+0000 7fe37834e640 1 -- 172.21.15.149:0/475895278 shutdown_connections 2024-09-13T18:22:48.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.704+0000 7fe37834e640 1 --2- 172.21.15.149:0/475895278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701002a0 0x7fe370102690 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:48.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.704+0000 7fe37834e640 1 -- 172.21.15.149:0/475895278 >> 172.21.15.149:0/475895278 conn(0x7fe3700f9e80 msgr2=0x7fe3700fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:48.707 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.704+0000 7fe37834e640 1 -- 172.21.15.149:0/475895278 shutdown_connections 2024-09-13T18:22:48.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.704+0000 7fe37834e640 1 -- 172.21.15.149:0/475895278 wait complete. 2024-09-13T18:22:48.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.705+0000 7fe37834e640 1 Processor -- start 2024-09-13T18:22:48.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.705+0000 7fe37834e640 1 -- start start 2024-09-13T18:22:48.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.705+0000 7fe37834e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701002a0 0x7fe370194cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:48.708 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.705+0000 7fe37834e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe370195230 con 0x7fe3701002a0 2024-09-13T18:22:48.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.705+0000 7fe3760ea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701002a0 0x7fe370194cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:48.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.705+0000 7fe3760ea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701002a0 0x7fe370194cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:60998/0 (socket says 172.21.15.149:60998) 2024-09-13T18:22:48.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.705+0000 7fe3760ea640 1 -- 172.21.15.149:0/417267683 learned_addr learned my addr 172.21.15.149:0/417267683 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:22:48.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.706+0000 7fe3760ea640 1 -- 172.21.15.149:0/417267683 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe360009900 con 0x7fe3701002a0 2024-09-13T18:22:48.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.706+0000 7fe3760ea640 1 --2- 172.21.15.149:0/417267683 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701002a0 0x7fe370194cf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe36002f8a0 tx=0x7fe36002f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:48.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.706+0000 7fe36f7fe640 1 -- 172.21.15.149:0/417267683 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe36003e070 con 0x7fe3701002a0 2024-09-13T18:22:48.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.706+0000 7fe37834e640 1 -- 172.21.15.149:0/417267683 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe370195430 con 0x7fe3701002a0 2024-09-13T18:22:48.709 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.706+0000 7fe36f7fe640 1 -- 172.21.15.149:0/417267683 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe36002fc20 con 0x7fe3701002a0 2024-09-13T18:22:48.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.706+0000 7fe36f7fe640 1 -- 172.21.15.149:0/417267683 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3600047d0 con 0x7fe3701002a0 2024-09-13T18:22:48.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.706+0000 7fe37834e640 1 -- 172.21.15.149:0/417267683 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3701958d0 con 0x7fe3701002a0 2024-09-13T18:22:48.710 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.707+0000 7fe36f7fe640 1 -- 172.21.15.149:0/417267683 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fe36000a040 con 0x7fe3701002a0 2024-09-13T18:22:48.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.707+0000 7fe37834e640 1 -- 172.21.15.149:0/417267683 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37018e4a0 con 0x7fe3701002a0 2024-09-13T18:22:48.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.707+0000 7fe36f7fe640 1 --2- 172.21.15.149:0/417267683 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fe3580386f0 0x7fe35803abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:48.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.707+0000 7fe36f7fe640 1 -- 172.21.15.149:0/417267683 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe36006c220 con 0x7fe3701002a0 2024-09-13T18:22:48.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.708+0000 7fe3758e9640 1 --2- 172.21.15.149:0/417267683 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fe3580386f0 0x7fe35803abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:48.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.708+0000 7fe3758e9640 1 --2- 172.21.15.149:0/417267683 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fe3580386f0 0x7fe35803abb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe3640098c0 tx=0x7fe364006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:48.715 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.713+0000 7fe36f7fe640 1 -- 172.21.15.149:0/417267683 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe360037ba0 con 0x7fe3701002a0 2024-09-13T18:22:48.941 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.938+0000 7fe37834e640 1 -- 172.21.15.149:0/417267683 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe370105780 con 0x7fe3701002a0 2024-09-13T18:22:48.945 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.943+0000 7fe36f7fe640 1 -- 172.21.15.149:0/417267683 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fe360047300 con 0x7fe3701002a0 2024-09-13T18:22:48.946 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:22:48.946 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:22:48.946 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:22:48.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.945+0000 7fe37834e640 1 -- 172.21.15.149:0/417267683 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fe3580386f0 msgr2=0x7fe35803abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:48.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.945+0000 7fe37834e640 1 --2- 172.21.15.149:0/417267683 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fe3580386f0 0x7fe35803abb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe3640098c0 tx=0x7fe364006db0 comp rx=0 tx=0).stop 2024-09-13T18:22:48.947 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.945+0000 7fe37834e640 1 -- 172.21.15.149:0/417267683 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701002a0 msgr2=0x7fe370194cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:48.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.945+0000 7fe37834e640 1 --2- 172.21.15.149:0/417267683 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701002a0 0x7fe370194cf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe36002f8a0 tx=0x7fe36002f8d0 comp rx=0 tx=0).stop 2024-09-13T18:22:48.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.945+0000 7fe37834e640 1 -- 172.21.15.149:0/417267683 shutdown_connections 2024-09-13T18:22:48.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.945+0000 7fe37834e640 1 --2- 172.21.15.149:0/417267683 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7fe3580386f0 0x7fe35803abb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:48.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.945+0000 7fe37834e640 1 --2- 172.21.15.149:0/417267683 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701002a0 0x7fe370194cf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:48.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.945+0000 7fe37834e640 1 -- 172.21.15.149:0/417267683 >> 172.21.15.149:0/417267683 conn(0x7fe3700f9e80 msgr2=0x7fe3700faa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:48.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.945+0000 7fe37834e640 1 -- 172.21.15.149:0/417267683 shutdown_connections 2024-09-13T18:22:48.948 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:48.945+0000 7fe37834e640 1 -- 172.21.15.149:0/417267683 wait complete. 2024-09-13T18:22:49.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:48 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/417267683' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:22:50.512 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:22:50.512 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:22:50.557 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:50 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:50.557 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:50 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:50.557 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:50 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:50.557 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:50 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T18:22:50.557 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:50 smithi038 ceph-mon[27689]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:22:50.706 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:50.749 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:51.496 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:51 smithi038 ceph-mon[27689]: from='mgr.14162 172.21.15.38:0/3292783501' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T18:22:51.496 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:51 smithi038 ceph-mon[27689]: mgrmap e14: smithi038.jeygoq(active, since 64s) 2024-09-13T18:22:52.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.224+0000 7f8d1b393640 1 -- 172.21.15.149:0/2644962651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d140fe6f0 msgr2=0x7f8d140feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:52.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.224+0000 7f8d1b393640 1 --2- 172.21.15.149:0/2644962651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d140fe6f0 0x7f8d140feaf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009880 tx=0x7f8d1002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:52.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.224+0000 7f8d1b393640 1 -- 172.21.15.149:0/2644962651 shutdown_connections 2024-09-13T18:22:52.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.224+0000 7f8d1b393640 1 --2- 172.21.15.149:0/2644962651 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d140fe6f0 0x7f8d140feaf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:52.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.224+0000 7f8d1b393640 1 -- 172.21.15.149:0/2644962651 >> 172.21.15.149:0/2644962651 conn(0x7f8d140f9e80 msgr2=0x7f8d140fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:52.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.224+0000 7f8d1b393640 1 -- 172.21.15.149:0/2644962651 shutdown_connections 2024-09-13T18:22:52.228 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.224+0000 7f8d1b393640 1 -- 172.21.15.149:0/2644962651 wait complete. 2024-09-13T18:22:52.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.224+0000 7f8d1b393640 1 Processor -- start 2024-09-13T18:22:52.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.224+0000 7f8d1b393640 1 -- start start 2024-09-13T18:22:52.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.225+0000 7f8d1b393640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d140fe6f0 0x7f8d14068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:52.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.225+0000 7f8d1b393640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14197900 con 0x7f8d140fe6f0 2024-09-13T18:22:52.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.225+0000 7f8d1912f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d140fe6f0 0x7f8d14068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:52.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.225+0000 7f8d1912f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d140fe6f0 0x7f8d14068980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:32780/0 (socket says 172.21.15.149:32780) 2024-09-13T18:22:52.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.225+0000 7f8d1912f640 1 -- 172.21.15.149:0/769847974 learned_addr learned my addr 172.21.15.149:0/769847974 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:22:52.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.225+0000 7f8d1912f640 1 -- 172.21.15.149:0/769847974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d10009560 con 0x7f8d140fe6f0 2024-09-13T18:22:52.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.225+0000 7f8d1912f640 1 --2- 172.21.15.149:0/769847974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d140fe6f0 0x7f8d14068980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8d10004cf0 tx=0x7f8d10004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:52.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.225+0000 7f8d0a7fc640 1 -- 172.21.15.149:0/769847974 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d100053f0 con 0x7f8d140fe6f0 2024-09-13T18:22:52.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.226+0000 7f8d1b393640 1 -- 172.21.15.149:0/769847974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d14197a40 con 0x7f8d140fe6f0 2024-09-13T18:22:52.229 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.226+0000 7f8d0a7fc640 1 -- 172.21.15.149:0/769847974 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d10005550 con 0x7f8d140fe6f0 2024-09-13T18:22:52.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.226+0000 7f8d0a7fc640 1 -- 172.21.15.149:0/769847974 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d100319c0 con 0x7f8d140fe6f0 2024-09-13T18:22:52.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.226+0000 7f8d1b393640 1 -- 172.21.15.149:0/769847974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d14197e20 con 0x7f8d140fe6f0 2024-09-13T18:22:52.230 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.226+0000 7f8d0a7fc640 1 -- 172.21.15.149:0/769847974 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 14) v1 ==== 45626+0+0 (secure 0 0 0) 0x7f8d10031c30 con 0x7f8d140fe6f0 2024-09-13T18:22:52.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.226+0000 7f8d1b393640 1 -- 172.21.15.149:0/769847974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d140feaf0 con 0x7f8d140fe6f0 2024-09-13T18:22:52.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.227+0000 7f8d0a7fc640 1 --2- 172.21.15.149:0/769847974 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f8d00038790 0x7f8d0003ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:52.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.227+0000 7f8d0a7fc640 1 -- 172.21.15.149:0/769847974 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8d1006c570 con 0x7f8d140fe6f0 2024-09-13T18:22:52.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.227+0000 7f8d1892e640 1 -- 172.21.15.149:0/769847974 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f8d00038790 msgr2=0x7f8d0003ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/1869434741 2024-09-13T18:22:52.231 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.227+0000 7f8d1892e640 1 --2- 172.21.15.149:0/769847974 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f8d00038790 0x7f8d0003ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:22:52.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.236+0000 7f8d0a7fc640 1 -- 172.21.15.149:0/769847974 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8d1004d7c0 con 0x7f8d140fe6f0 2024-09-13T18:22:52.430 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.428+0000 7f8d1892e640 1 -- 172.21.15.149:0/769847974 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f8d00038790 msgr2=0x7f8d0003ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.38:6800/1869434741 2024-09-13T18:22:52.430 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.428+0000 7f8d1892e640 1 --2- 172.21.15.149:0/769847974 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f8d00038790 0x7f8d0003ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:22:52.464 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.462+0000 7f8d1b393640 1 -- 172.21.15.149:0/769847974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8d1418d3e0 con 0x7f8d140fe6f0 2024-09-13T18:22:52.465 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.463+0000 7f8d0a7fc640 1 -- 172.21.15.149:0/769847974 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8d10035070 con 0x7f8d140fe6f0 2024-09-13T18:22:52.465 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:22:52.466 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:22:52.466 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:22:52.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.465+0000 7f8d1b393640 1 -- 172.21.15.149:0/769847974 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f8d00038790 msgr2=0x7f8d0003ac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:22:52.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.465+0000 7f8d1b393640 1 --2- 172.21.15.149:0/769847974 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f8d00038790 0x7f8d0003ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:52.467 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.465+0000 7f8d1b393640 1 -- 172.21.15.149:0/769847974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d140fe6f0 msgr2=0x7f8d14068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:52.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.465+0000 7f8d1b393640 1 --2- 172.21.15.149:0/769847974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d140fe6f0 0x7f8d14068980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8d10004cf0 tx=0x7f8d10004d20 comp rx=0 tx=0).stop 2024-09-13T18:22:52.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.465+0000 7f8d1b393640 1 -- 172.21.15.149:0/769847974 shutdown_connections 2024-09-13T18:22:52.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.465+0000 7f8d1b393640 1 --2- 172.21.15.149:0/769847974 >> [v2:172.21.15.38:6800/1869434741,v1:172.21.15.38:6801/1869434741] conn(0x7f8d00038790 0x7f8d0003ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:52.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.465+0000 7f8d1b393640 1 --2- 172.21.15.149:0/769847974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d140fe6f0 0x7f8d14068980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:52.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.465+0000 7f8d1b393640 1 -- 172.21.15.149:0/769847974 >> 172.21.15.149:0/769847974 conn(0x7f8d140f9e80 msgr2=0x7f8d140fa8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:52.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.465+0000 7f8d1b393640 1 -- 172.21.15.149:0/769847974 shutdown_connections 2024-09-13T18:22:52.468 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:52.465+0000 7f8d1b393640 1 -- 172.21.15.149:0/769847974 wait complete. 2024-09-13T18:22:52.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:52 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/769847974' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:22:54.032 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:22:54.032 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:22:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:54.274 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:55.530 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: Active manager daemon smithi038.jeygoq restarted 2024-09-13T18:22:55.530 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: Activating manager daemon smithi038.jeygoq 2024-09-13T18:22:55.530 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T18:22:55.530 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: mgrmap e15: smithi038.jeygoq(active, starting, since 0.00541451s) 2024-09-13T18:22:55.530 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:22:55.530 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr metadata", "who": "smithi038.jeygoq", "id": "smithi038.jeygoq"}]: dispatch 2024-09-13T18:22:55.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T18:22:55.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T18:22:55.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T18:22:55.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: Manager daemon smithi038.jeygoq is now available 2024-09-13T18:22:55.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:22:55.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:55.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:22:55.836 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.832+0000 7f8fca5c6640 1 -- 172.21.15.149:0/7055886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fc40fe6d0 msgr2=0x7f8fc40fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:55.836 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.832+0000 7f8fca5c6640 1 --2- 172.21.15.149:0/7055886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fc40fe6d0 0x7f8fc40fead0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009880 tx=0x7f8fb402a5d0 comp rx=0 tx=0).stop 2024-09-13T18:22:55.836 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.833+0000 7f8fca5c6640 1 -- 172.21.15.149:0/7055886 shutdown_connections 2024-09-13T18:22:55.836 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.833+0000 7f8fca5c6640 1 --2- 172.21.15.149:0/7055886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fc40fe6d0 0x7f8fc40fead0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:55.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.833+0000 7f8fca5c6640 1 -- 172.21.15.149:0/7055886 >> 172.21.15.149:0/7055886 conn(0x7f8fc40f9e80 msgr2=0x7f8fc40fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:55.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.833+0000 7f8fca5c6640 1 -- 172.21.15.149:0/7055886 shutdown_connections 2024-09-13T18:22:55.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.833+0000 7f8fca5c6640 1 -- 172.21.15.149:0/7055886 wait complete. 2024-09-13T18:22:55.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.833+0000 7f8fca5c6640 1 Processor -- start 2024-09-13T18:22:55.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.833+0000 7f8fca5c6640 1 -- start start 2024-09-13T18:22:55.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.834+0000 7f8fca5c6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fc40fe6d0 0x7f8fc4068120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:22:55.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.834+0000 7f8fca5c6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc4068660 con 0x7f8fc40fe6d0 2024-09-13T18:22:55.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.834+0000 7f8fc3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fc40fe6d0 0x7f8fc4068120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:22:55.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.834+0000 7f8fc3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fc40fe6d0 0x7f8fc4068120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:32790/0 (socket says 172.21.15.149:32790) 2024-09-13T18:22:55.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.834+0000 7f8fc3fff640 1 -- 172.21.15.149:0/555760399 learned_addr learned my addr 172.21.15.149:0/555760399 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:22:55.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.834+0000 7f8fc3fff640 1 -- 172.21.15.149:0/555760399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb4009560 con 0x7f8fc40fe6d0 2024-09-13T18:22:55.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.834+0000 7f8fc3fff640 1 --2- 172.21.15.149:0/555760399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fc40fe6d0 0x7f8fc4068120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40055c0 tx=0x7f8fb40055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:22:55.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.835+0000 7f8fc17fa640 1 -- 172.21.15.149:0/555760399 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fb40049d0 con 0x7f8fc40fe6d0 2024-09-13T18:22:55.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.835+0000 7f8fca5c6640 1 -- 172.21.15.149:0/555760399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc41979e0 con 0x7f8fc40fe6d0 2024-09-13T18:22:55.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.835+0000 7f8fc17fa640 1 -- 172.21.15.149:0/555760399 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8fb4004b30 con 0x7f8fc40fe6d0 2024-09-13T18:22:55.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.835+0000 7f8fc17fa640 1 -- 172.21.15.149:0/555760399 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fb4031780 con 0x7f8fc40fe6d0 2024-09-13T18:22:55.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.835+0000 7f8fca5c6640 1 -- 172.21.15.149:0/555760399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc4197e80 con 0x7f8fc40fe6d0 2024-09-13T18:22:55.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.836+0000 7f8fc17fa640 1 -- 172.21.15.149:0/555760399 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 15) v1 ==== 45350+0+0 (secure 0 0 0) 0x7f8fb4031a50 con 0x7f8fc40fe6d0 2024-09-13T18:22:55.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.836+0000 7f8fc17fa640 1 -- 172.21.15.149:0/555760399 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f8fb406c1b0 con 0x7f8fc40fe6d0 2024-09-13T18:22:55.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.836+0000 7f8fca5c6640 1 -- 172.21.15.149:0/555760399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc40fead0 con 0x7f8fc40fe6d0 2024-09-13T18:22:55.845 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:55.843+0000 7f8fc17fa640 1 -- 172.21.15.149:0/555760399 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8fb4035020 con 0x7f8fc40fe6d0 2024-09-13T18:22:56.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:56.086+0000 7f8fca5c6640 1 -- 172.21.15.149:0/555760399 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8fc418d3c0 con 0x7f8fc40fe6d0 2024-09-13T18:22:56.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:56.087+0000 7f8fc17fa640 1 -- 172.21.15.149:0/555760399 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8fb4040070 con 0x7f8fc40fe6d0 2024-09-13T18:22:56.089 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:22:56.089 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:22:56.090 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:22:56.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:56.089+0000 7f8fca5c6640 1 -- 172.21.15.149:0/555760399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fc40fe6d0 msgr2=0x7f8fc4068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:22:56.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:56.089+0000 7f8fca5c6640 1 --2- 172.21.15.149:0/555760399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fc40fe6d0 0x7f8fc4068120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40055c0 tx=0x7f8fb40055f0 comp rx=0 tx=0).stop 2024-09-13T18:22:56.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:56.089+0000 7f8fca5c6640 1 -- 172.21.15.149:0/555760399 shutdown_connections 2024-09-13T18:22:56.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:56.089+0000 7f8fca5c6640 1 --2- 172.21.15.149:0/555760399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8fc40fe6d0 0x7f8fc4068120 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:22:56.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:56.089+0000 7f8fca5c6640 1 -- 172.21.15.149:0/555760399 >> 172.21.15.149:0/555760399 conn(0x7f8fc40f9e80 msgr2=0x7f8fc40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:22:56.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:56.089+0000 7f8fca5c6640 1 -- 172.21.15.149:0/555760399 shutdown_connections 2024-09-13T18:22:56.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:22:56.089+0000 7f8fca5c6640 1 -- 172.21.15.149:0/555760399 wait complete. 2024-09-13T18:22:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:22:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/trash_purge_schedule"}]: dispatch 2024-09-13T18:22:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:56 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/555760399' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:22:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:56 smithi038 ceph-mon[27689]: mgrmap e16: smithi038.jeygoq(active, since 1.01001s) 2024-09-13T18:22:57.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:57 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:57.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:57 smithi038 ceph-mon[27689]: [13/Sep/2024:18:22:56] ENGINE Bus STARTING 2024-09-13T18:22:57.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:57 smithi038 ceph-mon[27689]: [13/Sep/2024:18:22:56] ENGINE Serving on https://172.21.15.38:7150 2024-09-13T18:22:57.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:57 smithi038 ceph-mon[27689]: [13/Sep/2024:18:22:56] ENGINE Error in HTTPServer.serve 2024-09-13T18:22:57.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Traceback (most recent call last): 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._connections.run(self.expiration_interval) 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._run(expiration_interval) 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: s = self.context.wrap_socket( 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: return self.sslsocket_class._create( 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T18:22:57.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self.do_handshake() 2024-09-13T18:22:57.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T18:22:57.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._sslobj.do_handshake() 2024-09-13T18:22:57.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T18:22:57.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:57 smithi038 ceph-mon[27689]: [13/Sep/2024:18:22:56] ENGINE Serving on http://172.21.15.38:8765 2024-09-13T18:22:57.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:57 smithi038 ceph-mon[27689]: [13/Sep/2024:18:22:56] ENGINE Bus STARTED 2024-09-13T18:22:57.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:57 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:22:57.737 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:22:57.737 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:22:58.002 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:58.784 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T18:22:59.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:22:59 smithi038 ceph-mon[27689]: mgrmap e17: smithi038.jeygoq(active, since 2s) 2024-09-13T18:23:00.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:00.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:00.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:00.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:00.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:00.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:00.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:00.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:00.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:00.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi038", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:23:00.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:00.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:23:00.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-13T18:23:00.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:00 smithi038 ceph-mon[27689]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T18:23:00.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.875+0000 7feb754a9640 1 -- 172.21.15.149:0/143315960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb700ff7e0 msgr2=0x7feb700ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:00.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.875+0000 7feb754a9640 1 --2- 172.21.15.149:0/143315960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb700ff7e0 0x7feb700ffbe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb60009880 tx=0x7feb6002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:23:00.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.875+0000 7feb754a9640 1 -- 172.21.15.149:0/143315960 shutdown_connections 2024-09-13T18:23:00.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.875+0000 7feb754a9640 1 --2- 172.21.15.149:0/143315960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb700ff7e0 0x7feb700ffbe0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:00.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.875+0000 7feb754a9640 1 -- 172.21.15.149:0/143315960 >> 172.21.15.149:0/143315960 conn(0x7feb700faf70 msgr2=0x7feb700fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:00.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.875+0000 7feb754a9640 1 -- 172.21.15.149:0/143315960 shutdown_connections 2024-09-13T18:23:00.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.875+0000 7feb754a9640 1 -- 172.21.15.149:0/143315960 wait complete. 2024-09-13T18:23:00.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.876+0000 7feb754a9640 1 Processor -- start 2024-09-13T18:23:00.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.876+0000 7feb754a9640 1 -- start start 2024-09-13T18:23:00.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.876+0000 7feb754a9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb700ff7e0 0x7feb70194be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:00.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.876+0000 7feb754a9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb70195120 con 0x7feb700ff7e0 2024-09-13T18:23:00.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.876+0000 7feb6effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb700ff7e0 0x7feb70194be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:00.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.876+0000 7feb6effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb700ff7e0 0x7feb70194be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:56016/0 (socket says 172.21.15.149:56016) 2024-09-13T18:23:00.914 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.876+0000 7feb6effd640 1 -- 172.21.15.149:0/759057924 learned_addr learned my addr 172.21.15.149:0/759057924 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.877+0000 7feb6effd640 1 -- 172.21.15.149:0/759057924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60009560 con 0x7feb700ff7e0 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.877+0000 7feb6effd640 1 --2- 172.21.15.149:0/759057924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb700ff7e0 0x7feb70194be0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feb60004cf0 tx=0x7feb60004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.877+0000 7feb57fff640 1 -- 172.21.15.149:0/759057924 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb600053f0 con 0x7feb700ff7e0 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.877+0000 7feb754a9640 1 -- 172.21.15.149:0/759057924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb70195320 con 0x7feb700ff7e0 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.877+0000 7feb57fff640 1 -- 172.21.15.149:0/759057924 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb60005550 con 0x7feb700ff7e0 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.877+0000 7feb57fff640 1 -- 172.21.15.149:0/759057924 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb600319c0 con 0x7feb700ff7e0 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.877+0000 7feb754a9640 1 -- 172.21.15.149:0/759057924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb701957c0 con 0x7feb700ff7e0 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.878+0000 7feb57fff640 1 -- 172.21.15.149:0/759057924 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7feb60031c30 con 0x7feb700ff7e0 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.878+0000 7feb754a9640 1 -- 172.21.15.149:0/759057924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb700ffbe0 con 0x7feb700ff7e0 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.878+0000 7feb57fff640 1 --2- 172.21.15.149:0/759057924 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7feb58038830 0x7feb5803acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.878+0000 7feb57fff640 1 -- 172.21.15.149:0/759057924 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7feb6006c700 con 0x7feb700ff7e0 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.878+0000 7feb6e7fc640 1 --2- 172.21.15.149:0/759057924 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7feb58038830 0x7feb5803acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:00.915 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.879+0000 7feb6e7fc640 1 --2- 172.21.15.149:0/759057924 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7feb58038830 0x7feb5803acf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7feb640098c0 tx=0x7feb64006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:00.916 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:00.883+0000 7feb57fff640 1 -- 172.21.15.149:0/759057924 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7feb6004d960 con 0x7feb700ff7e0 2024-09-13T18:23:01.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:01.119+0000 7feb754a9640 1 -- 172.21.15.149:0/759057924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7feb7018e4d0 con 0x7feb700ff7e0 2024-09-13T18:23:01.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:01.120+0000 7feb57fff640 1 -- 172.21.15.149:0/759057924 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7feb60035020 con 0x7feb700ff7e0 2024-09-13T18:23:01.122 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:23:01.122 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:23:01.123 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:23:01.124 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:01.122+0000 7feb754a9640 1 -- 172.21.15.149:0/759057924 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7feb58038830 msgr2=0x7feb5803acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:01.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:01.122+0000 7feb754a9640 1 --2- 172.21.15.149:0/759057924 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7feb58038830 0x7feb5803acf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7feb640098c0 tx=0x7feb64006db0 comp rx=0 tx=0).stop 2024-09-13T18:23:01.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:01.122+0000 7feb754a9640 1 -- 172.21.15.149:0/759057924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb700ff7e0 msgr2=0x7feb70194be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:01.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:01.122+0000 7feb754a9640 1 --2- 172.21.15.149:0/759057924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb700ff7e0 0x7feb70194be0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feb60004cf0 tx=0x7feb60004d20 comp rx=0 tx=0).stop 2024-09-13T18:23:01.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:01.122+0000 7feb754a9640 1 -- 172.21.15.149:0/759057924 shutdown_connections 2024-09-13T18:23:01.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:01.122+0000 7feb754a9640 1 --2- 172.21.15.149:0/759057924 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7feb58038830 0x7feb5803acf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:01.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:01.122+0000 7feb754a9640 1 --2- 172.21.15.149:0/759057924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feb700ff7e0 0x7feb70194be0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:01.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:01.122+0000 7feb754a9640 1 -- 172.21.15.149:0/759057924 >> 172.21.15.149:0/759057924 conn(0x7feb700faf70 msgr2=0x7feb700fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:01.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:01.122+0000 7feb754a9640 1 -- 172.21.15.149:0/759057924 shutdown_connections 2024-09-13T18:23:01.125 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:01.122+0000 7feb754a9640 1 -- 172.21.15.149:0/759057924 wait complete. 2024-09-13T18:23:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: Updating smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:23:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: Updating smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:23:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:23:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:23:02.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: Updating smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:23:02.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: Updating smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:23:02.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:02.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:02.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:02.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:02.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:02.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T18:23:02.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-13T18:23:02.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:02.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: Deploying daemon ceph-exporter.smithi149 on smithi149 2024-09-13T18:23:02.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:01 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/759057924' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:23:02.688 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:23:02.689 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:23:02.891 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:23:04.561 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.557+0000 7f1a56123640 1 -- 172.21.15.149:0/213066639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a501057a0 msgr2=0x7f1a50105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.557+0000 7f1a56123640 1 --2- 172.21.15.149:0/213066639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a501057a0 0x7f1a50105b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009880 tx=0x7f1a4002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:23:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.557+0000 7f1a56123640 1 -- 172.21.15.149:0/213066639 shutdown_connections 2024-09-13T18:23:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.557+0000 7f1a56123640 1 --2- 172.21.15.149:0/213066639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a501057a0 0x7f1a50105b80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.557+0000 7f1a56123640 1 -- 172.21.15.149:0/213066639 >> 172.21.15.149:0/213066639 conn(0x7f1a50076500 msgr2=0x7f1a50076910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.557+0000 7f1a56123640 1 -- 172.21.15.149:0/213066639 shutdown_connections 2024-09-13T18:23:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.557+0000 7f1a56123640 1 -- 172.21.15.149:0/213066639 wait complete. 2024-09-13T18:23:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.557+0000 7f1a56123640 1 Processor -- start 2024-09-13T18:23:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.558+0000 7f1a56123640 1 -- start start 2024-09-13T18:23:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.558+0000 7f1a56123640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a501057a0 0x7f1a50194f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.558+0000 7f1a56123640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a50195450 con 0x7f1a501057a0 2024-09-13T18:23:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.558+0000 7f1a4f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a501057a0 0x7f1a50194f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.558+0000 7f1a4f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a501057a0 0x7f1a50194f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:56022/0 (socket says 172.21.15.149:56022) 2024-09-13T18:23:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.558+0000 7f1a4f7fe640 1 -- 172.21.15.149:0/1883291413 learned_addr learned my addr 172.21.15.149:0/1883291413 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:23:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.558+0000 7f1a4f7fe640 1 -- 172.21.15.149:0/1883291413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a40009560 con 0x7f1a501057a0 2024-09-13T18:23:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.559+0000 7f1a4f7fe640 1 --2- 172.21.15.149:0/1883291413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a501057a0 0x7f1a50194f10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009230 tx=0x7f1a40005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.559+0000 7f1a4cff9640 1 -- 172.21.15.149:0/1883291413 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a40004b70 con 0x7f1a501057a0 2024-09-13T18:23:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.559+0000 7f1a56123640 1 -- 172.21.15.149:0/1883291413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a501956b0 con 0x7f1a501057a0 2024-09-13T18:23:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.559+0000 7f1a56123640 1 -- 172.21.15.149:0/1883291413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a50195b30 con 0x7f1a501057a0 2024-09-13T18:23:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.559+0000 7f1a4cff9640 1 -- 172.21.15.149:0/1883291413 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a40004cd0 con 0x7f1a501057a0 2024-09-13T18:23:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.559+0000 7f1a4cff9640 1 -- 172.21.15.149:0/1883291413 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a4003c730 con 0x7f1a501057a0 2024-09-13T18:23:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.560+0000 7f1a56123640 1 -- 172.21.15.149:0/1883291413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a500fc9d0 con 0x7f1a501057a0 2024-09-13T18:23:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.560+0000 7f1a4cff9640 1 -- 172.21.15.149:0/1883291413 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f1a40003c90 con 0x7f1a501057a0 2024-09-13T18:23:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.560+0000 7f1a4cff9640 1 --2- 172.21.15.149:0/1883291413 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f1a38038830 0x7f1a3803acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.560+0000 7f1a4cff9640 1 -- 172.21.15.149:0/1883291413 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f1a4006c540 con 0x7f1a501057a0 2024-09-13T18:23:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.561+0000 7f1a4effd640 1 --2- 172.21.15.149:0/1883291413 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f1a38038830 0x7f1a3803acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.561+0000 7f1a4effd640 1 --2- 172.21.15.149:0/1883291413 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f1a38038830 0x7f1a3803acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1a440098c0 tx=0x7f1a44006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:04.567 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.565+0000 7f1a4cff9640 1 -- 172.21.15.149:0/1883291413 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1a4003a540 con 0x7f1a501057a0 2024-09-13T18:23:04.798 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.796+0000 7f1a56123640 1 -- 172.21.15.149:0/1883291413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1a50100e70 con 0x7f1a501057a0 2024-09-13T18:23:04.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.796+0000 7f1a4cff9640 1 -- 172.21.15.149:0/1883291413 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f1a40035090 con 0x7f1a501057a0 2024-09-13T18:23:04.799 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:23:04.799 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:23:04.799 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:23:04.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.799+0000 7f1a56123640 1 -- 172.21.15.149:0/1883291413 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f1a38038830 msgr2=0x7f1a3803acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:04.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.799+0000 7f1a56123640 1 --2- 172.21.15.149:0/1883291413 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f1a38038830 0x7f1a3803acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1a440098c0 tx=0x7f1a44006db0 comp rx=0 tx=0).stop 2024-09-13T18:23:04.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.799+0000 7f1a56123640 1 -- 172.21.15.149:0/1883291413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a501057a0 msgr2=0x7f1a50194f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:04.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.799+0000 7f1a56123640 1 --2- 172.21.15.149:0/1883291413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a501057a0 0x7f1a50194f10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009230 tx=0x7f1a40005650 comp rx=0 tx=0).stop 2024-09-13T18:23:04.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.799+0000 7f1a56123640 1 -- 172.21.15.149:0/1883291413 shutdown_connections 2024-09-13T18:23:04.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.799+0000 7f1a56123640 1 --2- 172.21.15.149:0/1883291413 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f1a38038830 0x7f1a3803acf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:04.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.799+0000 7f1a56123640 1 --2- 172.21.15.149:0/1883291413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1a501057a0 0x7f1a50194f10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:04.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.799+0000 7f1a56123640 1 -- 172.21.15.149:0/1883291413 >> 172.21.15.149:0/1883291413 conn(0x7f1a50076500 msgr2=0x7f1a500fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:04.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.799+0000 7f1a56123640 1 -- 172.21.15.149:0/1883291413 shutdown_connections 2024-09-13T18:23:04.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:04.799+0000 7f1a56123640 1 -- 172.21.15.149:0/1883291413 wait complete. 2024-09-13T18:23:05.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:04 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/1883291413' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:23:06.330 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:23:06.330 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:23:06.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:06.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:06.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:06.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:06.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T18:23:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T18:23:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:06 smithi038 ceph-mon[27689]: Deploying daemon crash.smithi149 on smithi149 2024-09-13T18:23:06.853 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:23:08.678 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.671+0000 7f83ce7fc640 1 -- 172.21.15.149:0/3414585994 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83c00316e0 con 0x7f83d0100a80 2024-09-13T18:23:08.678 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.672+0000 7f83d6245640 1 -- 172.21.15.149:0/3414585994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d0100a80 msgr2=0x7f83d0100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.672+0000 7f83d6245640 1 --2- 172.21.15.149:0/3414585994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d0100a80 0x7f83d0100e60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009880 tx=0x7f83c002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:23:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.672+0000 7f83d6245640 1 -- 172.21.15.149:0/3414585994 shutdown_connections 2024-09-13T18:23:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.672+0000 7f83d6245640 1 --2- 172.21.15.149:0/3414585994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d0100a80 0x7f83d0100e60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.672+0000 7f83d6245640 1 -- 172.21.15.149:0/3414585994 >> 172.21.15.149:0/3414585994 conn(0x7f83d00fa440 msgr2=0x7f83d00fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.672+0000 7f83d6245640 1 -- 172.21.15.149:0/3414585994 shutdown_connections 2024-09-13T18:23:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.672+0000 7f83d6245640 1 -- 172.21.15.149:0/3414585994 wait complete. 2024-09-13T18:23:08.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.672+0000 7f83d6245640 1 Processor -- start 2024-09-13T18:23:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.673+0000 7f83d6245640 1 -- start start 2024-09-13T18:23:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.673+0000 7f83d6245640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d0100a80 0x7f83d0197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.673+0000 7f83d6245640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d01977b0 con 0x7f83d0100a80 2024-09-13T18:23:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.673+0000 7f83cf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d0100a80 0x7f83d0197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.673+0000 7f83cf7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d0100a80 0x7f83d0197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:42756/0 (socket says 172.21.15.149:42756) 2024-09-13T18:23:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.673+0000 7f83cf7fe640 1 -- 172.21.15.149:0/4015323133 learned_addr learned my addr 172.21.15.149:0/4015323133 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:23:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.673+0000 7f83cf7fe640 1 -- 172.21.15.149:0/4015323133 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c0009560 con 0x7f83d0100a80 2024-09-13T18:23:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.674+0000 7f83cf7fe640 1 --2- 172.21.15.149:0/4015323133 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d0100a80 0x7f83d0197270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009230 tx=0x7f83c0005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:08.680 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.674+0000 7f83ccff9640 1 -- 172.21.15.149:0/4015323133 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83c0004b70 con 0x7f83d0100a80 2024-09-13T18:23:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.674+0000 7f83d6245640 1 -- 172.21.15.149:0/4015323133 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d01979b0 con 0x7f83d0100a80 2024-09-13T18:23:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.674+0000 7f83ccff9640 1 -- 172.21.15.149:0/4015323133 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f83c0004cd0 con 0x7f83d0100a80 2024-09-13T18:23:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.674+0000 7f83d6245640 1 -- 172.21.15.149:0/4015323133 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d0197d70 con 0x7f83d0100a80 2024-09-13T18:23:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.674+0000 7f83ccff9640 1 -- 172.21.15.149:0/4015323133 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83c003c830 con 0x7f83d0100a80 2024-09-13T18:23:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.675+0000 7f83ccff9640 1 -- 172.21.15.149:0/4015323133 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f83c00035f0 con 0x7f83d0100a80 2024-09-13T18:23:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.675+0000 7f83d6245640 1 -- 172.21.15.149:0/4015323133 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d0106c50 con 0x7f83d0100a80 2024-09-13T18:23:08.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.675+0000 7f83ccff9640 1 --2- 172.21.15.149:0/4015323133 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f83b8038830 0x7f83b803acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:08.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.675+0000 7f83ccff9640 1 -- 172.21.15.149:0/4015323133 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f83c006c980 con 0x7f83d0100a80 2024-09-13T18:23:08.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.675+0000 7f83ceffd640 1 --2- 172.21.15.149:0/4015323133 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f83b8038830 0x7f83b803acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:08.682 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.676+0000 7f83ceffd640 1 --2- 172.21.15.149:0/4015323133 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f83b8038830 0x7f83b803acf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83c40098c0 tx=0x7f83c4006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:08.683 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.680+0000 7f83ccff9640 1 -- 172.21.15.149:0/4015323133 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f83c00437d0 con 0x7f83d0100a80 2024-09-13T18:23:08.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.922+0000 7f83d6245640 1 -- 172.21.15.149:0/4015323133 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f83d01986b0 con 0x7f83d0100a80 2024-09-13T18:23:08.924 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.922+0000 7f83ccff9640 1 -- 172.21.15.149:0/4015323133 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f83c0035070 con 0x7f83d0100a80 2024-09-13T18:23:08.925 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:23:08.925 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:23:08.925 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:23:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.924+0000 7f83d6245640 1 -- 172.21.15.149:0/4015323133 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f83b8038830 msgr2=0x7f83b803acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.924+0000 7f83d6245640 1 --2- 172.21.15.149:0/4015323133 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f83b8038830 0x7f83b803acf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83c40098c0 tx=0x7f83c4006db0 comp rx=0 tx=0).stop 2024-09-13T18:23:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.924+0000 7f83d6245640 1 -- 172.21.15.149:0/4015323133 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d0100a80 msgr2=0x7f83d0197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.924+0000 7f83d6245640 1 --2- 172.21.15.149:0/4015323133 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d0100a80 0x7f83d0197270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009230 tx=0x7f83c0005650 comp rx=0 tx=0).stop 2024-09-13T18:23:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.924+0000 7f83d6245640 1 -- 172.21.15.149:0/4015323133 shutdown_connections 2024-09-13T18:23:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.924+0000 7f83d6245640 1 --2- 172.21.15.149:0/4015323133 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f83b8038830 0x7f83b803acf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.924+0000 7f83d6245640 1 --2- 172.21.15.149:0/4015323133 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83d0100a80 0x7f83d0197270 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.924+0000 7f83d6245640 1 -- 172.21.15.149:0/4015323133 >> 172.21.15.149:0/4015323133 conn(0x7f83d00fa440 msgr2=0x7f83d0105c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.925+0000 7f83d6245640 1 -- 172.21.15.149:0/4015323133 shutdown_connections 2024-09-13T18:23:08.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:08.925+0000 7f83d6245640 1 -- 172.21.15.149:0/4015323133 wait complete. 2024-09-13T18:23:10.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:09 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:10.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:09 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:10.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:09 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:10.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:09 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:10.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:09 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/4015323133' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:23:10.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:09 smithi038 ceph-mon[27689]: Deploying daemon node-exporter.smithi149 on smithi149 2024-09-13T18:23:10.511 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:23:10.512 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:23:10.708 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:23:11.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:11 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:11.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:11 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:23:13.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.832+0000 7fbdd80e6640 1 -- 172.21.15.149:0/1296587196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd0104670 msgr2=0x7fbdd0104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:13.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.832+0000 7fbdd80e6640 1 --2- 172.21.15.149:0/1296587196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd0104670 0x7fbdd0104a50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009880 tx=0x7fbdcc02a5d0 comp rx=0 tx=0).stop 2024-09-13T18:23:13.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.832+0000 7fbdd80e6640 1 -- 172.21.15.149:0/1296587196 shutdown_connections 2024-09-13T18:23:13.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.832+0000 7fbdd80e6640 1 --2- 172.21.15.149:0/1296587196 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd0104670 0x7fbdd0104a50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:13.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.832+0000 7fbdd80e6640 1 -- 172.21.15.149:0/1296587196 >> 172.21.15.149:0/1296587196 conn(0x7fbdd00fa3b0 msgr2=0x7fbdd00fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:13.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.832+0000 7fbdd80e6640 1 -- 172.21.15.149:0/1296587196 shutdown_connections 2024-09-13T18:23:13.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.832+0000 7fbdd80e6640 1 -- 172.21.15.149:0/1296587196 wait complete. 2024-09-13T18:23:13.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.833+0000 7fbdd80e6640 1 Processor -- start 2024-09-13T18:23:13.837 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.833+0000 7fbdd80e6640 1 -- start start 2024-09-13T18:23:13.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.833+0000 7fbdd80e6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd0104670 0x7fbdd0195000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:13.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.833+0000 7fbdd80e6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0195540 con 0x7fbdd0104670 2024-09-13T18:23:13.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.833+0000 7fbdd5e82640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd0104670 0x7fbdd0195000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:13.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.833+0000 7fbdd5e82640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd0104670 0x7fbdd0195000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:42790/0 (socket says 172.21.15.149:42790) 2024-09-13T18:23:13.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.833+0000 7fbdd5e82640 1 -- 172.21.15.149:0/3025933720 learned_addr learned my addr 172.21.15.149:0/3025933720 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:23:13.838 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.834+0000 7fbdd5e82640 1 -- 172.21.15.149:0/3025933720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc009560 con 0x7fbdd0104670 2024-09-13T18:23:13.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.834+0000 7fbdd5e82640 1 --2- 172.21.15.149:0/3025933720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd0104670 0x7fbdd0195000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009230 tx=0x7fbdcc005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:13.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.834+0000 7fbdc6ffd640 1 -- 172.21.15.149:0/3025933720 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdcc004b70 con 0x7fbdd0104670 2024-09-13T18:23:13.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.834+0000 7fbdc6ffd640 1 -- 172.21.15.149:0/3025933720 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbdcc004cd0 con 0x7fbdd0104670 2024-09-13T18:23:13.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.834+0000 7fbdd80e6640 1 -- 172.21.15.149:0/3025933720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd0195740 con 0x7fbdd0104670 2024-09-13T18:23:13.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.834+0000 7fbdc6ffd640 1 -- 172.21.15.149:0/3025933720 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdcc03c910 con 0x7fbdd0104670 2024-09-13T18:23:13.839 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.834+0000 7fbdd80e6640 1 -- 172.21.15.149:0/3025933720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd0195bc0 con 0x7fbdd0104670 2024-09-13T18:23:13.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.835+0000 7fbdd80e6640 1 -- 172.21.15.149:0/3025933720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd00ffdb0 con 0x7fbdd0104670 2024-09-13T18:23:13.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.835+0000 7fbdc6ffd640 1 -- 172.21.15.149:0/3025933720 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7fbdcc0035f0 con 0x7fbdd0104670 2024-09-13T18:23:13.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.835+0000 7fbdc6ffd640 1 --2- 172.21.15.149:0/3025933720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbdbc038830 0x7fbdbc03acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:13.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.836+0000 7fbdc6ffd640 1 -- 172.21.15.149:0/3025933720 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fbdcc06c720 con 0x7fbdd0104670 2024-09-13T18:23:13.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.836+0000 7fbdd5681640 1 --2- 172.21.15.149:0/3025933720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbdbc038830 0x7fbdbc03acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:13.840 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.836+0000 7fbdd5681640 1 --2- 172.21.15.149:0/3025933720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbdbc038830 0x7fbdbc03acf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00098c0 tx=0x7fbdc0006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:13.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:13.840+0000 7fbdc6ffd640 1 -- 172.21.15.149:0/3025933720 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbdcc03a540 con 0x7fbdd0104670 2024-09-13T18:23:14.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:14.079+0000 7fbdd80e6640 1 -- 172.21.15.149:0/3025933720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbdd0108990 con 0x7fbdd0104670 2024-09-13T18:23:14.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:14.079+0000 7fbdc6ffd640 1 -- 172.21.15.149:0/3025933720 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fbdcc04a090 con 0x7fbdd0104670 2024-09-13T18:23:14.082 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:23:14.082 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:23:14.082 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:23:14.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:14.081+0000 7fbdd80e6640 1 -- 172.21.15.149:0/3025933720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbdbc038830 msgr2=0x7fbdbc03acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:14.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:14.081+0000 7fbdd80e6640 1 --2- 172.21.15.149:0/3025933720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbdbc038830 0x7fbdbc03acf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00098c0 tx=0x7fbdc0006db0 comp rx=0 tx=0).stop 2024-09-13T18:23:14.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:14.081+0000 7fbdd80e6640 1 -- 172.21.15.149:0/3025933720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd0104670 msgr2=0x7fbdd0195000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:14.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:14.081+0000 7fbdd80e6640 1 --2- 172.21.15.149:0/3025933720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd0104670 0x7fbdd0195000 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009230 tx=0x7fbdcc005650 comp rx=0 tx=0).stop 2024-09-13T18:23:14.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:14.082+0000 7fbdd80e6640 1 -- 172.21.15.149:0/3025933720 shutdown_connections 2024-09-13T18:23:14.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:14.082+0000 7fbdd80e6640 1 --2- 172.21.15.149:0/3025933720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbdbc038830 0x7fbdbc03acf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:14.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:14.082+0000 7fbdd80e6640 1 --2- 172.21.15.149:0/3025933720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbdd0104670 0x7fbdd0195000 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:14.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:14.082+0000 7fbdd80e6640 1 -- 172.21.15.149:0/3025933720 >> 172.21.15.149:0/3025933720 conn(0x7fbdd00fa3b0 msgr2=0x7fbdd00fb050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:14.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:14.082+0000 7fbdd80e6640 1 -- 172.21.15.149:0/3025933720 shutdown_connections 2024-09-13T18:23:14.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:14.082+0000 7fbdd80e6640 1 -- 172.21.15.149:0/3025933720 wait complete. 2024-09-13T18:23:14.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:14 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:14.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:14 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:14.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:14 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:14.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:14 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:14.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:14 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.eabzne", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:23:14.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:14 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.eabzne", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T18:23:14.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:14 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:23:14.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:14 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:14.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:14 smithi038 ceph-mon[27689]: Deploying daemon mgr.smithi149.eabzne on smithi149 2024-09-13T18:23:14.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:14 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/3025933720' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:23:15.690 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:23:15.690 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:23:16.431 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:23:16.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:16 smithi038 ceph-mon[27689]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:16.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:16 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:17.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:17 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:17.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:17 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:17.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:17 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:17.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:17 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:17.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:17 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:23:17.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:17 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:17.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:17 smithi038 ceph-mon[27689]: Deploying daemon mon.smithi149 on smithi149 2024-09-13T18:23:17.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:17 smithi038 ceph-mon[27689]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:18.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.493+0000 7f8b2ff60640 1 -- 172.21.15.149:0/248955776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b281009b0 msgr2=0x7f8b28100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:18.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.493+0000 7f8b2ff60640 1 --2- 172.21.15.149:0/248955776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b281009b0 0x7f8b28100d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009880 tx=0x7f8b2402a670 comp rx=0 tx=0).stop 2024-09-13T18:23:18.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.493+0000 7f8b2ff60640 1 -- 172.21.15.149:0/248955776 shutdown_connections 2024-09-13T18:23:18.506 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.493+0000 7f8b2ff60640 1 --2- 172.21.15.149:0/248955776 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b281009b0 0x7f8b28100d90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.493+0000 7f8b2ff60640 1 -- 172.21.15.149:0/248955776 >> 172.21.15.149:0/248955776 conn(0x7f8b28075490 msgr2=0x7f8b280fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.493+0000 7f8b2ff60640 1 -- 172.21.15.149:0/248955776 shutdown_connections 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.493+0000 7f8b2ff60640 1 -- 172.21.15.149:0/248955776 wait complete. 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.494+0000 7f8b2ff60640 1 Processor -- start 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.494+0000 7f8b2ff60640 1 -- start start 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.494+0000 7f8b2ff60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b281009b0 0x7f8b28194ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.494+0000 7f8b2ff60640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b28195400 con 0x7f8b281009b0 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.494+0000 7f8b2dcfc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b281009b0 0x7f8b28194ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.494+0000 7f8b2dcfc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b281009b0 0x7f8b28194ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:58254/0 (socket says 172.21.15.149:58254) 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.494+0000 7f8b2dcfc640 1 -- 172.21.15.149:0/3920411535 learned_addr learned my addr 172.21.15.149:0/3920411535 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.495+0000 7f8b2dcfc640 1 -- 172.21.15.149:0/3920411535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24009560 con 0x7f8b281009b0 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.495+0000 7f8b2dcfc640 1 --2- 172.21.15.149:0/3920411535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b281009b0 0x7f8b28194ec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b24000c00 tx=0x7f8b24004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:18.507 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.495+0000 7f8b1effd640 1 -- 172.21.15.149:0/3920411535 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b240054a0 con 0x7f8b281009b0 2024-09-13T18:23:18.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.495+0000 7f8b2ff60640 1 -- 172.21.15.149:0/3920411535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b28195600 con 0x7f8b281009b0 2024-09-13T18:23:18.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.495+0000 7f8b1effd640 1 -- 172.21.15.149:0/3920411535 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b24005600 con 0x7f8b281009b0 2024-09-13T18:23:18.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.495+0000 7f8b1effd640 1 -- 172.21.15.149:0/3920411535 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b2403c980 con 0x7f8b281009b0 2024-09-13T18:23:18.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.495+0000 7f8b2ff60640 1 -- 172.21.15.149:0/3920411535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b28195a20 con 0x7f8b281009b0 2024-09-13T18:23:18.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.496+0000 7f8b2ff60640 1 -- 172.21.15.149:0/3920411535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b28067ee0 con 0x7f8b281009b0 2024-09-13T18:23:18.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.496+0000 7f8b1effd640 1 -- 172.21.15.149:0/3920411535 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f8b240035f0 con 0x7f8b281009b0 2024-09-13T18:23:18.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.497+0000 7f8b1effd640 1 --2- 172.21.15.149:0/3920411535 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f8b14038830 0x7f8b1403acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:18.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.497+0000 7f8b1effd640 1 -- 172.21.15.149:0/3920411535 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f8b2406c670 con 0x7f8b281009b0 2024-09-13T18:23:18.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.497+0000 7f8b2d4fb640 1 --2- 172.21.15.149:0/3920411535 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f8b14038830 0x7f8b1403acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:18.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.497+0000 7f8b2d4fb640 1 --2- 172.21.15.149:0/3920411535 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f8b14038830 0x7f8b1403acf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8b180098c0 tx=0x7f8b18006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:18.508 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.502+0000 7f8b1effd640 1 -- 172.21.15.149:0/3920411535 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8b24003d90 con 0x7f8b281009b0 2024-09-13T18:23:18.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.738+0000 7f8b2ff60640 1 -- 172.21.15.149:0/3920411535 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8b28109ae0 con 0x7f8b281009b0 2024-09-13T18:23:18.741 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.739+0000 7f8b1effd640 1 -- 172.21.15.149:0/3920411535 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8b24035090 con 0x7f8b281009b0 2024-09-13T18:23:18.742 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:23:18.742 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:20:42.977568Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T18:23:18.742 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-09-13T18:23:18.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.741+0000 7f8b2ff60640 1 -- 172.21.15.149:0/3920411535 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f8b14038830 msgr2=0x7f8b1403acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:18.743 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.741+0000 7f8b2ff60640 1 --2- 172.21.15.149:0/3920411535 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f8b14038830 0x7f8b1403acf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8b180098c0 tx=0x7f8b18006db0 comp rx=0 tx=0).stop 2024-09-13T18:23:18.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.741+0000 7f8b2ff60640 1 -- 172.21.15.149:0/3920411535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b281009b0 msgr2=0x7f8b28194ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:18.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.741+0000 7f8b2ff60640 1 --2- 172.21.15.149:0/3920411535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b281009b0 0x7f8b28194ec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b24000c00 tx=0x7f8b24004c60 comp rx=0 tx=0).stop 2024-09-13T18:23:18.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.741+0000 7f8b2ff60640 1 -- 172.21.15.149:0/3920411535 shutdown_connections 2024-09-13T18:23:18.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.741+0000 7f8b2ff60640 1 --2- 172.21.15.149:0/3920411535 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f8b14038830 0x7f8b1403acf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:18.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.741+0000 7f8b2ff60640 1 --2- 172.21.15.149:0/3920411535 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8b281009b0 0x7f8b28194ec0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:18.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.741+0000 7f8b2ff60640 1 -- 172.21.15.149:0/3920411535 >> 172.21.15.149:0/3920411535 conn(0x7f8b28075490 msgr2=0x7f8b28101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:18.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.741+0000 7f8b2ff60640 1 -- 172.21.15.149:0/3920411535 shutdown_connections 2024-09-13T18:23:18.744 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:18.741+0000 7f8b2ff60640 1 -- 172.21.15.149:0/3920411535 wait complete. 2024-09-13T18:23:19.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:18 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/3920411535' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:23:20.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:19 smithi038 ceph-mon[27689]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:20.906 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:20 smithi149 podman[35826]: 2024-09-13 18:23:20.904653736 +0000 UTC m=+0.172434855 container create 0133a107f35deb6fa5590d40c02761a232f3a5db05c53bada749f805a12c06a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-e4e227b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T18:23:21.173 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 podman[35826]: 2024-09-13 18:23:21.115415627 +0000 UTC m=+0.383196744 container init 0133a107f35deb6fa5590d40c02761a232f3a5db05c53bada749f805a12c06a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=reef-e4e227b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:23:21.173 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 podman[35826]: 2024-09-13 18:23:21.119693998 +0000 UTC m=+0.387475117 container start 0133a107f35deb6fa5590d40c02761a232f3a5db05c53bada749f805a12c06a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=reef-e4e227b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T18:23:21.173 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T18:23:21.173 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable), process ceph-mon, pid 2 2024-09-13T18:23:21.173 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: pidfile_write: ignore empty --pid-file 2024-09-13T18:23:21.173 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: load: jerasure load: lrc 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: RocksDB version: 7.9.2 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Git sha 0 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Compile date 2024-09-13 16:45:57 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: DB SUMMARY 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: DB Session ID: H1OOYRNH0HN7H3VGB46Y 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: CURRENT file: CURRENT 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi149/store.db dir, Total Num: 0, files: 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi149/store.db: 000004.log size: 511 ; 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.error_if_exists: 0 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.create_if_missing: 0 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.paranoid_checks: 1 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T18:23:21.174 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T18:23:21.175 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T18:23:21.175 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.env: 0x564c2a3d6bc0 2024-09-13T18:23:21.175 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T18:23:21.175 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.info_log: 0x564c2ac7adc0 2024-09-13T18:23:21.175 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T18:23:21.175 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.statistics: (nil) 2024-09-13T18:23:21.176 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.use_fsync: 0 2024-09-13T18:23:21.176 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_log_file_size: 0 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.allow_fallocate: 1 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.use_direct_reads: 0 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.db_log_dir: 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.wal_dir: 2024-09-13T18:23:21.177 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T18:23:21.178 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T18:23:21.178 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T18:23:21.178 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T18:23:21.178 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T18:23:21.178 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T18:23:21.178 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T18:23:21.178 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T18:23:21.178 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.write_buffer_manager: 0x564c2ac88320 2024-09-13T18:23:21.178 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.unordered_write: 0 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.row_cache: None 2024-09-13T18:23:21.179 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.wal_filter: None 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.two_write_queues: 0 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.wal_compression: 0 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.atomic_flush: 0 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.log_readahead_size: 0 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T18:23:21.180 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_background_jobs: 2 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_background_compactions: -1 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_subcompactions: 1 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T18:23:21.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_open_files: -1 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_background_flushes: -1 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Compression algorithms supported: 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: kZSTD supported: 0 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: kXpressCompression supported: 0 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: kBZip2Compression supported: 0 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: kLZ4Compression supported: 1 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: kZlibCompression supported: 1 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T18:23:21.182 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: kSnappyCompression supported: 1 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi149/store.db/MANIFEST-000005 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.merge_operator: 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_filter: None 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564c2ac7aa20) 2024-09-13T18:23:21.183 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: cache_index_and_filter_blocks: 1 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: pin_top_level_index_and_filter: 1 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_type: 0 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_block_index_type: 0 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_shortening: 1 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: checksum: 4 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: no_block_cache: 0 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache: 0x564c2ac6f350 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_name: BinnedLRUCache 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_options: 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: capacity : 536870912 2024-09-13T18:23:21.184 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: num_shard_bits : 4 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: strict_capacity_limit : 0 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: high_pri_pool_ratio: 0.000 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_compressed: (nil) 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: persistent_cache: (nil) 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_size: 4096 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_size_deviation: 10 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_restart_interval: 16 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_block_restart_interval: 1 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: metadata_block_size: 4096 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: partition_filters: 0 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: use_delta_encoding: 1 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: filter_policy: bloomfilter 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: whole_key_filtering: 1 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: verify_compression: 0 2024-09-13T18:23:21.185 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: read_amp_bytes_per_bit: 0 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: format_version: 5 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: enable_index_compression: 1 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_align: 0 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_auto_readahead_size: 262144 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: prepopulate_block_cache: 0 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: initial_auto_readahead_size: 8192 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compression: NoCompression 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.num_levels: 7 2024-09-13T18:23:21.186 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T18:23:21.187 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T18:23:21.187 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T18:23:21.187 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T18:23:21.187 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T18:23:21.187 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T18:23:21.187 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T18:23:21.187 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T18:23:21.187 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T18:23:21.187 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T18:23:21.187 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T18:23:21.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T18:23:21.189 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T18:23:21.190 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.inplace_update_support: 0 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.bloom_locality: 0 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.max_successive_merges: 0 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.ttl: 2592000 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T18:23:21.191 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.enable_blob_files: false 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.min_blob_size: 0 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi149/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T18:23:21.192 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1b4a73f2-624c-4634-8cd4-cff87cd2b297 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726251801146758, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726251801147196, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726251801, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1b4a73f2-624c-4634-8cd4-cff87cd2b297", "db_session_id": "H1OOYRNH0HN7H3VGB46Y", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726251801147300, "job": 1, "event": "recovery_finished"} 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi149/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564c2ac9ae00 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: DB pointer 0x564c2ad8e000 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** DB Stats ** 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T18:23:21.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** Compaction Stats [default] ** 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** Compaction Stats [default] ** 2024-09-13T18:23:21.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T18:23:21.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Block cache BinnedLRUCache@0x564c2ac6f350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149 does not exist in monmap, will attempt to join an existing cluster 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: using public_addr v2:172.21.15.149:0/0 -> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: starting mon.smithi149 rank -1 at public addrs [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] at bind addrs [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi149 fsid ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(???) e0 preinit fsid ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).mds e1 new map 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).mds e1 print_map 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: e1 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:23:21.196 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: legacy client fscid: -1 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: No filesystems configured 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:21.197 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.eabzne", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.eabzne", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: Deploying daemon mgr.smithi149.eabzne on smithi149 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='client.? 172.21.15.149:0/3025933720' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:21.198 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:21.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:23:21.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:21.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: Deploying daemon mon.smithi149 on smithi149 2024-09-13T18:23:21.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:21.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: from='client.? 172.21.15.149:0/3920411535' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:23:21.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:21.199 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 ceph-mon[35845]: mon.smithi149@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-13T18:23:21.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 bash[35826]: 0133a107f35deb6fa5590d40c02761a232f3a5db05c53bada749f805a12c06a8 2024-09-13T18:23:21.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:21 smithi149 systemd[1]: Started Ceph mon.smithi149 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:23:21.543 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T18:23:21.544 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T18:23:21.739 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi149/config 2024-09-13T18:23:26.384 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.380+0000 7f3e6a105640 1 -- 172.21.15.149:0/3078615297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e640fed10 msgr2=0x7f3e50005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:26.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.380+0000 7f3e6a105640 1 --2- 172.21.15.149:0/3078615297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e640fed10 0x7f3e50005580 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e54013ce0 tx=0x7f3e5402c350 comp rx=0 tx=0).stop 2024-09-13T18:23:26.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.380+0000 7f3e6a105640 1 -- 172.21.15.149:0/3078615297 shutdown_connections 2024-09-13T18:23:26.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.380+0000 7f3e6a105640 1 --2- 172.21.15.149:0/3078615297 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e640fed10 0x7f3e50005580 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:26.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.380+0000 7f3e6a105640 1 -- 172.21.15.149:0/3078615297 >> 172.21.15.149:0/3078615297 conn(0x7f3e64074620 msgr2=0x7f3e64074a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:26.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.380+0000 7f3e6a105640 1 -- 172.21.15.149:0/3078615297 shutdown_connections 2024-09-13T18:23:26.385 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.380+0000 7f3e6a105640 1 -- 172.21.15.149:0/3078615297 wait complete. 2024-09-13T18:23:26.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.381+0000 7f3e6a105640 1 Processor -- start 2024-09-13T18:23:26.386 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e6a105640 1 -- start start 2024-09-13T18:23:26.386 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:26.387 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:23:26.387 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:26.387 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: mon.smithi038 calling monitor election 2024-09-13T18:23:26.387 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/2151231059' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/crt"}]: dispatch 2024-09-13T18:23:26.387 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:26.387 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:26.387 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:26.387 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: mon.smithi149 calling monitor election 2024-09-13T18:23:26.387 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:26.387 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:26.387 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:26.388 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:23:26.388 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:26.388 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: mon.smithi038 is new leader, mons smithi038,smithi149 in quorum (ranks 0,1) 2024-09-13T18:23:26.388 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: monmap e2: 2 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0],smithi149=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:23:26.388 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: fsmap 2024-09-13T18:23:26.388 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T18:23:26.388 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: mgrmap e17: smithi038.jeygoq(active, since 31s) 2024-09-13T18:23:26.388 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: overall HEALTH_OK 2024-09-13T18:23:26.388 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: Standby manager daemon smithi149.eabzne started 2024-09-13T18:23:26.388 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/2151231059' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:23:26.388 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:26.389 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/2151231059' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/key"}]: dispatch 2024-09-13T18:23:26.389 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/2151231059' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:23:26.389 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:26.389 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:26.389 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:26.389 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:26.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e6a105640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e640fed10 0x7f3e64193000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:26.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e6a105640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e64193540 0x7f3e64197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:26.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e6a105640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64193b40 con 0x7f3e640fed10 2024-09-13T18:23:26.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e6a105640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64193cb0 con 0x7f3e64193540 2024-09-13T18:23:26.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e5bfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e64193540 0x7f3e64197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:26.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e637fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e640fed10 0x7f3e64193000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:26.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e637fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e640fed10 0x7f3e64193000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.149:33844/0 (socket says 172.21.15.149:33844) 2024-09-13T18:23:26.391 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e5bfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e64193540 0x7f3e64197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:56708/0 (socket says 172.21.15.149:56708) 2024-09-13T18:23:26.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e637fe640 1 -- 172.21.15.149:0/2298157723 learned_addr learned my addr 172.21.15.149:0/2298157723 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:23:26.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e5bfff640 1 -- 172.21.15.149:0/2298157723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e64193540 msgr2=0x7f3e64197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T18:23:26.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e5bfff640 1 -- 172.21.15.149:0/2298157723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e64193540 msgr2=0x7f3e64197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:23:26.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e5bfff640 1 --2- 172.21.15.149:0/2298157723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e64193540 0x7f3e64197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:23:26.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.382+0000 7f3e5bfff640 1 --2- 172.21.15.149:0/2298157723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e64193540 0x7f3e64197940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:23:26.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.383+0000 7f3e637fe640 1 -- 172.21.15.149:0/2298157723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e64193540 msgr2=0x7f3e64197940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:23:26.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.383+0000 7f3e637fe640 1 --2- 172.21.15.149:0/2298157723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e64193540 0x7f3e64197940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:26.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.383+0000 7f3e637fe640 1 -- 172.21.15.149:0/2298157723 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e540139c0 con 0x7f3e640fed10 2024-09-13T18:23:26.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.383+0000 7f3e637fe640 1 --2- 172.21.15.149:0/2298157723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e640fed10 0x7f3e64193000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005270 tx=0x7f3e540052a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:26.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.383+0000 7f3e617fa640 1 -- 172.21.15.149:0/2298157723 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e54005650 con 0x7f3e640fed10 2024-09-13T18:23:26.392 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.383+0000 7f3e617fa640 1 -- 172.21.15.149:0/2298157723 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3e54012a60 con 0x7f3e640fed10 2024-09-13T18:23:26.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.383+0000 7f3e617fa640 1 -- 172.21.15.149:0/2298157723 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e54036410 con 0x7f3e640fed10 2024-09-13T18:23:26.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.383+0000 7f3e6a105640 1 -- 172.21.15.149:0/2298157723 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e64197f40 con 0x7f3e640fed10 2024-09-13T18:23:26.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.383+0000 7f3e6a105640 1 -- 172.21.15.149:0/2298157723 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e64198510 con 0x7f3e640fed10 2024-09-13T18:23:26.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.385+0000 7f3e6a105640 1 -- 172.21.15.149:0/2298157723 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e64198780 con 0x7f3e640fed10 2024-09-13T18:23:26.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.385+0000 7f3e617fa640 1 -- 172.21.15.149:0/2298157723 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f3e540125c0 con 0x7f3e640fed10 2024-09-13T18:23:26.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.385+0000 7f3e617fa640 1 --2- 172.21.15.149:0/2298157723 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3e4406ef30 0x7f3e440713f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:26.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.386+0000 7f3e617fa640 1 -- 172.21.15.149:0/2298157723 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f3e540ac500 con 0x7f3e640fed10 2024-09-13T18:23:26.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.386+0000 7f3e5bfff640 1 --2- 172.21.15.149:0/2298157723 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3e4406ef30 0x7f3e440713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:26.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.386+0000 7f3e5bfff640 1 --2- 172.21.15.149:0/2298157723 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3e4406ef30 0x7f3e440713f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c006fd0 tx=0x7f3e4c008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:26.394 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.390+0000 7f3e617fa640 1 -- 172.21.15.149:0/2298157723 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3e54077ba0 con 0x7f3e640fed10 2024-09-13T18:23:26.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:26.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: mon.smithi038 calling monitor election 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/2151231059' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/crt"}]: dispatch 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: mon.smithi149 calling monitor election 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: mon.smithi038 is new leader, mons smithi038,smithi149 in quorum (ranks 0,1) 2024-09-13T18:23:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: monmap e2: 2 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0],smithi149=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: fsmap 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: mgrmap e17: smithi038.jeygoq(active, since 31s) 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: overall HEALTH_OK 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: Standby manager daemon smithi149.eabzne started 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/2151231059' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/2151231059' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/key"}]: dispatch 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/2151231059' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:26.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:26.668 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.665+0000 7f3e6a105640 1 -- 172.21.15.149:0/2298157723 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3e640fe890 con 0x7f3e640fed10 2024-09-13T18:23:26.668 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.666+0000 7f3e617fa640 1 -- 172.21.15.149:0/2298157723 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7f3e54043410 con 0x7f3e640fed10 2024-09-13T18:23:26.668 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-13T18:23:26.669 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":2,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","modified":"2024-09-13T18:23:21.176827Z","created":"2024-09-13T18:20:42.977568Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi038","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:3300","nonce":0},{"type":"v1","addr":"172.21.15.38:6789","nonce":0}]},"addr":"172.21.15.38:6789/0","public_addr":"172.21.15.38:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi149","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T18:23:26.669 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 2 2024-09-13T18:23:26.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.668+0000 7f3e6a105640 1 -- 172.21.15.149:0/2298157723 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3e4406ef30 msgr2=0x7f3e440713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:26.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.668+0000 7f3e6a105640 1 --2- 172.21.15.149:0/2298157723 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3e4406ef30 0x7f3e440713f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c006fd0 tx=0x7f3e4c008040 comp rx=0 tx=0).stop 2024-09-13T18:23:26.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.668+0000 7f3e6a105640 1 -- 172.21.15.149:0/2298157723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e640fed10 msgr2=0x7f3e64193000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:26.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.668+0000 7f3e6a105640 1 --2- 172.21.15.149:0/2298157723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e640fed10 0x7f3e64193000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005270 tx=0x7f3e540052a0 comp rx=0 tx=0).stop 2024-09-13T18:23:26.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.668+0000 7f3e6a105640 1 -- 172.21.15.149:0/2298157723 shutdown_connections 2024-09-13T18:23:26.670 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.668+0000 7f3e6a105640 1 --2- 172.21.15.149:0/2298157723 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3e4406ef30 0x7f3e440713f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:26.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.668+0000 7f3e6a105640 1 --2- 172.21.15.149:0/2298157723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e64193540 0x7f3e64197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:26.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.668+0000 7f3e6a105640 1 --2- 172.21.15.149:0/2298157723 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3e640fed10 0x7f3e64193000 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:26.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.668+0000 7f3e6a105640 1 -- 172.21.15.149:0/2298157723 >> 172.21.15.149:0/2298157723 conn(0x7f3e64074620 msgr2=0x7f3e640fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:26.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.668+0000 7f3e6a105640 1 -- 172.21.15.149:0/2298157723 shutdown_connections 2024-09-13T18:23:26.671 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:23:26.668+0000 7f3e6a105640 1 -- 172.21.15.149:0/2298157723 wait complete. 2024-09-13T18:23:27.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:27 smithi149 ceph-mon[35845]: mgrmap e18: smithi038.jeygoq(active, since 31s), standbys: smithi149.eabzne 2024-09-13T18:23:27.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:27 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr metadata", "who": "smithi149.eabzne", "id": "smithi149.eabzne"}]: dispatch 2024-09-13T18:23:27.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:27 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:23:27.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:27 smithi149 ceph-mon[35845]: from='client.? 172.21.15.149:0/2298157723' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:23:27.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:27 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:27.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:27 smithi038 ceph-mon[27689]: mgrmap e18: smithi038.jeygoq(active, since 31s), standbys: smithi149.eabzne 2024-09-13T18:23:27.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:27 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr metadata", "who": "smithi149.eabzne", "id": "smithi149.eabzne"}]: dispatch 2024-09-13T18:23:27.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:27 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:23:27.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:27 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/2298157723' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T18:23:27.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:27 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:23:27.619 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T18:23:27.620 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T18:23:27.840 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:23:28.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:28 smithi149 ceph-mon[35845]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:28.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:28 smithi038 ceph-mon[27689]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:29.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.623+0000 7f8893b72640 1 -- 172.21.15.38:0/2893966263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f888c0fe720 msgr2=0x7f888c0feb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:29.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.623+0000 7f8893b72640 1 --2- 172.21.15.38:0/2893966263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f888c0fe720 0x7f888c0feb00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8888009880 tx=0x7f888802a5d0 comp rx=0 tx=0).stop 2024-09-13T18:23:29.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.623+0000 7f8893b72640 1 -- 172.21.15.38:0/2893966263 shutdown_connections 2024-09-13T18:23:29.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.623+0000 7f8893b72640 1 --2- 172.21.15.38:0/2893966263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f888c0fe720 0x7f888c0feb00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:29.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.623+0000 7f8893b72640 1 -- 172.21.15.38:0/2893966263 >> 172.21.15.38:0/2893966263 conn(0x7f888c0fa440 msgr2=0x7f888c0fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:29.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.623+0000 7f8893b72640 1 -- 172.21.15.38:0/2893966263 shutdown_connections 2024-09-13T18:23:29.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.623+0000 7f8893b72640 1 -- 172.21.15.38:0/2893966263 wait complete. 2024-09-13T18:23:29.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.624+0000 7f8893b72640 1 Processor -- start 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.624+0000 7f8893b72640 1 -- start start 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.624+0000 7f8893b72640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f888c0fe720 0x7f888c19b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.624+0000 7f8893b72640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f888c19bcc0 0x7f888c19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.624+0000 7f8893b72640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c19c2c0 con 0x7f888c19bcc0 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.624+0000 7f8893b72640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c19c400 con 0x7f888c0fe720 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.624+0000 7f889110d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f888c19bcc0 0x7f888c19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.624+0000 7f889110d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f888c19bcc0 0x7f888c19f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50640/0 (socket says 172.21.15.38:50640) 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.624+0000 7f889110d640 1 -- 172.21.15.38:0/615112362 learned_addr learned my addr 172.21.15.38:0/615112362 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.625+0000 7f889190e640 1 --2- 172.21.15.38:0/615112362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f888c0fe720 0x7f888c19b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.625+0000 7f889110d640 1 -- 172.21.15.38:0/615112362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f888c0fe720 msgr2=0x7f888c19b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.625+0000 7f889110d640 1 --2- 172.21.15.38:0/615112362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f888c0fe720 0x7f888c19b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.625+0000 7f889110d640 1 -- 172.21.15.38:0/615112362 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8888009560 con 0x7f888c19bcc0 2024-09-13T18:23:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.625+0000 7f889190e640 1 --2- 172.21.15.38:0/615112362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f888c0fe720 0x7f888c19b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.625+0000 7f889110d640 1 --2- 172.21.15.38:0/615112362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f888c19bcc0 0x7f888c19f010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f887c00b4a0 tx=0x7f887c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.625+0000 7f8882ffd640 1 -- 172.21.15.38:0/615112362 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f887c0107e0 con 0x7f888c19bcc0 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.625+0000 7f8882ffd640 1 -- 172.21.15.38:0/615112362 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f887c010de0 con 0x7f888c19bcc0 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.625+0000 7f8882ffd640 1 -- 172.21.15.38:0/615112362 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f887c00f360 con 0x7f888c19bcc0 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.625+0000 7f8893b72640 1 -- 172.21.15.38:0/615112362 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888c19f5b0 con 0x7f888c19bcc0 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.625+0000 7f8893b72640 1 -- 172.21.15.38:0/615112362 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888c19fb00 con 0x7f888c19bcc0 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.626+0000 7f8893b72640 1 -- 172.21.15.38:0/615112362 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f888c0687a0 con 0x7f888c19bcc0 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.626+0000 7f8882ffd640 1 -- 172.21.15.38:0/615112362 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f887c017360 con 0x7f888c19bcc0 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.627+0000 7f8882ffd640 1 --2- 172.21.15.38:0/615112362 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f887806cd20 0x7f887806f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.627+0000 7f8882ffd640 1 -- 172.21.15.38:0/615112362 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f887c08ab60 con 0x7f888c19bcc0 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.627+0000 7f889190e640 1 --2- 172.21.15.38:0/615112362 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f887806cd20 0x7f887806f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.627+0000 7f889190e640 1 --2- 172.21.15.38:0/615112362 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f887806cd20 0x7f887806f1e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f88880314f0 tx=0x7f8888005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:29.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.631+0000 7f8882ffd640 1 -- 172.21.15.38:0/615112362 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f887c056010 con 0x7f888c19bcc0 2024-09-13T18:23:29.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.805+0000 7f8893b72640 1 -- 172.21.15.38:0/615112362 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f888c19cae0 con 0x7f888c19bcc0 2024-09-13T18:23:29.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.806+0000 7f8882ffd640 1 -- 172.21.15.38:0/615112362 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f887c08a320 con 0x7f888c19bcc0 2024-09-13T18:23:29.808 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: Updating smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: Updating smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:23:29.809 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:23:29.810 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:29.810 INFO:teuthology.orchestra.run.smithi038.stdout:# minimal ceph.conf for ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:23:29.810 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2024-09-13T18:23:29.810 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:23:29.810 INFO:teuthology.orchestra.run.smithi038.stdout: mon_host = [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-13T18:23:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.808+0000 7f8893b72640 1 -- 172.21.15.38:0/615112362 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f887806cd20 msgr2=0x7f887806f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.808+0000 7f8893b72640 1 --2- 172.21.15.38:0/615112362 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f887806cd20 0x7f887806f1e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f88880314f0 tx=0x7f8888005a20 comp rx=0 tx=0).stop 2024-09-13T18:23:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.808+0000 7f8893b72640 1 -- 172.21.15.38:0/615112362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f888c19bcc0 msgr2=0x7f888c19f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.808+0000 7f8893b72640 1 --2- 172.21.15.38:0/615112362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f888c19bcc0 0x7f888c19f010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f887c00b4a0 tx=0x7f887c00b960 comp rx=0 tx=0).stop 2024-09-13T18:23:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.808+0000 7f8893b72640 1 -- 172.21.15.38:0/615112362 shutdown_connections 2024-09-13T18:23:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.808+0000 7f8893b72640 1 --2- 172.21.15.38:0/615112362 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f887806cd20 0x7f887806f1e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.808+0000 7f8893b72640 1 --2- 172.21.15.38:0/615112362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f888c19bcc0 0x7f888c19f010 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.808+0000 7f8893b72640 1 --2- 172.21.15.38:0/615112362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f888c0fe720 0x7f888c19b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.808+0000 7f8893b72640 1 -- 172.21.15.38:0/615112362 >> 172.21.15.38:0/615112362 conn(0x7f888c0fa440 msgr2=0x7f888c0fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.808+0000 7f8893b72640 1 -- 172.21.15.38:0/615112362 shutdown_connections 2024-09-13T18:23:29.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:29.808+0000 7f8893b72640 1 -- 172.21.15.38:0/615112362 wait complete. 2024-09-13T18:23:30.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:30.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:30.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: Updating smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: Updating smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:23:30.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:23:30.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:30.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:30 smithi149 ceph-mon[35845]: Reconfiguring mon.smithi038 (unknown last config time)... 2024-09-13T18:23:30.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:30 smithi149 ceph-mon[35845]: Reconfiguring daemon mon.smithi038 on smithi038 2024-09-13T18:23:30.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:30 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/615112362' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:30.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:30 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:31.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:30 smithi038 ceph-mon[27689]: Reconfiguring mon.smithi038 (unknown last config time)... 2024-09-13T18:23:31.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:30 smithi038 ceph-mon[27689]: Reconfiguring daemon mon.smithi038 on smithi038 2024-09-13T18:23:31.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:30 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/615112362' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:31.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:30 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:31.568 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T18:23:31.568 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:23:31.568 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T18:23:31.597 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:23:31.597 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:23:31.663 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:23:31.664 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T18:23:31.702 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:23:31.702 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:23:31.772 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T18:23:31.772 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:23:31.772 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:23:31.790 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:23:31.790 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 2024-09-13T18:23:31.846 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:23:31.846 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:31.846 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-13T18:23:31.846 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:31.846 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:23:31.846 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-13 18:22:47.338843390 +0000 2024-09-13T18:23:31.846 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-13 18:17:36.453905000 +0000 2024-09-13T18:23:31.846 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-13 18:17:36.453905000 +0000 2024-09-13T18:23:31.846 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-13 18:17:36.453905000 +0000 2024-09-13T18:23:31.847 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:23:31.921 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-13T18:23:31.921 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-13T18:23:31.921 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000318347 s, 1.6 MB/s 2024-09-13T18:23:31.922 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:23:31.980 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 2024-09-13T18:23:32.037 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:23:32.037 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:32.037 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T18:23:32.037 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:32.037 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:23:32.037 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-13 18:22:47.338843390 +0000 2024-09-13T18:23:32.037 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-13 18:17:36.788898661 +0000 2024-09-13T18:23:32.037 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-13 18:17:36.788898661 +0000 2024-09-13T18:23:32.037 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-13 18:17:36.788898661 +0000 2024-09-13T18:23:32.038 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:23:32.103 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-13T18:23:32.103 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-13T18:23:32.103 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000368345 s, 1.4 MB/s 2024-09-13T18:23:32.104 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:23:32.161 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 2024-09-13T18:23:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:23:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:32.218 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-13T18:23:32.218 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:32.218 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:23:32.218 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-13 18:22:47.338843390 +0000 2024-09-13T18:23:32.218 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-13 18:17:37.134892114 +0000 2024-09-13T18:23:32.218 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-13 18:17:37.134892114 +0000 2024-09-13T18:23:32.218 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-13 18:17:37.134892114 +0000 2024-09-13T18:23:32.219 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:23:32.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:31 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:32.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:31 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:32.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:31 smithi149 ceph-mon[35845]: Reconfiguring mgr.smithi038.jeygoq (unknown last config time)... 2024-09-13T18:23:32.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:31 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.jeygoq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:23:32.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:31 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:23:32.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:31 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:32.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:31 smithi149 ceph-mon[35845]: Reconfiguring daemon mgr.smithi038.jeygoq on smithi038 2024-09-13T18:23:32.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:31 smithi149 ceph-mon[35845]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:32.280 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:31 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:32.280 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:31 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:32.280 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:31 smithi038 ceph-mon[27689]: Reconfiguring mgr.smithi038.jeygoq (unknown last config time)... 2024-09-13T18:23:32.281 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:31 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.jeygoq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:23:32.281 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:31 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:23:32.281 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:31 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:32.281 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:31 smithi038 ceph-mon[27689]: Reconfiguring daemon mgr.smithi038.jeygoq on smithi038 2024-09-13T18:23:32.281 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:31 smithi038 ceph-mon[27689]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:32.282 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-13T18:23:32.283 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-13T18:23:32.283 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000269081 s, 1.9 MB/s 2024-09-13T18:23:32.284 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:23:32.341 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 2024-09-13T18:23:32.398 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:23:32.398 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:32.398 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-13T18:23:32.398 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:32.398 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:23:32.398 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2024-09-13 18:22:47.339843371 +0000 2024-09-13T18:23:32.399 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-13 18:17:37.470885756 +0000 2024-09-13T18:23:32.399 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-13 18:17:37.470885756 +0000 2024-09-13T18:23:32.399 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-13 18:17:37.470885756 +0000 2024-09-13T18:23:32.399 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:23:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2024-09-13T18:23:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2024-09-13T18:23:32.462 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000267451 s, 1.9 MB/s 2024-09-13T18:23:32.463 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:23:32.521 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:23:32.521 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:23:32.539 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:23:32.540 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-09-13T18:23:32.597 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:23:32.597 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:32.597 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 806 Links: 1 2024-09-13T18:23:32.597 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:32.597 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:23:32.597 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-13 18:23:20.562964004 +0000 2024-09-13T18:23:32.597 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-13 18:17:41.462647070 +0000 2024-09-13T18:23:32.598 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-13 18:17:41.462647070 +0000 2024-09-13T18:23:32.598 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-13 18:17:41.462647070 +0000 2024-09-13T18:23:32.598 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:23:32.663 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-13T18:23:32.663 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-13T18:23:32.663 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000227817 s, 2.2 MB/s 2024-09-13T18:23:32.664 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:23:32.722 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-09-13T18:23:32.780 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:23:32.780 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:32.780 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 824 Links: 1 2024-09-13T18:23:32.781 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:32.781 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:23:32.781 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-13 18:23:20.563963983 +0000 2024-09-13T18:23:32.781 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-13 18:17:41.776640348 +0000 2024-09-13T18:23:32.781 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-13 18:17:41.776640348 +0000 2024-09-13T18:23:32.781 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-13 18:17:41.776640348 +0000 2024-09-13T18:23:32.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:23:32.848 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-13T18:23:32.848 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-13T18:23:32.848 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000209711 s, 2.4 MB/s 2024-09-13T18:23:32.849 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:23:32.909 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-09-13T18:23:32.966 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:23:32.966 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:32.967 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 843 Links: 1 2024-09-13T18:23:32.967 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:32.967 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:23:32.967 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-13 18:23:20.563963983 +0000 2024-09-13T18:23:32.967 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-13 18:17:42.110633196 +0000 2024-09-13T18:23:32.967 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-13 18:17:42.110633196 +0000 2024-09-13T18:23:32.967 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-13 18:17:42.110633196 +0000 2024-09-13T18:23:32.967 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:23:33.033 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-13T18:23:33.033 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-13T18:23:33.033 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000178106 s, 2.9 MB/s 2024-09-13T18:23:33.034 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:23:33.093 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-09-13T18:23:33.151 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:23:33.151 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:23:33.151 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 865 Links: 1 2024-09-13T18:23:33.151 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:23:33.151 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:23:33.151 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-13 18:23:20.564963962 +0000 2024-09-13T18:23:33.151 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-13 18:17:42.447625978 +0000 2024-09-13T18:23:33.151 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-13 18:17:42.447625978 +0000 2024-09-13T18:23:33.151 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-13 18:17:42.447625978 +0000 2024-09-13T18:23:33.151 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:23:33.216 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-13T18:23:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-13T18:23:33.217 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.00024733 s, 2.1 MB/s 2024-09-13T18:23:33.218 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:23:33.276 INFO:tasks.cephadm:Deploying osd.0 on smithi038 with /dev/vg_nvme/lv_4... 2024-09-13T18:23:33.276 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T18:23:34.138 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:23:34.190 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:33 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:34.190 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:33 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:34.190 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:33 smithi038 ceph-mon[27689]: Reconfiguring ceph-exporter.smithi038 (monmap changed)... 2024-09-13T18:23:34.190 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:33 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi038", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T18:23:34.190 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:33 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:34.191 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:33 smithi038 ceph-mon[27689]: Reconfiguring daemon ceph-exporter.smithi038 on smithi038 2024-09-13T18:23:34.191 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:33 smithi038 ceph-mon[27689]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:34.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:33 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:34.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:33 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:34.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:33 smithi149 ceph-mon[35845]: Reconfiguring ceph-exporter.smithi038 (monmap changed)... 2024-09-13T18:23:34.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:33 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi038", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T18:23:34.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:33 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:34.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:33 smithi149 ceph-mon[35845]: Reconfiguring daemon ceph-exporter.smithi038 on smithi038 2024-09-13T18:23:34.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:33 smithi149 ceph-mon[35845]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:35.489 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:35 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:35.489 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:35 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:35.489 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:35 smithi149 ceph-mon[35845]: Reconfiguring crash.smithi038 (monmap changed)... 2024-09-13T18:23:35.490 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:35 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T18:23:35.490 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:35 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:35.490 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:35 smithi149 ceph-mon[35845]: Reconfiguring daemon crash.smithi038 on smithi038 2024-09-13T18:23:35.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:35 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:35.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:35 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:35.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:35 smithi038 ceph-mon[27689]: Reconfiguring crash.smithi038 (monmap changed)... 2024-09-13T18:23:35.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:35 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T18:23:35.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:35 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:35.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:35 smithi038 ceph-mon[27689]: Reconfiguring daemon crash.smithi038 on smithi038 2024-09-13T18:23:36.498 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:36 smithi038 ceph-mon[27689]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:36.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:36 smithi149 ceph-mon[35845]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:37.025 INFO:teuthology.orchestra.run.smithi038.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T18:23:37.107 INFO:teuthology.orchestra.run.smithi038.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T18:23:37.126 INFO:teuthology.orchestra.run.smithi038.stderr: stderr: 10+0 records in 2024-09-13T18:23:37.126 INFO:teuthology.orchestra.run.smithi038.stderr:10+0 records out 2024-09-13T18:23:37.126 INFO:teuthology.orchestra.run.smithi038.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0168737 s, 621 MB/s 2024-09-13T18:23:37.126 INFO:teuthology.orchestra.run.smithi038.stderr:--> Zapping successful for: 2024-09-13T18:23:37.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:37 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:37.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:37 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:37.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:37 smithi149 ceph-mon[35845]: Reconfiguring alertmanager.smithi038 (dependencies changed)... 2024-09-13T18:23:37.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:37 smithi149 ceph-mon[35845]: Reconfiguring daemon alertmanager.smithi038 on smithi038 2024-09-13T18:23:37.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:37 smithi149 ceph-mon[35845]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:37.616 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:37 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:37.616 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:37 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:37.616 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:37 smithi038 ceph-mon[27689]: Reconfiguring alertmanager.smithi038 (dependencies changed)... 2024-09-13T18:23:37.616 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:37 smithi038 ceph-mon[27689]: Reconfiguring daemon alertmanager.smithi038 on smithi038 2024-09-13T18:23:37.616 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:37 smithi038 ceph-mon[27689]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:38.337 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi038:vg_nvme/lv_4 2024-09-13T18:23:40.326 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:23:40.454 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:40 smithi038 ceph-mon[27689]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:41.350 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:40 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:23:41.351 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:40 smithi149 ceph-mon[35845]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:41.351 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:40 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:23:42.435 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:42 smithi038 ceph-mon[27689]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:42.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:42 smithi149 ceph-mon[35845]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:42.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.519+0000 7ff32a967640 1 -- 172.21.15.38:0/1267067165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff324100d90 msgr2=0x7ff324101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:42.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.519+0000 7ff32a967640 1 --2- 172.21.15.38:0/1267067165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff324100d90 0x7ff324101210 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff3180097e0 tx=0x7ff31802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:23:42.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.519+0000 7ff32a967640 1 -- 172.21.15.38:0/1267067165 shutdown_connections 2024-09-13T18:23:42.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.519+0000 7ff32a967640 1 --2- 172.21.15.38:0/1267067165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff324100d90 0x7ff324101210 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:42.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.519+0000 7ff32a967640 1 --2- 172.21.15.38:0/1267067165 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3240ffb90 0x7ff3240fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:42.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.519+0000 7ff32a967640 1 -- 172.21.15.38:0/1267067165 >> 172.21.15.38:0/1267067165 conn(0x7ff3240fb320 msgr2=0x7ff3240fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:23:42.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.519+0000 7ff32a967640 1 -- 172.21.15.38:0/1267067165 shutdown_connections 2024-09-13T18:23:42.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.519+0000 7ff32a967640 1 -- 172.21.15.38:0/1267067165 wait complete. 2024-09-13T18:23:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.519+0000 7ff32a967640 1 Processor -- start 2024-09-13T18:23:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.519+0000 7ff32a967640 1 -- start start 2024-09-13T18:23:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.520+0000 7ff32a967640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3240ffb90 0x7ff324195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.520+0000 7ff32a967640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff324100d90 0x7ff324195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.520+0000 7ff32a967640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff324196040 con 0x7ff3240ffb90 2024-09-13T18:23:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.520+0000 7ff32a967640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3241961b0 con 0x7ff324100d90 2024-09-13T18:23:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.520+0000 7ff323fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3240ffb90 0x7ff324195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.520+0000 7ff323fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3240ffb90 0x7ff324195530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54762/0 (socket says 172.21.15.38:54762) 2024-09-13T18:23:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.520+0000 7ff323fff640 1 -- 172.21.15.38:0/2546392408 learned_addr learned my addr 172.21.15.38:0/2546392408 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:23:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.520+0000 7ff3237fe640 1 --2- 172.21.15.38:0/2546392408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff324100d90 0x7ff324195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:42.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.520+0000 7ff323fff640 1 -- 172.21.15.38:0/2546392408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff324100d90 msgr2=0x7ff324195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:23:42.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.520+0000 7ff323fff640 1 --2- 172.21.15.38:0/2546392408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff324100d90 0x7ff324195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:23:42.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.520+0000 7ff323fff640 1 -- 172.21.15.38:0/2546392408 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff318009490 con 0x7ff3240ffb90 2024-09-13T18:23:42.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.520+0000 7ff3237fe640 1 --2- 172.21.15.38:0/2546392408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff324100d90 0x7ff324195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:23:42.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.521+0000 7ff323fff640 1 --2- 172.21.15.38:0/2546392408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3240ffb90 0x7ff324195530 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff31400e9a0 tx=0x7ff31400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:42.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.521+0000 7ff3217fa640 1 -- 172.21.15.38:0/2546392408 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff31400cc90 con 0x7ff3240ffb90 2024-09-13T18:23:42.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.521+0000 7ff32a967640 1 -- 172.21.15.38:0/2546392408 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32419ac50 con 0x7ff3240ffb90 2024-09-13T18:23:42.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.521+0000 7ff3217fa640 1 -- 172.21.15.38:0/2546392408 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff3140044c0 con 0x7ff3240ffb90 2024-09-13T18:23:42.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.521+0000 7ff3217fa640 1 -- 172.21.15.38:0/2546392408 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff314010430 con 0x7ff3240ffb90 2024-09-13T18:23:42.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.521+0000 7ff32a967640 1 -- 172.21.15.38:0/2546392408 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32419b1a0 con 0x7ff3240ffb90 2024-09-13T18:23:42.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.522+0000 7ff32a967640 1 -- 172.21.15.38:0/2546392408 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32418f5d0 con 0x7ff3240ffb90 2024-09-13T18:23:42.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.523+0000 7ff3217fa640 1 -- 172.21.15.38:0/2546392408 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7ff3140036f0 con 0x7ff3240ffb90 2024-09-13T18:23:42.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.523+0000 7ff3217fa640 1 --2- 172.21.15.38:0/2546392408 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff30c06cbd0 0x7ff30c06f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:23:42.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.523+0000 7ff3217fa640 1 -- 172.21.15.38:0/2546392408 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff314014070 con 0x7ff3240ffb90 2024-09-13T18:23:42.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.523+0000 7ff3237fe640 1 --2- 172.21.15.38:0/2546392408 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff30c06cbd0 0x7ff30c06f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:23:42.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.524+0000 7ff3237fe640 1 --2- 172.21.15.38:0/2546392408 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff30c06cbd0 0x7ff30c06f090 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff318030810 tx=0x7ff318005af0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:23:42.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.528+0000 7ff3217fa640 1 -- 172.21.15.38:0/2546392408 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff3140569d0 con 0x7ff3240ffb90 2024-09-13T18:23:42.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:23:42.722+0000 7ff32a967640 1 -- 172.21.15.38:0/2546392408 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff32402c5d0 con 0x7ff30c06cbd0 2024-09-13T18:23:43.391 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:43 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:23:43.391 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:43 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:23:43.391 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:43 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:43.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:43 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:23:43.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:43 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:23:43.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:43 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:44.247 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:44 smithi038 ceph-mon[27689]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:23:44.247 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:44 smithi038 ceph-mon[27689]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:44.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:44 smithi149 ceph-mon[35845]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:23:44.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:44 smithi149 ceph-mon[35845]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:45.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:45 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:45.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:45 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:45.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:45 smithi149 ceph-mon[35845]: Reconfiguring grafana.smithi038 (dependencies changed)... 2024-09-13T18:23:45.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:45 smithi149 ceph-mon[35845]: Reconfiguring daemon grafana.smithi038 on smithi038 2024-09-13T18:23:45.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:45 smithi149 ceph-mon[35845]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:45.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:45 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:45.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:45 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:45.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:45 smithi038 ceph-mon[27689]: Reconfiguring grafana.smithi038 (dependencies changed)... 2024-09-13T18:23:45.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:45 smithi038 ceph-mon[27689]: Reconfiguring daemon grafana.smithi038 on smithi038 2024-09-13T18:23:45.984 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:45 smithi038 ceph-mon[27689]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:47.200 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:46 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1232883354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8245ff4-3301-430c-a290-6000dfd0807f"}]: dispatch 2024-09-13T18:23:47.201 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:46 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1232883354' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8245ff4-3301-430c-a290-6000dfd0807f"}]': finished 2024-09-13T18:23:47.201 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:46 smithi038 ceph-mon[27689]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T18:23:47.201 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:46 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:23:47.201 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:46 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1789809546' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:23:47.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:46 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1232883354' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8245ff4-3301-430c-a290-6000dfd0807f"}]: dispatch 2024-09-13T18:23:47.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:46 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1232883354' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8245ff4-3301-430c-a290-6000dfd0807f"}]': finished 2024-09-13T18:23:47.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:46 smithi149 ceph-mon[35845]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T18:23:47.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:46 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:23:47.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:46 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1789809546' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:23:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:47 smithi038 ceph-mon[27689]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:48.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:47 smithi149 ceph-mon[35845]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:50.504 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:50 smithi038 ceph-mon[27689]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:50.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:50 smithi149 ceph-mon[35845]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:52.297 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:52 smithi038 ceph-mon[27689]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:52.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:52 smithi149 ceph-mon[35845]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:54.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:54 smithi149 ceph-mon[35845]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:54.561 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:54 smithi038 ceph-mon[27689]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:55.429 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:23:55.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:55 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:23:56.409 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:56 smithi038 ceph-mon[27689]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:56.409 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:56.409 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:56.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:56 smithi149 ceph-mon[35845]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:56.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:56.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:23:57.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:57 smithi149 ceph-mon[35845]: Reconfiguring prometheus.smithi038 (dependencies changed)... 2024-09-13T18:23:57.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:57 smithi038 ceph-mon[27689]: Reconfiguring prometheus.smithi038 (dependencies changed)... 2024-09-13T18:23:58.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:58 smithi149 ceph-mon[35845]: Reconfiguring daemon prometheus.smithi038 on smithi038 2024-09-13T18:23:58.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:58 smithi149 ceph-mon[35845]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:58.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:58 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T18:23:58.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:58 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:58.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:58 smithi149 ceph-mon[35845]: Deploying daemon osd.0 on smithi038 2024-09-13T18:23:58.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:58 smithi038 ceph-mon[27689]: Reconfiguring daemon prometheus.smithi038 on smithi038 2024-09-13T18:23:58.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:58 smithi038 ceph-mon[27689]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:58.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:58 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T18:23:58.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:58 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:23:58.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:58 smithi038 ceph-mon[27689]: Deploying daemon osd.0 on smithi038 2024-09-13T18:23:59.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:23:59 smithi038 ceph-mon[27689]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:23:59.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:23:59 smithi149 ceph-mon[35845]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:02.429 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:02 smithi149 ceph-mon[35845]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:02.429 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:02 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:02.429 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:02 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:02.429 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:02 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T18:24:02.429 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:02 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:02.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:02 smithi038 ceph-mon[27689]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:02.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:02 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:02.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:02 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:02.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:02 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T18:24:02.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:02 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:03.436 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:03 smithi038 ceph-mon[27689]: Reconfiguring ceph-exporter.smithi149 (monmap changed)... 2024-09-13T18:24:03.436 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:03 smithi038 ceph-mon[27689]: Reconfiguring daemon ceph-exporter.smithi149 on smithi149 2024-09-13T18:24:03.436 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:03 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:03.437 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:03 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:03.437 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:03 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T18:24:03.437 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:03 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:03.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:03 smithi149 ceph-mon[35845]: Reconfiguring ceph-exporter.smithi149 (monmap changed)... 2024-09-13T18:24:03.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:03 smithi149 ceph-mon[35845]: Reconfiguring daemon ceph-exporter.smithi149 on smithi149 2024-09-13T18:24:03.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:03 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:03 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:03 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T18:24:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:03 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:04.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:04 smithi149 ceph-mon[35845]: Reconfiguring crash.smithi149 (monmap changed)... 2024-09-13T18:24:04.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:04 smithi149 ceph-mon[35845]: Reconfiguring daemon crash.smithi149 on smithi149 2024-09-13T18:24:04.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:04 smithi149 ceph-mon[35845]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:04.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:04.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:04.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.eabzne", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:24:04.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:24:04.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:04.528 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:04 smithi038 ceph-mon[27689]: Reconfiguring crash.smithi149 (monmap changed)... 2024-09-13T18:24:04.529 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:04 smithi038 ceph-mon[27689]: Reconfiguring daemon crash.smithi149 on smithi149 2024-09-13T18:24:04.529 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:04 smithi038 ceph-mon[27689]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:04.529 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:04.529 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:04.529 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.eabzne", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:24:04.529 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:24:04.529 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:05.421 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:05 smithi149 ceph-mon[35845]: Reconfiguring mgr.smithi149.eabzne (monmap changed)... 2024-09-13T18:24:05.421 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:05 smithi149 ceph-mon[35845]: Reconfiguring daemon mgr.smithi149.eabzne on smithi149 2024-09-13T18:24:05.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:05 smithi038 ceph-mon[27689]: Reconfiguring mgr.smithi149.eabzne (monmap changed)... 2024-09-13T18:24:05.460 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:05 smithi038 ceph-mon[27689]: Reconfiguring daemon mgr.smithi149.eabzne on smithi149 2024-09-13T18:24:06.491 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:06 smithi149 ceph-mon[35845]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:06.491 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:06 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:06.491 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:06 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:06.491 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:06 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:24:06.491 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:06 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:24:06.491 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:06 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:06.518 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:06 smithi038 ceph-mon[27689]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:06.518 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:06.518 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:06.518 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:24:06.518 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:24:06.518 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:07.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: Reconfiguring mon.smithi149 (monmap changed)... 2024-09-13T18:24:07.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: Reconfiguring daemon mon.smithi149 on smithi149 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi038.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi038.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi038.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T18:24:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:24:07.538 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: Reconfiguring mon.smithi149 (monmap changed)... 2024-09-13T18:24:07.538 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: Reconfiguring daemon mon.smithi149 on smithi149 2024-09-13T18:24:07.538 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.538 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T18:24:07.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi038.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T18:24:07.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T18:24:07.539 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi038.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T18:24:07.540 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.540 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:24:07.540 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi038.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T18:24:07.540 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:07.540 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:24:08.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:08 smithi149 ceph-mon[35845]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T18:24:08.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:08 smithi149 ceph-mon[35845]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi038.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T18:24:08.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:08 smithi149 ceph-mon[35845]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T18:24:08.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:08 smithi149 ceph-mon[35845]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi038.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T18:24:08.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:08 smithi149 ceph-mon[35845]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:24:08.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:08 smithi149 ceph-mon[35845]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi038.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T18:24:08.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:08 smithi149 ceph-mon[35845]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:08.537 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:08 smithi038 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T18:24:08.537 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:08 smithi038 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi038.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T18:24:08.537 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:08 smithi038 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T18:24:08.537 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:08 smithi038 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi038.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T18:24:08.537 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:08 smithi038 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:24:08.537 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:08 smithi038 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi038.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T18:24:08.537 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:08 smithi038 ceph-mon[27689]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:09.830 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:09 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:09.830 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:09 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:09.830 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:09 smithi038 ceph-mon[27689]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:09 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:09 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:09 smithi149 ceph-mon[35845]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:10.723 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:10 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:24:10.723 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:10 smithi038 ceph-mon[27689]: from='osd.0 [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T18:24:10.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:10.754+0000 7ff3217fa640 1 -- 172.21.15.38:0/2546392408 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff32402c5d0 con 0x7ff30c06cbd0 2024-09-13T18:24:10.757 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 0 on host 'smithi038' 2024-09-13T18:24:10.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:10.756+0000 7ff32a967640 1 -- 172.21.15.38:0/2546392408 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff30c06cbd0 msgr2=0x7ff30c06f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:10.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:10.756+0000 7ff32a967640 1 --2- 172.21.15.38:0/2546392408 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff30c06cbd0 0x7ff30c06f090 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff318030810 tx=0x7ff318005af0 comp rx=0 tx=0).stop 2024-09-13T18:24:10.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:10.756+0000 7ff32a967640 1 -- 172.21.15.38:0/2546392408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3240ffb90 msgr2=0x7ff324195530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:10.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:10.756+0000 7ff32a967640 1 --2- 172.21.15.38:0/2546392408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3240ffb90 0x7ff324195530 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff31400e9a0 tx=0x7ff31400ee60 comp rx=0 tx=0).stop 2024-09-13T18:24:10.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:10.756+0000 7ff32a967640 1 -- 172.21.15.38:0/2546392408 shutdown_connections 2024-09-13T18:24:10.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:10.756+0000 7ff32a967640 1 --2- 172.21.15.38:0/2546392408 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff30c06cbd0 0x7ff30c06f090 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:10.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:10.756+0000 7ff32a967640 1 --2- 172.21.15.38:0/2546392408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff324100d90 0x7ff324195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:10.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:10.756+0000 7ff32a967640 1 --2- 172.21.15.38:0/2546392408 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3240ffb90 0x7ff324195530 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:10.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:10.756+0000 7ff32a967640 1 -- 172.21.15.38:0/2546392408 >> 172.21.15.38:0/2546392408 conn(0x7ff3240fb320 msgr2=0x7ff3241044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:10.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:10.756+0000 7ff32a967640 1 -- 172.21.15.38:0/2546392408 shutdown_connections 2024-09-13T18:24:10.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:10.756+0000 7ff32a967640 1 -- 172.21.15.38:0/2546392408 wait complete. 2024-09-13T18:24:11.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:10 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:24:11.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:10 smithi149 ceph-mon[35845]: from='osd.0 [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T18:24:11.377 DEBUG:teuthology.orchestra.run.smithi038:osd.0> sudo journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T18:24:11.419 INFO:tasks.cephadm:Deploying osd.1 on smithi038 with /dev/vg_nvme/lv_3... 2024-09-13T18:24:11.419 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T18:24:11.713 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:11 smithi038 ceph-mon[27689]: from='osd.0 [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T18:24:11.713 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:11 smithi038 ceph-mon[27689]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T18:24:11.713 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:11 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:24:11.713 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:11 smithi038 ceph-mon[27689]: from='osd.0 [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-13T18:24:11.713 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:11 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:11.713 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:11 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:11.713 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:11 smithi038 ceph-mon[27689]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:11 smithi149 ceph-mon[35845]: from='osd.0 [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T18:24:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:11 smithi149 ceph-mon[35845]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T18:24:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:11 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:24:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:11 smithi149 ceph-mon[35845]: from='osd.0 [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-13T18:24:12.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:11 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:12.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:11 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:12.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:11 smithi149 ceph-mon[35845]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:12.110 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:24:12.551 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:24:12 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0[45914]: 2024-09-13T18:24:12.473+0000 7fc45856e640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T18:24:12.551 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:24:12 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0[45914]: 2024-09-13T18:24:12.482+0000 7fc450ba1640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:24:12.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:12 smithi038 ceph-mon[27689]: from='osd.0 [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-13T18:24:12.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:12 smithi038 ceph-mon[27689]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T18:24:12.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:12 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:24:12.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:12 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:24:12.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:12 smithi038 ceph-mon[27689]: from='osd.0 [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112]' entity='osd.0' 2024-09-13T18:24:13.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:12 smithi149 ceph-mon[35845]: from='osd.0 [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-13T18:24:13.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:12 smithi149 ceph-mon[35845]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T18:24:13.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:12 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:24:13.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:12 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:24:13.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:12 smithi149 ceph-mon[35845]: from='osd.0 [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112]' entity='osd.0' 2024-09-13T18:24:13.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:13 smithi038 ceph-mon[27689]: purged_snaps scrub starts 2024-09-13T18:24:13.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:13 smithi038 ceph-mon[27689]: purged_snaps scrub ok 2024-09-13T18:24:13.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:13 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:24:13.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:13 smithi038 ceph-mon[27689]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:13.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:13 smithi038 ceph-mon[27689]: osd.0 [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112] boot 2024-09-13T18:24:13.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:13 smithi038 ceph-mon[27689]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T18:24:13.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:13 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:24:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:13 smithi149 ceph-mon[35845]: purged_snaps scrub starts 2024-09-13T18:24:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:13 smithi149 ceph-mon[35845]: purged_snaps scrub ok 2024-09-13T18:24:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:13 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:24:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:13 smithi149 ceph-mon[35845]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T18:24:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:13 smithi149 ceph-mon[35845]: osd.0 [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112] boot 2024-09-13T18:24:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:13 smithi149 ceph-mon[35845]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T18:24:14.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:13 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:24:15.097 INFO:teuthology.orchestra.run.smithi038.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T18:24:15.191 INFO:teuthology.orchestra.run.smithi038.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T18:24:15.205 INFO:teuthology.orchestra.run.smithi038.stderr: stderr: 10+0 records in 2024-09-13T18:24:15.205 INFO:teuthology.orchestra.run.smithi038.stderr:10+0 records out 2024-09-13T18:24:15.205 INFO:teuthology.orchestra.run.smithi038.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125732 s, 834 MB/s 2024-09-13T18:24:15.205 INFO:teuthology.orchestra.run.smithi038.stderr:--> Zapping successful for: 2024-09-13T18:24:15.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:15 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:15.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:15 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:15.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:15 smithi149 ceph-mon[35845]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T18:24:15.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:15 smithi149 ceph-mon[35845]: pgmap v38: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:15.802 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:15 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:15.803 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:15 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:15.803 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:15 smithi038 ceph-mon[27689]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T18:24:15.803 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:15 smithi038 ceph-mon[27689]: pgmap v38: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:15.826 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi038:vg_nvme/lv_3 2024-09-13T18:24:16.798 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:24:18.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:18 smithi149 ceph-mon[35845]: pgmap v39: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:18.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:18 smithi038 ceph-mon[27689]: pgmap v39: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:19.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.467+0000 7fa75693d640 1 -- 172.21.15.38:0/3071305206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7501006e0 msgr2=0x7fa750102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:19.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.467+0000 7fa75693d640 1 --2- 172.21.15.38:0/3071305206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7501006e0 0x7fa750102ad0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa740009880 tx=0x7fa74002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:24:19.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.467+0000 7fa75693d640 1 -- 172.21.15.38:0/3071305206 shutdown_connections 2024-09-13T18:24:19.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.467+0000 7fa75693d640 1 --2- 172.21.15.38:0/3071305206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa750103010 0x7fa750105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:19.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.467+0000 7fa75693d640 1 --2- 172.21.15.38:0/3071305206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7501006e0 0x7fa750102ad0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:19.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.467+0000 7fa75693d640 1 -- 172.21.15.38:0/3071305206 >> 172.21.15.38:0/3071305206 conn(0x7fa7500fa280 msgr2=0x7fa7500fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:19.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.467+0000 7fa75693d640 1 -- 172.21.15.38:0/3071305206 shutdown_connections 2024-09-13T18:24:19.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.467+0000 7fa75693d640 1 -- 172.21.15.38:0/3071305206 wait complete. 2024-09-13T18:24:19.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.468+0000 7fa75693d640 1 Processor -- start 2024-09-13T18:24:19.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.468+0000 7fa75693d640 1 -- start start 2024-09-13T18:24:19.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.468+0000 7fa75693d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7501006e0 0x7fa7500ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:19.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.468+0000 7fa75693d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa750103010 0x7fa7500fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.468+0000 7fa75693d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa750100530 con 0x7fa7501006e0 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.468+0000 7fa75693d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7500febd0 con 0x7fa750103010 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.468+0000 7fa74ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7501006e0 0x7fa7500ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.468+0000 7fa74ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7501006e0 0x7fa7500ffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55998/0 (socket says 172.21.15.38:55998) 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.468+0000 7fa74ffff640 1 -- 172.21.15.38:0/2847472054 learned_addr learned my addr 172.21.15.38:0/2847472054 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.468+0000 7fa74f7fe640 1 --2- 172.21.15.38:0/2847472054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa750103010 0x7fa7500fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.469+0000 7fa74ffff640 1 -- 172.21.15.38:0/2847472054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa750103010 msgr2=0x7fa7500fe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.469+0000 7fa74ffff640 1 --2- 172.21.15.38:0/2847472054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa750103010 0x7fa7500fe690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.469+0000 7fa74ffff640 1 -- 172.21.15.38:0/2847472054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740009560 con 0x7fa7501006e0 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.469+0000 7fa74ffff640 1 --2- 172.21.15.38:0/2847472054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7501006e0 0x7fa7500ffff0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa740031460 tx=0x7fa7400056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.469+0000 7fa74d7fa640 1 -- 172.21.15.38:0/2847472054 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa740004ba0 con 0x7fa7501006e0 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.469+0000 7fa75693d640 1 -- 172.21.15.38:0/2847472054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7500feeb0 con 0x7fa7501006e0 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.469+0000 7fa74d7fa640 1 -- 172.21.15.38:0/2847472054 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa740004d00 con 0x7fa7501006e0 2024-09-13T18:24:19.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.469+0000 7fa74d7fa640 1 -- 172.21.15.38:0/2847472054 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa740031a50 con 0x7fa7501006e0 2024-09-13T18:24:19.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.469+0000 7fa75693d640 1 -- 172.21.15.38:0/2847472054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7500ff400 con 0x7fa7501006e0 2024-09-13T18:24:19.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.470+0000 7fa75693d640 1 -- 172.21.15.38:0/2847472054 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa750100ac0 con 0x7fa7501006e0 2024-09-13T18:24:19.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.471+0000 7fa74d7fa640 1 -- 172.21.15.38:0/2847472054 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fa740031cd0 con 0x7fa7501006e0 2024-09-13T18:24:19.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.471+0000 7fa74d7fa640 1 --2- 172.21.15.38:0/2847472054 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa73806cbd0 0x7fa73806f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:19.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.471+0000 7fa74d7fa640 1 -- 172.21.15.38:0/2847472054 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7fa7400ac630 con 0x7fa7501006e0 2024-09-13T18:24:19.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.471+0000 7fa74f7fe640 1 --2- 172.21.15.38:0/2847472054 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa73806cbd0 0x7fa73806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:19.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.472+0000 7fa74f7fe640 1 --2- 172.21.15.38:0/2847472054 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa73806cbd0 0x7fa73806f090 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa7500ffd70 tx=0x7fa74400a2d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:19.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.476+0000 7fa74d7fa640 1 -- 172.21.15.38:0/2847472054 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa740077880 con 0x7fa7501006e0 2024-09-13T18:24:19.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:19.681+0000 7fa75693d640 1 -- 172.21.15.38:0/2847472054 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa750103ab0 con 0x7fa73806cbd0 2024-09-13T18:24:20.252 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: Detected new or changed devices on smithi038 2024-09-13T18:24:20.252 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:20.252 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:20.252 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:20.252 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: Adjusting osd_memory_target on smithi038 to 11844M 2024-09-13T18:24:20.252 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:20.252 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:20.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:24:20.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:20.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:24:20.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:20.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:24:20.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:24:20.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:19 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:20.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: Detected new or changed devices on smithi038 2024-09-13T18:24:20.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:20.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:20.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:20.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: Adjusting osd_memory_target on smithi038 to 11844M 2024-09-13T18:24:20.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:20.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:20.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:24:20.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:20.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:24:20.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:20.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:24:20.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:24:20.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:19 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:21.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:20 smithi038 ceph-mon[27689]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:24:21.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:20 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:21.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:20 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:21.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:20 smithi149 ceph-mon[35845]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:24:21.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:20 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:21.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:20 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:22.238 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:21 smithi038 ceph-mon[27689]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:22.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:21 smithi149 ceph-mon[35845]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:24.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:24 smithi149 ceph-mon[35845]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:24.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:24 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1819878191' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1518b6f4-6e5f-445f-b0cd-2ebaecb3c203"}]: dispatch 2024-09-13T18:24:24.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:24 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1819878191' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1518b6f4-6e5f-445f-b0cd-2ebaecb3c203"}]': finished 2024-09-13T18:24:24.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:24 smithi149 ceph-mon[35845]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T18:24:24.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:24 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:24:24.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:24 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1702558635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:24:24.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:24 smithi038 ceph-mon[27689]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:24.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:24 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1819878191' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1518b6f4-6e5f-445f-b0cd-2ebaecb3c203"}]: dispatch 2024-09-13T18:24:24.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:24 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1819878191' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1518b6f4-6e5f-445f-b0cd-2ebaecb3c203"}]': finished 2024-09-13T18:24:24.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:24 smithi038 ceph-mon[27689]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T18:24:24.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:24 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:24:24.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:24 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1702558635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:24:26.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:26.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:26 smithi149 ceph-mon[35845]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:26.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:24:26.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:26.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:26.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:24:26.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:26.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:26.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:26 smithi038 ceph-mon[27689]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:24:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:24:26.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:28.483 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:28 smithi038 ceph-mon[27689]: pgmap v45: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:28.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:28 smithi149 ceph-mon[35845]: pgmap v45: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:30.441 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:30 smithi038 ceph-mon[27689]: pgmap v46: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:30.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:30 smithi149 ceph-mon[35845]: pgmap v46: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:32.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:32 smithi149 ceph-mon[35845]: pgmap v47: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:32.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:32 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T18:24:32.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:32 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:32.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:32 smithi038 ceph-mon[27689]: pgmap v47: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:32.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:32 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T18:24:32.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:32 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:33.316 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:33 smithi038 ceph-mon[27689]: Deploying daemon osd.1 on smithi038 2024-09-13T18:24:33.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:33 smithi149 ceph-mon[35845]: Deploying daemon osd.1 on smithi038 2024-09-13T18:24:34.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:34 smithi038 ceph-mon[27689]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:34.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:34 smithi149 ceph-mon[35845]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:35.563 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:35 smithi038 ceph-mon[27689]: pgmap v49: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:35.608 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:35 smithi149 ceph-mon[35845]: pgmap v49: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:36.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:36 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:24:36.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:36 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:36.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:36 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:37.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:36 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:24:37.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:36 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:37.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:36 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:37.717 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:37 smithi149 ceph-mon[35845]: pgmap v50: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:37.801 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:37 smithi038 ceph-mon[27689]: pgmap v50: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:39.313 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:39 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:39.313 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:39 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:39.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:39 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:39.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:39 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:39.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:39.644+0000 7fa74d7fa640 1 -- 172.21.15.38:0/2847472054 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa750103ab0 con 0x7fa73806cbd0 2024-09-13T18:24:39.648 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 1 on host 'smithi038' 2024-09-13T18:24:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:39.648+0000 7fa75693d640 1 -- 172.21.15.38:0/2847472054 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa73806cbd0 msgr2=0x7fa73806f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:39.648+0000 7fa75693d640 1 --2- 172.21.15.38:0/2847472054 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa73806cbd0 0x7fa73806f090 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa7500ffd70 tx=0x7fa74400a2d0 comp rx=0 tx=0).stop 2024-09-13T18:24:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:39.649+0000 7fa75693d640 1 -- 172.21.15.38:0/2847472054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7501006e0 msgr2=0x7fa7500ffff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:39.649+0000 7fa75693d640 1 --2- 172.21.15.38:0/2847472054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7501006e0 0x7fa7500ffff0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa740031460 tx=0x7fa7400056e0 comp rx=0 tx=0).stop 2024-09-13T18:24:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:39.649+0000 7fa75693d640 1 -- 172.21.15.38:0/2847472054 shutdown_connections 2024-09-13T18:24:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:39.649+0000 7fa75693d640 1 --2- 172.21.15.38:0/2847472054 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa73806cbd0 0x7fa73806f090 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:39.649+0000 7fa75693d640 1 --2- 172.21.15.38:0/2847472054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa750103010 0x7fa7500fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:39.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:39.649+0000 7fa75693d640 1 --2- 172.21.15.38:0/2847472054 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7501006e0 0x7fa7500ffff0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:39.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:39.649+0000 7fa75693d640 1 -- 172.21.15.38:0/2847472054 >> 172.21.15.38:0/2847472054 conn(0x7fa7500fa280 msgr2=0x7fa7500fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:39.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:39.649+0000 7fa75693d640 1 -- 172.21.15.38:0/2847472054 shutdown_connections 2024-09-13T18:24:39.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:39.649+0000 7fa75693d640 1 -- 172.21.15.38:0/2847472054 wait complete. 2024-09-13T18:24:40.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:40 smithi038 ceph-mon[27689]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:40.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:40 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:40.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:40 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:40.356 DEBUG:teuthology.orchestra.run.smithi038:osd.1> sudo journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T18:24:40.359 INFO:tasks.cephadm:Deploying osd.2 on smithi038 with /dev/vg_nvme/lv_2... 2024-09-13T18:24:40.359 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T18:24:40.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:40 smithi149 ceph-mon[35845]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:40.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:40 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:40.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:40 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:41.120 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:24:41.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:41 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:24:41.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:41 smithi149 ceph-mon[35845]: from='osd.1 [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T18:24:41.564 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:41 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:24:41.564 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:41 smithi038 ceph-mon[27689]: from='osd.1 [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T18:24:42.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:42 smithi149 ceph-mon[35845]: pgmap v52: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:42.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:42 smithi149 ceph-mon[35845]: from='osd.1 [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T18:24:42.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:42 smithi149 ceph-mon[35845]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T18:24:42.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:42 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:24:42.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:42 smithi149 ceph-mon[35845]: from='osd.1 [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-13T18:24:42.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:42 smithi038 ceph-mon[27689]: pgmap v52: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:42.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:42 smithi038 ceph-mon[27689]: from='osd.1 [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T18:24:42.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:42 smithi038 ceph-mon[27689]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T18:24:42.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:42 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:24:42.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:42 smithi038 ceph-mon[27689]: from='osd.1 [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-13T18:24:43.391 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:43 smithi038 ceph-mon[27689]: from='osd.1 [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-13T18:24:43.392 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:43 smithi038 ceph-mon[27689]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T18:24:43.392 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:43 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:24:43.392 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:43 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:24:43.392 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:43 smithi038 ceph-mon[27689]: from='osd.1 [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176]' entity='osd.1' 2024-09-13T18:24:43.392 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:24:43 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1[53752]: 2024-09-13T18:24:43.111+0000 7f8bf43f3640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T18:24:43.392 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:24:43 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1[53752]: 2024-09-13T18:24:43.119+0000 7f8beca26640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:24:43.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:43 smithi149 ceph-mon[35845]: from='osd.1 [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-13T18:24:43.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:43 smithi149 ceph-mon[35845]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T18:24:43.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:43 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:24:43.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:43 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:24:43.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:43 smithi149 ceph-mon[35845]: from='osd.1 [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176]' entity='osd.1' 2024-09-13T18:24:44.085 INFO:teuthology.orchestra.run.smithi038.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T18:24:44.187 INFO:teuthology.orchestra.run.smithi038.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T18:24:44.205 INFO:teuthology.orchestra.run.smithi038.stderr: stderr: 10+0 records in 2024-09-13T18:24:44.205 INFO:teuthology.orchestra.run.smithi038.stderr:10+0 records out 2024-09-13T18:24:44.205 INFO:teuthology.orchestra.run.smithi038.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0145268 s, 722 MB/s 2024-09-13T18:24:44.205 INFO:teuthology.orchestra.run.smithi038.stderr:--> Zapping successful for: 2024-09-13T18:24:44.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:44 smithi149 ceph-mon[35845]: purged_snaps scrub starts 2024-09-13T18:24:44.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:44 smithi149 ceph-mon[35845]: purged_snaps scrub ok 2024-09-13T18:24:44.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:44 smithi149 ceph-mon[35845]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:44.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:24:44.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:44 smithi149 ceph-mon[35845]: osd.1 [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176] boot 2024-09-13T18:24:44.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:44 smithi149 ceph-mon[35845]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T18:24:44.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:24:44.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:44 smithi038 ceph-mon[27689]: purged_snaps scrub starts 2024-09-13T18:24:44.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:44 smithi038 ceph-mon[27689]: purged_snaps scrub ok 2024-09-13T18:24:44.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:44 smithi038 ceph-mon[27689]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T18:24:44.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:24:44.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:44 smithi038 ceph-mon[27689]: osd.1 [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176] boot 2024-09-13T18:24:44.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:44 smithi038 ceph-mon[27689]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T18:24:44.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:24:44.865 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi038:vg_nvme/lv_2 2024-09-13T18:24:45.261 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:24:46.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:46 smithi038 ceph-mon[27689]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:46.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:46 smithi038 ceph-mon[27689]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T18:24:46.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:46 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:46.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:46 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:46.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:46 smithi149 ceph-mon[35845]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:46.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:46 smithi149 ceph-mon[35845]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T18:24:46.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:46 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:46.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:46 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:48.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.291+0000 7f193afac640 1 -- 172.21.15.38:0/3805838891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934100690 msgr2=0x7f1934102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:48.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.291+0000 7f193afac640 1 --2- 172.21.15.38:0/3805838891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934100690 0x7f1934102a80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1928009880 tx=0x7f192802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:24:48.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.291+0000 7f193afac640 1 -- 172.21.15.38:0/3805838891 shutdown_connections 2024-09-13T18:24:48.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.291+0000 7f193afac640 1 --2- 172.21.15.38:0/3805838891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1934102fc0 0x7f19341053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.291+0000 7f193afac640 1 --2- 172.21.15.38:0/3805838891 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934100690 0x7f1934102a80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.291+0000 7f193afac640 1 -- 172.21.15.38:0/3805838891 >> 172.21.15.38:0/3805838891 conn(0x7f19340fa230 msgr2=0x7f19340fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:24:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.291+0000 7f193afac640 1 -- 172.21.15.38:0/3805838891 shutdown_connections 2024-09-13T18:24:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.291+0000 7f193afac640 1 -- 172.21.15.38:0/3805838891 wait complete. 2024-09-13T18:24:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.292+0000 7f193afac640 1 Processor -- start 2024-09-13T18:24:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.292+0000 7f193afac640 1 -- start start 2024-09-13T18:24:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.292+0000 7f193afac640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934100690 0x7f19341955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.292+0000 7f193afac640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1934102fc0 0x7f1934195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.292+0000 7f193afac640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19341960b0 con 0x7f1934100690 2024-09-13T18:24:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.292+0000 7f193afac640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934196220 con 0x7f1934102fc0 2024-09-13T18:24:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.292+0000 7f1938d48640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934100690 0x7f19341955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.292+0000 7f1938d48640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934100690 0x7f19341955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41026/0 (socket says 172.21.15.38:41026) 2024-09-13T18:24:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.292+0000 7f1938d48640 1 -- 172.21.15.38:0/359071485 learned_addr learned my addr 172.21.15.38:0/359071485 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:24:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.293+0000 7f1933fff640 1 --2- 172.21.15.38:0/359071485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1934102fc0 0x7f1934195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.293+0000 7f1938d48640 1 -- 172.21.15.38:0/359071485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1934102fc0 msgr2=0x7f1934195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:24:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.293+0000 7f1938d48640 1 --2- 172.21.15.38:0/359071485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1934102fc0 0x7f1934195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:24:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.293+0000 7f1938d48640 1 -- 172.21.15.38:0/359071485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1928009560 con 0x7f1934100690 2024-09-13T18:24:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.293+0000 7f1938d48640 1 --2- 172.21.15.38:0/359071485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934100690 0x7f19341955a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1928006010 tx=0x7f19280056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:48.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.293+0000 7f1931ffb640 1 -- 172.21.15.38:0/359071485 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1928004c60 con 0x7f1934100690 2024-09-13T18:24:48.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.293+0000 7f1931ffb640 1 -- 172.21.15.38:0/359071485 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1928031a00 con 0x7f1934100690 2024-09-13T18:24:48.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.293+0000 7f193afac640 1 -- 172.21.15.38:0/359071485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193419acc0 con 0x7f1934100690 2024-09-13T18:24:48.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.293+0000 7f1931ffb640 1 -- 172.21.15.38:0/359071485 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1928003bc0 con 0x7f1934100690 2024-09-13T18:24:48.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.293+0000 7f193afac640 1 -- 172.21.15.38:0/359071485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193419b240 con 0x7f1934100690 2024-09-13T18:24:48.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.294+0000 7f193afac640 1 -- 172.21.15.38:0/359071485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1934108680 con 0x7f1934100690 2024-09-13T18:24:48.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.295+0000 7f1931ffb640 1 -- 172.21.15.38:0/359071485 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f1928003df0 con 0x7f1934100690 2024-09-13T18:24:48.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.296+0000 7f1931ffb640 1 --2- 172.21.15.38:0/359071485 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f192406cbd0 0x7f192406f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:24:48.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.296+0000 7f1931ffb640 1 -- 172.21.15.38:0/359071485 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f19280ac7c0 con 0x7f1934100690 2024-09-13T18:24:48.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.296+0000 7f1933fff640 1 --2- 172.21.15.38:0/359071485 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f192406cbd0 0x7f192406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:24:48.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.296+0000 7f1933fff640 1 --2- 172.21.15.38:0/359071485 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f192406cbd0 0x7f192406f090 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1934196ac0 tx=0x7f1920008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:24:48.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.300+0000 7f1931ffb640 1 -- 172.21.15.38:0/359071485 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1928077860 con 0x7f1934100690 2024-09-13T18:24:48.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:48 smithi038 ceph-mon[27689]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:48.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:24:48.483+0000 7f193afac640 1 -- 172.21.15.38:0/359071485 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f193419b430 con 0x7f192406cbd0 2024-09-13T18:24:48.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:48 smithi149 ceph-mon[35845]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:49.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:49 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:24:49.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:49 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:24:49.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:49 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:49.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:49 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:24:49.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:49 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:24:49.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:49 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:50.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:50 smithi149 ceph-mon[35845]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:24:50.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:50 smithi149 ceph-mon[35845]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:50.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:50 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:50.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:50 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:50.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:50 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:50.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:50 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:50.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:50 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:50.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:50 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:50.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:50 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:24:50.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:50 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:50.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:50 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:24:50.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:50 smithi038 ceph-mon[27689]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi038:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:24:50.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:50 smithi038 ceph-mon[27689]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:50.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:50 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:50.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:50 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:50.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:50 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:50.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:50 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:24:50.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:50 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:50.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:50 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:50.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:50 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:24:50.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:50 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:50.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:50 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:24:51.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:51 smithi149 ceph-mon[35845]: Detected new or changed devices on smithi038 2024-09-13T18:24:51.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:51 smithi149 ceph-mon[35845]: Adjusting osd_memory_target on smithi038 to 5922M 2024-09-13T18:24:51.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:51 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:51.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:51 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:51.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:51 smithi038 ceph-mon[27689]: Detected new or changed devices on smithi038 2024-09-13T18:24:51.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:51 smithi038 ceph-mon[27689]: Adjusting osd_memory_target on smithi038 to 5922M 2024-09-13T18:24:51.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:51 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:51.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:51 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:52.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:52 smithi149 ceph-mon[35845]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:52.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:52 smithi038 ceph-mon[27689]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:53.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:53 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1105796395' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43ebe637-fa97-4ac6-b85e-01440f6ca6eb"}]: dispatch 2024-09-13T18:24:53.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:53 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1105796395' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43ebe637-fa97-4ac6-b85e-01440f6ca6eb"}]': finished 2024-09-13T18:24:53.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:53 smithi038 ceph-mon[27689]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T18:24:53.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:53 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:24:53.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:53 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2048155455' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:24:53.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:53 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1105796395' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43ebe637-fa97-4ac6-b85e-01440f6ca6eb"}]: dispatch 2024-09-13T18:24:53.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:53 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1105796395' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43ebe637-fa97-4ac6-b85e-01440f6ca6eb"}]': finished 2024-09-13T18:24:53.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:53 smithi149 ceph-mon[35845]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T18:24:53.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:53 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:24:53.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:53 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/2048155455' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:24:54.766 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:54 smithi038 ceph-mon[27689]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:54.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:54 smithi149 ceph-mon[35845]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:56.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:56.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:56.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:56.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:24:56.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:56.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:56 smithi149 ceph-mon[35845]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:56.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:24:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:24:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:24:56.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:24:56.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:56 smithi038 ceph-mon[27689]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:56.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:24:58.248 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:24:58 smithi038 ceph-mon[27689]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:24:58.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:24:58 smithi149 ceph-mon[35845]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:00.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:00 smithi149 ceph-mon[35845]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:00.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:00 smithi038 ceph-mon[27689]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:01.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:01 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T18:25:01.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:01 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:01.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T18:25:01.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:02.491 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:02 smithi038 ceph-mon[27689]: Deploying daemon osd.2 on smithi038 2024-09-13T18:25:02.491 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:02 smithi038 ceph-mon[27689]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:02.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:02 smithi149 ceph-mon[35845]: Deploying daemon osd.2 on smithi038 2024-09-13T18:25:02.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:02 smithi149 ceph-mon[35845]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:04.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:04 smithi038 ceph-mon[27689]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:04.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:04 smithi149 ceph-mon[35845]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:05.559 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:05 smithi038 ceph-mon[27689]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:05.596 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:05 smithi149 ceph-mon[35845]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:06.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:06.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:06.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:06.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:06 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:06.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:06 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:06.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:06 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:07.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:07 smithi038 ceph-mon[27689]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:07.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:07 smithi149 ceph-mon[35845]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:08.995 INFO:teuthology.orchestra.run.smithi038.stdout:Created osd(s) 2 on host 'smithi038' 2024-09-13T18:25:08.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:25:08.992+0000 7f1931ffb640 1 -- 172.21.15.38:0/359071485 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f193419b430 con 0x7f192406cbd0 2024-09-13T18:25:08.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:25:08.995+0000 7f193afac640 1 -- 172.21.15.38:0/359071485 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f192406cbd0 msgr2=0x7f192406f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:25:08.995+0000 7f193afac640 1 --2- 172.21.15.38:0/359071485 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f192406cbd0 0x7f192406f090 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1934196ac0 tx=0x7f1920008040 comp rx=0 tx=0).stop 2024-09-13T18:25:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:25:08.995+0000 7f193afac640 1 -- 172.21.15.38:0/359071485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934100690 msgr2=0x7f19341955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:25:08.995+0000 7f193afac640 1 --2- 172.21.15.38:0/359071485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934100690 0x7f19341955a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1928006010 tx=0x7f19280056e0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:25:08.995+0000 7f193afac640 1 -- 172.21.15.38:0/359071485 shutdown_connections 2024-09-13T18:25:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:25:08.995+0000 7f193afac640 1 --2- 172.21.15.38:0/359071485 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f192406cbd0 0x7f192406f090 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:25:08.995+0000 7f193afac640 1 --2- 172.21.15.38:0/359071485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1934102fc0 0x7f1934195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:25:08.995+0000 7f193afac640 1 --2- 172.21.15.38:0/359071485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1934100690 0x7f19341955a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:25:08.995+0000 7f193afac640 1 -- 172.21.15.38:0/359071485 >> 172.21.15.38:0/359071485 conn(0x7f19340fa230 msgr2=0x7f19340fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:25:08.995+0000 7f193afac640 1 -- 172.21.15.38:0/359071485 shutdown_connections 2024-09-13T18:25:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:25:08.995+0000 7f193afac640 1 -- 172.21.15.38:0/359071485 wait complete. 2024-09-13T18:25:09.647 DEBUG:teuthology.orchestra.run.smithi038:osd.2> sudo journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T18:25:09.650 INFO:tasks.cephadm:Deploying osd.3 on smithi149 with /dev/vg_nvme/lv_4... 2024-09-13T18:25:09.650 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T18:25:09.854 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi149/config 2024-09-13T18:25:10.218 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:09 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:10.218 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:09 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:10.218 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:09 smithi038 ceph-mon[27689]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:10.218 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:09 smithi038 ceph-mon[27689]: from='osd.2 [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T18:25:10.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:09 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:10.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:09 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:10.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:09 smithi149 ceph-mon[35845]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:10.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:09 smithi149 ceph-mon[35845]: from='osd.2 [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T18:25:11.258 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:11 smithi149 ceph-mon[35845]: from='osd.2 [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T18:25:11.258 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:11 smithi149 ceph-mon[35845]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T18:25:11.258 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:11 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:25:11.258 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:11 smithi149 ceph-mon[35845]: from='osd.2 [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-13T18:25:11.258 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:11 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:25:11.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:11 smithi038 ceph-mon[27689]: from='osd.2 [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T18:25:11.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:11 smithi038 ceph-mon[27689]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T18:25:11.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:11 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:25:11.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:11 smithi038 ceph-mon[27689]: from='osd.2 [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-13T18:25:11.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:11 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:25:11.332 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:25:11 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2[61365]: 2024-09-13T18:25:11.004+0000 7f1b8c26c640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T18:25:11.332 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:25:11 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2[61365]: 2024-09-13T18:25:11.013+0000 7f1b888a7640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:25:11.761 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T18:25:11.856 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T18:25:11.869 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-09-13T18:25:11.869 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-09-13T18:25:11.869 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114661 s, 915 MB/s 2024-09-13T18:25:11.869 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-09-13T18:25:12.215 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:12 smithi149 ceph-mon[35845]: from='osd.2 [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-13T18:25:12.215 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:12 smithi149 ceph-mon[35845]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T18:25:12.216 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:12 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:25:12.216 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:12 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:25:12.216 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:12 smithi149 ceph-mon[35845]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:12.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:12 smithi038 ceph-mon[27689]: from='osd.2 [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]': finished 2024-09-13T18:25:12.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:12 smithi038 ceph-mon[27689]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T18:25:12.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:12 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:25:12.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:12 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:25:12.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:12 smithi038 ceph-mon[27689]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-13T18:25:12.430 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi149:vg_nvme/lv_4 2024-09-13T18:25:12.637 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi149/config 2024-09-13T18:25:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:13 smithi149 ceph-mon[35845]: purged_snaps scrub starts 2024-09-13T18:25:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:13 smithi149 ceph-mon[35845]: purged_snaps scrub ok 2024-09-13T18:25:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:13 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:25:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:13 smithi149 ceph-mon[35845]: osd.2 [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082] boot 2024-09-13T18:25:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:13 smithi149 ceph-mon[35845]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T18:25:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:13 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:25:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:13 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:13 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:13.282 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:13 smithi038 ceph-mon[27689]: purged_snaps scrub starts 2024-09-13T18:25:13.282 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:13 smithi038 ceph-mon[27689]: purged_snaps scrub ok 2024-09-13T18:25:13.282 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:13 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:25:13.282 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:13 smithi038 ceph-mon[27689]: osd.2 [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082] boot 2024-09-13T18:25:13.282 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:13 smithi038 ceph-mon[27689]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T18:25:13.282 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:13 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:25:13.282 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:13 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:13.282 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:13 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:14.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.139+0000 7f5055e01640 1 -- 172.21.15.149:0/562958409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5050100e40 msgr2=0x7f50501012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:14.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.139+0000 7f5055e01640 1 --2- 172.21.15.149:0/562958409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5050100e40 0x7f50501012c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5044009880 tx=0x7f504402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:25:14.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.139+0000 7f5055e01640 1 -- 172.21.15.149:0/562958409 shutdown_connections 2024-09-13T18:25:14.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.139+0000 7f5055e01640 1 --2- 172.21.15.149:0/562958409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5050100e40 0x7f50501012c0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:14.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.139+0000 7f5055e01640 1 --2- 172.21.15.149:0/562958409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50500fde60 0x7f50500fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:14.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.139+0000 7f5055e01640 1 -- 172.21.15.149:0/562958409 >> 172.21.15.149:0/562958409 conn(0x7f50500f99b0 msgr2=0x7f50500fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:14.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.139+0000 7f5055e01640 1 -- 172.21.15.149:0/562958409 shutdown_connections 2024-09-13T18:25:14.144 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.139+0000 7f5055e01640 1 -- 172.21.15.149:0/562958409 wait complete. 2024-09-13T18:25:14.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.140+0000 7f5055e01640 1 Processor -- start 2024-09-13T18:25:14.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.140+0000 7f5055e01640 1 -- start start 2024-09-13T18:25:14.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f5055e01640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50500fde60 0x7f50501007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:14.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f5055e01640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5050100e40 0x7f50500fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:14.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f5055e01640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50500ff330 con 0x7f50500fde60 2024-09-13T18:25:14.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f5055e01640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50500ff4a0 con 0x7f5050100e40 2024-09-13T18:25:14.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f504effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5050100e40 0x7f50500fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:14.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f504effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5050100e40 0x7f50500fedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:57684/0 (socket says 172.21.15.149:57684) 2024-09-13T18:25:14.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f504effd640 1 -- 172.21.15.149:0/985254916 learned_addr learned my addr 172.21.15.149:0/985254916 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:25:14.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f504f7fe640 1 --2- 172.21.15.149:0/985254916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50500fde60 0x7f50501007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:14.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f504effd640 1 -- 172.21.15.149:0/985254916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50500fde60 msgr2=0x7f50501007a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:14.145 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f504effd640 1 --2- 172.21.15.149:0/985254916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50500fde60 0x7f50501007a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:14.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f504effd640 1 -- 172.21.15.149:0/985254916 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044009560 con 0x7f5050100e40 2024-09-13T18:25:14.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f504effd640 1 --2- 172.21.15.149:0/985254916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5050100e40 0x7f50500fedf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5044031460 tx=0x7f5044005610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:14.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f504cff9640 1 -- 172.21.15.149:0/985254916 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5044004b20 con 0x7f5050100e40 2024-09-13T18:25:14.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f504cff9640 1 -- 172.21.15.149:0/985254916 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5044004c80 con 0x7f5050100e40 2024-09-13T18:25:14.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f504cff9640 1 -- 172.21.15.149:0/985254916 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5044031a80 con 0x7f5050100e40 2024-09-13T18:25:14.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f5055e01640 1 -- 172.21.15.149:0/985254916 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50500ff720 con 0x7f5050100e40 2024-09-13T18:25:14.146 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.141+0000 7f5055e01640 1 -- 172.21.15.149:0/985254916 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505019d5a0 con 0x7f5050100e40 2024-09-13T18:25:14.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.142+0000 7f5055e01640 1 -- 172.21.15.149:0/985254916 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50500fe260 con 0x7f5050100e40 2024-09-13T18:25:14.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.143+0000 7f504cff9640 1 -- 172.21.15.149:0/985254916 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f5044031d40 con 0x7f5050100e40 2024-09-13T18:25:14.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.143+0000 7f504cff9640 1 --2- 172.21.15.149:0/985254916 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f503806cbd0 0x7f503806f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:14.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.143+0000 7f504cff9640 1 -- 172.21.15.149:0/985254916 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3221+0+0 (secure 0 0 0) 0x7f50440acaa0 con 0x7f5050100e40 2024-09-13T18:25:14.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.144+0000 7f504f7fe640 1 --2- 172.21.15.149:0/985254916 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f503806cbd0 0x7f503806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:14.147 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.144+0000 7f504f7fe640 1 --2- 172.21.15.149:0/985254916 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f503806cbd0 0x7f503806f090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5050068250 tx=0x7f5040009870 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:14.150 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.148+0000 7f504cff9640 1 -- 172.21.15.149:0/985254916 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5044077810 con 0x7f5050100e40 2024-09-13T18:25:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:14 smithi149 ceph-mon[35845]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T18:25:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:14 smithi149 ceph-mon[35845]: pgmap v77: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:25:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:14 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:25:14.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:14.321+0000 7f5055e01640 1 -- 172.21.15.149:0/985254916 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5050105790 con 0x7f503806cbd0 2024-09-13T18:25:14.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:14 smithi038 ceph-mon[27689]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T18:25:14.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:14 smithi038 ceph-mon[27689]: pgmap v77: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:25:14.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:14 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:25:15.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:15 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T18:25:15.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:15 smithi149 ceph-mon[35845]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T18:25:15.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:15 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:25:15.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:15 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:25:15.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:15 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:25:15.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:15 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:15.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:15 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T18:25:15.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:15 smithi038 ceph-mon[27689]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T18:25:15.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:15 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:25:15.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:15 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:25:15.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:15 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:25:15.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:15 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:16.049 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:25:16.049 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T18:25:16.049 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T18:25:16.049 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:25:16.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:16.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:16.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:25:16.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:25:16.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:25:16.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:16.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:16.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:25:16.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:16.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:16 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:16.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:25:16.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T18:25:16.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T18:25:16.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:25:16.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:16.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:16.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:25:16.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:25:16.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:25:16.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:16.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:16.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:25:16.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:16.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:16 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:16.331 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:25:16 smithi038 sudo[65592]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T18:25:16.331 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:25:16 smithi038 sudo[65592]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:25:16.331 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:25:16 smithi038 sudo[65592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:25:16.331 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:25:16 smithi038 sudo[65592]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:25:16.751 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:25:16 smithi038 sudo[65687]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T18:25:16.751 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:25:16 smithi038 sudo[65687]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:25:16.751 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:25:16 smithi038 sudo[65687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:25:16.751 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:25:16 smithi038 sudo[65687]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:25:17.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:17 smithi149 ceph-mon[35845]: Detected new or changed devices on smithi038 2024-09-13T18:25:17.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:17 smithi149 ceph-mon[35845]: Adjusting osd_memory_target on smithi038 to 3948M 2024-09-13T18:25:17.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:17 smithi149 ceph-mon[35845]: osdmap e23: 3 total, 3 up, 3 in 2024-09-13T18:25:17.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:17 smithi149 ceph-mon[35845]: from='client.? 172.21.15.149:0/1913767878' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ffdedaf-95c7-45b3-9af6-36b5a74d60f0"}]: dispatch 2024-09-13T18:25:17.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:17 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:17.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:17 smithi149 ceph-mon[35845]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ffdedaf-95c7-45b3-9af6-36b5a74d60f0"}]: dispatch 2024-09-13T18:25:17.154 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:17 smithi149 ceph-mon[35845]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ffdedaf-95c7-45b3-9af6-36b5a74d60f0"}]': finished 2024-09-13T18:25:17.155 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:17 smithi149 ceph-mon[35845]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T18:25:17.155 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:17 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:25:17.301 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:25:17 smithi038 sudo[65756]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T18:25:17.301 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:25:17 smithi038 sudo[65756]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:25:17.301 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:25:17 smithi038 sudo[65756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:25:17.301 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:25:17 smithi038 sudo[65756]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:25:17.302 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:17 smithi038 ceph-mon[27689]: Detected new or changed devices on smithi038 2024-09-13T18:25:17.302 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:17 smithi038 ceph-mon[27689]: Adjusting osd_memory_target on smithi038 to 3948M 2024-09-13T18:25:17.302 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:17 smithi038 ceph-mon[27689]: osdmap e23: 3 total, 3 up, 3 in 2024-09-13T18:25:17.302 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:17 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/1913767878' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ffdedaf-95c7-45b3-9af6-36b5a74d60f0"}]: dispatch 2024-09-13T18:25:17.302 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:17 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:17.302 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:17 smithi038 ceph-mon[27689]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ffdedaf-95c7-45b3-9af6-36b5a74d60f0"}]: dispatch 2024-09-13T18:25:17.303 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:17 smithi038 ceph-mon[27689]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ffdedaf-95c7-45b3-9af6-36b5a74d60f0"}]': finished 2024-09-13T18:25:17.303 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:17 smithi038 ceph-mon[27689]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T18:25:17.303 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:17 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:25:17.581 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:25:17 smithi038 sudo[65813]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T18:25:17.581 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:25:17 smithi038 sudo[65813]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:25:17.581 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:25:17 smithi038 sudo[65813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:25:17.581 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:25:17 smithi038 sudo[65813]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:25:18.060 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:18.058+0000 7f504cff9640 1 -- 172.21.15.149:0/985254916 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5044003d00 con 0x7f5050100e40 2024-09-13T18:25:18.206 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:18 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/2807187696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:25:18.206 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:18 smithi038 ceph-mon[27689]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:25:18.206 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:25:17 smithi038 sudo[65861]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T18:25:18.206 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:25:17 smithi038 sudo[65861]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:25:18.206 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:25:17 smithi038 sudo[65861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:25:18.206 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:25:17 smithi038 sudo[65861]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:25:18.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:18 smithi149 ceph-mon[35845]: from='client.? 172.21.15.149:0/2807187696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:25:18.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:18 smithi149 ceph-mon[35845]: pgmap v83: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:25:18.581 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:25:18 smithi038 sudo[65889]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T18:25:18.581 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:25:18 smithi038 sudo[65889]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:25:18.581 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:25:18 smithi038 sudo[65889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:25:18.581 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:25:18 smithi038 sudo[65889]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:25:19.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:18 smithi038 sudo[65963]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T18:25:19.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:18 smithi038 sudo[65963]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:25:19.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:18 smithi038 sudo[65963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:25:19.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:18 smithi038 sudo[65963]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:25:19.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:19 smithi038 sudo[66009]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T18:25:19.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:19 smithi038 sudo[66009]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:25:19.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:19 smithi038 sudo[66009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:25:19.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:19 smithi038 sudo[66009]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:25:19.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:19 smithi038 ceph-mon[27689]: mgrmap e19: smithi038.jeygoq(active, since 2m), standbys: smithi149.eabzne 2024-09-13T18:25:19.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:19 smithi038 ceph-mon[27689]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:25:19.595 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:19 smithi149 ceph-mon[35845]: mgrmap e19: smithi038.jeygoq(active, since 2m), standbys: smithi149.eabzne 2024-09-13T18:25:19.595 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:19 smithi149 ceph-mon[35845]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:25:19.595 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:19 smithi149 sudo[40776]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T18:25:19.595 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:19 smithi149 sudo[40776]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:25:19.596 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:19 smithi149 sudo[40776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:25:19.596 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:19 smithi149 sudo[40776]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:25:20.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:19 smithi149 sudo[40971]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T18:25:20.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:19 smithi149 sudo[40971]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T18:25:20.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:19 smithi149 sudo[40971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T18:25:20.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:19 smithi149 sudo[40971]: pam_unix(sudo:session): session closed for user root 2024-09-13T18:25:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:25:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:25:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:25:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:25:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:25:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:25:20.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:25:20.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:25:20.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:20.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:20.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:20.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:20.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:20 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:25:20.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:25:20.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:25:20.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:25:20.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:25:20.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T18:25:20.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:25:20.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:25:20.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T18:25:20.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:20.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:20.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:20.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:20.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:20 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:25:21.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:21.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:21 smithi149 ceph-mon[35845]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:25:21.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:21 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:21.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:21 smithi038 ceph-mon[27689]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:25:24.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:24 smithi149 ceph-mon[35845]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:25:24.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:24 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T18:25:24.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:24 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:24.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:24 smithi038 ceph-mon[27689]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T18:25:24.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:24 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T18:25:24.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:24 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:25.295 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:25 smithi149 ceph-mon[35845]: Deploying daemon osd.3 on smithi149 2024-09-13T18:25:25.295 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:25 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:25:25.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:25 smithi038 ceph-mon[27689]: Deploying daemon osd.3 on smithi149 2024-09-13T18:25:25.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:25 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:25:26.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:26 smithi149 ceph-mon[35845]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-13T18:25:26.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:26 smithi038 ceph-mon[27689]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-13T18:25:28.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:28 smithi149 ceph-mon[35845]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-13T18:25:28.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:28 smithi038 ceph-mon[27689]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-13T18:25:29.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:29.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:29.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:29 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:29.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:29.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:29.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:29 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:30.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:30 smithi149 ceph-mon[35845]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-13T18:25:30.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:30 smithi038 ceph-mon[27689]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-13T18:25:31.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:31 smithi038 ceph-mon[27689]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-13T18:25:31.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:31 smithi149 ceph-mon[35845]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-13T18:25:32.165 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:32.163+0000 7f504cff9640 1 -- 172.21.15.149:0/985254916 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5050105790 con 0x7f503806cbd0 2024-09-13T18:25:32.166 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 3 on host 'smithi149' 2024-09-13T18:25:32.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:32.166+0000 7f5055e01640 1 -- 172.21.15.149:0/985254916 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f503806cbd0 msgr2=0x7f503806f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:32.166+0000 7f5055e01640 1 --2- 172.21.15.149:0/985254916 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f503806cbd0 0x7f503806f090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5050068250 tx=0x7f5040009870 comp rx=0 tx=0).stop 2024-09-13T18:25:32.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:32.166+0000 7f5055e01640 1 -- 172.21.15.149:0/985254916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5050100e40 msgr2=0x7f50500fedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:32.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:32.166+0000 7f5055e01640 1 --2- 172.21.15.149:0/985254916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5050100e40 0x7f50500fedf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5044031460 tx=0x7f5044005610 comp rx=0 tx=0).stop 2024-09-13T18:25:32.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:32.166+0000 7f5055e01640 1 -- 172.21.15.149:0/985254916 shutdown_connections 2024-09-13T18:25:32.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:32.166+0000 7f5055e01640 1 --2- 172.21.15.149:0/985254916 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f503806cbd0 0x7f503806f090 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:32.166+0000 7f5055e01640 1 --2- 172.21.15.149:0/985254916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5050100e40 0x7f50500fedf0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:32.166+0000 7f5055e01640 1 --2- 172.21.15.149:0/985254916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50500fde60 0x7f50501007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:32.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:32.166+0000 7f5055e01640 1 -- 172.21.15.149:0/985254916 >> 172.21.15.149:0/985254916 conn(0x7f50500f99b0 msgr2=0x7f5050104070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:32.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:32.166+0000 7f5055e01640 1 -- 172.21.15.149:0/985254916 shutdown_connections 2024-09-13T18:25:32.169 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:32.166+0000 7f5055e01640 1 -- 172.21.15.149:0/985254916 wait complete. 2024-09-13T18:25:32.821 DEBUG:teuthology.orchestra.run.smithi149:osd.3> sudo journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T18:25:32.823 INFO:tasks.cephadm:Deploying osd.4 on smithi149 with /dev/vg_nvme/lv_3... 2024-09-13T18:25:32.823 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T18:25:33.064 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi149/config 2024-09-13T18:25:33.478 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:33 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:33.478 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:33 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:33.479 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:33 smithi149 ceph-mon[35845]: from='osd.3 [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T18:25:33.479 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:33 smithi149 ceph-mon[35845]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T18:25:33.479 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:33 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:33.479 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:33 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:33.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:33 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:33.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:33 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:33.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:33 smithi038 ceph-mon[27689]: from='osd.3 [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T18:25:33.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:33 smithi038 ceph-mon[27689]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T18:25:33.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:33 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:33.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:33 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:34.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:34 smithi149 ceph-mon[35845]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T18:25:34.443 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:34 smithi149 ceph-mon[35845]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T18:25:34.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:34 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:25:34.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:34 smithi149 ceph-mon[35845]: from='osd.3 [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:25:34.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:34 smithi149 ceph-mon[35845]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:25:34.444 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:34 smithi149 ceph-mon[35845]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-13T18:25:34.444 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:25:34 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[41836]: 2024-09-13T18:25:34.183+0000 7f6d49ba6640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T18:25:34.444 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:25:34 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[41836]: 2024-09-13T18:25:34.189+0000 7f6d461e1640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:25:34.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:34 smithi038 ceph-mon[27689]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T18:25:34.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:34 smithi038 ceph-mon[27689]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T18:25:34.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:34 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:25:34.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:34 smithi038 ceph-mon[27689]: from='osd.3 [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:25:34.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:34 smithi038 ceph-mon[27689]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:25:34.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:34 smithi038 ceph-mon[27689]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-13T18:25:34.820 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T18:25:34.905 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T18:25:34.921 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-09-13T18:25:34.921 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-09-13T18:25:34.921 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0144031 s, 728 MB/s 2024-09-13T18:25:34.922 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-09-13T18:25:35.375 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:35 smithi149 ceph-mon[35845]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T18:25:35.375 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:35 smithi149 ceph-mon[35845]: osdmap e26: 4 total, 3 up, 4 in 2024-09-13T18:25:35.376 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:35 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:25:35.376 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:35 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:25:35.376 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:35 smithi149 ceph-mon[35845]: osd.3 [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989] boot 2024-09-13T18:25:35.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:35 smithi038 ceph-mon[27689]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T18:25:35.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:35 smithi038 ceph-mon[27689]: osdmap e26: 4 total, 3 up, 4 in 2024-09-13T18:25:35.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:35 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:25:35.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:35 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:25:35.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:35 smithi038 ceph-mon[27689]: osd.3 [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989] boot 2024-09-13T18:25:36.245 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:36 smithi149 ceph-mon[35845]: purged_snaps scrub starts 2024-09-13T18:25:36.245 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:36 smithi149 ceph-mon[35845]: purged_snaps scrub ok 2024-09-13T18:25:36.245 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:36 smithi149 ceph-mon[35845]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T18:25:36.245 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:36 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:25:36.246 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:36 smithi149 ceph-mon[35845]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:36.246 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:36 smithi149 ceph-mon[35845]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T18:25:36.483 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:36 smithi038 ceph-mon[27689]: purged_snaps scrub starts 2024-09-13T18:25:36.483 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:36 smithi038 ceph-mon[27689]: purged_snaps scrub ok 2024-09-13T18:25:36.483 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:36 smithi038 ceph-mon[27689]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T18:25:36.484 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:36 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:25:36.484 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:36 smithi038 ceph-mon[27689]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:36.484 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:36 smithi038 ceph-mon[27689]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T18:25:36.619 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi149:vg_nvme/lv_3 2024-09-13T18:25:36.880 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi149/config 2024-09-13T18:25:37.896 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:37 smithi149 ceph-mon[35845]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T18:25:37.897 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:37 smithi149 ceph-mon[35845]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:38.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:37 smithi038 ceph-mon[27689]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T18:25:38.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:37 smithi038 ceph-mon[27689]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:39.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T18:25:39.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: Detected new or changed devices on smithi149 2024-09-13T18:25:39.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:39.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:39.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:25:39.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: Adjusting osd_memory_target on smithi149 to 3639M 2024-09-13T18:25:39.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:39.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:39.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:25:39.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:39.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:39.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:39.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:25:39.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.043+0000 7f7b9d72f640 1 -- 172.21.15.149:0/3465518518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b980ffba0 msgr2=0x7f7b980fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.043+0000 7f7b9d72f640 1 --2- 172.21.15.149:0/3465518518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b980ffba0 0x7f7b980fffa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009880 tx=0x7f7b8802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b9d72f640 1 -- 172.21.15.149:0/3465518518 shutdown_connections 2024-09-13T18:25:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b9d72f640 1 --2- 172.21.15.149:0/3465518518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b98100da0 0x7f7b98101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b9d72f640 1 --2- 172.21.15.149:0/3465518518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b980ffba0 0x7f7b980fffa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.053 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b9d72f640 1 -- 172.21.15.149:0/3465518518 >> 172.21.15.149:0/3465518518 conn(0x7f7b980fb330 msgr2=0x7f7b980fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b9d72f640 1 -- 172.21.15.149:0/3465518518 shutdown_connections 2024-09-13T18:25:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b9d72f640 1 -- 172.21.15.149:0/3465518518 wait complete. 2024-09-13T18:25:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b9d72f640 1 Processor -- start 2024-09-13T18:25:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b9d72f640 1 -- start start 2024-09-13T18:25:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b9d72f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b980ffba0 0x7f7b98195550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b9d72f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b98100da0 0x7f7b98195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b9d72f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b98196060 con 0x7f7b980ffba0 2024-09-13T18:25:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b9d72f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b981961d0 con 0x7f7b98100da0 2024-09-13T18:25:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b8ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b98100da0 0x7f7b98195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b8ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b98100da0 0x7f7b98195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:58144/0 (socket says 172.21.15.149:58144) 2024-09-13T18:25:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.044+0000 7f7b8ffff640 1 -- 172.21.15.149:0/1098006320 learned_addr learned my addr 172.21.15.149:0/1098006320 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:25:39.054 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.045+0000 7f7b96ffd640 1 --2- 172.21.15.149:0/1098006320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b980ffba0 0x7f7b98195550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.045+0000 7f7b8ffff640 1 -- 172.21.15.149:0/1098006320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b980ffba0 msgr2=0x7f7b98195550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.045+0000 7f7b8ffff640 1 --2- 172.21.15.149:0/1098006320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b980ffba0 0x7f7b98195550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.045+0000 7f7b8ffff640 1 -- 172.21.15.149:0/1098006320 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88009560 con 0x7f7b98100da0 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.045+0000 7f7b96ffd640 1 --2- 172.21.15.149:0/1098006320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b980ffba0 0x7f7b98195550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.045+0000 7f7b8ffff640 1 --2- 172.21.15.149:0/1098006320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b98100da0 0x7f7b98195a90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000e970 tx=0x7f7b8000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.045+0000 7f7b94ff9640 1 -- 172.21.15.149:0/1098006320 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b8000cc90 con 0x7f7b98100da0 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.045+0000 7f7b9d72f640 1 -- 172.21.15.149:0/1098006320 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9819ac70 con 0x7f7b98100da0 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.045+0000 7f7b94ff9640 1 -- 172.21.15.149:0/1098006320 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7b8000cdf0 con 0x7f7b98100da0 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.045+0000 7f7b94ff9640 1 -- 172.21.15.149:0/1098006320 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b80010430 con 0x7f7b98100da0 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.045+0000 7f7b9d72f640 1 -- 172.21.15.149:0/1098006320 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9819b240 con 0x7f7b98100da0 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.046+0000 7f7b9d72f640 1 -- 172.21.15.149:0/1098006320 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b98108670 con 0x7f7b98100da0 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.047+0000 7f7b94ff9640 1 -- 172.21.15.149:0/1098006320 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7b80004ef0 con 0x7f7b98100da0 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.047+0000 7f7b94ff9640 1 --2- 172.21.15.149:0/1098006320 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f7b8406cc50 0x7f7b8406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:25:39.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.047+0000 7f7b94ff9640 1 -- 172.21.15.149:0/1098006320 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f7b80014070 con 0x7f7b98100da0 2024-09-13T18:25:39.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.047+0000 7f7b96ffd640 1 --2- 172.21.15.149:0/1098006320 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f7b8406cc50 0x7f7b8406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:25:39.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.048+0000 7f7b96ffd640 1 --2- 172.21.15.149:0/1098006320 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f7b8406cc50 0x7f7b8406f110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7b88000c00 tx=0x7f7b88031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:25:39.056 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.052+0000 7f7b94ff9640 1 -- 172.21.15.149:0/1098006320 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7b80056ba0 con 0x7f7b98100da0 2024-09-13T18:25:39.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T18:25:39.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: Detected new or changed devices on smithi149 2024-09-13T18:25:39.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:25:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: Adjusting osd_memory_target on smithi149 to 3639M 2024-09-13T18:25:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:25:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:25:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:39.223 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:39.221+0000 7f7b9d72f640 1 -- 172.21.15.149:0/1098006320 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b9819b490 con 0x7f7b8406cc50 2024-09-13T18:25:39.865 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:39 smithi149 ceph-mon[35845]: osdmap e31: 4 total, 4 up, 4 in 2024-09-13T18:25:39.865 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:39 smithi149 ceph-mon[35845]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:39.865 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:39 smithi149 ceph-mon[35845]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:25:39.865 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:39 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:25:39.865 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:39 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:25:39.865 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:39 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:40.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:39 smithi038 ceph-mon[27689]: osdmap e31: 4 total, 4 up, 4 in 2024-09-13T18:25:40.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:39 smithi038 ceph-mon[27689]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:40.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:39 smithi038 ceph-mon[27689]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:25:40.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:39 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:25:40.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:39 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:25:40.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:39 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:41.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:40 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:25:41.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:40 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:25:41.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:41 smithi149 ceph-mon[35845]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-13T18:25:41.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:41 smithi149 ceph-mon[35845]: from='client.? 172.21.15.149:0/2116379404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e91e0c22-0686-45ef-a8b3-a356ab76eb88"}]: dispatch 2024-09-13T18:25:41.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:41 smithi149 ceph-mon[35845]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e91e0c22-0686-45ef-a8b3-a356ab76eb88"}]: dispatch 2024-09-13T18:25:41.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:41 smithi149 ceph-mon[35845]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e91e0c22-0686-45ef-a8b3-a356ab76eb88"}]': finished 2024-09-13T18:25:41.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:41 smithi149 ceph-mon[35845]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T18:25:41.956 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:41 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:25:42.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:41 smithi038 ceph-mon[27689]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-13T18:25:42.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:41 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/2116379404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e91e0c22-0686-45ef-a8b3-a356ab76eb88"}]: dispatch 2024-09-13T18:25:42.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:41 smithi038 ceph-mon[27689]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e91e0c22-0686-45ef-a8b3-a356ab76eb88"}]: dispatch 2024-09-13T18:25:42.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:41 smithi038 ceph-mon[27689]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e91e0c22-0686-45ef-a8b3-a356ab76eb88"}]': finished 2024-09-13T18:25:42.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:41 smithi038 ceph-mon[27689]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T18:25:42.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:41 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:25:43.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:42 smithi149 ceph-mon[35845]: from='client.? 172.21.15.149:0/2940102572' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:25:43.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:42 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/2940102572' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:25:44.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:43 smithi038 ceph-mon[27689]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T18:25:44.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:43 smithi149 ceph-mon[35845]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T18:25:46.487 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:46 smithi149 ceph-mon[35845]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-13T18:25:46.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:46 smithi038 ceph-mon[27689]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-13T18:25:48.313 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:48 smithi149 ceph-mon[35845]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-13T18:25:48.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:48 smithi038 ceph-mon[27689]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-13T18:25:49.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:49 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T18:25:49.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:49 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:49.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:49 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T18:25:49.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:49 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:25:50.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:50 smithi149 ceph-mon[35845]: Deploying daemon osd.4 on smithi149 2024-09-13T18:25:50.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:50 smithi149 ceph-mon[35845]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T18:25:50.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:50 smithi038 ceph-mon[27689]: Deploying daemon osd.4 on smithi149 2024-09-13T18:25:50.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:50 smithi038 ceph-mon[27689]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T18:25:52.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:52 smithi149 ceph-mon[35845]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:52.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:52 smithi038 ceph-mon[27689]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:53.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:53 smithi038 ceph-mon[27689]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:53.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:53 smithi149 ceph-mon[35845]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:54.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:54 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:54.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:54 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:54.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:54 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:54.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:54 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:25:54.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:54 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:54.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:54 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:55.468 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:55 smithi149 ceph-mon[35845]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:55.469 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:55 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:25:55.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:55 smithi038 ceph-mon[27689]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:55.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:25:56.451 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:56.448+0000 7f7b94ff9640 1 -- 172.21.15.149:0/1098006320 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7b9819b490 con 0x7f7b8406cc50 2024-09-13T18:25:56.452 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 4 on host 'smithi149' 2024-09-13T18:25:56.454 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:56.452+0000 7f7b9d72f640 1 -- 172.21.15.149:0/1098006320 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f7b8406cc50 msgr2=0x7f7b8406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:56.452+0000 7f7b9d72f640 1 --2- 172.21.15.149:0/1098006320 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f7b8406cc50 0x7f7b8406f110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7b88000c00 tx=0x7f7b88031400 comp rx=0 tx=0).stop 2024-09-13T18:25:56.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:56.452+0000 7f7b9d72f640 1 -- 172.21.15.149:0/1098006320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b98100da0 msgr2=0x7f7b98195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:25:56.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:56.452+0000 7f7b9d72f640 1 --2- 172.21.15.149:0/1098006320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b98100da0 0x7f7b98195a90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000e970 tx=0x7f7b8000ed70 comp rx=0 tx=0).stop 2024-09-13T18:25:56.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:56.452+0000 7f7b9d72f640 1 -- 172.21.15.149:0/1098006320 shutdown_connections 2024-09-13T18:25:56.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:56.452+0000 7f7b9d72f640 1 --2- 172.21.15.149:0/1098006320 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f7b8406cc50 0x7f7b8406f110 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:56.452+0000 7f7b9d72f640 1 --2- 172.21.15.149:0/1098006320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b98100da0 0x7f7b98195a90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:56.452+0000 7f7b9d72f640 1 --2- 172.21.15.149:0/1098006320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7b980ffba0 0x7f7b98195550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:25:56.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:56.452+0000 7f7b9d72f640 1 -- 172.21.15.149:0/1098006320 >> 172.21.15.149:0/1098006320 conn(0x7f7b980fb330 msgr2=0x7f7b98103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:25:56.455 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:56.452+0000 7f7b9d72f640 1 -- 172.21.15.149:0/1098006320 shutdown_connections 2024-09-13T18:25:56.456 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:25:56.452+0000 7f7b9d72f640 1 -- 172.21.15.149:0/1098006320 wait complete. 2024-09-13T18:25:57.061 DEBUG:teuthology.orchestra.run.smithi149:osd.4> sudo journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T18:25:57.063 INFO:tasks.cephadm:Deploying osd.5 on smithi149 with /dev/vg_nvme/lv_2... 2024-09-13T18:25:57.063 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T18:25:57.746 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi149/config 2024-09-13T18:25:57.754 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:57 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:57.754 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:57 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:57.754 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:57 smithi149 ceph-mon[35845]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:57.755 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:57 smithi149 ceph-mon[35845]: from='osd.4 [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:25:57.755 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:57 smithi149 ceph-mon[35845]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:25:57.755 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:25:57 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[48231]: 2024-09-13T18:25:57.384+0000 7f9c6ebfc640 -1 osd.4 0 log_to_monitors true 2024-09-13T18:25:57.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:57 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:57.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:57 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:57.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:57 smithi038 ceph-mon[27689]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:57.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:57 smithi038 ceph-mon[27689]: from='osd.4 [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:25:57.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:57 smithi038 ceph-mon[27689]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:25:58.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:58 smithi149 ceph-mon[35845]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T18:25:58.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:58 smithi149 ceph-mon[35845]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T18:25:58.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:58 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:25:58.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:58 smithi149 ceph-mon[35845]: from='osd.4 [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:25:58.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:58 smithi149 ceph-mon[35845]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:25:58.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:58 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:58.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:58 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:58.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:58 smithi038 ceph-mon[27689]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T18:25:58.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:58 smithi038 ceph-mon[27689]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T18:25:58.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:58 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:25:58.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:58 smithi038 ceph-mon[27689]: from='osd.4 [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:25:58.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:58 smithi038 ceph-mon[27689]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:25:58.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:58 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:58.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:58 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:25:59.404 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:25:59 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[48231]: 2024-09-13T18:25:59.285+0000 7f9c6bb95640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T18:25:59.404 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:25:59 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[48231]: 2024-09-13T18:25:59.294+0000 7f9c6298d640 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:25:59.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:59 smithi149 ceph-mon[35845]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T18:25:59.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:59 smithi149 ceph-mon[35845]: osdmap e34: 5 total, 4 up, 5 in 2024-09-13T18:25:59.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:59 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:25:59.715 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:59 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:25:59.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:59 smithi149 ceph-mon[35845]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:59.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:59 smithi149 ceph-mon[35845]: from='osd.4 ' entity='osd.4' 2024-09-13T18:25:59.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:59 smithi149 ceph-mon[35845]: osd.4 [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615] boot 2024-09-13T18:25:59.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:59 smithi149 ceph-mon[35845]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T18:25:59.716 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:25:59 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:25:59.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:59 smithi038 ceph-mon[27689]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T18:25:59.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:59 smithi038 ceph-mon[27689]: osdmap e34: 5 total, 4 up, 5 in 2024-09-13T18:25:59.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:59 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:25:59.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:59 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:25:59.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:59 smithi038 ceph-mon[27689]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-13T18:25:59.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:59 smithi038 ceph-mon[27689]: from='osd.4 ' entity='osd.4' 2024-09-13T18:25:59.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:59 smithi038 ceph-mon[27689]: osd.4 [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615] boot 2024-09-13T18:25:59.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:59 smithi038 ceph-mon[27689]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T18:25:59.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:25:59 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:25:59.884 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T18:25:59.969 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T18:25:59.984 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-09-13T18:25:59.984 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-09-13T18:25:59.984 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.012503 s, 839 MB/s 2024-09-13T18:25:59.984 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-09-13T18:26:00.721 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:00 smithi149 ceph-mon[35845]: purged_snaps scrub starts 2024-09-13T18:26:00.721 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:00 smithi149 ceph-mon[35845]: purged_snaps scrub ok 2024-09-13T18:26:00.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:00 smithi038 ceph-mon[27689]: purged_snaps scrub starts 2024-09-13T18:26:00.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:00 smithi038 ceph-mon[27689]: purged_snaps scrub ok 2024-09-13T18:26:01.280 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi149:vg_nvme/lv_2 2024-09-13T18:26:01.545 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi149/config 2024-09-13T18:26:01.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:01 smithi149 ceph-mon[35845]: osdmap e36: 5 total, 5 up, 5 in 2024-09-13T18:26:01.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:01 smithi149 ceph-mon[35845]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 547 MiB used, 446 GiB / 447 GiB avail 2024-09-13T18:26:01.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:01 smithi038 ceph-mon[27689]: osdmap e36: 5 total, 5 up, 5 in 2024-09-13T18:26:01.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:01 smithi038 ceph-mon[27689]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 547 MiB used, 446 GiB / 447 GiB avail 2024-09-13T18:26:03.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.543+0000 7efce2515640 1 -- 172.21.15.149:0/1292699499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcdc0fed60 msgr2=0x7efcdc0ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:03.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.543+0000 7efce2515640 1 --2- 172.21.15.149:0/1292699499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcdc0fed60 0x7efcdc0ff1e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009880 tx=0x7efcd002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.543+0000 7efce2515640 1 -- 172.21.15.149:0/1292699499 shutdown_connections 2024-09-13T18:26:03.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.543+0000 7efce2515640 1 --2- 172.21.15.149:0/1292699499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcdc0fed60 0x7efcdc0ff1e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.543+0000 7efce2515640 1 --2- 172.21.15.149:0/1292699499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc100020 0x7efcdc100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.543+0000 7efce2515640 1 -- 172.21.15.149:0/1292699499 >> 172.21.15.149:0/1292699499 conn(0x7efcdc0f99c0 msgr2=0x7efcdc0fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:03.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.543+0000 7efce2515640 1 -- 172.21.15.149:0/1292699499 shutdown_connections 2024-09-13T18:26:03.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.543+0000 7efce2515640 1 -- 172.21.15.149:0/1292699499 wait complete. 2024-09-13T18:26:03.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.544+0000 7efce2515640 1 Processor -- start 2024-09-13T18:26:03.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.544+0000 7efce2515640 1 -- start start 2024-09-13T18:26:03.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.544+0000 7efce2515640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcdc0fed60 0x7efcdc194440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:03.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.544+0000 7efce2515640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc100020 0x7efcdc194980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:03.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.544+0000 7efce2515640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc194f50 con 0x7efcdc100020 2024-09-13T18:26:03.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.544+0000 7efce2515640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc1950c0 con 0x7efcdc0fed60 2024-09-13T18:26:03.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.544+0000 7efcdbfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcdc0fed60 0x7efcdc194440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:03.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.544+0000 7efcdbfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcdc0fed60 0x7efcdc194440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:43974/0 (socket says 172.21.15.149:43974) 2024-09-13T18:26:03.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.544+0000 7efcdbfff640 1 -- 172.21.15.149:0/1905247100 learned_addr learned my addr 172.21.15.149:0/1905247100 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.544+0000 7efcdb7fe640 1 --2- 172.21.15.149:0/1905247100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc100020 0x7efcdc194980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.545+0000 7efcdbfff640 1 -- 172.21.15.149:0/1905247100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc100020 msgr2=0x7efcdc194980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.545+0000 7efcdbfff640 1 --2- 172.21.15.149:0/1905247100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc100020 0x7efcdc194980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.545+0000 7efcdbfff640 1 -- 172.21.15.149:0/1905247100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd0009560 con 0x7efcdc0fed60 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.545+0000 7efcdbfff640 1 --2- 172.21.15.149:0/1905247100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcdc0fed60 0x7efcdc194440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efccc00d8d0 tx=0x7efccc00dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.545+0000 7efcd97fa640 1 -- 172.21.15.149:0/1905247100 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efccc009a30 con 0x7efcdc0fed60 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.545+0000 7efcd97fa640 1 -- 172.21.15.149:0/1905247100 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efccc009b90 con 0x7efcdc0fed60 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.545+0000 7efce2515640 1 -- 172.21.15.149:0/1905247100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc199b60 con 0x7efcdc0fed60 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.545+0000 7efcd97fa640 1 -- 172.21.15.149:0/1905247100 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efccc00f5f0 con 0x7efcdc0fed60 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.545+0000 7efce2515640 1 -- 172.21.15.149:0/1905247100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc19a0b0 con 0x7efcdc0fed60 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.546+0000 7efce2515640 1 -- 172.21.15.149:0/1905247100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc107550 con 0x7efcdc0fed60 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.547+0000 7efcd97fa640 1 -- 172.21.15.149:0/1905247100 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efccc009d00 con 0x7efcdc0fed60 2024-09-13T18:26:03.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.547+0000 7efcd97fa640 1 --2- 172.21.15.149:0/1905247100 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7efcc406cc50 0x7efcc406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:03.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.547+0000 7efcd97fa640 1 -- 172.21.15.149:0/1905247100 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4206+0+0 (secure 0 0 0) 0x7efccc08ba10 con 0x7efcdc0fed60 2024-09-13T18:26:03.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.547+0000 7efcdb7fe640 1 --2- 172.21.15.149:0/1905247100 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7efcc406cc50 0x7efcc406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:03.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.548+0000 7efcdb7fe640 1 --2- 172.21.15.149:0/1905247100 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7efcc406cc50 0x7efcc406f110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efcdc195960 tx=0x7efcd0031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:03.582 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.551+0000 7efcd97fa640 1 -- 172.21.15.149:0/1905247100 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efccc056400 con 0x7efcdc0fed60 2024-09-13T18:26:03.728 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:03.726+0000 7efce2515640 1 -- 172.21.15.149:0/1905247100 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7efcdc1046c0 con 0x7efcc406cc50 2024-09-13T18:26:04.358 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 547 MiB used, 446 GiB / 447 GiB avail 2024-09-13T18:26:04.358 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:04.358 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:04.358 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:26:04.358 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:26:04.358 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:04.358 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:04.358 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:26:04.359 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:04.359 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:26:04.359 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:04.359 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:26:04.359 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:04.359 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:26:04.359 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:26:04.359 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:04 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:04.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 547 MiB used, 446 GiB / 447 GiB avail 2024-09-13T18:26:04.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:04.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:04.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:26:04.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:26:04.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:04.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:04.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:26:04.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:04.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:26:04.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:04.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:26:04.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:04.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:26:04.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:26:04.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:04 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:05.397 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:05 smithi149 ceph-mon[35845]: Detected new or changed devices on smithi149 2024-09-13T18:26:05.397 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:05 smithi149 ceph-mon[35845]: Adjusting osd_memory_target on smithi149 to 1819M 2024-09-13T18:26:05.397 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:05 smithi149 ceph-mon[35845]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:26:05.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:05 smithi038 ceph-mon[27689]: Detected new or changed devices on smithi149 2024-09-13T18:26:05.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:05 smithi038 ceph-mon[27689]: Adjusting osd_memory_target on smithi149 to 1819M 2024-09-13T18:26:05.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:05 smithi038 ceph-mon[27689]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:26:06.514 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:06 smithi149 ceph-mon[35845]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:06.514 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:06 smithi149 ceph-mon[35845]: from='client.? 172.21.15.149:0/1042806374' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad710f6e-dbff-455c-8a67-7aca4ab8a56f"}]: dispatch 2024-09-13T18:26:06.514 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:06 smithi149 ceph-mon[35845]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad710f6e-dbff-455c-8a67-7aca4ab8a56f"}]: dispatch 2024-09-13T18:26:06.514 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:06 smithi149 ceph-mon[35845]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad710f6e-dbff-455c-8a67-7aca4ab8a56f"}]': finished 2024-09-13T18:26:06.514 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:06 smithi149 ceph-mon[35845]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T18:26:06.514 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:06 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:26:06.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:06 smithi038 ceph-mon[27689]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:06.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:06 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/1042806374' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad710f6e-dbff-455c-8a67-7aca4ab8a56f"}]: dispatch 2024-09-13T18:26:06.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:06 smithi038 ceph-mon[27689]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad710f6e-dbff-455c-8a67-7aca4ab8a56f"}]: dispatch 2024-09-13T18:26:06.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:06 smithi038 ceph-mon[27689]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad710f6e-dbff-455c-8a67-7aca4ab8a56f"}]': finished 2024-09-13T18:26:06.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:06 smithi038 ceph-mon[27689]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T18:26:06.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:06 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:26:07.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:07 smithi149 ceph-mon[35845]: from='client.? 172.21.15.149:0/382616650' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:26:07.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:07 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/382616650' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:26:08.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:08 smithi038 ceph-mon[27689]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:08.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:08 smithi149 ceph-mon[35845]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:09.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:09 smithi038 ceph-mon[27689]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:09.651 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:09 smithi149 ceph-mon[35845]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:10.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:10 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:26:10.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:10 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:26:11.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:11 smithi038 ceph-mon[27689]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:11.608 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:11 smithi149 ceph-mon[35845]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:13.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:12 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T18:26:13.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:12 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:13.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:12 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T18:26:13.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:12 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:14.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:13 smithi149 ceph-mon[35845]: Deploying daemon osd.5 on smithi149 2024-09-13T18:26:14.188 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:13 smithi149 ceph-mon[35845]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:14.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:13 smithi038 ceph-mon[27689]: Deploying daemon osd.5 on smithi149 2024-09-13T18:26:14.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:13 smithi038 ceph-mon[27689]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:16.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:16 smithi149 ceph-mon[35845]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:16.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:16 smithi038 ceph-mon[27689]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:18.523 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:18 smithi149 ceph-mon[35845]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:18.523 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:18 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:26:18.523 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:18 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:18.523 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:18 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:18.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:18 smithi038 ceph-mon[27689]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:18.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:18 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:26:18.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:18 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:18.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:18 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:20.533 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:20 smithi149 ceph-mon[35845]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:20.577 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:20.574+0000 7efcd97fa640 1 -- 172.21.15.149:0/1905247100 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efcdc1046c0 con 0x7efcc406cc50 2024-09-13T18:26:20.577 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 5 on host 'smithi149' 2024-09-13T18:26:20.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:20.577+0000 7efce2515640 1 -- 172.21.15.149:0/1905247100 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7efcc406cc50 msgr2=0x7efcc406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:20.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:20.577+0000 7efce2515640 1 --2- 172.21.15.149:0/1905247100 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7efcc406cc50 0x7efcc406f110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efcdc195960 tx=0x7efcd0031400 comp rx=0 tx=0).stop 2024-09-13T18:26:20.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:20.577+0000 7efce2515640 1 -- 172.21.15.149:0/1905247100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcdc0fed60 msgr2=0x7efcdc194440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:20.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:20.577+0000 7efce2515640 1 --2- 172.21.15.149:0/1905247100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcdc0fed60 0x7efcdc194440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efccc00d8d0 tx=0x7efccc00dd90 comp rx=0 tx=0).stop 2024-09-13T18:26:20.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:20.577+0000 7efce2515640 1 -- 172.21.15.149:0/1905247100 shutdown_connections 2024-09-13T18:26:20.579 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:20.577+0000 7efce2515640 1 --2- 172.21.15.149:0/1905247100 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7efcc406cc50 0x7efcc406f110 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:20.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:20.577+0000 7efce2515640 1 --2- 172.21.15.149:0/1905247100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcdc100020 0x7efcdc194980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:20.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:20.577+0000 7efce2515640 1 --2- 172.21.15.149:0/1905247100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcdc0fed60 0x7efcdc194440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:20.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:20.577+0000 7efce2515640 1 -- 172.21.15.149:0/1905247100 >> 172.21.15.149:0/1905247100 conn(0x7efcdc0f99c0 msgr2=0x7efcdc102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:20.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:20.577+0000 7efce2515640 1 -- 172.21.15.149:0/1905247100 shutdown_connections 2024-09-13T18:26:20.580 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:20.577+0000 7efce2515640 1 -- 172.21.15.149:0/1905247100 wait complete. 2024-09-13T18:26:20.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:20 smithi038 ceph-mon[27689]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:21.148 DEBUG:teuthology.orchestra.run.smithi149:osd.5> sudo journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T18:26:21.151 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-13T18:26:21.151 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T18:26:21.375 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:21.748 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:21 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:21.748 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:21 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:21.748 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:21 smithi038 ceph-mon[27689]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:21.898 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:21.898 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:21 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:21.898 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:21 smithi149 ceph-mon[35845]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:21.898 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:26:21 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[54713]: 2024-09-13T18:26:21.789+0000 7f8974cad640 -1 osd.5 0 log_to_monitors true 2024-09-13T18:26:22.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:22 smithi038 ceph-mon[27689]: from='osd.5 [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:26:22.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:22 smithi038 ceph-mon[27689]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:26:22.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:22 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:22.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:22 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:22.961 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:22 smithi149 ceph-mon[35845]: from='osd.5 [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:26:22.961 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:22 smithi149 ceph-mon[35845]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:26:22.961 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:22 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:22.961 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:22 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:23.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.023+0000 7f4b99f32640 1 -- 172.21.15.38:0/1851757075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b94100d90 msgr2=0x7f4b94101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.023+0000 7f4b99f32640 1 --2- 172.21.15.38:0/1851757075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b94100d90 0x7f4b94101210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009880 tx=0x7f4b7c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.024+0000 7f4b99f32640 1 -- 172.21.15.38:0/1851757075 shutdown_connections 2024-09-13T18:26:23.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.024+0000 7f4b99f32640 1 --2- 172.21.15.38:0/1851757075 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b94100d90 0x7f4b94101210 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.024+0000 7f4b99f32640 1 --2- 172.21.15.38:0/1851757075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b940ffb90 0x7f4b940fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.024+0000 7f4b99f32640 1 -- 172.21.15.38:0/1851757075 >> 172.21.15.38:0/1851757075 conn(0x7f4b940fb320 msgr2=0x7f4b940fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:23.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.024+0000 7f4b99f32640 1 -- 172.21.15.38:0/1851757075 shutdown_connections 2024-09-13T18:26:23.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.024+0000 7f4b99f32640 1 -- 172.21.15.38:0/1851757075 wait complete. 2024-09-13T18:26:23.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.024+0000 7f4b99f32640 1 Processor -- start 2024-09-13T18:26:23.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.024+0000 7f4b99f32640 1 -- start start 2024-09-13T18:26:23.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.025+0000 7f4b99f32640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b940ffb90 0x7f4b941955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.025+0000 7f4b99f32640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b94100d90 0x7f4b94195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.025+0000 7f4b99f32640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b941960e0 con 0x7f4b940ffb90 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.025+0000 7f4b99f32640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b94196250 con 0x7f4b94100d90 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.025+0000 7f4b937fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b940ffb90 0x7f4b941955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.025+0000 7f4b937fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b940ffb90 0x7f4b941955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47300/0 (socket says 172.21.15.38:47300) 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.025+0000 7f4b937fe640 1 -- 172.21.15.38:0/4280085350 learned_addr learned my addr 172.21.15.38:0/4280085350 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.025+0000 7f4b8affd640 1 --2- 172.21.15.38:0/4280085350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b94100d90 0x7f4b94195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.025+0000 7f4b937fe640 1 -- 172.21.15.38:0/4280085350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b94100d90 msgr2=0x7f4b94195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.025+0000 7f4b937fe640 1 --2- 172.21.15.38:0/4280085350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b94100d90 0x7f4b94195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.025+0000 7f4b937fe640 1 -- 172.21.15.38:0/4280085350 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c009560 con 0x7f4b940ffb90 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.025+0000 7f4b937fe640 1 --2- 172.21.15.38:0/4280085350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b940ffb90 0x7f4b941955d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400e970 tx=0x7f4b8400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.026+0000 7f4b917fa640 1 -- 172.21.15.38:0/4280085350 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b840096e0 con 0x7f4b940ffb90 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.026+0000 7f4b917fa640 1 -- 172.21.15.38:0/4280085350 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4b840044d0 con 0x7f4b940ffb90 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.026+0000 7f4b99f32640 1 -- 172.21.15.38:0/4280085350 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9419acf0 con 0x7f4b940ffb90 2024-09-13T18:26:23.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.026+0000 7f4b917fa640 1 -- 172.21.15.38:0/4280085350 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b84003e70 con 0x7f4b940ffb90 2024-09-13T18:26:23.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.026+0000 7f4b99f32640 1 -- 172.21.15.38:0/4280085350 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9419b240 con 0x7f4b940ffb90 2024-09-13T18:26:23.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.027+0000 7f4b99f32640 1 -- 172.21.15.38:0/4280085350 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b940fff90 con 0x7f4b940ffb90 2024-09-13T18:26:23.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.027+0000 7f4b917fa640 1 -- 172.21.15.38:0/4280085350 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4b8400cc90 con 0x7f4b940ffb90 2024-09-13T18:26:23.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.028+0000 7f4b917fa640 1 --2- 172.21.15.38:0/4280085350 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4b8006cc50 0x7f4b8006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:23.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.028+0000 7f4b917fa640 1 -- 172.21.15.38:0/4280085350 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4342+0+0 (secure 0 0 0) 0x7f4b84014070 con 0x7f4b940ffb90 2024-09-13T18:26:23.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.028+0000 7f4b8affd640 1 --2- 172.21.15.38:0/4280085350 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4b8006cc50 0x7f4b8006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:23.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.028+0000 7f4b8affd640 1 --2- 172.21.15.38:0/4280085350 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4b8006cc50 0x7f4b8006f110 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c004fa0 tx=0x7f4b7c004260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:23.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.032+0000 7f4b917fa640 1 -- 172.21.15.38:0/4280085350 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4b84056c30 con 0x7f4b940ffb90 2024-09-13T18:26:23.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.203+0000 7f4b99f32640 1 -- 172.21.15.38:0/4280085350 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4b9418f5f0 con 0x7f4b940ffb90 2024-09-13T18:26:23.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.203+0000 7f4b917fa640 1 -- 172.21.15.38:0/4280085350 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f4b8405a250 con 0x7f4b940ffb90 2024-09-13T18:26:23.206 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:26:23.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.206+0000 7f4b99f32640 1 -- 172.21.15.38:0/4280085350 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4b8006cc50 msgr2=0x7f4b8006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.206+0000 7f4b99f32640 1 --2- 172.21.15.38:0/4280085350 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4b8006cc50 0x7f4b8006f110 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c004fa0 tx=0x7f4b7c004260 comp rx=0 tx=0).stop 2024-09-13T18:26:23.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.206+0000 7f4b99f32640 1 -- 172.21.15.38:0/4280085350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b940ffb90 msgr2=0x7f4b941955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:23.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.206+0000 7f4b99f32640 1 --2- 172.21.15.38:0/4280085350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b940ffb90 0x7f4b941955d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400e970 tx=0x7f4b8400ee30 comp rx=0 tx=0).stop 2024-09-13T18:26:23.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.207+0000 7f4b99f32640 1 -- 172.21.15.38:0/4280085350 shutdown_connections 2024-09-13T18:26:23.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.207+0000 7f4b99f32640 1 --2- 172.21.15.38:0/4280085350 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4b8006cc50 0x7f4b8006f110 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.207+0000 7f4b99f32640 1 --2- 172.21.15.38:0/4280085350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b94100d90 0x7f4b94195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.207+0000 7f4b99f32640 1 --2- 172.21.15.38:0/4280085350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b940ffb90 0x7f4b941955d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.207+0000 7f4b99f32640 1 -- 172.21.15.38:0/4280085350 >> 172.21.15.38:0/4280085350 conn(0x7f4b940fb320 msgr2=0x7f4b94104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.207+0000 7f4b99f32640 1 -- 172.21.15.38:0/4280085350 shutdown_connections 2024-09-13T18:26:23.210 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:23.207+0000 7f4b99f32640 1 -- 172.21.15.38:0/4280085350 wait complete. 2024-09-13T18:26:23.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:23 smithi038 ceph-mon[27689]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T18:26:23.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:23 smithi038 ceph-mon[27689]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T18:26:23.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:23 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:26:23.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:23 smithi038 ceph-mon[27689]: from='osd.5 [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:26:23.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:23 smithi038 ceph-mon[27689]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:26:23.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:23 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/4280085350' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:26:23.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:23 smithi038 ceph-mon[27689]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:23.928 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1726251959,"num_in_osds":6,"osd_in_since":1726251965,"num_remapped_pgs":0} 2024-09-13T18:26:24.019 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:26:23 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[54713]: 2024-09-13T18:26:23.604+0000 7f897040b640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T18:26:24.019 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:26:23 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[54713]: 2024-09-13T18:26:23.613+0000 7f896ca46640 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:26:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:23 smithi149 ceph-mon[35845]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T18:26:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:23 smithi149 ceph-mon[35845]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T18:26:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:23 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:26:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:23 smithi149 ceph-mon[35845]: from='osd.5 [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:26:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:23 smithi149 ceph-mon[35845]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:26:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:23 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/4280085350' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:26:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:23 smithi149 ceph-mon[35845]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:24.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:24 smithi038 ceph-mon[27689]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T18:26:24.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:24 smithi038 ceph-mon[27689]: osdmap e39: 6 total, 5 up, 6 in 2024-09-13T18:26:24.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:24 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:26:24.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:24 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:26:24.930 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T18:26:25.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:24 smithi149 ceph-mon[35845]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-09-13T18:26:25.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:24 smithi149 ceph-mon[35845]: osdmap e39: 6 total, 5 up, 6 in 2024-09-13T18:26:25.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:24 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:26:25.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:24 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:26:25.143 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:25.939 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:25 smithi038 ceph-mon[27689]: purged_snaps scrub starts 2024-09-13T18:26:25.939 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:25 smithi038 ceph-mon[27689]: purged_snaps scrub ok 2024-09-13T18:26:25.939 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:25 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:26:25.939 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:25 smithi038 ceph-mon[27689]: osd.5 [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730] boot 2024-09-13T18:26:25.939 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:25 smithi038 ceph-mon[27689]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T18:26:25.939 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:25 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:26:25.939 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:25 smithi038 ceph-mon[27689]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:25.939 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:25 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:26:26.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:25 smithi149 ceph-mon[35845]: purged_snaps scrub starts 2024-09-13T18:26:26.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:25 smithi149 ceph-mon[35845]: purged_snaps scrub ok 2024-09-13T18:26:26.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:25 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:26:26.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:25 smithi149 ceph-mon[35845]: osd.5 [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730] boot 2024-09-13T18:26:26.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:25 smithi149 ceph-mon[35845]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T18:26:26.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:25 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:26:26.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:25 smithi149 ceph-mon[35845]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-13T18:26:26.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:25 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:26:26.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.836+0000 7f876c499640 1 -- 172.21.15.38:0/1225168933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87640ffb90 msgr2=0x7f87640fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.836+0000 7f876c499640 1 --2- 172.21.15.38:0/1225168933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87640ffb90 0x7f87640fff90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8760009880 tx=0x7f876002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.836+0000 7f876c499640 1 -- 172.21.15.38:0/1225168933 shutdown_connections 2024-09-13T18:26:26.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.836+0000 7f876c499640 1 --2- 172.21.15.38:0/1225168933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8764100d90 0x7f8764101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.836+0000 7f876c499640 1 --2- 172.21.15.38:0/1225168933 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87640ffb90 0x7f87640fff90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.836+0000 7f876c499640 1 -- 172.21.15.38:0/1225168933 >> 172.21.15.38:0/1225168933 conn(0x7f87640fb360 msgr2=0x7f87640fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:26.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.836+0000 7f876c499640 1 -- 172.21.15.38:0/1225168933 shutdown_connections 2024-09-13T18:26:26.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.836+0000 7f876c499640 1 -- 172.21.15.38:0/1225168933 wait complete. 2024-09-13T18:26:26.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.836+0000 7f876c499640 1 Processor -- start 2024-09-13T18:26:26.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.836+0000 7f876c499640 1 -- start start 2024-09-13T18:26:26.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f876c499640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87640ffb90 0x7f8764074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f876c499640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8764100d90 0x7f87640728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f876c499640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8764072de0 con 0x7f8764100d90 2024-09-13T18:26:26.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f876c499640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8764072f50 con 0x7f87640ffb90 2024-09-13T18:26:26.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f8769a34640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8764100d90 0x7f87640728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f8769a34640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8764100d90 0x7f87640728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47306/0 (socket says 172.21.15.38:47306) 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f8769a34640 1 -- 172.21.15.38:0/3928130166 learned_addr learned my addr 172.21.15.38:0/3928130166 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f876a235640 1 --2- 172.21.15.38:0/3928130166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87640ffb90 0x7f8764074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f8769a34640 1 -- 172.21.15.38:0/3928130166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87640ffb90 msgr2=0x7f8764074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f8769a34640 1 --2- 172.21.15.38:0/3928130166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87640ffb90 0x7f8764074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f8769a34640 1 -- 172.21.15.38:0/3928130166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760009560 con 0x7f8764100d90 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f8769a34640 1 --2- 172.21.15.38:0/3928130166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8764100d90 0x7f87640728a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f875400e970 tx=0x7f875400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f875b7fe640 1 -- 172.21.15.38:0/3928130166 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f875400cc90 con 0x7f8764100d90 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f875b7fe640 1 -- 172.21.15.38:0/3928130166 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f875400cdf0 con 0x7f8764100d90 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f876c499640 1 -- 172.21.15.38:0/3928130166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8764073230 con 0x7f8764100d90 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f875b7fe640 1 -- 172.21.15.38:0/3928130166 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8754018770 con 0x7f8764100d90 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.837+0000 7f876c499640 1 -- 172.21.15.38:0/3928130166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876419d590 con 0x7f8764100d90 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.838+0000 7f876c499640 1 -- 172.21.15.38:0/3928130166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876418f5d0 con 0x7f8764100d90 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.839+0000 7f875b7fe640 1 -- 172.21.15.38:0/3928130166 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8754010b60 con 0x7f8764100d90 2024-09-13T18:26:26.846 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.839+0000 7f875b7fe640 1 --2- 172.21.15.38:0/3928130166 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f875006cc50 0x7f875006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:26.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.839+0000 7f875b7fe640 1 -- 172.21.15.38:0/3928130166 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f8754014070 con 0x7f8764100d90 2024-09-13T18:26:26.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.840+0000 7f876a235640 1 --2- 172.21.15.38:0/3928130166 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f875006cc50 0x7f875006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:26.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.840+0000 7f876a235640 1 --2- 172.21.15.38:0/3928130166 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f875006cc50 0x7f875006f110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8760000c00 tx=0x7f8760031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:26.847 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:26.844+0000 7f875b7fe640 1 -- 172.21.15.38:0/3928130166 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8754052e20 con 0x7f8764100d90 2024-09-13T18:26:27.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.015+0000 7f876c499640 1 -- 172.21.15.38:0/3928130166 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f876402c3e0 con 0x7f8764100d90 2024-09-13T18:26:27.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T18:26:27.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: Detected new or changed devices on smithi149 2024-09-13T18:26:27.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:27.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:27.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:26:27.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:26:27.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:26:27.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: Adjusting osd_memory_target on smithi149 to 1213M 2024-09-13T18:26:27.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:27.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:27.019 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:26:27.019 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:27.019 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:26:27.019 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.015+0000 7f875b7fe640 1 -- 172.21.15.38:0/3928130166 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7f875405a5f0 con 0x7f8764100d90 2024-09-13T18:26:27.019 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:26:27.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.017+0000 7f876c499640 1 -- 172.21.15.38:0/3928130166 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f875006cc50 msgr2=0x7f875006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.017+0000 7f876c499640 1 --2- 172.21.15.38:0/3928130166 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f875006cc50 0x7f875006f110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8760000c00 tx=0x7f8760031400 comp rx=0 tx=0).stop 2024-09-13T18:26:27.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.017+0000 7f876c499640 1 -- 172.21.15.38:0/3928130166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8764100d90 msgr2=0x7f87640728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:27.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.017+0000 7f876c499640 1 --2- 172.21.15.38:0/3928130166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8764100d90 0x7f87640728a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f875400e970 tx=0x7f875400ee30 comp rx=0 tx=0).stop 2024-09-13T18:26:27.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.017+0000 7f876c499640 1 -- 172.21.15.38:0/3928130166 shutdown_connections 2024-09-13T18:26:27.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.017+0000 7f876c499640 1 --2- 172.21.15.38:0/3928130166 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f875006cc50 0x7f875006f110 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.017+0000 7f876c499640 1 --2- 172.21.15.38:0/3928130166 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8764100d90 0x7f87640728a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.017+0000 7f876c499640 1 --2- 172.21.15.38:0/3928130166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87640ffb90 0x7f8764074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:27.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.017+0000 7f876c499640 1 -- 172.21.15.38:0/3928130166 >> 172.21.15.38:0/3928130166 conn(0x7f87640fb360 msgr2=0x7f87641044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:27.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.017+0000 7f876c499640 1 -- 172.21.15.38:0/3928130166 shutdown_connections 2024-09-13T18:26:27.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:27.017+0000 7f876c499640 1 -- 172.21.15.38:0/3928130166 wait complete. 2024-09-13T18:26:27.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T18:26:27.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: Detected new or changed devices on smithi149 2024-09-13T18:26:27.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:27.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:27.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:26:27.022 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:26:27.022 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:26:27.022 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: Adjusting osd_memory_target on smithi149 to 1213M 2024-09-13T18:26:27.022 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:27.022 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:27.022 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:26:27.022 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:27.022 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:26:27.698 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1726251984,"num_in_osds":6,"osd_in_since":1726251965,"num_remapped_pgs":0} 2024-09-13T18:26:27.698 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T18:26:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:27 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:27 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:26:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:27 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:27 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3928130166' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:26:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:27 smithi038 ceph-mon[27689]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:27.908 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:28.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:27 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:26:28.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:27 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:26:28.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:27 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:26:28.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:27 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/3928130166' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:26:28.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:27 smithi149 ceph-mon[35845]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:29.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.624+0000 7f4836b68640 1 -- 172.21.15.38:0/3349532368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4830101610 msgr2=0x7f4830109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.624+0000 7f4836b68640 1 --2- 172.21.15.38:0/3349532368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4830101610 0x7f4830109b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f48180098b0 tx=0x7f481802a4d0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.624+0000 7f4836b68640 1 -- 172.21.15.38:0/3349532368 shutdown_connections 2024-09-13T18:26:29.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.624+0000 7f4836b68640 1 --2- 172.21.15.38:0/3349532368 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4830101610 0x7f4830109b00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.624+0000 7f4836b68640 1 --2- 172.21.15.38:0/3349532368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4830100c60 0x7f4830101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.624+0000 7f4836b68640 1 -- 172.21.15.38:0/3349532368 >> 172.21.15.38:0/3349532368 conn(0x7f48300fa730 msgr2=0x7f48300fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:29.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.624+0000 7f4836b68640 1 -- 172.21.15.38:0/3349532368 shutdown_connections 2024-09-13T18:26:29.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.624+0000 7f4836b68640 1 -- 172.21.15.38:0/3349532368 wait complete. 2024-09-13T18:26:29.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.625+0000 7f4836b68640 1 Processor -- start 2024-09-13T18:26:29.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.625+0000 7f4836b68640 1 -- start start 2024-09-13T18:26:29.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.625+0000 7f4836b68640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4830100c60 0x7f483019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.630 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.625+0000 7f4836b68640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4830101610 0x7f483019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.625+0000 7f4836b68640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483019c270 con 0x7f4830101610 2024-09-13T18:26:29.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.625+0000 7f4836b68640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4830195890 con 0x7f4830100c60 2024-09-13T18:26:29.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.625+0000 7f482ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4830101610 0x7f483019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.625+0000 7f482ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4830101610 0x7f483019bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47312/0 (socket says 172.21.15.38:47312) 2024-09-13T18:26:29.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.625+0000 7f482ffff640 1 -- 172.21.15.38:0/1318816875 learned_addr learned my addr 172.21.15.38:0/1318816875 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:29.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.626+0000 7f4834904640 1 --2- 172.21.15.38:0/1318816875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4830100c60 0x7f483019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.626+0000 7f482ffff640 1 -- 172.21.15.38:0/1318816875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4830100c60 msgr2=0x7f483019b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.626+0000 7f482ffff640 1 --2- 172.21.15.38:0/1318816875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4830100c60 0x7f483019b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.626+0000 7f482ffff640 1 -- 172.21.15.38:0/1318816875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4818009560 con 0x7f4830101610 2024-09-13T18:26:29.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.626+0000 7f482ffff640 1 --2- 172.21.15.38:0/1318816875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4830101610 0x7f483019bce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4818006010 tx=0x7f4818005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:29.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.626+0000 7f482dffb640 1 -- 172.21.15.38:0/1318816875 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4818004b20 con 0x7f4830101610 2024-09-13T18:26:29.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.627+0000 7f482dffb640 1 -- 172.21.15.38:0/1318816875 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4818004c80 con 0x7f4830101610 2024-09-13T18:26:29.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.627+0000 7f4836b68640 1 -- 172.21.15.38:0/1318816875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4830195b10 con 0x7f4830101610 2024-09-13T18:26:29.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.627+0000 7f482dffb640 1 -- 172.21.15.38:0/1318816875 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4818031990 con 0x7f4830101610 2024-09-13T18:26:29.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.627+0000 7f4836b68640 1 -- 172.21.15.38:0/1318816875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4830196000 con 0x7f4830101610 2024-09-13T18:26:29.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.628+0000 7f4836b68640 1 -- 172.21.15.38:0/1318816875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4830068d30 con 0x7f4830101610 2024-09-13T18:26:29.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.628+0000 7f482dffb640 1 -- 172.21.15.38:0/1318816875 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4818031b10 con 0x7f4830101610 2024-09-13T18:26:29.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.629+0000 7f482dffb640 1 --2- 172.21.15.38:0/1318816875 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f481c06cc50 0x7f481c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:29.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.629+0000 7f482dffb640 1 -- 172.21.15.38:0/1318816875 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f48180acfd0 con 0x7f4830101610 2024-09-13T18:26:29.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.629+0000 7f4834904640 1 --2- 172.21.15.38:0/1318816875 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f481c06cc50 0x7f481c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:29.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.629+0000 7f4834904640 1 --2- 172.21.15.38:0/1318816875 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f481c06cc50 0x7f481c06f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4820005e10 tx=0x7f4820005da0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:29.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.633+0000 7f482dffb640 1 -- 172.21.15.38:0/1318816875 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4818077700 con 0x7f4830101610 2024-09-13T18:26:29.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.804+0000 7f4836b68640 1 -- 172.21.15.38:0/1318816875 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4830101040 con 0x7f4830101610 2024-09-13T18:26:29.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.805+0000 7f482dffb640 1 -- 172.21.15.38:0/1318816875 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11348 (secure 0 0 0) 0x7f481807ad20 con 0x7f4830101610 2024-09-13T18:26:29.807 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:26:29.807 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":41,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","created":"2024-09-13T18:20:45.975848+0000","modified":"2024-09-13T18:26:25.615448+0000","last_up_change":"2024-09-13T18:26:24.605474+0000","last_in_change":"2024-09-13T18:26:05.887130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:25:13.672723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8245ff4-3301-430c-a290-6000dfd0807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6803","nonce":3226287112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6805","nonce":3226287112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6809","nonce":3226287112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6807","nonce":3226287112}]},"public_addr":"172.21.15.38:6803/3226287112","cluster_addr":"172.21.15.38:6805/3226287112","heartbeat_back_addr":"172.21.15.38:6809/3226287112","heartbeat_front_addr":"172.21.15.38:6807/3226287112","state":["exists","up"]},{"osd":1,"uuid":"1518b6f4-6e5f-445f-b0cd-2ebaecb3c203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6811","nonce":3899453176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6813","nonce":3899453176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6817","nonce":3899453176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6815","nonce":3899453176}]},"public_addr":"172.21.15.38:6811/3899453176","cluster_addr":"172.21.15.38:6813/3899453176","heartbeat_back_addr":"172.21.15.38:6817/3899453176","heartbeat_front_addr":"172.21.15.38:6815/3899453176","state":["exists","up"]},{"osd":2,"uuid":"43ebe637-fa97-4ac6-b85e-01440f6ca6eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6819","nonce":1096956082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6821","nonce":1096956082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6825","nonce":1096956082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6823","nonce":1096956082}]},"public_addr":"172.21.15.38:6819/1096956082","cluster_addr":"172.21.15.38:6821/1096956082","heartbeat_back_addr":"172.21.15.38:6825/1096956082","heartbeat_front_addr":"172.21.15.38:6823/1096956082","state":["exists","up"]},{"osd":3,"uuid":"5ffdedaf-95c7-45b3-9af6-36b5a74d60f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6801","nonce":3475497989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6803","nonce":3475497989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6807","nonce":3475497989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6805","nonce":3475497989}]},"public_addr":"172.21.15.149:6801/3475497989","cluster_addr":"172.21.15.149:6803/3475497989","heartbeat_back_addr":"172.21.15.149:6807/3475497989","heartbeat_front_addr":"172.21.15.149:6805/3475497989","state":["exists","up"]},{"osd":4,"uuid":"e91e0c22-0686-45ef-a8b3-a356ab76eb88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6809","nonce":3561461615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6811","nonce":3561461615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6815","nonce":3561461615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6813","nonce":3561461615}]},"public_addr":"172.21.15.149:6809/3561461615","cluster_addr":"172.21.15.149:6811/3561461615","heartbeat_back_addr":"172.21.15.149:6815/3561461615","heartbeat_front_addr":"172.21.15.149:6813/3561461615","state":["exists","up"]},{"osd":5,"uuid":"ad710f6e-dbff-455c-8a67-7aca4ab8a56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6817","nonce":2289738730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6819","nonce":2289738730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6823","nonce":2289738730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6821","nonce":2289738730}]},"public_addr":"172.21.15.149:6817/2289738730","cluster_addr":"172.21.15.149:6819/2289738730","heartbeat_back_addr":"172.21.15.149:6823/2289738730","heartbeat_front_addr":"172.21.15.149:6821/2289738730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:11.540858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.374275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:10.472792+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:33.374560+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:58.381692+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:22.772809+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:0/3421440666":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/2793935378":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/1699958329":"2024-09-14T18:21:45.526804+0000","172.21.15.38:0/3719380288":"2024-09-14T18:21:07.813395+0000","172.21.15.38:6800/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/1884863821":"2024-09-14T18:21:07.813395+0000","172.21.15.38:6801/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/133472565":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6800/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6801/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:0/1436289281":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/1458254215":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6800/1869434741":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/1704785391":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6801/1869434741":"2024-09-14T18:22:55.167215+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:29.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.808+0000 7f4836b68640 1 -- 172.21.15.38:0/1318816875 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f481c06cc50 msgr2=0x7f481c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.808+0000 7f4836b68640 1 --2- 172.21.15.38:0/1318816875 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f481c06cc50 0x7f481c06f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4820005e10 tx=0x7f4820005da0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.808+0000 7f4836b68640 1 -- 172.21.15.38:0/1318816875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4830101610 msgr2=0x7f483019bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:29.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.808+0000 7f4836b68640 1 --2- 172.21.15.38:0/1318816875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4830101610 0x7f483019bce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4818006010 tx=0x7f4818005610 comp rx=0 tx=0).stop 2024-09-13T18:26:29.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.808+0000 7f4836b68640 1 -- 172.21.15.38:0/1318816875 shutdown_connections 2024-09-13T18:26:29.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.808+0000 7f4836b68640 1 --2- 172.21.15.38:0/1318816875 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f481c06cc50 0x7f481c06f110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.808+0000 7f4836b68640 1 --2- 172.21.15.38:0/1318816875 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4830101610 0x7f483019bce0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.808+0000 7f4836b68640 1 --2- 172.21.15.38:0/1318816875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4830100c60 0x7f483019b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.808+0000 7f4836b68640 1 -- 172.21.15.38:0/1318816875 >> 172.21.15.38:0/1318816875 conn(0x7f48300fa730 msgr2=0x7f4830101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.808+0000 7f4836b68640 1 -- 172.21.15.38:0/1318816875 shutdown_connections 2024-09-13T18:26:29.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:29.808+0000 7f4836b68640 1 -- 172.21.15.38:0/1318816875 wait complete. 2024-09-13T18:26:30.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:30 smithi149 ceph-mon[35845]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:30.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:30 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1318816875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:26:30.574 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:30 smithi038 ceph-mon[27689]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:30.574 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:30 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1318816875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:26:30.598 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:25:13.672723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:26:30.598 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T18:26:30.805 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:32.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.469+0000 7fb04d3f9640 1 -- 172.21.15.38:0/1728657795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb048100750 msgr2=0x7fb0481047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:32.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.469+0000 7fb04d3f9640 1 --2- 172.21.15.38:0/1728657795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb048100750 0x7fb0481047a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb030009880 tx=0x7fb03002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.469+0000 7fb04d3f9640 1 -- 172.21.15.38:0/1728657795 shutdown_connections 2024-09-13T18:26:32.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.469+0000 7fb04d3f9640 1 --2- 172.21.15.38:0/1728657795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb048100750 0x7fb0481047a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.469+0000 7fb04d3f9640 1 --2- 172.21.15.38:0/1728657795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0480ffda0 0x7fb048100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.469+0000 7fb04d3f9640 1 -- 172.21.15.38:0/1728657795 >> 172.21.15.38:0/1728657795 conn(0x7fb0480fb840 msgr2=0x7fb0480fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:32.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.469+0000 7fb04d3f9640 1 -- 172.21.15.38:0/1728657795 shutdown_connections 2024-09-13T18:26:32.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.469+0000 7fb04d3f9640 1 -- 172.21.15.38:0/1728657795 wait complete. 2024-09-13T18:26:32.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.470+0000 7fb04d3f9640 1 Processor -- start 2024-09-13T18:26:32.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.470+0000 7fb04d3f9640 1 -- start start 2024-09-13T18:26:32.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.470+0000 7fb04d3f9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0480ffda0 0x7fb04819d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:32.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.470+0000 7fb04d3f9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb048100750 0x7fb04819deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:32.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.470+0000 7fb04d3f9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04819e4d0 con 0x7fb0480ffda0 2024-09-13T18:26:32.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.470+0000 7fb04d3f9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb048197a60 con 0x7fb048100750 2024-09-13T18:26:32.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.470+0000 7fb046ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0480ffda0 0x7fb04819d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:32.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.470+0000 7fb046ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0480ffda0 0x7fb04819d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41474/0 (socket says 172.21.15.38:41474) 2024-09-13T18:26:32.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.470+0000 7fb046ffd640 1 -- 172.21.15.38:0/3532009426 learned_addr learned my addr 172.21.15.38:0/3532009426 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:32.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.470+0000 7fb046ffd640 1 -- 172.21.15.38:0/3532009426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb048100750 msgr2=0x7fb04819deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:32.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.470+0000 7fb046ffd640 1 --2- 172.21.15.38:0/3532009426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb048100750 0x7fb04819deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.470+0000 7fb046ffd640 1 -- 172.21.15.38:0/3532009426 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb030009560 con 0x7fb0480ffda0 2024-09-13T18:26:32.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.471+0000 7fb046ffd640 1 --2- 172.21.15.38:0/3532009426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0480ffda0 0x7fb04819d970 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb03800d6f0 tx=0x7fb03800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:32.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.471+0000 7fb044ff9640 1 -- 172.21.15.38:0/3532009426 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb038009a30 con 0x7fb0480ffda0 2024-09-13T18:26:32.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.471+0000 7fb04d3f9640 1 -- 172.21.15.38:0/3532009426 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb048197d40 con 0x7fb0480ffda0 2024-09-13T18:26:32.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.471+0000 7fb044ff9640 1 -- 172.21.15.38:0/3532009426 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb0380054c0 con 0x7fb0480ffda0 2024-09-13T18:26:32.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.471+0000 7fb044ff9640 1 -- 172.21.15.38:0/3532009426 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb038004db0 con 0x7fb0480ffda0 2024-09-13T18:26:32.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.471+0000 7fb04d3f9640 1 -- 172.21.15.38:0/3532009426 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb048198290 con 0x7fb0480ffda0 2024-09-13T18:26:32.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.472+0000 7fb04d3f9640 1 -- 172.21.15.38:0/3532009426 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb048101280 con 0x7fb0480ffda0 2024-09-13T18:26:32.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.472+0000 7fb044ff9640 1 -- 172.21.15.38:0/3532009426 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb038004f30 con 0x7fb0480ffda0 2024-09-13T18:26:32.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.473+0000 7fb044ff9640 1 --2- 172.21.15.38:0/3532009426 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb03406cbf0 0x7fb03406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:32.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.473+0000 7fb044ff9640 1 -- 172.21.15.38:0/3532009426 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb03808ba20 con 0x7fb0480ffda0 2024-09-13T18:26:32.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.473+0000 7fb03ffff640 1 --2- 172.21.15.38:0/3532009426 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb03406cbf0 0x7fb03406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:32.478 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.473+0000 7fb03ffff640 1 --2- 172.21.15.38:0/3532009426 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb03406cbf0 0x7fb03406f0b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb048198ed0 tx=0x7fb030000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:32.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.477+0000 7fb044ff9640 1 -- 172.21.15.38:0/3532009426 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb038056130 con 0x7fb0480ffda0 2024-09-13T18:26:32.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:32 smithi038 ceph-mon[27689]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:32.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.647+0000 7fb04d3f9640 1 -- 172.21.15.38:0/3532009426 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb048074080 con 0x7fb0480ffda0 2024-09-13T18:26:32.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.647+0000 7fb044ff9640 1 -- 172.21.15.38:0/3532009426 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0380200a0 con 0x7fb0480ffda0 2024-09-13T18:26:32.650 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-09-13T18:26:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.649+0000 7fb04d3f9640 1 -- 172.21.15.38:0/3532009426 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb03406cbf0 msgr2=0x7fb03406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.649+0000 7fb04d3f9640 1 --2- 172.21.15.38:0/3532009426 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb03406cbf0 0x7fb03406f0b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb048198ed0 tx=0x7fb030000bc0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.649+0000 7fb04d3f9640 1 -- 172.21.15.38:0/3532009426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0480ffda0 msgr2=0x7fb04819d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.649+0000 7fb04d3f9640 1 --2- 172.21.15.38:0/3532009426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0480ffda0 0x7fb04819d970 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb03800d6f0 tx=0x7fb03800dbb0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.649+0000 7fb04d3f9640 1 -- 172.21.15.38:0/3532009426 shutdown_connections 2024-09-13T18:26:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.649+0000 7fb04d3f9640 1 --2- 172.21.15.38:0/3532009426 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb03406cbf0 0x7fb03406f0b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.649+0000 7fb04d3f9640 1 --2- 172.21.15.38:0/3532009426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb048100750 0x7fb04819deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.649+0000 7fb04d3f9640 1 --2- 172.21.15.38:0/3532009426 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb0480ffda0 0x7fb04819d970 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.649+0000 7fb04d3f9640 1 -- 172.21.15.38:0/3532009426 >> 172.21.15.38:0/3532009426 conn(0x7fb0480fb840 msgr2=0x7fb0480fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:32.652 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.649+0000 7fb04d3f9640 1 -- 172.21.15.38:0/3532009426 shutdown_connections 2024-09-13T18:26:32.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:32.649+0000 7fb04d3f9640 1 -- 172.21.15.38:0/3532009426 wait complete. 2024-09-13T18:26:32.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:32 smithi149 ceph-mon[35845]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:33.423 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T18:26:33.424 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T18:26:33.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:33 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3532009426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:26:33.637 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:33.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:33 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/3532009426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:26:34.313 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:34 smithi038 ceph-mon[27689]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:34.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:34 smithi149 ceph-mon[35845]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.355+0000 7f3dab5ff640 1 -- 172.21.15.38:0/1535986051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3da40ffb80 msgr2=0x7f3da40fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.355+0000 7f3dab5ff640 1 --2- 172.21.15.38:0/1535986051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3da40ffb80 0x7f3da40fff80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009c20 tx=0x7f3d9402a970 comp rx=0 tx=0).stop 2024-09-13T18:26:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.356+0000 7f3dab5ff640 1 -- 172.21.15.38:0/1535986051 shutdown_connections 2024-09-13T18:26:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.356+0000 7f3dab5ff640 1 --2- 172.21.15.38:0/1535986051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3da4100d80 0x7f3da4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.356+0000 7f3dab5ff640 1 --2- 172.21.15.38:0/1535986051 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3da40ffb80 0x7f3da40fff80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.356+0000 7f3dab5ff640 1 -- 172.21.15.38:0/1535986051 >> 172.21.15.38:0/1535986051 conn(0x7f3da40fb2f0 msgr2=0x7f3da40fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.356+0000 7f3dab5ff640 1 -- 172.21.15.38:0/1535986051 shutdown_connections 2024-09-13T18:26:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.356+0000 7f3dab5ff640 1 -- 172.21.15.38:0/1535986051 wait complete. 2024-09-13T18:26:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.356+0000 7f3dab5ff640 1 Processor -- start 2024-09-13T18:26:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.356+0000 7f3dab5ff640 1 -- start start 2024-09-13T18:26:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.356+0000 7f3dab5ff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3da40ffb80 0x7f3da4195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.356+0000 7f3dab5ff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3da4100d80 0x7f3da4195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.356+0000 7f3dab5ff640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da4196190 con 0x7f3da40ffb80 2024-09-13T18:26:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.356+0000 7f3dab5ff640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da4196300 con 0x7f3da4100d80 2024-09-13T18:26:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3da939b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3da40ffb80 0x7f3da4195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3da939b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3da40ffb80 0x7f3da4195680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41498/0 (socket says 172.21.15.38:41498) 2024-09-13T18:26:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3da939b640 1 -- 172.21.15.38:0/948588831 learned_addr learned my addr 172.21.15.38:0/948588831 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3da8b9a640 1 --2- 172.21.15.38:0/948588831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3da4100d80 0x7f3da4195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3da939b640 1 -- 172.21.15.38:0/948588831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3da4100d80 msgr2=0x7f3da4195bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3da939b640 1 --2- 172.21.15.38:0/948588831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3da4100d80 0x7f3da4195bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3da939b640 1 -- 172.21.15.38:0/948588831 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d94009900 con 0x7f3da40ffb80 2024-09-13T18:26:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3da939b640 1 --2- 172.21.15.38:0/948588831 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3da40ffb80 0x7f3da4195680 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d94035000 tx=0x7f3d9402f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3da27fc640 1 -- 172.21.15.38:0/948588831 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d94030840 con 0x7f3da40ffb80 2024-09-13T18:26:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3da27fc640 1 -- 172.21.15.38:0/948588831 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d94004040 con 0x7f3da40ffb80 2024-09-13T18:26:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3dab5ff640 1 -- 172.21.15.38:0/948588831 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da419ad40 con 0x7f3da40ffb80 2024-09-13T18:26:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3da27fc640 1 -- 172.21.15.38:0/948588831 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d94039680 con 0x7f3da40ffb80 2024-09-13T18:26:35.362 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.357+0000 7f3dab5ff640 1 -- 172.21.15.38:0/948588831 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da419b250 con 0x7f3da40ffb80 2024-09-13T18:26:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.358+0000 7f3dab5ff640 1 -- 172.21.15.38:0/948588831 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da41086b0 con 0x7f3da40ffb80 2024-09-13T18:26:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.359+0000 7f3da27fc640 1 -- 172.21.15.38:0/948588831 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3d9400a040 con 0x7f3da40ffb80 2024-09-13T18:26:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.359+0000 7f3da27fc640 1 --2- 172.21.15.38:0/948588831 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3d8c06cc50 0x7f3d8c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.359+0000 7f3da27fc640 1 -- 172.21.15.38:0/948588831 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3d9402c040 con 0x7f3da40ffb80 2024-09-13T18:26:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.359+0000 7f3da8b9a640 1 --2- 172.21.15.38:0/948588831 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3d8c06cc50 0x7f3d8c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:35.363 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.360+0000 7f3da8b9a640 1 --2- 172.21.15.38:0/948588831 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3d8c06cc50 0x7f3d8c06f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3da4196ba0 tx=0x7f3d98008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:35.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.364+0000 7f3da27fc640 1 -- 172.21.15.38:0/948588831 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3d94077ac0 con 0x7f3da40ffb80 2024-09-13T18:26:35.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:35 smithi038 ceph-mon[27689]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:35.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.599+0000 7f3dab5ff640 1 -- 172.21.15.38:0/948588831 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f3da419b470 con 0x7f3da40ffb80 2024-09-13T18:26:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.604+0000 7f3da27fc640 1 -- 172.21.15.38:0/948588831 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f3d9407b0e0 con 0x7f3da40ffb80 2024-09-13T18:26:35.606 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2024-09-13T18:26:35.606 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQDbg+RmPsnUIxAAkSszAKFxyYcQm2tUUzwyYg== 2024-09-13T18:26:35.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.606+0000 7f3dab5ff640 1 -- 172.21.15.38:0/948588831 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3d8c06cc50 msgr2=0x7f3d8c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.606+0000 7f3dab5ff640 1 --2- 172.21.15.38:0/948588831 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3d8c06cc50 0x7f3d8c06f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3da4196ba0 tx=0x7f3d98008040 comp rx=0 tx=0).stop 2024-09-13T18:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.606+0000 7f3dab5ff640 1 -- 172.21.15.38:0/948588831 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3da40ffb80 msgr2=0x7f3da4195680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.606+0000 7f3dab5ff640 1 --2- 172.21.15.38:0/948588831 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3da40ffb80 0x7f3da4195680 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d94035000 tx=0x7f3d9402f5f0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.606+0000 7f3dab5ff640 1 -- 172.21.15.38:0/948588831 shutdown_connections 2024-09-13T18:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.606+0000 7f3dab5ff640 1 --2- 172.21.15.38:0/948588831 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3d8c06cc50 0x7f3d8c06f110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.606+0000 7f3dab5ff640 1 --2- 172.21.15.38:0/948588831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3da4100d80 0x7f3da4195bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.606+0000 7f3dab5ff640 1 --2- 172.21.15.38:0/948588831 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3da40ffb80 0x7f3da4195680 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.606+0000 7f3dab5ff640 1 -- 172.21.15.38:0/948588831 >> 172.21.15.38:0/948588831 conn(0x7f3da40fb2f0 msgr2=0x7f3da4103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.606+0000 7f3dab5ff640 1 -- 172.21.15.38:0/948588831 shutdown_connections 2024-09-13T18:26:35.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:35.606+0000 7f3dab5ff640 1 -- 172.21.15.38:0/948588831 wait complete. 2024-09-13T18:26:35.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:35 smithi149 ceph-mon[35845]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:36.388 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:26:36.388 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T18:26:36.388 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:26:36.430 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T18:26:36.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:36 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/948588831' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T18:26:36.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:36 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/948588831' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T18:26:36.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:36 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/948588831' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T18:26:36.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:36 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/948588831' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T18:26:36.642 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi149/config 2024-09-13T18:26:37.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:37 smithi149 ceph-mon[35845]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:37.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:37 smithi038 ceph-mon[27689]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:38.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.114+0000 7fe12d1d9640 1 -- 172.21.15.149:0/2240604874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1280ffb80 msgr2=0x7fe1280fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.114+0000 7fe12d1d9640 1 --2- 172.21.15.149:0/2240604874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1280ffb80 0x7fe1280fff80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe110009880 tx=0x7fe11002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.114+0000 7fe12d1d9640 1 -- 172.21.15.149:0/2240604874 shutdown_connections 2024-09-13T18:26:38.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.114+0000 7fe12d1d9640 1 --2- 172.21.15.149:0/2240604874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe128100d80 0x7fe128101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.114+0000 7fe12d1d9640 1 --2- 172.21.15.149:0/2240604874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1280ffb80 0x7fe1280fff80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.117 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.114+0000 7fe12d1d9640 1 -- 172.21.15.149:0/2240604874 >> 172.21.15.149:0/2240604874 conn(0x7fe1280fb2f0 msgr2=0x7fe1280fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.114+0000 7fe12d1d9640 1 -- 172.21.15.149:0/2240604874 shutdown_connections 2024-09-13T18:26:38.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.114+0000 7fe12d1d9640 1 -- 172.21.15.149:0/2240604874 wait complete. 2024-09-13T18:26:38.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe12d1d9640 1 Processor -- start 2024-09-13T18:26:38.118 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe12d1d9640 1 -- start start 2024-09-13T18:26:38.120 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe12d1d9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1280ffb80 0x7fe128195590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.120 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe12d1d9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe128100d80 0x7fe128195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.120 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe12d1d9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1281960a0 con 0x7fe1280ffb80 2024-09-13T18:26:38.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe12d1d9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe128196210 con 0x7fe128100d80 2024-09-13T18:26:38.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe12659c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe128100d80 0x7fe128195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe12659c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe128100d80 0x7fe128195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:45136/0 (socket says 172.21.15.149:45136) 2024-09-13T18:26:38.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe12659c640 1 -- 172.21.15.149:0/1128608174 learned_addr learned my addr 172.21.15.149:0/1128608174 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-13T18:26:38.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe126d9d640 1 --2- 172.21.15.149:0/1128608174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1280ffb80 0x7fe128195590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe12659c640 1 -- 172.21.15.149:0/1128608174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1280ffb80 msgr2=0x7fe128195590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe12659c640 1 --2- 172.21.15.149:0/1128608174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1280ffb80 0x7fe128195590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.115+0000 7fe12659c640 1 -- 172.21.15.149:0/1128608174 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110009560 con 0x7fe128100d80 2024-09-13T18:26:38.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.116+0000 7fe12659c640 1 --2- 172.21.15.149:0/1128608174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe128100d80 0x7fe128195ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe11800e970 tx=0x7fe11800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.116+0000 7fe11ffff640 1 -- 172.21.15.149:0/1128608174 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe11800cc90 con 0x7fe128100d80 2024-09-13T18:26:38.121 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.116+0000 7fe11ffff640 1 -- 172.21.15.149:0/1128608174 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe11800cdf0 con 0x7fe128100d80 2024-09-13T18:26:38.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.116+0000 7fe12d1d9640 1 -- 172.21.15.149:0/1128608174 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12819acb0 con 0x7fe128100d80 2024-09-13T18:26:38.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.116+0000 7fe11ffff640 1 -- 172.21.15.149:0/1128608174 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe118010430 con 0x7fe128100d80 2024-09-13T18:26:38.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.116+0000 7fe12d1d9640 1 -- 172.21.15.149:0/1128608174 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12819b280 con 0x7fe128100d80 2024-09-13T18:26:38.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.117+0000 7fe12d1d9640 1 -- 172.21.15.149:0/1128608174 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe128108650 con 0x7fe128100d80 2024-09-13T18:26:38.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.118+0000 7fe11ffff640 1 -- 172.21.15.149:0/1128608174 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe118004ef0 con 0x7fe128100d80 2024-09-13T18:26:38.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.118+0000 7fe11ffff640 1 --2- 172.21.15.149:0/1128608174 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe11406cc50 0x7fe11406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:38.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.118+0000 7fe11ffff640 1 -- 172.21.15.149:0/1128608174 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe118014070 con 0x7fe128100d80 2024-09-13T18:26:38.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.118+0000 7fe126d9d640 1 --2- 172.21.15.149:0/1128608174 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe11406cc50 0x7fe11406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:38.122 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.119+0000 7fe126d9d640 1 --2- 172.21.15.149:0/1128608174 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe11406cc50 0x7fe11406f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe110000c00 tx=0x7fe110031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:38.124 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.122+0000 7fe11ffff640 1 -- 172.21.15.149:0/1128608174 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe118056ad0 con 0x7fe128100d80 2024-09-13T18:26:38.346 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.344+0000 7fe12d1d9640 1 -- 172.21.15.149:0/1128608174 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe128108840 con 0x7fe128100d80 2024-09-13T18:26:38.350 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.348+0000 7fe11ffff640 1 -- 172.21.15.149:0/1128608174 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe11805a0f0 con 0x7fe128100d80 2024-09-13T18:26:38.351 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2024-09-13T18:26:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDeg+RmsFKaFBAAlSWBPdhwZ0ej8iBAKE6vxg== 2024-09-13T18:26:38.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.351+0000 7fe12d1d9640 1 -- 172.21.15.149:0/1128608174 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe11406cc50 msgr2=0x7fe11406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.351+0000 7fe12d1d9640 1 --2- 172.21.15.149:0/1128608174 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe11406cc50 0x7fe11406f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe110000c00 tx=0x7fe110031400 comp rx=0 tx=0).stop 2024-09-13T18:26:38.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.351+0000 7fe12d1d9640 1 -- 172.21.15.149:0/1128608174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe128100d80 msgr2=0x7fe128195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:38.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.351+0000 7fe12d1d9640 1 --2- 172.21.15.149:0/1128608174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe128100d80 0x7fe128195ad0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe11800e970 tx=0x7fe11800ed70 comp rx=0 tx=0).stop 2024-09-13T18:26:38.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.351+0000 7fe12d1d9640 1 -- 172.21.15.149:0/1128608174 shutdown_connections 2024-09-13T18:26:38.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.351+0000 7fe12d1d9640 1 --2- 172.21.15.149:0/1128608174 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe11406cc50 0x7fe11406f110 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.351+0000 7fe12d1d9640 1 --2- 172.21.15.149:0/1128608174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe128100d80 0x7fe128195ad0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.351+0000 7fe12d1d9640 1 --2- 172.21.15.149:0/1128608174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1280ffb80 0x7fe128195590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:38.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.351+0000 7fe12d1d9640 1 -- 172.21.15.149:0/1128608174 >> 172.21.15.149:0/1128608174 conn(0x7fe1280fb2f0 msgr2=0x7fe128103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:38.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.351+0000 7fe12d1d9640 1 -- 172.21.15.149:0/1128608174 shutdown_connections 2024-09-13T18:26:38.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-13T18:26:38.351+0000 7fe12d1d9640 1 -- 172.21.15.149:0/1128608174 wait complete. 2024-09-13T18:26:38.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:38 smithi149 ceph-mon[35845]: from='client.? 172.21.15.149:0/1128608174' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T18:26:38.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:38 smithi149 ceph-mon[35845]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T18:26:38.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:38 smithi149 ceph-mon[35845]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T18:26:38.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:38 smithi038 ceph-mon[27689]: from='client.? 172.21.15.149:0/1128608174' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T18:26:38.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:38 smithi038 ceph-mon[27689]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T18:26:38.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:38 smithi038 ceph-mon[27689]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T18:26:38.995 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:26:38.995 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-13T18:26:38.995 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T18:26:39.033 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:26:39.033 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:26:39.033 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T18:26:39.243 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:39.641 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:39 smithi038 ceph-mon[27689]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:39.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:39 smithi149 ceph-mon[35845]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:40.653 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:40 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:26:40.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:40 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:26:40.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.929+0000 7f07a7f01640 1 -- 172.21.15.38:0/3513841091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a0100750 msgr2=0x7f07a01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.929+0000 7f07a7f01640 1 --2- 172.21.15.38:0/3513841091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a0100750 0x7f07a01047a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0794009880 tx=0x7f079402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.929+0000 7f07a7f01640 1 -- 172.21.15.38:0/3513841091 shutdown_connections 2024-09-13T18:26:40.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.929+0000 7f07a7f01640 1 --2- 172.21.15.38:0/3513841091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a0100750 0x7f07a01047a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.929+0000 7f07a7f01640 1 --2- 172.21.15.38:0/3513841091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00ffda0 0x7f07a0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.929+0000 7f07a7f01640 1 -- 172.21.15.38:0/3513841091 >> 172.21.15.38:0/3513841091 conn(0x7f07a00fb840 msgr2=0x7f07a00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:40.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.930+0000 7f07a7f01640 1 -- 172.21.15.38:0/3513841091 shutdown_connections 2024-09-13T18:26:40.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.930+0000 7f07a7f01640 1 -- 172.21.15.38:0/3513841091 wait complete. 2024-09-13T18:26:40.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.930+0000 7f07a7f01640 1 Processor -- start 2024-09-13T18:26:40.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.930+0000 7f07a7f01640 1 -- start start 2024-09-13T18:26:40.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.930+0000 7f07a7f01640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00ffda0 0x7f07a019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.930+0000 7f07a7f01640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a0100750 0x7f07a019df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.930+0000 7f07a7f01640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a019e530 con 0x7f07a0100750 2024-09-13T18:26:40.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.930+0000 7f07a7f01640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a0197ac0 con 0x7f07a00ffda0 2024-09-13T18:26:40.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f07a549c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a0100750 0x7f07a019df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f07a549c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a0100750 0x7f07a019df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41516/0 (socket says 172.21.15.38:41516) 2024-09-13T18:26:40.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f07a549c640 1 -- 172.21.15.38:0/897572613 learned_addr learned my addr 172.21.15.38:0/897572613 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:40.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f07a5c9d640 1 --2- 172.21.15.38:0/897572613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00ffda0 0x7f07a019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f07a549c640 1 -- 172.21.15.38:0/897572613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00ffda0 msgr2=0x7f07a019d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:40.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f07a549c640 1 --2- 172.21.15.38:0/897572613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00ffda0 0x7f07a019d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:40.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f07a549c640 1 -- 172.21.15.38:0/897572613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0794009560 con 0x7f07a0100750 2024-09-13T18:26:40.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f07a549c640 1 --2- 172.21.15.38:0/897572613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a0100750 0x7f07a019df10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0794006010 tx=0x7f07940055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:40.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f0792ffd640 1 -- 172.21.15.38:0/897572613 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0794004aa0 con 0x7f07a0100750 2024-09-13T18:26:40.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f0792ffd640 1 -- 172.21.15.38:0/897572613 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0794004c00 con 0x7f07a0100750 2024-09-13T18:26:40.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f0792ffd640 1 -- 172.21.15.38:0/897572613 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0794031910 con 0x7f07a0100750 2024-09-13T18:26:40.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f07a7f01640 1 -- 172.21.15.38:0/897572613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a0197d40 con 0x7f07a0100750 2024-09-13T18:26:40.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.931+0000 7f07a7f01640 1 -- 172.21.15.38:0/897572613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a0198230 con 0x7f07a0100750 2024-09-13T18:26:40.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.932+0000 7f07a7f01640 1 -- 172.21.15.38:0/897572613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a0101280 con 0x7f07a0100750 2024-09-13T18:26:40.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.933+0000 7f0792ffd640 1 -- 172.21.15.38:0/897572613 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0794031a70 con 0x7f07a0100750 2024-09-13T18:26:40.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.933+0000 7f0792ffd640 1 --2- 172.21.15.38:0/897572613 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f078c06cc60 0x7f078c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:40.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.934+0000 7f0792ffd640 1 -- 172.21.15.38:0/897572613 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f07940acf40 con 0x7f07a0100750 2024-09-13T18:26:40.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.934+0000 7f07a5c9d640 1 --2- 172.21.15.38:0/897572613 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f078c06cc60 0x7f078c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:40.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.934+0000 7f07a5c9d640 1 --2- 172.21.15.38:0/897572613 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f078c06cc60 0x7f078c06f120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f079c005fd0 tx=0x7f079c00b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:40.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:40.938+0000 7f0792ffd640 1 -- 172.21.15.38:0/897572613 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f07940e0e20 con 0x7f07a0100750 2024-09-13T18:26:41.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.155+0000 7f07a7f01640 1 -- 172.21.15.38:0/897572613 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f07a0100180 con 0x7f07a0100750 2024-09-13T18:26:41.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.158+0000 7f0792ffd640 1 -- 172.21.15.38:0/897572613 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+174012 (secure 0 0 0) 0x7f07940de7d0 con 0x7f07a0100750 2024-09-13T18:26:41.164 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:26:41.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.161+0000 7f07a7f01640 1 -- 172.21.15.38:0/897572613 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f078c06cc60 msgr2=0x7f078c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:41.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.161+0000 7f07a7f01640 1 --2- 172.21.15.38:0/897572613 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f078c06cc60 0x7f078c06f120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f079c005fd0 tx=0x7f079c00b390 comp rx=0 tx=0).stop 2024-09-13T18:26:41.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.161+0000 7f07a7f01640 1 -- 172.21.15.38:0/897572613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a0100750 msgr2=0x7f07a019df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:41.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.161+0000 7f07a7f01640 1 --2- 172.21.15.38:0/897572613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a0100750 0x7f07a019df10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0794006010 tx=0x7f07940055a0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.161+0000 7f07a7f01640 1 -- 172.21.15.38:0/897572613 shutdown_connections 2024-09-13T18:26:41.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.161+0000 7f07a7f01640 1 --2- 172.21.15.38:0/897572613 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f078c06cc60 0x7f078c06f120 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.161+0000 7f07a7f01640 1 --2- 172.21.15.38:0/897572613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07a0100750 0x7f07a019df10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.161+0000 7f07a7f01640 1 --2- 172.21.15.38:0/897572613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07a00ffda0 0x7f07a019d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:41.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.161+0000 7f07a7f01640 1 -- 172.21.15.38:0/897572613 >> 172.21.15.38:0/897572613 conn(0x7f07a00fb840 msgr2=0x7f07a00fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:41.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.161+0000 7f07a7f01640 1 -- 172.21.15.38:0/897572613 shutdown_connections 2024-09-13T18:26:41.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:41.161+0000 7f07a7f01640 1 -- 172.21.15.38:0/897572613 wait complete. 2024-09-13T18:26:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:41 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/897572613' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T18:26:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:41 smithi149 ceph-mon[35845]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:41.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:41 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/897572613' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T18:26:41.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:41 smithi038 ceph-mon[27689]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:41.902 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":19,"flags":0,"active_gid":14213,"active_name":"smithi038.jeygoq","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":2302807265},{"type":"v1","addr":"172.21.15.38:6801","nonce":2302807265}]},"active_addr":"172.21.15.38:6801/2302807265","active_change":"2024-09-13T18:22:55.167324+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14234,"name":"smithi149.eabzne","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.38:8443/","prometheus":"http://172.21.15.38:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":2217216874}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":3449425844}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":954446429}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":2254155782}]}]} 2024-09-13T18:26:41.906 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T18:26:41.906 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T18:26:41.907 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T18:26:42.120 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:43.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.735+0000 7fc6e65f8640 1 -- 172.21.15.38:0/1737521506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0100c50 msgr2=0x7fc6e0101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:43.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.735+0000 7fc6e65f8640 1 --2- 172.21.15.38:0/1737521506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0100c50 0x7fc6e0101030 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00098b0 tx=0x7fc6d002a4d0 comp rx=0 tx=0).stop 2024-09-13T18:26:43.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.735+0000 7fc6e65f8640 1 -- 172.21.15.38:0/1737521506 shutdown_connections 2024-09-13T18:26:43.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.735+0000 7fc6e65f8640 1 --2- 172.21.15.38:0/1737521506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e0101600 0x7fc6e0109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:43.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.735+0000 7fc6e65f8640 1 --2- 172.21.15.38:0/1737521506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0100c50 0x7fc6e0101030 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:43.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.735+0000 7fc6e65f8640 1 -- 172.21.15.38:0/1737521506 >> 172.21.15.38:0/1737521506 conn(0x7fc6e00fa700 msgr2=0x7fc6e00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:43.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.735+0000 7fc6e65f8640 1 -- 172.21.15.38:0/1737521506 shutdown_connections 2024-09-13T18:26:43.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.735+0000 7fc6e65f8640 1 -- 172.21.15.38:0/1737521506 wait complete. 2024-09-13T18:26:43.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.736+0000 7fc6e65f8640 1 Processor -- start 2024-09-13T18:26:43.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.736+0000 7fc6e65f8640 1 -- start start 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.736+0000 7fc6e65f8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e0100c50 0x7fc6e0195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.736+0000 7fc6e65f8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0101600 0x7fc6e0195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.736+0000 7fc6e65f8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0196630 con 0x7fc6e0101600 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.736+0000 7fc6e65f8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e019a380 con 0x7fc6e0100c50 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.736+0000 7fc6df7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0101600 0x7fc6e0195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.737+0000 7fc6df7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0101600 0x7fc6e0195f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46926/0 (socket says 172.21.15.38:46926) 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.737+0000 7fc6df7fe640 1 -- 172.21.15.38:0/3829940136 learned_addr learned my addr 172.21.15.38:0/3829940136 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.737+0000 7fc6dffff640 1 --2- 172.21.15.38:0/3829940136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e0100c50 0x7fc6e0195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.737+0000 7fc6df7fe640 1 -- 172.21.15.38:0/3829940136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e0100c50 msgr2=0x7fc6e0195a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.737+0000 7fc6df7fe640 1 --2- 172.21.15.38:0/3829940136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e0100c50 0x7fc6e0195a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.737+0000 7fc6df7fe640 1 -- 172.21.15.38:0/3829940136 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d0009560 con 0x7fc6e0101600 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.737+0000 7fc6df7fe640 1 --2- 172.21.15.38:0/3829940136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0101600 0x7fc6e0195f50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400d6f0 tx=0x7fc6d400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:43.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.737+0000 7fc6dd7fa640 1 -- 172.21.15.38:0/3829940136 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d4009a30 con 0x7fc6e0101600 2024-09-13T18:26:43.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.737+0000 7fc6dd7fa640 1 -- 172.21.15.38:0/3829940136 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6d40054c0 con 0x7fc6e0101600 2024-09-13T18:26:43.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.737+0000 7fc6e65f8640 1 -- 172.21.15.38:0/3829940136 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e019a660 con 0x7fc6e0101600 2024-09-13T18:26:43.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.737+0000 7fc6dd7fa640 1 -- 172.21.15.38:0/3829940136 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d4004db0 con 0x7fc6e0101600 2024-09-13T18:26:43.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.737+0000 7fc6e65f8640 1 -- 172.21.15.38:0/3829940136 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e019abb0 con 0x7fc6e0101600 2024-09-13T18:26:43.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.738+0000 7fc6e65f8640 1 -- 172.21.15.38:0/3829940136 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e0068d30 con 0x7fc6e0101600 2024-09-13T18:26:43.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.739+0000 7fc6dd7fa640 1 -- 172.21.15.38:0/3829940136 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc6d4004f30 con 0x7fc6e0101600 2024-09-13T18:26:43.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.739+0000 7fc6dd7fa640 1 --2- 172.21.15.38:0/3829940136 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc6c806cbf0 0x7fc6c806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:43.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.740+0000 7fc6dffff640 1 --2- 172.21.15.38:0/3829940136 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc6c806cbf0 0x7fc6c806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:43.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.740+0000 7fc6dd7fa640 1 -- 172.21.15.38:0/3829940136 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc6d408ba20 con 0x7fc6e0101600 2024-09-13T18:26:43.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.740+0000 7fc6dffff640 1 --2- 172.21.15.38:0/3829940136 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc6c806cbf0 0x7fc6c806f0b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0000c00 tx=0x7fc6d0005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:43.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.744+0000 7fc6dd7fa640 1 -- 172.21.15.38:0/3829940136 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc6d4056130 con 0x7fc6e0101600 2024-09-13T18:26:43.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.915+0000 7fc6e65f8640 1 -- 172.21.15.38:0/3829940136 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6e0196d70 con 0x7fc6e0101600 2024-09-13T18:26:43.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.916+0000 7fc6dd7fa640 1 -- 172.21.15.38:0/3829940136 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11348 (secure 0 0 0) 0x7fc6d4020090 con 0x7fc6e0101600 2024-09-13T18:26:43.919 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:26:43.919 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":41,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","created":"2024-09-13T18:20:45.975848+0000","modified":"2024-09-13T18:26:25.615448+0000","last_up_change":"2024-09-13T18:26:24.605474+0000","last_in_change":"2024-09-13T18:26:05.887130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:25:13.672723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8245ff4-3301-430c-a290-6000dfd0807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6803","nonce":3226287112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6805","nonce":3226287112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6809","nonce":3226287112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6807","nonce":3226287112}]},"public_addr":"172.21.15.38:6803/3226287112","cluster_addr":"172.21.15.38:6805/3226287112","heartbeat_back_addr":"172.21.15.38:6809/3226287112","heartbeat_front_addr":"172.21.15.38:6807/3226287112","state":["exists","up"]},{"osd":1,"uuid":"1518b6f4-6e5f-445f-b0cd-2ebaecb3c203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6811","nonce":3899453176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6813","nonce":3899453176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6817","nonce":3899453176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6815","nonce":3899453176}]},"public_addr":"172.21.15.38:6811/3899453176","cluster_addr":"172.21.15.38:6813/3899453176","heartbeat_back_addr":"172.21.15.38:6817/3899453176","heartbeat_front_addr":"172.21.15.38:6815/3899453176","state":["exists","up"]},{"osd":2,"uuid":"43ebe637-fa97-4ac6-b85e-01440f6ca6eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6819","nonce":1096956082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6821","nonce":1096956082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6825","nonce":1096956082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6823","nonce":1096956082}]},"public_addr":"172.21.15.38:6819/1096956082","cluster_addr":"172.21.15.38:6821/1096956082","heartbeat_back_addr":"172.21.15.38:6825/1096956082","heartbeat_front_addr":"172.21.15.38:6823/1096956082","state":["exists","up"]},{"osd":3,"uuid":"5ffdedaf-95c7-45b3-9af6-36b5a74d60f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6801","nonce":3475497989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6803","nonce":3475497989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6807","nonce":3475497989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6805","nonce":3475497989}]},"public_addr":"172.21.15.149:6801/3475497989","cluster_addr":"172.21.15.149:6803/3475497989","heartbeat_back_addr":"172.21.15.149:6807/3475497989","heartbeat_front_addr":"172.21.15.149:6805/3475497989","state":["exists","up"]},{"osd":4,"uuid":"e91e0c22-0686-45ef-a8b3-a356ab76eb88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6809","nonce":3561461615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6811","nonce":3561461615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6815","nonce":3561461615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6813","nonce":3561461615}]},"public_addr":"172.21.15.149:6809/3561461615","cluster_addr":"172.21.15.149:6811/3561461615","heartbeat_back_addr":"172.21.15.149:6815/3561461615","heartbeat_front_addr":"172.21.15.149:6813/3561461615","state":["exists","up"]},{"osd":5,"uuid":"ad710f6e-dbff-455c-8a67-7aca4ab8a56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6817","nonce":2289738730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6819","nonce":2289738730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6823","nonce":2289738730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6821","nonce":2289738730}]},"public_addr":"172.21.15.149:6817/2289738730","cluster_addr":"172.21.15.149:6819/2289738730","heartbeat_back_addr":"172.21.15.149:6823/2289738730","heartbeat_front_addr":"172.21.15.149:6821/2289738730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:11.540858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.374275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:10.472792+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:33.374560+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:58.381692+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:22.772809+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:0/3421440666":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/2793935378":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/1699958329":"2024-09-14T18:21:45.526804+0000","172.21.15.38:0/3719380288":"2024-09-14T18:21:07.813395+0000","172.21.15.38:6800/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/1884863821":"2024-09-14T18:21:07.813395+0000","172.21.15.38:6801/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/133472565":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6800/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6801/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:0/1436289281":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/1458254215":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6800/1869434741":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/1704785391":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6801/1869434741":"2024-09-14T18:22:55.167215+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.918+0000 7fc6e65f8640 1 -- 172.21.15.38:0/3829940136 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc6c806cbf0 msgr2=0x7fc6c806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.918+0000 7fc6e65f8640 1 --2- 172.21.15.38:0/3829940136 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc6c806cbf0 0x7fc6c806f0b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0000c00 tx=0x7fc6d0005a20 comp rx=0 tx=0).stop 2024-09-13T18:26:43.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.918+0000 7fc6e65f8640 1 -- 172.21.15.38:0/3829940136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0101600 msgr2=0x7fc6e0195f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.918+0000 7fc6e65f8640 1 --2- 172.21.15.38:0/3829940136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0101600 0x7fc6e0195f50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400d6f0 tx=0x7fc6d400dbb0 comp rx=0 tx=0).stop 2024-09-13T18:26:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.918+0000 7fc6e65f8640 1 -- 172.21.15.38:0/3829940136 shutdown_connections 2024-09-13T18:26:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.918+0000 7fc6e65f8640 1 --2- 172.21.15.38:0/3829940136 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc6c806cbf0 0x7fc6c806f0b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.918+0000 7fc6e65f8640 1 --2- 172.21.15.38:0/3829940136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0101600 0x7fc6e0195f50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.918+0000 7fc6e65f8640 1 --2- 172.21.15.38:0/3829940136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e0100c50 0x7fc6e0195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.918+0000 7fc6e65f8640 1 -- 172.21.15.38:0/3829940136 >> 172.21.15.38:0/3829940136 conn(0x7fc6e00fa700 msgr2=0x7fc6e0101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.918+0000 7fc6e65f8640 1 -- 172.21.15.38:0/3829940136 shutdown_connections 2024-09-13T18:26:43.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:43.918+0000 7fc6e65f8640 1 -- 172.21.15.38:0/3829940136 wait complete. 2024-09-13T18:26:44.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:44 smithi038 ceph-mon[27689]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:44.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:44 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3829940136' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:26:44.614 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T18:26:44.615 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T18:26:44.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:44 smithi149 ceph-mon[35845]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:44.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:44 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/3829940136' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:26:44.822 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:46.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.450+0000 7f4a35f58640 1 -- 172.21.15.38:0/1545980327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a30101610 msgr2=0x7f4a30109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.450+0000 7f4a35f58640 1 --2- 172.21.15.38:0/1545980327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a30101610 0x7f4a30109b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4a180098b0 tx=0x7f4a1802a4d0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.450+0000 7f4a35f58640 1 -- 172.21.15.38:0/1545980327 shutdown_connections 2024-09-13T18:26:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.450+0000 7f4a35f58640 1 --2- 172.21.15.38:0/1545980327 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a30101610 0x7f4a30109b00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.450+0000 7f4a35f58640 1 --2- 172.21.15.38:0/1545980327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a30100c60 0x7f4a30101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.450+0000 7f4a35f58640 1 -- 172.21.15.38:0/1545980327 >> 172.21.15.38:0/1545980327 conn(0x7f4a300fa730 msgr2=0x7f4a300fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.450+0000 7f4a35f58640 1 -- 172.21.15.38:0/1545980327 shutdown_connections 2024-09-13T18:26:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.450+0000 7f4a35f58640 1 -- 172.21.15.38:0/1545980327 wait complete. 2024-09-13T18:26:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.450+0000 7f4a35f58640 1 Processor -- start 2024-09-13T18:26:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.451+0000 7f4a35f58640 1 -- start start 2024-09-13T18:26:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.451+0000 7f4a35f58640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a30100c60 0x7f4a3019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.451+0000 7f4a35f58640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a30101610 0x7f4a3019ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.451+0000 7f4a35f58640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3019e4f0 con 0x7f4a30101610 2024-09-13T18:26:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.451+0000 7f4a35f58640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30197a80 con 0x7f4a30100c60 2024-09-13T18:26:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.451+0000 7f4a2effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a30101610 0x7f4a3019ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.451+0000 7f4a2effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a30101610 0x7f4a3019ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46948/0 (socket says 172.21.15.38:46948) 2024-09-13T18:26:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.451+0000 7f4a2effd640 1 -- 172.21.15.38:0/1623364490 learned_addr learned my addr 172.21.15.38:0/1623364490 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.451+0000 7f4a2f7fe640 1 --2- 172.21.15.38:0/1623364490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a30100c60 0x7f4a3019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.451+0000 7f4a2effd640 1 -- 172.21.15.38:0/1623364490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a30100c60 msgr2=0x7f4a3019d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.451+0000 7f4a2effd640 1 --2- 172.21.15.38:0/1623364490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a30100c60 0x7f4a3019d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.451+0000 7f4a2effd640 1 -- 172.21.15.38:0/1623364490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009560 con 0x7f4a30101610 2024-09-13T18:26:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.452+0000 7f4a2effd640 1 --2- 172.21.15.38:0/1623364490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a30101610 0x7f4a3019ded0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009230 tx=0x7f4a180056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.452+0000 7f4a2cff9640 1 -- 172.21.15.38:0/1623364490 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a18004b20 con 0x7f4a30101610 2024-09-13T18:26:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.452+0000 7f4a2cff9640 1 -- 172.21.15.38:0/1623364490 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a18004c80 con 0x7f4a30101610 2024-09-13T18:26:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.452+0000 7f4a35f58640 1 -- 172.21.15.38:0/1623364490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a30197d00 con 0x7f4a30101610 2024-09-13T18:26:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.452+0000 7f4a2cff9640 1 -- 172.21.15.38:0/1623364490 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a18031950 con 0x7f4a30101610 2024-09-13T18:26:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.452+0000 7f4a35f58640 1 -- 172.21.15.38:0/1623364490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a301981f0 con 0x7f4a30101610 2024-09-13T18:26:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.453+0000 7f4a35f58640 1 -- 172.21.15.38:0/1623364490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a30068d30 con 0x7f4a30101610 2024-09-13T18:26:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.453+0000 7f4a2cff9640 1 -- 172.21.15.38:0/1623364490 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4a18031b30 con 0x7f4a30101610 2024-09-13T18:26:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.454+0000 7f4a2cff9640 1 --2- 172.21.15.38:0/1623364490 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4a1c06cc60 0x7f4a1c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.454+0000 7f4a2cff9640 1 -- 172.21.15.38:0/1623364490 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f4a180acfc0 con 0x7f4a30101610 2024-09-13T18:26:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.454+0000 7f4a2f7fe640 1 --2- 172.21.15.38:0/1623364490 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4a1c06cc60 0x7f4a1c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.454+0000 7f4a2f7fe640 1 --2- 172.21.15.38:0/1623364490 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4a1c06cc60 0x7f4a1c06f120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a200058c0 tx=0x7f4a2000a250 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:46.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.458+0000 7f4a2cff9640 1 -- 172.21.15.38:0/1623364490 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4a18077780 con 0x7f4a30101610 2024-09-13T18:26:46.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:46 smithi038 ceph-mon[27689]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:46.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.631+0000 7f4a35f58640 1 -- 172.21.15.38:0/1623364490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a30109520 con 0x7f4a30101610 2024-09-13T18:26:46.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.632+0000 7f4a2cff9640 1 -- 172.21.15.38:0/1623364490 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11348 (secure 0 0 0) 0x7f4a1807ada0 con 0x7f4a30101610 2024-09-13T18:26:46.634 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:26:46.635 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":41,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","created":"2024-09-13T18:20:45.975848+0000","modified":"2024-09-13T18:26:25.615448+0000","last_up_change":"2024-09-13T18:26:24.605474+0000","last_in_change":"2024-09-13T18:26:05.887130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:25:13.672723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8245ff4-3301-430c-a290-6000dfd0807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6803","nonce":3226287112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6805","nonce":3226287112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6809","nonce":3226287112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6807","nonce":3226287112}]},"public_addr":"172.21.15.38:6803/3226287112","cluster_addr":"172.21.15.38:6805/3226287112","heartbeat_back_addr":"172.21.15.38:6809/3226287112","heartbeat_front_addr":"172.21.15.38:6807/3226287112","state":["exists","up"]},{"osd":1,"uuid":"1518b6f4-6e5f-445f-b0cd-2ebaecb3c203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6811","nonce":3899453176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6813","nonce":3899453176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6817","nonce":3899453176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6815","nonce":3899453176}]},"public_addr":"172.21.15.38:6811/3899453176","cluster_addr":"172.21.15.38:6813/3899453176","heartbeat_back_addr":"172.21.15.38:6817/3899453176","heartbeat_front_addr":"172.21.15.38:6815/3899453176","state":["exists","up"]},{"osd":2,"uuid":"43ebe637-fa97-4ac6-b85e-01440f6ca6eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6819","nonce":1096956082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6821","nonce":1096956082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6825","nonce":1096956082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6823","nonce":1096956082}]},"public_addr":"172.21.15.38:6819/1096956082","cluster_addr":"172.21.15.38:6821/1096956082","heartbeat_back_addr":"172.21.15.38:6825/1096956082","heartbeat_front_addr":"172.21.15.38:6823/1096956082","state":["exists","up"]},{"osd":3,"uuid":"5ffdedaf-95c7-45b3-9af6-36b5a74d60f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6801","nonce":3475497989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6803","nonce":3475497989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6807","nonce":3475497989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6805","nonce":3475497989}]},"public_addr":"172.21.15.149:6801/3475497989","cluster_addr":"172.21.15.149:6803/3475497989","heartbeat_back_addr":"172.21.15.149:6807/3475497989","heartbeat_front_addr":"172.21.15.149:6805/3475497989","state":["exists","up"]},{"osd":4,"uuid":"e91e0c22-0686-45ef-a8b3-a356ab76eb88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6809","nonce":3561461615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6811","nonce":3561461615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6815","nonce":3561461615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6813","nonce":3561461615}]},"public_addr":"172.21.15.149:6809/3561461615","cluster_addr":"172.21.15.149:6811/3561461615","heartbeat_back_addr":"172.21.15.149:6815/3561461615","heartbeat_front_addr":"172.21.15.149:6813/3561461615","state":["exists","up"]},{"osd":5,"uuid":"ad710f6e-dbff-455c-8a67-7aca4ab8a56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6817","nonce":2289738730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6819","nonce":2289738730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6823","nonce":2289738730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6821","nonce":2289738730}]},"public_addr":"172.21.15.149:6817/2289738730","cluster_addr":"172.21.15.149:6819/2289738730","heartbeat_back_addr":"172.21.15.149:6823/2289738730","heartbeat_front_addr":"172.21.15.149:6821/2289738730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:11.540858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.374275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:10.472792+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:33.374560+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:58.381692+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:22.772809+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:0/3421440666":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/2793935378":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/1699958329":"2024-09-14T18:21:45.526804+0000","172.21.15.38:0/3719380288":"2024-09-14T18:21:07.813395+0000","172.21.15.38:6800/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/1884863821":"2024-09-14T18:21:07.813395+0000","172.21.15.38:6801/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/133472565":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6800/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6801/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:0/1436289281":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/1458254215":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6800/1869434741":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/1704785391":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6801/1869434741":"2024-09-14T18:22:55.167215+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.634+0000 7f4a35f58640 1 -- 172.21.15.38:0/1623364490 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4a1c06cc60 msgr2=0x7f4a1c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.634+0000 7f4a35f58640 1 --2- 172.21.15.38:0/1623364490 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4a1c06cc60 0x7f4a1c06f120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a200058c0 tx=0x7f4a2000a250 comp rx=0 tx=0).stop 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.634+0000 7f4a35f58640 1 -- 172.21.15.38:0/1623364490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a30101610 msgr2=0x7f4a3019ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.634+0000 7f4a35f58640 1 --2- 172.21.15.38:0/1623364490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a30101610 0x7f4a3019ded0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009230 tx=0x7f4a180056e0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.635+0000 7f4a35f58640 1 -- 172.21.15.38:0/1623364490 shutdown_connections 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.635+0000 7f4a35f58640 1 --2- 172.21.15.38:0/1623364490 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4a1c06cc60 0x7f4a1c06f120 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.635+0000 7f4a35f58640 1 --2- 172.21.15.38:0/1623364490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a30101610 0x7f4a3019ded0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.635+0000 7f4a35f58640 1 --2- 172.21.15.38:0/1623364490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a30100c60 0x7f4a3019d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:46.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.635+0000 7f4a35f58640 1 -- 172.21.15.38:0/1623364490 >> 172.21.15.38:0/1623364490 conn(0x7f4a300fa730 msgr2=0x7f4a300fff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:46.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.635+0000 7f4a35f58640 1 -- 172.21.15.38:0/1623364490 shutdown_connections 2024-09-13T18:26:46.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:46.635+0000 7f4a35f58640 1 -- 172.21.15.38:0/1623364490 wait complete. 2024-09-13T18:26:46.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:46 smithi149 ceph-mon[35845]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:47.331 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T18:26:47.332 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T18:26:47.332 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T18:26:47.332 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T18:26:47.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T18:26:47.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T18:26:47.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:47 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1623364490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:26:47.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:47 smithi038 ceph-mon[27689]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:47.598 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:47.600 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:47.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:47 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1623364490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:26:47.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:47 smithi149 ceph-mon[35845]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:48.909 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:48.913 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:48.920 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:50.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:50 smithi149 ceph-mon[35845]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:50.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:50 smithi038 ceph-mon[27689]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:52.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:52 smithi038 ceph-mon[27689]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:52.637 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:52.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:52 smithi149 ceph-mon[35845]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:53.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.866+0000 7f7fda48d640 1 -- 172.21.15.38:0/4083681256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fd41015d0 msgr2=0x7f7fd4109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:53.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.866+0000 7f7fda48d640 1 --2- 172.21.15.38:0/4083681256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fd41015d0 0x7f7fd4109ac0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009880 tx=0x7f7fbc02a540 comp rx=0 tx=0).stop 2024-09-13T18:26:53.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.866+0000 7f7fda48d640 1 -- 172.21.15.38:0/4083681256 shutdown_connections 2024-09-13T18:26:53.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.866+0000 7f7fda48d640 1 --2- 172.21.15.38:0/4083681256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fd41015d0 0x7f7fd4109ac0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:53.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.866+0000 7f7fda48d640 1 --2- 172.21.15.38:0/4083681256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd4100cb0 0x7f7fd4101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:53.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.866+0000 7f7fda48d640 1 -- 172.21.15.38:0/4083681256 >> 172.21.15.38:0/4083681256 conn(0x7f7fd40758a0 msgr2=0x7f7fd40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:53.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.866+0000 7f7fda48d640 1 -- 172.21.15.38:0/4083681256 shutdown_connections 2024-09-13T18:26:53.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.866+0000 7f7fda48d640 1 -- 172.21.15.38:0/4083681256 wait complete. 2024-09-13T18:26:53.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.867+0000 7f7fda48d640 1 Processor -- start 2024-09-13T18:26:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.867+0000 7f7fda48d640 1 -- start start 2024-09-13T18:26:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.867+0000 7f7fda48d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fd4100cb0 0x7f7fd419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.867+0000 7f7fda48d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd41015d0 0x7f7fd419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.867+0000 7f7fda48d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd419c3f0 con 0x7f7fd4100cb0 2024-09-13T18:26:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.867+0000 7f7fda48d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd4195980 con 0x7f7fd41015d0 2024-09-13T18:26:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.867+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fd4100cb0 0x7f7fd419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.867+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fd4100cb0 0x7f7fd419b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41962/0 (socket says 172.21.15.38:41962) 2024-09-13T18:26:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.867+0000 7f7fd3fff640 1 -- 172.21.15.38:0/293894710 learned_addr learned my addr 172.21.15.38:0/293894710 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.868+0000 7f7fcbfff640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd41015d0 0x7f7fd419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.868+0000 7f7fd3fff640 1 -- 172.21.15.38:0/293894710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd41015d0 msgr2=0x7f7fd419bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.868+0000 7f7fd3fff640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd41015d0 0x7f7fd419bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:53.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.868+0000 7f7fd3fff640 1 -- 172.21.15.38:0/293894710 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc009560 con 0x7f7fd4100cb0 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.868+0000 7f7fd3fff640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fd4100cb0 0x7f7fd419b890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400b420 tx=0x7f7fc400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.868+0000 7f7fd1ffb640 1 -- 172.21.15.38:0/293894710 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fc4011800 con 0x7f7fd4100cb0 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.868+0000 7f7fda48d640 1 -- 172.21.15.38:0/293894710 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd4195c60 con 0x7f7fd4100cb0 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.868+0000 7f7fd1ffb640 1 -- 172.21.15.38:0/293894710 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fc4011e00 con 0x7f7fd4100cb0 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.868+0000 7f7fd1ffb640 1 -- 172.21.15.38:0/293894710 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fc400f2e0 con 0x7f7fd4100cb0 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.868+0000 7f7fda48d640 1 -- 172.21.15.38:0/293894710 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd41961b0 con 0x7f7fd4100cb0 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.869+0000 7f7fda48d640 1 -- 172.21.15.38:0/293894710 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7fd410cfc0 con 0x7f7fd4100cb0 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.870+0000 7f7fd1ffb640 1 -- 172.21.15.38:0/293894710 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7fc4010380 con 0x7f7fd4100cb0 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.870+0000 7f7fd1ffb640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f7fc006cc50 0x7f7fc006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.871+0000 7f7fd1ffb640 1 -- 172.21.15.38:0/293894710 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7fc408c3c0 con 0x7f7fd4100cb0 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.871+0000 7f7fcbfff640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f7fc006cc50 0x7f7fc006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.871+0000 7f7fd1ffb640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112] conn(0x7f7fc00729e0 0x7f7fc0074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:53.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.871+0000 7f7fd1ffb640 1 -- 172.21.15.38:0/293894710 --> [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fc00754b0 con 0x7f7fc00729e0 2024-09-13T18:26:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.871+0000 7f7fd1ffb640 1 -- 172.21.15.38:0/293894710 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fc408c820 con 0x7f7fd4100cb0 2024-09-13T18:26:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.871+0000 7f7fd8a2a640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112] conn(0x7f7fc00729e0 0x7f7fc0074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.871+0000 7f7fcbfff640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f7fc006cc50 0x7f7fc006f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4196df0 tx=0x7f7fbc005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.871+0000 7f7fd8a2a640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112] conn(0x7f7fc00729e0 0x7f7fc0074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.872+0000 7f7fd1ffb640 1 -- 172.21.15.38:0/293894710 <== osd.0 v2:172.21.15.38:6802/3226287112 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7fc00754b0 con 0x7f7fc00729e0 2024-09-13T18:26:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.890+0000 7f7fda48d640 1 -- 172.21.15.38:0/293894710 --> [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7fd4068510 con 0x7f7fc00729e0 2024-09-13T18:26:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fd1ffb640 1 -- 172.21.15.38:0/293894710 <== osd.0 v2:172.21.15.38:6802/3226287112 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7fd4068510 con 0x7f7fc00729e0 2024-09-13T18:26:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fda48d640 1 -- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112] conn(0x7f7fc00729e0 msgr2=0x7f7fc0074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:53.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fda48d640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112] conn(0x7f7fc00729e0 0x7f7fc0074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fda48d640 1 -- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f7fc006cc50 msgr2=0x7f7fc006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fda48d640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f7fc006cc50 0x7f7fc006f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4196df0 tx=0x7f7fbc005a20 comp rx=0 tx=0).stop 2024-09-13T18:26:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fda48d640 1 -- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fd4100cb0 msgr2=0x7f7fd419b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fda48d640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fd4100cb0 0x7f7fd419b890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400b420 tx=0x7f7fc400b8e0 comp rx=0 tx=0).stop 2024-09-13T18:26:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fda48d640 1 -- 172.21.15.38:0/293894710 shutdown_connections 2024-09-13T18:26:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fda48d640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:6802/3226287112,v1:172.21.15.38:6803/3226287112] conn(0x7f7fc00729e0 0x7f7fc0074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fda48d640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f7fc006cc50 0x7f7fc006f110 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fda48d640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fd41015d0 0x7f7fd419bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fda48d640 1 --2- 172.21.15.38:0/293894710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fd4100cb0 0x7f7fd419b890 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400b420 tx=0x7f7fc400b8e0 comp rx=0 tx=0).stop 2024-09-13T18:26:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.891+0000 7f7fda48d640 1 -- 172.21.15.38:0/293894710 >> 172.21.15.38:0/293894710 conn(0x7f7fd40758a0 msgr2=0x7f7fd4101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.892+0000 7f7fda48d640 1 -- 172.21.15.38:0/293894710 shutdown_connections 2024-09-13T18:26:53.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:53.892+0000 7f7fda48d640 1 -- 172.21.15.38:0/293894710 wait complete. 2024-09-13T18:26:54.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.092+0000 7fbf517e7640 1 -- 172.21.15.38:0/575613135 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf4c105bf0 msgr2=0x7fbf4c105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.092+0000 7fbf517e7640 1 --2- 172.21.15.38:0/575613135 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf4c105bf0 0x7fbf4c105fd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009880 tx=0x7fbf3c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.092+0000 7fbf517e7640 1 -- 172.21.15.38:0/575613135 shutdown_connections 2024-09-13T18:26:54.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.092+0000 7fbf517e7640 1 --2- 172.21.15.38:0/575613135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf4c0ffb40 0x7fbf4c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.092+0000 7fbf517e7640 1 --2- 172.21.15.38:0/575613135 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf4c105bf0 0x7fbf4c105fd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.092+0000 7fbf517e7640 1 -- 172.21.15.38:0/575613135 >> 172.21.15.38:0/575613135 conn(0x7fbf4c0fb7e0 msgr2=0x7fbf4c0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.092+0000 7fbf517e7640 1 -- 172.21.15.38:0/575613135 shutdown_connections 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.092+0000 7fbf517e7640 1 -- 172.21.15.38:0/575613135 wait complete. 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.092+0000 7fbf517e7640 1 Processor -- start 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.092+0000 7fbf517e7640 1 -- start start 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf517e7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf4c0ffb40 0x7fbf4c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf517e7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf4c105bf0 0x7fbf4c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf517e7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c073230 con 0x7fbf4c105bf0 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf517e7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c073370 con 0x7fbf4c0ffb40 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf43fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf4c105bf0 0x7fbf4c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf43fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf4c105bf0 0x7fbf4c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41990/0 (socket says 172.21.15.38:41990) 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf43fff640 1 -- 172.21.15.38:0/1188291924 learned_addr learned my addr 172.21.15.38:0/1188291924 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf4affd640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf4c0ffb40 0x7fbf4c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf43fff640 1 -- 172.21.15.38:0/1188291924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf4c0ffb40 msgr2=0x7fbf4c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf43fff640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf4c0ffb40 0x7fbf4c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf43fff640 1 -- 172.21.15.38:0/1188291924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c009560 con 0x7fbf4c105bf0 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf43fff640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf4c105bf0 0x7fbf4c072cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400c8a0 tx=0x7fbf3400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf48ff9640 1 -- 172.21.15.38:0/1188291924 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf34007b80 con 0x7fbf4c105bf0 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf48ff9640 1 -- 172.21.15.38:0/1188291924 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbf34007ce0 con 0x7fbf4c105bf0 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.093+0000 7fbf517e7640 1 -- 172.21.15.38:0/1188291924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c1a1bf0 con 0x7fbf4c105bf0 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.094+0000 7fbf48ff9640 1 -- 172.21.15.38:0/1188291924 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf34018770 con 0x7fbf4c105bf0 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.094+0000 7fbf517e7640 1 -- 172.21.15.38:0/1188291924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c1a1f50 con 0x7fbf4c105bf0 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.094+0000 7fbf517e7640 1 -- 172.21.15.38:0/1188291924 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf4c10ced0 con 0x7fbf4c105bf0 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.095+0000 7fbf48ff9640 1 -- 172.21.15.38:0/1188291924 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbf3400f450 con 0x7fbf4c105bf0 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.096+0000 7fbf48ff9640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbf3806cc50 0x7fbf3806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.096+0000 7fbf48ff9640 1 -- 172.21.15.38:0/1188291924 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fbf3408c3a0 con 0x7fbf4c105bf0 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.096+0000 7fbf4affd640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbf3806cc50 0x7fbf3806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.096+0000 7fbf48ff9640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176] conn(0x7fbf380729e0 0x7fbf38074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.096+0000 7fbf48ff9640 1 -- 172.21.15.38:0/1188291924 --> [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf380754b0 con 0x7fbf380729e0 2024-09-13T18:26:54.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.096+0000 7fbf48ff9640 1 -- 172.21.15.38:0/1188291924 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf3408c760 con 0x7fbf4c105bf0 2024-09-13T18:26:54.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.096+0000 7fbf4b7fe640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176] conn(0x7fbf380729e0 0x7fbf38074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.096+0000 7fbf4affd640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbf3806cc50 0x7fbf3806f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c000c00 tx=0x7fbf3c0058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:54.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.096+0000 7fbf4b7fe640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176] conn(0x7fbf380729e0 0x7fbf38074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:54.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.097+0000 7fbf48ff9640 1 -- 172.21.15.38:0/1188291924 <== osd.1 v2:172.21.15.38:6810/3899453176 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbf380754b0 con 0x7fbf380729e0 2024-09-13T18:26:54.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.111+0000 7fbf517e7640 1 -- 172.21.15.38:0/1188291924 --> [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbf4c060b30 con 0x7fbf380729e0 2024-09-13T18:26:54.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.111+0000 7fbf48ff9640 1 -- 172.21.15.38:0/1188291924 <== osd.1 v2:172.21.15.38:6810/3899453176 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbf4c060b30 con 0x7fbf380729e0 2024-09-13T18:26:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 -- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176] conn(0x7fbf380729e0 msgr2=0x7fbf38074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176] conn(0x7fbf380729e0 0x7fbf38074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 -- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbf3806cc50 msgr2=0x7fbf3806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbf3806cc50 0x7fbf3806f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c000c00 tx=0x7fbf3c0058d0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 -- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf4c105bf0 msgr2=0x7fbf4c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf4c105bf0 0x7fbf4c072cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400c8a0 tx=0x7fbf3400cd60 comp rx=0 tx=0).stop 2024-09-13T18:26:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 -- 172.21.15.38:0/1188291924 shutdown_connections 2024-09-13T18:26:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:6810/3899453176,v1:172.21.15.38:6811/3899453176] conn(0x7fbf380729e0 0x7fbf38074e00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbf3806cc50 0x7fbf3806f110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf4c105bf0 0x7fbf4c072cf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 --2- 172.21.15.38:0/1188291924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf4c0ffb40 0x7fbf4c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 -- 172.21.15.38:0/1188291924 >> 172.21.15.38:0/1188291924 conn(0x7fbf4c0fb7e0 msgr2=0x7fbf4c0fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 -- 172.21.15.38:0/1188291924 shutdown_connections 2024-09-13T18:26:54.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.112+0000 7fbf517e7640 1 -- 172.21.15.38:0/1188291924 wait complete. 2024-09-13T18:26:54.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.317+0000 7f4d57bd8640 1 -- 172.21.15.38:0/4099719009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d501049f0 msgr2=0x7f4d50104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.317+0000 7f4d57bd8640 1 --2- 172.21.15.38:0/4099719009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d501049f0 0x7f4d50104dd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009880 tx=0x7f4d4c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.317+0000 7f4d57bd8640 1 -- 172.21.15.38:0/4099719009 shutdown_connections 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.317+0000 7f4d57bd8640 1 --2- 172.21.15.38:0/4099719009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d500fe9f0 0x7f4d500fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.317+0000 7f4d57bd8640 1 --2- 172.21.15.38:0/4099719009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d501049f0 0x7f4d50104dd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.317+0000 7f4d57bd8640 1 -- 172.21.15.38:0/4099719009 >> 172.21.15.38:0/4099719009 conn(0x7f4d500758a0 msgr2=0x7f4d500fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.317+0000 7f4d57bd8640 1 -- 172.21.15.38:0/4099719009 shutdown_connections 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.317+0000 7f4d57bd8640 1 -- 172.21.15.38:0/4099719009 wait complete. 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.318+0000 7f4d57bd8640 1 Processor -- start 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.318+0000 7f4d57bd8640 1 -- start start 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.318+0000 7f4d57bd8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d500fe9f0 0x7f4d5019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.318+0000 7f4d57bd8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d501049f0 0x7f4d5019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.318+0000 7f4d57bd8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5019c390 con 0x7f4d500fe9f0 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.318+0000 7f4d57bd8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50195920 con 0x7f4d501049f0 2024-09-13T18:26:54.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.318+0000 7f4d55974640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d500fe9f0 0x7f4d5019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.318+0000 7f4d55974640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d500fe9f0 0x7f4d5019b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41996/0 (socket says 172.21.15.38:41996) 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.318+0000 7f4d55974640 1 -- 172.21.15.38:0/424942503 learned_addr learned my addr 172.21.15.38:0/424942503 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.318+0000 7f4d55173640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d501049f0 0x7f4d5019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.319+0000 7f4d55974640 1 -- 172.21.15.38:0/424942503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d501049f0 msgr2=0x7f4d5019bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.319+0000 7f4d55974640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d501049f0 0x7f4d5019bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.319+0000 7f4d55974640 1 -- 172.21.15.38:0/424942503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c009560 con 0x7f4d500fe9f0 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.319+0000 7f4d55974640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d500fe9f0 0x7f4d5019b830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c006010 tx=0x7f4d4c0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.319+0000 7f4d46ffd640 1 -- 172.21.15.38:0/424942503 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d4c004b20 con 0x7f4d500fe9f0 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.319+0000 7f4d46ffd640 1 -- 172.21.15.38:0/424942503 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4d4c004c80 con 0x7f4d500fe9f0 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.319+0000 7f4d57bd8640 1 -- 172.21.15.38:0/424942503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d50195ba0 con 0x7f4d500fe9f0 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.319+0000 7f4d46ffd640 1 -- 172.21.15.38:0/424942503 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d4c031890 con 0x7f4d500fe9f0 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.319+0000 7f4d57bd8640 1 -- 172.21.15.38:0/424942503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d50196090 con 0x7f4d500fe9f0 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.320+0000 7f4d57bd8640 1 -- 172.21.15.38:0/424942503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d5010bea0 con 0x7f4d500fe9f0 2024-09-13T18:26:54.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.321+0000 7f4d46ffd640 1 -- 172.21.15.38:0/424942503 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4d4c031b00 con 0x7f4d500fe9f0 2024-09-13T18:26:54.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.321+0000 7f4d46ffd640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4d3c06cc60 0x7f4d3c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.321+0000 7f4d55173640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4d3c06cc60 0x7f4d3c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.321+0000 7f4d46ffd640 1 -- 172.21.15.38:0/424942503 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f4d4c0acfb0 con 0x7f4d500fe9f0 2024-09-13T18:26:54.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.322+0000 7f4d46ffd640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615] conn(0x7f4d3c0729f0 0x7f4d3c074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:54.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.322+0000 7f4d46ffd640 1 -- 172.21.15.38:0/424942503 --> [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d3c0754c0 con 0x7f4d3c0729f0 2024-09-13T18:26:54.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.322+0000 7f4d46ffd640 1 -- 172.21.15.38:0/424942503 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d4c0af680 con 0x7f4d500fe9f0 2024-09-13T18:26:54.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.322+0000 7f4d55173640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4d3c06cc60 0x7f4d3c06f120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d50196d90 tx=0x7f4d40009110 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:54.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.322+0000 7f4d56175640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615] conn(0x7f4d3c0729f0 0x7f4d3c074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:54.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.322+0000 7f4d56175640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615] conn(0x7f4d3c0729f0 0x7f4d3c074e10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:54.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.323+0000 7f4d46ffd640 1 -- 172.21.15.38:0/424942503 <== osd.4 v2:172.21.15.149:6808/3561461615 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4d3c0754c0 con 0x7f4d3c0729f0 2024-09-13T18:26:54.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.350+0000 7f4d57bd8640 1 -- 172.21.15.38:0/424942503 --> [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4d50196540 con 0x7f4d3c0729f0 2024-09-13T18:26:54.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d46ffd640 1 -- 172.21.15.38:0/424942503 <== osd.4 v2:172.21.15.149:6808/3561461615 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4d50196540 con 0x7f4d3c0729f0 2024-09-13T18:26:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 -- 172.21.15.38:0/424942503 >> [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615] conn(0x7f4d3c0729f0 msgr2=0x7f4d3c074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615] conn(0x7f4d3c0729f0 0x7f4d3c074e10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 -- 172.21.15.38:0/424942503 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4d3c06cc60 msgr2=0x7f4d3c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4d3c06cc60 0x7f4d3c06f120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d50196d90 tx=0x7f4d40009110 comp rx=0 tx=0).stop 2024-09-13T18:26:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 -- 172.21.15.38:0/424942503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d500fe9f0 msgr2=0x7f4d5019b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d500fe9f0 0x7f4d5019b830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c006010 tx=0x7f4d4c0055f0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 -- 172.21.15.38:0/424942503 shutdown_connections 2024-09-13T18:26:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.149:6808/3561461615,v1:172.21.15.149:6809/3561461615] conn(0x7f4d3c0729f0 0x7f4d3c074e10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4d3c06cc60 0x7f4d3c06f120 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d501049f0 0x7f4d5019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 --2- 172.21.15.38:0/424942503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4d500fe9f0 0x7f4d5019b830 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:54.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 -- 172.21.15.38:0/424942503 >> 172.21.15.38:0/424942503 conn(0x7f4d500758a0 msgr2=0x7f4d50102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:54.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 -- 172.21.15.38:0/424942503 shutdown_connections 2024-09-13T18:26:54.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:54.351+0000 7f4d57bd8640 1 -- 172.21.15.38:0/424942503 wait complete. 2024-09-13T18:26:54.440 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:54 smithi038 ceph-mon[27689]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:54.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:54 smithi149 ceph-mon[35845]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:55.461 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:26:55.671 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:55 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:26:55.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.931+0000 7ff0764ac640 1 -- 172.21.15.38:0/1460923170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0700fea30 msgr2=0x7ff0700fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.931+0000 7ff0764ac640 1 --2- 172.21.15.38:0/1460923170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0700fea30 0x7ff0700fee90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff064009880 tx=0x7ff06402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.931+0000 7ff0764ac640 1 -- 172.21.15.38:0/1460923170 shutdown_connections 2024-09-13T18:26:55.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.931+0000 7ff0764ac640 1 --2- 172.21.15.38:0/1460923170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0700fea30 0x7ff0700fee90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.931+0000 7ff0764ac640 1 --2- 172.21.15.38:0/1460923170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff070104a30 0x7ff070104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.931+0000 7ff0764ac640 1 -- 172.21.15.38:0/1460923170 >> 172.21.15.38:0/1460923170 conn(0x7ff0700fa730 msgr2=0x7ff0700fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:55.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.931+0000 7ff0764ac640 1 -- 172.21.15.38:0/1460923170 shutdown_connections 2024-09-13T18:26:55.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.931+0000 7ff0764ac640 1 -- 172.21.15.38:0/1460923170 wait complete. 2024-09-13T18:26:55.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.932+0000 7ff0764ac640 1 Processor -- start 2024-09-13T18:26:55.940 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.932+0000 7ff0764ac640 1 -- start start 2024-09-13T18:26:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.932+0000 7ff0764ac640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0700fea30 0x7ff070196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.932+0000 7ff0764ac640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff070104a30 0x7ff070196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.932+0000 7ff0764ac640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff070197390 con 0x7ff0700fea30 2024-09-13T18:26:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff0764ac640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff070197500 con 0x7ff070104a30 2024-09-13T18:26:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff06ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0700fea30 0x7ff070196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff06ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0700fea30 0x7ff070196880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42022/0 (socket says 172.21.15.38:42022) 2024-09-13T18:26:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff06ffff640 1 -- 172.21.15.38:0/126333579 learned_addr learned my addr 172.21.15.38:0/126333579 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff06f7fe640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff070104a30 0x7ff070196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff06ffff640 1 -- 172.21.15.38:0/126333579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff070104a30 msgr2=0x7ff070196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff06ffff640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff070104a30 0x7ff070196dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff06ffff640 1 -- 172.21.15.38:0/126333579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff064009560 con 0x7ff0700fea30 2024-09-13T18:26:55.941 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff06ffff640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0700fea30 0x7ff070196880 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff06000d6f0 tx=0x7ff06000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff06d7fa640 1 -- 172.21.15.38:0/126333579 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff060009a30 con 0x7ff0700fea30 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff0764ac640 1 -- 172.21.15.38:0/126333579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07019f8f0 con 0x7ff0700fea30 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff06d7fa640 1 -- 172.21.15.38:0/126333579 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff0600054c0 con 0x7ff0700fea30 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff06d7fa640 1 -- 172.21.15.38:0/126333579 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff060004db0 con 0x7ff0700fea30 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.933+0000 7ff0764ac640 1 -- 172.21.15.38:0/126333579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07019fd00 con 0x7ff0700fea30 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.934+0000 7ff0764ac640 1 -- 172.21.15.38:0/126333579 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff07010be80 con 0x7ff0700fea30 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.935+0000 7ff06d7fa640 1 -- 172.21.15.38:0/126333579 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff060004f30 con 0x7ff0700fea30 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.935+0000 7ff06d7fa640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff05806cc00 0x7ff05806f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.936+0000 7ff06d7fa640 1 -- 172.21.15.38:0/126333579 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff06008ba10 con 0x7ff0700fea30 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.936+0000 7ff06f7fe640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff05806cc00 0x7ff05806f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.936+0000 7ff06d7fa640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730] conn(0x7ff058072990 0x7ff058074db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.936+0000 7ff06d7fa640 1 -- 172.21.15.38:0/126333579 --> [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff058075460 con 0x7ff058072990 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.936+0000 7ff06d7fa640 1 -- 172.21.15.38:0/126333579 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0600902a0 con 0x7ff0700fea30 2024-09-13T18:26:55.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.936+0000 7ff074a49640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730] conn(0x7ff058072990 0x7ff058074db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:55.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.936+0000 7ff06f7fe640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff05806cc00 0x7ff05806f0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff064000c00 tx=0x7ff064005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:55.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.936+0000 7ff074a49640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730] conn(0x7ff058072990 0x7ff058074db0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:55.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.937+0000 7ff06d7fa640 1 -- 172.21.15.38:0/126333579 <== osd.5 v2:172.21.15.149:6816/2289738730 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff058075460 con 0x7ff058072990 2024-09-13T18:26:55.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.950+0000 7ff0764ac640 1 -- 172.21.15.38:0/126333579 --> [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff070100170 con 0x7ff058072990 2024-09-13T18:26:55.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.951+0000 7ff06d7fa640 1 -- 172.21.15.38:0/126333579 <== osd.5 v2:172.21.15.149:6816/2289738730 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff070100170 con 0x7ff058072990 2024-09-13T18:26:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.951+0000 7ff0764ac640 1 -- 172.21.15.38:0/126333579 >> [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730] conn(0x7ff058072990 msgr2=0x7ff058074db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.951+0000 7ff0764ac640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730] conn(0x7ff058072990 0x7ff058074db0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.951+0000 7ff0764ac640 1 -- 172.21.15.38:0/126333579 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff05806cc00 msgr2=0x7ff05806f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.951+0000 7ff0764ac640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff05806cc00 0x7ff05806f0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff064000c00 tx=0x7ff064005a20 comp rx=0 tx=0).stop 2024-09-13T18:26:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.951+0000 7ff0764ac640 1 -- 172.21.15.38:0/126333579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0700fea30 msgr2=0x7ff070196880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.951+0000 7ff0764ac640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0700fea30 0x7ff070196880 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff06000d6f0 tx=0x7ff06000dbb0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.951+0000 7ff0764ac640 1 -- 172.21.15.38:0/126333579 shutdown_connections 2024-09-13T18:26:55.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.951+0000 7ff0764ac640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.149:6816/2289738730,v1:172.21.15.149:6817/2289738730] conn(0x7ff058072990 0x7ff058074db0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.952+0000 7ff0764ac640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff05806cc00 0x7ff05806f0c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.952+0000 7ff0764ac640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff070104a30 0x7ff070196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.952+0000 7ff0764ac640 1 --2- 172.21.15.38:0/126333579 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff0700fea30 0x7ff070196880 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:55.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.952+0000 7ff0764ac640 1 -- 172.21.15.38:0/126333579 >> 172.21.15.38:0/126333579 conn(0x7ff0700fa730 msgr2=0x7ff0700fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:55.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.952+0000 7ff0764ac640 1 -- 172.21.15.38:0/126333579 shutdown_connections 2024-09-13T18:26:55.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:55.952+0000 7ff0764ac640 1 -- 172.21.15.38:0/126333579 wait complete. 2024-09-13T18:26:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:56 smithi038 ceph-mon[27689]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:56.649 INFO:teuthology.orchestra.run.smithi038.stdout:60129542172 2024-09-13T18:26:56.650 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T18:26:56.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:56 smithi149 ceph-mon[35845]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:57.412 INFO:teuthology.orchestra.run.smithi038.stdout:38654705700 2024-09-13T18:26:57.412 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T18:26:57.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:26:57 smithi038 ceph-mon[27689]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:57.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:26:57 smithi149 ceph-mon[35845]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:26:58.003 INFO:teuthology.orchestra.run.smithi038.stdout:171798691850 2024-09-13T18:26:58.004 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T18:26:58.656 INFO:teuthology.orchestra.run.smithi038.stdout:150323855372 2024-09-13T18:26:58.656 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T18:26:59.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.292+0000 7f3b39f97640 1 -- 172.21.15.38:0/3133542950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b340ff1f0 msgr2=0x7f3b3410bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.292+0000 7f3b39f97640 1 --2- 172.21.15.38:0/3133542950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b340ff1f0 0x7f3b3410bf40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009880 tx=0x7f3b2802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.292+0000 7f3b39f97640 1 -- 172.21.15.38:0/3133542950 shutdown_connections 2024-09-13T18:26:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.292+0000 7f3b39f97640 1 --2- 172.21.15.38:0/3133542950 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b340ff1f0 0x7f3b3410bf40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.292+0000 7f3b39f97640 1 --2- 172.21.15.38:0/3133542950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b340fe8d0 0x7f3b340fecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.292+0000 7f3b39f97640 1 -- 172.21.15.38:0/3133542950 >> 172.21.15.38:0/3133542950 conn(0x7f3b340fa700 msgr2=0x7f3b340fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.292+0000 7f3b39f97640 1 -- 172.21.15.38:0/3133542950 shutdown_connections 2024-09-13T18:26:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.292+0000 7f3b39f97640 1 -- 172.21.15.38:0/3133542950 wait complete. 2024-09-13T18:26:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.293+0000 7f3b39f97640 1 Processor -- start 2024-09-13T18:26:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.293+0000 7f3b39f97640 1 -- start start 2024-09-13T18:26:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.293+0000 7f3b39f97640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b340fe8d0 0x7f3b3419d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.293+0000 7f3b39f97640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b340ff1f0 0x7f3b3419de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.293+0000 7f3b39f97640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3419e400 con 0x7f3b340ff1f0 2024-09-13T18:26:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.293+0000 7f3b39f97640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34197a20 con 0x7f3b340fe8d0 2024-09-13T18:26:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.293+0000 7f3b32ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b340ff1f0 0x7f3b3419de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.293+0000 7f3b32ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b340ff1f0 0x7f3b3419de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42036/0 (socket says 172.21.15.38:42036) 2024-09-13T18:26:59.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.293+0000 7f3b32ffd640 1 -- 172.21.15.38:0/123453765 learned_addr learned my addr 172.21.15.38:0/123453765 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:26:59.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.293+0000 7f3b337fe640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b340fe8d0 0x7f3b3419d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.293+0000 7f3b32ffd640 1 -- 172.21.15.38:0/123453765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b340fe8d0 msgr2=0x7f3b3419d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.294+0000 7f3b32ffd640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b340fe8d0 0x7f3b3419d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.294+0000 7f3b32ffd640 1 -- 172.21.15.38:0/123453765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b28009560 con 0x7f3b340ff1f0 2024-09-13T18:26:59.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.294+0000 7f3b32ffd640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b340ff1f0 0x7f3b3419de70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b28006010 tx=0x7f3b28004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.294+0000 7f3b30ff9640 1 -- 172.21.15.38:0/123453765 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b280053b0 con 0x7f3b340ff1f0 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.294+0000 7f3b30ff9640 1 -- 172.21.15.38:0/123453765 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b28005510 con 0x7f3b340ff1f0 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.294+0000 7f3b39f97640 1 -- 172.21.15.38:0/123453765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b34197ca0 con 0x7f3b340ff1f0 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.294+0000 7f3b30ff9640 1 -- 172.21.15.38:0/123453765 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b280319f0 con 0x7f3b340ff1f0 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.294+0000 7f3b39f97640 1 -- 172.21.15.38:0/123453765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b34198190 con 0x7f3b340ff1f0 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.295+0000 7f3b39f97640 1 -- 172.21.15.38:0/123453765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b3410f160 con 0x7f3b340ff1f0 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.295+0000 7f3b30ff9640 1 -- 172.21.15.38:0/123453765 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3b28003c90 con 0x7f3b340ff1f0 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.296+0000 7f3b30ff9640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3b1c06cc50 0x7f3b1c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.296+0000 7f3b30ff9640 1 -- 172.21.15.38:0/123453765 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3b280ad090 con 0x7f3b340ff1f0 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.296+0000 7f3b337fe640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3b1c06cc50 0x7f3b1c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.296+0000 7f3b30ff9640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989] conn(0x7f3b1c0729e0 0x7f3b1c074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.296+0000 7f3b30ff9640 1 -- 172.21.15.38:0/123453765 --> [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b1c0754b0 con 0x7f3b1c0729e0 2024-09-13T18:26:59.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.296+0000 7f3b30ff9640 1 -- 172.21.15.38:0/123453765 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b280af760 con 0x7f3b340ff1f0 2024-09-13T18:26:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.296+0000 7f3b33fff640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989] conn(0x7f3b1c0729e0 0x7f3b1c074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:26:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.296+0000 7f3b337fe640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3b1c06cc50 0x7f3b1c06f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b24005e10 tx=0x7f3b24005da0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.297+0000 7f3b33fff640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989] conn(0x7f3b1c0729e0 0x7f3b1c074e00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:26:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.298+0000 7f3b30ff9640 1 -- 172.21.15.38:0/123453765 <== osd.3 v2:172.21.15.149:6800/3475497989 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3b1c0754b0 con 0x7f3b1c0729e0 2024-09-13T18:26:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.311+0000 7f3b39f97640 1 -- 172.21.15.38:0/123453765 --> [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b34198670 con 0x7f3b1c0729e0 2024-09-13T18:26:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.311+0000 7f3b30ff9640 1 -- 172.21.15.38:0/123453765 <== osd.3 v2:172.21.15.149:6800/3475497989 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3b34198670 con 0x7f3b1c0729e0 2024-09-13T18:26:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 -- 172.21.15.38:0/123453765 >> [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989] conn(0x7f3b1c0729e0 msgr2=0x7f3b1c074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989] conn(0x7f3b1c0729e0 0x7f3b1c074e00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 -- 172.21.15.38:0/123453765 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3b1c06cc50 msgr2=0x7f3b1c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3b1c06cc50 0x7f3b1c06f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b24005e10 tx=0x7f3b24005da0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 -- 172.21.15.38:0/123453765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b340ff1f0 msgr2=0x7f3b3419de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:26:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b340ff1f0 0x7f3b3419de70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b28006010 tx=0x7f3b28004da0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 -- 172.21.15.38:0/123453765 shutdown_connections 2024-09-13T18:26:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3b1c06cc50 0x7f3b1c06f110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.149:6800/3475497989,v1:172.21.15.149:6801/3475497989] conn(0x7f3b1c0729e0 0x7f3b1c074e00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3b340ff1f0 0x7f3b3419de70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 --2- 172.21.15.38:0/123453765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b340fe8d0 0x7f3b3419d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:26:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 -- 172.21.15.38:0/123453765 >> 172.21.15.38:0/123453765 conn(0x7f3b340fa700 msgr2=0x7f3b340fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:26:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 -- 172.21.15.38:0/123453765 shutdown_connections 2024-09-13T18:26:59.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:26:59.312+0000 7f3b39f97640 1 -- 172.21.15.38:0/123453765 wait complete. 2024-09-13T18:26:59.329 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:26:59.329 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:00.158 INFO:teuthology.orchestra.run.smithi038.stdout:115964117011 2024-09-13T18:27:00.159 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T18:27:00.213 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:00.439 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:00 smithi038 ceph-mon[27689]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:00.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:00 smithi149 ceph-mon[35845]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:01.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.860+0000 7fc0a30f5640 1 -- 172.21.15.38:0/1789448374 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc09c0fea30 msgr2=0x7fc09c0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.860+0000 7fc0a30f5640 1 --2- 172.21.15.38:0/1789448374 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc09c0fea30 0x7fc09c0fee90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009c20 tx=0x7fc08c02a970 comp rx=0 tx=0).stop 2024-09-13T18:27:01.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.860+0000 7fc0a30f5640 1 -- 172.21.15.38:0/1789448374 shutdown_connections 2024-09-13T18:27:01.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.860+0000 7fc0a30f5640 1 --2- 172.21.15.38:0/1789448374 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc09c0fea30 0x7fc09c0fee90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.860+0000 7fc0a30f5640 1 --2- 172.21.15.38:0/1789448374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc09c104a30 0x7fc09c104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.860+0000 7fc0a30f5640 1 -- 172.21.15.38:0/1789448374 >> 172.21.15.38:0/1789448374 conn(0x7fc09c0fa730 msgr2=0x7fc09c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.860+0000 7fc0a30f5640 1 -- 172.21.15.38:0/1789448374 shutdown_connections 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.860+0000 7fc0a30f5640 1 -- 172.21.15.38:0/1789448374 wait complete. 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.861+0000 7fc0a30f5640 1 Processor -- start 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.861+0000 7fc0a30f5640 1 -- start start 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.861+0000 7fc0a30f5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc09c0fea30 0x7fc09c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.861+0000 7fc0a30f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc09c104a30 0x7fc09c19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.861+0000 7fc0a30f5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c19b370 con 0x7fc09c104a30 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.861+0000 7fc0a30f5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c194900 con 0x7fc09c0fea30 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.861+0000 7fc09bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc09c104a30 0x7fc09c19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.862+0000 7fc09bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc09c104a30 0x7fc09c19ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42050/0 (socket says 172.21.15.38:42050) 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.862+0000 7fc09bfff640 1 -- 172.21.15.38:0/3551973149 learned_addr learned my addr 172.21.15.38:0/3551973149 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.862+0000 7fc0a0e91640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc09c0fea30 0x7fc09c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.862+0000 7fc09bfff640 1 -- 172.21.15.38:0/3551973149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc09c0fea30 msgr2=0x7fc09c19a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.862+0000 7fc09bfff640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc09c0fea30 0x7fc09c19a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.862+0000 7fc09bfff640 1 -- 172.21.15.38:0/3551973149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c009900 con 0x7fc09c104a30 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.862+0000 7fc09bfff640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc09c104a30 0x7fc09c19ad50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc08c006010 tx=0x7fc08c0308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.862+0000 7fc099ffb640 1 -- 172.21.15.38:0/3551973149 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc08c02f3c0 con 0x7fc09c104a30 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.862+0000 7fc099ffb640 1 -- 172.21.15.38:0/3551973149 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc08c02f9c0 con 0x7fc09c104a30 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.862+0000 7fc0a30f5640 1 -- 172.21.15.38:0/3551973149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c194b80 con 0x7fc09c104a30 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.862+0000 7fc099ffb640 1 -- 172.21.15.38:0/3551973149 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc08c039450 con 0x7fc09c104a30 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.862+0000 7fc0a30f5640 1 -- 172.21.15.38:0/3551973149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c195070 con 0x7fc09c104a30 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.863+0000 7fc0a30f5640 1 -- 172.21.15.38:0/3551973149 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc09c10be60 con 0x7fc09c104a30 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.864+0000 7fc099ffb640 1 -- 172.21.15.38:0/3551973149 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc08c00a040 con 0x7fc09c104a30 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.864+0000 7fc099ffb640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc08806cc60 0x7fc08806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.864+0000 7fc099ffb640 1 -- 172.21.15.38:0/3551973149 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc08c02c040 con 0x7fc09c104a30 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.864+0000 7fc0a0e91640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc08806cc60 0x7fc08806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.865+0000 7fc099ffb640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082] conn(0x7fc088072a40 0x7fc088074e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:01.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.865+0000 7fc099ffb640 1 -- 172.21.15.38:0/3551973149 --> [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc088075510 con 0x7fc088072a40 2024-09-13T18:27:01.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.865+0000 7fc099ffb640 1 -- 172.21.15.38:0/3551973149 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc08c0af7b0 con 0x7fc09c104a30 2024-09-13T18:27:01.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.865+0000 7fc0a1692640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082] conn(0x7fc088072a40 0x7fc088074e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:01.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.865+0000 7fc0a0e91640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc08806cc60 0x7fc08806f120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc084009990 tx=0x7fc084009110 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.865+0000 7fc0a1692640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082] conn(0x7fc088072a40 0x7fc088074e60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:01.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.866+0000 7fc099ffb640 1 -- 172.21.15.38:0/3551973149 <== osd.2 v2:172.21.15.38:6818/1096956082 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc088075510 con 0x7fc088072a40 2024-09-13T18:27:01.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.879+0000 7fc0a30f5640 1 -- 172.21.15.38:0/3551973149 --> [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc09c100170 con 0x7fc088072a40 2024-09-13T18:27:01.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.879+0000 7fc099ffb640 1 -- 172.21.15.38:0/3551973149 <== osd.2 v2:172.21.15.38:6818/1096956082 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc09c100170 con 0x7fc088072a40 2024-09-13T18:27:01.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.880+0000 7fc0a30f5640 1 -- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082] conn(0x7fc088072a40 msgr2=0x7fc088074e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.880+0000 7fc0a30f5640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082] conn(0x7fc088072a40 0x7fc088074e60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.880+0000 7fc0a30f5640 1 -- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc08806cc60 msgr2=0x7fc08806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.880+0000 7fc0a30f5640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc08806cc60 0x7fc08806f120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc084009990 tx=0x7fc084009110 comp rx=0 tx=0).stop 2024-09-13T18:27:01.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.880+0000 7fc0a30f5640 1 -- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc09c104a30 msgr2=0x7fc09c19ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:01.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.880+0000 7fc0a30f5640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc09c104a30 0x7fc09c19ad50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc08c006010 tx=0x7fc08c0308a0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.880+0000 7fc0a30f5640 1 -- 172.21.15.38:0/3551973149 shutdown_connections 2024-09-13T18:27:01.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.880+0000 7fc0a30f5640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc08806cc60 0x7fc08806f120 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.880+0000 7fc0a30f5640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:6818/1096956082,v1:172.21.15.38:6819/1096956082] conn(0x7fc088072a40 0x7fc088074e60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.880+0000 7fc0a30f5640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc09c104a30 0x7fc09c19ad50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.880+0000 7fc0a30f5640 1 --2- 172.21.15.38:0/3551973149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc09c0fea30 0x7fc09c19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:01.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.880+0000 7fc0a30f5640 1 -- 172.21.15.38:0/3551973149 >> 172.21.15.38:0/3551973149 conn(0x7fc09c0fa730 msgr2=0x7fc09c0fb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:01.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.881+0000 7fc0a30f5640 1 -- 172.21.15.38:0/3551973149 shutdown_connections 2024-09-13T18:27:01.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:00.881+0000 7fc0a30f5640 1 -- 172.21.15.38:0/3551973149 wait complete. 2024-09-13T18:27:02.530 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:02 smithi038 ceph-mon[27689]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:02.556 INFO:teuthology.orchestra.run.smithi038.stdout:81604378649 2024-09-13T18:27:02.556 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T18:27:02.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:02 smithi149 ceph-mon[35845]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:03.483 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:03.483 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:04.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:04 smithi038 ceph-mon[27689]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:04.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:04 smithi149 ceph-mon[35845]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:05.429 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:05 smithi038 ceph-mon[27689]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:05.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:05 smithi149 ceph-mon[35845]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:06.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.260+0000 7efcf849a640 1 -- 172.21.15.38:0/899710790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf0100750 msgr2=0x7efcf01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.260+0000 7efcf849a640 1 --2- 172.21.15.38:0/899710790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf0100750 0x7efcf01047a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efce0009880 tx=0x7efce002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.260+0000 7efcf849a640 1 -- 172.21.15.38:0/899710790 shutdown_connections 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.260+0000 7efcf849a640 1 --2- 172.21.15.38:0/899710790 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf0100750 0x7efcf01047a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.260+0000 7efcf849a640 1 --2- 172.21.15.38:0/899710790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf00ffda0 0x7efcf0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.260+0000 7efcf849a640 1 -- 172.21.15.38:0/899710790 >> 172.21.15.38:0/899710790 conn(0x7efcf00fb840 msgr2=0x7efcf00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.260+0000 7efcf849a640 1 -- 172.21.15.38:0/899710790 shutdown_connections 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.260+0000 7efcf849a640 1 -- 172.21.15.38:0/899710790 wait complete. 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.261+0000 7efcf849a640 1 Processor -- start 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.261+0000 7efcf849a640 1 -- start start 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.261+0000 7efcf849a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf00ffda0 0x7efcf00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.261+0000 7efcf849a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf0100750 0x7efcf0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.261+0000 7efcf849a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0073230 con 0x7efcf00ffda0 2024-09-13T18:27:06.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.261+0000 7efcf849a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf00733a0 con 0x7efcf0100750 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.261+0000 7efcf6236640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf00ffda0 0x7efcf00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.261+0000 7efcf6236640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf00ffda0 0x7efcf00727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54212/0 (socket says 172.21.15.38:54212) 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.261+0000 7efcf6236640 1 -- 172.21.15.38:0/3826436548 learned_addr learned my addr 172.21.15.38:0/3826436548 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.262+0000 7efcf5a35640 1 --2- 172.21.15.38:0/3826436548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf0100750 0x7efcf0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.262+0000 7efcf6236640 1 -- 172.21.15.38:0/3826436548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf0100750 msgr2=0x7efcf0072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.262+0000 7efcf6236640 1 --2- 172.21.15.38:0/3826436548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf0100750 0x7efcf0072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.262+0000 7efcf6236640 1 -- 172.21.15.38:0/3826436548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce0009560 con 0x7efcf00ffda0 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.262+0000 7efcf6236640 1 --2- 172.21.15.38:0/3826436548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf00ffda0 0x7efcf00727b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efcec00b420 tx=0x7efcec00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.262+0000 7efce77fe640 1 -- 172.21.15.38:0/3826436548 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcec011800 con 0x7efcf00ffda0 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.262+0000 7efce77fe640 1 -- 172.21.15.38:0/3826436548 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efcec011e00 con 0x7efcf00ffda0 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.262+0000 7efcf849a640 1 -- 172.21.15.38:0/3826436548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf01a1d70 con 0x7efcf00ffda0 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.262+0000 7efce77fe640 1 -- 172.21.15.38:0/3826436548 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcec00f2e0 con 0x7efcf00ffda0 2024-09-13T18:27:06.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.262+0000 7efcf849a640 1 -- 172.21.15.38:0/3826436548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf01a20d0 con 0x7efcf00ffda0 2024-09-13T18:27:06.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.263+0000 7efcf849a640 1 -- 172.21.15.38:0/3826436548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf0101280 con 0x7efcf00ffda0 2024-09-13T18:27:06.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.264+0000 7efce77fe640 1 -- 172.21.15.38:0/3826436548 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efcec010380 con 0x7efcf00ffda0 2024-09-13T18:27:06.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.264+0000 7efce77fe640 1 --2- 172.21.15.38:0/3826436548 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7efcdc06cc50 0x7efcdc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.264+0000 7efce77fe640 1 -- 172.21.15.38:0/3826436548 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7efcec08b7e0 con 0x7efcf00ffda0 2024-09-13T18:27:06.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.264+0000 7efcf5a35640 1 --2- 172.21.15.38:0/3826436548 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7efcdc06cc50 0x7efcdc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.265+0000 7efcf5a35640 1 --2- 172.21.15.38:0/3826436548 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7efcdc06cc50 0x7efcdc06f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efce0000c00 tx=0x7efce0004200 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.269+0000 7efce77fe640 1 -- 172.21.15.38:0/3826436548 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efcec055f70 con 0x7efcf00ffda0 2024-09-13T18:27:06.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.442+0000 7efcf849a640 1 -- 172.21.15.38:0/3826436548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efcf010ccf0 con 0x7efcf00ffda0 2024-09-13T18:27:06.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.442+0000 7efce77fe640 1 -- 172.21.15.38:0/3826436548 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efcec059590 con 0x7efcf00ffda0 2024-09-13T18:27:06.445 INFO:teuthology.orchestra.run.smithi038.stdout:38654705702 2024-09-13T18:27:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.444+0000 7efcf849a640 1 -- 172.21.15.38:0/3826436548 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7efcdc06cc50 msgr2=0x7efcdc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.444+0000 7efcf849a640 1 --2- 172.21.15.38:0/3826436548 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7efcdc06cc50 0x7efcdc06f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efce0000c00 tx=0x7efce0004200 comp rx=0 tx=0).stop 2024-09-13T18:27:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.444+0000 7efcf849a640 1 -- 172.21.15.38:0/3826436548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf00ffda0 msgr2=0x7efcf00727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.444+0000 7efcf849a640 1 --2- 172.21.15.38:0/3826436548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf00ffda0 0x7efcf00727b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efcec00b420 tx=0x7efcec00b8e0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.445+0000 7efcf849a640 1 -- 172.21.15.38:0/3826436548 shutdown_connections 2024-09-13T18:27:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.445+0000 7efcf849a640 1 --2- 172.21.15.38:0/3826436548 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7efcdc06cc50 0x7efcdc06f110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.445+0000 7efcf849a640 1 --2- 172.21.15.38:0/3826436548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcf0100750 0x7efcf0072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.445+0000 7efcf849a640 1 --2- 172.21.15.38:0/3826436548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efcf00ffda0 0x7efcf00727b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.445+0000 7efcf849a640 1 -- 172.21.15.38:0/3826436548 >> 172.21.15.38:0/3826436548 conn(0x7efcf00fb840 msgr2=0x7efcf00fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.445+0000 7efcf849a640 1 -- 172.21.15.38:0/3826436548 shutdown_connections 2024-09-13T18:27:06.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.445+0000 7efcf849a640 1 -- 172.21.15.38:0/3826436548 wait complete. 2024-09-13T18:27:06.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.496+0000 7fa5732ce640 1 -- 172.21.15.38:0/3009199897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa56c105c00 msgr2=0x7fa56c105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.496+0000 7fa5732ce640 1 --2- 172.21.15.38:0/3009199897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa56c105c00 0x7fa56c105fe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa568009880 tx=0x7fa56802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.496+0000 7fa5732ce640 1 -- 172.21.15.38:0/3009199897 shutdown_connections 2024-09-13T18:27:06.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.496+0000 7fa5732ce640 1 --2- 172.21.15.38:0/3009199897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0ffb50 0x7fa56c0fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.496+0000 7fa5732ce640 1 --2- 172.21.15.38:0/3009199897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa56c105c00 0x7fa56c105fe0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.496+0000 7fa5732ce640 1 -- 172.21.15.38:0/3009199897 >> 172.21.15.38:0/3009199897 conn(0x7fa56c0fb830 msgr2=0x7fa56c0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.496+0000 7fa5732ce640 1 -- 172.21.15.38:0/3009199897 shutdown_connections 2024-09-13T18:27:06.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.496+0000 7fa5732ce640 1 -- 172.21.15.38:0/3009199897 wait complete. 2024-09-13T18:27:06.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.497+0000 7fa5732ce640 1 Processor -- start 2024-09-13T18:27:06.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.497+0000 7fa5732ce640 1 -- start start 2024-09-13T18:27:06.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.497+0000 7fa5732ce640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0ffb50 0x7fa56c19da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.497+0000 7fa5732ce640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa56c105c00 0x7fa56c19df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.497+0000 7fa5732ce640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c197a90 con 0x7fa56c105c00 2024-09-13T18:27:06.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.497+0000 7fa5732ce640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c197bd0 con 0x7fa56c0ffb50 2024-09-13T18:27:06.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.497+0000 7fa570869640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa56c105c00 0x7fa56c19df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.497+0000 7fa570869640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa56c105c00 0x7fa56c19df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54232/0 (socket says 172.21.15.38:54232) 2024-09-13T18:27:06.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.497+0000 7fa570869640 1 -- 172.21.15.38:0/1454068115 learned_addr learned my addr 172.21.15.38:0/1454068115 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:06.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.497+0000 7fa57106a640 1 --2- 172.21.15.38:0/1454068115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0ffb50 0x7fa56c19da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.498+0000 7fa570869640 1 -- 172.21.15.38:0/1454068115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0ffb50 msgr2=0x7fa56c19da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.498+0000 7fa570869640 1 --2- 172.21.15.38:0/1454068115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0ffb50 0x7fa56c19da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.498+0000 7fa570869640 1 -- 172.21.15.38:0/1454068115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa568009560 con 0x7fa56c105c00 2024-09-13T18:27:06.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.498+0000 7fa570869640 1 --2- 172.21.15.38:0/1454068115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa56c105c00 0x7fa56c19df70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00b420 tx=0x7fa55c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.505+0000 7fa5627fc640 1 -- 172.21.15.38:0/1454068115 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa55c011800 con 0x7fa56c105c00 2024-09-13T18:27:06.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.505+0000 7fa5732ce640 1 -- 172.21.15.38:0/1454068115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c197eb0 con 0x7fa56c105c00 2024-09-13T18:27:06.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.505+0000 7fa5627fc640 1 -- 172.21.15.38:0/1454068115 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa55c011e00 con 0x7fa56c105c00 2024-09-13T18:27:06.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.505+0000 7fa5627fc640 1 -- 172.21.15.38:0/1454068115 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa55c00f2e0 con 0x7fa56c105c00 2024-09-13T18:27:06.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.505+0000 7fa5732ce640 1 -- 172.21.15.38:0/1454068115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c198480 con 0x7fa56c105c00 2024-09-13T18:27:06.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.507+0000 7fa5732ce640 1 -- 172.21.15.38:0/1454068115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c101200 con 0x7fa56c105c00 2024-09-13T18:27:06.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.507+0000 7fa5627fc640 1 -- 172.21.15.38:0/1454068115 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa55c010380 con 0x7fa56c105c00 2024-09-13T18:27:06.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.507+0000 7fa5627fc640 1 --2- 172.21.15.38:0/1454068115 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa55806cc50 0x7fa55806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.507+0000 7fa5627fc640 1 -- 172.21.15.38:0/1454068115 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa55c08b800 con 0x7fa56c105c00 2024-09-13T18:27:06.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.507+0000 7fa57106a640 1 --2- 172.21.15.38:0/1454068115 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa55806cc50 0x7fa55806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.508+0000 7fa57106a640 1 --2- 172.21.15.38:0/1454068115 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa55806cc50 0x7fa55806f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa568000c00 tx=0x7fa5680058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.512+0000 7fa5627fc640 1 -- 172.21.15.38:0/1454068115 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa55c055f10 con 0x7fa56c105c00 2024-09-13T18:27:06.514 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:06 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3826436548' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T18:27:06.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.686+0000 7fa5732ce640 1 -- 172.21.15.38:0/1454068115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa56c104e10 con 0x7fa56c105c00 2024-09-13T18:27:06.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.686+0000 7fa5627fc640 1 -- 172.21.15.38:0/1454068115 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa55c059530 con 0x7fa56c105c00 2024-09-13T18:27:06.689 INFO:teuthology.orchestra.run.smithi038.stdout:60129542175 2024-09-13T18:27:06.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.689+0000 7fa5732ce640 1 -- 172.21.15.38:0/1454068115 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa55806cc50 msgr2=0x7fa55806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.689+0000 7fa5732ce640 1 --2- 172.21.15.38:0/1454068115 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa55806cc50 0x7fa55806f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa568000c00 tx=0x7fa5680058d0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.689+0000 7fa5732ce640 1 -- 172.21.15.38:0/1454068115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa56c105c00 msgr2=0x7fa56c19df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.689+0000 7fa5732ce640 1 --2- 172.21.15.38:0/1454068115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa56c105c00 0x7fa56c19df70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00b420 tx=0x7fa55c00b8e0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.689+0000 7fa5732ce640 1 -- 172.21.15.38:0/1454068115 shutdown_connections 2024-09-13T18:27:06.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.689+0000 7fa5732ce640 1 --2- 172.21.15.38:0/1454068115 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa55806cc50 0x7fa55806f110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.689+0000 7fa5732ce640 1 --2- 172.21.15.38:0/1454068115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa56c105c00 0x7fa56c19df70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.689+0000 7fa5732ce640 1 --2- 172.21.15.38:0/1454068115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa56c0ffb50 0x7fa56c19da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.689+0000 7fa5732ce640 1 -- 172.21.15.38:0/1454068115 >> 172.21.15.38:0/1454068115 conn(0x7fa56c0fb830 msgr2=0x7fa56c073060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.689+0000 7fa5732ce640 1 -- 172.21.15.38:0/1454068115 shutdown_connections 2024-09-13T18:27:06.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.689+0000 7fa5732ce640 1 -- 172.21.15.38:0/1454068115 wait complete. 2024-09-13T18:27:06.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:06 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/3826436548' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T18:27:06.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.771+0000 7f650d1b3640 1 -- 172.21.15.38:0/21775822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65080ffda0 msgr2=0x7f6508100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.771+0000 7f650d1b3640 1 --2- 172.21.15.38:0/21775822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65080ffda0 0x7f6508100180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009880 tx=0x7f64f802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.771+0000 7f650d1b3640 1 -- 172.21.15.38:0/21775822 shutdown_connections 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.771+0000 7f650d1b3640 1 --2- 172.21.15.38:0/21775822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6508100750 0x7f65081047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.771+0000 7f650d1b3640 1 --2- 172.21.15.38:0/21775822 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65080ffda0 0x7f6508100180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.771+0000 7f650d1b3640 1 -- 172.21.15.38:0/21775822 >> 172.21.15.38:0/21775822 conn(0x7f65080fb840 msgr2=0x7f65080fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.771+0000 7f650d1b3640 1 -- 172.21.15.38:0/21775822 shutdown_connections 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.772+0000 7f650d1b3640 1 -- 172.21.15.38:0/21775822 wait complete. 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.772+0000 7f650d1b3640 1 Processor -- start 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.773+0000 7f650d1b3640 1 -- start start 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.773+0000 7f650d1b3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65080ffda0 0x7f650819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.773+0000 7f650d1b3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6508100750 0x7f650819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.773+0000 7f650d1b3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650819c360 con 0x7f6508100750 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.773+0000 7f650d1b3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65081958f0 con 0x7f65080ffda0 2024-09-13T18:27:06.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.773+0000 7f650659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6508100750 0x7f650819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.773+0000 7f650659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6508100750 0x7f650819bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54258/0 (socket says 172.21.15.38:54258) 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.773+0000 7f650659c640 1 -- 172.21.15.38:0/3724625720 learned_addr learned my addr 172.21.15.38:0/3724625720 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.773+0000 7f6506d9d640 1 --2- 172.21.15.38:0/3724625720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65080ffda0 0x7f650819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.773+0000 7f650659c640 1 -- 172.21.15.38:0/3724625720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65080ffda0 msgr2=0x7f650819b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.774+0000 7f650659c640 1 --2- 172.21.15.38:0/3724625720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65080ffda0 0x7f650819b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.774+0000 7f650659c640 1 -- 172.21.15.38:0/3724625720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f8009560 con 0x7f6508100750 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.774+0000 7f650659c640 1 --2- 172.21.15.38:0/3724625720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6508100750 0x7f650819bd40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00d6f0 tx=0x7f64fc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.774+0000 7f64effff640 1 -- 172.21.15.38:0/3724625720 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64fc009a30 con 0x7f6508100750 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.774+0000 7f64effff640 1 -- 172.21.15.38:0/3724625720 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f64fc0054c0 con 0x7f6508100750 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.774+0000 7f650d1b3640 1 -- 172.21.15.38:0/3724625720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6508195bd0 con 0x7f6508100750 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.774+0000 7f64effff640 1 -- 172.21.15.38:0/3724625720 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64fc004db0 con 0x7f6508100750 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.774+0000 7f650d1b3640 1 -- 172.21.15.38:0/3724625720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6508196120 con 0x7f6508100750 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.775+0000 7f650d1b3640 1 -- 172.21.15.38:0/3724625720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6508101280 con 0x7f6508100750 2024-09-13T18:27:06.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.775+0000 7f64effff640 1 -- 172.21.15.38:0/3724625720 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f64fc010460 con 0x7f6508100750 2024-09-13T18:27:06.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.776+0000 7f64effff640 1 --2- 172.21.15.38:0/3724625720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f64f006cbf0 0x7f64f006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:06.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.776+0000 7f6506d9d640 1 --2- 172.21.15.38:0/3724625720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f64f006cbf0 0x7f64f006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:06.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.776+0000 7f64effff640 1 -- 172.21.15.38:0/3724625720 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f64fc08ba30 con 0x7f6508100750 2024-09-13T18:27:06.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.777+0000 7f6506d9d640 1 --2- 172.21.15.38:0/3724625720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f64f006cbf0 0x7f64f006f0b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64f8005ab0 tx=0x7f64f8005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:06.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.780+0000 7f64effff640 1 -- 172.21.15.38:0/3724625720 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f64fc056140 con 0x7f6508100750 2024-09-13T18:27:06.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.954+0000 7f650d1b3640 1 -- 172.21.15.38:0/3724625720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f65081080b0 con 0x7f6508100750 2024-09-13T18:27:06.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.954+0000 7f64effff640 1 -- 172.21.15.38:0/3724625720 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64fc059760 con 0x7f6508100750 2024-09-13T18:27:06.957 INFO:teuthology.orchestra.run.smithi038.stdout:171798691851 2024-09-13T18:27:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.956+0000 7f650d1b3640 1 -- 172.21.15.38:0/3724625720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f64f006cbf0 msgr2=0x7f64f006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.956+0000 7f650d1b3640 1 --2- 172.21.15.38:0/3724625720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f64f006cbf0 0x7f64f006f0b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64f8005ab0 tx=0x7f64f8005a20 comp rx=0 tx=0).stop 2024-09-13T18:27:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.956+0000 7f650d1b3640 1 -- 172.21.15.38:0/3724625720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6508100750 msgr2=0x7f650819bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.956+0000 7f650d1b3640 1 --2- 172.21.15.38:0/3724625720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6508100750 0x7f650819bd40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00d6f0 tx=0x7f64fc00dbb0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.956+0000 7f650d1b3640 1 -- 172.21.15.38:0/3724625720 shutdown_connections 2024-09-13T18:27:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.956+0000 7f650d1b3640 1 --2- 172.21.15.38:0/3724625720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f64f006cbf0 0x7f64f006f0b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.956+0000 7f650d1b3640 1 --2- 172.21.15.38:0/3724625720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6508100750 0x7f650819bd40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.956+0000 7f650d1b3640 1 --2- 172.21.15.38:0/3724625720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65080ffda0 0x7f650819b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.957+0000 7f650d1b3640 1 -- 172.21.15.38:0/3724625720 >> 172.21.15.38:0/3724625720 conn(0x7f65080fb840 msgr2=0x7f65080fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.957+0000 7f650d1b3640 1 -- 172.21.15.38:0/3724625720 shutdown_connections 2024-09-13T18:27:06.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:06.957+0000 7f650d1b3640 1 -- 172.21.15.38:0/3724625720 wait complete. 2024-09-13T18:27:07.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:07 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1454068115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T18:27:07.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:07 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3724625720' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T18:27:07.655 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:07 smithi038 ceph-mon[27689]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:07.681 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542172 got 60129542175 for osd.1 2024-09-13T18:27:07.682 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:07.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:07 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1454068115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T18:27:07.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:07 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/3724625720' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T18:27:07.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:07 smithi149 ceph-mon[35845]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:08.925 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691850 got 171798691851 for osd.5 2024-09-13T18:27:08.925 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:09.470 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705702 for osd.0 2024-09-13T18:27:09.470 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.713+0000 7f6047427640 1 -- 172.21.15.38:0/1516393359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6040104a30 msgr2=0x7f6040104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.713+0000 7f6047427640 1 --2- 172.21.15.38:0/1516393359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6040104a30 0x7f6040104e10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f603c009880 tx=0x7f603c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.713+0000 7f6047427640 1 -- 172.21.15.38:0/1516393359 shutdown_connections 2024-09-13T18:27:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.713+0000 7f6047427640 1 --2- 172.21.15.38:0/1516393359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60400fea30 0x7f60400fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.713+0000 7f6047427640 1 --2- 172.21.15.38:0/1516393359 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6040104a30 0x7f6040104e10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.713+0000 7f6047427640 1 -- 172.21.15.38:0/1516393359 >> 172.21.15.38:0/1516393359 conn(0x7f60400fa730 msgr2=0x7f60400fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:09.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.714+0000 7f6047427640 1 -- 172.21.15.38:0/1516393359 shutdown_connections 2024-09-13T18:27:09.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.714+0000 7f6047427640 1 -- 172.21.15.38:0/1516393359 wait complete. 2024-09-13T18:27:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.714+0000 7f6047427640 1 Processor -- start 2024-09-13T18:27:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.714+0000 7f6047427640 1 -- start start 2024-09-13T18:27:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.715+0000 7f6047427640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60400fea30 0x7f6040195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.715+0000 7f6047427640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6040104a30 0x7f6040195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.715+0000 7f6047427640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6040196660 con 0x7f6040104a30 2024-09-13T18:27:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.715+0000 7f6047427640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604019a360 con 0x7f60400fea30 2024-09-13T18:27:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.715+0000 7f60449c2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6040104a30 0x7f6040195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.715+0000 7f60449c2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6040104a30 0x7f6040195f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54284/0 (socket says 172.21.15.38:54284) 2024-09-13T18:27:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.715+0000 7f60449c2640 1 -- 172.21.15.38:0/49669541 learned_addr learned my addr 172.21.15.38:0/49669541 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.715+0000 7f60451c3640 1 --2- 172.21.15.38:0/49669541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60400fea30 0x7f6040195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.715+0000 7f60449c2640 1 -- 172.21.15.38:0/49669541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60400fea30 msgr2=0x7f6040195a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.715+0000 7f60449c2640 1 --2- 172.21.15.38:0/49669541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60400fea30 0x7f6040195a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.715+0000 7f60449c2640 1 -- 172.21.15.38:0/49669541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c009560 con 0x7f6040104a30 2024-09-13T18:27:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.716+0000 7f60449c2640 1 --2- 172.21.15.38:0/49669541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6040104a30 0x7f6040195f80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f603000d6f0 tx=0x7f603000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.716+0000 7f60367fc640 1 -- 172.21.15.38:0/49669541 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6030009a30 con 0x7f6040104a30 2024-09-13T18:27:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.716+0000 7f6047427640 1 -- 172.21.15.38:0/49669541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604019a640 con 0x7f6040104a30 2024-09-13T18:27:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.716+0000 7f60367fc640 1 -- 172.21.15.38:0/49669541 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f60300054c0 con 0x7f6040104a30 2024-09-13T18:27:09.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.716+0000 7f60367fc640 1 -- 172.21.15.38:0/49669541 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6030004db0 con 0x7f6040104a30 2024-09-13T18:27:09.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.716+0000 7f6047427640 1 -- 172.21.15.38:0/49669541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604019ab90 con 0x7f6040104a30 2024-09-13T18:27:09.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.717+0000 7f6047427640 1 -- 172.21.15.38:0/49669541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6040103090 con 0x7f6040104a30 2024-09-13T18:27:09.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.718+0000 7f60367fc640 1 -- 172.21.15.38:0/49669541 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6030005000 con 0x7f6040104a30 2024-09-13T18:27:09.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.718+0000 7f60367fc640 1 --2- 172.21.15.38:0/49669541 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f602c06cbf0 0x7f602c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:09.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.718+0000 7f60367fc640 1 -- 172.21.15.38:0/49669541 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f603008b6b0 con 0x7f6040104a30 2024-09-13T18:27:09.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.718+0000 7f60451c3640 1 --2- 172.21.15.38:0/49669541 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f602c06cbf0 0x7f602c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:09.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.719+0000 7f60451c3640 1 --2- 172.21.15.38:0/49669541 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f602c06cbf0 0x7f602c06f0b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f603c005ab0 tx=0x7f603c005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:09.724 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:09.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.723+0000 7f60367fc640 1 -- 172.21.15.38:0/49669541 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6030055e40 con 0x7f6040104a30 2024-09-13T18:27:09.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.899+0000 7f6047427640 1 -- 172.21.15.38:0/49669541 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6040100170 con 0x7f6040104a30 2024-09-13T18:27:09.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.899+0000 7f60367fc640 1 -- 172.21.15.38:0/49669541 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6030017090 con 0x7f6040104a30 2024-09-13T18:27:09.902 INFO:teuthology.orchestra.run.smithi038.stdout:150323855375 2024-09-13T18:27:09.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.901+0000 7f6047427640 1 -- 172.21.15.38:0/49669541 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f602c06cbf0 msgr2=0x7f602c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:09.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.901+0000 7f6047427640 1 --2- 172.21.15.38:0/49669541 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f602c06cbf0 0x7f602c06f0b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f603c005ab0 tx=0x7f603c005a20 comp rx=0 tx=0).stop 2024-09-13T18:27:09.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.901+0000 7f6047427640 1 -- 172.21.15.38:0/49669541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6040104a30 msgr2=0x7f6040195f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:09.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.901+0000 7f6047427640 1 --2- 172.21.15.38:0/49669541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6040104a30 0x7f6040195f80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f603000d6f0 tx=0x7f603000dbb0 comp rx=0 tx=0).stop 2024-09-13T18:27:09.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.901+0000 7f6047427640 1 -- 172.21.15.38:0/49669541 shutdown_connections 2024-09-13T18:27:09.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.901+0000 7f6047427640 1 --2- 172.21.15.38:0/49669541 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f602c06cbf0 0x7f602c06f0b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:09.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.901+0000 7f6047427640 1 --2- 172.21.15.38:0/49669541 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6040104a30 0x7f6040195f80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:09.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.901+0000 7f6047427640 1 --2- 172.21.15.38:0/49669541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60400fea30 0x7f6040195a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:09.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.901+0000 7f6047427640 1 -- 172.21.15.38:0/49669541 >> 172.21.15.38:0/49669541 conn(0x7f60400fa730 msgr2=0x7f6040068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:09.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.901+0000 7f6047427640 1 -- 172.21.15.38:0/49669541 shutdown_connections 2024-09-13T18:27:09.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:09.901+0000 7f6047427640 1 -- 172.21.15.38:0/49669541 wait complete. 2024-09-13T18:27:10.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:10 smithi038 ceph-mon[27689]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:10.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:10 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/49669541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T18:27:10.531 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:10 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:27:10.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:10 smithi149 ceph-mon[35845]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:10.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:10 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/49669541' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T18:27:10.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:10 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:27:12.216 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855372 got 150323855375 for osd.4 2024-09-13T18:27:12.216 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:12.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:12 smithi038 ceph-mon[27689]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:12.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:12 smithi149 ceph-mon[35845]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:13.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.232+0000 7f09daae0640 1 -- 172.21.15.38:0/3095411718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09d40feaa0 msgr2=0x7f09d40fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.232+0000 7f09daae0640 1 --2- 172.21.15.38:0/3095411718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09d40feaa0 0x7f09d40fee80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009880 tx=0x7f09c402a530 comp rx=0 tx=0).stop 2024-09-13T18:27:13.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.232+0000 7f09daae0640 1 -- 172.21.15.38:0/3095411718 shutdown_connections 2024-09-13T18:27:13.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.232+0000 7f09daae0640 1 --2- 172.21.15.38:0/3095411718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09d40ff3c0 0x7f09d4103890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.232+0000 7f09daae0640 1 --2- 172.21.15.38:0/3095411718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09d40feaa0 0x7f09d40fee80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.232+0000 7f09daae0640 1 -- 172.21.15.38:0/3095411718 >> 172.21.15.38:0/3095411718 conn(0x7f09d40758a0 msgr2=0x7f09d40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.233+0000 7f09daae0640 1 -- 172.21.15.38:0/3095411718 shutdown_connections 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.233+0000 7f09daae0640 1 -- 172.21.15.38:0/3095411718 wait complete. 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.233+0000 7f09daae0640 1 Processor -- start 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.233+0000 7f09daae0640 1 -- start start 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.233+0000 7f09daae0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09d40feaa0 0x7f09d419c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.233+0000 7f09daae0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09d40ff3c0 0x7f09d419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.233+0000 7f09daae0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d419cd40 con 0x7f09d40feaa0 2024-09-13T18:27:13.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.233+0000 7f09daae0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d41a0ab0 con 0x7f09d40ff3c0 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.234+0000 7f09d887c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09d40feaa0 0x7f09d419c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.234+0000 7f09d887c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09d40feaa0 0x7f09d419c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60772/0 (socket says 172.21.15.38:60772) 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.234+0000 7f09d887c640 1 -- 172.21.15.38:0/4283071720 learned_addr learned my addr 172.21.15.38:0/4283071720 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.234+0000 7f09d3fff640 1 --2- 172.21.15.38:0/4283071720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09d40ff3c0 0x7f09d419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.234+0000 7f09d887c640 1 -- 172.21.15.38:0/4283071720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09d40ff3c0 msgr2=0x7f09d419c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.234+0000 7f09d887c640 1 --2- 172.21.15.38:0/4283071720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09d40ff3c0 0x7f09d419c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.234+0000 7f09d887c640 1 -- 172.21.15.38:0/4283071720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4009560 con 0x7f09d40feaa0 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.234+0000 7f09d887c640 1 --2- 172.21.15.38:0/4283071720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09d40feaa0 0x7f09d419c170 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f09c4006010 tx=0x7f09c40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.234+0000 7f09d1ffb640 1 -- 172.21.15.38:0/4283071720 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09c4004ba0 con 0x7f09d40feaa0 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.234+0000 7f09d1ffb640 1 -- 172.21.15.38:0/4283071720 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f09c4004d00 con 0x7f09d40feaa0 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.234+0000 7f09daae0640 1 -- 172.21.15.38:0/4283071720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d41a0d30 con 0x7f09d40feaa0 2024-09-13T18:27:13.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.234+0000 7f09d1ffb640 1 -- 172.21.15.38:0/4283071720 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09c4031910 con 0x7f09d40feaa0 2024-09-13T18:27:13.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.235+0000 7f09daae0640 1 -- 172.21.15.38:0/4283071720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d41a1220 con 0x7f09d40feaa0 2024-09-13T18:27:13.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.236+0000 7f09daae0640 1 -- 172.21.15.38:0/4283071720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d4068510 con 0x7f09d40feaa0 2024-09-13T18:27:13.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.236+0000 7f09d1ffb640 1 -- 172.21.15.38:0/4283071720 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f09c402ad50 con 0x7f09d40feaa0 2024-09-13T18:27:13.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.237+0000 7f09d1ffb640 1 --2- 172.21.15.38:0/4283071720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f09c006cc50 0x7f09c006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:13.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.237+0000 7f09d1ffb640 1 -- 172.21.15.38:0/4283071720 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f09c40accc0 con 0x7f09d40feaa0 2024-09-13T18:27:13.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.237+0000 7f09d3fff640 1 --2- 172.21.15.38:0/4283071720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f09c006cc50 0x7f09c006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:13.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.237+0000 7f09d3fff640 1 --2- 172.21.15.38:0/4283071720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f09c006cc50 0x7f09c006f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09d419d720 tx=0x7f09bc009060 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:13.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.241+0000 7f09d1ffb640 1 -- 172.21.15.38:0/4283071720 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f09c4077500 con 0x7f09d40feaa0 2024-09-13T18:27:13.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.414+0000 7f09daae0640 1 -- 172.21.15.38:0/4283071720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09d40fef00 con 0x7f09d40feaa0 2024-09-13T18:27:13.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.415+0000 7f09d1ffb640 1 -- 172.21.15.38:0/4283071720 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09c404a020 con 0x7f09d40feaa0 2024-09-13T18:27:13.417 INFO:teuthology.orchestra.run.smithi038.stdout:81604378652 2024-09-13T18:27:13.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.417+0000 7f09daae0640 1 -- 172.21.15.38:0/4283071720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f09c006cc50 msgr2=0x7f09c006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.417+0000 7f09daae0640 1 --2- 172.21.15.38:0/4283071720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f09c006cc50 0x7f09c006f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09d419d720 tx=0x7f09bc009060 comp rx=0 tx=0).stop 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.417+0000 7f09daae0640 1 -- 172.21.15.38:0/4283071720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09d40feaa0 msgr2=0x7f09d419c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.417+0000 7f09daae0640 1 --2- 172.21.15.38:0/4283071720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09d40feaa0 0x7f09d419c170 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f09c4006010 tx=0x7f09c40056e0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.417+0000 7f09daae0640 1 -- 172.21.15.38:0/4283071720 shutdown_connections 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.417+0000 7f09daae0640 1 --2- 172.21.15.38:0/4283071720 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f09c006cc50 0x7f09c006f110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.417+0000 7f09daae0640 1 --2- 172.21.15.38:0/4283071720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09d40ff3c0 0x7f09d419c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.417+0000 7f09daae0640 1 --2- 172.21.15.38:0/4283071720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09d40feaa0 0x7f09d419c170 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.417+0000 7f09daae0640 1 -- 172.21.15.38:0/4283071720 >> 172.21.15.38:0/4283071720 conn(0x7f09d40758a0 msgr2=0x7f09d410d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.417+0000 7f09daae0640 1 -- 172.21.15.38:0/4283071720 shutdown_connections 2024-09-13T18:27:13.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:13.417+0000 7f09daae0640 1 -- 172.21.15.38:0/4283071720 wait complete. 2024-09-13T18:27:14.122 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378652 for osd.2 2024-09-13T18:27:14.122 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:14.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.342+0000 7f83bffdb640 1 -- 172.21.15.38:0/1997246394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83b80ffda0 msgr2=0x7f83b8100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.342+0000 7f83bffdb640 1 --2- 172.21.15.38:0/1997246394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83b80ffda0 0x7f83b8100180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009880 tx=0x7f83b402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.343+0000 7f83bffdb640 1 -- 172.21.15.38:0/1997246394 shutdown_connections 2024-09-13T18:27:14.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.343+0000 7f83bffdb640 1 --2- 172.21.15.38:0/1997246394 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83b8100750 0x7f83b81047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.343+0000 7f83bffdb640 1 --2- 172.21.15.38:0/1997246394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83b80ffda0 0x7f83b8100180 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.343+0000 7f83bffdb640 1 -- 172.21.15.38:0/1997246394 >> 172.21.15.38:0/1997246394 conn(0x7f83b80fb840 msgr2=0x7f83b80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.343+0000 7f83bffdb640 1 -- 172.21.15.38:0/1997246394 shutdown_connections 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.343+0000 7f83bffdb640 1 -- 172.21.15.38:0/1997246394 wait complete. 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.343+0000 7f83bffdb640 1 Processor -- start 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.343+0000 7f83bffdb640 1 -- start start 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bffdb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83b80ffda0 0x7f83b819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bffdb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83b8100750 0x7f83b819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bffdb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b819c360 con 0x7f83b8100750 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bffdb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b81958f0 con 0x7f83b80ffda0 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bd576640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83b8100750 0x7f83b819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bd576640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83b8100750 0x7f83b819bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60786/0 (socket says 172.21.15.38:60786) 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bd576640 1 -- 172.21.15.38:0/3714244205 learned_addr learned my addr 172.21.15.38:0/3714244205 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bdd77640 1 --2- 172.21.15.38:0/3714244205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83b80ffda0 0x7f83b819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bd576640 1 -- 172.21.15.38:0/3714244205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83b80ffda0 msgr2=0x7f83b819b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bd576640 1 --2- 172.21.15.38:0/3714244205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83b80ffda0 0x7f83b819b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bd576640 1 -- 172.21.15.38:0/3714244205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4009560 con 0x7f83b8100750 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bd576640 1 --2- 172.21.15.38:0/3714244205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83b8100750 0x7f83b819bd40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f83a800d6f0 tx=0x7f83a800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83aeffd640 1 -- 172.21.15.38:0/3714244205 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a8009a30 con 0x7f83b8100750 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83aeffd640 1 -- 172.21.15.38:0/3714244205 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f83a80054c0 con 0x7f83b8100750 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83bffdb640 1 -- 172.21.15.38:0/3714244205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b8195bd0 con 0x7f83b8100750 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.344+0000 7f83aeffd640 1 -- 172.21.15.38:0/3714244205 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a8004db0 con 0x7f83b8100750 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.345+0000 7f83bffdb640 1 -- 172.21.15.38:0/3714244205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b8196120 con 0x7f83b8100750 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.346+0000 7f83bffdb640 1 -- 172.21.15.38:0/3714244205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b8101280 con 0x7f83b8100750 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.346+0000 7f83aeffd640 1 -- 172.21.15.38:0/3714244205 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f83a8004f10 con 0x7f83b8100750 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.347+0000 7f83aeffd640 1 --2- 172.21.15.38:0/3714244205 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f83a406cc50 0x7f83a406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.347+0000 7f83aeffd640 1 -- 172.21.15.38:0/3714244205 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f83a808b900 con 0x7f83b8100750 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.347+0000 7f83bdd77640 1 --2- 172.21.15.38:0/3714244205 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f83a406cc50 0x7f83a406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.347+0000 7f83bdd77640 1 --2- 172.21.15.38:0/3714244205 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f83a406cc50 0x7f83a406f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f83b4000c00 tx=0x7f83b40058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.351+0000 7f83aeffd640 1 -- 172.21.15.38:0/3714244205 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f83a80560e0 con 0x7f83b8100750 2024-09-13T18:27:14.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.523+0000 7f83bffdb640 1 -- 172.21.15.38:0/3714244205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f83b81080b0 con 0x7f83b8100750 2024-09-13T18:27:14.526 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:14 smithi038 ceph-mon[27689]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:14.526 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:14 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/4283071720' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T18:27:14.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.524+0000 7f83aeffd640 1 -- 172.21.15.38:0/3714244205 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83a8017090 con 0x7f83b8100750 2024-09-13T18:27:14.527 INFO:teuthology.orchestra.run.smithi038.stdout:115964117014 2024-09-13T18:27:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.526+0000 7f83bffdb640 1 -- 172.21.15.38:0/3714244205 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f83a406cc50 msgr2=0x7f83a406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.526+0000 7f83bffdb640 1 --2- 172.21.15.38:0/3714244205 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f83a406cc50 0x7f83a406f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f83b4000c00 tx=0x7f83b40058d0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.526+0000 7f83bffdb640 1 -- 172.21.15.38:0/3714244205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83b8100750 msgr2=0x7f83b819bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.526+0000 7f83bffdb640 1 --2- 172.21.15.38:0/3714244205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83b8100750 0x7f83b819bd40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f83a800d6f0 tx=0x7f83a800dbb0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.526+0000 7f83bffdb640 1 -- 172.21.15.38:0/3714244205 shutdown_connections 2024-09-13T18:27:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.526+0000 7f83bffdb640 1 --2- 172.21.15.38:0/3714244205 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f83a406cc50 0x7f83a406f110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.526+0000 7f83bffdb640 1 --2- 172.21.15.38:0/3714244205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83b8100750 0x7f83b819bd40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.526+0000 7f83bffdb640 1 --2- 172.21.15.38:0/3714244205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83b80ffda0 0x7f83b819b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.526+0000 7f83bffdb640 1 -- 172.21.15.38:0/3714244205 >> 172.21.15.38:0/3714244205 conn(0x7f83b80fb840 msgr2=0x7f83b80fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.526+0000 7f83bffdb640 1 -- 172.21.15.38:0/3714244205 shutdown_connections 2024-09-13T18:27:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:14.526+0000 7f83bffdb640 1 -- 172.21.15.38:0/3714244205 wait complete. 2024-09-13T18:27:14.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:14 smithi149 ceph-mon[35845]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:14.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:14 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/4283071720' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T18:27:15.217 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117014 for osd.3 2024-09-13T18:27:15.217 DEBUG:teuthology.parallel:result is None 2024-09-13T18:27:15.217 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T18:27:15.217 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T18:27:15.425 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:15.547 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:15 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3714244205' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T18:27:15.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:15 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/3714244205' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T18:27:16.573 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:16 smithi038 ceph-mon[27689]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:16.736 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:16 smithi149 ceph-mon[35845]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:17.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.122+0000 7feca3809640 1 -- 172.21.15.38:0/2573814945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fec9c1049f0 msgr2=0x7fec9c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.122+0000 7feca3809640 1 --2- 172.21.15.38:0/2573814945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fec9c1049f0 0x7fec9c104dd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fec98009880 tx=0x7fec9802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.122+0000 7feca3809640 1 -- 172.21.15.38:0/2573814945 shutdown_connections 2024-09-13T18:27:17.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.122+0000 7feca3809640 1 --2- 172.21.15.38:0/2573814945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c0fe9f0 0x7fec9c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.122+0000 7feca3809640 1 --2- 172.21.15.38:0/2573814945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fec9c1049f0 0x7fec9c104dd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.122+0000 7feca3809640 1 -- 172.21.15.38:0/2573814945 >> 172.21.15.38:0/2573814945 conn(0x7fec9c0758a0 msgr2=0x7fec9c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:17.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.122+0000 7feca3809640 1 -- 172.21.15.38:0/2573814945 shutdown_connections 2024-09-13T18:27:17.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.122+0000 7feca3809640 1 -- 172.21.15.38:0/2573814945 wait complete. 2024-09-13T18:27:17.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.122+0000 7feca3809640 1 Processor -- start 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca3809640 1 -- start start 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca3809640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fec9c0fe9f0 0x7fec9c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca3809640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c1049f0 0x7fec9c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca3809640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c19b230 con 0x7fec9c0fe9f0 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca3809640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c194700 con 0x7fec9c1049f0 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca15a5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fec9c0fe9f0 0x7fec9c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca15a5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fec9c0fe9f0 0x7fec9c19a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60804/0 (socket says 172.21.15.38:60804) 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca15a5640 1 -- 172.21.15.38:0/2691838102 learned_addr learned my addr 172.21.15.38:0/2691838102 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca0da4640 1 --2- 172.21.15.38:0/2691838102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c1049f0 0x7fec9c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca15a5640 1 -- 172.21.15.38:0/2691838102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c1049f0 msgr2=0x7fec9c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca15a5640 1 --2- 172.21.15.38:0/2691838102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c1049f0 0x7fec9c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca15a5640 1 -- 172.21.15.38:0/2691838102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec98009560 con 0x7fec9c0fe9f0 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca0da4640 1 --2- 172.21.15.38:0/2691838102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c1049f0 0x7fec9c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:17.127 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.123+0000 7feca15a5640 1 --2- 172.21.15.38:0/2691838102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fec9c0fe9f0 0x7fec9c19a6a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fec98006010 tx=0x7fec980056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:17.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.124+0000 7fec927fc640 1 -- 172.21.15.38:0/2691838102 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec9803e070 con 0x7fec9c0fe9f0 2024-09-13T18:27:17.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.124+0000 7fec927fc640 1 -- 172.21.15.38:0/2691838102 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fec980035f0 con 0x7fec9c0fe9f0 2024-09-13T18:27:17.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.124+0000 7feca3809640 1 -- 172.21.15.38:0/2691838102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c194980 con 0x7fec9c0fe9f0 2024-09-13T18:27:17.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.124+0000 7fec927fc640 1 -- 172.21.15.38:0/2691838102 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec98031790 con 0x7fec9c0fe9f0 2024-09-13T18:27:17.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.124+0000 7feca3809640 1 -- 172.21.15.38:0/2691838102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9c194e70 con 0x7fec9c0fe9f0 2024-09-13T18:27:17.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.125+0000 7feca3809640 1 -- 172.21.15.38:0/2691838102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9c100130 con 0x7fec9c0fe9f0 2024-09-13T18:27:17.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.125+0000 7fec927fc640 1 -- 172.21.15.38:0/2691838102 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fec98003760 con 0x7fec9c0fe9f0 2024-09-13T18:27:17.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.126+0000 7fec927fc640 1 --2- 172.21.15.38:0/2691838102 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fec8806cc50 0x7fec8806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:17.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.126+0000 7fec927fc640 1 -- 172.21.15.38:0/2691838102 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fec980ae340 con 0x7fec9c0fe9f0 2024-09-13T18:27:17.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.126+0000 7feca0da4640 1 --2- 172.21.15.38:0/2691838102 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fec8806cc50 0x7fec8806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:17.129 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.126+0000 7feca0da4640 1 --2- 172.21.15.38:0/2691838102 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fec8806cc50 0x7fec8806f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec9c195fc0 tx=0x7fec8c00a5c0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:17.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.130+0000 7fec927fc640 1 -- 172.21.15.38:0/2691838102 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fec98078ad0 con 0x7fec9c0fe9f0 2024-09-13T18:27:17.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.300+0000 7feca3809640 1 -- 172.21.15.38:0/2691838102 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec9c10bb90 con 0x7fec8806cc50 2024-09-13T18:27:17.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.301+0000 7fec927fc640 1 -- 172.21.15.38:0/2691838102 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28178 (secure 0 0 0) 0x7fec9c10bb90 con 0x7fec8806cc50 2024-09-13T18:27:17.304 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:27:17.304 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-13T18:27:17.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.303+0000 7feca3809640 1 -- 172.21.15.38:0/2691838102 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fec8806cc50 msgr2=0x7fec8806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.303+0000 7feca3809640 1 --2- 172.21.15.38:0/2691838102 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fec8806cc50 0x7fec8806f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec9c195fc0 tx=0x7fec8c00a5c0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.303+0000 7feca3809640 1 -- 172.21.15.38:0/2691838102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fec9c0fe9f0 msgr2=0x7fec9c19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:17.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.303+0000 7feca3809640 1 --2- 172.21.15.38:0/2691838102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fec9c0fe9f0 0x7fec9c19a6a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fec98006010 tx=0x7fec980056e0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.304+0000 7feca3809640 1 -- 172.21.15.38:0/2691838102 shutdown_connections 2024-09-13T18:27:17.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.304+0000 7feca3809640 1 --2- 172.21.15.38:0/2691838102 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fec8806cc50 0x7fec8806f110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.304+0000 7feca3809640 1 --2- 172.21.15.38:0/2691838102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec9c1049f0 0x7fec9c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.304+0000 7feca3809640 1 --2- 172.21.15.38:0/2691838102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fec9c0fe9f0 0x7fec9c19a6a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:17.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.304+0000 7feca3809640 1 -- 172.21.15.38:0/2691838102 >> 172.21.15.38:0/2691838102 conn(0x7fec9c0758a0 msgr2=0x7fec9c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:17.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.304+0000 7feca3809640 1 -- 172.21.15.38:0/2691838102 shutdown_connections 2024-09-13T18:27:17.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:17.304+0000 7feca3809640 1 -- 172.21.15.38:0/2691838102 wait complete. 2024-09-13T18:27:17.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:17 smithi038 ceph-mon[27689]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:17.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:17 smithi149 ceph-mon[35845]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:18.014 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-13T18:27:17.217559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":178360,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":174326,"kb_avail":562292552,"statfs":{"total":575970213888,"available":575787573248,"internally_reserved":0,"allocated":4018176,"data_stored":2627442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":178510503},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002019"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":186,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T18:26:24.609762+0000","last_change":"2024-09-13T18:25:59.474357+0000","last_active":"2024-09-13T18:26:24.609762+0000","last_peered":"2024-09-13T18:26:24.609762+0000","last_clean":"2024-09-13T18:26:24.609762+0000","last_became_active":"2024-09-13T18:25:59.473939+0000","last_became_peered":"2024-09-13T18:25:59.473939+0000","last_unstale":"2024-09-13T18:26:24.609762+0000","last_undegraded":"2024-09-13T18:26:24.609762+0000","last_fullsized":"2024-09-13T18:26:24.609762+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:14.019699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:14.019699+0000","last_clean_scrub_stamp":"2024-09-13T18:25:14.019699+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:56.584949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31488,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713664,"statfs":{"total":95995035648,"available":95962791936,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:01 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:27:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:27:01 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:01 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.623}]},{"osd":4,"last update":"Fri Sep 13 18:26:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717764,"statfs":{"total":95995035648,"available":95966990336,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:26:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:26:15 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.443},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:26:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.626},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:27:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.52800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.27500000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.246},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.26100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.29099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:26:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"last":0.26900000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:26:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.623}]},{"osd":4,"last update":"Fri Sep 13 18:27:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.21199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.224,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.372}]},{"osd":2,"last update":"Fri Sep 13 18:26:16 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67500000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:27:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:27:18.015 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T18:27:18.236 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:18.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:18 smithi038 ceph-mon[27689]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:27:18.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:18 smithi149 ceph-mon[35845]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:27:19.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:19 smithi038 ceph-mon[27689]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:19.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:19 smithi149 ceph-mon[35845]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:20.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.978+0000 7f90f487d640 1 -- 172.21.15.38:0/1294123922 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90f0100c60 msgr2=0x7f90f0101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:20.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.978+0000 7f90f487d640 1 --2- 172.21.15.38:0/1294123922 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90f0100c60 0x7f90f0101040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f90e00098b0 tx=0x7f90e002a4d0 comp rx=0 tx=0).stop 2024-09-13T18:27:20.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.978+0000 7f90f487d640 1 -- 172.21.15.38:0/1294123922 shutdown_connections 2024-09-13T18:27:20.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.978+0000 7f90f487d640 1 --2- 172.21.15.38:0/1294123922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f0101610 0x7f90f0109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:20.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.978+0000 7f90f487d640 1 --2- 172.21.15.38:0/1294123922 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90f0100c60 0x7f90f0101040 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:20.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.978+0000 7f90f487d640 1 -- 172.21.15.38:0/1294123922 >> 172.21.15.38:0/1294123922 conn(0x7f90f00fa730 msgr2=0x7f90f00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:20.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.978+0000 7f90f487d640 1 -- 172.21.15.38:0/1294123922 shutdown_connections 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.978+0000 7f90f487d640 1 -- 172.21.15.38:0/1294123922 wait complete. 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.979+0000 7f90f487d640 1 Processor -- start 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.979+0000 7f90f487d640 1 -- start start 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.979+0000 7f90f487d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f0100c60 0x7f90f019b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.979+0000 7f90f487d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90f0101610 0x7f90f019bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.979+0000 7f90f487d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f019c2e0 con 0x7f90f0101610 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.979+0000 7f90f487d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f0195870 con 0x7f90f0100c60 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.979+0000 7f90edd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90f0101610 0x7f90f019bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.979+0000 7f90edd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90f0101610 0x7f90f019bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60824/0 (socket says 172.21.15.38:60824) 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.979+0000 7f90edd9b640 1 -- 172.21.15.38:0/1721064275 learned_addr learned my addr 172.21.15.38:0/1721064275 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.980+0000 7f90ee59c640 1 --2- 172.21.15.38:0/1721064275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f0100c60 0x7f90f019b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.980+0000 7f90edd9b640 1 -- 172.21.15.38:0/1721064275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f0100c60 msgr2=0x7f90f019b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:20.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.980+0000 7f90edd9b640 1 --2- 172.21.15.38:0/1721064275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f0100c60 0x7f90f019b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.980+0000 7f90edd9b640 1 -- 172.21.15.38:0/1721064275 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e0009560 con 0x7f90f0101610 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.980+0000 7f90ee59c640 1 --2- 172.21.15.38:0/1721064275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f0100c60 0x7f90f019b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.980+0000 7f90edd9b640 1 --2- 172.21.15.38:0/1721064275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90f0101610 0x7f90f019bcc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f90d800c810 tx=0x7f90d800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.980+0000 7f90e77fe640 1 -- 172.21.15.38:0/1721064275 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d80041f0 con 0x7f90f0101610 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.980+0000 7f90e77fe640 1 -- 172.21.15.38:0/1721064275 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f90d8007e50 con 0x7f90f0101610 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.980+0000 7f90f487d640 1 -- 172.21.15.38:0/1721064275 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f0195b50 con 0x7f90f0101610 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.980+0000 7f90e77fe640 1 -- 172.21.15.38:0/1721064275 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d80049d0 con 0x7f90f0101610 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.980+0000 7f90f487d640 1 -- 172.21.15.38:0/1721064275 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f01960a0 con 0x7f90f0101610 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.981+0000 7f90f487d640 1 -- 172.21.15.38:0/1721064275 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f0068d30 con 0x7f90f0101610 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.982+0000 7f90e77fe640 1 -- 172.21.15.38:0/1721064275 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f90d80079b0 con 0x7f90f0101610 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.982+0000 7f90e77fe640 1 --2- 172.21.15.38:0/1721064275 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f90dc06cc50 0x7f90dc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.982+0000 7f90e77fe640 1 -- 172.21.15.38:0/1721064275 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f90d808bca0 con 0x7f90f0101610 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.982+0000 7f90ee59c640 1 --2- 172.21.15.38:0/1721064275 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f90dc06cc50 0x7f90dc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:20.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.983+0000 7f90ee59c640 1 --2- 172.21.15.38:0/1721064275 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f90dc06cc50 0x7f90dc06f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f90e0006010 tx=0x7f90e0005d50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:20.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:19.986+0000 7f90e77fe640 1 -- 172.21.15.38:0/1721064275 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f90d8090070 con 0x7f90f0101610 2024-09-13T18:27:20.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.153+0000 7f90f487d640 1 -- 172.21.15.38:0/1721064275 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90f0104460 con 0x7f90dc06cc50 2024-09-13T18:27:20.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.154+0000 7f90e77fe640 1 -- 172.21.15.38:0/1721064275 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28080 (secure 0 0 0) 0x7f90f0104460 con 0x7f90dc06cc50 2024-09-13T18:27:20.157 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:27:20.158 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-09-13T18:27:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.157+0000 7f90f487d640 1 -- 172.21.15.38:0/1721064275 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f90dc06cc50 msgr2=0x7f90dc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.157+0000 7f90f487d640 1 --2- 172.21.15.38:0/1721064275 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f90dc06cc50 0x7f90dc06f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f90e0006010 tx=0x7f90e0005d50 comp rx=0 tx=0).stop 2024-09-13T18:27:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.157+0000 7f90f487d640 1 -- 172.21.15.38:0/1721064275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90f0101610 msgr2=0x7f90f019bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:20.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.157+0000 7f90f487d640 1 --2- 172.21.15.38:0/1721064275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90f0101610 0x7f90f019bcc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f90d800c810 tx=0x7f90d800ccd0 comp rx=0 tx=0).stop 2024-09-13T18:27:20.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.157+0000 7f90f487d640 1 -- 172.21.15.38:0/1721064275 shutdown_connections 2024-09-13T18:27:20.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.157+0000 7f90f487d640 1 --2- 172.21.15.38:0/1721064275 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f90dc06cc50 0x7f90dc06f110 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:20.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.157+0000 7f90f487d640 1 --2- 172.21.15.38:0/1721064275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90f0101610 0x7f90f019bcc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:20.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.157+0000 7f90f487d640 1 --2- 172.21.15.38:0/1721064275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90f0100c60 0x7f90f019b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:20.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.157+0000 7f90f487d640 1 -- 172.21.15.38:0/1721064275 >> 172.21.15.38:0/1721064275 conn(0x7f90f00fa730 msgr2=0x7f90f0101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:20.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.157+0000 7f90f487d640 1 -- 172.21.15.38:0/1721064275 shutdown_connections 2024-09-13T18:27:20.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:20.157+0000 7f90f487d640 1 -- 172.21.15.38:0/1721064275 wait complete. 2024-09-13T18:27:20.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:20 smithi038 ceph-mon[27689]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:27:20.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:20 smithi149 ceph-mon[35845]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:27:20.863 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-13T18:27:19.217842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":178360,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":174326,"kb_avail":562292552,"statfs":{"total":575970213888,"available":575787573248,"internally_reserved":0,"allocated":4018176,"data_stored":2627442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":178510503},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001942"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":186,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-13T18:26:24.609762+0000","last_change":"2024-09-13T18:25:59.474357+0000","last_active":"2024-09-13T18:26:24.609762+0000","last_peered":"2024-09-13T18:26:24.609762+0000","last_clean":"2024-09-13T18:26:24.609762+0000","last_became_active":"2024-09-13T18:25:59.473939+0000","last_became_peered":"2024-09-13T18:25:59.473939+0000","last_unstale":"2024-09-13T18:26:24.609762+0000","last_undegraded":"2024-09-13T18:26:24.609762+0000","last_fullsized":"2024-09-13T18:26:24.609762+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:25:14.019699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:25:14.019699+0000","last_clean_scrub_stamp":"2024-09-13T18:25:14.019699+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:56.584949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31488,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713664,"statfs":{"total":95995035648,"available":95962791936,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:01 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:27:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.51600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:27:01 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:27:01 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.623}]},{"osd":4,"last update":"Fri Sep 13 18:26:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717764,"statfs":{"total":95995035648,"available":95966990336,"internally_reserved":0,"allocated":372736,"data_stored":142723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:27:16 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35199999999999998,"15min":0.35099999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.49299999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35599999999999998},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.505,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.36899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:27:16 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.374,"15min":0.373},"min":{"1min":0.28199999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.48799999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.37,"15min":0.37},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.502,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.41299999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:26:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:27:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.27500000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.246},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.26100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.29099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:26:15 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"last":0.26900000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:26:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.623}]},{"osd":4,"last update":"Fri Sep 13 18:27:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":966656,"data_stored":733091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.21199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.224,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.25700000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:27:17 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.34999999999999998,"15min":0.35599999999999998},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.46300000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.378,"15min":0.38600000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.496,"5min":0.621,"15min":0.621},"last":0.23100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:26:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.627},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:27:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:27:20.864 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T18:27:20.864 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:27:20.865 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:27:20.865 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T18:27:21.076 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:21.474 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:21 smithi038 ceph-mon[27689]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:21.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:21 smithi149 ceph-mon[35845]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.755+0000 7f5428eb2640 1 -- 172.21.15.38:0/2869816336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240fea30 msgr2=0x7f54240fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.755+0000 7f5428eb2640 1 --2- 172.21.15.38:0/2869816336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240fea30 0x7f54240fee90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f540c009880 tx=0x7f540c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.755+0000 7f5428eb2640 1 -- 172.21.15.38:0/2869816336 shutdown_connections 2024-09-13T18:27:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.755+0000 7f5428eb2640 1 --2- 172.21.15.38:0/2869816336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240fea30 0x7f54240fee90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.755+0000 7f5428eb2640 1 --2- 172.21.15.38:0/2869816336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5424104a30 0x7f5424104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.755+0000 7f5428eb2640 1 -- 172.21.15.38:0/2869816336 >> 172.21.15.38:0/2869816336 conn(0x7f54240fa730 msgr2=0x7f54240fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.755+0000 7f5428eb2640 1 -- 172.21.15.38:0/2869816336 shutdown_connections 2024-09-13T18:27:22.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.755+0000 7f5428eb2640 1 -- 172.21.15.38:0/2869816336 wait complete. 2024-09-13T18:27:22.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.756+0000 7f5428eb2640 1 Processor -- start 2024-09-13T18:27:22.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.756+0000 7f5428eb2640 1 -- start start 2024-09-13T18:27:22.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.756+0000 7f5428eb2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240fea30 0x7f5424196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:22.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.756+0000 7f5428eb2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5424104a30 0x7f5424196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:22.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.756+0000 7f5428eb2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5424197490 con 0x7f54240fea30 2024-09-13T18:27:22.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.756+0000 7f5428eb2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5424197600 con 0x7f5424104a30 2024-09-13T18:27:22.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.756+0000 7f542259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240fea30 0x7f5424196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:22.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.756+0000 7f542259c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240fea30 0x7f5424196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33070/0 (socket says 172.21.15.38:33070) 2024-09-13T18:27:22.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.756+0000 7f542259c640 1 -- 172.21.15.38:0/293315929 learned_addr learned my addr 172.21.15.38:0/293315929 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:22.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.756+0000 7f5421d9b640 1 --2- 172.21.15.38:0/293315929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5424104a30 0x7f5424196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:22.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.757+0000 7f542259c640 1 -- 172.21.15.38:0/293315929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5424104a30 msgr2=0x7f5424196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:22.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.757+0000 7f542259c640 1 --2- 172.21.15.38:0/293315929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5424104a30 0x7f5424196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.757+0000 7f542259c640 1 -- 172.21.15.38:0/293315929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c009560 con 0x7f54240fea30 2024-09-13T18:27:22.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.757+0000 7f542259c640 1 --2- 172.21.15.38:0/293315929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240fea30 0x7f5424196980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f541400b420 tx=0x7f541400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:22.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.757+0000 7f541b7fe640 1 -- 172.21.15.38:0/293315929 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5414011800 con 0x7f54240fea30 2024-09-13T18:27:22.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.757+0000 7f541b7fe640 1 -- 172.21.15.38:0/293315929 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5414011e00 con 0x7f54240fea30 2024-09-13T18:27:22.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.757+0000 7f5428eb2640 1 -- 172.21.15.38:0/293315929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542419f9f0 con 0x7f54240fea30 2024-09-13T18:27:22.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.757+0000 7f541b7fe640 1 -- 172.21.15.38:0/293315929 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f541400f2e0 con 0x7f54240fea30 2024-09-13T18:27:22.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.757+0000 7f5428eb2640 1 -- 172.21.15.38:0/293315929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542419fe60 con 0x7f54240fea30 2024-09-13T18:27:22.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.758+0000 7f5428eb2640 1 -- 172.21.15.38:0/293315929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5424100170 con 0x7f54240fea30 2024-09-13T18:27:22.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.759+0000 7f541b7fe640 1 -- 172.21.15.38:0/293315929 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f541400f550 con 0x7f54240fea30 2024-09-13T18:27:22.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.759+0000 7f541b7fe640 1 --2- 172.21.15.38:0/293315929 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f541006cc60 0x7f541006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:22.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.760+0000 7f5421d9b640 1 --2- 172.21.15.38:0/293315929 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f541006cc60 0x7f541006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:22.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.760+0000 7f541b7fe640 1 -- 172.21.15.38:0/293315929 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f541408b8e0 con 0x7f54240fea30 2024-09-13T18:27:22.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.760+0000 7f5421d9b640 1 --2- 172.21.15.38:0/293315929 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f541006cc60 0x7f541006f120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5424068c90 tx=0x7f540c005df0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:22.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.764+0000 7f541b7fe640 1 -- 172.21.15.38:0/293315929 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5414055ff0 con 0x7f54240fea30 2024-09-13T18:27:22.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.971+0000 7f5428eb2640 1 -- 172.21.15.38:0/293315929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f54240fef10 con 0x7f54240fea30 2024-09-13T18:27:22.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.971+0000 7f541b7fe640 1 -- 172.21.15.38:0/293315929 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5414059610 con 0x7f54240fea30 2024-09-13T18:27:22.974 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:27:22.974 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:27:22.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.973+0000 7f5428eb2640 1 -- 172.21.15.38:0/293315929 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f541006cc60 msgr2=0x7f541006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:22.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.973+0000 7f5428eb2640 1 --2- 172.21.15.38:0/293315929 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f541006cc60 0x7f541006f120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5424068c90 tx=0x7f540c005df0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.973+0000 7f5428eb2640 1 -- 172.21.15.38:0/293315929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240fea30 msgr2=0x7f5424196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:22.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.973+0000 7f5428eb2640 1 --2- 172.21.15.38:0/293315929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240fea30 0x7f5424196980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f541400b420 tx=0x7f541400b8e0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.973+0000 7f5428eb2640 1 -- 172.21.15.38:0/293315929 shutdown_connections 2024-09-13T18:27:22.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.973+0000 7f5428eb2640 1 --2- 172.21.15.38:0/293315929 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f541006cc60 0x7f541006f120 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.973+0000 7f5428eb2640 1 --2- 172.21.15.38:0/293315929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5424104a30 0x7f5424196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.973+0000 7f5428eb2640 1 --2- 172.21.15.38:0/293315929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54240fea30 0x7f5424196980 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:22.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.973+0000 7f5428eb2640 1 -- 172.21.15.38:0/293315929 >> 172.21.15.38:0/293315929 conn(0x7f54240fa730 msgr2=0x7f54240fb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:22.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.973+0000 7f5428eb2640 1 -- 172.21.15.38:0/293315929 shutdown_connections 2024-09-13T18:27:22.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:22.973+0000 7f5428eb2640 1 -- 172.21.15.38:0/293315929 wait complete. 2024-09-13T18:27:23.318 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:23 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/293315929' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T18:27:23.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:23 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/293315929' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T18:27:23.647 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:27:23.647 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T18:27:23.647 INFO:teuthology.run_tasks:Running task print... 2024-09-13T18:27:23.657 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-09-13T18:27:23.657 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T18:27:23.726 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:27:23.727 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-13T18:27:23.945 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:24.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:24 smithi038 ceph-mon[27689]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:24.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:24 smithi149 ceph-mon[35845]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:25.328 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:25 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:27:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.556+0000 7f3ce184a640 1 -- 172.21.15.38:0/49024926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cdc100d90 msgr2=0x7f3cdc101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.556+0000 7f3ce184a640 1 --2- 172.21.15.38:0/49024926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cdc100d90 0x7f3cdc101210 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009880 tx=0x7f3cc402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.556+0000 7f3ce184a640 1 -- 172.21.15.38:0/49024926 shutdown_connections 2024-09-13T18:27:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.556+0000 7f3ce184a640 1 --2- 172.21.15.38:0/49024926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cdc100d90 0x7f3cdc101210 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:25.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.556+0000 7f3ce184a640 1 --2- 172.21.15.38:0/49024926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cdc0ffb90 0x7f3cdc0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.556+0000 7f3ce184a640 1 -- 172.21.15.38:0/49024926 >> 172.21.15.38:0/49024926 conn(0x7f3cdc0fb320 msgr2=0x7f3cdc0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.556+0000 7f3ce184a640 1 -- 172.21.15.38:0/49024926 shutdown_connections 2024-09-13T18:27:25.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.556+0000 7f3ce184a640 1 -- 172.21.15.38:0/49024926 wait complete. 2024-09-13T18:27:25.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.557+0000 7f3ce184a640 1 Processor -- start 2024-09-13T18:27:25.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.557+0000 7f3ce184a640 1 -- start start 2024-09-13T18:27:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.557+0000 7f3ce184a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cdc0ffb90 0x7f3cdc195560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.557+0000 7f3ce184a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cdc100d90 0x7f3cdc195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.557+0000 7f3ce184a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc196070 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.557+0000 7f3ce184a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc1961e0 con 0x7f3cdc100d90 2024-09-13T18:27:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3cdaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cdc0ffb90 0x7f3cdc195560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3cdaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cdc0ffb90 0x7f3cdc195560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33088/0 (socket says 172.21.15.38:33088) 2024-09-13T18:27:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3cdaffd640 1 -- 172.21.15.38:0/2540362517 learned_addr learned my addr 172.21.15.38:0/2540362517 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3cd3fff640 1 --2- 172.21.15.38:0/2540362517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cdc100d90 0x7f3cdc195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3cdaffd640 1 -- 172.21.15.38:0/2540362517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cdc100d90 msgr2=0x7f3cdc195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3cdaffd640 1 --2- 172.21.15.38:0/2540362517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cdc100d90 0x7f3cdc195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3cdaffd640 1 -- 172.21.15.38:0/2540362517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc4009560 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.562 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3cdaffd640 1 --2- 172.21.15.38:0/2540362517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cdc0ffb90 0x7f3cdc195560 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00d900 tx=0x7f3ccc00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3ce0848640 1 -- 172.21.15.38:0/2540362517 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ccc009c00 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3ce184a640 1 -- 172.21.15.38:0/2540362517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc19ac30 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3ce0848640 1 -- 172.21.15.38:0/2540362517 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3ccc009d60 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3ce0848640 1 -- 172.21.15.38:0/2540362517 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ccc00f5f0 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.563 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.558+0000 7f3ce184a640 1 -- 172.21.15.38:0/2540362517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc19b180 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.559+0000 7f3ce184a640 1 -- 172.21.15.38:0/2540362517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc18f5f0 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.560+0000 7f3ce0848640 1 -- 172.21.15.38:0/2540362517 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3ccc010460 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.560+0000 7f3ce0848640 1 --2- 172.21.15.38:0/2540362517 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3cc806cc50 0x7f3cc806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.560+0000 7f3ce0848640 1 -- 172.21.15.38:0/2540362517 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3ccc08bd10 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.560+0000 7f3cd3fff640 1 --2- 172.21.15.38:0/2540362517 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3cc806cc50 0x7f3cc806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:25.564 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.561+0000 7f3cd3fff640 1 --2- 172.21.15.38:0/2540362517 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3cc806cc50 0x7f3cc806f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc196a30 tx=0x7f3cc4031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:25.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.565+0000 7f3ce0848640 1 -- 172.21.15.38:0/2540362517 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3ccc0564d0 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.737+0000 7f3ce184a640 1 -- 172.21.15.38:0/2540362517 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f3cdc108660 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.742+0000 7f3ce0848640 1 -- 172.21.15.38:0/2540362517 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v23)=0 v23) v1 ==== 143+0+0 (secure 0 0 0) 0x7f3ccc059af0 con 0x7f3cdc0ffb90 2024-09-13T18:27:25.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.744+0000 7f3ce184a640 1 -- 172.21.15.38:0/2540362517 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3cc806cc50 msgr2=0x7f3cc806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:25.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.744+0000 7f3ce184a640 1 --2- 172.21.15.38:0/2540362517 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3cc806cc50 0x7f3cc806f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc196a30 tx=0x7f3cc4031400 comp rx=0 tx=0).stop 2024-09-13T18:27:25.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.744+0000 7f3ce184a640 1 -- 172.21.15.38:0/2540362517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cdc0ffb90 msgr2=0x7f3cdc195560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:25.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.744+0000 7f3ce184a640 1 --2- 172.21.15.38:0/2540362517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cdc0ffb90 0x7f3cdc195560 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00d900 tx=0x7f3ccc00ddc0 comp rx=0 tx=0).stop 2024-09-13T18:27:25.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.745+0000 7f3ce184a640 1 -- 172.21.15.38:0/2540362517 shutdown_connections 2024-09-13T18:27:25.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.745+0000 7f3ce184a640 1 --2- 172.21.15.38:0/2540362517 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3cc806cc50 0x7f3cc806f110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:25.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.745+0000 7f3ce184a640 1 --2- 172.21.15.38:0/2540362517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cdc100d90 0x7f3cdc195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:25.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.745+0000 7f3ce184a640 1 --2- 172.21.15.38:0/2540362517 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3cdc0ffb90 0x7f3cdc195560 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:25.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.745+0000 7f3ce184a640 1 -- 172.21.15.38:0/2540362517 >> 172.21.15.38:0/2540362517 conn(0x7f3cdc0fb320 msgr2=0x7f3cdc1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:25.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.745+0000 7f3ce184a640 1 -- 172.21.15.38:0/2540362517 shutdown_connections 2024-09-13T18:27:25.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:25.745+0000 7f3ce184a640 1 -- 172.21.15.38:0/2540362517 wait complete. 2024-09-13T18:27:25.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:25 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:27:26.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:26 smithi038 ceph-mon[27689]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:26.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:26 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2540362517' entity='client.admin' 2024-09-13T18:27:26.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:27:26.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:26.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:27:26.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:26.385 INFO:teuthology.run_tasks:Running task print... 2024-09-13T18:27:26.394 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-13T18:27:26.395 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T18:27:26.421 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:27:26.422 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T18:27:26.633 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:26 smithi149 ceph-mon[35845]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:26 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/2540362517' entity='client.admin' 2024-09-13T18:27:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:27:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:27:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:28.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.233+0000 7f221220b640 1 -- 172.21.15.38:0/88876606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220c100630 msgr2=0x7f220c102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:28.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.233+0000 7f221220b640 1 --2- 172.21.15.38:0/88876606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220c100630 0x7f220c102a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0098b0 tx=0x7f21fc02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:27:28.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.233+0000 7f221220b640 1 -- 172.21.15.38:0/88876606 shutdown_connections 2024-09-13T18:27:28.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.233+0000 7f221220b640 1 --2- 172.21.15.38:0/88876606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220c102f60 0x7f220c105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:28.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.233+0000 7f221220b640 1 --2- 172.21.15.38:0/88876606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220c100630 0x7f220c102a20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:28.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.233+0000 7f221220b640 1 -- 172.21.15.38:0/88876606 >> 172.21.15.38:0/88876606 conn(0x7f220c0fa250 msgr2=0x7f220c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:28.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.233+0000 7f221220b640 1 -- 172.21.15.38:0/88876606 shutdown_connections 2024-09-13T18:27:28.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.233+0000 7f221220b640 1 -- 172.21.15.38:0/88876606 wait complete. 2024-09-13T18:27:28.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.233+0000 7f221220b640 1 Processor -- start 2024-09-13T18:27:28.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f221220b640 1 -- start start 2024-09-13T18:27:28.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f221220b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220c100630 0x7f220c195660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:28.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f221220b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220c102f60 0x7f220c195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:28.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f221220b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c196170 con 0x7f220c100630 2024-09-13T18:27:28.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f221220b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c1962e0 con 0x7f220c102f60 2024-09-13T18:27:28.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f220b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220c100630 0x7f220c195660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:28.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f220b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220c100630 0x7f220c195660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33100/0 (socket says 172.21.15.38:33100) 2024-09-13T18:27:28.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f220b7fe640 1 -- 172.21.15.38:0/3627876930 learned_addr learned my addr 172.21.15.38:0/3627876930 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:28.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f220affd640 1 --2- 172.21.15.38:0/3627876930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220c102f60 0x7f220c195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:28.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f220b7fe640 1 -- 172.21.15.38:0/3627876930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220c102f60 msgr2=0x7f220c195ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:28.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f220b7fe640 1 --2- 172.21.15.38:0/3627876930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220c102f60 0x7f220c195ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:28.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f220b7fe640 1 -- 172.21.15.38:0/3627876930 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc009560 con 0x7f220c100630 2024-09-13T18:27:28.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.234+0000 7f220b7fe640 1 --2- 172.21.15.38:0/3627876930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220c100630 0x7f220c195660 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f21fc006010 tx=0x7f21fc005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:28.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.235+0000 7f2208ff9640 1 -- 172.21.15.38:0/3627876930 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21fc004b20 con 0x7f220c100630 2024-09-13T18:27:28.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.235+0000 7f2208ff9640 1 -- 172.21.15.38:0/3627876930 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f21fc004c80 con 0x7f220c100630 2024-09-13T18:27:28.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.235+0000 7f221220b640 1 -- 172.21.15.38:0/3627876930 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c19ad20 con 0x7f220c100630 2024-09-13T18:27:28.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.235+0000 7f2208ff9640 1 -- 172.21.15.38:0/3627876930 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21fc031970 con 0x7f220c100630 2024-09-13T18:27:28.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.235+0000 7f221220b640 1 -- 172.21.15.38:0/3627876930 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c19b240 con 0x7f220c100630 2024-09-13T18:27:28.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.236+0000 7f221220b640 1 -- 172.21.15.38:0/3627876930 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c1086f0 con 0x7f220c100630 2024-09-13T18:27:28.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.236+0000 7f2208ff9640 1 -- 172.21.15.38:0/3627876930 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f21fc031b50 con 0x7f220c100630 2024-09-13T18:27:28.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.237+0000 7f2208ff9640 1 --2- 172.21.15.38:0/3627876930 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f21f406cc50 0x7f21f406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:28.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.237+0000 7f2208ff9640 1 -- 172.21.15.38:0/3627876930 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f21fc0ad0a0 con 0x7f220c100630 2024-09-13T18:27:28.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.237+0000 7f220affd640 1 --2- 172.21.15.38:0/3627876930 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f21f406cc50 0x7f21f406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:28.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.237+0000 7f220affd640 1 --2- 172.21.15.38:0/3627876930 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f21f406cc50 0x7f21f406f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f220c196b80 tx=0x7f2200009110 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:28.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.241+0000 7f2208ff9640 1 -- 172.21.15.38:0/3627876930 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f21fc077830 con 0x7f220c100630 2024-09-13T18:27:28.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.428+0000 7f221220b640 1 -- 172.21.15.38:0/3627876930 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f220c1039a0 con 0x7f21f406cc50 2024-09-13T18:27:28.431 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.429+0000 7f2208ff9640 1 -- 172.21.15.38:0/3627876930 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f220c1039a0 con 0x7f21f406cc50 2024-09-13T18:27:28.432 INFO:teuthology.orchestra.run.smithi038.stdout:Backend: cephadm 2024-09-13T18:27:28.432 INFO:teuthology.orchestra.run.smithi038.stdout:Available: Yes 2024-09-13T18:27:28.432 INFO:teuthology.orchestra.run.smithi038.stdout:Paused: No 2024-09-13T18:27:28.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.431+0000 7f221220b640 1 -- 172.21.15.38:0/3627876930 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f21f406cc50 msgr2=0x7f21f406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:28.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.431+0000 7f221220b640 1 --2- 172.21.15.38:0/3627876930 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f21f406cc50 0x7f21f406f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f220c196b80 tx=0x7f2200009110 comp rx=0 tx=0).stop 2024-09-13T18:27:28.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.431+0000 7f221220b640 1 -- 172.21.15.38:0/3627876930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220c100630 msgr2=0x7f220c195660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:28.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.431+0000 7f221220b640 1 --2- 172.21.15.38:0/3627876930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220c100630 0x7f220c195660 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f21fc006010 tx=0x7f21fc005630 comp rx=0 tx=0).stop 2024-09-13T18:27:28.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.431+0000 7f221220b640 1 -- 172.21.15.38:0/3627876930 shutdown_connections 2024-09-13T18:27:28.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.431+0000 7f221220b640 1 --2- 172.21.15.38:0/3627876930 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f21f406cc50 0x7f21f406f110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:28.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.431+0000 7f221220b640 1 --2- 172.21.15.38:0/3627876930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f220c102f60 0x7f220c195ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:28.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.431+0000 7f221220b640 1 --2- 172.21.15.38:0/3627876930 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f220c100630 0x7f220c195660 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:28.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.431+0000 7f221220b640 1 -- 172.21.15.38:0/3627876930 >> 172.21.15.38:0/3627876930 conn(0x7f220c0fa250 msgr2=0x7f220c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:28.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.431+0000 7f221220b640 1 -- 172.21.15.38:0/3627876930 shutdown_connections 2024-09-13T18:27:28.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:28.431+0000 7f221220b640 1 -- 172.21.15.38:0/3627876930 wait complete. 2024-09-13T18:27:28.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:28 smithi038 ceph-mon[27689]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:28.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:28 smithi149 ceph-mon[35845]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:29.064 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T18:27:29.273 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:30.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:30 smithi038 ceph-mon[27689]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:27:30.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:30 smithi038 ceph-mon[27689]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:30.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:30 smithi149 ceph-mon[35845]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:27:30.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:30 smithi149 ceph-mon[35845]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:30.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.985+0000 7faf94d69640 1 -- 172.21.15.38:0/3057944912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf90100d90 msgr2=0x7faf90101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.985+0000 7faf94d69640 1 --2- 172.21.15.38:0/3057944912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf90100d90 0x7faf90101210 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faf84009880 tx=0x7faf8402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.985+0000 7faf94d69640 1 -- 172.21.15.38:0/3057944912 shutdown_connections 2024-09-13T18:27:30.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.985+0000 7faf94d69640 1 --2- 172.21.15.38:0/3057944912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf90100d90 0x7faf90101210 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.985+0000 7faf94d69640 1 --2- 172.21.15.38:0/3057944912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf900ffb90 0x7faf900fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.985+0000 7faf94d69640 1 -- 172.21.15.38:0/3057944912 >> 172.21.15.38:0/3057944912 conn(0x7faf900fb320 msgr2=0x7faf900fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:30.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.985+0000 7faf94d69640 1 -- 172.21.15.38:0/3057944912 shutdown_connections 2024-09-13T18:27:30.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.985+0000 7faf94d69640 1 -- 172.21.15.38:0/3057944912 wait complete. 2024-09-13T18:27:30.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.986+0000 7faf94d69640 1 Processor -- start 2024-09-13T18:27:30.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.986+0000 7faf94d69640 1 -- start start 2024-09-13T18:27:30.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.986+0000 7faf94d69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf900ffb90 0x7faf901955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf94d69640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf90100d90 0x7faf90195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf94d69640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf901960e0 con 0x7faf900ffb90 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf94d69640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf90196250 con 0x7faf90100d90 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf8e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf900ffb90 0x7faf901955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf8e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf900ffb90 0x7faf901955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:33108/0 (socket says 172.21.15.38:33108) 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf8e59c640 1 -- 172.21.15.38:0/2474637109 learned_addr learned my addr 172.21.15.38:0/2474637109 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf8dd9b640 1 --2- 172.21.15.38:0/2474637109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf90100d90 0x7faf90195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf8e59c640 1 -- 172.21.15.38:0/2474637109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf90100d90 msgr2=0x7faf90195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf8e59c640 1 --2- 172.21.15.38:0/2474637109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf90100d90 0x7faf90195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf8e59c640 1 -- 172.21.15.38:0/2474637109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84009560 con 0x7faf900ffb90 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf8dd9b640 1 --2- 172.21.15.38:0/2474637109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf90100d90 0x7faf90195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf8e59c640 1 --2- 172.21.15.38:0/2474637109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf900ffb90 0x7faf901955d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf8000d900 tx=0x7faf8000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf7f7fe640 1 -- 172.21.15.38:0/2474637109 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf80009c00 con 0x7faf900ffb90 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf7f7fe640 1 -- 172.21.15.38:0/2474637109 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faf80009d60 con 0x7faf900ffb90 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf94d69640 1 -- 172.21.15.38:0/2474637109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9019acf0 con 0x7faf900ffb90 2024-09-13T18:27:30.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf7f7fe640 1 -- 172.21.15.38:0/2474637109 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf8000f5f0 con 0x7faf900ffb90 2024-09-13T18:27:30.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.987+0000 7faf94d69640 1 -- 172.21.15.38:0/2474637109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9019b260 con 0x7faf900ffb90 2024-09-13T18:27:30.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.989+0000 7faf94d69640 1 -- 172.21.15.38:0/2474637109 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9018f5f0 con 0x7faf900ffb90 2024-09-13T18:27:30.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.989+0000 7faf7f7fe640 1 -- 172.21.15.38:0/2474637109 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faf80010460 con 0x7faf900ffb90 2024-09-13T18:27:30.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.989+0000 7faf7f7fe640 1 --2- 172.21.15.38:0/2474637109 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7faf7806cc60 0x7faf7806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:30.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.990+0000 7faf7f7fe640 1 -- 172.21.15.38:0/2474637109 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7faf8008bcf0 con 0x7faf900ffb90 2024-09-13T18:27:30.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.990+0000 7faf8dd9b640 1 --2- 172.21.15.38:0/2474637109 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7faf7806cc60 0x7faf7806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:30.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.990+0000 7faf8dd9b640 1 --2- 172.21.15.38:0/2474637109 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7faf7806cc60 0x7faf7806f120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf90196af0 tx=0x7faf84031420 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:30.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:30.994+0000 7faf7f7fe640 1 -- 172.21.15.38:0/2474637109 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faf80056480 con 0x7faf900ffb90 2024-09-13T18:27:31.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.172+0000 7faf94d69640 1 -- 172.21.15.38:0/2474637109 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faf9002c590 con 0x7faf7806cc60 2024-09-13T18:27:31.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.180+0000 7faf7f7fe640 1 -- 172.21.15.38:0/2474637109 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3080 (secure 0 0 0) 0x7faf9002c590 con 0x7faf7806cc60 2024-09-13T18:27:31.183 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:27:31.183 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (3m) 2m ago 5m 25.7M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:27:31.183 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (5m) 2m ago 5m 7130k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:27:31.183 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (4m) 68s ago 4m 7063k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:27:31.183 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (5m) 2m ago 5m 6899k - 18.2.4-845-ge4e227b3 67ddd33fa72f 30c026e97a6b 2024-09-13T18:27:31.183 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (4m) 68s ago 4m 6895k - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c179d7df975 2024-09-13T18:27:31.183 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (3m) 2m ago 4m 79.6M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:9283,8765,8443 running (6m) 2m ago 6m 479M - 18.2.4-845-ge4e227b3 67ddd33fa72f 1cebd33ffd6a 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (4m) 68s ago 4m 439M - 18.2.4-845-ge4e227b3 67ddd33fa72f 9c9aea66991f 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (6m) 2m ago 6m 44.2M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f b654a36a9082 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (4m) 68s ago 4m 40.7M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 0133a107f35d 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (5m) 2m ago 5m 15.4M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (4m) 68s ago 4m 15.5M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (3m) 2m ago 3m 51.7M 3948M 18.2.4-845-ge4e227b3 67ddd33fa72f 69a9e66fb097 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (2m) 2m ago 2m 49.8M 3948M 18.2.4-845-ge4e227b3 67ddd33fa72f 07986b4ba73b 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (2m) 2m ago 2m 42.0M 3948M 18.2.4-845-ge4e227b3 67ddd33fa72f e44cdda01aee 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (2m) 68s ago 2m 40.1M 1213M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (98s) 68s ago 97s 49.0M 1213M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (73s) 68s ago 73s 12.1M 1213M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:27:31.184 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (3m) 2m ago 4m 42.5M - 2.43.0 a07b618ecd1d 292b390ae245 2024-09-13T18:27:31.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.182+0000 7faf94d69640 1 -- 172.21.15.38:0/2474637109 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7faf7806cc60 msgr2=0x7faf7806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.182+0000 7faf94d69640 1 --2- 172.21.15.38:0/2474637109 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7faf7806cc60 0x7faf7806f120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf90196af0 tx=0x7faf84031420 comp rx=0 tx=0).stop 2024-09-13T18:27:31.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.182+0000 7faf94d69640 1 -- 172.21.15.38:0/2474637109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf900ffb90 msgr2=0x7faf901955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:31.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.182+0000 7faf94d69640 1 --2- 172.21.15.38:0/2474637109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf900ffb90 0x7faf901955d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf8000d900 tx=0x7faf8000ddc0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.182+0000 7faf94d69640 1 -- 172.21.15.38:0/2474637109 shutdown_connections 2024-09-13T18:27:31.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.182+0000 7faf94d69640 1 --2- 172.21.15.38:0/2474637109 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7faf7806cc60 0x7faf7806f120 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.182+0000 7faf94d69640 1 --2- 172.21.15.38:0/2474637109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf90100d90 0x7faf90195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.182+0000 7faf94d69640 1 --2- 172.21.15.38:0/2474637109 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faf900ffb90 0x7faf901955d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:31.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.182+0000 7faf94d69640 1 -- 172.21.15.38:0/2474637109 >> 172.21.15.38:0/2474637109 conn(0x7faf900fb320 msgr2=0x7faf90104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:31.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.183+0000 7faf94d69640 1 -- 172.21.15.38:0/2474637109 shutdown_connections 2024-09-13T18:27:31.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:31.183+0000 7faf94d69640 1 -- 172.21.15.38:0/2474637109 wait complete. 2024-09-13T18:27:31.548 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:31 smithi038 ceph-mon[27689]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:27:31.548 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:31 smithi038 ceph-mon[27689]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:31.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:31 smithi149 ceph-mon[35845]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:27:31.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:31 smithi149 ceph-mon[35845]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:31.879 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T18:27:32.086 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.690+0000 7fad70328640 1 -- 172.21.15.38:0/3530337441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68102f60 msgr2=0x7fad68105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.690+0000 7fad70328640 1 --2- 172.21.15.38:0/3530337441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68102f60 0x7fad68105350 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fad580098b0 tx=0x7fad5802a4d0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.690+0000 7fad70328640 1 -- 172.21.15.38:0/3530337441 shutdown_connections 2024-09-13T18:27:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.690+0000 7fad70328640 1 --2- 172.21.15.38:0/3530337441 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68102f60 0x7fad68105350 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.690+0000 7fad70328640 1 --2- 172.21.15.38:0/3530337441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad68100630 0x7fad68102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.690+0000 7fad70328640 1 -- 172.21.15.38:0/3530337441 >> 172.21.15.38:0/3530337441 conn(0x7fad680fa250 msgr2=0x7fad680fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.690+0000 7fad70328640 1 -- 172.21.15.38:0/3530337441 shutdown_connections 2024-09-13T18:27:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.690+0000 7fad70328640 1 -- 172.21.15.38:0/3530337441 wait complete. 2024-09-13T18:27:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.690+0000 7fad70328640 1 Processor -- start 2024-09-13T18:27:33.709 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.690+0000 7fad70328640 1 -- start start 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad70328640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68100630 0x7fad681955b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad70328640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad68102f60 0x7fad68195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad70328640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad681960c0 con 0x7fad68100630 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad70328640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad68196230 con 0x7fad68102f60 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad6e0c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68100630 0x7fad681955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad6e0c4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68100630 0x7fad681955b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53402/0 (socket says 172.21.15.38:53402) 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad6e0c4640 1 -- 172.21.15.38:0/2641220800 learned_addr learned my addr 172.21.15.38:0/2641220800 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad6e0c4640 1 -- 172.21.15.38:0/2641220800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad68102f60 msgr2=0x7fad68195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad6e0c4640 1 --2- 172.21.15.38:0/2641220800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad68102f60 0x7fad68195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad6e0c4640 1 -- 172.21.15.38:0/2641220800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58009560 con 0x7fad68100630 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad6e0c4640 1 --2- 172.21.15.38:0/2641220800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68100630 0x7fad681955b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fad6400d720 tx=0x7fad6400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad5f7fe640 1 -- 172.21.15.38:0/2641220800 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad640051f0 con 0x7fad68100630 2024-09-13T18:27:33.710 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad5f7fe640 1 -- 172.21.15.38:0/2641220800 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad64009820 con 0x7fad68100630 2024-09-13T18:27:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad70328640 1 -- 172.21.15.38:0/2641220800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6819acd0 con 0x7fad68100630 2024-09-13T18:27:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad5f7fe640 1 -- 172.21.15.38:0/2641220800 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad64004d40 con 0x7fad68100630 2024-09-13T18:27:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.691+0000 7fad70328640 1 -- 172.21.15.38:0/2641220800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6819b2a0 con 0x7fad68100630 2024-09-13T18:27:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.692+0000 7fad70328640 1 -- 172.21.15.38:0/2641220800 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad68108670 con 0x7fad68100630 2024-09-13T18:27:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.693+0000 7fad5f7fe640 1 -- 172.21.15.38:0/2641220800 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fad64009990 con 0x7fad68100630 2024-09-13T18:27:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.693+0000 7fad5f7fe640 1 --2- 172.21.15.38:0/2641220800 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fad5406cc50 0x7fad5406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.694+0000 7fad6d8c3640 1 --2- 172.21.15.38:0/2641220800 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fad5406cc50 0x7fad5406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.694+0000 7fad5f7fe640 1 -- 172.21.15.38:0/2641220800 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fad6408ba20 con 0x7fad68100630 2024-09-13T18:27:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.694+0000 7fad6d8c3640 1 --2- 172.21.15.38:0/2641220800 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fad5406cc50 0x7fad5406f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fad5802a9f0 tx=0x7fad58000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:33.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.698+0000 7fad5f7fe640 1 -- 172.21.15.38:0/2641220800 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fad640561b0 con 0x7fad68100630 2024-09-13T18:27:33.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.878+0000 7fad70328640 1 -- 172.21.15.38:0/2641220800 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fad6819b4e0 con 0x7fad5406cc50 2024-09-13T18:27:33.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.883+0000 7fad5f7fe640 1 -- 172.21.15.38:0/2641220800 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7fad6819b4e0 con 0x7fad5406cc50 2024-09-13T18:27:33.886 INFO:teuthology.orchestra.run.smithi038.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T18:27:33.886 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-13T18:27:33.886 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter 2/2 2m ago 6m * 2024-09-13T18:27:33.886 INFO:teuthology.orchestra.run.smithi038.stdout:crash 2/2 2m ago 6m * 2024-09-13T18:27:33.886 INFO:teuthology.orchestra.run.smithi038.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-09-13T18:27:33.886 INFO:teuthology.orchestra.run.smithi038.stdout:mgr 2/2 2m ago 6m count:2 2024-09-13T18:27:33.886 INFO:teuthology.orchestra.run.smithi038.stdout:mon 2/2 2m ago 5m smithi038:172.21.15.38=smithi038;smithi149:172.21.15.149=smithi149;count:2 2024-09-13T18:27:33.886 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-13T18:27:33.886 INFO:teuthology.orchestra.run.smithi038.stdout:osd 6 2m ago - 2024-09-13T18:27:33.887 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-09-13T18:27:33.887 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.885+0000 7fad70328640 1 -- 172.21.15.38:0/2641220800 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fad5406cc50 msgr2=0x7fad5406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.885+0000 7fad70328640 1 --2- 172.21.15.38:0/2641220800 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fad5406cc50 0x7fad5406f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fad5802a9f0 tx=0x7fad58000bc0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.885+0000 7fad70328640 1 -- 172.21.15.38:0/2641220800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68100630 msgr2=0x7fad681955b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.885+0000 7fad70328640 1 --2- 172.21.15.38:0/2641220800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68100630 0x7fad681955b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fad6400d720 tx=0x7fad6400dbe0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.885+0000 7fad70328640 1 -- 172.21.15.38:0/2641220800 shutdown_connections 2024-09-13T18:27:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.885+0000 7fad70328640 1 --2- 172.21.15.38:0/2641220800 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fad5406cc50 0x7fad5406f110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.885+0000 7fad70328640 1 --2- 172.21.15.38:0/2641220800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad68102f60 0x7fad68195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.885+0000 7fad70328640 1 --2- 172.21.15.38:0/2641220800 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad68100630 0x7fad681955b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.885+0000 7fad70328640 1 -- 172.21.15.38:0/2641220800 >> 172.21.15.38:0/2641220800 conn(0x7fad680fa250 msgr2=0x7fad680fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.885+0000 7fad70328640 1 -- 172.21.15.38:0/2641220800 shutdown_connections 2024-09-13T18:27:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:33.885+0000 7fad70328640 1 -- 172.21.15.38:0/2641220800 wait complete. 2024-09-13T18:27:34.571 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:34 smithi038 ceph-mon[27689]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:34.597 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T18:27:34.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:34 smithi149 ceph-mon[35845]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:34.809 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:35.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:35 smithi038 ceph-mon[27689]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:27:35.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:35 smithi149 ceph-mon[35845]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:27:36.470 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.466+0000 7fa4c82e6640 1 -- 172.21.15.38:0/3097165788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c0100d90 msgr2=0x7fa4c0101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.466+0000 7fa4c82e6640 1 --2- 172.21.15.38:0/3097165788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c0100d90 0x7fa4c0101210 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009880 tx=0x7fa4b002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.466+0000 7fa4c82e6640 1 -- 172.21.15.38:0/3097165788 shutdown_connections 2024-09-13T18:27:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.466+0000 7fa4c82e6640 1 --2- 172.21.15.38:0/3097165788 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c0100d90 0x7fa4c0101210 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.466+0000 7fa4c82e6640 1 --2- 172.21.15.38:0/3097165788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c00ffb90 0x7fa4c00fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.466+0000 7fa4c82e6640 1 -- 172.21.15.38:0/3097165788 >> 172.21.15.38:0/3097165788 conn(0x7fa4c00fb320 msgr2=0x7fa4c00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.467+0000 7fa4c82e6640 1 -- 172.21.15.38:0/3097165788 shutdown_connections 2024-09-13T18:27:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.467+0000 7fa4c82e6640 1 -- 172.21.15.38:0/3097165788 wait complete. 2024-09-13T18:27:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.467+0000 7fa4c82e6640 1 Processor -- start 2024-09-13T18:27:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.467+0000 7fa4c82e6640 1 -- start start 2024-09-13T18:27:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.467+0000 7fa4c82e6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c00ffb90 0x7fa4c0195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.467+0000 7fa4c82e6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c0100d90 0x7fa4c0195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.467+0000 7fa4c82e6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0195fb0 con 0x7fa4c00ffb90 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.467+0000 7fa4c82e6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0196120 con 0x7fa4c0100d90 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.467+0000 7fa4c6082640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c00ffb90 0x7fa4c0195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.467+0000 7fa4c6082640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c00ffb90 0x7fa4c0195530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53418/0 (socket says 172.21.15.38:53418) 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.467+0000 7fa4c6082640 1 -- 172.21.15.38:0/1287506745 learned_addr learned my addr 172.21.15.38:0/1287506745 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.468+0000 7fa4c5881640 1 --2- 172.21.15.38:0/1287506745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c0100d90 0x7fa4c0195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.468+0000 7fa4c6082640 1 -- 172.21.15.38:0/1287506745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c0100d90 msgr2=0x7fa4c0195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.468+0000 7fa4c6082640 1 --2- 172.21.15.38:0/1287506745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c0100d90 0x7fa4c0195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.468+0000 7fa4c6082640 1 -- 172.21.15.38:0/1287506745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b0009560 con 0x7fa4c00ffb90 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.468+0000 7fa4c5881640 1 --2- 172.21.15.38:0/1287506745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c0100d90 0x7fa4c0195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.468+0000 7fa4c6082640 1 --2- 172.21.15.38:0/1287506745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c00ffb90 0x7fa4c0195530 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00c8f0 tx=0x7fa4bc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.468+0000 7fa4b77fe640 1 -- 172.21.15.38:0/1287506745 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4bc0041f0 con 0x7fa4c00ffb90 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.468+0000 7fa4c82e6640 1 -- 172.21.15.38:0/1287506745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c019ac00 con 0x7fa4c00ffb90 2024-09-13T18:27:36.472 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.468+0000 7fa4b77fe640 1 -- 172.21.15.38:0/1287506745 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa4bc007df0 con 0x7fa4c00ffb90 2024-09-13T18:27:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.468+0000 7fa4b77fe640 1 -- 172.21.15.38:0/1287506745 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4bc00f450 con 0x7fa4c00ffb90 2024-09-13T18:27:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.468+0000 7fa4c82e6640 1 -- 172.21.15.38:0/1287506745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c019b100 con 0x7fa4c00ffb90 2024-09-13T18:27:36.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.469+0000 7fa4c82e6640 1 -- 172.21.15.38:0/1287506745 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c018f5d0 con 0x7fa4c00ffb90 2024-09-13T18:27:36.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.470+0000 7fa4b77fe640 1 -- 172.21.15.38:0/1287506745 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa4bc007950 con 0x7fa4c00ffb90 2024-09-13T18:27:36.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.470+0000 7fa4b77fe640 1 --2- 172.21.15.38:0/1287506745 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa4ac06cc60 0x7fa4ac06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:36.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.470+0000 7fa4b77fe640 1 -- 172.21.15.38:0/1287506745 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa4bc013070 con 0x7fa4c00ffb90 2024-09-13T18:27:36.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.470+0000 7fa4c5881640 1 --2- 172.21.15.38:0/1287506745 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa4ac06cc60 0x7fa4ac06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:36.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.471+0000 7fa4c5881640 1 --2- 172.21.15.38:0/1287506745 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa4ac06cc60 0x7fa4ac06f120 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0031460 tx=0x7fa4b0000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:36.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.475+0000 7fa4b77fe640 1 -- 172.21.15.38:0/1287506745 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa4bc0566e0 con 0x7fa4c00ffb90 2024-09-13T18:27:36.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:36 smithi038 ceph-mon[27689]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:36.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.653+0000 7fa4c82e6640 1 -- 172.21.15.38:0/1287506745 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4c002c600 con 0x7fa4ac06cc60 2024-09-13T18:27:36.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.655+0000 7fa4b77fe640 1 -- 172.21.15.38:0/1287506745 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fa4c002c600 con 0x7fa4ac06cc60 2024-09-13T18:27:36.657 INFO:teuthology.orchestra.run.smithi038.stdout:HOST ADDR LABELS STATUS 2024-09-13T18:27:36.657 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038 172.21.15.38 2024-09-13T18:27:36.657 INFO:teuthology.orchestra.run.smithi038.stdout:smithi149 172.21.15.149 2024-09-13T18:27:36.657 INFO:teuthology.orchestra.run.smithi038.stdout:2 hosts in cluster 2024-09-13T18:27:36.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.657+0000 7fa4c82e6640 1 -- 172.21.15.38:0/1287506745 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa4ac06cc60 msgr2=0x7fa4ac06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.657+0000 7fa4c82e6640 1 --2- 172.21.15.38:0/1287506745 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa4ac06cc60 0x7fa4ac06f120 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0031460 tx=0x7fa4b0000bc0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.657+0000 7fa4c82e6640 1 -- 172.21.15.38:0/1287506745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c00ffb90 msgr2=0x7fa4c0195530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:36.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.657+0000 7fa4c82e6640 1 --2- 172.21.15.38:0/1287506745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c00ffb90 0x7fa4c0195530 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00c8f0 tx=0x7fa4bc00cdb0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.657+0000 7fa4c82e6640 1 -- 172.21.15.38:0/1287506745 shutdown_connections 2024-09-13T18:27:36.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.657+0000 7fa4c82e6640 1 --2- 172.21.15.38:0/1287506745 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fa4ac06cc60 0x7fa4ac06f120 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.657+0000 7fa4c82e6640 1 --2- 172.21.15.38:0/1287506745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c0100d90 0x7fa4c0195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.657+0000 7fa4c82e6640 1 --2- 172.21.15.38:0/1287506745 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c00ffb90 0x7fa4c0195530 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:36.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.657+0000 7fa4c82e6640 1 -- 172.21.15.38:0/1287506745 >> 172.21.15.38:0/1287506745 conn(0x7fa4c00fb320 msgr2=0x7fa4c01044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:36.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.657+0000 7fa4c82e6640 1 -- 172.21.15.38:0/1287506745 shutdown_connections 2024-09-13T18:27:36.660 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:36.657+0000 7fa4c82e6640 1 -- 172.21.15.38:0/1287506745 wait complete. 2024-09-13T18:27:36.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:36 smithi149 ceph-mon[35845]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:37.353 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T18:27:37.565 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:37.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:37 smithi038 ceph-mon[27689]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:27:37.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:37 smithi038 ceph-mon[27689]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:37.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:37 smithi149 ceph-mon[35845]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:27:37.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:37 smithi149 ceph-mon[35845]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:39.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.251+0000 7f7622da0640 1 -- 172.21.15.38:0/2881714700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c0ffca0 msgr2=0x7f761c100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.251+0000 7f7622da0640 1 --2- 172.21.15.38:0/2881714700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c0ffca0 0x7f761c100120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7608009880 tx=0x7f760802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.251+0000 7f7622da0640 1 -- 172.21.15.38:0/2881714700 shutdown_connections 2024-09-13T18:27:39.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.251+0000 7f7622da0640 1 --2- 172.21.15.38:0/2881714700 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c0ffca0 0x7f761c100120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.251+0000 7f7622da0640 1 --2- 172.21.15.38:0/2881714700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0feaa0 0x7f761c0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.251+0000 7f7622da0640 1 -- 172.21.15.38:0/2881714700 >> 172.21.15.38:0/2881714700 conn(0x7f761c0fa250 msgr2=0x7f761c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:39.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.251+0000 7f7622da0640 1 -- 172.21.15.38:0/2881714700 shutdown_connections 2024-09-13T18:27:39.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.251+0000 7f7622da0640 1 -- 172.21.15.38:0/2881714700 wait complete. 2024-09-13T18:27:39.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.252+0000 7f7622da0640 1 Processor -- start 2024-09-13T18:27:39.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.252+0000 7f7622da0640 1 -- start start 2024-09-13T18:27:39.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.252+0000 7f7622da0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c0feaa0 0x7f761c102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.252+0000 7f7622da0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0ffca0 0x7f761c101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.252+0000 7f7622da0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c1015c0 con 0x7f761c0feaa0 2024-09-13T18:27:39.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.252+0000 7f7622da0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c101730 con 0x7f761c0ffca0 2024-09-13T18:27:39.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.252+0000 7f7620b3c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c0feaa0 0x7f761c102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.252+0000 7f7620b3c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c0feaa0 0x7f761c102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53436/0 (socket says 172.21.15.38:53436) 2024-09-13T18:27:39.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.252+0000 7f7620b3c640 1 -- 172.21.15.38:0/168419126 learned_addr learned my addr 172.21.15.38:0/168419126 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:39.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.252+0000 7f761bfff640 1 --2- 172.21.15.38:0/168419126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0ffca0 0x7f761c101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.253+0000 7f7620b3c640 1 -- 172.21.15.38:0/168419126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0ffca0 msgr2=0x7f761c101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.253+0000 7f7620b3c640 1 --2- 172.21.15.38:0/168419126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0ffca0 0x7f761c101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.253+0000 7f7620b3c640 1 -- 172.21.15.38:0/168419126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7608009560 con 0x7f761c0feaa0 2024-09-13T18:27:39.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.253+0000 7f7620b3c640 1 --2- 172.21.15.38:0/168419126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c0feaa0 0x7f761c102a30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f761000b3d0 tx=0x7f761000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.253+0000 7f7619ffb640 1 -- 172.21.15.38:0/168419126 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7610011800 con 0x7f761c0feaa0 2024-09-13T18:27:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.253+0000 7f7619ffb640 1 -- 172.21.15.38:0/168419126 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7610011e00 con 0x7f761c0feaa0 2024-09-13T18:27:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.253+0000 7f7619ffb640 1 -- 172.21.15.38:0/168419126 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f761000f2e0 con 0x7f761c0feaa0 2024-09-13T18:27:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.253+0000 7f7622da0640 1 -- 172.21.15.38:0/168419126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761c101a10 con 0x7f761c0feaa0 2024-09-13T18:27:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.253+0000 7f7622da0640 1 -- 172.21.15.38:0/168419126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761c19d6b0 con 0x7f761c0feaa0 2024-09-13T18:27:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.254+0000 7f7622da0640 1 -- 172.21.15.38:0/168419126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761c1075f0 con 0x7f761c0feaa0 2024-09-13T18:27:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.255+0000 7f7619ffb640 1 -- 172.21.15.38:0/168419126 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7610010380 con 0x7f761c0feaa0 2024-09-13T18:27:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.255+0000 7f7619ffb640 1 --2- 172.21.15.38:0/168419126 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f760c06cc50 0x7f760c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.255+0000 7f7619ffb640 1 -- 172.21.15.38:0/168419126 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f761008bab0 con 0x7f761c0feaa0 2024-09-13T18:27:39.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.255+0000 7f761bfff640 1 --2- 172.21.15.38:0/168419126 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f760c06cc50 0x7f760c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:39.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.256+0000 7f761bfff640 1 --2- 172.21.15.38:0/168419126 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f760c06cc50 0x7f760c06f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f761c1027b0 tx=0x7f7608031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:39.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.259+0000 7f7619ffb640 1 -- 172.21.15.38:0/168419126 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7610056240 con 0x7f761c0feaa0 2024-09-13T18:27:39.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.442+0000 7f7622da0640 1 -- 172.21.15.38:0/168419126 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f761c068b60 con 0x7f760c06cc50 2024-09-13T18:27:39.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.444+0000 7f7619ffb640 1 -- 172.21.15.38:0/168419126 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f761c068b60 con 0x7f760c06cc50 2024-09-13T18:27:39.446 INFO:teuthology.orchestra.run.smithi038.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T18:27:39.446 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN 3726G No 2m ago Has a FileSystem, LVM detected 2024-09-13T18:27:39.446 INFO:teuthology.orchestra.run.smithi038.stdout:smithi149 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CK400BGN 372G No 73s ago Has a FileSystem, LVM detected 2024-09-13T18:27:39.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.446+0000 7f7622da0640 1 -- 172.21.15.38:0/168419126 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f760c06cc50 msgr2=0x7f760c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.446+0000 7f7622da0640 1 --2- 172.21.15.38:0/168419126 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f760c06cc50 0x7f760c06f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f761c1027b0 tx=0x7f7608031400 comp rx=0 tx=0).stop 2024-09-13T18:27:39.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.446+0000 7f7622da0640 1 -- 172.21.15.38:0/168419126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c0feaa0 msgr2=0x7f761c102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:39.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.446+0000 7f7622da0640 1 --2- 172.21.15.38:0/168419126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c0feaa0 0x7f761c102a30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f761000b3d0 tx=0x7f761000b890 comp rx=0 tx=0).stop 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.446+0000 7f7622da0640 1 -- 172.21.15.38:0/168419126 shutdown_connections 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.446+0000 7f7622da0640 1 --2- 172.21.15.38:0/168419126 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f760c06cc50 0x7f760c06f110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.446+0000 7f7622da0640 1 --2- 172.21.15.38:0/168419126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c0ffca0 0x7f761c101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.446+0000 7f7622da0640 1 --2- 172.21.15.38:0/168419126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c0feaa0 0x7f761c102a30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.446+0000 7f7622da0640 1 -- 172.21.15.38:0/168419126 >> 172.21.15.38:0/168419126 conn(0x7f761c0fa250 msgr2=0x7f761c068450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.446+0000 7f7622da0640 1 -- 172.21.15.38:0/168419126 shutdown_connections 2024-09-13T18:27:39.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:39.446+0000 7f7622da0640 1 -- 172.21.15.38:0/168419126 wait complete. 2024-09-13T18:27:40.077 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T18:27:40.090 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:27:40.090 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-13T18:27:40.303 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:40.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:40 smithi038 ceph-mon[27689]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:40.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:40 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:27:40.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:40 smithi149 ceph-mon[35845]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:40.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:40 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:27:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:41 smithi038 ceph-mon[27689]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:27:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:41 smithi149 ceph-mon[35845]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:27:42.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.003+0000 7fd20ce4a640 1 -- 172.21.15.38:0/816966869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd208100d90 msgr2=0x7fd208101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.003+0000 7fd20ce4a640 1 --2- 172.21.15.38:0/816966869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd208100d90 0x7fd208101210 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009880 tx=0x7fd1fc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.003+0000 7fd20ce4a640 1 -- 172.21.15.38:0/816966869 shutdown_connections 2024-09-13T18:27:42.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.003+0000 7fd20ce4a640 1 --2- 172.21.15.38:0/816966869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd208100d90 0x7fd208101210 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.003+0000 7fd20ce4a640 1 --2- 172.21.15.38:0/816966869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2080ffb90 0x7fd2080fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.003+0000 7fd20ce4a640 1 -- 172.21.15.38:0/816966869 >> 172.21.15.38:0/816966869 conn(0x7fd2080fb320 msgr2=0x7fd2080fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:42.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.003+0000 7fd20ce4a640 1 -- 172.21.15.38:0/816966869 shutdown_connections 2024-09-13T18:27:42.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.003+0000 7fd20ce4a640 1 -- 172.21.15.38:0/816966869 wait complete. 2024-09-13T18:27:42.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.004+0000 7fd20ce4a640 1 Processor -- start 2024-09-13T18:27:42.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.004+0000 7fd20ce4a640 1 -- start start 2024-09-13T18:27:42.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.004+0000 7fd20ce4a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2080ffb90 0x7fd208195540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.004+0000 7fd20ce4a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd208100d90 0x7fd208195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd20ce4a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd208196050 con 0x7fd208100d90 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd20ce4a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081961c0 con 0x7fd2080ffb90 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd205d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd208100d90 0x7fd208195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd205d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd208100d90 0x7fd208195a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53448/0 (socket says 172.21.15.38:53448) 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd205d9b640 1 -- 172.21.15.38:0/3736150326 learned_addr learned my addr 172.21.15.38:0/3736150326 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd20659c640 1 --2- 172.21.15.38:0/3736150326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2080ffb90 0x7fd208195540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd205d9b640 1 -- 172.21.15.38:0/3736150326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2080ffb90 msgr2=0x7fd208195540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd205d9b640 1 --2- 172.21.15.38:0/3736150326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2080ffb90 0x7fd208195540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd205d9b640 1 -- 172.21.15.38:0/3736150326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc009560 con 0x7fd208100d90 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd205d9b640 1 --2- 172.21.15.38:0/3736150326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd208100d90 0x7fd208195a80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0099a0 tx=0x7fd1fc0055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd1f77fe640 1 -- 172.21.15.38:0/3736150326 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1fc004aa0 con 0x7fd208100d90 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd20ce4a640 1 -- 172.21.15.38:0/3736150326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20819abb0 con 0x7fd208100d90 2024-09-13T18:27:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd1f77fe640 1 -- 172.21.15.38:0/3736150326 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd1fc004c00 con 0x7fd208100d90 2024-09-13T18:27:42.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd1f77fe640 1 -- 172.21.15.38:0/3736150326 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1fc031950 con 0x7fd208100d90 2024-09-13T18:27:42.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.005+0000 7fd20ce4a640 1 -- 172.21.15.38:0/3736150326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20819b120 con 0x7fd208100d90 2024-09-13T18:27:42.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.007+0000 7fd20ce4a640 1 -- 172.21.15.38:0/3736150326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20818f5d0 con 0x7fd208100d90 2024-09-13T18:27:42.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.007+0000 7fd1f77fe640 1 -- 172.21.15.38:0/3736150326 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd1fc031c10 con 0x7fd208100d90 2024-09-13T18:27:42.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.007+0000 7fd1f77fe640 1 --2- 172.21.15.38:0/3736150326 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd1f006cc60 0x7fd1f006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:42.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.008+0000 7fd1f77fe640 1 -- 172.21.15.38:0/3736150326 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd1fc0ad0d0 con 0x7fd208100d90 2024-09-13T18:27:42.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.008+0000 7fd20659c640 1 --2- 172.21.15.38:0/3736150326 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd1f006cc60 0x7fd1f006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:42.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.008+0000 7fd20659c640 1 --2- 172.21.15.38:0/3736150326 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd1f006cc60 0x7fd1f006f120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd208100bf0 tx=0x7fd1f800b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:42.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.012+0000 7fd1f77fe640 1 -- 172.21.15.38:0/3736150326 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd1fc077890 con 0x7fd208100d90 2024-09-13T18:27:42.217 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:42.214+0000 7fd20ce4a640 1 -- 172.21.15.38:0/3736150326 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd20802c450 con 0x7fd1f006cc60 2024-09-13T18:27:43.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:42 smithi149 ceph-mon[35845]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:43.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:42 smithi038 ceph-mon[27689]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:43.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:43.733+0000 7fd1f77fe640 1 -- 172.21.15.38:0/3736150326 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd20802c450 con 0x7fd1f006cc60 2024-09-13T18:27:43.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:43.737+0000 7fd20ce4a640 1 -- 172.21.15.38:0/3736150326 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd1f006cc60 msgr2=0x7fd1f006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:43.737+0000 7fd20ce4a640 1 --2- 172.21.15.38:0/3736150326 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd1f006cc60 0x7fd1f006f120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd208100bf0 tx=0x7fd1f800b390 comp rx=0 tx=0).stop 2024-09-13T18:27:43.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:43.737+0000 7fd20ce4a640 1 -- 172.21.15.38:0/3736150326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd208100d90 msgr2=0x7fd208195a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:43.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:43.737+0000 7fd20ce4a640 1 --2- 172.21.15.38:0/3736150326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd208100d90 0x7fd208195a80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0099a0 tx=0x7fd1fc0055c0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:43.737+0000 7fd20ce4a640 1 -- 172.21.15.38:0/3736150326 shutdown_connections 2024-09-13T18:27:43.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:43.737+0000 7fd20ce4a640 1 --2- 172.21.15.38:0/3736150326 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd1f006cc60 0x7fd1f006f120 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:43.737+0000 7fd20ce4a640 1 --2- 172.21.15.38:0/3736150326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd208100d90 0x7fd208195a80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:43.737+0000 7fd20ce4a640 1 --2- 172.21.15.38:0/3736150326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2080ffb90 0x7fd208195540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:43.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:43.737+0000 7fd20ce4a640 1 -- 172.21.15.38:0/3736150326 >> 172.21.15.38:0/3736150326 conn(0x7fd2080fb320 msgr2=0x7fd2081044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:43.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:43.737+0000 7fd20ce4a640 1 -- 172.21.15.38:0/3736150326 shutdown_connections 2024-09-13T18:27:43.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:43.737+0000 7fd20ce4a640 1 -- 172.21.15.38:0/3736150326 wait complete. 2024-09-13T18:27:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:43 smithi149 ceph-mon[35845]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:27:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:43 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T18:27:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:43 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T18:27:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:43 smithi149 ceph-mon[35845]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T18:27:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:43 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T18:27:44.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:43 smithi149 ceph-mon[35845]: pgmap v174: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:44.068 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:43 smithi038 ceph-mon[27689]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:27:44.068 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:43 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T18:27:44.068 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:43 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T18:27:44.068 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:43 smithi038 ceph-mon[27689]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T18:27:44.069 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:43 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T18:27:44.069 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:43 smithi038 ceph-mon[27689]: pgmap v174: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:44.069 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:43 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038[27685]: 2024-09-13T18:27:43.710+0000 7f6764c8b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:27:44.396 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T18:27:44.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T18:27:44.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T18:27:44.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T18:27:44.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T18:27:44.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:27:44.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T18:27:44.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T18:27:44.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T18:27:44.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: fsmap cephfs:0 2024-09-13T18:27:44.955 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: Saving service mds.cephfs spec with placement count:4 2024-09-13T18:27:44.956 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:44.956 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:27:44.956 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:44.956 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:27:44.956 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:44.956 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.ubvgaq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:27:44.956 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.ubvgaq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:27:44.956 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:44.956 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:44 smithi038 ceph-mon[27689]: Deploying daemon mds.cephfs.smithi038.ubvgaq on smithi038 2024-09-13T18:27:45.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T18:27:45.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T18:27:45.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T18:27:45.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T18:27:45.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:27:45.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T18:27:45.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T18:27:45.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T18:27:45.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: fsmap cephfs:0 2024-09-13T18:27:45.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: Saving service mds.cephfs spec with placement count:4 2024-09-13T18:27:45.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:45.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:27:45.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:45.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:27:45.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:45.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.ubvgaq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:27:45.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.ubvgaq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:27:45.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:45.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:44 smithi149 ceph-mon[35845]: Deploying daemon mds.cephfs.smithi038.ubvgaq on smithi038 2024-09-13T18:27:45.671 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:45.844 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:45 smithi038 ceph-mon[27689]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T18:27:45.844 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:45 smithi038 ceph-mon[27689]: pgmap v178: 65 pgs: 16 creating+peering, 23 unknown, 26 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:46.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:45 smithi149 ceph-mon[35845]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T18:27:46.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:45 smithi149 ceph-mon[35845]: pgmap v178: 65 pgs: 16 creating+peering, 23 unknown, 26 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:46.792 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:46 smithi038 ceph-mon[27689]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T18:27:46.793 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:46 smithi038 ceph-mon[27689]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T18:27:47.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:46 smithi149 ceph-mon[35845]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T18:27:47.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:46 smithi149 ceph-mon[35845]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T18:27:47.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.451+0000 7f3d293fa640 1 -- 172.21.15.38:0/2121847841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d240ffcf0 msgr2=0x7f3d24100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.451+0000 7f3d293fa640 1 --2- 172.21.15.38:0/2121847841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d240ffcf0 0x7f3d24100170 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009880 tx=0x7f3d1802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.451+0000 7f3d293fa640 1 -- 172.21.15.38:0/2121847841 shutdown_connections 2024-09-13T18:27:47.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.451+0000 7f3d293fa640 1 --2- 172.21.15.38:0/2121847841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d240ffcf0 0x7f3d24100170 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.451+0000 7f3d293fa640 1 --2- 172.21.15.38:0/2121847841 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d240feaf0 0x7f3d240feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.451+0000 7f3d293fa640 1 -- 172.21.15.38:0/2121847841 >> 172.21.15.38:0/2121847841 conn(0x7f3d240fa280 msgr2=0x7f3d240fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:47.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.451+0000 7f3d293fa640 1 -- 172.21.15.38:0/2121847841 shutdown_connections 2024-09-13T18:27:47.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.451+0000 7f3d293fa640 1 -- 172.21.15.38:0/2121847841 wait complete. 2024-09-13T18:27:47.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.451+0000 7f3d293fa640 1 Processor -- start 2024-09-13T18:27:47.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.451+0000 7f3d293fa640 1 -- start start 2024-09-13T18:27:47.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d293fa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d240feaf0 0x7f3d241955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d293fa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d240ffcf0 0x7f3d24195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d293fa640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d241960b0 con 0x7f3d240feaf0 2024-09-13T18:27:47.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d293fa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24196220 con 0x7f3d240ffcf0 2024-09-13T18:27:47.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d22ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d240feaf0 0x7f3d241955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d22ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d240feaf0 0x7f3d241955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55660/0 (socket says 172.21.15.38:55660) 2024-09-13T18:27:47.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d22ffd640 1 -- 172.21.15.38:0/562516737 learned_addr learned my addr 172.21.15.38:0/562516737 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:47.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d22ffd640 1 -- 172.21.15.38:0/562516737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d240ffcf0 msgr2=0x7f3d24195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d22ffd640 1 --2- 172.21.15.38:0/562516737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d240ffcf0 0x7f3d24195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.600 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d22ffd640 1 -- 172.21.15.38:0/562516737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d18009560 con 0x7f3d240feaf0 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d22ffd640 1 --2- 172.21.15.38:0/562516737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d240feaf0 0x7f3d241955a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400e970 tx=0x7f3d1400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d0bfff640 1 -- 172.21.15.38:0/562516737 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d140096e0 con 0x7f3d240feaf0 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d0bfff640 1 -- 172.21.15.38:0/562516737 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d140044d0 con 0x7f3d240feaf0 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d293fa640 1 -- 172.21.15.38:0/562516737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2419acc0 con 0x7f3d240feaf0 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.452+0000 7f3d0bfff640 1 -- 172.21.15.38:0/562516737 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d14003e70 con 0x7f3d240feaf0 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.453+0000 7f3d293fa640 1 -- 172.21.15.38:0/562516737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2419b210 con 0x7f3d240feaf0 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.454+0000 7f3d293fa640 1 -- 172.21.15.38:0/562516737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d241075c0 con 0x7f3d240feaf0 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.454+0000 7f3d0bfff640 1 -- 172.21.15.38:0/562516737 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3d14004030 con 0x7f3d240feaf0 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.454+0000 7f3d0bfff640 1 --2- 172.21.15.38:0/562516737 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3d0c06cc50 0x7f3d0c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.455+0000 7f3d0bfff640 1 -- 172.21.15.38:0/562516737 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f3d14014070 con 0x7f3d240feaf0 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.455+0000 7f3d227fc640 1 --2- 172.21.15.38:0/562516737 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3d0c06cc50 0x7f3d0c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.455+0000 7f3d227fc640 1 --2- 172.21.15.38:0/562516737 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3d0c06cc50 0x7f3d0c06f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d1802a9c0 tx=0x7f3d18000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:47.601 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.459+0000 7f3d0bfff640 1 -- 172.21.15.38:0/562516737 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3d14056c20 con 0x7f3d240feaf0 2024-09-13T18:27:47.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.667+0000 7f3d293fa640 1 -- 172.21.15.38:0/562516737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3d2419b460 con 0x7f3d240feaf0 2024-09-13T18:27:47.670 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.667+0000 7f3d0bfff640 1 -- 172.21.15.38:0/562516737 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1114 (secure 0 0 0) 0x7f3d1405a240 con 0x7f3d240feaf0 2024-09-13T18:27:47.670 INFO:teuthology.orchestra.run.smithi038.stdout:e2 2024-09-13T18:27:47.670 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:27:47.670 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:27:47.670 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:27:47.670 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:27:47.670 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 2 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:27:43.711644+0000 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:27:47.671 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 0 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 1 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:in 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:up {} 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 0 2024-09-13T18:27:47.672 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:27:47.673 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:27:47.673 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 2 2024-09-13T18:27:47.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.669+0000 7f3d293fa640 1 -- 172.21.15.38:0/562516737 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3d0c06cc50 msgr2=0x7f3d0c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.669+0000 7f3d293fa640 1 --2- 172.21.15.38:0/562516737 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3d0c06cc50 0x7f3d0c06f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d1802a9c0 tx=0x7f3d18000bc0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.673 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.669+0000 7f3d293fa640 1 -- 172.21.15.38:0/562516737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d240feaf0 msgr2=0x7f3d241955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:47.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.669+0000 7f3d293fa640 1 --2- 172.21.15.38:0/562516737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d240feaf0 0x7f3d241955a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400e970 tx=0x7f3d1400ee30 comp rx=0 tx=0).stop 2024-09-13T18:27:47.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.669+0000 7f3d293fa640 1 -- 172.21.15.38:0/562516737 shutdown_connections 2024-09-13T18:27:47.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.669+0000 7f3d293fa640 1 --2- 172.21.15.38:0/562516737 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3d0c06cc50 0x7f3d0c06f110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.669+0000 7f3d293fa640 1 --2- 172.21.15.38:0/562516737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d240ffcf0 0x7f3d24195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.669+0000 7f3d293fa640 1 --2- 172.21.15.38:0/562516737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3d240feaf0 0x7f3d241955a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:47.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.669+0000 7f3d293fa640 1 -- 172.21.15.38:0/562516737 >> 172.21.15.38:0/562516737 conn(0x7f3d240fa280 msgr2=0x7f3d240fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:47.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.670+0000 7f3d293fa640 1 -- 172.21.15.38:0/562516737 shutdown_connections 2024-09-13T18:27:47.674 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:47.670+0000 7f3d293fa640 1 -- 172.21.15.38:0/562516737 wait complete. 2024-09-13T18:27:48.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:47 smithi149 ceph-mon[35845]: pgmap v180: 65 pgs: 16 creating+peering, 10 unknown, 39 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:48.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:47 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/562516737' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:27:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:47 smithi038 ceph-mon[27689]: pgmap v180: 65 pgs: 16 creating+peering, 10 unknown, 39 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:47 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/562516737' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:27:48.318 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T18:27:48.328 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:27:48.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-13T18:27:48.546 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:49.637 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:49.637 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:49.637 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:49.637 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.doanhj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:27:49.637 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.doanhj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:27:49.638 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:49.638 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: Deploying daemon mds.cephfs.smithi149.doanhj on smithi149 2024-09-13T18:27:49.638 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.38:6826/1032191718,v1:172.21.15.38:6827/1032191718] up:boot 2024-09-13T18:27:49.638 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: daemon mds.cephfs.smithi038.ubvgaq assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T18:27:49.638 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T18:27:49.638 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T18:27:49.638 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: Cluster is now healthy 2024-09-13T18:27:49.638 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: fsmap cephfs:0 1 up:standby 2024-09-13T18:27:49.638 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:27:49.638 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:creating} 2024-09-13T18:27:49.638 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: daemon mds.cephfs.smithi038.ubvgaq is now active in filesystem cephfs as rank 0 2024-09-13T18:27:49.638 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:49 smithi038 ceph-mon[27689]: pgmap v181: 65 pgs: 8 creating+peering, 57 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:49.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.doanhj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.doanhj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: Deploying daemon mds.cephfs.smithi149.doanhj on smithi149 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.38:6826/1032191718,v1:172.21.15.38:6827/1032191718] up:boot 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: daemon mds.cephfs.smithi038.ubvgaq assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: Cluster is now healthy 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: fsmap cephfs:0 1 up:standby 2024-09-13T18:27:49.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:27:49.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:creating} 2024-09-13T18:27:49.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: daemon mds.cephfs.smithi038.ubvgaq is now active in filesystem cephfs as rank 0 2024-09-13T18:27:49.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:49 smithi149 ceph-mon[35845]: pgmap v181: 65 pgs: 8 creating+peering, 57 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:27:50.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.117+0000 7fd28fcc2640 1 -- 172.21.15.38:0/740677268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880feaf0 msgr2=0x7fd2880feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.117+0000 7fd28fcc2640 1 --2- 172.21.15.38:0/740677268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880feaf0 0x7fd2880feef0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd284009880 tx=0x7fd28402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.132 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.117+0000 7fd28fcc2640 1 -- 172.21.15.38:0/740677268 shutdown_connections 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.117+0000 7fd28fcc2640 1 --2- 172.21.15.38:0/740677268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2880ffcf0 0x7fd288100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.117+0000 7fd28fcc2640 1 --2- 172.21.15.38:0/740677268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880feaf0 0x7fd2880feef0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.117+0000 7fd28fcc2640 1 -- 172.21.15.38:0/740677268 >> 172.21.15.38:0/740677268 conn(0x7fd2880fa280 msgr2=0x7fd2880fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.117+0000 7fd28fcc2640 1 -- 172.21.15.38:0/740677268 shutdown_connections 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.117+0000 7fd28fcc2640 1 -- 172.21.15.38:0/740677268 wait complete. 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28fcc2640 1 Processor -- start 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28fcc2640 1 -- start start 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28fcc2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880feaf0 0x7fd288102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28fcc2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2880ffcf0 0x7fd2881010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28fcc2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd288101610 con 0x7fd2880feaf0 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28fcc2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd288101780 con 0x7fd2880ffcf0 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28da5e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880feaf0 0x7fd288102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28da5e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880feaf0 0x7fd288102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55708/0 (socket says 172.21.15.38:55708) 2024-09-13T18:27:50.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28da5e640 1 -- 172.21.15.38:0/4191137254 learned_addr learned my addr 172.21.15.38:0/4191137254 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28d25d640 1 --2- 172.21.15.38:0/4191137254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2880ffcf0 0x7fd2881010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28da5e640 1 -- 172.21.15.38:0/4191137254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2880ffcf0 msgr2=0x7fd2881010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28da5e640 1 --2- 172.21.15.38:0/4191137254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2880ffcf0 0x7fd2881010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28da5e640 1 -- 172.21.15.38:0/4191137254 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284009560 con 0x7fd2880feaf0 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.118+0000 7fd28da5e640 1 --2- 172.21.15.38:0/4191137254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880feaf0 0x7fd288102a80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd2840054f0 tx=0x7fd284005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.119+0000 7fd27effd640 1 -- 172.21.15.38:0/4191137254 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd284004aa0 con 0x7fd2880feaf0 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.119+0000 7fd28fcc2640 1 -- 172.21.15.38:0/4191137254 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd288101a00 con 0x7fd2880feaf0 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.119+0000 7fd27effd640 1 -- 172.21.15.38:0/4191137254 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd284004c00 con 0x7fd2880feaf0 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.119+0000 7fd27effd640 1 -- 172.21.15.38:0/4191137254 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2840319f0 con 0x7fd2880feaf0 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.119+0000 7fd28fcc2640 1 -- 172.21.15.38:0/4191137254 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd288101ef0 con 0x7fd2880feaf0 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.120+0000 7fd28fcc2640 1 -- 172.21.15.38:0/4191137254 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2880feef0 con 0x7fd2880feaf0 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.120+0000 7fd27effd640 1 -- 172.21.15.38:0/4191137254 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd284003c90 con 0x7fd2880feaf0 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.121+0000 7fd27effd640 1 --2- 172.21.15.38:0/4191137254 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd27406cc50 0x7fd27406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.121+0000 7fd27effd640 1 -- 172.21.15.38:0/4191137254 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd2840ad380 con 0x7fd2880feaf0 2024-09-13T18:27:50.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.121+0000 7fd28d25d640 1 --2- 172.21.15.38:0/4191137254 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd27406cc50 0x7fd27406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:50.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.121+0000 7fd28d25d640 1 --2- 172.21.15.38:0/4191137254 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd27406cc50 0x7fd27406f110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd288102800 tx=0x7fd27800b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:50.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.125+0000 7fd27effd640 1 -- 172.21.15.38:0/4191137254 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd284077800 con 0x7fd2880feaf0 2024-09-13T18:27:50.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.366+0000 7fd28fcc2640 1 -- 172.21.15.38:0/4191137254 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fd28819d830 con 0x7fd2880feaf0 2024-09-13T18:27:50.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.752+0000 7fd27effd640 1 -- 172.21.15.38:0/4191137254 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fd28407ae20 con 0x7fd2880feaf0 2024-09-13T18:27:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.754+0000 7fd28fcc2640 1 -- 172.21.15.38:0/4191137254 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd27406cc50 msgr2=0x7fd27406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.754+0000 7fd28fcc2640 1 --2- 172.21.15.38:0/4191137254 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd27406cc50 0x7fd27406f110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd288102800 tx=0x7fd27800b390 comp rx=0 tx=0).stop 2024-09-13T18:27:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.754+0000 7fd28fcc2640 1 -- 172.21.15.38:0/4191137254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880feaf0 msgr2=0x7fd288102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.754+0000 7fd28fcc2640 1 --2- 172.21.15.38:0/4191137254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880feaf0 0x7fd288102a80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd2840054f0 tx=0x7fd284005520 comp rx=0 tx=0).stop 2024-09-13T18:27:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.754+0000 7fd28fcc2640 1 -- 172.21.15.38:0/4191137254 shutdown_connections 2024-09-13T18:27:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.754+0000 7fd28fcc2640 1 --2- 172.21.15.38:0/4191137254 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd27406cc50 0x7fd27406f110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.754+0000 7fd28fcc2640 1 --2- 172.21.15.38:0/4191137254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2880ffcf0 0x7fd2881010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.754+0000 7fd28fcc2640 1 --2- 172.21.15.38:0/4191137254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2880feaf0 0x7fd288102a80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.754+0000 7fd28fcc2640 1 -- 172.21.15.38:0/4191137254 >> 172.21.15.38:0/4191137254 conn(0x7fd2880fa280 msgr2=0x7fd288067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.754+0000 7fd28fcc2640 1 -- 172.21.15.38:0/4191137254 shutdown_connections 2024-09-13T18:27:50.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:50.754+0000 7fd28fcc2640 1 -- 172.21.15.38:0/4191137254 wait complete. 2024-09-13T18:27:51.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:50 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.38:6826/1032191718,v1:172.21.15.38:6827/1032191718] up:active 2024-09-13T18:27:51.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:50 smithi149 ceph-mon[35845]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 2024-09-13T18:27:51.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:50 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/4191137254' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T18:27:51.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:50 smithi149 ceph-mon[35845]: daemon mds.cephfs.smithi149.doanhj assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T18:27:51.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:50 smithi149 ceph-mon[35845]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T18:27:51.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:50 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/4191137254' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T18:27:51.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:50 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] up:boot 2024-09-13T18:27:51.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:50 smithi149 ceph-mon[35845]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:creating} 2024-09-13T18:27:51.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:50 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:27:51.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:50 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.38:6826/1032191718,v1:172.21.15.38:6827/1032191718] up:active 2024-09-13T18:27:51.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:50 smithi038 ceph-mon[27689]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 2024-09-13T18:27:51.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:50 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/4191137254' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T18:27:51.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:50 smithi038 ceph-mon[27689]: daemon mds.cephfs.smithi149.doanhj assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T18:27:51.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:50 smithi038 ceph-mon[27689]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T18:27:51.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:50 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/4191137254' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T18:27:51.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:50 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] up:boot 2024-09-13T18:27:51.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:50 smithi038 ceph-mon[27689]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:creating} 2024-09-13T18:27:51.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:50 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:27:51.450 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T18:27:51.460 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:27:51.460 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-13T18:27:51.949 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:51 smithi038 ceph-mon[27689]: daemon mds.cephfs.smithi149.doanhj is now active in filesystem cephfs as rank 1 2024-09-13T18:27:51.949 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:51 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:51.949 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:51 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:51.949 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:51 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:51.949 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:51 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.dtnkqo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:27:51.949 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:51 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.dtnkqo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:27:51.949 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:51 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:51.949 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:51 smithi038 ceph-mon[27689]: Deploying daemon mds.cephfs.smithi038.dtnkqo on smithi038 2024-09-13T18:27:51.950 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:51 smithi038 ceph-mon[27689]: pgmap v182: 65 pgs: 65 active+clean; 578 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 818 B/s wr, 2 op/s 2024-09-13T18:27:52.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:51 smithi149 ceph-mon[35845]: daemon mds.cephfs.smithi149.doanhj is now active in filesystem cephfs as rank 1 2024-09-13T18:27:52.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:51 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:52.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:51 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:52.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:51 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:52.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:51 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.dtnkqo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:27:52.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:51 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.dtnkqo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:27:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:51 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:51 smithi149 ceph-mon[35845]: Deploying daemon mds.cephfs.smithi038.dtnkqo on smithi038 2024-09-13T18:27:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:51 smithi149 ceph-mon[35845]: pgmap v182: 65 pgs: 65 active+clean; 578 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 818 B/s wr, 2 op/s 2024-09-13T18:27:52.306 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:53.061 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:52 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] up:active 2024-09-13T18:27:53.061 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:52 smithi038 ceph-mon[27689]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:active} 2024-09-13T18:27:53.117 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:52 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] up:active 2024-09-13T18:27:53.117 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:52 smithi149 ceph-mon[35845]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:active} 2024-09-13T18:27:54.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:53 smithi038 ceph-mon[27689]: pgmap v183: 65 pgs: 65 active+clean; 578 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 722 B/s wr, 4 op/s 2024-09-13T18:27:54.082 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:53 smithi149 ceph-mon[35845]: pgmap v183: 65 pgs: 65 active+clean; 578 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 722 B/s wr, 4 op/s 2024-09-13T18:27:54.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.909+0000 7fbc1edc4640 1 -- 172.21.15.38:0/4126112506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc18100d80 msgr2=0x7fbc18101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.909+0000 7fbc1edc4640 1 --2- 172.21.15.38:0/4126112506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc18100d80 0x7fbc18101200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009880 tx=0x7fbc0402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.909+0000 7fbc1edc4640 1 -- 172.21.15.38:0/4126112506 shutdown_connections 2024-09-13T18:27:54.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.909+0000 7fbc1edc4640 1 --2- 172.21.15.38:0/4126112506 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc18100d80 0x7fbc18101200 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.909+0000 7fbc1edc4640 1 --2- 172.21.15.38:0/4126112506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc180ffb80 0x7fbc180fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.909+0000 7fbc1edc4640 1 -- 172.21.15.38:0/4126112506 >> 172.21.15.38:0/4126112506 conn(0x7fbc180fb330 msgr2=0x7fbc180fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:54.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.909+0000 7fbc1edc4640 1 -- 172.21.15.38:0/4126112506 shutdown_connections 2024-09-13T18:27:54.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.909+0000 7fbc1edc4640 1 -- 172.21.15.38:0/4126112506 wait complete. 2024-09-13T18:27:54.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc1edc4640 1 Processor -- start 2024-09-13T18:27:54.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc1edc4640 1 -- start start 2024-09-13T18:27:54.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc1edc4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc180ffb80 0x7fbc181954f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc1edc4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc18100d80 0x7fbc18195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc1edc4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18195f70 con 0x7fbc180ffb80 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc1edc4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc181960e0 con 0x7fbc18100d80 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc1cb60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc180ffb80 0x7fbc181954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc1cb60640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc180ffb80 0x7fbc181954f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53412/0 (socket says 172.21.15.38:53412) 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc1cb60640 1 -- 172.21.15.38:0/2667754524 learned_addr learned my addr 172.21.15.38:0/2667754524 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc17fff640 1 --2- 172.21.15.38:0/2667754524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc18100d80 0x7fbc18195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc1cb60640 1 -- 172.21.15.38:0/2667754524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc18100d80 msgr2=0x7fbc18195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc1cb60640 1 --2- 172.21.15.38:0/2667754524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc18100d80 0x7fbc18195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.910+0000 7fbc1cb60640 1 -- 172.21.15.38:0/2667754524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc04009560 con 0x7fbc180ffb80 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.911+0000 7fbc1cb60640 1 --2- 172.21.15.38:0/2667754524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc180ffb80 0x7fbc181954f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00c8f0 tx=0x7fbc0c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.911+0000 7fbc15ffb640 1 -- 172.21.15.38:0/2667754524 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc0c0041f0 con 0x7fbc180ffb80 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.911+0000 7fbc15ffb640 1 -- 172.21.15.38:0/2667754524 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbc0c007df0 con 0x7fbc180ffb80 2024-09-13T18:27:54.916 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.911+0000 7fbc1edc4640 1 -- 172.21.15.38:0/2667754524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1819abc0 con 0x7fbc180ffb80 2024-09-13T18:27:54.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.911+0000 7fbc15ffb640 1 -- 172.21.15.38:0/2667754524 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc0c00f450 con 0x7fbc180ffb80 2024-09-13T18:27:54.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.911+0000 7fbc1edc4640 1 -- 172.21.15.38:0/2667754524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1819b0c0 con 0x7fbc180ffb80 2024-09-13T18:27:54.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.912+0000 7fbc1edc4640 1 -- 172.21.15.38:0/2667754524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc18108630 con 0x7fbc180ffb80 2024-09-13T18:27:54.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.913+0000 7fbc15ffb640 1 -- 172.21.15.38:0/2667754524 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbc0c007950 con 0x7fbc180ffb80 2024-09-13T18:27:54.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.913+0000 7fbc15ffb640 1 --2- 172.21.15.38:0/2667754524 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbc0806cc50 0x7fbc0806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:54.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.913+0000 7fbc17fff640 1 --2- 172.21.15.38:0/2667754524 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbc0806cc50 0x7fbc0806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:54.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.913+0000 7fbc15ffb640 1 -- 172.21.15.38:0/2667754524 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fbc0c013070 con 0x7fbc180ffb80 2024-09-13T18:27:54.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.914+0000 7fbc17fff640 1 --2- 172.21.15.38:0/2667754524 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbc0806cc50 0x7fbc0806f110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbc18196a10 tx=0x7fbc04031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:54.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:54.918+0000 7fbc15ffb640 1 -- 172.21.15.38:0/2667754524 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbc0c056690 con 0x7fbc180ffb80 2024-09-13T18:27:55.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.127+0000 7fbc1edc4640 1 -- 172.21.15.38:0/2667754524 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fbc18108880 con 0x7fbc180ffb80 2024-09-13T18:27:55.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:55 smithi038 ceph-mon[27689]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T18:27:55.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:55 smithi038 ceph-mon[27689]: Cluster is now healthy 2024-09-13T18:27:55.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:55 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] up:boot 2024-09-13T18:27:55.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:55 smithi038 ceph-mon[27689]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:active} 1 up:standby 2024-09-13T18:27:55.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dtnkqo"}]: dispatch 2024-09-13T18:27:55.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:55 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2667754524' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T18:27:55.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:55 smithi149 ceph-mon[35845]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T18:27:55.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:55 smithi149 ceph-mon[35845]: Cluster is now healthy 2024-09-13T18:27:55.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:55 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] up:boot 2024-09-13T18:27:55.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:55 smithi149 ceph-mon[35845]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:active} 1 up:standby 2024-09-13T18:27:55.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:55 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dtnkqo"}]: dispatch 2024-09-13T18:27:55.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:55 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/2667754524' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T18:27:55.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.753+0000 7fbc15ffb640 1 -- 172.21.15.38:0/2667754524 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7fbc0c059cb0 con 0x7fbc180ffb80 2024-09-13T18:27:55.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.756+0000 7fbc1edc4640 1 -- 172.21.15.38:0/2667754524 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbc0806cc50 msgr2=0x7fbc0806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:55.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.756+0000 7fbc1edc4640 1 --2- 172.21.15.38:0/2667754524 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbc0806cc50 0x7fbc0806f110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbc18196a10 tx=0x7fbc04031400 comp rx=0 tx=0).stop 2024-09-13T18:27:55.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.756+0000 7fbc1edc4640 1 -- 172.21.15.38:0/2667754524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc180ffb80 msgr2=0x7fbc181954f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:55.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.756+0000 7fbc1edc4640 1 --2- 172.21.15.38:0/2667754524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc180ffb80 0x7fbc181954f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00c8f0 tx=0x7fbc0c00cdb0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.756+0000 7fbc1edc4640 1 -- 172.21.15.38:0/2667754524 shutdown_connections 2024-09-13T18:27:55.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.756+0000 7fbc1edc4640 1 --2- 172.21.15.38:0/2667754524 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbc0806cc50 0x7fbc0806f110 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.756+0000 7fbc1edc4640 1 --2- 172.21.15.38:0/2667754524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc18100d80 0x7fbc18195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.756+0000 7fbc1edc4640 1 --2- 172.21.15.38:0/2667754524 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbc180ffb80 0x7fbc181954f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:55.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.756+0000 7fbc1edc4640 1 -- 172.21.15.38:0/2667754524 >> 172.21.15.38:0/2667754524 conn(0x7fbc180fb330 msgr2=0x7fbc18103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:55.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.756+0000 7fbc1edc4640 1 -- 172.21.15.38:0/2667754524 shutdown_connections 2024-09-13T18:27:55.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:55.756+0000 7fbc1edc4640 1 -- 172.21.15.38:0/2667754524 wait complete. 2024-09-13T18:27:56.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:56.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:56.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:56.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.zdzwzb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:27:56.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.zdzwzb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:27:56.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:56.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:56 smithi038 ceph-mon[27689]: Deploying daemon mds.cephfs.smithi149.zdzwzb on smithi149 2024-09-13T18:27:56.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:27:56.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:56 smithi038 ceph-mon[27689]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s wr, 7 op/s 2024-09-13T18:27:56.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:56.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:56 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2667754524' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T18:27:56.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:56 smithi038 ceph-mon[27689]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 2024-09-13T18:27:56.396 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T18:27:56.406 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:27:56.406 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-13T18:27:56.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:56.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:56.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:56.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.zdzwzb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:27:56.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.zdzwzb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:27:56.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:27:56.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:56 smithi149 ceph-mon[35845]: Deploying daemon mds.cephfs.smithi149.zdzwzb on smithi149 2024-09-13T18:27:56.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:27:56.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:56 smithi149 ceph-mon[35845]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s wr, 7 op/s 2024-09-13T18:27:56.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:56.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:56 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/2667754524' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T18:27:56.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:56 smithi149 ceph-mon[35845]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 2024-09-13T18:27:56.618 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:27:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.219+0000 7f07b132a640 1 -- 172.21.15.38:0/155816844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07ac102fb0 msgr2=0x7f07ac1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.219+0000 7f07b132a640 1 --2- 172.21.15.38:0/155816844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07ac102fb0 0x7f07ac1053a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f07a00098b0 tx=0x7f07a002a4d0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.219+0000 7f07b132a640 1 -- 172.21.15.38:0/155816844 shutdown_connections 2024-09-13T18:27:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.219+0000 7f07b132a640 1 --2- 172.21.15.38:0/155816844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07ac102fb0 0x7f07ac1053a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.219+0000 7f07b132a640 1 --2- 172.21.15.38:0/155816844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac100680 0x7f07ac102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.219+0000 7f07b132a640 1 -- 172.21.15.38:0/155816844 >> 172.21.15.38:0/155816844 conn(0x7f07ac0fa280 msgr2=0x7f07ac0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.219+0000 7f07b132a640 1 -- 172.21.15.38:0/155816844 shutdown_connections 2024-09-13T18:27:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.219+0000 7f07b132a640 1 -- 172.21.15.38:0/155816844 wait complete. 2024-09-13T18:27:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.220+0000 7f07b132a640 1 Processor -- start 2024-09-13T18:27:58.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.220+0000 7f07b132a640 1 -- start start 2024-09-13T18:27:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.220+0000 7f07b132a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07ac100680 0x7f07ac0fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:58.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.220+0000 7f07b132a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac102fb0 0x7f07ac0fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.220+0000 7f07b132a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0feb70 con 0x7f07ac100680 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.220+0000 7f07b132a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0fece0 con 0x7f07ac102fb0 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.220+0000 7f07aaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07ac100680 0x7f07ac0fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.220+0000 7f07aaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07ac100680 0x7f07ac0fffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53462/0 (socket says 172.21.15.38:53462) 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.220+0000 7f07aaffd640 1 -- 172.21.15.38:0/3986431347 learned_addr learned my addr 172.21.15.38:0/3986431347 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.221+0000 7f07aa7fc640 1 --2- 172.21.15.38:0/3986431347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac102fb0 0x7f07ac0fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.221+0000 7f07aaffd640 1 -- 172.21.15.38:0/3986431347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac102fb0 msgr2=0x7f07ac0fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.221+0000 7f07aaffd640 1 --2- 172.21.15.38:0/3986431347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac102fb0 0x7f07ac0fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.221+0000 7f07aaffd640 1 -- 172.21.15.38:0/3986431347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a0009560 con 0x7f07ac100680 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.221+0000 7f07aa7fc640 1 --2- 172.21.15.38:0/3986431347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac102fb0 0x7f07ac0fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.221+0000 7f07aaffd640 1 --2- 172.21.15.38:0/3986431347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07ac100680 0x7f07ac0fffe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f079c00d8d0 tx=0x7f079c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.221+0000 7f0793fff640 1 -- 172.21.15.38:0/3986431347 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f079c00bea0 con 0x7f07ac100680 2024-09-13T18:27:58.225 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.221+0000 7f0793fff640 1 -- 172.21.15.38:0/3986431347 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f079c009c00 con 0x7f07ac100680 2024-09-13T18:27:58.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.221+0000 7f07b132a640 1 -- 172.21.15.38:0/3986431347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ac0fefc0 con 0x7f07ac100680 2024-09-13T18:27:58.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.221+0000 7f0793fff640 1 -- 172.21.15.38:0/3986431347 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f079c00f680 con 0x7f07ac100680 2024-09-13T18:27:58.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.221+0000 7f07b132a640 1 -- 172.21.15.38:0/3986431347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac19d620 con 0x7f07ac100680 2024-09-13T18:27:58.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.222+0000 7f07b132a640 1 -- 172.21.15.38:0/3986431347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0798005280 con 0x7f07ac100680 2024-09-13T18:27:58.226 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.223+0000 7f0793fff640 1 -- 172.21.15.38:0/3986431347 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f079c010ae0 con 0x7f07ac100680 2024-09-13T18:27:58.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.223+0000 7f0793fff640 1 --2- 172.21.15.38:0/3986431347 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f079406cc50 0x7f079406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:27:58.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.224+0000 7f0793fff640 1 -- 172.21.15.38:0/3986431347 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f079c08bf30 con 0x7f07ac100680 2024-09-13T18:27:58.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.224+0000 7f07aa7fc640 1 --2- 172.21.15.38:0/3986431347 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f079406cc50 0x7f079406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:27:58.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.224+0000 7f07aa7fc640 1 --2- 172.21.15.38:0/3986431347 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f079406cc50 0x7f079406f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f07a0006010 tx=0x7f07a0031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:27:58.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.228+0000 7f0793fff640 1 -- 172.21.15.38:0/3986431347 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f079c059eb0 con 0x7f07ac100680 2024-09-13T18:27:58.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:58.461+0000 7f07b132a640 1 -- 172.21.15.38:0/3986431347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f07980050f0 con 0x7f07ac100680 2024-09-13T18:27:58.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:58 smithi149 ceph-mon[35845]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-13T18:27:58.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:58 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:58.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:58 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:58.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:58 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:58.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:58 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:58.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:58 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:58.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:58 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:27:58.564 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:58 smithi038 ceph-mon[27689]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-13T18:27:58.565 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:58 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:58.565 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:58 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:58.565 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:58 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:58.565 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:58 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:58.565 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:58 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:27:58.565 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:58 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:27:59.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:59.312+0000 7f0793fff640 1 -- 172.21.15.38:0/3986431347 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f079c059a40 con 0x7f07ac100680 2024-09-13T18:27:59.315 INFO:teuthology.orchestra.run.smithi038.stderr:inline data disabled 2024-09-13T18:27:59.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:59.316+0000 7f07b132a640 1 -- 172.21.15.38:0/3986431347 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f079406cc50 msgr2=0x7f079406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:59.316+0000 7f07b132a640 1 --2- 172.21.15.38:0/3986431347 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f079406cc50 0x7f079406f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f07a0006010 tx=0x7f07a0031400 comp rx=0 tx=0).stop 2024-09-13T18:27:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:59.316+0000 7f07b132a640 1 -- 172.21.15.38:0/3986431347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07ac100680 msgr2=0x7f07ac0fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:27:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:59.316+0000 7f07b132a640 1 --2- 172.21.15.38:0/3986431347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07ac100680 0x7f07ac0fffe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f079c00d8d0 tx=0x7f079c00dd90 comp rx=0 tx=0).stop 2024-09-13T18:27:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:59.316+0000 7f07b132a640 1 -- 172.21.15.38:0/3986431347 shutdown_connections 2024-09-13T18:27:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:59.316+0000 7f07b132a640 1 --2- 172.21.15.38:0/3986431347 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f079406cc50 0x7f079406f110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:59.316+0000 7f07b132a640 1 --2- 172.21.15.38:0/3986431347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07ac102fb0 0x7f07ac0fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:59.316+0000 7f07b132a640 1 --2- 172.21.15.38:0/3986431347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f07ac100680 0x7f07ac0fffe0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:27:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:59.316+0000 7f07b132a640 1 -- 172.21.15.38:0/3986431347 >> 172.21.15.38:0/3986431347 conn(0x7f07ac0fa280 msgr2=0x7f07ac0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:27:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:59.316+0000 7f07b132a640 1 -- 172.21.15.38:0/3986431347 shutdown_connections 2024-09-13T18:27:59.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:27:59.316+0000 7f07b132a640 1 -- 172.21.15.38:0/3986431347 wait complete. 2024-09-13T18:27:59.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:59 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] up:boot 2024-09-13T18:27:59.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:59 smithi149 ceph-mon[35845]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T18:27:59.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:59 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:27:59.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:59 smithi149 ceph-mon[35845]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:active} 2 up:standby-replay 2024-09-13T18:27:59.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:27:59 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/3986431347' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-13T18:27:59.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:59 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] up:boot 2024-09-13T18:27:59.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:59 smithi038 ceph-mon[27689]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T18:27:59.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:59 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:27:59.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:59 smithi038 ceph-mon[27689]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:active} 2 up:standby-replay 2024-09-13T18:27:59.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:27:59 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3986431347' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-13T18:27:59.976 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T18:27:59.986 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:27:59.986 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T18:28:00.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-13T18:28:00.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3986431347' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-13T18:28:00.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] up:active 2024-09-13T18:28:00.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] up:standby-replay 2024-09-13T18:28:00.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: Dropping low affinity active daemon mds.cephfs.smithi038.ubvgaq in favor of higher affinity standby. 2024-09-13T18:28:00.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: Replacing daemon mds.cephfs.smithi038.ubvgaq as rank 0 with standby daemon mds.cephfs.smithi038.dtnkqo 2024-09-13T18:28:00.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T18:28:00.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:active} 2 up:standby-replay 2024-09-13T18:28:00.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T18:28:00.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: fsmap cephfs:2/2 {0=cephfs.smithi038.dtnkqo=up:replay,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 2024-09-13T18:28:00.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:00.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:00.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:00.760 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:28:00.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-13T18:28:00.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/3986431347' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-13T18:28:00.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] up:active 2024-09-13T18:28:00.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] up:standby-replay 2024-09-13T18:28:00.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: Dropping low affinity active daemon mds.cephfs.smithi038.ubvgaq in favor of higher affinity standby. 2024-09-13T18:28:00.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: Replacing daemon mds.cephfs.smithi038.ubvgaq as rank 0 with standby daemon mds.cephfs.smithi038.dtnkqo 2024-09-13T18:28:00.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T18:28:00.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi149.doanhj=up:active} 2 up:standby-replay 2024-09-13T18:28:00.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T18:28:00.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: fsmap cephfs:2/2 {0=cephfs.smithi038.dtnkqo=up:replay,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 2024-09-13T18:28:00.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:00.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:00.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:00 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:01.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:01 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] up:boot 2024-09-13T18:28:01.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:01 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] up:resolve 2024-09-13T18:28:01.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:01 smithi038 ceph-mon[27689]: fsmap cephfs:2/2 {0=cephfs.smithi038.dtnkqo=up:resolve,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T18:28:01.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:28:01.643 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:01 smithi038 ceph-mon[27689]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-13T18:28:01.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:01 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] up:boot 2024-09-13T18:28:01.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:01 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] up:resolve 2024-09-13T18:28:01.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:01 smithi149 ceph-mon[35845]: fsmap cephfs:2/2 {0=cephfs.smithi038.dtnkqo=up:resolve,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T18:28:01.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:01 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:28:01.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:01 smithi149 ceph-mon[35845]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-13T18:28:02.764 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:02 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] up:reconnect 2024-09-13T18:28:02.764 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:02 smithi038 ceph-mon[27689]: fsmap cephfs:2/2 {0=cephfs.smithi038.dtnkqo=up:reconnect,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T18:28:02.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:02 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] up:reconnect 2024-09-13T18:28:02.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:02 smithi149 ceph-mon[35845]: fsmap cephfs:2/2 {0=cephfs.smithi038.dtnkqo=up:reconnect,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T18:28:03.672 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:03 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] up:rejoin 2024-09-13T18:28:03.672 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:03 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] up:standby-replay 2024-09-13T18:28:03.672 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:03 smithi038 ceph-mon[27689]: fsmap cephfs:2/2 {0=cephfs.smithi038.dtnkqo=up:rejoin,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T18:28:03.672 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:03 smithi038 ceph-mon[27689]: daemon mds.cephfs.smithi038.dtnkqo is now active in filesystem cephfs as rank 0 2024-09-13T18:28:03.673 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:03 smithi038 ceph-mon[27689]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-13T18:28:03.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:03 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] up:rejoin 2024-09-13T18:28:03.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:03 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] up:standby-replay 2024-09-13T18:28:03.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:03 smithi149 ceph-mon[35845]: fsmap cephfs:2/2 {0=cephfs.smithi038.dtnkqo=up:rejoin,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T18:28:03.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:03 smithi149 ceph-mon[35845]: daemon mds.cephfs.smithi038.dtnkqo is now active in filesystem cephfs as rank 0 2024-09-13T18:28:03.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:03 smithi149 ceph-mon[35845]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-13T18:28:04.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.280+0000 7fb58d500640 1 -- 172.21.15.38:0/3091713855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb588100d90 msgr2=0x7fb588101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:04.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.280+0000 7fb58d500640 1 --2- 172.21.15.38:0/3091713855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb588100d90 0x7fb588101210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009880 tx=0x7fb57c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.280+0000 7fb58d500640 1 -- 172.21.15.38:0/3091713855 shutdown_connections 2024-09-13T18:28:04.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.280+0000 7fb58d500640 1 --2- 172.21.15.38:0/3091713855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb588100d90 0x7fb588101210 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.280+0000 7fb58d500640 1 --2- 172.21.15.38:0/3091713855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5880ffb90 0x7fb5880fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.280+0000 7fb58d500640 1 -- 172.21.15.38:0/3091713855 >> 172.21.15.38:0/3091713855 conn(0x7fb5880fb320 msgr2=0x7fb5880fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:04.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.280+0000 7fb58d500640 1 -- 172.21.15.38:0/3091713855 shutdown_connections 2024-09-13T18:28:04.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.280+0000 7fb58d500640 1 -- 172.21.15.38:0/3091713855 wait complete. 2024-09-13T18:28:04.283 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.281+0000 7fb58d500640 1 Processor -- start 2024-09-13T18:28:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.281+0000 7fb58d500640 1 -- start start 2024-09-13T18:28:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.281+0000 7fb58d500640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5880ffb90 0x7fb588195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.281+0000 7fb58d500640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb588100d90 0x7fb588195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.281+0000 7fb58d500640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb588195fb0 con 0x7fb588100d90 2024-09-13T18:28:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.281+0000 7fb58d500640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb588196120 con 0x7fb5880ffb90 2024-09-13T18:28:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.281+0000 7fb5867fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb588100d90 0x7fb588195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:04.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.281+0000 7fb5867fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb588100d90 0x7fb588195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45720/0 (socket says 172.21.15.38:45720) 2024-09-13T18:28:04.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.281+0000 7fb5867fc640 1 -- 172.21.15.38:0/2213867949 learned_addr learned my addr 172.21.15.38:0/2213867949 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:04.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.281+0000 7fb586ffd640 1 --2- 172.21.15.38:0/2213867949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5880ffb90 0x7fb588195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:04.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.282+0000 7fb5867fc640 1 -- 172.21.15.38:0/2213867949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5880ffb90 msgr2=0x7fb588195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:04.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.282+0000 7fb5867fc640 1 --2- 172.21.15.38:0/2213867949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5880ffb90 0x7fb588195530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.282+0000 7fb5867fc640 1 -- 172.21.15.38:0/2213867949 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c009560 con 0x7fb588100d90 2024-09-13T18:28:04.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.282+0000 7fb5867fc640 1 --2- 172.21.15.38:0/2213867949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb588100d90 0x7fb588195a70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0099a0 tx=0x7fb57c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:04.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.282+0000 7fb56ffff640 1 -- 172.21.15.38:0/2213867949 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb57c004b20 con 0x7fb588100d90 2024-09-13T18:28:04.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.282+0000 7fb58d500640 1 -- 172.21.15.38:0/2213867949 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58819aba0 con 0x7fb588100d90 2024-09-13T18:28:04.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.282+0000 7fb56ffff640 1 -- 172.21.15.38:0/2213867949 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb57c004c80 con 0x7fb588100d90 2024-09-13T18:28:04.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.282+0000 7fb56ffff640 1 -- 172.21.15.38:0/2213867949 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb57c031a00 con 0x7fb588100d90 2024-09-13T18:28:04.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.282+0000 7fb58d500640 1 -- 172.21.15.38:0/2213867949 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58819b0c0 con 0x7fb588100d90 2024-09-13T18:28:04.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.283+0000 7fb58d500640 1 -- 172.21.15.38:0/2213867949 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58818f5d0 con 0x7fb588100d90 2024-09-13T18:28:04.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.284+0000 7fb56ffff640 1 -- 172.21.15.38:0/2213867949 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb57c031cc0 con 0x7fb588100d90 2024-09-13T18:28:04.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.284+0000 7fb56ffff640 1 --2- 172.21.15.38:0/2213867949 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb57006cc60 0x7fb57006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:04.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.284+0000 7fb56ffff640 1 -- 172.21.15.38:0/2213867949 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb57c0ad550 con 0x7fb588100d90 2024-09-13T18:28:04.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.284+0000 7fb586ffd640 1 --2- 172.21.15.38:0/2213867949 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb57006cc60 0x7fb57006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:04.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.285+0000 7fb586ffd640 1 --2- 172.21.15.38:0/2213867949 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb57006cc60 0x7fb57006f120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb5780058c0 tx=0x7fb578005850 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:04.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.289+0000 7fb56ffff640 1 -- 172.21.15.38:0/2213867949 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb57c0778c0 con 0x7fb588100d90 2024-09-13T18:28:04.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:04 smithi149 ceph-mon[35845]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T18:28:04.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:04 smithi149 ceph-mon[35845]: Cluster is now healthy 2024-09-13T18:28:04.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:04 smithi149 ceph-mon[35845]: mds.? [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] up:active 2024-09-13T18:28:04.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:04 smithi149 ceph-mon[35845]: fsmap cephfs:2 {0=cephfs.smithi038.dtnkqo=up:active,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T18:28:04.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:04 smithi149 ceph-mon[35845]: fsmap cephfs:2 {0=cephfs.smithi038.dtnkqo=up:active,1=cephfs.smithi149.doanhj=up:active} 2 up:standby-replay 2024-09-13T18:28:04.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.533+0000 7fb58d500640 1 -- 172.21.15.38:0/2213867949 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb58802c480 con 0x7fb588100d90 2024-09-13T18:28:04.535 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:04 smithi038 ceph-mon[27689]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T18:28:04.535 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:04 smithi038 ceph-mon[27689]: Cluster is now healthy 2024-09-13T18:28:04.536 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:04 smithi038 ceph-mon[27689]: mds.? [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] up:active 2024-09-13T18:28:04.536 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:04 smithi038 ceph-mon[27689]: fsmap cephfs:2 {0=cephfs.smithi038.dtnkqo=up:active,1=cephfs.smithi149.doanhj=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T18:28:04.536 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:04 smithi038 ceph-mon[27689]: fsmap cephfs:2 {0=cephfs.smithi038.dtnkqo=up:active,1=cephfs.smithi149.doanhj=up:active} 2 up:standby-replay 2024-09-13T18:28:04.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.533+0000 7fb56ffff640 1 -- 172.21.15.38:0/2213867949 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7fb57c07aee0 con 0x7fb588100d90 2024-09-13T18:28:04.536 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:28:04.537 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:28:04.538 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:28:04.539 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:28:04.539 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:28:04.539 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:28:04.539 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:28:04.539 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:28:04.539 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:28:04.539 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:28:04.539 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:28:04.539 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:28:04.539 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:28:04.539 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:28:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:28:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.536+0000 7fb58d500640 1 -- 172.21.15.38:0/2213867949 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb57006cc60 msgr2=0x7fb57006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.536+0000 7fb58d500640 1 --2- 172.21.15.38:0/2213867949 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb57006cc60 0x7fb57006f120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb5780058c0 tx=0x7fb578005850 comp rx=0 tx=0).stop 2024-09-13T18:28:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.536+0000 7fb58d500640 1 -- 172.21.15.38:0/2213867949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb588100d90 msgr2=0x7fb588195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.536+0000 7fb58d500640 1 --2- 172.21.15.38:0/2213867949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb588100d90 0x7fb588195a70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0099a0 tx=0x7fb57c0056e0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.536+0000 7fb58d500640 1 -- 172.21.15.38:0/2213867949 shutdown_connections 2024-09-13T18:28:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.536+0000 7fb58d500640 1 --2- 172.21.15.38:0/2213867949 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb57006cc60 0x7fb57006f120 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.536+0000 7fb58d500640 1 --2- 172.21.15.38:0/2213867949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb588100d90 0x7fb588195a70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.536+0000 7fb58d500640 1 --2- 172.21.15.38:0/2213867949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5880ffb90 0x7fb588195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:04.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.536+0000 7fb58d500640 1 -- 172.21.15.38:0/2213867949 >> 172.21.15.38:0/2213867949 conn(0x7fb5880fb320 msgr2=0x7fb5881044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:04.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.536+0000 7fb58d500640 1 -- 172.21.15.38:0/2213867949 shutdown_connections 2024-09-13T18:28:04.541 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:04.537+0000 7fb58d500640 1 -- 172.21.15.38:0/2213867949 wait complete. 2024-09-13T18:28:05.194 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-13T18:28:05.488 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:05 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2213867949' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:28:05.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:05 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:05.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:05 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:05.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:05 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:28:05.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:05 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:28:05.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:05 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:05.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:05 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:28:05.489 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:05 smithi038 ceph-mon[27689]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 716 B/s wr, 9 op/s 2024-09-13T18:28:05.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:05 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/2213867949' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:28:05.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:05 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:05.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:05 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:05.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:05 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:28:05.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:05 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:28:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:05 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:05 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:28:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:05 smithi149 ceph-mon[35845]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 716 B/s wr, 9 op/s 2024-09-13T18:28:06.008 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:28:07.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.705+0000 7fd4269af640 1 -- 172.21.15.38:0/2966089627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4200ffb90 msgr2=0x7fd4200fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:07.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.705+0000 7fd4269af640 1 --2- 172.21.15.38:0/2966089627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4200ffb90 0x7fd4200fff90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd410009880 tx=0x7fd41002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.705+0000 7fd4269af640 1 -- 172.21.15.38:0/2966089627 shutdown_connections 2024-09-13T18:28:07.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.705+0000 7fd4269af640 1 --2- 172.21.15.38:0/2966089627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd420100d90 0x7fd420101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.705+0000 7fd4269af640 1 --2- 172.21.15.38:0/2966089627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4200ffb90 0x7fd4200fff90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.705+0000 7fd4269af640 1 -- 172.21.15.38:0/2966089627 >> 172.21.15.38:0/2966089627 conn(0x7fd4200fb320 msgr2=0x7fd4200fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:07.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.705+0000 7fd4269af640 1 -- 172.21.15.38:0/2966089627 shutdown_connections 2024-09-13T18:28:07.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.705+0000 7fd4269af640 1 -- 172.21.15.38:0/2966089627 wait complete. 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd4269af640 1 Processor -- start 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd4269af640 1 -- start start 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd4269af640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4200ffb90 0x7fd420074190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd4269af640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd420100d90 0x7fd4200728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd4269af640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd420074760 con 0x7fd4200ffb90 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd4269af640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd420072de0 con 0x7fd420100d90 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd41ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4200ffb90 0x7fd420074190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd41ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4200ffb90 0x7fd420074190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45730/0 (socket says 172.21.15.38:45730) 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd41ffff640 1 -- 172.21.15.38:0/4154524227 learned_addr learned my addr 172.21.15.38:0/4154524227 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd41f7fe640 1 --2- 172.21.15.38:0/4154524227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd420100d90 0x7fd4200728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd41ffff640 1 -- 172.21.15.38:0/4154524227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd420100d90 msgr2=0x7fd4200728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd41ffff640 1 --2- 172.21.15.38:0/4154524227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd420100d90 0x7fd4200728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.706+0000 7fd41ffff640 1 -- 172.21.15.38:0/4154524227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd410009560 con 0x7fd4200ffb90 2024-09-13T18:28:07.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.707+0000 7fd41ffff640 1 --2- 172.21.15.38:0/4154524227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4200ffb90 0x7fd420074190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd410005610 tx=0x7fd410005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.707+0000 7fd41d7fa640 1 -- 172.21.15.38:0/4154524227 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd410004b20 con 0x7fd4200ffb90 2024-09-13T18:28:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.707+0000 7fd4269af640 1 -- 172.21.15.38:0/4154524227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd420073060 con 0x7fd4200ffb90 2024-09-13T18:28:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.707+0000 7fd41d7fa640 1 -- 172.21.15.38:0/4154524227 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd410004c80 con 0x7fd4200ffb90 2024-09-13T18:28:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.707+0000 7fd41d7fa640 1 -- 172.21.15.38:0/4154524227 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd410031af0 con 0x7fd4200ffb90 2024-09-13T18:28:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.707+0000 7fd4269af640 1 -- 172.21.15.38:0/4154524227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4200735d0 con 0x7fd4200ffb90 2024-09-13T18:28:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.708+0000 7fd4269af640 1 -- 172.21.15.38:0/4154524227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4201086c0 con 0x7fd4200ffb90 2024-09-13T18:28:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.708+0000 7fd41d7fa640 1 -- 172.21.15.38:0/4154524227 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd4100035f0 con 0x7fd4200ffb90 2024-09-13T18:28:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.709+0000 7fd41d7fa640 1 --2- 172.21.15.38:0/4154524227 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd40806cc50 0x7fd40806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.709+0000 7fd41d7fa640 1 -- 172.21.15.38:0/4154524227 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd4100ad5d0 con 0x7fd4200ffb90 2024-09-13T18:28:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.709+0000 7fd41f7fe640 1 --2- 172.21.15.38:0/4154524227 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd40806cc50 0x7fd40806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.709+0000 7fd41f7fe640 1 --2- 172.21.15.38:0/4154524227 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd40806cc50 0x7fd40806f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd420073f10 tx=0x7fd414008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:07.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.713+0000 7fd41d7fa640 1 -- 172.21.15.38:0/4154524227 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd410077940 con 0x7fd4200ffb90 2024-09-13T18:28:07.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:07.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:07.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:07 smithi149 ceph-mon[35845]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T18:28:07.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.929+0000 7fd4269af640 1 -- 172.21.15.38:0/4154524227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd420108850 con 0x7fd4200ffb90 2024-09-13T18:28:07.932 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:07.932 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:07.932 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:07 smithi038 ceph-mon[27689]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T18:28:07.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.930+0000 7fd41d7fa640 1 -- 172.21.15.38:0/4154524227 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4859 (secure 0 0 0) 0x7fd41007af60 con 0x7fd4200ffb90 2024-09-13T18:28:07.933 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:28:07.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.932+0000 7fd4269af640 1 -- 172.21.15.38:0/4154524227 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd40806cc50 msgr2=0x7fd40806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:07.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.932+0000 7fd4269af640 1 --2- 172.21.15.38:0/4154524227 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd40806cc50 0x7fd40806f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd420073f10 tx=0x7fd414008040 comp rx=0 tx=0).stop 2024-09-13T18:28:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.932+0000 7fd4269af640 1 -- 172.21.15.38:0/4154524227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4200ffb90 msgr2=0x7fd420074190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.932+0000 7fd4269af640 1 --2- 172.21.15.38:0/4154524227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4200ffb90 0x7fd420074190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd410005610 tx=0x7fd410005640 comp rx=0 tx=0).stop 2024-09-13T18:28:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.932+0000 7fd4269af640 1 -- 172.21.15.38:0/4154524227 shutdown_connections 2024-09-13T18:28:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.932+0000 7fd4269af640 1 --2- 172.21.15.38:0/4154524227 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd40806cc50 0x7fd40806f110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.932+0000 7fd4269af640 1 --2- 172.21.15.38:0/4154524227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd420100d90 0x7fd4200728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.932+0000 7fd4269af640 1 --2- 172.21.15.38:0/4154524227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4200ffb90 0x7fd420074190 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.932+0000 7fd4269af640 1 -- 172.21.15.38:0/4154524227 >> 172.21.15.38:0/4154524227 conn(0x7fd4200fb320 msgr2=0x7fd420103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.932+0000 7fd4269af640 1 -- 172.21.15.38:0/4154524227 shutdown_connections 2024-09-13T18:28:07.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:07.932+0000 7fd4269af640 1 -- 172.21.15.38:0/4154524227 wait complete. 2024-09-13T18:28:07.943 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:28:08.706 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-13T18:28:09.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:08 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/4154524227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:28:09.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:08 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/4154524227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:28:09.107 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:28:09.979 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:09 smithi038 ceph-mon[27689]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 11 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-13T18:28:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:09 smithi149 ceph-mon[35845]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 11 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-13T18:28:10.810 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:10 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:28:11.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:10 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:28:11.868 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:11 smithi038 ceph-mon[27689]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 9.7 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-13T18:28:11.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.949+0000 7fda375e2640 1 -- 172.21.15.38:0/481945328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda30102f60 msgr2=0x7fda30105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:11.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.949+0000 7fda375e2640 1 --2- 172.21.15.38:0/481945328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda30102f60 0x7fda30105350 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fda200098b0 tx=0x7fda2002a4d0 comp rx=0 tx=0).stop 2024-09-13T18:28:11.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.949+0000 7fda375e2640 1 -- 172.21.15.38:0/481945328 shutdown_connections 2024-09-13T18:28:11.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.949+0000 7fda375e2640 1 --2- 172.21.15.38:0/481945328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda30102f60 0x7fda30105350 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:11.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.949+0000 7fda375e2640 1 --2- 172.21.15.38:0/481945328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda30100630 0x7fda30102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:11.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.949+0000 7fda375e2640 1 -- 172.21.15.38:0/481945328 >> 172.21.15.38:0/481945328 conn(0x7fda300fa250 msgr2=0x7fda300fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:11.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.949+0000 7fda375e2640 1 -- 172.21.15.38:0/481945328 shutdown_connections 2024-09-13T18:28:11.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.949+0000 7fda375e2640 1 -- 172.21.15.38:0/481945328 wait complete. 2024-09-13T18:28:11.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.950+0000 7fda375e2640 1 Processor -- start 2024-09-13T18:28:11.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.950+0000 7fda375e2640 1 -- start start 2024-09-13T18:28:11.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.950+0000 7fda375e2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda30100630 0x7fda301955b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:11.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.950+0000 7fda375e2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda30102f60 0x7fda30195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:11.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.950+0000 7fda375e2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda301960c0 con 0x7fda30100630 2024-09-13T18:28:11.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.950+0000 7fda375e2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda30196230 con 0x7fda30102f60 2024-09-13T18:28:11.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.950+0000 7fda3537e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda30100630 0x7fda301955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:11.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.950+0000 7fda3537e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda30100630 0x7fda301955b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45756/0 (socket says 172.21.15.38:45756) 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.950+0000 7fda3537e640 1 -- 172.21.15.38:0/2717332312 learned_addr learned my addr 172.21.15.38:0/2717332312 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.951+0000 7fda34b7d640 1 --2- 172.21.15.38:0/2717332312 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda30102f60 0x7fda30195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.951+0000 7fda3537e640 1 -- 172.21.15.38:0/2717332312 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda30102f60 msgr2=0x7fda30195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.951+0000 7fda3537e640 1 --2- 172.21.15.38:0/2717332312 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda30102f60 0x7fda30195af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.951+0000 7fda3537e640 1 -- 172.21.15.38:0/2717332312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20009560 con 0x7fda30100630 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.951+0000 7fda3537e640 1 --2- 172.21.15.38:0/2717332312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda30100630 0x7fda301955b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00d720 tx=0x7fda2c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.951+0000 7fda267fc640 1 -- 172.21.15.38:0/2717332312 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2c0051f0 con 0x7fda30100630 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.951+0000 7fda375e2640 1 -- 172.21.15.38:0/2717332312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3019acd0 con 0x7fda30100630 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.951+0000 7fda267fc640 1 -- 172.21.15.38:0/2717332312 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda2c009820 con 0x7fda30100630 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.951+0000 7fda267fc640 1 -- 172.21.15.38:0/2717332312 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2c004d40 con 0x7fda30100630 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.951+0000 7fda375e2640 1 -- 172.21.15.38:0/2717332312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3019b220 con 0x7fda30100630 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.952+0000 7fda375e2640 1 -- 172.21.15.38:0/2717332312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda30108670 con 0x7fda30100630 2024-09-13T18:28:11.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.953+0000 7fda267fc640 1 -- 172.21.15.38:0/2717332312 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fda2c009990 con 0x7fda30100630 2024-09-13T18:28:11.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.953+0000 7fda267fc640 1 --2- 172.21.15.38:0/2717332312 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fda1c06cc60 0x7fda1c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:11.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.953+0000 7fda267fc640 1 -- 172.21.15.38:0/2717332312 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fda2c08be80 con 0x7fda30100630 2024-09-13T18:28:11.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.953+0000 7fda34b7d640 1 --2- 172.21.15.38:0/2717332312 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fda1c06cc60 0x7fda1c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:11.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.954+0000 7fda34b7d640 1 --2- 172.21.15.38:0/2717332312 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fda1c06cc60 0x7fda1c06f120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fda20006010 tx=0x7fda20031420 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:11.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:11.957+0000 7fda267fc640 1 -- 172.21.15.38:0/2717332312 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fda2c0561f0 con 0x7fda30100630 2024-09-13T18:28:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:11 smithi149 ceph-mon[35845]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 9.7 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-13T18:28:12.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.199+0000 7fda375e2640 1 -- 172.21.15.38:0/2717332312 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fda30108880 con 0x7fda30100630 2024-09-13T18:28:12.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.200+0000 7fda267fc640 1 -- 172.21.15.38:0/2717332312 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v18) v1 ==== 78+0+97 (secure 0 0 0) 0x7fda2c009c40 con 0x7fda30100630 2024-09-13T18:28:12.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.202+0000 7fda375e2640 1 -- 172.21.15.38:0/2717332312 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fda1c06cc60 msgr2=0x7fda1c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:12.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.202+0000 7fda375e2640 1 --2- 172.21.15.38:0/2717332312 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fda1c06cc60 0x7fda1c06f120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fda20006010 tx=0x7fda20031420 comp rx=0 tx=0).stop 2024-09-13T18:28:12.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.202+0000 7fda375e2640 1 -- 172.21.15.38:0/2717332312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda30100630 msgr2=0x7fda301955b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:12.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.202+0000 7fda375e2640 1 --2- 172.21.15.38:0/2717332312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda30100630 0x7fda301955b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00d720 tx=0x7fda2c00dbe0 comp rx=0 tx=0).stop 2024-09-13T18:28:12.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.202+0000 7fda375e2640 1 -- 172.21.15.38:0/2717332312 shutdown_connections 2024-09-13T18:28:12.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.202+0000 7fda375e2640 1 --2- 172.21.15.38:0/2717332312 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fda1c06cc60 0x7fda1c06f120 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:12.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.202+0000 7fda375e2640 1 --2- 172.21.15.38:0/2717332312 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda30102f60 0x7fda30195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:12.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.202+0000 7fda375e2640 1 --2- 172.21.15.38:0/2717332312 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda30100630 0x7fda301955b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:12.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.202+0000 7fda375e2640 1 -- 172.21.15.38:0/2717332312 >> 172.21.15.38:0/2717332312 conn(0x7fda300fa250 msgr2=0x7fda300fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:12.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.202+0000 7fda375e2640 1 -- 172.21.15.38:0/2717332312 shutdown_connections 2024-09-13T18:28:12.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:12.202+0000 7fda375e2640 1 -- 172.21.15.38:0/2717332312 wait complete. 2024-09-13T18:28:12.213 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:28:12.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:12 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/2717332312' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T18:28:12.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:12 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2717332312' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T18:28:13.320 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-13T18:28:13.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:28:13.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.478+0000 7fe562480640 1 -- 172.21.15.38:0/2778413026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55c0ffb90 msgr2=0x7fe55c100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.478+0000 7fe562480640 1 --2- 172.21.15.38:0/2778413026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55c0ffb90 0x7fe55c100010 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe550009880 tx=0x7fe55002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.478+0000 7fe562480640 1 -- 172.21.15.38:0/2778413026 shutdown_connections 2024-09-13T18:28:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.478+0000 7fe562480640 1 --2- 172.21.15.38:0/2778413026 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55c0ffb90 0x7fe55c100010 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.478+0000 7fe562480640 1 --2- 172.21.15.38:0/2778413026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe55c0fe9a0 0x7fe55c0feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.478+0000 7fe562480640 1 -- 172.21.15.38:0/2778413026 >> 172.21.15.38:0/2778413026 conn(0x7fe55c0fa100 msgr2=0x7fe55c0fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.478+0000 7fe562480640 1 -- 172.21.15.38:0/2778413026 shutdown_connections 2024-09-13T18:28:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.478+0000 7fe562480640 1 -- 172.21.15.38:0/2778413026 wait complete. 2024-09-13T18:28:13.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.479+0000 7fe562480640 1 Processor -- start 2024-09-13T18:28:13.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.479+0000 7fe562480640 1 -- start start 2024-09-13T18:28:13.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.479+0000 7fe562480640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55c0fe9a0 0x7fe55c195500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.479+0000 7fe562480640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe55c0ffb90 0x7fe55c195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.479+0000 7fe562480640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c195f80 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.479+0000 7fe562480640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c1960f0 con 0x7fe55c0ffb90 2024-09-13T18:28:13.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.479+0000 7fe55bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55c0fe9a0 0x7fe55c195500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.479+0000 7fe55bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55c0fe9a0 0x7fe55c195500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39634/0 (socket says 172.21.15.38:39634) 2024-09-13T18:28:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.479+0000 7fe55bfff640 1 -- 172.21.15.38:0/3033041438 learned_addr learned my addr 172.21.15.38:0/3033041438 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.479+0000 7fe55b7fe640 1 --2- 172.21.15.38:0/3033041438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe55c0ffb90 0x7fe55c195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.479+0000 7fe55bfff640 1 -- 172.21.15.38:0/3033041438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe55c0ffb90 msgr2=0x7fe55c195a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.479+0000 7fe55bfff640 1 --2- 172.21.15.38:0/3033041438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe55c0ffb90 0x7fe55c195a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.480+0000 7fe55bfff640 1 -- 172.21.15.38:0/3033041438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe550009560 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.480+0000 7fe55bfff640 1 --2- 172.21.15.38:0/3033041438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55c0fe9a0 0x7fe55c195500 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00c8f0 tx=0x7fe54c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.480+0000 7fe5597fa640 1 -- 172.21.15.38:0/3033041438 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe54c0041f0 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.480+0000 7fe562480640 1 -- 172.21.15.38:0/3033041438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c19abc0 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.480+0000 7fe5597fa640 1 -- 172.21.15.38:0/3033041438 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe54c007df0 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.480+0000 7fe5597fa640 1 -- 172.21.15.38:0/3033041438 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe54c00f450 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.480+0000 7fe562480640 1 -- 172.21.15.38:0/3033041438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c19b0f0 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.481+0000 7fe562480640 1 -- 172.21.15.38:0/3033041438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c0feda0 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.482+0000 7fe5597fa640 1 -- 172.21.15.38:0/3033041438 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe54c007950 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.482+0000 7fe5597fa640 1 --2- 172.21.15.38:0/3033041438 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe54406cc50 0x7fe54406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.485 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.482+0000 7fe5597fa640 1 -- 172.21.15.38:0/3033041438 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe54c013070 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.482+0000 7fe55b7fe640 1 --2- 172.21.15.38:0/3033041438 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe54406cc50 0x7fe54406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.486 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.483+0000 7fe55b7fe640 1 --2- 172.21.15.38:0/3033041438 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe54406cc50 0x7fe54406f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe55c196a10 tx=0x7fe550031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:13.488 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.486+0000 7fe5597fa640 1 -- 172.21.15.38:0/3033041438 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe54c0566d0 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.698+0000 7fe562480640 1 -- 172.21.15.38:0/3033041438 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe55c107440 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.699+0000 7fe5597fa640 1 -- 172.21.15.38:0/3033041438 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+15151 (secure 0 0 0) 0x7fe54c059cf0 con 0x7fe55c0fe9a0 2024-09-13T18:28:13.701 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:28:13.701 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":47,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","created":"2024-09-13T18:20:45.975848+0000","modified":"2024-09-13T18:27:59.313669+0000","last_up_change":"2024-09-13T18:26:24.605474+0000","last_in_change":"2024-09-13T18:26:05.887130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:25:13.672723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-09-13T18:27:42.648350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-09-13T18:27:43.137400+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8245ff4-3301-430c-a290-6000dfd0807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6803","nonce":3226287112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6805","nonce":3226287112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6809","nonce":3226287112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3226287112},{"type":"v1","addr":"172.21.15.38:6807","nonce":3226287112}]},"public_addr":"172.21.15.38:6803/3226287112","cluster_addr":"172.21.15.38:6805/3226287112","heartbeat_back_addr":"172.21.15.38:6809/3226287112","heartbeat_front_addr":"172.21.15.38:6807/3226287112","state":["exists","up"]},{"osd":1,"uuid":"1518b6f4-6e5f-445f-b0cd-2ebaecb3c203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6811","nonce":3899453176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6813","nonce":3899453176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6817","nonce":3899453176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3899453176},{"type":"v1","addr":"172.21.15.38:6815","nonce":3899453176}]},"public_addr":"172.21.15.38:6811/3899453176","cluster_addr":"172.21.15.38:6813/3899453176","heartbeat_back_addr":"172.21.15.38:6817/3899453176","heartbeat_front_addr":"172.21.15.38:6815/3899453176","state":["exists","up"]},{"osd":2,"uuid":"43ebe637-fa97-4ac6-b85e-01440f6ca6eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6819","nonce":1096956082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6821","nonce":1096956082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6825","nonce":1096956082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1096956082},{"type":"v1","addr":"172.21.15.38:6823","nonce":1096956082}]},"public_addr":"172.21.15.38:6819/1096956082","cluster_addr":"172.21.15.38:6821/1096956082","heartbeat_back_addr":"172.21.15.38:6825/1096956082","heartbeat_front_addr":"172.21.15.38:6823/1096956082","state":["exists","up"]},{"osd":3,"uuid":"5ffdedaf-95c7-45b3-9af6-36b5a74d60f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6801","nonce":3475497989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6803","nonce":3475497989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6807","nonce":3475497989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3475497989},{"type":"v1","addr":"172.21.15.149:6805","nonce":3475497989}]},"public_addr":"172.21.15.149:6801/3475497989","cluster_addr":"172.21.15.149:6803/3475497989","heartbeat_back_addr":"172.21.15.149:6807/3475497989","heartbeat_front_addr":"172.21.15.149:6805/3475497989","state":["exists","up"]},{"osd":4,"uuid":"e91e0c22-0686-45ef-a8b3-a356ab76eb88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6809","nonce":3561461615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6811","nonce":3561461615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6815","nonce":3561461615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3561461615},{"type":"v1","addr":"172.21.15.149:6813","nonce":3561461615}]},"public_addr":"172.21.15.149:6809/3561461615","cluster_addr":"172.21.15.149:6811/3561461615","heartbeat_back_addr":"172.21.15.149:6815/3561461615","heartbeat_front_addr":"172.21.15.149:6813/3561461615","state":["exists","up"]},{"osd":5,"uuid":"ad710f6e-dbff-455c-8a67-7aca4ab8a56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6817","nonce":2289738730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6819","nonce":2289738730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6823","nonce":2289738730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2289738730},{"type":"v1","addr":"172.21.15.149:6821","nonce":2289738730}]},"public_addr":"172.21.15.149:6817/2289738730","cluster_addr":"172.21.15.149:6819/2289738730","heartbeat_back_addr":"172.21.15.149:6823/2289738730","heartbeat_front_addr":"172.21.15.149:6821/2289738730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:11.540858+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.374275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:10.472792+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:33.374560+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:58.381692+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:22.772809+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6827/1032191718":"2024-09-14T18:27:59.313642+0000","172.21.15.38:6826/1032191718":"2024-09-14T18:27:59.313642+0000","172.21.15.38:0/3421440666":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/2793935378":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/1699958329":"2024-09-14T18:21:45.526804+0000","172.21.15.38:0/3719380288":"2024-09-14T18:21:07.813395+0000","172.21.15.38:6800/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/1884863821":"2024-09-14T18:21:07.813395+0000","172.21.15.38:6801/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/133472565":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6800/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6801/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:0/1436289281":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/1458254215":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6800/1869434741":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/1704785391":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6801/1869434741":"2024-09-14T18:22:55.167215+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:28:13.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.701+0000 7fe562480640 1 -- 172.21.15.38:0/3033041438 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe54406cc50 msgr2=0x7fe54406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:13.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.701+0000 7fe562480640 1 --2- 172.21.15.38:0/3033041438 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe54406cc50 0x7fe54406f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe55c196a10 tx=0x7fe550031400 comp rx=0 tx=0).stop 2024-09-13T18:28:13.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.701+0000 7fe562480640 1 -- 172.21.15.38:0/3033041438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55c0fe9a0 msgr2=0x7fe55c195500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:13.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.701+0000 7fe562480640 1 --2- 172.21.15.38:0/3033041438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55c0fe9a0 0x7fe55c195500 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00c8f0 tx=0x7fe54c00cdb0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.701+0000 7fe562480640 1 -- 172.21.15.38:0/3033041438 shutdown_connections 2024-09-13T18:28:13.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.701+0000 7fe562480640 1 --2- 172.21.15.38:0/3033041438 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe54406cc50 0x7fe54406f110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.701+0000 7fe562480640 1 --2- 172.21.15.38:0/3033041438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe55c0ffb90 0x7fe55c195a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.701+0000 7fe562480640 1 --2- 172.21.15.38:0/3033041438 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe55c0fe9a0 0x7fe55c195500 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.701+0000 7fe562480640 1 -- 172.21.15.38:0/3033041438 >> 172.21.15.38:0/3033041438 conn(0x7fe55c0fa100 msgr2=0x7fe55c068010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:13.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.701+0000 7fe562480640 1 -- 172.21.15.38:0/3033041438 shutdown_connections 2024-09-13T18:28:13.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.701+0000 7fe562480640 1 -- 172.21.15.38:0/3033041438 wait complete. 2024-09-13T18:28:13.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:25:13.672723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-09-13T18:27:42.648350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-09-13T18:27:43.137400+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:28:13.715 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:28:13.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.820+0000 7fc27fd65640 1 -- 172.21.15.38:0/3537849826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2780ffaa0 msgr2=0x7fc2780ffea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:13.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.820+0000 7fc27fd65640 1 --2- 172.21.15.38:0/3537849826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2780ffaa0 0x7fc2780ffea0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc270009880 tx=0x7fc27002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.820+0000 7fc27fd65640 1 -- 172.21.15.38:0/3537849826 shutdown_connections 2024-09-13T18:28:13.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.820+0000 7fc27fd65640 1 --2- 172.21.15.38:0/3537849826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc278100c90 0x7fc278101110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.820+0000 7fc27fd65640 1 --2- 172.21.15.38:0/3537849826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2780ffaa0 0x7fc2780ffea0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.820+0000 7fc27fd65640 1 -- 172.21.15.38:0/3537849826 >> 172.21.15.38:0/3537849826 conn(0x7fc2780fb220 msgr2=0x7fc2780fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:13.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.820+0000 7fc27fd65640 1 -- 172.21.15.38:0/3537849826 shutdown_connections 2024-09-13T18:28:13.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.820+0000 7fc27fd65640 1 -- 172.21.15.38:0/3537849826 wait complete. 2024-09-13T18:28:13.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27fd65640 1 Processor -- start 2024-09-13T18:28:13.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27fd65640 1 -- start start 2024-09-13T18:28:13.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27fd65640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2780ffaa0 0x7fc2781954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27fd65640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc278100c90 0x7fc278195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27fd65640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc278195ff0 con 0x7fc2780ffaa0 2024-09-13T18:28:13.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27fd65640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc278196160 con 0x7fc278100c90 2024-09-13T18:28:13.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27db01640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2780ffaa0 0x7fc2781954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27db01640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2780ffaa0 0x7fc2781954e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39664/0 (socket says 172.21.15.38:39664) 2024-09-13T18:28:13.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27db01640 1 -- 172.21.15.38:0/1256510673 learned_addr learned my addr 172.21.15.38:0/1256510673 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:13.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27d300640 1 --2- 172.21.15.38:0/1256510673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc278100c90 0x7fc278195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27db01640 1 -- 172.21.15.38:0/1256510673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc278100c90 msgr2=0x7fc278195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:13.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27db01640 1 --2- 172.21.15.38:0/1256510673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc278100c90 0x7fc278195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:13.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27db01640 1 -- 172.21.15.38:0/1256510673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc270009560 con 0x7fc2780ffaa0 2024-09-13T18:28:13.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.821+0000 7fc27db01640 1 --2- 172.21.15.38:0/1256510673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2780ffaa0 0x7fc2781954e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc2700054f0 tx=0x7fc270005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:13.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.822+0000 7fc276ffd640 1 -- 172.21.15.38:0/1256510673 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc270004aa0 con 0x7fc2780ffaa0 2024-09-13T18:28:13.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.822+0000 7fc276ffd640 1 -- 172.21.15.38:0/1256510673 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc270004c00 con 0x7fc2780ffaa0 2024-09-13T18:28:13.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.822+0000 7fc27fd65640 1 -- 172.21.15.38:0/1256510673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27819ab90 con 0x7fc2780ffaa0 2024-09-13T18:28:13.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.822+0000 7fc276ffd640 1 -- 172.21.15.38:0/1256510673 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2700319f0 con 0x7fc2780ffaa0 2024-09-13T18:28:13.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.822+0000 7fc27fd65640 1 -- 172.21.15.38:0/1256510673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27819b090 con 0x7fc2780ffaa0 2024-09-13T18:28:13.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.823+0000 7fc27fd65640 1 -- 172.21.15.38:0/1256510673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc278108560 con 0x7fc2780ffaa0 2024-09-13T18:28:13.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.823+0000 7fc276ffd640 1 -- 172.21.15.38:0/1256510673 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc270003c90 con 0x7fc2780ffaa0 2024-09-13T18:28:13.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.824+0000 7fc276ffd640 1 --2- 172.21.15.38:0/1256510673 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc26006cc50 0x7fc26006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:13.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.824+0000 7fc276ffd640 1 -- 172.21.15.38:0/1256510673 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc2700ad3e0 con 0x7fc2780ffaa0 2024-09-13T18:28:13.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.824+0000 7fc27d300640 1 --2- 172.21.15.38:0/1256510673 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc26006cc50 0x7fc26006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:13.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.824+0000 7fc27d300640 1 --2- 172.21.15.38:0/1256510673 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc26006cc50 0x7fc26006f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2781969f0 tx=0x7fc26c00b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:13.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.828+0000 7fc276ffd640 1 -- 172.21.15.38:0/1256510673 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc270077800 con 0x7fc2780ffaa0 2024-09-13T18:28:14.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.999+0000 7fc27fd65640 1 -- 172.21.15.38:0/1256510673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc27819b2b0 con 0x7fc2780ffaa0 2024-09-13T18:28:14.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:13.999+0000 7fc276ffd640 1 -- 172.21.15.38:0/1256510673 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc27007ae20 con 0x7fc2780ffaa0 2024-09-13T18:28:14.002 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-09-13T18:28:14.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.001+0000 7fc27fd65640 1 -- 172.21.15.38:0/1256510673 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc26006cc50 msgr2=0x7fc26006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.001+0000 7fc27fd65640 1 --2- 172.21.15.38:0/1256510673 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc26006cc50 0x7fc26006f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2781969f0 tx=0x7fc26c00b390 comp rx=0 tx=0).stop 2024-09-13T18:28:14.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.001+0000 7fc27fd65640 1 -- 172.21.15.38:0/1256510673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2780ffaa0 msgr2=0x7fc2781954e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.001+0000 7fc27fd65640 1 --2- 172.21.15.38:0/1256510673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2780ffaa0 0x7fc2781954e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc2700054f0 tx=0x7fc270005520 comp rx=0 tx=0).stop 2024-09-13T18:28:14.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.001+0000 7fc27fd65640 1 -- 172.21.15.38:0/1256510673 shutdown_connections 2024-09-13T18:28:14.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.001+0000 7fc27fd65640 1 --2- 172.21.15.38:0/1256510673 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc26006cc50 0x7fc26006f110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.001+0000 7fc27fd65640 1 --2- 172.21.15.38:0/1256510673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc278100c90 0x7fc278195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.001+0000 7fc27fd65640 1 --2- 172.21.15.38:0/1256510673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc2780ffaa0 0x7fc2781954e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.001+0000 7fc27fd65640 1 -- 172.21.15.38:0/1256510673 >> 172.21.15.38:0/1256510673 conn(0x7fc2780fb220 msgr2=0x7fc278103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.001+0000 7fc27fd65640 1 -- 172.21.15.38:0/1256510673 shutdown_connections 2024-09-13T18:28:14.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.001+0000 7fc27fd65640 1 -- 172.21.15.38:0/1256510673 wait complete. 2024-09-13T18:28:14.013 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:13 smithi038 ceph-mon[27689]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T18:28:14.013 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:13 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:14.013 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:13 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:14.013 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:13 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:28:14.014 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:13 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:28:14.014 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:13 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:14.015 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-09-13T18:28:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:13 smithi149 ceph-mon[35845]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T18:28:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:13 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:13 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:13 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:28:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:13 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:28:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:13 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:14.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.118+0000 7fe094ee5640 1 -- 172.21.15.38:0/2292059013 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0900fe140 msgr2=0x7fe0900fe540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.118+0000 7fe094ee5640 1 --2- 172.21.15.38:0/2292059013 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0900fe140 0x7fe0900fe540 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe080009880 tx=0x7fe08002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.118+0000 7fe094ee5640 1 -- 172.21.15.38:0/2292059013 shutdown_connections 2024-09-13T18:28:14.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.118+0000 7fe094ee5640 1 --2- 172.21.15.38:0/2292059013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0900ff330 0x7fe0900ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.118+0000 7fe094ee5640 1 --2- 172.21.15.38:0/2292059013 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0900fe140 0x7fe0900fe540 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.118+0000 7fe094ee5640 1 -- 172.21.15.38:0/2292059013 >> 172.21.15.38:0/2292059013 conn(0x7fe0900f98a0 msgr2=0x7fe0900fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.118+0000 7fe094ee5640 1 -- 172.21.15.38:0/2292059013 shutdown_connections 2024-09-13T18:28:14.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.118+0000 7fe094ee5640 1 -- 172.21.15.38:0/2292059013 wait complete. 2024-09-13T18:28:14.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe094ee5640 1 Processor -- start 2024-09-13T18:28:14.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe094ee5640 1 -- start start 2024-09-13T18:28:14.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe094ee5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0900fe140 0x7fe0901976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe094ee5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0900ff330 0x7fe090197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe094ee5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe090198200 con 0x7fe0900ff330 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe094ee5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe090198370 con 0x7fe0900fe140 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe087fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0900ff330 0x7fe090197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe087fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0900ff330 0x7fe090197c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39682/0 (socket says 172.21.15.38:39682) 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe087fff640 1 -- 172.21.15.38:0/311535101 learned_addr learned my addr 172.21.15.38:0/311535101 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe08e59c640 1 --2- 172.21.15.38:0/311535101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0900fe140 0x7fe0901976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe087fff640 1 -- 172.21.15.38:0/311535101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0900fe140 msgr2=0x7fe0901976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe087fff640 1 --2- 172.21.15.38:0/311535101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0900fe140 0x7fe0901976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe087fff640 1 -- 172.21.15.38:0/311535101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe080009560 con 0x7fe0900ff330 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.119+0000 7fe08e59c640 1 --2- 172.21.15.38:0/311535101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0900fe140 0x7fe0901976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.120+0000 7fe087fff640 1 --2- 172.21.15.38:0/311535101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0900ff330 0x7fe090197c30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe07800e970 tx=0x7fe07800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.120+0000 7fe0877fe640 1 -- 172.21.15.38:0/311535101 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe07800cc90 con 0x7fe0900ff330 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.120+0000 7fe0877fe640 1 -- 172.21.15.38:0/311535101 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe07800cdf0 con 0x7fe0900ff330 2024-09-13T18:28:14.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.120+0000 7fe094ee5640 1 -- 172.21.15.38:0/311535101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09019ce00 con 0x7fe0900ff330 2024-09-13T18:28:14.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.120+0000 7fe0877fe640 1 -- 172.21.15.38:0/311535101 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe078010430 con 0x7fe0900ff330 2024-09-13T18:28:14.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.120+0000 7fe094ee5640 1 -- 172.21.15.38:0/311535101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09019d3b0 con 0x7fe0900ff330 2024-09-13T18:28:14.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.121+0000 7fe094ee5640 1 -- 172.21.15.38:0/311535101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0900fe540 con 0x7fe0900ff330 2024-09-13T18:28:14.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.121+0000 7fe0877fe640 1 -- 172.21.15.38:0/311535101 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe0780046c0 con 0x7fe0900ff330 2024-09-13T18:28:14.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.122+0000 7fe0877fe640 1 --2- 172.21.15.38:0/311535101 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe07c06cc60 0x7fe07c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.122+0000 7fe0877fe640 1 -- 172.21.15.38:0/311535101 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe078014070 con 0x7fe0900ff330 2024-09-13T18:28:14.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.122+0000 7fe08e59c640 1 --2- 172.21.15.38:0/311535101 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe07c06cc60 0x7fe07c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.122+0000 7fe08e59c640 1 --2- 172.21.15.38:0/311535101 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe07c06cc60 0x7fe07c06f120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe080000c00 tx=0x7fe080031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.126+0000 7fe0877fe640 1 -- 172.21.15.38:0/311535101 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe078056bd0 con 0x7fe0900ff330 2024-09-13T18:28:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.299+0000 7fe094ee5640 1 -- 172.21.15.38:0/311535101 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fe09019d630 con 0x7fe0900ff330 2024-09-13T18:28:14.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.300+0000 7fe0877fe640 1 -- 172.21.15.38:0/311535101 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe07805a1f0 con 0x7fe0900ff330 2024-09-13T18:28:14.302 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-13T18:28:14.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.302+0000 7fe094ee5640 1 -- 172.21.15.38:0/311535101 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe07c06cc60 msgr2=0x7fe07c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.302+0000 7fe094ee5640 1 --2- 172.21.15.38:0/311535101 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe07c06cc60 0x7fe07c06f120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe080000c00 tx=0x7fe080031400 comp rx=0 tx=0).stop 2024-09-13T18:28:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.302+0000 7fe094ee5640 1 -- 172.21.15.38:0/311535101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0900ff330 msgr2=0x7fe090197c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.302+0000 7fe094ee5640 1 --2- 172.21.15.38:0/311535101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0900ff330 0x7fe090197c30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe07800e970 tx=0x7fe07800ed70 comp rx=0 tx=0).stop 2024-09-13T18:28:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.302+0000 7fe094ee5640 1 -- 172.21.15.38:0/311535101 shutdown_connections 2024-09-13T18:28:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.302+0000 7fe094ee5640 1 --2- 172.21.15.38:0/311535101 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe07c06cc60 0x7fe07c06f120 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.302+0000 7fe094ee5640 1 --2- 172.21.15.38:0/311535101 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0900ff330 0x7fe090197c30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.302+0000 7fe094ee5640 1 --2- 172.21.15.38:0/311535101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0900fe140 0x7fe0901976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.302+0000 7fe094ee5640 1 -- 172.21.15.38:0/311535101 >> 172.21.15.38:0/311535101 conn(0x7fe0900f98a0 msgr2=0x7fe090102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.302+0000 7fe094ee5640 1 -- 172.21.15.38:0/311535101 shutdown_connections 2024-09-13T18:28:14.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.302+0000 7fe094ee5640 1 -- 172.21.15.38:0/311535101 wait complete. 2024-09-13T18:28:14.315 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-09-13T18:28:14.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.418+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/2325886011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0dc100520 msgr2=0x7fd0dc102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.418+0000 7fd0e3f9c640 1 --2- 172.21.15.38:0/2325886011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0dc100520 0x7fd0dc102910 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009880 tx=0x7fd0d802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.418+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/2325886011 shutdown_connections 2024-09-13T18:28:14.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.418+0000 7fd0e3f9c640 1 --2- 172.21.15.38:0/2325886011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc102e50 0x7fd0dc105240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.418+0000 7fd0e3f9c640 1 --2- 172.21.15.38:0/2325886011 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0dc100520 0x7fd0dc102910 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.418+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/2325886011 >> 172.21.15.38:0/2325886011 conn(0x7fd0dc0fa100 msgr2=0x7fd0dc0fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.418+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/2325886011 shutdown_connections 2024-09-13T18:28:14.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.418+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/2325886011 wait complete. 2024-09-13T18:28:14.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e3f9c640 1 Processor -- start 2024-09-13T18:28:14.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e3f9c640 1 -- start start 2024-09-13T18:28:14.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e3f9c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc100520 0x7fd0dc195490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e3f9c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0dc102e50 0x7fd0dc1959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e3f9c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc195f10 con 0x7fd0dc102e50 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e3f9c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc196080 con 0x7fd0dc100520 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e1537640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0dc102e50 0x7fd0dc1959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e1537640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0dc102e50 0x7fd0dc1959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39702/0 (socket says 172.21.15.38:39702) 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e1537640 1 -- 172.21.15.38:0/995916236 learned_addr learned my addr 172.21.15.38:0/995916236 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e1d38640 1 --2- 172.21.15.38:0/995916236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc100520 0x7fd0dc195490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e1537640 1 -- 172.21.15.38:0/995916236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc100520 msgr2=0x7fd0dc195490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e1537640 1 --2- 172.21.15.38:0/995916236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc100520 0x7fd0dc195490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e1537640 1 -- 172.21.15.38:0/995916236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d8009560 con 0x7fd0dc102e50 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0e1537640 1 --2- 172.21.15.38:0/995916236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0dc102e50 0x7fd0dc1959d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00c8f0 tx=0x7fd0cc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.419+0000 7fd0d2ffd640 1 -- 172.21.15.38:0/995916236 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0cc004410 con 0x7fd0dc102e50 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.420+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/995916236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc19ab50 con 0x7fd0dc102e50 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.420+0000 7fd0d2ffd640 1 -- 172.21.15.38:0/995916236 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0cc007c40 con 0x7fd0dc102e50 2024-09-13T18:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.420+0000 7fd0d2ffd640 1 -- 172.21.15.38:0/995916236 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0cc00f450 con 0x7fd0dc102e50 2024-09-13T18:28:14.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.420+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/995916236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc19b100 con 0x7fd0dc102e50 2024-09-13T18:28:14.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.420+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/995916236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc108570 con 0x7fd0dc102e50 2024-09-13T18:28:14.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.421+0000 7fd0d2ffd640 1 -- 172.21.15.38:0/995916236 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd0cc0077a0 con 0x7fd0dc102e50 2024-09-13T18:28:14.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.422+0000 7fd0d2ffd640 1 --2- 172.21.15.38:0/995916236 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd0c806cc60 0x7fd0c806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.422+0000 7fd0d2ffd640 1 -- 172.21.15.38:0/995916236 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd0cc08c210 con 0x7fd0dc102e50 2024-09-13T18:28:14.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.422+0000 7fd0e1d38640 1 --2- 172.21.15.38:0/995916236 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd0c806cc60 0x7fd0c806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.422+0000 7fd0e1d38640 1 --2- 172.21.15.38:0/995916236 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd0c806cc60 0x7fd0c806f120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8000c00 tx=0x7fd0d8031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.426+0000 7fd0d2ffd640 1 -- 172.21.15.38:0/995916236 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd0cc056580 con 0x7fd0dc102e50 2024-09-13T18:28:14.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.597+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/995916236 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd0dc108750 con 0x7fd0dc102e50 2024-09-13T18:28:14.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.597+0000 7fd0d2ffd640 1 -- 172.21.15.38:0/995916236 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd0cc059ba0 con 0x7fd0dc102e50 2024-09-13T18:28:14.600 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-13T18:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.599+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/995916236 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd0c806cc60 msgr2=0x7fd0c806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.599+0000 7fd0e3f9c640 1 --2- 172.21.15.38:0/995916236 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd0c806cc60 0x7fd0c806f120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8000c00 tx=0x7fd0d8031400 comp rx=0 tx=0).stop 2024-09-13T18:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.599+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/995916236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0dc102e50 msgr2=0x7fd0dc1959d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.599+0000 7fd0e3f9c640 1 --2- 172.21.15.38:0/995916236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0dc102e50 0x7fd0dc1959d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00c8f0 tx=0x7fd0cc00cdb0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.599+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/995916236 shutdown_connections 2024-09-13T18:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.599+0000 7fd0e3f9c640 1 --2- 172.21.15.38:0/995916236 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd0c806cc60 0x7fd0c806f120 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.599+0000 7fd0e3f9c640 1 --2- 172.21.15.38:0/995916236 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd0dc102e50 0x7fd0dc1959d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.599+0000 7fd0e3f9c640 1 --2- 172.21.15.38:0/995916236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc100520 0x7fd0dc195490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.599+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/995916236 >> 172.21.15.38:0/995916236 conn(0x7fd0dc0fa100 msgr2=0x7fd0dc0fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.599+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/995916236 shutdown_connections 2024-09-13T18:28:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.599+0000 7fd0e3f9c640 1 -- 172.21.15.38:0/995916236 wait complete. 2024-09-13T18:28:14.613 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.712+0000 7fb43fd5a640 1 -- 172.21.15.38:0/3445940128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4380ffb90 msgr2=0x7fb438100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.712+0000 7fb43fd5a640 1 --2- 172.21.15.38:0/3445940128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4380ffb90 0x7fb438100010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb428009880 tx=0x7fb42802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.712+0000 7fb43fd5a640 1 -- 172.21.15.38:0/3445940128 shutdown_connections 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.712+0000 7fb43fd5a640 1 --2- 172.21.15.38:0/3445940128 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4380ffb90 0x7fb438100010 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.712+0000 7fb43fd5a640 1 --2- 172.21.15.38:0/3445940128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4380fe9a0 0x7fb4380feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.712+0000 7fb43fd5a640 1 -- 172.21.15.38:0/3445940128 >> 172.21.15.38:0/3445940128 conn(0x7fb4380fa100 msgr2=0x7fb4380fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.712+0000 7fb43fd5a640 1 -- 172.21.15.38:0/3445940128 shutdown_connections 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.712+0000 7fb43fd5a640 1 -- 172.21.15.38:0/3445940128 wait complete. 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.713+0000 7fb43fd5a640 1 Processor -- start 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.713+0000 7fb43fd5a640 1 -- start start 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.713+0000 7fb43fd5a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4380fe9a0 0x7fb438068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.713+0000 7fb43fd5a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4380ffb90 0x7fb43819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.713+0000 7fb43fd5a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43819a7b0 con 0x7fb4380fe9a0 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.713+0000 7fb43fd5a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43819a8f0 con 0x7fb4380ffb90 2024-09-13T18:28:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.713+0000 7fb43daf6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4380fe9a0 0x7fb438068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.713+0000 7fb43daf6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4380fe9a0 0x7fb438068b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39724/0 (socket says 172.21.15.38:39724) 2024-09-13T18:28:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.713+0000 7fb43daf6640 1 -- 172.21.15.38:0/747655473 learned_addr learned my addr 172.21.15.38:0/747655473 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.713+0000 7fb43daf6640 1 -- 172.21.15.38:0/747655473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4380ffb90 msgr2=0x7fb43819a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.713+0000 7fb43daf6640 1 --2- 172.21.15.38:0/747655473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4380ffb90 0x7fb43819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.713+0000 7fb43daf6640 1 -- 172.21.15.38:0/747655473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428009560 con 0x7fb4380fe9a0 2024-09-13T18:28:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.714+0000 7fb43daf6640 1 --2- 172.21.15.38:0/747655473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4380fe9a0 0x7fb438068b40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb43400d8d0 tx=0x7fb43400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.714+0000 7fb42effd640 1 -- 172.21.15.38:0/747655473 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43400bea0 con 0x7fb4380fe9a0 2024-09-13T18:28:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.714+0000 7fb42effd640 1 -- 172.21.15.38:0/747655473 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb434009c00 con 0x7fb4380fe9a0 2024-09-13T18:28:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.714+0000 7fb43fd5a640 1 -- 172.21.15.38:0/747655473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43819aba0 con 0x7fb4380fe9a0 2024-09-13T18:28:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.714+0000 7fb42effd640 1 -- 172.21.15.38:0/747655473 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43400f710 con 0x7fb4380fe9a0 2024-09-13T18:28:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.714+0000 7fb43fd5a640 1 -- 172.21.15.38:0/747655473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43819b100 con 0x7fb4380fe9a0 2024-09-13T18:28:14.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.715+0000 7fb43fd5a640 1 -- 172.21.15.38:0/747655473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb438107440 con 0x7fb4380fe9a0 2024-09-13T18:28:14.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.715+0000 7fb42effd640 1 -- 172.21.15.38:0/747655473 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb434010460 con 0x7fb4380fe9a0 2024-09-13T18:28:14.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.716+0000 7fb42effd640 1 --2- 172.21.15.38:0/747655473 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb42406cc50 0x7fb42406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:14.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.716+0000 7fb42effd640 1 -- 172.21.15.38:0/747655473 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb43408c290 con 0x7fb4380fe9a0 2024-09-13T18:28:14.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.716+0000 7fb43d2f5640 1 --2- 172.21.15.38:0/747655473 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb42406cc50 0x7fb42406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:14.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.716+0000 7fb43d2f5640 1 --2- 172.21.15.38:0/747655473 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb42406cc50 0x7fb42406f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb42802a9c0 tx=0x7fb428000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:14.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.720+0000 7fb42effd640 1 -- 172.21.15.38:0/747655473 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb4340565e0 con 0x7fb4380fe9a0 2024-09-13T18:28:14.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.926+0000 7fb43fd5a640 1 -- 172.21.15.38:0/747655473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb43819b3d0 con 0x7fb4380fe9a0 2024-09-13T18:28:14.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.927+0000 7fb42effd640 1 -- 172.21.15.38:0/747655473 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4859 (secure 0 0 0) 0x7fb434059c00 con 0x7fb4380fe9a0 2024-09-13T18:28:14.929 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:28:14.929 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:28:03.378050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14484,"mds_1":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi038.dtnkqo","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.38:6829/1171569676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1171569676},{"type":"v1","addr":"172.21.15.38:6829","nonce":1171569676}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14492":{"gid":14492,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6827/4022520279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":4022520279},{"type":"v1","addr":"172.21.15.38:6827","nonce":4022520279}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24275":{"gid":24275,"name":"cephfs.smithi149.doanhj","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.149:6825/443686826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":443686826},{"type":"v1","addr":"172.21.15.149:6825","nonce":443686826}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24283":{"gid":24283,"name":"cephfs.smithi149.zdzwzb","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.149:6827/3095156708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3095156708},{"type":"v1","addr":"172.21.15.149:6827","nonce":3095156708}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:28:14.929 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:28:14.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.929+0000 7fb43fd5a640 1 -- 172.21.15.38:0/747655473 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb42406cc50 msgr2=0x7fb42406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.929+0000 7fb43fd5a640 1 --2- 172.21.15.38:0/747655473 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb42406cc50 0x7fb42406f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb42802a9c0 tx=0x7fb428000bc0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.929+0000 7fb43fd5a640 1 -- 172.21.15.38:0/747655473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4380fe9a0 msgr2=0x7fb438068b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:14.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.929+0000 7fb43fd5a640 1 --2- 172.21.15.38:0/747655473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4380fe9a0 0x7fb438068b40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb43400d8d0 tx=0x7fb43400dd90 comp rx=0 tx=0).stop 2024-09-13T18:28:14.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.929+0000 7fb43fd5a640 1 -- 172.21.15.38:0/747655473 shutdown_connections 2024-09-13T18:28:14.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.929+0000 7fb43fd5a640 1 --2- 172.21.15.38:0/747655473 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb42406cc50 0x7fb42406f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.929+0000 7fb43fd5a640 1 --2- 172.21.15.38:0/747655473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4380ffb90 0x7fb43819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.929+0000 7fb43fd5a640 1 --2- 172.21.15.38:0/747655473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb4380fe9a0 0x7fb438068b40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:14.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.929+0000 7fb43fd5a640 1 -- 172.21.15.38:0/747655473 >> 172.21.15.38:0/747655473 conn(0x7fb4380fa100 msgr2=0x7fb438102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:14.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.929+0000 7fb43fd5a640 1 -- 172.21.15.38:0/747655473 shutdown_connections 2024-09-13T18:28:14.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:14.929+0000 7fb43fd5a640 1 -- 172.21.15.38:0/747655473 wait complete. 2024-09-13T18:28:14.940 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:14 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3033041438' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:28:14.940 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:14 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1256510673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:28:14.941 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:14 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/311535101' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T18:28:14.941 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:14 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/995916236' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T18:28:14.942 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 50} 2024-09-13T18:28:14.942 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T18:28:14.971 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T18:28:14.971 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-13T18:28:14.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:14.972 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-09-13T18:28:14.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:14.989 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2024-09-13T18:28:15.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:14 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/3033041438' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:28:15.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:14 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1256510673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:28:15.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:14 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/311535101' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T18:28:15.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:14 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/995916236' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T18:28:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:Cannot find device "ceph-brx" 2024-09-13T18:28:15.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:28:15.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:15.058 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-13T18:28:15.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:15.078 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-13T18:28:15.152 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-09-13T18:28:15.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:28:15.154 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-13T18:28:15.154 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:28:15.154 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:15.155 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T18:28:15.359 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:28:15.763 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:15 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/747655473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:28:15.763 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:15 smithi038 ceph-mon[27689]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 8.6 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-13T18:28:16.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:15 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/747655473' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:28:16.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:15 smithi149 ceph-mon[35845]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 8.6 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-13T18:28:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.010+0000 7fe0f9404640 1 -- 172.21.15.38:0/2876870357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0f40ffda0 msgr2=0x7fe0f4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.010+0000 7fe0f9404640 1 --2- 172.21.15.38:0/2876870357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0f40ffda0 0x7fe0f4100180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009c20 tx=0x7fe0e402a970 comp rx=0 tx=0).stop 2024-09-13T18:28:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.010+0000 7fe0f9404640 1 -- 172.21.15.38:0/2876870357 shutdown_connections 2024-09-13T18:28:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.010+0000 7fe0f9404640 1 --2- 172.21.15.38:0/2876870357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f4100750 0x7fe0f41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.010+0000 7fe0f9404640 1 --2- 172.21.15.38:0/2876870357 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0f40ffda0 0x7fe0f4100180 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.010+0000 7fe0f9404640 1 -- 172.21.15.38:0/2876870357 >> 172.21.15.38:0/2876870357 conn(0x7fe0f40fb840 msgr2=0x7fe0f40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.010+0000 7fe0f9404640 1 -- 172.21.15.38:0/2876870357 shutdown_connections 2024-09-13T18:28:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.010+0000 7fe0f9404640 1 -- 172.21.15.38:0/2876870357 wait complete. 2024-09-13T18:28:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.011+0000 7fe0f9404640 1 Processor -- start 2024-09-13T18:28:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.011+0000 7fe0f9404640 1 -- start start 2024-09-13T18:28:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.011+0000 7fe0f9404640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f40ffda0 0x7fe0f419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.011+0000 7fe0f9404640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0f4100750 0x7fe0f419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.011+0000 7fe0f9404640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f419c320 con 0x7fe0f4100750 2024-09-13T18:28:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.011+0000 7fe0f9404640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f41958b0 con 0x7fe0f40ffda0 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.011+0000 7fe0f2ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f40ffda0 0x7fe0f419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0f2ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f40ffda0 0x7fe0f419b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.38:45322/0 (socket says 172.21.15.38:45322) 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0f27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0f4100750 0x7fe0f419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0f2ffd640 1 -- 172.21.15.38:0/1508965299 learned_addr learned my addr 172.21.15.38:0/1508965299 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0f2ffd640 1 -- 172.21.15.38:0/1508965299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0f4100750 msgr2=0x7fe0f419bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0f2ffd640 1 --2- 172.21.15.38:0/1508965299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0f4100750 0x7fe0f419bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0f2ffd640 1 -- 172.21.15.38:0/1508965299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e4009900 con 0x7fe0f40ffda0 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0f27fc640 1 --2- 172.21.15.38:0/1508965299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0f4100750 0x7fe0f419bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0f2ffd640 1 --2- 172.21.15.38:0/1508965299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f40ffda0 0x7fe0f419b7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4006010 tx=0x7fe0e40308a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0dbfff640 1 -- 172.21.15.38:0/1508965299 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e402f3c0 con 0x7fe0f40ffda0 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0f9404640 1 -- 172.21.15.38:0/1508965299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f4195b30 con 0x7fe0f40ffda0 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0dbfff640 1 -- 172.21.15.38:0/1508965299 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe0e402f9c0 con 0x7fe0f40ffda0 2024-09-13T18:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0dbfff640 1 -- 172.21.15.38:0/1508965299 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e4004890 con 0x7fe0f40ffda0 2024-09-13T18:28:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.012+0000 7fe0f9404640 1 -- 172.21.15.38:0/1508965299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f4196020 con 0x7fe0f40ffda0 2024-09-13T18:28:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.013+0000 7fe0f9404640 1 -- 172.21.15.38:0/1508965299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f4101280 con 0x7fe0f40ffda0 2024-09-13T18:28:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.014+0000 7fe0dbfff640 1 -- 172.21.15.38:0/1508965299 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe0e400a040 con 0x7fe0f40ffda0 2024-09-13T18:28:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.015+0000 7fe0dbfff640 1 --2- 172.21.15.38:0/1508965299 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe0dc06cc50 0x7fe0dc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.015+0000 7fe0dbfff640 1 -- 172.21.15.38:0/1508965299 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe0e402c040 con 0x7fe0f40ffda0 2024-09-13T18:28:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.015+0000 7fe0f27fc640 1 --2- 172.21.15.38:0/1508965299 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe0dc06cc50 0x7fe0dc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.015+0000 7fe0f27fc640 1 --2- 172.21.15.38:0/1508965299 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe0dc06cc50 0x7fe0dc06f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4196d20 tx=0x7fe0e8005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:17.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.018+0000 7fe0dbfff640 1 -- 172.21.15.38:0/1508965299 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe0e4077ae0 con 0x7fe0f40ffda0 2024-09-13T18:28:17.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.225+0000 7fe0f9404640 1 -- 172.21.15.38:0/1508965299 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe0f41080b0 con 0x7fe0f40ffda0 2024-09-13T18:28:17.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.226+0000 7fe0dbfff640 1 -- 172.21.15.38:0/1508965299 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7fe0e4048070 con 0x7fe0f40ffda0 2024-09-13T18:28:17.229 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T18:28:17.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.228+0000 7fe0f9404640 1 -- 172.21.15.38:0/1508965299 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe0dc06cc50 msgr2=0x7fe0dc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.228+0000 7fe0f9404640 1 --2- 172.21.15.38:0/1508965299 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe0dc06cc50 0x7fe0dc06f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4196d20 tx=0x7fe0e8005f90 comp rx=0 tx=0).stop 2024-09-13T18:28:17.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.228+0000 7fe0f9404640 1 -- 172.21.15.38:0/1508965299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f40ffda0 msgr2=0x7fe0f419b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:17.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.228+0000 7fe0f9404640 1 --2- 172.21.15.38:0/1508965299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f40ffda0 0x7fe0f419b7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4006010 tx=0x7fe0e40308a0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.228+0000 7fe0f9404640 1 -- 172.21.15.38:0/1508965299 shutdown_connections 2024-09-13T18:28:17.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.228+0000 7fe0f9404640 1 --2- 172.21.15.38:0/1508965299 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fe0dc06cc50 0x7fe0dc06f110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.228+0000 7fe0f9404640 1 --2- 172.21.15.38:0/1508965299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe0f4100750 0x7fe0f419bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.228+0000 7fe0f9404640 1 --2- 172.21.15.38:0/1508965299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0f40ffda0 0x7fe0f419b7c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:17.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.228+0000 7fe0f9404640 1 -- 172.21.15.38:0/1508965299 >> 172.21.15.38:0/1508965299 conn(0x7fe0f40fb840 msgr2=0x7fe0f40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:17.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.228+0000 7fe0f9404640 1 -- 172.21.15.38:0/1508965299 shutdown_connections 2024-09-13T18:28:17.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:17.228+0000 7fe0f9404640 1 -- 172.21.15.38:0/1508965299 wait complete. 2024-09-13T18:28:17.533 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:17 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1508965299' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T18:28:17.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:17 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1508965299' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T18:28:17.863 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:28:17.864 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:28:17.864 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2024-09-13T18:28:17.864 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:28:17.864 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:17.864 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:28:17.864 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:28:17.864 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:28:17.864 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:17.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.865 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2024-09-13T18:28:17.882 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:28:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:28:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:28:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2024-09-13T18:28:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:17.882 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:28:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:17.882 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42343sec preferred_lft 42343sec 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:17.883 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2024-09-13T18:28:17.884 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:28:17.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:17.884 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2024-09-13T18:28:17.884 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-13T18:28:17.884 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:28:17.884 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr flush dev ceph-brx 2024-09-13T18:28:17.884 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set ceph-brx up 2024-09-13T18:28:17.885 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:28:17.885 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-13T18:28:18.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:18.055 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:28:18.080 INFO:teuthology.orchestra.run.smithi038.stdout:1 2024-09-13T18:28:18.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:18.082 DEBUG:teuthology.orchestra.run.smithi038:> route 2024-09-13T18:28:18.150 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2024-09-13T18:28:18.150 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:28:18.151 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T18:28:18.151 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T18:28:18.151 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:28:18.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:18.151 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2024-09-13T18:28:18.151 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-13T18:28:18.152 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:28:18.152 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:28:18.152 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:28:18.152 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-13T18:28:18.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:18.397 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-09-13T18:28:18.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:18.414 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list-id 2024-09-13T18:28:18.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:18.470 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2024-09-13T18:28:18.471 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-13T18:28:18.471 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:28:18.471 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:28:18.471 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-13T18:28:18.533 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:18 smithi038 ceph-mon[27689]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 4.6 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T18:28:18.550 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:28:18.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:18.552 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2024-09-13T18:28:18.552 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-13T18:28:18.552 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:28:18.552 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:28:18.552 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:28:18.552 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:28:18.552 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:28:18.552 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-13T18:28:18.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:18.676 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2024-09-13T18:28:18.676 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-09-13T18:28:18.676 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2024-09-13T18:28:18.676 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:28:18.676 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-09-13T18:28:18.714 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:18.714 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:18.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:18 smithi149 ceph-mon[35845]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 4.6 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T18:28:18.771 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:28:18.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:18.772 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:18.827 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:28:18.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:18.828 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:28:18.920 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:28:18.920 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:28:18.920 INFO:teuthology.orchestra.run.smithi038.stdout:invalid new device string format 2024-09-13T18:28:19.049 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:28:19.049 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:28:19.049 INFO:teuthology.orchestra.run.smithi038.stdout:invalid new device string format 2024-09-13T18:28:19.049 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.149:3300" 2024-09-13T18:28:19.049 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:28:19.054 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T18:28:19.055 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T18:28:19.055 INFO:teuthology.orchestra.run.smithi038.stdout:invalid new device string format 2024-09-13T18:28:19.055 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.149:3300" 2024-09-13T18:28:19.055 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:28:19.055 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: resolved to: "172.21.15.38:6789,172.21.15.149:6789" 2024-09-13T18:28:19.055 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.38:6789,172.21.15.149:6789:/ 2024-09-13T18:28:19.055 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=ccb73e88-71fc-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T18:28:19.056 INFO:teuthology.orchestra.run.smithi038.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:28:19.056 INFO:teuthology.orchestra.run.smithi038.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:28:19.056 INFO:teuthology.orchestra.run.smithi038.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:28:19.056 INFO:teuthology.orchestra.run.smithi038.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:28:19.056 INFO:teuthology.orchestra.run.smithi038.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:28:19.059 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:28:19.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:19.059 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:19.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:19.088 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:28:19.150 INFO:teuthology.orchestra.run.smithi038.stdout:client24319 2024-09-13T18:28:19.150 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:28:19.150 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:19.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:19.208 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:28:19.269 INFO:teuthology.orchestra.run.smithi038.stdout:client24319 2024-09-13T18:28:19.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:19.270 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:28:19.330 INFO:teuthology.orchestra.run.smithi038.stdout:client24319 2024-09-13T18:28:19.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:19.331 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968.client24319/status') 2024-09-13T18:28:19.398 INFO:teuthology.orchestra.run.smithi038.stdout:instance: client.24319 (3)172.21.15.38:0/3203947527 2024-09-13T18:28:19.399 INFO:teuthology.orchestra.run.smithi038.stdout:blocklisted: false 2024-09-13T18:28:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:0+1 records in 2024-09-13T18:28:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:0+1 records out 2024-09-13T18:28:19.399 INFO:teuthology.orchestra.run.smithi038.stderr:71 bytes copied, 2.9561e-05 s, 2.4 MB/s 2024-09-13T18:28:19.400 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-13T18:28:19.400 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:28:19.401 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:19.401 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T18:28:19.648 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:28:20.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:20 smithi038 ceph-mon[27689]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T18:28:20.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:20 smithi149 ceph-mon[35845]: pgmap v197: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T18:28:21.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.303+0000 7f6dec0df640 1 -- 172.21.15.38:0/2316816726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de40ffb40 msgr2=0x7f6de40fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.303+0000 7f6dec0df640 1 --2- 172.21.15.38:0/2316816726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de40ffb40 0x7f6de40fffa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4009880 tx=0x7f6dd402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.303+0000 7f6dec0df640 1 -- 172.21.15.38:0/2316816726 shutdown_connections 2024-09-13T18:28:21.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.303+0000 7f6dec0df640 1 --2- 172.21.15.38:0/2316816726 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de40ffb40 0x7f6de40fffa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.303+0000 7f6dec0df640 1 --2- 172.21.15.38:0/2316816726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6de4105bf0 0x7f6de4105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.303+0000 7f6dec0df640 1 -- 172.21.15.38:0/2316816726 >> 172.21.15.38:0/2316816726 conn(0x7f6de40fb7e0 msgr2=0x7f6de40fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:21.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.303+0000 7f6dec0df640 1 -- 172.21.15.38:0/2316816726 shutdown_connections 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.303+0000 7f6dec0df640 1 -- 172.21.15.38:0/2316816726 wait complete. 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6dec0df640 1 Processor -- start 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6dec0df640 1 -- start start 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6dec0df640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de40ffb40 0x7f6de40727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6dec0df640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6de4105bf0 0x7f6de4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6dec0df640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de4073230 con 0x7f6de40ffb40 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6dec0df640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40733a0 con 0x7f6de4105bf0 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6de9e7b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de40ffb40 0x7f6de40727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6de9e7b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de40ffb40 0x7f6de40727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:39758/0 (socket says 172.21.15.38:39758) 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6de9e7b640 1 -- 172.21.15.38:0/2587420100 learned_addr learned my addr 172.21.15.38:0/2587420100 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6de967a640 1 --2- 172.21.15.38:0/2587420100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6de4105bf0 0x7f6de4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6de9e7b640 1 -- 172.21.15.38:0/2587420100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6de4105bf0 msgr2=0x7f6de4072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6de9e7b640 1 --2- 172.21.15.38:0/2587420100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6de4105bf0 0x7f6de4072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.304+0000 7f6de9e7b640 1 -- 172.21.15.38:0/2587420100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd4009560 con 0x7f6de40ffb40 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.305+0000 7f6de967a640 1 --2- 172.21.15.38:0/2587420100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6de4105bf0 0x7f6de4072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.305+0000 7f6de9e7b640 1 --2- 172.21.15.38:0/2587420100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de40ffb40 0x7f6de40727b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6de000d8d0 tx=0x7f6de000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.305+0000 7f6ddaffd640 1 -- 172.21.15.38:0/2587420100 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6de000bea0 con 0x7f6de40ffb40 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.305+0000 7f6ddaffd640 1 -- 172.21.15.38:0/2587420100 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6de0009c00 con 0x7f6de40ffb40 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.305+0000 7f6dec0df640 1 -- 172.21.15.38:0/2587420100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de41a1bb0 con 0x7f6de40ffb40 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.305+0000 7f6ddaffd640 1 -- 172.21.15.38:0/2587420100 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6de000f680 con 0x7f6de40ffb40 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.305+0000 7f6dec0df640 1 -- 172.21.15.38:0/2587420100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de41a1f10 con 0x7f6de40ffb40 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.306+0000 7f6dec0df640 1 -- 172.21.15.38:0/2587420100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de41011f0 con 0x7f6de40ffb40 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.306+0000 7f6ddaffd640 1 -- 172.21.15.38:0/2587420100 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6de0010460 con 0x7f6de40ffb40 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.307+0000 7f6ddaffd640 1 --2- 172.21.15.38:0/2587420100 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f6dd006cc50 0x7f6dd006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.307+0000 7f6ddaffd640 1 -- 172.21.15.38:0/2587420100 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f6de008bfd0 con 0x7f6de40ffb40 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.307+0000 7f6de967a640 1 --2- 172.21.15.38:0/2587420100 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f6dd006cc50 0x7f6dd006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:21.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.307+0000 7f6de967a640 1 --2- 172.21.15.38:0/2587420100 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f6dd006cc50 0x7f6dd006f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4006010 tx=0x7f6dd4005d50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:21.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.311+0000 7f6ddaffd640 1 -- 172.21.15.38:0/2587420100 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6de0059e50 con 0x7f6de40ffb40 2024-09-13T18:28:21.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.518+0000 7f6dec0df640 1 -- 172.21.15.38:0/2587420100 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6de4073560 con 0x7f6de40ffb40 2024-09-13T18:28:21.521 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:21 smithi038 ceph-mon[27689]: pgmap v198: 65 pgs: 65 active+clean; 581 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T18:28:21.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.518+0000 7f6ddaffd640 1 -- 172.21.15.38:0/2587420100 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7f6de4073560 con 0x7f6de40ffb40 2024-09-13T18:28:21.521 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T18:28:21.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.520+0000 7f6dec0df640 1 -- 172.21.15.38:0/2587420100 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f6dd006cc50 msgr2=0x7f6dd006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.520+0000 7f6dec0df640 1 --2- 172.21.15.38:0/2587420100 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f6dd006cc50 0x7f6dd006f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4006010 tx=0x7f6dd4005d50 comp rx=0 tx=0).stop 2024-09-13T18:28:21.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.520+0000 7f6dec0df640 1 -- 172.21.15.38:0/2587420100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de40ffb40 msgr2=0x7f6de40727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:21.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.520+0000 7f6dec0df640 1 --2- 172.21.15.38:0/2587420100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de40ffb40 0x7f6de40727b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6de000d8d0 tx=0x7f6de000dd90 comp rx=0 tx=0).stop 2024-09-13T18:28:21.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.520+0000 7f6dec0df640 1 -- 172.21.15.38:0/2587420100 shutdown_connections 2024-09-13T18:28:21.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.520+0000 7f6dec0df640 1 --2- 172.21.15.38:0/2587420100 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f6dd006cc50 0x7f6dd006f110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.520+0000 7f6dec0df640 1 --2- 172.21.15.38:0/2587420100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6de4105bf0 0x7f6de4072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.520+0000 7f6dec0df640 1 --2- 172.21.15.38:0/2587420100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6de40ffb40 0x7f6de40727b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:21.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.520+0000 7f6dec0df640 1 -- 172.21.15.38:0/2587420100 >> 172.21.15.38:0/2587420100 conn(0x7f6de40fb7e0 msgr2=0x7f6de40fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:21.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.521+0000 7f6dec0df640 1 -- 172.21.15.38:0/2587420100 shutdown_connections 2024-09-13T18:28:21.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:21.521+0000 7f6dec0df640 1 -- 172.21.15.38:0/2587420100 wait complete. 2024-09-13T18:28:21.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:21 smithi149 ceph-mon[35845]: pgmap v198: 65 pgs: 65 active+clean; 581 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T18:28:22.203 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:28:22.203 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:28:22.203 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-13T18:28:22.203 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:28:22.203 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:22.203 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:28:22.203 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:28:22.203 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:28:22.204 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:28:22.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:22.204 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-13T18:28:22.222 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:28:22.222 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:28:22.222 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:28:22.222 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:28:22.223 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42320sec preferred_lft 42320sec 2024-09-13T18:28:22.224 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link noprefixroute 2024-09-13T18:28:22.224 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:28:22.224 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:28:22.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:22.224 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-09-13T18:28:22.224 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-13T18:28:22.224 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:28:22.224 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2024-09-13T18:28:22.224 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2024-09-13T18:28:22.224 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:28:22.224 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-13T18:28:22.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:22.402 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:28:22.428 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-13T18:28:22.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:22.429 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-13T18:28:22.499 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-13T18:28:22.499 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:28:22.499 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:28:22.500 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:28:22.500 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:28:22.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:22.500 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-09-13T18:28:22.500 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-13T18:28:22.500 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:28:22.500 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:28:22.500 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:28:22.500 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-13T18:28:22.563 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:22 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/2587420100' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T18:28:22.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:22 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2587420100' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T18:28:22.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:22.774 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-13T18:28:22.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:22.832 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-09-13T18:28:22.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:22.887 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-09-13T18:28:22.887 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-13T18:28:22.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:28:22.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T18:28:22.888 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-13T18:28:22.968 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T18:28:22.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:22.968 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-09-13T18:28:22.968 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-13T18:28:22.968 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T18:28:22.968 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:28:22.968 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T18:28:22.968 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T18:28:22.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T18:28:22.969 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-13T18:28:23.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:23.098 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2024-09-13T18:28:23.098 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-13T18:28:23.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-13T18:28:23.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:28:23.099 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-13T18:28:23.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:23.137 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:23.194 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:28:23.194 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:28:23.194 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:23.249 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T18:28:23.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:23.250 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:28:23.353 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:28:23.354 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:28:23.354 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-13T18:28:23.384 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:23 smithi149 ceph-mon[35845]: pgmap v199: 65 pgs: 65 active+clean; 581 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-13T18:28:23.483 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:28:23.483 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:28:23.483 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-13T18:28:23.483 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.149:3300" 2024-09-13T18:28:23.483 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:28:23.488 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T18:28:23.488 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T18:28:23.488 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-13T18:28:23.488 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.38:3300,172.21.15.149:3300" 2024-09-13T18:28:23.488 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T18:28:23.488 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.38:6789,172.21.15.149:6789" 2024-09-13T18:28:23.488 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.38:6789,172.21.15.149:6789:/ 2024-09-13T18:28:23.488 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=ccb73e88-71fc-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T18:28:23.489 INFO:teuthology.orchestra.run.smithi149.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:28:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:28:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:28:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:28:23.489 INFO:teuthology.orchestra.run.smithi149.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:28:23.491 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:28:23.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:23.492 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:23.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:23.515 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:28:23.572 INFO:teuthology.orchestra.run.smithi149.stdout:client24323 2024-09-13T18:28:23.573 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:28:23.573 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:28:23.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:23 smithi038 ceph-mon[27689]: pgmap v199: 65 pgs: 65 active+clean; 581 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-13T18:28:23.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:23.629 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:28:23.685 INFO:teuthology.orchestra.run.smithi149.stdout:client24323 2024-09-13T18:28:23.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:23.686 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:28:23.742 INFO:teuthology.orchestra.run.smithi149.stdout:client24323 2024-09-13T18:28:23.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:28:23.743 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968.client24323/status') 2024-09-13T18:28:23.808 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.24323 (3)192.168.0.1:0/3153087224 2024-09-13T18:28:23.808 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2024-09-13T18:28:23.809 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2024-09-13T18:28:23.809 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2024-09-13T18:28:23.809 INFO:teuthology.orchestra.run.smithi149.stderr:70 bytes copied, 2.3699e-05 s, 3.0 MB/s 2024-09-13T18:28:23.810 INFO:teuthology.run_tasks:Running task print... 2024-09-13T18:28:23.820 INFO:teuthology.task.print:**** done client 2024-09-13T18:28:23.821 INFO:teuthology.run_tasks:Running task parallel... 2024-09-13T18:28:23.859 INFO:teuthology.task.parallel:starting parallel... 2024-09-13T18:28:23.860 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T18:28:23.860 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T18:28:23.861 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:28:23.861 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-13T18:28:23.861 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T18:28:23.862 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-13T18:28:23.866 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:28:23.866 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T18:28:23.866 INFO:tasks.workunit:timeout=3h 2024-09-13T18:28:23.866 INFO:tasks.workunit:cleanup=True 2024-09-13T18:28:23.866 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:23.888 INFO:teuthology.orchestra.run.smithi038.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:23.889 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T18:28:23.889 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 8dh/141d Inode: 1 Links: 2 2024-09-13T18:28:23.889 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:28:23.889 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T18:28:23.889 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T18:28:23.889 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-09-13 18:27:48.747305289 +0000 2024-09-13T18:28:23.889 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-09-13 18:28:19.080470635 +0000 2024-09-13T18:28:23.889 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: 2024-09-13 18:27:48.747305289 +0000 2024-09-13T18:28:23.889 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T18:28:23.889 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T18:28:23.962 DEBUG:teuthology.orchestra.run.smithi149:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-13T18:28:23.980 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-13T18:28:23.980 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:28:23.980 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T18:28:23.980 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T18:28:23.980 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-13 18:28:23.954377226 +0000 2024-09-13T18:28:23.980 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-13 18:28:23.954377226 +0000 2024-09-13T18:28:23.980 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-13 18:27:48.747305289 +0000 2024-09-13T18:28:23.980 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-13T18:28:23.981 DEBUG:teuthology.orchestra.run.smithi149:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-13T18:28:24.052 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:28:24.053 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:28:24.071 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T18:28:24.094 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:28:24.108 INFO:tasks.workunit.client.1.smithi149.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-13T18:28:25.485 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:25 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:28:25.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:25 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:28:25.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.831+0000 7f4938e7d640 1 -- 172.21.15.38:0/991165232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49340feaa0 msgr2=0x7f49340feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.831+0000 7f4938e7d640 1 --2- 172.21.15.38:0/991165232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49340feaa0 0x7f49340feea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4924009880 tx=0x7f492402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.831+0000 7f4938e7d640 1 -- 172.21.15.38:0/991165232 shutdown_connections 2024-09-13T18:28:25.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.831+0000 7f4938e7d640 1 --2- 172.21.15.38:0/991165232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49340ffca0 0x7f4934100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.831+0000 7f4938e7d640 1 --2- 172.21.15.38:0/991165232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49340feaa0 0x7f49340feea0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.831+0000 7f4938e7d640 1 -- 172.21.15.38:0/991165232 >> 172.21.15.38:0/991165232 conn(0x7f49340fa250 msgr2=0x7f49340fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:25.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.831+0000 7f4938e7d640 1 -- 172.21.15.38:0/991165232 shutdown_connections 2024-09-13T18:28:25.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.831+0000 7f4938e7d640 1 -- 172.21.15.38:0/991165232 wait complete. 2024-09-13T18:28:25.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.832+0000 7f4938e7d640 1 Processor -- start 2024-09-13T18:28:25.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.832+0000 7f4938e7d640 1 -- start start 2024-09-13T18:28:25.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.832+0000 7f4938e7d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49340feaa0 0x7f4934068ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.832+0000 7f4938e7d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49340ffca0 0x7f493419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.832+0000 7f4938e7d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493419a930 con 0x7f49340ffca0 2024-09-13T18:28:25.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.832+0000 7f4938e7d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493419aaa0 con 0x7f49340feaa0 2024-09-13T18:28:25.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.832+0000 7f492bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49340ffca0 0x7f493419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.832+0000 7f492bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49340ffca0 0x7f493419a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46046/0 (socket says 172.21.15.38:46046) 2024-09-13T18:28:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.832+0000 7f492bfff640 1 -- 172.21.15.38:0/2456634130 learned_addr learned my addr 172.21.15.38:0/2456634130 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.833+0000 7f493259c640 1 --2- 172.21.15.38:0/2456634130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49340feaa0 0x7f4934068ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.833+0000 7f492bfff640 1 -- 172.21.15.38:0/2456634130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49340feaa0 msgr2=0x7f4934068ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.833+0000 7f492bfff640 1 --2- 172.21.15.38:0/2456634130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49340feaa0 0x7f4934068ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.833+0000 7f492bfff640 1 -- 172.21.15.38:0/2456634130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4924009560 con 0x7f49340ffca0 2024-09-13T18:28:25.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.833+0000 7f492bfff640 1 --2- 172.21.15.38:0/2456634130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49340ffca0 0x7f493419a360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b420 tx=0x7f491c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.833+0000 7f492b7fe640 1 -- 172.21.15.38:0/2456634130 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f491c011800 con 0x7f49340ffca0 2024-09-13T18:28:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.833+0000 7f492b7fe640 1 -- 172.21.15.38:0/2456634130 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f491c011e00 con 0x7f49340ffca0 2024-09-13T18:28:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.833+0000 7f4938e7d640 1 -- 172.21.15.38:0/2456634130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493419ad80 con 0x7f49340ffca0 2024-09-13T18:28:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.833+0000 7f492b7fe640 1 -- 172.21.15.38:0/2456634130 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f491c00f2e0 con 0x7f49340ffca0 2024-09-13T18:28:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.833+0000 7f4938e7d640 1 -- 172.21.15.38:0/2456634130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493419b350 con 0x7f49340ffca0 2024-09-13T18:28:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.834+0000 7f4938e7d640 1 -- 172.21.15.38:0/2456634130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49341075d0 con 0x7f49340ffca0 2024-09-13T18:28:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.835+0000 7f492b7fe640 1 -- 172.21.15.38:0/2456634130 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f491c010380 con 0x7f49340ffca0 2024-09-13T18:28:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.835+0000 7f492b7fe640 1 --2- 172.21.15.38:0/2456634130 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f492006cc60 0x7f492006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.835+0000 7f493259c640 1 --2- 172.21.15.38:0/2456634130 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f492006cc60 0x7f492006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.835+0000 7f492b7fe640 1 -- 172.21.15.38:0/2456634130 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f491c08bbf0 con 0x7f49340ffca0 2024-09-13T18:28:25.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.836+0000 7f493259c640 1 --2- 172.21.15.38:0/2456634130 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f492006cc60 0x7f492006f120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4924006010 tx=0x7f4924004400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:25.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:25.840+0000 7f492b7fe640 1 -- 172.21.15.38:0/2456634130 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f491c055f60 con 0x7f49340ffca0 2024-09-13T18:28:26.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.035+0000 7f4938e7d640 1 -- 172.21.15.38:0/2456634130 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f493419b5a0 con 0x7f49340ffca0 2024-09-13T18:28:26.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.040+0000 7f492b7fe640 1 -- 172.21.15.38:0/2456634130 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v25)=0 v25) v1 ==== 126+0+0 (secure 0 0 0) 0x7f493419b5a0 con 0x7f49340ffca0 2024-09-13T18:28:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.042+0000 7f4938e7d640 1 -- 172.21.15.38:0/2456634130 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f492006cc60 msgr2=0x7f492006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.042+0000 7f4938e7d640 1 --2- 172.21.15.38:0/2456634130 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f492006cc60 0x7f492006f120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4924006010 tx=0x7f4924004400 comp rx=0 tx=0).stop 2024-09-13T18:28:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.042+0000 7f4938e7d640 1 -- 172.21.15.38:0/2456634130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49340ffca0 msgr2=0x7f493419a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.042+0000 7f4938e7d640 1 --2- 172.21.15.38:0/2456634130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49340ffca0 0x7f493419a360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b420 tx=0x7f491c00b8e0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.042+0000 7f4938e7d640 1 -- 172.21.15.38:0/2456634130 shutdown_connections 2024-09-13T18:28:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.042+0000 7f4938e7d640 1 --2- 172.21.15.38:0/2456634130 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f492006cc60 0x7f492006f120 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.042+0000 7f4938e7d640 1 --2- 172.21.15.38:0/2456634130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f49340ffca0 0x7f493419a360 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.043+0000 7f4938e7d640 1 --2- 172.21.15.38:0/2456634130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f49340feaa0 0x7f4934068ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.043+0000 7f4938e7d640 1 -- 172.21.15.38:0/2456634130 >> 172.21.15.38:0/2456634130 conn(0x7f49340fa250 msgr2=0x7f4934102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.043+0000 7f4938e7d640 1 -- 172.21.15.38:0/2456634130 shutdown_connections 2024-09-13T18:28:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:26.043+0000 7f4938e7d640 1 -- 172.21.15.38:0/2456634130 wait complete. 2024-09-13T18:28:26.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:26 smithi038 ceph-mon[27689]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-13T18:28:26.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:26 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2456634130' entity='client.admin' 2024-09-13T18:28:26.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:28:26.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:28:26.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:28:26.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:26 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:26.734 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T18:28:26.735 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:28:26.735 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T18:28:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:26 smithi149 ceph-mon[35845]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-13T18:28:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:26 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/2456634130' entity='client.admin' 2024-09-13T18:28:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:28:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:28:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:28:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:26 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:26.951 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:28:28.574 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:28 smithi038 ceph-mon[27689]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-13T18:28:28.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.578+0000 7f3de5c30640 1 -- 172.21.15.38:0/3397269247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de00fee30 msgr2=0x7f3de00ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:28.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.578+0000 7f3de5c30640 1 --2- 172.21.15.38:0/3397269247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de00fee30 0x7f3de00ff290 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009880 tx=0x7f3dc802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.578+0000 7f3de5c30640 1 -- 172.21.15.38:0/3397269247 shutdown_connections 2024-09-13T18:28:28.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.578+0000 7f3de5c30640 1 --2- 172.21.15.38:0/3397269247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de00fee30 0x7f3de00ff290 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.578+0000 7f3de5c30640 1 --2- 172.21.15.38:0/3397269247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3de00fe4f0 0x7f3de00fe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.578+0000 7f3de5c30640 1 -- 172.21.15.38:0/3397269247 >> 172.21.15.38:0/3397269247 conn(0x7f3de00fa280 msgr2=0x7f3de00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:28.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.578+0000 7f3de5c30640 1 -- 172.21.15.38:0/3397269247 shutdown_connections 2024-09-13T18:28:28.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.578+0000 7f3de5c30640 1 -- 172.21.15.38:0/3397269247 wait complete. 2024-09-13T18:28:28.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3de5c30640 1 Processor -- start 2024-09-13T18:28:28.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3de5c30640 1 -- start start 2024-09-13T18:28:28.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3de5c30640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3de00fe4f0 0x7f3de0197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:28.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3de5c30640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de00fee30 0x7f3de0197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:28.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3de5c30640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de01981f0 con 0x7f3de00fee30 2024-09-13T18:28:28.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3de5c30640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0198360 con 0x7f3de00fe4f0 2024-09-13T18:28:28.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3dd6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de00fee30 0x7f3de0197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:28.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3dd6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de00fee30 0x7f3de0197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46056/0 (socket says 172.21.15.38:46056) 2024-09-13T18:28:28.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3dd6ffd640 1 -- 172.21.15.38:0/3545612273 learned_addr learned my addr 172.21.15.38:0/3545612273 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:28.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3ddf7fe640 1 --2- 172.21.15.38:0/3545612273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3de00fe4f0 0x7f3de0197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:28.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3dd6ffd640 1 -- 172.21.15.38:0/3545612273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3de00fe4f0 msgr2=0x7f3de0197770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:28.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3dd6ffd640 1 --2- 172.21.15.38:0/3545612273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3de00fe4f0 0x7f3de0197770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.579+0000 7f3dd6ffd640 1 -- 172.21.15.38:0/3545612273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8009560 con 0x7f3de00fee30 2024-09-13T18:28:28.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.580+0000 7f3dd6ffd640 1 --2- 172.21.15.38:0/3545612273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de00fee30 0x7f3de0197cb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8031460 tx=0x7f3dc80056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:28.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.580+0000 7f3ddd7fa640 1 -- 172.21.15.38:0/3545612273 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dc8004c60 con 0x7f3de00fee30 2024-09-13T18:28:28.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.580+0000 7f3de5c30640 1 -- 172.21.15.38:0/3545612273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de019cde0 con 0x7f3de00fee30 2024-09-13T18:28:28.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.580+0000 7f3ddd7fa640 1 -- 172.21.15.38:0/3545612273 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3dc8003a90 con 0x7f3de00fee30 2024-09-13T18:28:28.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.580+0000 7f3ddd7fa640 1 -- 172.21.15.38:0/3545612273 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dc8031b10 con 0x7f3de00fee30 2024-09-13T18:28:28.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.580+0000 7f3de5c30640 1 -- 172.21.15.38:0/3545612273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de019d280 con 0x7f3de00fee30 2024-09-13T18:28:28.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.581+0000 7f3de5c30640 1 -- 172.21.15.38:0/3545612273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de010a890 con 0x7f3de00fee30 2024-09-13T18:28:28.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.581+0000 7f3ddd7fa640 1 -- 172.21.15.38:0/3545612273 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3dc8003c00 con 0x7f3de00fee30 2024-09-13T18:28:28.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.582+0000 7f3ddd7fa640 1 --2- 172.21.15.38:0/3545612273 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3dcc06cc50 0x7f3dcc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:28.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.582+0000 7f3ddd7fa640 1 -- 172.21.15.38:0/3545612273 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3dc80ad620 con 0x7f3de00fee30 2024-09-13T18:28:28.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.582+0000 7f3ddf7fe640 1 --2- 172.21.15.38:0/3545612273 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3dcc06cc50 0x7f3dcc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:28.586 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.583+0000 7f3ddf7fe640 1 --2- 172.21.15.38:0/3545612273 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3dcc06cc50 0x7f3dcc06f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000ba40 tx=0x7f3dd0005cc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:28.589 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.587+0000 7f3ddd7fa640 1 -- 172.21.15.38:0/3545612273 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3dc8077990 con 0x7f3de00fee30 2024-09-13T18:28:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.758+0000 7f3de5c30640 1 -- 172.21.15.38:0/3545612273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f3de010aa70 con 0x7f3de00fee30 2024-09-13T18:28:28.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.759+0000 7f3ddd7fa640 1 -- 172.21.15.38:0/3545612273 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v25)=0 v25) v1 ==== 155+0+0 (secure 0 0 0) 0x7f3dc807afb0 con 0x7f3de00fee30 2024-09-13T18:28:28.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.760+0000 7f3de5c30640 1 -- 172.21.15.38:0/3545612273 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3dcc06cc50 msgr2=0x7f3dcc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:28.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.760+0000 7f3de5c30640 1 --2- 172.21.15.38:0/3545612273 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3dcc06cc50 0x7f3dcc06f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000ba40 tx=0x7f3dd0005cc0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.760+0000 7f3de5c30640 1 -- 172.21.15.38:0/3545612273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de00fee30 msgr2=0x7f3de0197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:28.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.760+0000 7f3de5c30640 1 --2- 172.21.15.38:0/3545612273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de00fee30 0x7f3de0197cb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8031460 tx=0x7f3dc80056e0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.761+0000 7f3de5c30640 1 -- 172.21.15.38:0/3545612273 shutdown_connections 2024-09-13T18:28:28.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.761+0000 7f3de5c30640 1 --2- 172.21.15.38:0/3545612273 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3dcc06cc50 0x7f3dcc06f110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.761+0000 7f3de5c30640 1 --2- 172.21.15.38:0/3545612273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3de00fee30 0x7f3de0197cb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.761+0000 7f3de5c30640 1 --2- 172.21.15.38:0/3545612273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3de00fe4f0 0x7f3de0197770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:28.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.761+0000 7f3de5c30640 1 -- 172.21.15.38:0/3545612273 >> 172.21.15.38:0/3545612273 conn(0x7f3de00fa280 msgr2=0x7f3de0106b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:28.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.761+0000 7f3de5c30640 1 -- 172.21.15.38:0/3545612273 shutdown_connections 2024-09-13T18:28:28.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:28.761+0000 7f3de5c30640 1 -- 172.21.15.38:0/3545612273 wait complete. 2024-09-13T18:28:28.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:28 smithi149 ceph-mon[35845]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-13T18:28:29.523 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T18:28:29.738 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:28:30.560 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:30 smithi038 ceph-mon[27689]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-13T18:28:30.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:30 smithi149 ceph-mon[35845]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-13T18:28:31.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.492+0000 7fc69cbe6640 1 -- 172.21.15.38:0/1715006478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6980ffca0 msgr2=0x7fc698100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.492+0000 7fc69cbe6640 1 --2- 172.21.15.38:0/1715006478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6980ffca0 0x7fc698100120 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009880 tx=0x7fc68c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.493+0000 7fc69cbe6640 1 -- 172.21.15.38:0/1715006478 shutdown_connections 2024-09-13T18:28:31.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.493+0000 7fc69cbe6640 1 --2- 172.21.15.38:0/1715006478 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6980ffca0 0x7fc698100120 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.493+0000 7fc69cbe6640 1 --2- 172.21.15.38:0/1715006478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6980feaa0 0x7fc6980feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.493+0000 7fc69cbe6640 1 -- 172.21.15.38:0/1715006478 >> 172.21.15.38:0/1715006478 conn(0x7fc6980fa250 msgr2=0x7fc6980fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:31.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.493+0000 7fc69cbe6640 1 -- 172.21.15.38:0/1715006478 shutdown_connections 2024-09-13T18:28:31.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.493+0000 7fc69cbe6640 1 -- 172.21.15.38:0/1715006478 wait complete. 2024-09-13T18:28:31.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.493+0000 7fc69cbe6640 1 Processor -- start 2024-09-13T18:28:31.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc69cbe6640 1 -- start start 2024-09-13T18:28:31.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc69cbe6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6980feaa0 0x7fc698195580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc69cbe6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6980ffca0 0x7fc698195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc69cbe6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc698196090 con 0x7fc6980ffca0 2024-09-13T18:28:31.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc69cbe6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc698196200 con 0x7fc6980feaa0 2024-09-13T18:28:31.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc695d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6980ffca0 0x7fc698195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc695d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6980ffca0 0x7fc698195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:46074/0 (socket says 172.21.15.38:46074) 2024-09-13T18:28:31.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc695d9b640 1 -- 172.21.15.38:0/2644477398 learned_addr learned my addr 172.21.15.38:0/2644477398 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:31.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc69659c640 1 --2- 172.21.15.38:0/2644477398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6980feaa0 0x7fc698195580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc695d9b640 1 -- 172.21.15.38:0/2644477398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6980feaa0 msgr2=0x7fc698195580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc695d9b640 1 --2- 172.21.15.38:0/2644477398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6980feaa0 0x7fc698195580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc695d9b640 1 -- 172.21.15.38:0/2644477398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c009560 con 0x7fc6980ffca0 2024-09-13T18:28:31.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.494+0000 7fc695d9b640 1 --2- 172.21.15.38:0/2644477398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6980ffca0 0x7fc698195ac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0099a0 tx=0x7fc68c0055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.495+0000 7fc6877fe640 1 -- 172.21.15.38:0/2644477398 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc68c004aa0 con 0x7fc6980ffca0 2024-09-13T18:28:31.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.495+0000 7fc69cbe6640 1 -- 172.21.15.38:0/2644477398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69819ac40 con 0x7fc6980ffca0 2024-09-13T18:28:31.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.495+0000 7fc6877fe640 1 -- 172.21.15.38:0/2644477398 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc68c004c00 con 0x7fc6980ffca0 2024-09-13T18:28:31.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.495+0000 7fc6877fe640 1 -- 172.21.15.38:0/2644477398 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc68c031950 con 0x7fc6980ffca0 2024-09-13T18:28:31.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.495+0000 7fc69cbe6640 1 -- 172.21.15.38:0/2644477398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69819b1b0 con 0x7fc6980ffca0 2024-09-13T18:28:31.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.496+0000 7fc69cbe6640 1 -- 172.21.15.38:0/2644477398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc698107570 con 0x7fc6980ffca0 2024-09-13T18:28:31.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.496+0000 7fc6877fe640 1 -- 172.21.15.38:0/2644477398 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc68c031c10 con 0x7fc6980ffca0 2024-09-13T18:28:31.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.497+0000 7fc6877fe640 1 --2- 172.21.15.38:0/2644477398 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc68006cc60 0x7fc68006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:31.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.497+0000 7fc6877fe640 1 -- 172.21.15.38:0/2644477398 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc68c0ad470 con 0x7fc6980ffca0 2024-09-13T18:28:31.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.497+0000 7fc69659c640 1 --2- 172.21.15.38:0/2644477398 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc68006cc60 0x7fc68006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:31.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.497+0000 7fc69659c640 1 --2- 172.21.15.38:0/2644477398 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc68006cc60 0x7fc68006f120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc688005fd0 tx=0x7fc68800b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:31.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.501+0000 7fc6877fe640 1 -- 172.21.15.38:0/2644477398 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc68c077890 con 0x7fc6980ffca0 2024-09-13T18:28:31.510 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:31 smithi038 ceph-mon[27689]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T18:28:31.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.676+0000 7fc69cbe6640 1 -- 172.21.15.38:0/2644477398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fc698107790 con 0x7fc6980ffca0 2024-09-13T18:28:31.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.676+0000 7fc6877fe640 1 -- 172.21.15.38:0/2644477398 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v25)=0 v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc698107790 con 0x7fc6980ffca0 2024-09-13T18:28:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.678+0000 7fc69cbe6640 1 -- 172.21.15.38:0/2644477398 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc68006cc60 msgr2=0x7fc68006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.678+0000 7fc69cbe6640 1 --2- 172.21.15.38:0/2644477398 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc68006cc60 0x7fc68006f120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc688005fd0 tx=0x7fc68800b390 comp rx=0 tx=0).stop 2024-09-13T18:28:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.678+0000 7fc69cbe6640 1 -- 172.21.15.38:0/2644477398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6980ffca0 msgr2=0x7fc698195ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.678+0000 7fc69cbe6640 1 --2- 172.21.15.38:0/2644477398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6980ffca0 0x7fc698195ac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0099a0 tx=0x7fc68c0055c0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.679+0000 7fc69cbe6640 1 -- 172.21.15.38:0/2644477398 shutdown_connections 2024-09-13T18:28:31.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.679+0000 7fc69cbe6640 1 --2- 172.21.15.38:0/2644477398 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc68006cc60 0x7fc68006f120 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.679+0000 7fc69cbe6640 1 --2- 172.21.15.38:0/2644477398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6980ffca0 0x7fc698195ac0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.679+0000 7fc69cbe6640 1 --2- 172.21.15.38:0/2644477398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6980feaa0 0x7fc698195580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:31.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.679+0000 7fc69cbe6640 1 -- 172.21.15.38:0/2644477398 >> 172.21.15.38:0/2644477398 conn(0x7fc6980fa250 msgr2=0x7fc698068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:31.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.679+0000 7fc69cbe6640 1 -- 172.21.15.38:0/2644477398 shutdown_connections 2024-09-13T18:28:31.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:31.679+0000 7fc69cbe6640 1 -- 172.21.15.38:0/2644477398 wait complete. 2024-09-13T18:28:31.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:31 smithi149 ceph-mon[35845]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T18:28:32.379 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T18:28:32.592 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:28:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.330+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1379776784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2d40feaf0 msgr2=0x7fb2d40feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.330+0000 7fb2dc2cd640 1 --2- 172.21.15.38:0/1379776784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2d40feaf0 0x7fb2d40feef0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009880 tx=0x7fb2d002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.330+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1379776784 shutdown_connections 2024-09-13T18:28:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.330+0000 7fb2dc2cd640 1 --2- 172.21.15.38:0/1379776784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d40ffcf0 0x7fb2d4100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.330+0000 7fb2dc2cd640 1 --2- 172.21.15.38:0/1379776784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2d40feaf0 0x7fb2d40feef0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.330+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1379776784 >> 172.21.15.38:0/1379776784 conn(0x7fb2d40fa280 msgr2=0x7fb2d40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.330+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1379776784 shutdown_connections 2024-09-13T18:28:34.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.330+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1379776784 wait complete. 2024-09-13T18:28:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2dc2cd640 1 Processor -- start 2024-09-13T18:28:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2dc2cd640 1 -- start start 2024-09-13T18:28:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2dc2cd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2d40feaf0 0x7fb2d40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2dc2cd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d40ffcf0 0x7fb2d419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2dc2cd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d419a810 con 0x7fb2d40feaf0 2024-09-13T18:28:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2dc2cd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d419a980 con 0x7fb2d40ffcf0 2024-09-13T18:28:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2da069640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2d40feaf0 0x7fb2d40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2da069640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2d40feaf0 0x7fb2d40687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34650/0 (socket says 172.21.15.38:34650) 2024-09-13T18:28:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2da069640 1 -- 172.21.15.38:0/1880108078 learned_addr learned my addr 172.21.15.38:0/1880108078 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:34.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2d9868640 1 --2- 172.21.15.38:0/1880108078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d40ffcf0 0x7fb2d419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2da069640 1 -- 172.21.15.38:0/1880108078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d40ffcf0 msgr2=0x7fb2d419a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2da069640 1 --2- 172.21.15.38:0/1880108078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d40ffcf0 0x7fb2d419a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.331+0000 7fb2da069640 1 -- 172.21.15.38:0/1880108078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d0009560 con 0x7fb2d40feaf0 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.332+0000 7fb2da069640 1 --2- 172.21.15.38:0/1880108078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2d40feaf0 0x7fb2d40687d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0006010 tx=0x7fb2d00055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.332+0000 7fb2cb7fe640 1 -- 172.21.15.38:0/1880108078 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2d0004b20 con 0x7fb2d40feaf0 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.332+0000 7fb2cb7fe640 1 -- 172.21.15.38:0/1880108078 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb2d0004c80 con 0x7fb2d40feaf0 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.332+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1880108078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d419ac00 con 0x7fb2d40feaf0 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.332+0000 7fb2cb7fe640 1 -- 172.21.15.38:0/1880108078 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2d0031b00 con 0x7fb2d40feaf0 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.332+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1880108078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d419b0f0 con 0x7fb2d40feaf0 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.333+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1880108078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d41075a0 con 0x7fb2d40feaf0 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.333+0000 7fb2cb7fe640 1 -- 172.21.15.38:0/1880108078 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb2d00035f0 con 0x7fb2d40feaf0 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.334+0000 7fb2cb7fe640 1 --2- 172.21.15.38:0/1880108078 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb2c006cc60 0x7fb2c006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.334+0000 7fb2cb7fe640 1 -- 172.21.15.38:0/1880108078 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb2d00ad530 con 0x7fb2d40feaf0 2024-09-13T18:28:34.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.334+0000 7fb2d9868640 1 --2- 172.21.15.38:0/1880108078 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb2c006cc60 0x7fb2c006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.334+0000 7fb2d9868640 1 --2- 172.21.15.38:0/1880108078 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb2c006cc60 0x7fb2c006f120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4005e10 tx=0x7fb2c4005da0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:34.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.338+0000 7fb2cb7fe640 1 -- 172.21.15.38:0/1880108078 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb2d00778a0 con 0x7fb2d40feaf0 2024-09-13T18:28:34.351 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:34 smithi038 ceph-mon[27689]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-13T18:28:34.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.512+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1880108078 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fb2d4107730 con 0x7fb2d40feaf0 2024-09-13T18:28:34.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.512+0000 7fb2cb7fe640 1 -- 172.21.15.38:0/1880108078 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v25)=0 v25) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb2d0077030 con 0x7fb2d40feaf0 2024-09-13T18:28:34.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.514+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1880108078 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb2c006cc60 msgr2=0x7fb2c006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.514+0000 7fb2dc2cd640 1 --2- 172.21.15.38:0/1880108078 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb2c006cc60 0x7fb2c006f120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4005e10 tx=0x7fb2c4005da0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.514+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1880108078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2d40feaf0 msgr2=0x7fb2d40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:34.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.514+0000 7fb2dc2cd640 1 --2- 172.21.15.38:0/1880108078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2d40feaf0 0x7fb2d40687d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0006010 tx=0x7fb2d00055f0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.514+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1880108078 shutdown_connections 2024-09-13T18:28:34.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.514+0000 7fb2dc2cd640 1 --2- 172.21.15.38:0/1880108078 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fb2c006cc60 0x7fb2c006f120 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.514+0000 7fb2dc2cd640 1 --2- 172.21.15.38:0/1880108078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2d40ffcf0 0x7fb2d419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.514+0000 7fb2dc2cd640 1 --2- 172.21.15.38:0/1880108078 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2d40feaf0 0x7fb2d40687d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:34.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.514+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1880108078 >> 172.21.15.38:0/1880108078 conn(0x7fb2d40fa280 msgr2=0x7fb2d4102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:34.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.514+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1880108078 shutdown_connections 2024-09-13T18:28:34.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:34.515+0000 7fb2dc2cd640 1 -- 172.21.15.38:0/1880108078 wait complete. 2024-09-13T18:28:34.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:34 smithi149 ceph-mon[35845]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-13T18:28:35.313 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-13T18:28:35.529 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:28:36.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:36 smithi038 ceph-mon[27689]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-13T18:28:36.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:36 smithi149 ceph-mon[35845]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.197+0000 7f144647c640 1 -- 172.21.15.38:0/2704824258 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1440100d90 msgr2=0x7f1440101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.197+0000 7f144647c640 1 --2- 172.21.15.38:0/2704824258 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1440100d90 0x7f1440101210 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1434009880 tx=0x7f143402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.197+0000 7f144647c640 1 -- 172.21.15.38:0/2704824258 shutdown_connections 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.197+0000 7f144647c640 1 --2- 172.21.15.38:0/2704824258 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1440100d90 0x7f1440101210 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.197+0000 7f144647c640 1 --2- 172.21.15.38:0/2704824258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14400ffb90 0x7f14400fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.197+0000 7f144647c640 1 -- 172.21.15.38:0/2704824258 >> 172.21.15.38:0/2704824258 conn(0x7f14400fb320 msgr2=0x7f14400fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.197+0000 7f144647c640 1 -- 172.21.15.38:0/2704824258 shutdown_connections 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.197+0000 7f144647c640 1 -- 172.21.15.38:0/2704824258 wait complete. 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.198+0000 7f144647c640 1 Processor -- start 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.198+0000 7f144647c640 1 -- start start 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.198+0000 7f144647c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14400ffb90 0x7f1440074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:37.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.198+0000 7f144647c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1440100d90 0x7f14400728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.198+0000 7f144647c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440072de0 con 0x7f1440100d90 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.198+0000 7f144647c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440072f50 con 0x7f14400ffb90 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f143f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1440100d90 0x7f14400728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f143f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1440100d90 0x7f14400728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34660/0 (socket says 172.21.15.38:34660) 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f143f7fe640 1 -- 172.21.15.38:0/3463787718 learned_addr learned my addr 172.21.15.38:0/3463787718 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f143ffff640 1 --2- 172.21.15.38:0/3463787718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14400ffb90 0x7f1440074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f143f7fe640 1 -- 172.21.15.38:0/3463787718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14400ffb90 msgr2=0x7f1440074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f143f7fe640 1 --2- 172.21.15.38:0/3463787718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14400ffb90 0x7f1440074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f143f7fe640 1 -- 172.21.15.38:0/3463787718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434009560 con 0x7f1440100d90 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f143f7fe640 1 --2- 172.21.15.38:0/3463787718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1440100d90 0x7f14400728a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1434031460 tx=0x7f14340056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f143d7fa640 1 -- 172.21.15.38:0/3463787718 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1434004c60 con 0x7f1440100d90 2024-09-13T18:28:37.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f144647c640 1 -- 172.21.15.38:0/3463787718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14400731d0 con 0x7f1440100d90 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f143d7fa640 1 -- 172.21.15.38:0/3463787718 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1434003a90 con 0x7f1440100d90 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f143d7fa640 1 -- 172.21.15.38:0/3463787718 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1434031b10 con 0x7f1440100d90 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.199+0000 7f144647c640 1 -- 172.21.15.38:0/3463787718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144019d5a0 con 0x7f1440100d90 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.201+0000 7f144647c640 1 -- 172.21.15.38:0/3463787718 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14400fff90 con 0x7f1440100d90 2024-09-13T18:28:37.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.201+0000 7f143d7fa640 1 -- 172.21.15.38:0/3463787718 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f14340035f0 con 0x7f1440100d90 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.201+0000 7f143d7fa640 1 --2- 172.21.15.38:0/3463787718 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f142806cc50 0x7f142806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.201+0000 7f143d7fa640 1 -- 172.21.15.38:0/3463787718 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f14340ad640 con 0x7f1440100d90 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.201+0000 7f143ffff640 1 --2- 172.21.15.38:0/3463787718 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f142806cc50 0x7f142806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:37.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.202+0000 7f143ffff640 1 --2- 172.21.15.38:0/3463787718 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f142806cc50 0x7f142806f110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1430005db0 tx=0x7f1430005d40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:37.208 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.206+0000 7f143d7fa640 1 -- 172.21.15.38:0/3463787718 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f14340779b0 con 0x7f1440100d90 2024-09-13T18:28:37.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.394+0000 7f144647c640 1 -- 172.21.15.38:0/3463787718 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1440060990 con 0x7f142806cc50 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.401+0000 7f143d7fa640 1 -- 172.21.15.38:0/3463787718 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f1440060990 con 0x7f142806cc50 2024-09-13T18:28:37.403 INFO:teuthology.orchestra.run.smithi038.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.403+0000 7f144647c640 1 -- 172.21.15.38:0/3463787718 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f142806cc50 msgr2=0x7f142806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.403+0000 7f144647c640 1 --2- 172.21.15.38:0/3463787718 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f142806cc50 0x7f142806f110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1430005db0 tx=0x7f1430005d40 comp rx=0 tx=0).stop 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.403+0000 7f144647c640 1 -- 172.21.15.38:0/3463787718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1440100d90 msgr2=0x7f14400728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.403+0000 7f144647c640 1 --2- 172.21.15.38:0/3463787718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1440100d90 0x7f14400728a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1434031460 tx=0x7f14340056e0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.403+0000 7f144647c640 1 -- 172.21.15.38:0/3463787718 shutdown_connections 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.403+0000 7f144647c640 1 --2- 172.21.15.38:0/3463787718 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f142806cc50 0x7f142806f110 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.403+0000 7f144647c640 1 --2- 172.21.15.38:0/3463787718 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1440100d90 0x7f14400728a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.403+0000 7f144647c640 1 --2- 172.21.15.38:0/3463787718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14400ffb90 0x7f1440074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:37.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.403+0000 7f144647c640 1 -- 172.21.15.38:0/3463787718 >> 172.21.15.38:0/3463787718 conn(0x7f14400fb320 msgr2=0x7f14401044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.404+0000 7f144647c640 1 -- 172.21.15.38:0/3463787718 shutdown_connections 2024-09-13T18:28:37.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:37.404+0000 7f144647c640 1 -- 172.21.15.38:0/3463787718 wait complete. 2024-09-13T18:28:37.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:37 smithi038 ceph-mon[27689]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T18:28:37.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:37 smithi149 ceph-mon[35845]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T18:28:38.126 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T18:28:38.126 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:28:38.127 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-13T18:28:38.342 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:28:38.757 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:38 smithi038 ceph-mon[27689]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:28:38.757 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:38 smithi038 ceph-mon[27689]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:28:38.757 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:38.757 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:28:38.757 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:28:38.757 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:28:38.757 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:38 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:38.757 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:38 smithi038 ceph-mon[27689]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:28:38.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:38 smithi149 ceph-mon[35845]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:28:38.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:38 smithi149 ceph-mon[35845]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:28:38.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:38.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:28:38.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:28:38.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:28:38.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:38 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:28:38.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:38 smithi149 ceph-mon[35845]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:28:39.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:39 smithi038 ceph-mon[27689]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T18:28:39.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:39 smithi149 ceph-mon[35845]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T18:28:40.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.278+0000 7f4c4e890640 1 -- 172.21.15.38:0/4011513399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c48102f90 msgr2=0x7f4c48103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.278+0000 7f4c4e890640 1 --2- 172.21.15.38:0/4011513399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c48102f90 0x7f4c48103410 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009880 tx=0x7f4c3c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.278+0000 7f4c4e890640 1 -- 172.21.15.38:0/4011513399 shutdown_connections 2024-09-13T18:28:40.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.278+0000 7f4c4e890640 1 --2- 172.21.15.38:0/4011513399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c48102f90 0x7f4c48103410 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.278+0000 7f4c4e890640 1 --2- 172.21.15.38:0/4011513399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c48101d90 0x7f4c48102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.278+0000 7f4c4e890640 1 -- 172.21.15.38:0/4011513399 >> 172.21.15.38:0/4011513399 conn(0x7f4c480fd540 msgr2=0x7f4c480ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.279+0000 7f4c4e890640 1 -- 172.21.15.38:0/4011513399 shutdown_connections 2024-09-13T18:28:40.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.279+0000 7f4c4e890640 1 -- 172.21.15.38:0/4011513399 wait complete. 2024-09-13T18:28:40.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.279+0000 7f4c4e890640 1 Processor -- start 2024-09-13T18:28:40.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.279+0000 7f4c4e890640 1 -- start start 2024-09-13T18:28:40.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.280+0000 7f4c4e890640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c48101d90 0x7f4c48197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.280+0000 7f4c4e890640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c48102f90 0x7f4c48197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.280+0000 7f4c4e890640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c481981a0 con 0x7f4c48101d90 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.280+0000 7f4c4e890640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48198310 con 0x7f4c48102f90 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.280+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c48101d90 0x7f4c48197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.280+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c48101d90 0x7f4c48197720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34668/0 (socket says 172.21.15.38:34668) 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.280+0000 7f4c47fff640 1 -- 172.21.15.38:0/2687366906 learned_addr learned my addr 172.21.15.38:0/2687366906 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.280+0000 7f4c477fe640 1 --2- 172.21.15.38:0/2687366906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c48102f90 0x7f4c48197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.280+0000 7f4c47fff640 1 -- 172.21.15.38:0/2687366906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c48102f90 msgr2=0x7f4c48197c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.280+0000 7f4c47fff640 1 --2- 172.21.15.38:0/2687366906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c48102f90 0x7f4c48197c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.280+0000 7f4c47fff640 1 -- 172.21.15.38:0/2687366906 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c009560 con 0x7f4c48101d90 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.280+0000 7f4c47fff640 1 --2- 172.21.15.38:0/2687366906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c48101d90 0x7f4c48197720 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800c8f0 tx=0x7f4c3800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.281+0000 7f4c457fa640 1 -- 172.21.15.38:0/2687366906 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c380041f0 con 0x7f4c48101d90 2024-09-13T18:28:40.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.281+0000 7f4c4e890640 1 -- 172.21.15.38:0/2687366906 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4819cdf0 con 0x7f4c48101d90 2024-09-13T18:28:40.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.281+0000 7f4c457fa640 1 -- 172.21.15.38:0/2687366906 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c38007df0 con 0x7f4c48101d90 2024-09-13T18:28:40.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.281+0000 7f4c457fa640 1 -- 172.21.15.38:0/2687366906 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c3800f450 con 0x7f4c48101d90 2024-09-13T18:28:40.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.281+0000 7f4c4e890640 1 -- 172.21.15.38:0/2687366906 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4819d2e0 con 0x7f4c48101d90 2024-09-13T18:28:40.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.282+0000 7f4c4e890640 1 -- 172.21.15.38:0/2687366906 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4810a840 con 0x7f4c48101d90 2024-09-13T18:28:40.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.282+0000 7f4c457fa640 1 -- 172.21.15.38:0/2687366906 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4c38007950 con 0x7f4c48101d90 2024-09-13T18:28:40.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.283+0000 7f4c457fa640 1 --2- 172.21.15.38:0/2687366906 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4c3006cc50 0x7f4c3006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.283+0000 7f4c457fa640 1 -- 172.21.15.38:0/2687366906 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4c38013070 con 0x7f4c48101d90 2024-09-13T18:28:40.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.283+0000 7f4c477fe640 1 --2- 172.21.15.38:0/2687366906 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4c3006cc50 0x7f4c3006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.283+0000 7f4c477fe640 1 --2- 172.21.15.38:0/2687366906 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4c3006cc50 0x7f4c3006f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4c48198c40 tx=0x7f4c3c031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.287+0000 7f4c457fa640 1 -- 172.21.15.38:0/2687366906 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4c380566e0 con 0x7f4c48101d90 2024-09-13T18:28:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.502+0000 7f4c4e890640 1 -- 172.21.15.38:0/2687366906 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c4819d560 con 0x7f4c3006cc50 2024-09-13T18:28:40.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.503+0000 7f4c457fa640 1 -- 172.21.15.38:0/2687366906 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f4c4819d560 con 0x7f4c3006cc50 2024-09-13T18:28:40.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.505+0000 7f4c4e890640 1 -- 172.21.15.38:0/2687366906 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4c3006cc50 msgr2=0x7f4c3006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.505+0000 7f4c4e890640 1 --2- 172.21.15.38:0/2687366906 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4c3006cc50 0x7f4c3006f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4c48198c40 tx=0x7f4c3c031400 comp rx=0 tx=0).stop 2024-09-13T18:28:40.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.505+0000 7f4c4e890640 1 -- 172.21.15.38:0/2687366906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c48101d90 msgr2=0x7f4c48197720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.505+0000 7f4c4e890640 1 --2- 172.21.15.38:0/2687366906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c48101d90 0x7f4c48197720 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800c8f0 tx=0x7f4c3800cdb0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.506+0000 7f4c4e890640 1 -- 172.21.15.38:0/2687366906 shutdown_connections 2024-09-13T18:28:40.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.506+0000 7f4c4e890640 1 --2- 172.21.15.38:0/2687366906 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f4c3006cc50 0x7f4c3006f110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.506+0000 7f4c4e890640 1 --2- 172.21.15.38:0/2687366906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c48102f90 0x7f4c48197c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.506+0000 7f4c4e890640 1 --2- 172.21.15.38:0/2687366906 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c48101d90 0x7f4c48197720 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.506+0000 7f4c4e890640 1 -- 172.21.15.38:0/2687366906 >> 172.21.15.38:0/2687366906 conn(0x7f4c480fd540 msgr2=0x7f4c481061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.506+0000 7f4c4e890640 1 -- 172.21.15.38:0/2687366906 shutdown_connections 2024-09-13T18:28:40.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.506+0000 7f4c4e890640 1 -- 172.21.15.38:0/2687366906 wait complete. 2024-09-13T18:28:40.518 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:28:40.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:40 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:28:40.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.600+0000 7fdd9a52d640 1 -- 172.21.15.38:0/3312359688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd940ffb90 msgr2=0x7fdd940fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.600+0000 7fdd9a52d640 1 --2- 172.21.15.38:0/3312359688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd940ffb90 0x7fdd940fff90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009880 tx=0x7fdd8402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.600+0000 7fdd9a52d640 1 -- 172.21.15.38:0/3312359688 shutdown_connections 2024-09-13T18:28:40.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.600+0000 7fdd9a52d640 1 --2- 172.21.15.38:0/3312359688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd94100d90 0x7fdd94101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.600+0000 7fdd9a52d640 1 --2- 172.21.15.38:0/3312359688 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd940ffb90 0x7fdd940fff90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.600+0000 7fdd9a52d640 1 -- 172.21.15.38:0/3312359688 >> 172.21.15.38:0/3312359688 conn(0x7fdd940fb360 msgr2=0x7fdd940fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.600+0000 7fdd9a52d640 1 -- 172.21.15.38:0/3312359688 shutdown_connections 2024-09-13T18:28:40.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.600+0000 7fdd9a52d640 1 -- 172.21.15.38:0/3312359688 wait complete. 2024-09-13T18:28:40.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.600+0000 7fdd9a52d640 1 Processor -- start 2024-09-13T18:28:40.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.601+0000 7fdd9a52d640 1 -- start start 2024-09-13T18:28:40.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.601+0000 7fdd9a52d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd940ffb90 0x7fdd94074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.601+0000 7fdd9a52d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd94100d90 0x7fdd940728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.601+0000 7fdd9a52d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94072de0 con 0x7fdd94100d90 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.601+0000 7fdd9a52d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94072f50 con 0x7fdd940ffb90 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.601+0000 7fdd937fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd94100d90 0x7fdd940728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.601+0000 7fdd937fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd94100d90 0x7fdd940728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34684/0 (socket says 172.21.15.38:34684) 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.601+0000 7fdd937fe640 1 -- 172.21.15.38:0/1500243310 learned_addr learned my addr 172.21.15.38:0/1500243310 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.601+0000 7fdd93fff640 1 --2- 172.21.15.38:0/1500243310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd940ffb90 0x7fdd94074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.602+0000 7fdd937fe640 1 -- 172.21.15.38:0/1500243310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd940ffb90 msgr2=0x7fdd94074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.602+0000 7fdd937fe640 1 --2- 172.21.15.38:0/1500243310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd940ffb90 0x7fdd94074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.602+0000 7fdd937fe640 1 -- 172.21.15.38:0/1500243310 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84009560 con 0x7fdd94100d90 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.602+0000 7fdd937fe640 1 --2- 172.21.15.38:0/1500243310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd94100d90 0x7fdd940728a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800c8f0 tx=0x7fdd8800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.602+0000 7fdd917fa640 1 -- 172.21.15.38:0/1500243310 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd88007b80 con 0x7fdd94100d90 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.602+0000 7fdd9a52d640 1 -- 172.21.15.38:0/1500243310 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd94073230 con 0x7fdd94100d90 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.602+0000 7fdd917fa640 1 -- 172.21.15.38:0/1500243310 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdd88007ce0 con 0x7fdd94100d90 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.602+0000 7fdd917fa640 1 -- 172.21.15.38:0/1500243310 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd8800f450 con 0x7fdd94100d90 2024-09-13T18:28:40.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.602+0000 7fdd9a52d640 1 -- 172.21.15.38:0/1500243310 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9419d570 con 0x7fdd94100d90 2024-09-13T18:28:40.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.603+0000 7fdd9a52d640 1 -- 172.21.15.38:0/1500243310 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd80005280 con 0x7fdd94100d90 2024-09-13T18:28:40.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.604+0000 7fdd917fa640 1 -- 172.21.15.38:0/1500243310 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdd88004f10 con 0x7fdd94100d90 2024-09-13T18:28:40.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.604+0000 7fdd917fa640 1 --2- 172.21.15.38:0/1500243310 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fdd7c06cc50 0x7fdd7c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.604+0000 7fdd917fa640 1 -- 172.21.15.38:0/1500243310 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdd8808bf70 con 0x7fdd94100d90 2024-09-13T18:28:40.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.605+0000 7fdd93fff640 1 --2- 172.21.15.38:0/1500243310 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fdd7c06cc50 0x7fdd7c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.605+0000 7fdd93fff640 1 --2- 172.21.15.38:0/1500243310 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fdd7c06cc50 0x7fdd7c06f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd84000c00 tx=0x7fdd84031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.609+0000 7fdd917fa640 1 -- 172.21.15.38:0/1500243310 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdd880bfe20 con 0x7fdd94100d90 2024-09-13T18:28:40.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:40 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:28:40.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.821+0000 7fdd9a52d640 1 -- 172.21.15.38:0/1500243310 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd80000bf0 con 0x7fdd7c06cc50 2024-09-13T18:28:40.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.822+0000 7fdd917fa640 1 -- 172.21.15.38:0/1500243310 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fdd80000bf0 con 0x7fdd7c06cc50 2024-09-13T18:28:40.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.824+0000 7fdd9a52d640 1 -- 172.21.15.38:0/1500243310 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fdd7c06cc50 msgr2=0x7fdd7c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.824+0000 7fdd9a52d640 1 --2- 172.21.15.38:0/1500243310 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fdd7c06cc50 0x7fdd7c06f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd84000c00 tx=0x7fdd84031400 comp rx=0 tx=0).stop 2024-09-13T18:28:40.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.824+0000 7fdd9a52d640 1 -- 172.21.15.38:0/1500243310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd94100d90 msgr2=0x7fdd940728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.824+0000 7fdd9a52d640 1 --2- 172.21.15.38:0/1500243310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd94100d90 0x7fdd940728a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800c8f0 tx=0x7fdd8800cdb0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.824+0000 7fdd9a52d640 1 -- 172.21.15.38:0/1500243310 shutdown_connections 2024-09-13T18:28:40.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.824+0000 7fdd9a52d640 1 --2- 172.21.15.38:0/1500243310 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fdd7c06cc50 0x7fdd7c06f110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.824+0000 7fdd9a52d640 1 --2- 172.21.15.38:0/1500243310 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdd94100d90 0x7fdd940728a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.824+0000 7fdd9a52d640 1 --2- 172.21.15.38:0/1500243310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd940ffb90 0x7fdd94074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.824+0000 7fdd9a52d640 1 -- 172.21.15.38:0/1500243310 >> 172.21.15.38:0/1500243310 conn(0x7fdd940fb360 msgr2=0x7fdd94103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.824+0000 7fdd9a52d640 1 -- 172.21.15.38:0/1500243310 shutdown_connections 2024-09-13T18:28:40.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.825+0000 7fdd9a52d640 1 -- 172.21.15.38:0/1500243310 wait complete. 2024-09-13T18:28:40.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.916+0000 7f28c3f63640 1 -- 172.21.15.38:0/3101094294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28bc0ffcf0 msgr2=0x7f28bc100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.916+0000 7f28c3f63640 1 --2- 172.21.15.38:0/3101094294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28bc0ffcf0 0x7f28bc100170 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009880 tx=0x7f28ac02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.917+0000 7f28c3f63640 1 -- 172.21.15.38:0/3101094294 shutdown_connections 2024-09-13T18:28:40.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.917+0000 7f28c3f63640 1 --2- 172.21.15.38:0/3101094294 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28bc0ffcf0 0x7f28bc100170 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.917+0000 7f28c3f63640 1 --2- 172.21.15.38:0/3101094294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28bc0feaf0 0x7f28bc0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.917+0000 7f28c3f63640 1 -- 172.21.15.38:0/3101094294 >> 172.21.15.38:0/3101094294 conn(0x7f28bc0fa280 msgr2=0x7f28bc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:40.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.917+0000 7f28c3f63640 1 -- 172.21.15.38:0/3101094294 shutdown_connections 2024-09-13T18:28:40.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.917+0000 7f28c3f63640 1 -- 172.21.15.38:0/3101094294 wait complete. 2024-09-13T18:28:40.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.917+0000 7f28c3f63640 1 Processor -- start 2024-09-13T18:28:40.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c3f63640 1 -- start start 2024-09-13T18:28:40.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c3f63640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28bc0feaf0 0x7f28bc102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c3f63640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28bc0ffcf0 0x7f28bc1010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c3f63640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc101610 con 0x7f28bc0feaf0 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c3f63640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc101780 con 0x7f28bc0ffcf0 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c1cff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28bc0feaf0 0x7f28bc102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c1cff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28bc0feaf0 0x7f28bc102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34700/0 (socket says 172.21.15.38:34700) 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c1cff640 1 -- 172.21.15.38:0/3476767167 learned_addr learned my addr 172.21.15.38:0/3476767167 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c14fe640 1 --2- 172.21.15.38:0/3476767167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28bc0ffcf0 0x7f28bc1010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c1cff640 1 -- 172.21.15.38:0/3476767167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28bc0ffcf0 msgr2=0x7f28bc1010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c1cff640 1 --2- 172.21.15.38:0/3476767167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28bc0ffcf0 0x7f28bc1010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c1cff640 1 -- 172.21.15.38:0/3476767167 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac009560 con 0x7f28bc0feaf0 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.918+0000 7f28c1cff640 1 --2- 172.21.15.38:0/3476767167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28bc0feaf0 0x7f28bc102a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f28b800d6f0 tx=0x7f28b800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.919+0000 7f28b2ffd640 1 -- 172.21.15.38:0/3476767167 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28b8009a30 con 0x7f28bc0feaf0 2024-09-13T18:28:40.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.919+0000 7f28c3f63640 1 -- 172.21.15.38:0/3476767167 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc101a60 con 0x7f28bc0feaf0 2024-09-13T18:28:40.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.919+0000 7f28b2ffd640 1 -- 172.21.15.38:0/3476767167 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f28b80044c0 con 0x7f28bc0feaf0 2024-09-13T18:28:40.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.919+0000 7f28b2ffd640 1 -- 172.21.15.38:0/3476767167 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28b8003d60 con 0x7f28bc0feaf0 2024-09-13T18:28:40.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.919+0000 7f28c3f63640 1 -- 172.21.15.38:0/3476767167 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc19d610 con 0x7f28bc0feaf0 2024-09-13T18:28:40.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.921+0000 7f28c3f63640 1 -- 172.21.15.38:0/3476767167 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc0feef0 con 0x7f28bc0feaf0 2024-09-13T18:28:40.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.921+0000 7f28b2ffd640 1 -- 172.21.15.38:0/3476767167 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f28b8003f90 con 0x7f28bc0feaf0 2024-09-13T18:28:40.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.921+0000 7f28b2ffd640 1 --2- 172.21.15.38:0/3476767167 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f28a806cc50 0x7f28a806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:40.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.922+0000 7f28b2ffd640 1 -- 172.21.15.38:0/3476767167 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f28b808b8f0 con 0x7f28bc0feaf0 2024-09-13T18:28:40.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.922+0000 7f28c14fe640 1 --2- 172.21.15.38:0/3476767167 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f28a806cc50 0x7f28a806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:40.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.922+0000 7f28c14fe640 1 --2- 172.21.15.38:0/3476767167 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f28a806cc50 0x7f28a806f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28bc102800 tx=0x7f28ac031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:40.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:40.927+0000 7f28b2ffd640 1 -- 172.21.15.38:0/3476767167 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f28b8055d90 con 0x7f28bc0feaf0 2024-09-13T18:28:41.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.137+0000 7f28c3f63640 1 -- 172.21.15.38:0/3476767167 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f28bc0fc480 con 0x7f28a806cc50 2024-09-13T18:28:41.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.148+0000 7f28b2ffd640 1 -- 172.21.15.38:0/3476767167 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f28bc0fc480 con 0x7f28a806cc50 2024-09-13T18:28:41.151 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:28:41.151 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (4m) 27s ago 6m 24.6M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:28:41.151 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (6m) 27s ago 6m 7532k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:28:41.151 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (5m) 34s ago 5m 7516k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:28:41.151 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (6m) 27s ago 6m 6899k - 18.2.4-845-ge4e227b3 67ddd33fa72f 30c026e97a6b 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (5m) 34s ago 5m 6895k - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c179d7df975 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (4m) 27s ago 6m 87.5M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (46s) 27s ago 46s 15.8M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (53s) 27s ago 52s 12.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (50s) 34s ago 50s 15.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (43s) 34s ago 43s 14.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:9283,8765,8443 running (7m) 27s ago 7m 486M - 18.2.4-845-ge4e227b3 67ddd33fa72f 1cebd33ffd6a 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (5m) 34s ago 5m 440M - 18.2.4-845-ge4e227b3 67ddd33fa72f 9c9aea66991f 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (7m) 27s ago 7m 46.0M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f b654a36a9082 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (5m) 34s ago 5m 35.6M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 0133a107f35d 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (6m) 27s ago 6m 15.1M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (5m) 34s ago 5m 16.2M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (4m) 27s ago 4m 57.3M 3948M 18.2.4-845-ge4e227b3 67ddd33fa72f 69a9e66fb097 2024-09-13T18:28:41.152 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (4m) 27s ago 4m 56.6M 3948M 18.2.4-845-ge4e227b3 67ddd33fa72f 07986b4ba73b 2024-09-13T18:28:41.153 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (3m) 27s ago 3m 49.2M 3948M 18.2.4-845-ge4e227b3 67ddd33fa72f e44cdda01aee 2024-09-13T18:28:41.153 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (3m) 34s ago 3m 45.5M 1213M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:28:41.153 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (2m) 34s ago 2m 54.7M 1213M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:28:41.153 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (2m) 34s ago 2m 46.1M 1213M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:28:41.153 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (4m) 27s ago 5m 57.6M - 2.43.0 a07b618ecd1d 292b390ae245 2024-09-13T18:28:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.151+0000 7f28c3f63640 1 -- 172.21.15.38:0/3476767167 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f28a806cc50 msgr2=0x7f28a806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.151+0000 7f28c3f63640 1 --2- 172.21.15.38:0/3476767167 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f28a806cc50 0x7f28a806f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28bc102800 tx=0x7f28ac031400 comp rx=0 tx=0).stop 2024-09-13T18:28:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.151+0000 7f28c3f63640 1 -- 172.21.15.38:0/3476767167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28bc0feaf0 msgr2=0x7f28bc102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.151+0000 7f28c3f63640 1 --2- 172.21.15.38:0/3476767167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28bc0feaf0 0x7f28bc102a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f28b800d6f0 tx=0x7f28b800dbb0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.151+0000 7f28c3f63640 1 -- 172.21.15.38:0/3476767167 shutdown_connections 2024-09-13T18:28:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.151+0000 7f28c3f63640 1 --2- 172.21.15.38:0/3476767167 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f28a806cc50 0x7f28a806f110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.151+0000 7f28c3f63640 1 --2- 172.21.15.38:0/3476767167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28bc0ffcf0 0x7f28bc1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.151+0000 7f28c3f63640 1 --2- 172.21.15.38:0/3476767167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28bc0feaf0 0x7f28bc102a80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.151+0000 7f28c3f63640 1 -- 172.21.15.38:0/3476767167 >> 172.21.15.38:0/3476767167 conn(0x7f28bc0fa280 msgr2=0x7f28bc0fbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.151+0000 7f28c3f63640 1 -- 172.21.15.38:0/3476767167 shutdown_connections 2024-09-13T18:28:41.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.151+0000 7f28c3f63640 1 -- 172.21.15.38:0/3476767167 wait complete. 2024-09-13T18:28:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.252+0000 7fbe397f5640 1 -- 172.21.15.38:0/1459670299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe34100630 msgr2=0x7fbe34102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.252+0000 7fbe397f5640 1 --2- 172.21.15.38:0/1459670299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe34100630 0x7fbe34102a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbe240098b0 tx=0x7fbe2402a4d0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.252+0000 7fbe397f5640 1 -- 172.21.15.38:0/1459670299 shutdown_connections 2024-09-13T18:28:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.252+0000 7fbe397f5640 1 --2- 172.21.15.38:0/1459670299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe34102f60 0x7fbe34105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.252+0000 7fbe397f5640 1 --2- 172.21.15.38:0/1459670299 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe34100630 0x7fbe34102a20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.252+0000 7fbe397f5640 1 -- 172.21.15.38:0/1459670299 >> 172.21.15.38:0/1459670299 conn(0x7fbe340fa250 msgr2=0x7fbe340fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.252+0000 7fbe397f5640 1 -- 172.21.15.38:0/1459670299 shutdown_connections 2024-09-13T18:28:41.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.253+0000 7fbe397f5640 1 -- 172.21.15.38:0/1459670299 wait complete. 2024-09-13T18:28:41.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.253+0000 7fbe397f5640 1 Processor -- start 2024-09-13T18:28:41.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.253+0000 7fbe397f5640 1 -- start start 2024-09-13T18:28:41.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.254+0000 7fbe397f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe34100630 0x7fbe340fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.254+0000 7fbe397f5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe34102f60 0x7fbe340fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.254+0000 7fbe397f5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe340feb20 con 0x7fbe34100630 2024-09-13T18:28:41.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.254+0000 7fbe397f5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe340fec90 con 0x7fbe34102f60 2024-09-13T18:28:41.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.254+0000 7fbe32ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe34100630 0x7fbe340fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.254+0000 7fbe32ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe34100630 0x7fbe340fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34704/0 (socket says 172.21.15.38:34704) 2024-09-13T18:28:41.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.254+0000 7fbe32ffd640 1 -- 172.21.15.38:0/3857715747 learned_addr learned my addr 172.21.15.38:0/3857715747 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:41.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.254+0000 7fbe327fc640 1 --2- 172.21.15.38:0/3857715747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe34102f60 0x7fbe340fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.254+0000 7fbe32ffd640 1 -- 172.21.15.38:0/3857715747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe34102f60 msgr2=0x7fbe340fe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.254+0000 7fbe32ffd640 1 --2- 172.21.15.38:0/3857715747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe34102f60 0x7fbe340fe5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.254+0000 7fbe32ffd640 1 -- 172.21.15.38:0/3857715747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe24009560 con 0x7fbe34100630 2024-09-13T18:28:41.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.255+0000 7fbe32ffd640 1 --2- 172.21.15.38:0/3857715747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe34100630 0x7fbe340fff90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbe240099d0 tx=0x7fbe24005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.255+0000 7fbe1bfff640 1 -- 172.21.15.38:0/3857715747 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe24004be0 con 0x7fbe34100630 2024-09-13T18:28:41.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.255+0000 7fbe397f5640 1 -- 172.21.15.38:0/3857715747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe340fef10 con 0x7fbe34100630 2024-09-13T18:28:41.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.255+0000 7fbe1bfff640 1 -- 172.21.15.38:0/3857715747 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbe24004d40 con 0x7fbe34100630 2024-09-13T18:28:41.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.255+0000 7fbe397f5640 1 -- 172.21.15.38:0/3857715747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3419d6c0 con 0x7fbe34100630 2024-09-13T18:28:41.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.255+0000 7fbe1bfff640 1 -- 172.21.15.38:0/3857715747 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe24031af0 con 0x7fbe34100630 2024-09-13T18:28:41.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.256+0000 7fbe397f5640 1 -- 172.21.15.38:0/3857715747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe20005280 con 0x7fbe34100630 2024-09-13T18:28:41.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.257+0000 7fbe1bfff640 1 -- 172.21.15.38:0/3857715747 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbe24031d50 con 0x7fbe34100630 2024-09-13T18:28:41.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.258+0000 7fbe1bfff640 1 --2- 172.21.15.38:0/3857715747 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbe1c06cc50 0x7fbe1c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.258+0000 7fbe1bfff640 1 -- 172.21.15.38:0/3857715747 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbe240ad4d0 con 0x7fbe34100630 2024-09-13T18:28:41.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.258+0000 7fbe327fc640 1 --2- 172.21.15.38:0/3857715747 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbe1c06cc50 0x7fbe1c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.259+0000 7fbe327fc640 1 --2- 172.21.15.38:0/3857715747 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbe1c06cc50 0x7fbe1c06f110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbe340ffd10 tx=0x7fbe28008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.263+0000 7fbe1bfff640 1 -- 172.21.15.38:0/3857715747 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbe240778c0 con 0x7fbe34100630 2024-09-13T18:28:41.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.554+0000 7fbe397f5640 1 -- 172.21.15.38:0/3857715747 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbe20005d40 con 0x7fbe34100630 2024-09-13T18:28:41.557 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:41 smithi038 ceph-mon[27689]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:28:41.557 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:41 smithi038 ceph-mon[27689]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:28:41.557 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:41 smithi038 ceph-mon[27689]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:28:41.557 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:41 smithi038 ceph-mon[27689]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T18:28:41.557 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.555+0000 7fbe1bfff640 1 -- 172.21.15.38:0/3857715747 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fbe2407aee0 con 0x7fbe34100630 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:28:41.558 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:28:41.559 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:28:41.559 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 14 2024-09-13T18:28:41.559 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:28:41.559 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:28:41.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.557+0000 7fbe397f5640 1 -- 172.21.15.38:0/3857715747 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbe1c06cc50 msgr2=0x7fbe1c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.557+0000 7fbe397f5640 1 --2- 172.21.15.38:0/3857715747 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbe1c06cc50 0x7fbe1c06f110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbe340ffd10 tx=0x7fbe28008040 comp rx=0 tx=0).stop 2024-09-13T18:28:41.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.557+0000 7fbe397f5640 1 -- 172.21.15.38:0/3857715747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe34100630 msgr2=0x7fbe340fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.557+0000 7fbe397f5640 1 --2- 172.21.15.38:0/3857715747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe34100630 0x7fbe340fff90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbe240099d0 tx=0x7fbe24005630 comp rx=0 tx=0).stop 2024-09-13T18:28:41.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.557+0000 7fbe397f5640 1 -- 172.21.15.38:0/3857715747 shutdown_connections 2024-09-13T18:28:41.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.557+0000 7fbe397f5640 1 --2- 172.21.15.38:0/3857715747 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbe1c06cc50 0x7fbe1c06f110 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.557+0000 7fbe397f5640 1 --2- 172.21.15.38:0/3857715747 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe34102f60 0x7fbe340fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.557+0000 7fbe397f5640 1 --2- 172.21.15.38:0/3857715747 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbe34100630 0x7fbe340fff90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.557+0000 7fbe397f5640 1 -- 172.21.15.38:0/3857715747 >> 172.21.15.38:0/3857715747 conn(0x7fbe340fa250 msgr2=0x7fbe340fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.560 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.557+0000 7fbe397f5640 1 -- 172.21.15.38:0/3857715747 shutdown_connections 2024-09-13T18:28:41.561 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.558+0000 7fbe397f5640 1 -- 172.21.15.38:0/3857715747 wait complete. 2024-09-13T18:28:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.651+0000 7fd4020d6640 1 -- 172.21.15.38:0/245701019 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3fc100d80 msgr2=0x7fd3fc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.651+0000 7fd4020d6640 1 --2- 172.21.15.38:0/245701019 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3fc100d80 0x7fd3fc101200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009880 tx=0x7fd3f002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.651+0000 7fd4020d6640 1 -- 172.21.15.38:0/245701019 shutdown_connections 2024-09-13T18:28:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.651+0000 7fd4020d6640 1 --2- 172.21.15.38:0/245701019 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3fc100d80 0x7fd3fc101200 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.651+0000 7fd4020d6640 1 --2- 172.21.15.38:0/245701019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3fc0ffb80 0x7fd3fc0fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.651+0000 7fd4020d6640 1 -- 172.21.15.38:0/245701019 >> 172.21.15.38:0/245701019 conn(0x7fd3fc0fb330 msgr2=0x7fd3fc0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.651+0000 7fd4020d6640 1 -- 172.21.15.38:0/245701019 shutdown_connections 2024-09-13T18:28:41.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.651+0000 7fd4020d6640 1 -- 172.21.15.38:0/245701019 wait complete. 2024-09-13T18:28:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.652+0000 7fd4020d6640 1 Processor -- start 2024-09-13T18:28:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.652+0000 7fd4020d6640 1 -- start start 2024-09-13T18:28:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.652+0000 7fd4020d6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3fc0ffb80 0x7fd3fc074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.652+0000 7fd4020d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3fc100d80 0x7fd3fc0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.652+0000 7fd4020d6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc072de0 con 0x7fd3fc100d80 2024-09-13T18:28:41.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.652+0000 7fd4020d6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc072f50 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.653+0000 7fd3fb7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3fc0ffb80 0x7fd3fc074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.653+0000 7fd3faffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3fc100d80 0x7fd3fc0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.653+0000 7fd3fb7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3fc0ffb80 0x7fd3fc074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.38:53202/0 (socket says 172.21.15.38:53202) 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.653+0000 7fd3fb7fe640 1 -- 172.21.15.38:0/673202702 learned_addr learned my addr 172.21.15.38:0/673202702 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.653+0000 7fd3faffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3fc100d80 0x7fd3fc0728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34718/0 (socket says 172.21.15.38:34718) 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.653+0000 7fd3fb7fe640 1 -- 172.21.15.38:0/673202702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3fc100d80 msgr2=0x7fd3fc0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.653+0000 7fd3fb7fe640 1 --2- 172.21.15.38:0/673202702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3fc100d80 0x7fd3fc0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.653+0000 7fd3fb7fe640 1 -- 172.21.15.38:0/673202702 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0009560 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.653+0000 7fd3fb7fe640 1 --2- 172.21.15.38:0/673202702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3fc0ffb80 0x7fd3fc074250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00e940 tx=0x7fd3ec00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.653+0000 7fd3f8ff9640 1 -- 172.21.15.38:0/673202702 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3ec0096e0 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.654+0000 7fd3f8ff9640 1 -- 172.21.15.38:0/673202702 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd3ec0044d0 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.654+0000 7fd3f8ff9640 1 -- 172.21.15.38:0/673202702 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3ec003ea0 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.657 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.654+0000 7fd4020d6640 1 -- 172.21.15.38:0/673202702 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc073230 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.654+0000 7fd4020d6640 1 -- 172.21.15.38:0/673202702 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc19d5a0 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.655+0000 7fd4020d6640 1 -- 172.21.15.38:0/673202702 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc18f5e0 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.656+0000 7fd3f8ff9640 1 -- 172.21.15.38:0/673202702 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd3ec00cc90 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.656+0000 7fd3f8ff9640 1 --2- 172.21.15.38:0/673202702 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd3e406cc60 0x7fd3e406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:41.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.656+0000 7fd3f8ff9640 1 -- 172.21.15.38:0/673202702 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd3ec014070 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.656+0000 7fd3faffd640 1 --2- 172.21.15.38:0/673202702 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd3e406cc60 0x7fd3e406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:41.659 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.657+0000 7fd3faffd640 1 --2- 172.21.15.38:0/673202702 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd3e406cc60 0x7fd3e406f120 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc073fd0 tx=0x7fd3f0031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:41.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.660+0000 7fd3f8ff9640 1 -- 172.21.15.38:0/673202702 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd3ec056a50 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:41 smithi149 ceph-mon[35845]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:28:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:41 smithi149 ceph-mon[35845]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:28:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:41 smithi149 ceph-mon[35845]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:28:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:41 smithi149 ceph-mon[35845]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T18:28:41.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.905+0000 7fd4020d6640 1 -- 172.21.15.38:0/673202702 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3fc02c480 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.906+0000 7fd3f8ff9640 1 -- 172.21.15.38:0/673202702 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7fd3ec05a070 con 0x7fd3fc0ffb80 2024-09-13T18:28:41.908 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:28:41.908 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:28:41.909 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:28:41.910 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:28:41.911 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:28:41.911 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:28:41.911 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:28:41.911 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:28:41.911 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:28:41.911 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:28:41.911 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:28:41.911 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:28:41.911 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:28:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:28:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.908+0000 7fd4020d6640 1 -- 172.21.15.38:0/673202702 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd3e406cc60 msgr2=0x7fd3e406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.908+0000 7fd4020d6640 1 --2- 172.21.15.38:0/673202702 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd3e406cc60 0x7fd3e406f120 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc073fd0 tx=0x7fd3f0031400 comp rx=0 tx=0).stop 2024-09-13T18:28:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.908+0000 7fd4020d6640 1 -- 172.21.15.38:0/673202702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3fc0ffb80 msgr2=0x7fd3fc074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.908+0000 7fd4020d6640 1 --2- 172.21.15.38:0/673202702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3fc0ffb80 0x7fd3fc074250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00e940 tx=0x7fd3ec00ee00 comp rx=0 tx=0).stop 2024-09-13T18:28:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.908+0000 7fd4020d6640 1 -- 172.21.15.38:0/673202702 shutdown_connections 2024-09-13T18:28:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.908+0000 7fd4020d6640 1 --2- 172.21.15.38:0/673202702 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fd3e406cc60 0x7fd3e406f120 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.908+0000 7fd4020d6640 1 --2- 172.21.15.38:0/673202702 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd3fc100d80 0x7fd3fc0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.908+0000 7fd4020d6640 1 --2- 172.21.15.38:0/673202702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3fc0ffb80 0x7fd3fc074250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:41.912 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.908+0000 7fd4020d6640 1 -- 172.21.15.38:0/673202702 >> 172.21.15.38:0/673202702 conn(0x7fd3fc0fb330 msgr2=0x7fd3fc1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.908+0000 7fd4020d6640 1 -- 172.21.15.38:0/673202702 shutdown_connections 2024-09-13T18:28:41.913 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:41.908+0000 7fd4020d6640 1 -- 172.21.15.38:0/673202702 wait complete. 2024-09-13T18:28:42.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.003+0000 7f848a581640 1 -- 172.21.15.38:0/3625769008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84840ffcf0 msgr2=0x7f8484100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:42.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.003+0000 7f848a581640 1 --2- 172.21.15.38:0/3625769008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84840ffcf0 0x7f8484100170 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8478009880 tx=0x7f847802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.003+0000 7f848a581640 1 -- 172.21.15.38:0/3625769008 shutdown_connections 2024-09-13T18:28:42.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.003+0000 7f848a581640 1 --2- 172.21.15.38:0/3625769008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84840ffcf0 0x7f8484100170 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.003+0000 7f848a581640 1 --2- 172.21.15.38:0/3625769008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84840feaf0 0x7f84840feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.003+0000 7f848a581640 1 -- 172.21.15.38:0/3625769008 >> 172.21.15.38:0/3625769008 conn(0x7f84840fa280 msgr2=0x7f84840fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:42.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.003+0000 7f848a581640 1 -- 172.21.15.38:0/3625769008 shutdown_connections 2024-09-13T18:28:42.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.003+0000 7f848a581640 1 -- 172.21.15.38:0/3625769008 wait complete. 2024-09-13T18:28:42.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.004+0000 7f848a581640 1 Processor -- start 2024-09-13T18:28:42.007 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.004+0000 7f848a581640 1 -- start start 2024-09-13T18:28:42.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.004+0000 7f848a581640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84840feaf0 0x7f8484068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:42.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.004+0000 7f848a581640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84840ffcf0 0x7f848419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:42.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.004+0000 7f848a581640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848419a910 con 0x7f84840ffcf0 2024-09-13T18:28:42.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.004+0000 7f848a581640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848419aa50 con 0x7f84840feaf0 2024-09-13T18:28:42.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.004+0000 7f84837fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84840ffcf0 0x7f848419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:42.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.004+0000 7f8483fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84840feaf0 0x7f8484068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:42.008 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.004+0000 7f84837fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84840ffcf0 0x7f848419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34736/0 (socket says 172.21.15.38:34736) 2024-09-13T18:28:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.004+0000 7f84837fe640 1 -- 172.21.15.38:0/2540360338 learned_addr learned my addr 172.21.15.38:0/2540360338 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.005+0000 7f8483fff640 1 -- 172.21.15.38:0/2540360338 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84840ffcf0 msgr2=0x7f848419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.005+0000 7f8483fff640 1 --2- 172.21.15.38:0/2540360338 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84840ffcf0 0x7f848419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.005+0000 7f8483fff640 1 -- 172.21.15.38:0/2540360338 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8478009560 con 0x7f84840feaf0 2024-09-13T18:28:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.005+0000 7f84837fe640 1 --2- 172.21.15.38:0/2540360338 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84840ffcf0 0x7f848419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:28:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.005+0000 7f8483fff640 1 --2- 172.21.15.38:0/2540360338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84840feaf0 0x7f8484068790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f847400e940 tx=0x7f847400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.005+0000 7f84817fa640 1 -- 172.21.15.38:0/2540360338 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f847400cc90 con 0x7f84840feaf0 2024-09-13T18:28:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.005+0000 7f84817fa640 1 -- 172.21.15.38:0/2540360338 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f84740044d0 con 0x7f84840feaf0 2024-09-13T18:28:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.005+0000 7f848a581640 1 -- 172.21.15.38:0/2540360338 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848419ad00 con 0x7f84840feaf0 2024-09-13T18:28:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.005+0000 7f84817fa640 1 -- 172.21.15.38:0/2540360338 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8474010430 con 0x7f84840feaf0 2024-09-13T18:28:42.009 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.005+0000 7f848a581640 1 -- 172.21.15.38:0/2540360338 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848419b220 con 0x7f84840feaf0 2024-09-13T18:28:42.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.006+0000 7f848a581640 1 -- 172.21.15.38:0/2540360338 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84840feef0 con 0x7f84840feaf0 2024-09-13T18:28:42.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.007+0000 7f84817fa640 1 -- 172.21.15.38:0/2540360338 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8474004030 con 0x7f84840feaf0 2024-09-13T18:28:42.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.007+0000 7f84817fa640 1 --2- 172.21.15.38:0/2540360338 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f846c06cc50 0x7f846c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:42.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.007+0000 7f84817fa640 1 -- 172.21.15.38:0/2540360338 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8474014070 con 0x7f84840feaf0 2024-09-13T18:28:42.010 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.007+0000 7f84837fe640 1 --2- 172.21.15.38:0/2540360338 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f846c06cc50 0x7f846c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:42.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.008+0000 7f84837fe640 1 --2- 172.21.15.38:0/2540360338 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f846c06cc50 0x7f846c06f110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8484068510 tx=0x7f84780058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:42.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.012+0000 7f84817fa640 1 -- 172.21.15.38:0/2540360338 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8474056a30 con 0x7f84840feaf0 2024-09-13T18:28:42.230 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.228+0000 7f848a581640 1 -- 172.21.15.38:0/2540360338 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f848402c540 con 0x7f846c06cc50 2024-09-13T18:28:42.231 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.229+0000 7f84817fa640 1 -- 172.21.15.38:0/2540360338 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f848402c540 con 0x7f846c06cc50 2024-09-13T18:28:42.232 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:28:42.232 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:28:42.232 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:28:42.232 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:28:42.232 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [], 2024-09-13T18:28:42.232 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "", 2024-09-13T18:28:42.232 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 image", 2024-09-13T18:28:42.232 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:28:42.232 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:28:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.231+0000 7f848a581640 1 -- 172.21.15.38:0/2540360338 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f846c06cc50 msgr2=0x7f846c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.231+0000 7f848a581640 1 --2- 172.21.15.38:0/2540360338 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f846c06cc50 0x7f846c06f110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8484068510 tx=0x7f84780058d0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.231+0000 7f848a581640 1 -- 172.21.15.38:0/2540360338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84840feaf0 msgr2=0x7f8484068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.231+0000 7f848a581640 1 --2- 172.21.15.38:0/2540360338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84840feaf0 0x7f8484068790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f847400e940 tx=0x7f847400ee00 comp rx=0 tx=0).stop 2024-09-13T18:28:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.232+0000 7f848a581640 1 -- 172.21.15.38:0/2540360338 shutdown_connections 2024-09-13T18:28:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.232+0000 7f848a581640 1 --2- 172.21.15.38:0/2540360338 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f846c06cc50 0x7f846c06f110 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.232+0000 7f848a581640 1 --2- 172.21.15.38:0/2540360338 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f84840ffcf0 0x7f848419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.232+0000 7f848a581640 1 --2- 172.21.15.38:0/2540360338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84840feaf0 0x7f8484068790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.232+0000 7f848a581640 1 -- 172.21.15.38:0/2540360338 >> 172.21.15.38:0/2540360338 conn(0x7f84840fa280 msgr2=0x7f84841033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.232+0000 7f848a581640 1 -- 172.21.15.38:0/2540360338 shutdown_connections 2024-09-13T18:28:42.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.232+0000 7f848a581640 1 -- 172.21.15.38:0/2540360338 wait complete. 2024-09-13T18:28:42.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.326+0000 7faa1e3cf640 1 -- 172.21.15.38:0/4073070793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa180feaf0 msgr2=0x7faa180feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:42.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.326+0000 7faa1e3cf640 1 --2- 172.21.15.38:0/4073070793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa180feaf0 0x7faa180feef0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faa08009880 tx=0x7faa0802c6b0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.327+0000 7faa1e3cf640 1 -- 172.21.15.38:0/4073070793 shutdown_connections 2024-09-13T18:28:42.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.327+0000 7faa1e3cf640 1 --2- 172.21.15.38:0/4073070793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa180ffcf0 0x7faa18100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.327+0000 7faa1e3cf640 1 --2- 172.21.15.38:0/4073070793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa180feaf0 0x7faa180feef0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.327+0000 7faa1e3cf640 1 -- 172.21.15.38:0/4073070793 >> 172.21.15.38:0/4073070793 conn(0x7faa180fa280 msgr2=0x7faa180fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:42.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.327+0000 7faa1e3cf640 1 -- 172.21.15.38:0/4073070793 shutdown_connections 2024-09-13T18:28:42.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.327+0000 7faa1e3cf640 1 -- 172.21.15.38:0/4073070793 wait complete. 2024-09-13T18:28:42.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.327+0000 7faa1e3cf640 1 Processor -- start 2024-09-13T18:28:42.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.327+0000 7faa1e3cf640 1 -- start start 2024-09-13T18:28:42.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.328+0000 7faa1e3cf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa180feaf0 0x7faa181977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:42.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.328+0000 7faa1e3cf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa180ffcf0 0x7faa18197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:42.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.328+0000 7faa1e3cf640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa18198300 con 0x7faa180ffcf0 2024-09-13T18:28:42.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.328+0000 7faa1e3cf640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa18198470 con 0x7faa180feaf0 2024-09-13T18:28:42.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.328+0000 7faa177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa180ffcf0 0x7faa18197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:42.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.328+0000 7faa177fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa180ffcf0 0x7faa18197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42328/0 (socket says 172.21.15.38:42328) 2024-09-13T18:28:42.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.328+0000 7faa177fe640 1 -- 172.21.15.38:0/3866932191 learned_addr learned my addr 172.21.15.38:0/3866932191 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:28:42.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.328+0000 7faa17fff640 1 --2- 172.21.15.38:0/3866932191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa180feaf0 0x7faa181977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:42.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.328+0000 7faa177fe640 1 -- 172.21.15.38:0/3866932191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa180feaf0 msgr2=0x7faa181977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:42.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.328+0000 7faa177fe640 1 --2- 172.21.15.38:0/3866932191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa180feaf0 0x7faa181977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.328+0000 7faa177fe640 1 -- 172.21.15.38:0/3866932191 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa08009560 con 0x7faa180ffcf0 2024-09-13T18:28:42.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.329+0000 7faa177fe640 1 --2- 172.21.15.38:0/3866932191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa180ffcf0 0x7faa18197d30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00e9a0 tx=0x7faa0c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:42.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.329+0000 7faa157fa640 1 -- 172.21.15.38:0/3866932191 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa0c00cc90 con 0x7faa180ffcf0 2024-09-13T18:28:42.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.329+0000 7faa157fa640 1 -- 172.21.15.38:0/3866932191 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa0c00cdf0 con 0x7faa180ffcf0 2024-09-13T18:28:42.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.329+0000 7faa1e3cf640 1 -- 172.21.15.38:0/3866932191 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1819cf10 con 0x7faa180ffcf0 2024-09-13T18:28:42.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.329+0000 7faa157fa640 1 -- 172.21.15.38:0/3866932191 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa0c018770 con 0x7faa180ffcf0 2024-09-13T18:28:42.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.329+0000 7faa1e3cf640 1 -- 172.21.15.38:0/3866932191 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1819d430 con 0x7faa180ffcf0 2024-09-13T18:28:42.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.331+0000 7faa1e3cf640 1 -- 172.21.15.38:0/3866932191 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa180feef0 con 0x7faa180ffcf0 2024-09-13T18:28:42.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.331+0000 7faa157fa640 1 -- 172.21.15.38:0/3866932191 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faa0c010b60 con 0x7faa180ffcf0 2024-09-13T18:28:42.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.332+0000 7faa157fa640 1 --2- 172.21.15.38:0/3866932191 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7faa0006cc50 0x7faa0006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:28:42.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.332+0000 7faa157fa640 1 -- 172.21.15.38:0/3866932191 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7faa0c014070 con 0x7faa180ffcf0 2024-09-13T18:28:42.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.332+0000 7faa17fff640 1 --2- 172.21.15.38:0/3866932191 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7faa0006cc50 0x7faa0006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:28:42.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.333+0000 7faa17fff640 1 --2- 172.21.15.38:0/3866932191 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7faa0006cc50 0x7faa0006f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa08000c00 tx=0x7faa08033400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:28:42.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.337+0000 7faa157fa640 1 -- 172.21.15.38:0/3866932191 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faa0c052e20 con 0x7faa180ffcf0 2024-09-13T18:28:42.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:42 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3857715747' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:28:42.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:42 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/673202702' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:28:42.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:42 smithi038 ceph-mon[27689]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:28:42.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.640+0000 7faa1e3cf640 1 -- 172.21.15.38:0/3866932191 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7faa18191830 con 0x7faa180ffcf0 2024-09-13T18:28:42.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.640+0000 7faa157fa640 1 -- 172.21.15.38:0/3866932191 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7faa0c056ab0 con 0x7faa180ffcf0 2024-09-13T18:28:42.643 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:28:42.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.643+0000 7faa1e3cf640 1 -- 172.21.15.38:0/3866932191 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7faa0006cc50 msgr2=0x7faa0006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:42.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.643+0000 7faa1e3cf640 1 --2- 172.21.15.38:0/3866932191 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7faa0006cc50 0x7faa0006f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa08000c00 tx=0x7faa08033400 comp rx=0 tx=0).stop 2024-09-13T18:28:42.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.643+0000 7faa1e3cf640 1 -- 172.21.15.38:0/3866932191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa180ffcf0 msgr2=0x7faa18197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:28:42.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.643+0000 7faa1e3cf640 1 --2- 172.21.15.38:0/3866932191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa180ffcf0 0x7faa18197d30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00e9a0 tx=0x7faa0c00ee60 comp rx=0 tx=0).stop 2024-09-13T18:28:42.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.643+0000 7faa1e3cf640 1 -- 172.21.15.38:0/3866932191 shutdown_connections 2024-09-13T18:28:42.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.643+0000 7faa1e3cf640 1 --2- 172.21.15.38:0/3866932191 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7faa0006cc50 0x7faa0006f110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.643+0000 7faa1e3cf640 1 --2- 172.21.15.38:0/3866932191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faa180ffcf0 0x7faa18197d30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.643+0000 7faa1e3cf640 1 --2- 172.21.15.38:0/3866932191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa180feaf0 0x7faa181977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:28:42.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.643+0000 7faa1e3cf640 1 -- 172.21.15.38:0/3866932191 >> 172.21.15.38:0/3866932191 conn(0x7faa180fa280 msgr2=0x7faa18103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:28:42.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.643+0000 7faa1e3cf640 1 -- 172.21.15.38:0/3866932191 shutdown_connections 2024-09-13T18:28:42.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:28:42.643+0000 7faa1e3cf640 1 -- 172.21.15.38:0/3866932191 wait complete. 2024-09-13T18:28:42.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:42 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/3857715747' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:28:42.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:42 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/673202702' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:28:42.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:42 smithi149 ceph-mon[35845]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:28:43.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:43 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/3866932191' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:28:43.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:43 smithi149 ceph-mon[35845]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:28:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:43 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/3866932191' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:28:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:43 smithi038 ceph-mon[27689]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:28:46.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:46 smithi038 ceph-mon[27689]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:28:46.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:46 smithi149 ceph-mon[35845]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:28:48.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:48 smithi149 ceph-mon[35845]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:28:48.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:48 smithi038 ceph-mon[27689]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:28:49.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:49 smithi038 ceph-mon[27689]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:28:49.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:49 smithi149 ceph-mon[35845]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:28:52.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:51 smithi038 ceph-mon[27689]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:28:52.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:51 smithi149 ceph-mon[35845]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:28:54.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:54 smithi038 ceph-mon[27689]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:28:54.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:54 smithi149 ceph-mon[35845]: pgmap v214: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:28:55.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:28:55.670 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:55 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:28:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:56 smithi038 ceph-mon[27689]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:28:56.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:56 smithi149 ceph-mon[35845]: pgmap v215: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:28:57.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:28:57 smithi038 ceph-mon[27689]: pgmap v216: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:28:57.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:28:57 smithi149 ceph-mon[35845]: pgmap v216: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:29:00.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:00 smithi038 ceph-mon[27689]: pgmap v217: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:29:00.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:00 smithi149 ceph-mon[35845]: pgmap v217: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:29:02.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:02 smithi038 ceph-mon[27689]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T18:29:02.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:02 smithi149 ceph-mon[35845]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T18:29:03.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:03 smithi038 ceph-mon[27689]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-13T18:29:03.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:03 smithi149 ceph-mon[35845]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-13T18:29:06.483 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:06 smithi038 ceph-mon[27689]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T18:29:06.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:06 smithi149 ceph-mon[35845]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T18:29:07.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:07.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:07 smithi038 ceph-mon[27689]: Upgrade: Target is version 18.2.4-860-g6c6b083f (reef) 2024-09-13T18:29:07.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:07 smithi038 ceph-mon[27689]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, digests ['quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256'] 2024-09-13T18:29:07.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:29:07.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:07 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:07.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:07 smithi038 ceph-mon[27689]: Upgrade: Need to upgrade myself (mgr.smithi038.jeygoq) 2024-09-13T18:29:07.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:07 smithi038 ceph-mon[27689]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 on smithi149 2024-09-13T18:29:07.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:07 smithi038 ceph-mon[27689]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-13T18:29:07.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:07.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:07 smithi149 ceph-mon[35845]: Upgrade: Target is version 18.2.4-860-g6c6b083f (reef) 2024-09-13T18:29:07.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:07 smithi149 ceph-mon[35845]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, digests ['quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256'] 2024-09-13T18:29:07.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:29:07.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:07 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:07.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:07 smithi149 ceph-mon[35845]: Upgrade: Need to upgrade myself (mgr.smithi038.jeygoq) 2024-09-13T18:29:07.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:07 smithi149 ceph-mon[35845]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 on smithi149 2024-09-13T18:29:07.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:07 smithi149 ceph-mon[35845]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-13T18:29:10.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:10 smithi038 ceph-mon[27689]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T18:29:10.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:10 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:29:10.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:10 smithi149 ceph-mon[35845]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T18:29:10.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:10 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:29:11.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:11 smithi149 ceph-mon[35845]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-13T18:29:11.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:11 smithi038 ceph-mon[27689]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-13T18:29:12.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.775+0000 7f59968ed640 1 -- 172.21.15.38:0/4201567510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5990102fb0 msgr2=0x7f59901053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.780 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.775+0000 7f59968ed640 1 --2- 172.21.15.38:0/4201567510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5990102fb0 0x7f59901053a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f59840098b0 tx=0x7f598402a4d0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.775+0000 7f59968ed640 1 -- 172.21.15.38:0/4201567510 shutdown_connections 2024-09-13T18:29:12.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.775+0000 7f59968ed640 1 --2- 172.21.15.38:0/4201567510 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5990102fb0 0x7f59901053a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.775+0000 7f59968ed640 1 --2- 172.21.15.38:0/4201567510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5990100680 0x7f5990102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.775+0000 7f59968ed640 1 -- 172.21.15.38:0/4201567510 >> 172.21.15.38:0/4201567510 conn(0x7f59900fa280 msgr2=0x7f59900fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:12.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.775+0000 7f59968ed640 1 -- 172.21.15.38:0/4201567510 shutdown_connections 2024-09-13T18:29:12.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.775+0000 7f59968ed640 1 -- 172.21.15.38:0/4201567510 wait complete. 2024-09-13T18:29:12.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.775+0000 7f59968ed640 1 Processor -- start 2024-09-13T18:29:12.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.776+0000 7f59968ed640 1 -- start start 2024-09-13T18:29:12.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.776+0000 7f59968ed640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5990100680 0x7f59901955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.776+0000 7f59968ed640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5990102fb0 0x7f5990195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.776+0000 7f59968ed640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59901960e0 con 0x7f5990102fb0 2024-09-13T18:29:12.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.776+0000 7f59968ed640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5990196250 con 0x7f5990100680 2024-09-13T18:29:12.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.776+0000 7f598ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5990100680 0x7f59901955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.776+0000 7f598ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5990100680 0x7f59901955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.38:33912/0 (socket says 172.21.15.38:33912) 2024-09-13T18:29:12.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.776+0000 7f598ffff640 1 -- 172.21.15.38:0/108382707 learned_addr learned my addr 172.21.15.38:0/108382707 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:12.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.776+0000 7f598f7fe640 1 --2- 172.21.15.38:0/108382707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5990102fb0 0x7f5990195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.777+0000 7f598ffff640 1 -- 172.21.15.38:0/108382707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5990102fb0 msgr2=0x7f5990195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:12.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.777+0000 7f598ffff640 1 --2- 172.21.15.38:0/108382707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5990102fb0 0x7f5990195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:12.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.777+0000 7f598ffff640 1 -- 172.21.15.38:0/108382707 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5984009560 con 0x7f5990100680 2024-09-13T18:29:12.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.777+0000 7f598ffff640 1 --2- 172.21.15.38:0/108382707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5990100680 0x7f59901955d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f598000e970 tx=0x7f598000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.777+0000 7f598d7fa640 1 -- 172.21.15.38:0/108382707 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f598000cc90 con 0x7f5990100680 2024-09-13T18:29:12.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.777+0000 7f598d7fa640 1 -- 172.21.15.38:0/108382707 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f598000cdf0 con 0x7f5990100680 2024-09-13T18:29:12.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.778+0000 7f598d7fa640 1 -- 172.21.15.38:0/108382707 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5980010430 con 0x7f5990100680 2024-09-13T18:29:12.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.778+0000 7f59968ed640 1 -- 172.21.15.38:0/108382707 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599019acf0 con 0x7f5990100680 2024-09-13T18:29:12.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.778+0000 7f59968ed640 1 -- 172.21.15.38:0/108382707 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599019b1c0 con 0x7f5990100680 2024-09-13T18:29:12.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.779+0000 7f59968ed640 1 -- 172.21.15.38:0/108382707 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5990100a60 con 0x7f5990100680 2024-09-13T18:29:12.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.780+0000 7f598d7fa640 1 -- 172.21.15.38:0/108382707 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5980004f70 con 0x7f5990100680 2024-09-13T18:29:12.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.781+0000 7f598d7fa640 1 --2- 172.21.15.38:0/108382707 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f597806cc50 0x7f597806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:12.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.781+0000 7f598d7fa640 1 -- 172.21.15.38:0/108382707 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5980014070 con 0x7f5990100680 2024-09-13T18:29:12.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.781+0000 7f598f7fe640 1 --2- 172.21.15.38:0/108382707 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f597806cc50 0x7f597806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:12.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.782+0000 7f598f7fe640 1 --2- 172.21.15.38:0/108382707 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f597806cc50 0x7f597806f110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5984006010 tx=0x7f5984031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:12.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:12.787+0000 7f598d7fa640 1 -- 172.21.15.38:0/108382707 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5980056a70 con 0x7f5990100680 2024-09-13T18:29:13.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.165+0000 7f59968ed640 1 -- 172.21.15.38:0/108382707 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5990103a30 con 0x7f597806cc50 2024-09-13T18:29:13.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.167+0000 7f598d7fa640 1 -- 172.21.15.38:0/108382707 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f5990103a30 con 0x7f597806cc50 2024-09-13T18:29:13.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.170+0000 7f59968ed640 1 -- 172.21.15.38:0/108382707 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f597806cc50 msgr2=0x7f597806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.170+0000 7f59968ed640 1 --2- 172.21.15.38:0/108382707 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f597806cc50 0x7f597806f110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5984006010 tx=0x7f5984031400 comp rx=0 tx=0).stop 2024-09-13T18:29:13.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.170+0000 7f59968ed640 1 -- 172.21.15.38:0/108382707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5990100680 msgr2=0x7f59901955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.170+0000 7f59968ed640 1 --2- 172.21.15.38:0/108382707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5990100680 0x7f59901955d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f598000e970 tx=0x7f598000ed70 comp rx=0 tx=0).stop 2024-09-13T18:29:13.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.170+0000 7f59968ed640 1 -- 172.21.15.38:0/108382707 shutdown_connections 2024-09-13T18:29:13.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.170+0000 7f59968ed640 1 --2- 172.21.15.38:0/108382707 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f597806cc50 0x7f597806f110 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.170+0000 7f59968ed640 1 --2- 172.21.15.38:0/108382707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5990102fb0 0x7f5990195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.170+0000 7f59968ed640 1 --2- 172.21.15.38:0/108382707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5990100680 0x7f59901955d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.170+0000 7f59968ed640 1 -- 172.21.15.38:0/108382707 >> 172.21.15.38:0/108382707 conn(0x7f59900fa280 msgr2=0x7f59900fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.171+0000 7f59968ed640 1 -- 172.21.15.38:0/108382707 shutdown_connections 2024-09-13T18:29:13.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.171+0000 7f59968ed640 1 -- 172.21.15.38:0/108382707 wait complete. 2024-09-13T18:29:13.185 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:29:13.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.301+0000 7f3f046ab640 1 -- 172.21.15.38:0/2180255155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3efc102fb0 msgr2=0x7f3efc1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.301+0000 7f3f046ab640 1 --2- 172.21.15.38:0/2180255155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3efc102fb0 0x7f3efc1053a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0098b0 tx=0x7f3eec02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.301+0000 7f3f046ab640 1 -- 172.21.15.38:0/2180255155 shutdown_connections 2024-09-13T18:29:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.301+0000 7f3f046ab640 1 --2- 172.21.15.38:0/2180255155 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3efc102fb0 0x7f3efc1053a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.301+0000 7f3f046ab640 1 --2- 172.21.15.38:0/2180255155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3efc100680 0x7f3efc102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.301+0000 7f3f046ab640 1 -- 172.21.15.38:0/2180255155 >> 172.21.15.38:0/2180255155 conn(0x7f3efc0fa280 msgr2=0x7f3efc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.302+0000 7f3f046ab640 1 -- 172.21.15.38:0/2180255155 shutdown_connections 2024-09-13T18:29:13.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.302+0000 7f3f046ab640 1 -- 172.21.15.38:0/2180255155 wait complete. 2024-09-13T18:29:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.303+0000 7f3f046ab640 1 Processor -- start 2024-09-13T18:29:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.303+0000 7f3f046ab640 1 -- start start 2024-09-13T18:29:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.303+0000 7f3f046ab640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3efc100680 0x7f3efc193430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.303+0000 7f3f046ab640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3efc102fb0 0x7f3efc193970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.303+0000 7f3f046ab640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc193f40 con 0x7f3efc100680 2024-09-13T18:29:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.303+0000 7f3f046ab640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc1940b0 con 0x7f3efc102fb0 2024-09-13T18:29:13.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.303+0000 7f3f02447640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3efc100680 0x7f3efc193430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.303+0000 7f3f02447640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3efc100680 0x7f3efc193430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37198/0 (socket says 172.21.15.38:37198) 2024-09-13T18:29:13.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.303+0000 7f3f02447640 1 -- 172.21.15.38:0/2754539919 learned_addr learned my addr 172.21.15.38:0/2754539919 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:13.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.303+0000 7f3f01c46640 1 --2- 172.21.15.38:0/2754539919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3efc102fb0 0x7f3efc193970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.304+0000 7f3f02447640 1 -- 172.21.15.38:0/2754539919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3efc102fb0 msgr2=0x7f3efc193970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.304+0000 7f3f02447640 1 --2- 172.21.15.38:0/2754539919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3efc102fb0 0x7f3efc193970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.304+0000 7f3f02447640 1 -- 172.21.15.38:0/2754539919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec009560 con 0x7f3efc100680 2024-09-13T18:29:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.304+0000 7f3f02447640 1 --2- 172.21.15.38:0/2754539919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3efc100680 0x7f3efc193430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800e970 tx=0x7f3ef800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.304+0000 7f3ef37fe640 1 -- 172.21.15.38:0/2754539919 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef800cc90 con 0x7f3efc100680 2024-09-13T18:29:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.304+0000 7f3f046ab640 1 -- 172.21.15.38:0/2754539919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc198b80 con 0x7f3efc100680 2024-09-13T18:29:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.304+0000 7f3ef37fe640 1 -- 172.21.15.38:0/2754539919 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3ef800cdf0 con 0x7f3efc100680 2024-09-13T18:29:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.304+0000 7f3ef37fe640 1 -- 172.21.15.38:0/2754539919 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef8010430 con 0x7f3efc100680 2024-09-13T18:29:13.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.304+0000 7f3f046ab640 1 -- 172.21.15.38:0/2754539919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc1990a0 con 0x7f3efc100680 2024-09-13T18:29:13.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.306+0000 7f3f046ab640 1 -- 172.21.15.38:0/2754539919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc100a60 con 0x7f3efc100680 2024-09-13T18:29:13.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.307+0000 7f3ef37fe640 1 -- 172.21.15.38:0/2754539919 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3ef80046c0 con 0x7f3efc100680 2024-09-13T18:29:13.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.307+0000 7f3ef37fe640 1 --2- 172.21.15.38:0/2754539919 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3ee806cc50 0x7f3ee806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.307+0000 7f3ef37fe640 1 -- 172.21.15.38:0/2754539919 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3ef8014070 con 0x7f3efc100680 2024-09-13T18:29:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.308+0000 7f3f01c46640 1 --2- 172.21.15.38:0/2754539919 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3ee806cc50 0x7f3ee806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.308+0000 7f3f01c46640 1 --2- 172.21.15.38:0/2754539919 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3ee806cc50 0x7f3ee806f110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3eec006010 tx=0x7f3eec031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.315+0000 7f3ef37fe640 1 -- 172.21.15.38:0/2754539919 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3ef8056ac0 con 0x7f3efc100680 2024-09-13T18:29:13.629 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.627+0000 7f3f046ab640 1 -- 172.21.15.38:0/2754539919 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3efc0ffc80 con 0x7f3ee806cc50 2024-09-13T18:29:13.631 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.629+0000 7f3ef37fe640 1 -- 172.21.15.38:0/2754539919 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f3efc0ffc80 con 0x7f3ee806cc50 2024-09-13T18:29:13.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.631+0000 7f3f046ab640 1 -- 172.21.15.38:0/2754539919 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3ee806cc50 msgr2=0x7f3ee806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.631+0000 7f3f046ab640 1 --2- 172.21.15.38:0/2754539919 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3ee806cc50 0x7f3ee806f110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3eec006010 tx=0x7f3eec031400 comp rx=0 tx=0).stop 2024-09-13T18:29:13.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.631+0000 7f3f046ab640 1 -- 172.21.15.38:0/2754539919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3efc100680 msgr2=0x7f3efc193430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.631+0000 7f3f046ab640 1 --2- 172.21.15.38:0/2754539919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3efc100680 0x7f3efc193430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800e970 tx=0x7f3ef800ed70 comp rx=0 tx=0).stop 2024-09-13T18:29:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.632+0000 7f3f046ab640 1 -- 172.21.15.38:0/2754539919 shutdown_connections 2024-09-13T18:29:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.632+0000 7f3f046ab640 1 --2- 172.21.15.38:0/2754539919 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f3ee806cc50 0x7f3ee806f110 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.632+0000 7f3f046ab640 1 --2- 172.21.15.38:0/2754539919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3efc102fb0 0x7f3efc193970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.632+0000 7f3f046ab640 1 --2- 172.21.15.38:0/2754539919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3efc100680 0x7f3efc193430 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.632+0000 7f3f046ab640 1 -- 172.21.15.38:0/2754539919 >> 172.21.15.38:0/2754539919 conn(0x7f3efc0fa280 msgr2=0x7f3efc0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.632+0000 7f3f046ab640 1 -- 172.21.15.38:0/2754539919 shutdown_connections 2024-09-13T18:29:13.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.632+0000 7f3f046ab640 1 -- 172.21.15.38:0/2754539919 wait complete. 2024-09-13T18:29:13.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.723+0000 7fda4c06d640 1 -- 172.21.15.38:0/3580099243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda440fe470 msgr2=0x7fda440fe870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.723+0000 7fda4c06d640 1 --2- 172.21.15.38:0/3580099243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda440fe470 0x7fda440fe870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fda40009880 tx=0x7fda4002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.723+0000 7fda4c06d640 1 -- 172.21.15.38:0/3580099243 shutdown_connections 2024-09-13T18:29:13.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.723+0000 7fda4c06d640 1 --2- 172.21.15.38:0/3580099243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda440fedb0 0x7fda440ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.723+0000 7fda4c06d640 1 --2- 172.21.15.38:0/3580099243 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda440fe470 0x7fda440fe870 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.723+0000 7fda4c06d640 1 -- 172.21.15.38:0/3580099243 >> 172.21.15.38:0/3580099243 conn(0x7fda440fa280 msgr2=0x7fda440fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:13.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.723+0000 7fda4c06d640 1 -- 172.21.15.38:0/3580099243 shutdown_connections 2024-09-13T18:29:13.726 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.723+0000 7fda4c06d640 1 -- 172.21.15.38:0/3580099243 wait complete. 2024-09-13T18:29:13.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.724+0000 7fda4c06d640 1 Processor -- start 2024-09-13T18:29:13.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.724+0000 7fda4c06d640 1 -- start start 2024-09-13T18:29:13.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.724+0000 7fda4c06d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda440fe470 0x7fda44197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.724+0000 7fda4c06d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda440fedb0 0x7fda44197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.724+0000 7fda4c06d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44198260 con 0x7fda440fe470 2024-09-13T18:29:13.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.724+0000 7fda4c06d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda441983d0 con 0x7fda440fedb0 2024-09-13T18:29:13.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.724+0000 7fda49608640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda440fedb0 0x7fda44197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.724+0000 7fda49608640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda440fedb0 0x7fda44197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.38:33950/0 (socket says 172.21.15.38:33950) 2024-09-13T18:29:13.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.724+0000 7fda49608640 1 -- 172.21.15.38:0/1997043169 learned_addr learned my addr 172.21.15.38:0/1997043169 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:13.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.724+0000 7fda49e09640 1 --2- 172.21.15.38:0/1997043169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda440fe470 0x7fda44197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.725+0000 7fda49e09640 1 -- 172.21.15.38:0/1997043169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda440fedb0 msgr2=0x7fda44197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:13.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.725+0000 7fda49e09640 1 --2- 172.21.15.38:0/1997043169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda440fedb0 0x7fda44197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:13.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.725+0000 7fda49e09640 1 -- 172.21.15.38:0/1997043169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda40009560 con 0x7fda440fe470 2024-09-13T18:29:13.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.725+0000 7fda49e09640 1 --2- 172.21.15.38:0/1997043169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda440fe470 0x7fda44197750 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fda40009880 tx=0x7fda400055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.725+0000 7fda3affd640 1 -- 172.21.15.38:0/1997043169 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda40004aa0 con 0x7fda440fe470 2024-09-13T18:29:13.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.725+0000 7fda4c06d640 1 -- 172.21.15.38:0/1997043169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4419ce10 con 0x7fda440fe470 2024-09-13T18:29:13.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.725+0000 7fda3affd640 1 -- 172.21.15.38:0/1997043169 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda40005d50 con 0x7fda440fe470 2024-09-13T18:29:13.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.725+0000 7fda3affd640 1 -- 172.21.15.38:0/1997043169 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda40031820 con 0x7fda440fe470 2024-09-13T18:29:13.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.726+0000 7fda4c06d640 1 -- 172.21.15.38:0/1997043169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4419d270 con 0x7fda440fe470 2024-09-13T18:29:13.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.727+0000 7fda4c06d640 1 -- 172.21.15.38:0/1997043169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4410a8a0 con 0x7fda440fe470 2024-09-13T18:29:13.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.728+0000 7fda3affd640 1 -- 172.21.15.38:0/1997043169 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fda40031ae0 con 0x7fda440fe470 2024-09-13T18:29:13.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.728+0000 7fda3affd640 1 --2- 172.21.15.38:0/1997043169 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fda3006cc50 0x7fda3006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:13.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.729+0000 7fda49608640 1 --2- 172.21.15.38:0/1997043169 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fda3006cc50 0x7fda3006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:13.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.728+0000 7fda3affd640 1 -- 172.21.15.38:0/1997043169 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fda400ad2e0 con 0x7fda440fe470 2024-09-13T18:29:13.731 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.729+0000 7fda49608640 1 --2- 172.21.15.38:0/1997043169 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fda3006cc50 0x7fda3006f110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda44198c70 tx=0x7fda34005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:13.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:13.733+0000 7fda3affd640 1 -- 172.21.15.38:0/1997043169 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fda40077700 con 0x7fda440fe470 2024-09-13T18:29:14.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.034+0000 7fda4c06d640 1 -- 172.21.15.38:0/1997043169 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda4419d490 con 0x7fda3006cc50 2024-09-13T18:29:14.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.051+0000 7fda3affd640 1 -- 172.21.15.38:0/1997043169 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fda4419d490 con 0x7fda3006cc50 2024-09-13T18:29:14.054 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:29:14.054 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (5m) 60s ago 6m 24.6M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:29:14.054 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (7m) 60s ago 7m 7532k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:29:14.054 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (6m) 67s ago 6m 7516k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:29:14.054 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (7m) 60s ago 7m 6899k - 18.2.4-845-ge4e227b3 67ddd33fa72f 30c026e97a6b 2024-09-13T18:29:14.054 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (6m) 67s ago 6m 6895k - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c179d7df975 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (5m) 60s ago 6m 87.5M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (79s) 60s ago 78s 15.8M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (86s) 60s ago 85s 12.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (83s) 67s ago 83s 15.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (76s) 67s ago 76s 14.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:9283,8765,8443 running (8m) 60s ago 8m 486M - 18.2.4-845-ge4e227b3 67ddd33fa72f 1cebd33ffd6a 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (5m) 67s ago 5m 440M - 18.2.4-845-ge4e227b3 67ddd33fa72f 9c9aea66991f 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (8m) 60s ago 8m 46.0M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f b654a36a9082 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (5m) 67s ago 5m 35.6M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 0133a107f35d 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (7m) 60s ago 7m 15.1M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (6m) 67s ago 6m 16.2M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (5m) 60s ago 5m 57.3M 3948M 18.2.4-845-ge4e227b3 67ddd33fa72f 69a9e66fb097 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (4m) 60s ago 4m 56.6M 3948M 18.2.4-845-ge4e227b3 67ddd33fa72f 07986b4ba73b 2024-09-13T18:29:14.055 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (4m) 60s ago 4m 49.2M 3948M 18.2.4-845-ge4e227b3 67ddd33fa72f e44cdda01aee 2024-09-13T18:29:14.056 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (3m) 67s ago 3m 45.5M 1213M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:29:14.056 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (3m) 67s ago 3m 54.7M 1213M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:29:14.056 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (2m) 67s ago 2m 46.1M 1213M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:29:14.056 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (5m) 60s ago 6m 57.6M - 2.43.0 a07b618ecd1d 292b390ae245 2024-09-13T18:29:14.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.055+0000 7fda4c06d640 1 -- 172.21.15.38:0/1997043169 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fda3006cc50 msgr2=0x7fda3006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.055+0000 7fda4c06d640 1 --2- 172.21.15.38:0/1997043169 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fda3006cc50 0x7fda3006f110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda44198c70 tx=0x7fda34005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:14.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.055+0000 7fda4c06d640 1 -- 172.21.15.38:0/1997043169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda440fe470 msgr2=0x7fda44197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.055+0000 7fda4c06d640 1 --2- 172.21.15.38:0/1997043169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda440fe470 0x7fda44197750 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fda40009880 tx=0x7fda400055a0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.055+0000 7fda4c06d640 1 -- 172.21.15.38:0/1997043169 shutdown_connections 2024-09-13T18:29:14.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.055+0000 7fda4c06d640 1 --2- 172.21.15.38:0/1997043169 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fda3006cc50 0x7fda3006f110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.055+0000 7fda4c06d640 1 --2- 172.21.15.38:0/1997043169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda440fedb0 0x7fda44197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.055+0000 7fda4c06d640 1 --2- 172.21.15.38:0/1997043169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fda440fe470 0x7fda44197750 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.055+0000 7fda4c06d640 1 -- 172.21.15.38:0/1997043169 >> 172.21.15.38:0/1997043169 conn(0x7fda440fa280 msgr2=0x7fda44106aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.055+0000 7fda4c06d640 1 -- 172.21.15.38:0/1997043169 shutdown_connections 2024-09-13T18:29:14.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.055+0000 7fda4c06d640 1 -- 172.21.15.38:0/1997043169 wait complete. 2024-09-13T18:29:14.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.181+0000 7ff75c2d3640 1 -- 172.21.15.38:0/213905955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff754102fb0 msgr2=0x7ff7541053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.181+0000 7ff75c2d3640 1 --2- 172.21.15.38:0/213905955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff754102fb0 0x7ff7541053a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff7440098b0 tx=0x7ff74402a4d0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.181+0000 7ff75c2d3640 1 -- 172.21.15.38:0/213905955 shutdown_connections 2024-09-13T18:29:14.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.181+0000 7ff75c2d3640 1 --2- 172.21.15.38:0/213905955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff754102fb0 0x7ff7541053a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.181+0000 7ff75c2d3640 1 --2- 172.21.15.38:0/213905955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff754100680 0x7ff754102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.181+0000 7ff75c2d3640 1 -- 172.21.15.38:0/213905955 >> 172.21.15.38:0/213905955 conn(0x7ff7540fa280 msgr2=0x7ff7540fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.181+0000 7ff75c2d3640 1 -- 172.21.15.38:0/213905955 shutdown_connections 2024-09-13T18:29:14.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.181+0000 7ff75c2d3640 1 -- 172.21.15.38:0/213905955 wait complete. 2024-09-13T18:29:14.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.182+0000 7ff75c2d3640 1 Processor -- start 2024-09-13T18:29:14.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.182+0000 7ff75c2d3640 1 -- start start 2024-09-13T18:29:14.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.182+0000 7ff75c2d3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff754100680 0x7ff7540fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.182+0000 7ff75c2d3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff754102fb0 0x7ff7540fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.182+0000 7ff75c2d3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540feb70 con 0x7ff754102fb0 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.182+0000 7ff75c2d3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540fece0 con 0x7ff754100680 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.182+0000 7ff75986e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff754102fb0 0x7ff7540fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.182+0000 7ff75986e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff754102fb0 0x7ff7540fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37240/0 (socket says 172.21.15.38:37240) 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.182+0000 7ff75986e640 1 -- 172.21.15.38:0/626219036 learned_addr learned my addr 172.21.15.38:0/626219036 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.182+0000 7ff75a06f640 1 --2- 172.21.15.38:0/626219036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff754100680 0x7ff7540fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.183+0000 7ff75986e640 1 -- 172.21.15.38:0/626219036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff754100680 msgr2=0x7ff7540fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.183+0000 7ff75986e640 1 --2- 172.21.15.38:0/626219036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff754100680 0x7ff7540fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.183+0000 7ff75986e640 1 -- 172.21.15.38:0/626219036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff744009560 con 0x7ff754102fb0 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.183+0000 7ff75986e640 1 --2- 172.21.15.38:0/626219036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff754102fb0 0x7ff7540fe630 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff74402a9f0 tx=0x7ff7440055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.183+0000 7ff74b7fe640 1 -- 172.21.15.38:0/626219036 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff744004aa0 con 0x7ff754102fb0 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.183+0000 7ff74b7fe640 1 -- 172.21.15.38:0/626219036 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff744005d50 con 0x7ff754102fb0 2024-09-13T18:29:14.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.183+0000 7ff74b7fe640 1 -- 172.21.15.38:0/626219036 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7440318f0 con 0x7ff754102fb0 2024-09-13T18:29:14.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.183+0000 7ff75c2d3640 1 -- 172.21.15.38:0/626219036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7540fef60 con 0x7ff754102fb0 2024-09-13T18:29:14.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.183+0000 7ff75c2d3640 1 -- 172.21.15.38:0/626219036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7540ff450 con 0x7ff754102fb0 2024-09-13T18:29:14.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.185+0000 7ff75c2d3640 1 -- 172.21.15.38:0/626219036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7541086c0 con 0x7ff754102fb0 2024-09-13T18:29:14.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.185+0000 7ff74b7fe640 1 -- 172.21.15.38:0/626219036 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff744003b90 con 0x7ff754102fb0 2024-09-13T18:29:14.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.186+0000 7ff74b7fe640 1 --2- 172.21.15.38:0/626219036 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff74006cc60 0x7ff74006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.186+0000 7ff74b7fe640 1 -- 172.21.15.38:0/626219036 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff7440ad2b0 con 0x7ff754102fb0 2024-09-13T18:29:14.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.186+0000 7ff75a06f640 1 --2- 172.21.15.38:0/626219036 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff74006cc60 0x7ff74006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.186+0000 7ff75a06f640 1 --2- 172.21.15.38:0/626219036 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff74006cc60 0x7ff74006f120 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff750009bd0 tx=0x7ff750005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.190+0000 7ff74b7fe640 1 -- 172.21.15.38:0/626219036 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff744077750 con 0x7ff754102fb0 2024-09-13T18:29:14.299 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:14 smithi038 ceph-mon[27689]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:14.299 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:14 smithi038 ceph-mon[27689]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T18:29:14.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.433+0000 7ff75c2d3640 1 -- 172.21.15.38:0/626219036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff7541088a0 con 0x7ff754102fb0 2024-09-13T18:29:14.436 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.433+0000 7ff74b7fe640 1 -- 172.21.15.38:0/626219036 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7ff74407ad70 con 0x7ff754102fb0 2024-09-13T18:29:14.436 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:29:14.436 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:29:14.436 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T18:29:14.436 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:29:14.436 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:29:14.437 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T18:29:14.437 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:29:14.437 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:29:14.437 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T18:29:14.437 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:29:14.437 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:29:14.437 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:29:14.437 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:29:14.437 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:29:14.437 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 14 2024-09-13T18:29:14.437 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:29:14.437 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:29:14.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.435+0000 7ff75c2d3640 1 -- 172.21.15.38:0/626219036 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff74006cc60 msgr2=0x7ff74006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.435+0000 7ff75c2d3640 1 --2- 172.21.15.38:0/626219036 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff74006cc60 0x7ff74006f120 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff750009bd0 tx=0x7ff750005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:14.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.435+0000 7ff75c2d3640 1 -- 172.21.15.38:0/626219036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff754102fb0 msgr2=0x7ff7540fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.435+0000 7ff75c2d3640 1 --2- 172.21.15.38:0/626219036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff754102fb0 0x7ff7540fe630 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff74402a9f0 tx=0x7ff7440055a0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.435+0000 7ff75c2d3640 1 -- 172.21.15.38:0/626219036 shutdown_connections 2024-09-13T18:29:14.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.435+0000 7ff75c2d3640 1 --2- 172.21.15.38:0/626219036 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ff74006cc60 0x7ff74006f120 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.435+0000 7ff75c2d3640 1 --2- 172.21.15.38:0/626219036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff754102fb0 0x7ff7540fe630 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.435+0000 7ff75c2d3640 1 --2- 172.21.15.38:0/626219036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff754100680 0x7ff7540fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.435+0000 7ff75c2d3640 1 -- 172.21.15.38:0/626219036 >> 172.21.15.38:0/626219036 conn(0x7ff7540fa280 msgr2=0x7ff7540fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.436+0000 7ff75c2d3640 1 -- 172.21.15.38:0/626219036 shutdown_connections 2024-09-13T18:29:14.439 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.436+0000 7ff75c2d3640 1 -- 172.21.15.38:0/626219036 wait complete. 2024-09-13T18:29:14.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.524+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/645061585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc0ffb90 msgr2=0x7f0adc0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.524+0000 7f0ae2eb0640 1 --2- 172.21.15.38:0/645061585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc0ffb90 0x7f0adc0fff90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009880 tx=0x7f0ad002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.524+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/645061585 shutdown_connections 2024-09-13T18:29:14.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.524+0000 7f0ae2eb0640 1 --2- 172.21.15.38:0/645061585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0adc100d90 0x7f0adc101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.524+0000 7f0ae2eb0640 1 --2- 172.21.15.38:0/645061585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc0ffb90 0x7f0adc0fff90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.524+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/645061585 >> 172.21.15.38:0/645061585 conn(0x7f0adc0fb360 msgr2=0x7f0adc0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.524+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/645061585 shutdown_connections 2024-09-13T18:29:14.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.524+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/645061585 wait complete. 2024-09-13T18:29:14.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.525+0000 7f0ae2eb0640 1 Processor -- start 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.525+0000 7f0ae2eb0640 1 -- start start 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.525+0000 7f0ae2eb0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc100d90 0x7f0adc074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.525+0000 7f0ae2eb0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0adc0728a0 0x7f0adc072d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.525+0000 7f0ae2eb0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc074790 con 0x7f0adc100d90 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.525+0000 7f0ae2eb0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc1993a0 con 0x7f0adc0728a0 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.526+0000 7f0adbfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0adc0728a0 0x7f0adc072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.526+0000 7f0adbfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0adc0728a0 0x7f0adc072d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.38:33984/0 (socket says 172.21.15.38:33984) 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.526+0000 7f0adbfff640 1 -- 172.21.15.38:0/458510512 learned_addr learned my addr 172.21.15.38:0/458510512 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.526+0000 7f0ae0c4c640 1 --2- 172.21.15.38:0/458510512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc100d90 0x7f0adc074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.526+0000 7f0adbfff640 1 -- 172.21.15.38:0/458510512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc100d90 msgr2=0x7f0adc074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.526+0000 7f0adbfff640 1 --2- 172.21.15.38:0/458510512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc100d90 0x7f0adc074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.526+0000 7f0adbfff640 1 -- 172.21.15.38:0/458510512 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad0009560 con 0x7f0adc0728a0 2024-09-13T18:29:14.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.526+0000 7f0ae0c4c640 1 --2- 172.21.15.38:0/458510512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc100d90 0x7f0adc074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:14.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.526+0000 7f0adbfff640 1 --2- 172.21.15.38:0/458510512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0adc0728a0 0x7f0adc072d20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800e970 tx=0x7f0ac800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.526+0000 7f0ad9ffb640 1 -- 172.21.15.38:0/458510512 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ac800cc90 con 0x7f0adc0728a0 2024-09-13T18:29:14.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.527+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/458510512 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc073260 con 0x7f0adc0728a0 2024-09-13T18:29:14.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.527+0000 7f0ad9ffb640 1 -- 172.21.15.38:0/458510512 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ac800cdf0 con 0x7f0adc0728a0 2024-09-13T18:29:14.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.527+0000 7f0ad9ffb640 1 -- 172.21.15.38:0/458510512 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ac8018810 con 0x7f0adc0728a0 2024-09-13T18:29:14.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.527+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/458510512 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc1a1f70 con 0x7f0adc0728a0 2024-09-13T18:29:14.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.528+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/458510512 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc108640 con 0x7f0adc0728a0 2024-09-13T18:29:14.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.529+0000 7f0ad9ffb640 1 -- 172.21.15.38:0/458510512 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0ac8018a40 con 0x7f0adc0728a0 2024-09-13T18:29:14.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.529+0000 7f0ad9ffb640 1 --2- 172.21.15.38:0/458510512 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f0acc06cc50 0x7f0acc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:14.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.530+0000 7f0ad9ffb640 1 -- 172.21.15.38:0/458510512 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0ac8014070 con 0x7f0adc0728a0 2024-09-13T18:29:14.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.530+0000 7f0ae0c4c640 1 --2- 172.21.15.38:0/458510512 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f0acc06cc50 0x7f0acc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:14.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.531+0000 7f0ae0c4c640 1 --2- 172.21.15.38:0/458510512 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f0acc06cc50 0x7f0acc06f110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0006010 tx=0x7f0ad0031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:14.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.537+0000 7f0ad9ffb640 1 -- 172.21.15.38:0/458510512 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0ac8052e20 con 0x7f0adc0728a0 2024-09-13T18:29:14.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:14 smithi149 ceph-mon[35845]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:14.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:14 smithi149 ceph-mon[35845]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T18:29:14.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.917+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/458510512 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0adc1a2240 con 0x7f0adc0728a0 2024-09-13T18:29:14.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.917+0000 7f0ad9ffb640 1 -- 172.21.15.38:0/458510512 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7f0ac8056be0 con 0x7f0adc0728a0 2024-09-13T18:29:14.920 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:29:14.920 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:29:14.920 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:29:14.920 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:29:14.920 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:29:14.920 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:29:14.920 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:29:14.921 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:29:14.922 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:29:14.923 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:29:14.923 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:29:14.923 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:29:14.923 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:29:14.923 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:29:14.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.920+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/458510512 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f0acc06cc50 msgr2=0x7f0acc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.920+0000 7f0ae2eb0640 1 --2- 172.21.15.38:0/458510512 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f0acc06cc50 0x7f0acc06f110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0006010 tx=0x7f0ad0031400 comp rx=0 tx=0).stop 2024-09-13T18:29:14.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.920+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/458510512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0adc0728a0 msgr2=0x7f0adc072d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:14.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.920+0000 7f0ae2eb0640 1 --2- 172.21.15.38:0/458510512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0adc0728a0 0x7f0adc072d20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800e970 tx=0x7f0ac800ee30 comp rx=0 tx=0).stop 2024-09-13T18:29:14.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.921+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/458510512 shutdown_connections 2024-09-13T18:29:14.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.921+0000 7f0ae2eb0640 1 --2- 172.21.15.38:0/458510512 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f0acc06cc50 0x7f0acc06f110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.921+0000 7f0ae2eb0640 1 --2- 172.21.15.38:0/458510512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0adc0728a0 0x7f0adc072d20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.921+0000 7f0ae2eb0640 1 --2- 172.21.15.38:0/458510512 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0adc100d90 0x7f0adc074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:14.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.921+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/458510512 >> 172.21.15.38:0/458510512 conn(0x7f0adc0fb360 msgr2=0x7f0adc103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:14.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.921+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/458510512 shutdown_connections 2024-09-13T18:29:14.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:14.921+0000 7f0ae2eb0640 1 -- 172.21.15.38:0/458510512 wait complete. 2024-09-13T18:29:15.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.050+0000 7f5d137fe640 1 -- 172.21.15.38:0/3881074995 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d000317d0 con 0x7f5d140ffcf0 2024-09-13T18:29:15.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.051+0000 7f5d1b045640 1 -- 172.21.15.38:0/3881074995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d140ffcf0 msgr2=0x7f5d14100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.052+0000 7f5d1b045640 1 --2- 172.21.15.38:0/3881074995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d140ffcf0 0x7f5d14100170 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009880 tx=0x7f5d0002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.052+0000 7f5d1b045640 1 -- 172.21.15.38:0/3881074995 shutdown_connections 2024-09-13T18:29:15.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.052+0000 7f5d1b045640 1 --2- 172.21.15.38:0/3881074995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d140ffcf0 0x7f5d14100170 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.052+0000 7f5d1b045640 1 --2- 172.21.15.38:0/3881074995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d140feaf0 0x7f5d140feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.052+0000 7f5d1b045640 1 -- 172.21.15.38:0/3881074995 >> 172.21.15.38:0/3881074995 conn(0x7f5d140fa280 msgr2=0x7f5d140fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.052+0000 7f5d1b045640 1 -- 172.21.15.38:0/3881074995 shutdown_connections 2024-09-13T18:29:15.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.052+0000 7f5d1b045640 1 -- 172.21.15.38:0/3881074995 wait complete. 2024-09-13T18:29:15.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.052+0000 7f5d1b045640 1 Processor -- start 2024-09-13T18:29:15.055 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.052+0000 7f5d1b045640 1 -- start start 2024-09-13T18:29:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.053+0000 7f5d1b045640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d140feaf0 0x7f5d141977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.053+0000 7f5d1b045640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d140ffcf0 0x7f5d14197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.053+0000 7f5d1b045640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d141982f0 con 0x7f5d140ffcf0 2024-09-13T18:29:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.053+0000 7f5d1b045640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d14198460 con 0x7f5d140feaf0 2024-09-13T18:29:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.053+0000 7f5d18de1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d140feaf0 0x7f5d141977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.053+0000 7f5d18de1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d140feaf0 0x7f5d141977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.38:34000/0 (socket says 172.21.15.38:34000) 2024-09-13T18:29:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.053+0000 7f5d18de1640 1 -- 172.21.15.38:0/1703482825 learned_addr learned my addr 172.21.15.38:0/1703482825 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.053+0000 7f5d13fff640 1 --2- 172.21.15.38:0/1703482825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d140ffcf0 0x7f5d14197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.053+0000 7f5d18de1640 1 -- 172.21.15.38:0/1703482825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d140ffcf0 msgr2=0x7f5d14197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.053+0000 7f5d18de1640 1 --2- 172.21.15.38:0/1703482825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d140ffcf0 0x7f5d14197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.053+0000 7f5d18de1640 1 -- 172.21.15.38:0/1703482825 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d00009560 con 0x7f5d140feaf0 2024-09-13T18:29:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.054+0000 7f5d18de1640 1 --2- 172.21.15.38:0/1703482825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d140feaf0 0x7f5d141977e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800e940 tx=0x7f5d0800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.054+0000 7f5d11ffb640 1 -- 172.21.15.38:0/1703482825 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d080096e0 con 0x7f5d140feaf0 2024-09-13T18:29:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.054+0000 7f5d1b045640 1 -- 172.21.15.38:0/1703482825 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1419cf00 con 0x7f5d140feaf0 2024-09-13T18:29:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.054+0000 7f5d11ffb640 1 -- 172.21.15.38:0/1703482825 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5d080044d0 con 0x7f5d140feaf0 2024-09-13T18:29:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.054+0000 7f5d11ffb640 1 -- 172.21.15.38:0/1703482825 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d08010430 con 0x7f5d140feaf0 2024-09-13T18:29:15.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.054+0000 7f5d1b045640 1 -- 172.21.15.38:0/1703482825 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1419d3c0 con 0x7f5d140feaf0 2024-09-13T18:29:15.058 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.055+0000 7f5d1b045640 1 -- 172.21.15.38:0/1703482825 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d140feef0 con 0x7f5d140feaf0 2024-09-13T18:29:15.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.056+0000 7f5d11ffb640 1 -- 172.21.15.38:0/1703482825 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5d0800cc90 con 0x7f5d140feaf0 2024-09-13T18:29:15.059 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.057+0000 7f5d11ffb640 1 --2- 172.21.15.38:0/1703482825 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f5d0406cd10 0x7f5d0406f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.057+0000 7f5d11ffb640 1 -- 172.21.15.38:0/1703482825 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5d08014070 con 0x7f5d140feaf0 2024-09-13T18:29:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.057+0000 7f5d13fff640 1 --2- 172.21.15.38:0/1703482825 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f5d0406cd10 0x7f5d0406f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.058+0000 7f5d13fff640 1 --2- 172.21.15.38:0/1703482825 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f5d0406cd10 0x7f5d0406f1d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d14198d00 tx=0x7f5d00031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.062+0000 7f5d11ffb640 1 -- 172.21.15.38:0/1703482825 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5d08056a60 con 0x7f5d140feaf0 2024-09-13T18:29:15.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.255+0000 7f5d1b045640 1 -- 172.21.15.38:0/1703482825 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d1402c590 con 0x7f5d0406cd10 2024-09-13T18:29:15.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.256+0000 7f5d11ffb640 1 -- 172.21.15.38:0/1703482825 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f5d1402c590 con 0x7f5d0406cd10 2024-09-13T18:29:15.259 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:29:15.260 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:29:15.260 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:29:15.260 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:29:15.260 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [], 2024-09-13T18:29:15.260 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "0/23 daemons upgraded", 2024-09-13T18:29:15.260 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 image on host smithi149", 2024-09-13T18:29:15.260 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:29:15.260 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:29:15.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.259+0000 7f5d1b045640 1 -- 172.21.15.38:0/1703482825 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f5d0406cd10 msgr2=0x7f5d0406f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.259+0000 7f5d1b045640 1 --2- 172.21.15.38:0/1703482825 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f5d0406cd10 0x7f5d0406f1d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d14198d00 tx=0x7f5d00031400 comp rx=0 tx=0).stop 2024-09-13T18:29:15.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.259+0000 7f5d1b045640 1 -- 172.21.15.38:0/1703482825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d140feaf0 msgr2=0x7f5d141977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.259+0000 7f5d1b045640 1 --2- 172.21.15.38:0/1703482825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d140feaf0 0x7f5d141977e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800e940 tx=0x7f5d0800ee00 comp rx=0 tx=0).stop 2024-09-13T18:29:15.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.259+0000 7f5d1b045640 1 -- 172.21.15.38:0/1703482825 shutdown_connections 2024-09-13T18:29:15.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.259+0000 7f5d1b045640 1 --2- 172.21.15.38:0/1703482825 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f5d0406cd10 0x7f5d0406f1d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.259+0000 7f5d1b045640 1 --2- 172.21.15.38:0/1703482825 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d140ffcf0 0x7f5d14197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.259+0000 7f5d1b045640 1 --2- 172.21.15.38:0/1703482825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d140feaf0 0x7f5d141977e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.259+0000 7f5d1b045640 1 -- 172.21.15.38:0/1703482825 >> 172.21.15.38:0/1703482825 conn(0x7f5d140fa280 msgr2=0x7f5d141033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.260+0000 7f5d1b045640 1 -- 172.21.15.38:0/1703482825 shutdown_connections 2024-09-13T18:29:15.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.260+0000 7f5d1b045640 1 -- 172.21.15.38:0/1703482825 wait complete. 2024-09-13T18:29:15.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.348+0000 7f491fda1640 1 -- 172.21.15.38:0/75832404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4918102fb0 msgr2=0x7f49181053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.348+0000 7f491fda1640 1 --2- 172.21.15.38:0/75832404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4918102fb0 0x7f49181053a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f49080098b0 tx=0x7f490802a4d0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.348+0000 7f491fda1640 1 -- 172.21.15.38:0/75832404 shutdown_connections 2024-09-13T18:29:15.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.348+0000 7f491fda1640 1 --2- 172.21.15.38:0/75832404 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4918102fb0 0x7f49181053a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.348+0000 7f491fda1640 1 --2- 172.21.15.38:0/75832404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4918100680 0x7f4918102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.348+0000 7f491fda1640 1 -- 172.21.15.38:0/75832404 >> 172.21.15.38:0/75832404 conn(0x7f49180fa280 msgr2=0x7f49180fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.348+0000 7f491fda1640 1 -- 172.21.15.38:0/75832404 shutdown_connections 2024-09-13T18:29:15.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.348+0000 7f491fda1640 1 -- 172.21.15.38:0/75832404 wait complete. 2024-09-13T18:29:15.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.349+0000 7f491fda1640 1 Processor -- start 2024-09-13T18:29:15.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.349+0000 7f491fda1640 1 -- start start 2024-09-13T18:29:15.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.349+0000 7f491fda1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4918100680 0x7f49180fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.349+0000 7f491fda1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4918102fb0 0x7f49180fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.349+0000 7f491fda1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49180feb70 con 0x7f4918102fb0 2024-09-13T18:29:15.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.349+0000 7f491fda1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49180fece0 con 0x7f4918100680 2024-09-13T18:29:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.350+0000 7f491d33c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4918102fb0 0x7f49180fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.350+0000 7f491d33c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4918102fb0 0x7f49180fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37298/0 (socket says 172.21.15.38:37298) 2024-09-13T18:29:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.350+0000 7f491d33c640 1 -- 172.21.15.38:0/1076298852 learned_addr learned my addr 172.21.15.38:0/1076298852 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.350+0000 7f491db3d640 1 --2- 172.21.15.38:0/1076298852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4918100680 0x7f49180fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.350+0000 7f491d33c640 1 -- 172.21.15.38:0/1076298852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4918100680 msgr2=0x7f49180fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.350+0000 7f491d33c640 1 --2- 172.21.15.38:0/1076298852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4918100680 0x7f49180fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.350+0000 7f491d33c640 1 -- 172.21.15.38:0/1076298852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908009560 con 0x7f4918102fb0 2024-09-13T18:29:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.350+0000 7f491db3d640 1 --2- 172.21.15.38:0/1076298852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4918100680 0x7f49180fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.350+0000 7f491d33c640 1 --2- 172.21.15.38:0/1076298852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4918102fb0 0x7f49180fe630 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f490802a9f0 tx=0x7f49080055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.351+0000 7f490effd640 1 -- 172.21.15.38:0/1076298852 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4908004aa0 con 0x7f4918102fb0 2024-09-13T18:29:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.351+0000 7f491fda1640 1 -- 172.21.15.38:0/1076298852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49180fef60 con 0x7f4918102fb0 2024-09-13T18:29:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.351+0000 7f490effd640 1 -- 172.21.15.38:0/1076298852 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4908005d50 con 0x7f4918102fb0 2024-09-13T18:29:15.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.351+0000 7f490effd640 1 -- 172.21.15.38:0/1076298852 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49080318f0 con 0x7f4918102fb0 2024-09-13T18:29:15.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.351+0000 7f491fda1640 1 -- 172.21.15.38:0/1076298852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49180ff450 con 0x7f4918102fb0 2024-09-13T18:29:15.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.352+0000 7f491fda1640 1 -- 172.21.15.38:0/1076298852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49181086a0 con 0x7f4918102fb0 2024-09-13T18:29:15.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.353+0000 7f490effd640 1 -- 172.21.15.38:0/1076298852 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4908003b90 con 0x7f4918102fb0 2024-09-13T18:29:15.356 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.354+0000 7f490effd640 1 --2- 172.21.15.38:0/1076298852 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f490406cc60 0x7f490406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:15.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.354+0000 7f490effd640 1 -- 172.21.15.38:0/1076298852 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f49080ad420 con 0x7f4918102fb0 2024-09-13T18:29:15.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.354+0000 7f491db3d640 1 --2- 172.21.15.38:0/1076298852 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f490406cc60 0x7f490406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:15.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.355+0000 7f491db3d640 1 --2- 172.21.15.38:0/1076298852 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f490406cc60 0x7f490406f120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4914009c20 tx=0x7f4914005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:15.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.362+0000 7f490effd640 1 -- 172.21.15.38:0/1076298852 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4908077790 con 0x7f4918102fb0 2024-09-13T18:29:15.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:15 smithi038 ceph-mon[27689]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:15.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:15 smithi038 ceph-mon[27689]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:15.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:15 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/626219036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:29:15.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:15 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/458510512' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:29:15.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.602+0000 7f491fda1640 1 -- 172.21.15.38:0/1076298852 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f49181088b0 con 0x7f4918102fb0 2024-09-13T18:29:15.605 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.603+0000 7f490effd640 1 -- 172.21.15.38:0/1076298852 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f490807adb0 con 0x7f4918102fb0 2024-09-13T18:29:15.605 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:29:15.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.605+0000 7f491fda1640 1 -- 172.21.15.38:0/1076298852 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f490406cc60 msgr2=0x7f490406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.606+0000 7f491fda1640 1 --2- 172.21.15.38:0/1076298852 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f490406cc60 0x7f490406f120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4914009c20 tx=0x7f4914005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:15.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.606+0000 7f491fda1640 1 -- 172.21.15.38:0/1076298852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4918102fb0 msgr2=0x7f49180fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:15.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.606+0000 7f491fda1640 1 --2- 172.21.15.38:0/1076298852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4918102fb0 0x7f49180fe630 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f490802a9f0 tx=0x7f49080055a0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.606+0000 7f491fda1640 1 -- 172.21.15.38:0/1076298852 shutdown_connections 2024-09-13T18:29:15.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.606+0000 7f491fda1640 1 --2- 172.21.15.38:0/1076298852 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f490406cc60 0x7f490406f120 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.606+0000 7f491fda1640 1 --2- 172.21.15.38:0/1076298852 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4918102fb0 0x7f49180fe630 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.606+0000 7f491fda1640 1 --2- 172.21.15.38:0/1076298852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4918100680 0x7f49180fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:15.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.606+0000 7f491fda1640 1 -- 172.21.15.38:0/1076298852 >> 172.21.15.38:0/1076298852 conn(0x7f49180fa280 msgr2=0x7f49180fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:15.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.606+0000 7f491fda1640 1 -- 172.21.15.38:0/1076298852 shutdown_connections 2024-09-13T18:29:15.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:15.606+0000 7f491fda1640 1 -- 172.21.15.38:0/1076298852 wait complete. 2024-09-13T18:29:15.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:15 smithi149 ceph-mon[35845]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:15.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:15 smithi149 ceph-mon[35845]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:15.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:15 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/626219036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:29:15.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:15 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/458510512' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:29:16.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:16 smithi038 ceph-mon[27689]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T18:29:16.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:16 smithi038 ceph-mon[27689]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:16.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:16 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1076298852' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:29:16.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:16 smithi149 ceph-mon[35845]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-13T18:29:16.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:16 smithi149 ceph-mon[35845]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:16.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:16 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1076298852' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:29:17.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:17 smithi038 ceph-mon[27689]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T18:29:17.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:17 smithi149 ceph-mon[35845]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T18:29:20.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:20 smithi038 ceph-mon[27689]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T18:29:20.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:20 smithi149 ceph-mon[35845]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T18:29:21.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:21 smithi149 ceph-mon[35845]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T18:29:21.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:21 smithi038 ceph-mon[27689]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T18:29:24.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:24 smithi038 ceph-mon[27689]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:29:24.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:24 smithi149 ceph-mon[35845]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:29:25.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:25 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:29:25.670 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:25 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:29:26.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:26 smithi038 ceph-mon[27689]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:29:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:26 smithi149 ceph-mon[35845]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:29:27.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:27 smithi038 ceph-mon[27689]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:29:27.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:27 smithi149 ceph-mon[35845]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:29:29.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:29 smithi149 ceph-mon[35845]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:29:29.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:29 smithi038 ceph-mon[27689]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:29:30.797 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 90% (11494/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T18:29:31.360 INFO:tasks.workunit.client.1.smithi149.stderr:Updating files: 79% (10106/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T18:29:31.940 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:29:31.940 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-13T18:29:31.940 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:29:31.940 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:29:31.940 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:29:31.940 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-13T18:29:31.940 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:29:31.940 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:29:31.941 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-13T18:29:31.941 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-09-13T18:29:31.941 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-13T18:29:31.941 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-09-13T18:29:31.941 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-13T18:29:31.941 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-09-13T18:29:31.941 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-13T18:29:31.941 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:29:31.941 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-09-13T18:29:31.941 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:29:31.946 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T18:29:32.090 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:29:32.093 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:29:32.093 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:29:32.355 INFO:tasks.workunit.client.1.smithi149.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:29:32.355 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-13T18:29:32.355 INFO:tasks.workunit.client.1.smithi149.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:29:32.355 INFO:tasks.workunit.client.1.smithi149.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:29:32.355 INFO:tasks.workunit.client.1.smithi149.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:29:32.355 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-13T18:29:32.355 INFO:tasks.workunit.client.1.smithi149.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:29:32.355 INFO:tasks.workunit.client.1.smithi149.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:29:32.355 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-13T18:29:32.355 INFO:tasks.workunit.client.1.smithi149.stderr: git switch -c 2024-09-13T18:29:32.356 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-13T18:29:32.356 INFO:tasks.workunit.client.1.smithi149.stderr:Or undo this operation with: 2024-09-13T18:29:32.356 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-13T18:29:32.356 INFO:tasks.workunit.client.1.smithi149.stderr: git switch - 2024-09-13T18:29:32.356 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-13T18:29:32.356 INFO:tasks.workunit.client.1.smithi149.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:29:32.356 INFO:tasks.workunit.client.1.smithi149.stderr: 2024-09-13T18:29:32.356 INFO:tasks.workunit.client.1.smithi149.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:29:32.360 DEBUG:teuthology.orchestra.run.smithi149:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-13T18:29:32.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:32 smithi038 ceph-mon[27689]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:29:32.640 INFO:tasks.workunit.client.1.smithi149.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:29:32.643 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T18:29:32.643 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:29:32.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:32 smithi149 ceph-mon[35845]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:29:33.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:33 smithi149 ceph-mon[35845]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:29:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:33 smithi038 ceph-mon[27689]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:29:36.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:36 smithi038 ceph-mon[27689]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:29:36.640 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:36 smithi149 ceph-mon[35845]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:29:36.696 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:29:36.792 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:29:36.832 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T18:29:36.834 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T18:29:36.834 INFO:tasks.workunit.client.1.smithi149.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:29:36.876 INFO:tasks.workunit.client.1.smithi149.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T18:29:36.879 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:29:36.879 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-13T18:29:36.895 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-13T18:29:36.897 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T18:29:36.897 DEBUG:teuthology.orchestra.run.smithi149:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-13T18:29:36.963 INFO:tasks.workunit.client.1.smithi149.stderr:+ mkdir -p fsstress 2024-09-13T18:29:36.965 INFO:tasks.workunit.client.1.smithi149.stderr:+ pushd fsstress 2024-09-13T18:29:36.965 INFO:tasks.workunit.client.1.smithi149.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T18:29:36.965 INFO:tasks.workunit.client.1.smithi149.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T18:29:37.588 INFO:tasks.workunit.client.1.smithi149.stderr:+ tar xzf ltp-full.tgz 2024-09-13T18:29:37.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:37 smithi038 ceph-mon[27689]: Upgrade: Updating mgr.smithi149.eabzne 2024-09-13T18:29:37.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:37 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:37.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:37 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.eabzne", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:29:37.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:37 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:29:37.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:37 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:29:37.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:37 smithi038 ceph-mon[27689]: Deploying daemon mgr.smithi149.eabzne on smithi149 2024-09-13T18:29:37.994 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:37 smithi038 ceph-mon[27689]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:29:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:37 smithi149 ceph-mon[35845]: Upgrade: Updating mgr.smithi149.eabzne 2024-09-13T18:29:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:37 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:37 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.eabzne", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:29:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:37 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:29:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:37 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:29:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:37 smithi149 ceph-mon[35845]: Deploying daemon mgr.smithi149.eabzne on smithi149 2024-09-13T18:29:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:37 smithi149 ceph-mon[35845]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:29:39.113 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:29:39.210 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:29:39.257 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:29:39.259 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:29:39.259 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:29:39.302 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:29:39.305 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:29:39.305 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T18:29:39.322 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-13T18:29:39.323 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T18:29:39.323 DEBUG:teuthology.orchestra.run.smithi038:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-13T18:29:39.385 INFO:tasks.workunit.client.0.smithi038.stderr:+ mkdir -p fsstress 2024-09-13T18:29:39.387 INFO:tasks.workunit.client.0.smithi038.stderr:+ pushd fsstress 2024-09-13T18:29:39.388 INFO:tasks.workunit.client.0.smithi038.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T18:29:39.388 INFO:tasks.workunit.client.0.smithi038.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T18:29:40.515 INFO:tasks.workunit.client.0.smithi038.stderr:+ tar xzf ltp-full.tgz 2024-09-13T18:29:40.558 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:40 smithi149 ceph-mon[35845]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:29:40.558 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:40 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:29:40.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:40 smithi038 ceph-mon[27689]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:29:40.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:40 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:29:41.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:41 smithi149 ceph-mon[35845]: pgmap v238: 65 pgs: 65 active+clean; 6.3 MiB data, 192 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 488 KiB/s wr, 6 op/s 2024-09-13T18:29:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:41 smithi038 ceph-mon[27689]: pgmap v238: 65 pgs: 65 active+clean; 6.3 MiB data, 192 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 488 KiB/s wr, 6 op/s 2024-09-13T18:29:42.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:42 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:42.532 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:42 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:42.532 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:42 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:29:42.696 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:42 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:42.696 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:42 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:42.696 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:42 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:29:43.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:43 smithi149 ceph-mon[35845]: pgmap v239: 65 pgs: 65 active+clean; 8.6 MiB data, 202 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 706 KiB/s wr, 41 op/s 2024-09-13T18:29:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:43 smithi038 ceph-mon[27689]: pgmap v239: 65 pgs: 65 active+clean; 8.6 MiB data, 202 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 706 KiB/s wr, 41 op/s 2024-09-13T18:29:45.638 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:45 smithi149 ceph-mon[35845]: pgmap v240: 65 pgs: 65 active+clean; 45 MiB data, 331 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 255 op/s 2024-09-13T18:29:45.735 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:45 smithi038 ceph-mon[27689]: pgmap v240: 65 pgs: 65 active+clean; 45 MiB data, 331 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 255 op/s 2024-09-13T18:29:45.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.732+0000 7f7620b46640 1 -- 172.21.15.38:0/1895476273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c100680 msgr2=0x7f761c102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:45.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.732+0000 7f7620b46640 1 --2- 172.21.15.38:0/1895476273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c100680 0x7f761c102a70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f760c0098b0 tx=0x7f760c02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:29:45.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.733+0000 7f7620b46640 1 -- 172.21.15.38:0/1895476273 shutdown_connections 2024-09-13T18:29:45.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.733+0000 7f7620b46640 1 --2- 172.21.15.38:0/1895476273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c102fb0 0x7f761c1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:45.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.733+0000 7f7620b46640 1 --2- 172.21.15.38:0/1895476273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c100680 0x7f761c102a70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:45.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.733+0000 7f7620b46640 1 -- 172.21.15.38:0/1895476273 >> 172.21.15.38:0/1895476273 conn(0x7f761c0fa280 msgr2=0x7f761c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:45.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.733+0000 7f7620b46640 1 -- 172.21.15.38:0/1895476273 shutdown_connections 2024-09-13T18:29:45.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.733+0000 7f7620b46640 1 -- 172.21.15.38:0/1895476273 wait complete. 2024-09-13T18:29:45.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.734+0000 7f7620b46640 1 Processor -- start 2024-09-13T18:29:45.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.734+0000 7f7620b46640 1 -- start start 2024-09-13T18:29:45.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.734+0000 7f7620b46640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c100680 0x7f761c1955b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:45.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.734+0000 7f7620b46640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c102fb0 0x7f761c195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:45.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.734+0000 7f7620b46640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c1960c0 con 0x7f761c102fb0 2024-09-13T18:29:45.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.734+0000 7f7620b46640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c196230 con 0x7f761c100680 2024-09-13T18:29:45.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.734+0000 7f7619d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c102fb0 0x7f761c195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:45.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.734+0000 7f761a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c100680 0x7f761c1955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:45.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.734+0000 7f761a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c100680 0x7f761c1955b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.38:60866/0 (socket says 172.21.15.38:60866) 2024-09-13T18:29:45.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.734+0000 7f761a59c640 1 -- 172.21.15.38:0/1468811193 learned_addr learned my addr 172.21.15.38:0/1468811193 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:45.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.735+0000 7f761a59c640 1 -- 172.21.15.38:0/1468811193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c102fb0 msgr2=0x7f761c195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:45.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.735+0000 7f761a59c640 1 --2- 172.21.15.38:0/1468811193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c102fb0 0x7f761c195af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:45.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.735+0000 7f761a59c640 1 -- 172.21.15.38:0/1468811193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c009560 con 0x7f761c100680 2024-09-13T18:29:45.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.735+0000 7f7619d9b640 1 --2- 172.21.15.38:0/1468811193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c102fb0 0x7f761c195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:29:45.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.735+0000 7f761a59c640 1 --2- 172.21.15.38:0/1468811193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c100680 0x7f761c1955b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f760c0099d0 tx=0x7f760c0055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:45.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.735+0000 7f760b7fe640 1 -- 172.21.15.38:0/1468811193 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f760c004aa0 con 0x7f761c100680 2024-09-13T18:29:45.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.735+0000 7f760b7fe640 1 -- 172.21.15.38:0/1468811193 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f760c004c00 con 0x7f761c100680 2024-09-13T18:29:45.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.736+0000 7f7620b46640 1 -- 172.21.15.38:0/1468811193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761c19ac70 con 0x7f761c100680 2024-09-13T18:29:45.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.736+0000 7f760b7fe640 1 -- 172.21.15.38:0/1468811193 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f760c0318b0 con 0x7f761c100680 2024-09-13T18:29:45.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.736+0000 7f7620b46640 1 -- 172.21.15.38:0/1468811193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761c19b160 con 0x7f761c100680 2024-09-13T18:29:45.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.737+0000 7f7620b46640 1 -- 172.21.15.38:0/1468811193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761c1086d0 con 0x7f761c100680 2024-09-13T18:29:45.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.738+0000 7f760b7fe640 1 -- 172.21.15.38:0/1468811193 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f760c003b90 con 0x7f761c100680 2024-09-13T18:29:45.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.739+0000 7f760b7fe640 1 --2- 172.21.15.38:0/1468811193 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f760406cca0 0x7f760406f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:45.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.739+0000 7f760b7fe640 1 -- 172.21.15.38:0/1468811193 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f760c0ad410 con 0x7f761c100680 2024-09-13T18:29:45.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.739+0000 7f7619d9b640 1 --2- 172.21.15.38:0/1468811193 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f760406cca0 0x7f760406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:45.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.740+0000 7f7619d9b640 1 --2- 172.21.15.38:0/1468811193 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f760406cca0 0x7f760406f160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f761c196ad0 tx=0x7f7610005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:45.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.744+0000 7f760b7fe640 1 -- 172.21.15.38:0/1468811193 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f760c077760 con 0x7f761c100680 2024-09-13T18:29:45.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.974+0000 7f7620b46640 1 -- 172.21.15.38:0/1468811193 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f761c103a30 con 0x7f760406cca0 2024-09-13T18:29:45.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.975+0000 7f760b7fe640 1 -- 172.21.15.38:0/1468811193 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f761c103a30 con 0x7f760406cca0 2024-09-13T18:29:45.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.978+0000 7f7620b46640 1 -- 172.21.15.38:0/1468811193 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f760406cca0 msgr2=0x7f760406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:45.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.978+0000 7f7620b46640 1 --2- 172.21.15.38:0/1468811193 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f760406cca0 0x7f760406f160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f761c196ad0 tx=0x7f7610005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:45.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.978+0000 7f7620b46640 1 -- 172.21.15.38:0/1468811193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c100680 msgr2=0x7f761c1955b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:45.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.978+0000 7f7620b46640 1 --2- 172.21.15.38:0/1468811193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c100680 0x7f761c1955b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f760c0099d0 tx=0x7f760c0055a0 comp rx=0 tx=0).stop 2024-09-13T18:29:45.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.978+0000 7f7620b46640 1 -- 172.21.15.38:0/1468811193 shutdown_connections 2024-09-13T18:29:45.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.978+0000 7f7620b46640 1 --2- 172.21.15.38:0/1468811193 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f760406cca0 0x7f760406f160 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:45.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.978+0000 7f7620b46640 1 --2- 172.21.15.38:0/1468811193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f761c102fb0 0x7f761c195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:45.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.978+0000 7f7620b46640 1 --2- 172.21.15.38:0/1468811193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f761c100680 0x7f761c1955b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:45.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.978+0000 7f7620b46640 1 -- 172.21.15.38:0/1468811193 >> 172.21.15.38:0/1468811193 conn(0x7f761c0fa280 msgr2=0x7f761c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:45.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.978+0000 7f7620b46640 1 -- 172.21.15.38:0/1468811193 shutdown_connections 2024-09-13T18:29:45.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:45.978+0000 7f7620b46640 1 -- 172.21.15.38:0/1468811193 wait complete. 2024-09-13T18:29:45.990 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:29:46.082 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.080+0000 7fc4ab2df640 1 -- 172.21.15.38:0/566460752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4a4101d90 msgr2=0x7fc4a4102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.080+0000 7fc4ab2df640 1 --2- 172.21.15.38:0/566460752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4a4101d90 0x7fc4a4102190 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009880 tx=0x7fc4a002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.080+0000 7fc4ab2df640 1 -- 172.21.15.38:0/566460752 shutdown_connections 2024-09-13T18:29:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.080+0000 7fc4ab2df640 1 --2- 172.21.15.38:0/566460752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a4102f90 0x7fc4a4103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.080+0000 7fc4ab2df640 1 --2- 172.21.15.38:0/566460752 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4a4101d90 0x7fc4a4102190 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.080+0000 7fc4ab2df640 1 -- 172.21.15.38:0/566460752 >> 172.21.15.38:0/566460752 conn(0x7fc4a40fd540 msgr2=0x7fc4a40ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.080+0000 7fc4ab2df640 1 -- 172.21.15.38:0/566460752 shutdown_connections 2024-09-13T18:29:46.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.080+0000 7fc4ab2df640 1 -- 172.21.15.38:0/566460752 wait complete. 2024-09-13T18:29:46.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.080+0000 7fc4ab2df640 1 Processor -- start 2024-09-13T18:29:46.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.081+0000 7fc4ab2df640 1 -- start start 2024-09-13T18:29:46.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.081+0000 7fc4ab2df640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a4101d90 0x7fc4a4197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:46.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.081+0000 7fc4ab2df640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4a4102f90 0x7fc4a4197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:46.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.081+0000 7fc4ab2df640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a4198210 con 0x7fc4a4102f90 2024-09-13T18:29:46.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.081+0000 7fc4ab2df640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a4198380 con 0x7fc4a4101d90 2024-09-13T18:29:46.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.081+0000 7fc4a887a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4a4102f90 0x7fc4a4197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:46.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.081+0000 7fc4a887a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4a4102f90 0x7fc4a4197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55710/0 (socket says 172.21.15.38:55710) 2024-09-13T18:29:46.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.081+0000 7fc4a887a640 1 -- 172.21.15.38:0/435792347 learned_addr learned my addr 172.21.15.38:0/435792347 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:46.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.081+0000 7fc4a907b640 1 --2- 172.21.15.38:0/435792347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a4101d90 0x7fc4a4197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:46.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.081+0000 7fc4a887a640 1 -- 172.21.15.38:0/435792347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a4101d90 msgr2=0x7fc4a4197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:46.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.081+0000 7fc4a887a640 1 --2- 172.21.15.38:0/435792347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a4101d90 0x7fc4a4197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.081+0000 7fc4a887a640 1 -- 172.21.15.38:0/435792347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a0009560 con 0x7fc4a4102f90 2024-09-13T18:29:46.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.082+0000 7fc4a887a640 1 --2- 172.21.15.38:0/435792347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4a4102f90 0x7fc4a4197c40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc49400d900 tx=0x7fc49400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:46.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.082+0000 7fc49a7fc640 1 -- 172.21.15.38:0/435792347 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc494009c00 con 0x7fc4a4102f90 2024-09-13T18:29:46.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.082+0000 7fc49a7fc640 1 -- 172.21.15.38:0/435792347 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc49400b660 con 0x7fc4a4102f90 2024-09-13T18:29:46.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.082+0000 7fc4ab2df640 1 -- 172.21.15.38:0/435792347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a419ce20 con 0x7fc4a4102f90 2024-09-13T18:29:46.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.082+0000 7fc49a7fc640 1 -- 172.21.15.38:0/435792347 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc49400f5f0 con 0x7fc4a4102f90 2024-09-13T18:29:46.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.082+0000 7fc4ab2df640 1 -- 172.21.15.38:0/435792347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a419d3c0 con 0x7fc4a4102f90 2024-09-13T18:29:46.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.083+0000 7fc4ab2df640 1 -- 172.21.15.38:0/435792347 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a4102190 con 0x7fc4a4102f90 2024-09-13T18:29:46.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.084+0000 7fc49a7fc640 1 -- 172.21.15.38:0/435792347 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc494010a00 con 0x7fc4a4102f90 2024-09-13T18:29:46.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.084+0000 7fc49a7fc640 1 --2- 172.21.15.38:0/435792347 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc49006cc50 0x7fc49006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:46.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.084+0000 7fc49a7fc640 1 -- 172.21.15.38:0/435792347 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc49408bef0 con 0x7fc4a4102f90 2024-09-13T18:29:46.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.084+0000 7fc4a907b640 1 --2- 172.21.15.38:0/435792347 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc49006cc50 0x7fc49006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:46.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.085+0000 7fc4a907b640 1 --2- 172.21.15.38:0/435792347 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc49006cc50 0x7fc49006f110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0000c00 tx=0x7fc4a0031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:46.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.093+0000 7fc49a7fc640 1 -- 172.21.15.38:0/435792347 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc494056390 con 0x7fc4a4102f90 2024-09-13T18:29:46.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.330+0000 7fc4ab2df640 1 -- 172.21.15.38:0/435792347 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4a41078e0 con 0x7fc49006cc50 2024-09-13T18:29:46.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.331+0000 7fc49a7fc640 1 -- 172.21.15.38:0/435792347 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fc4a41078e0 con 0x7fc49006cc50 2024-09-13T18:29:46.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.334+0000 7fc4ab2df640 1 -- 172.21.15.38:0/435792347 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc49006cc50 msgr2=0x7fc49006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:46.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.334+0000 7fc4ab2df640 1 --2- 172.21.15.38:0/435792347 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc49006cc50 0x7fc49006f110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0000c00 tx=0x7fc4a0031400 comp rx=0 tx=0).stop 2024-09-13T18:29:46.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.334+0000 7fc4ab2df640 1 -- 172.21.15.38:0/435792347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4a4102f90 msgr2=0x7fc4a4197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:46.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.334+0000 7fc4ab2df640 1 --2- 172.21.15.38:0/435792347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4a4102f90 0x7fc4a4197c40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc49400d900 tx=0x7fc49400ddc0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.334+0000 7fc4ab2df640 1 -- 172.21.15.38:0/435792347 shutdown_connections 2024-09-13T18:29:46.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.334+0000 7fc4ab2df640 1 --2- 172.21.15.38:0/435792347 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc49006cc50 0x7fc49006f110 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.334+0000 7fc4ab2df640 1 --2- 172.21.15.38:0/435792347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4a4102f90 0x7fc4a4197c40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.334+0000 7fc4ab2df640 1 --2- 172.21.15.38:0/435792347 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4a4101d90 0x7fc4a4197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.334+0000 7fc4ab2df640 1 -- 172.21.15.38:0/435792347 >> 172.21.15.38:0/435792347 conn(0x7fc4a40fd540 msgr2=0x7fc4a41061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:46.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.334+0000 7fc4ab2df640 1 -- 172.21.15.38:0/435792347 shutdown_connections 2024-09-13T18:29:46.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.334+0000 7fc4ab2df640 1 -- 172.21.15.38:0/435792347 wait complete. 2024-09-13T18:29:46.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.422+0000 7fc94ece4640 1 -- 172.21.15.38:0/3589724844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9480feaf0 msgr2=0x7fc9480feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:46.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.422+0000 7fc94ece4640 1 --2- 172.21.15.38:0/3589724844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9480feaf0 0x7fc9480feef0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009880 tx=0x7fc93c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.422+0000 7fc94ece4640 1 -- 172.21.15.38:0/3589724844 shutdown_connections 2024-09-13T18:29:46.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.422+0000 7fc94ece4640 1 --2- 172.21.15.38:0/3589724844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9480ffcf0 0x7fc948100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.422+0000 7fc94ece4640 1 --2- 172.21.15.38:0/3589724844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9480feaf0 0x7fc9480feef0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.422+0000 7fc94ece4640 1 -- 172.21.15.38:0/3589724844 >> 172.21.15.38:0/3589724844 conn(0x7fc9480fa280 msgr2=0x7fc9480fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:46.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.422+0000 7fc94ece4640 1 -- 172.21.15.38:0/3589724844 shutdown_connections 2024-09-13T18:29:46.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.422+0000 7fc94ece4640 1 -- 172.21.15.38:0/3589724844 wait complete. 2024-09-13T18:29:46.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.423+0000 7fc94ece4640 1 Processor -- start 2024-09-13T18:29:46.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.423+0000 7fc94ece4640 1 -- start start 2024-09-13T18:29:46.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.423+0000 7fc94ece4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9480feaf0 0x7fc948195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:46.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.423+0000 7fc94ece4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9480ffcf0 0x7fc948195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:46.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.423+0000 7fc94ece4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948196180 con 0x7fc9480feaf0 2024-09-13T18:29:46.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.423+0000 7fc94ece4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9481962f0 con 0x7fc9480ffcf0 2024-09-13T18:29:46.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.423+0000 7fc94ca80640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9480feaf0 0x7fc948195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:46.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.423+0000 7fc94ca80640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9480feaf0 0x7fc948195670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55728/0 (socket says 172.21.15.38:55728) 2024-09-13T18:29:46.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.423+0000 7fc94ca80640 1 -- 172.21.15.38:0/2834064455 learned_addr learned my addr 172.21.15.38:0/2834064455 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:46.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.423+0000 7fc947fff640 1 --2- 172.21.15.38:0/2834064455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9480ffcf0 0x7fc948195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:46.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.424+0000 7fc94ca80640 1 -- 172.21.15.38:0/2834064455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9480ffcf0 msgr2=0x7fc948195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:46.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.424+0000 7fc94ca80640 1 --2- 172.21.15.38:0/2834064455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9480ffcf0 0x7fc948195bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.424+0000 7fc94ca80640 1 -- 172.21.15.38:0/2834064455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c009560 con 0x7fc9480feaf0 2024-09-13T18:29:46.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.424+0000 7fc94ca80640 1 --2- 172.21.15.38:0/2834064455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9480feaf0 0x7fc948195670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0055a0 tx=0x7fc93c0055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:46.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.424+0000 7fc945ffb640 1 -- 172.21.15.38:0/2834064455 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc93c004aa0 con 0x7fc9480feaf0 2024-09-13T18:29:46.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.424+0000 7fc945ffb640 1 -- 172.21.15.38:0/2834064455 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc93c005d50 con 0x7fc9480feaf0 2024-09-13T18:29:46.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.424+0000 7fc94ece4640 1 -- 172.21.15.38:0/2834064455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94819acc0 con 0x7fc9480feaf0 2024-09-13T18:29:46.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.424+0000 7fc945ffb640 1 -- 172.21.15.38:0/2834064455 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc93c031840 con 0x7fc9480feaf0 2024-09-13T18:29:46.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.424+0000 7fc94ece4640 1 -- 172.21.15.38:0/2834064455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94819b1b0 con 0x7fc9480feaf0 2024-09-13T18:29:46.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.425+0000 7fc94ece4640 1 -- 172.21.15.38:0/2834064455 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9481075c0 con 0x7fc9480feaf0 2024-09-13T18:29:46.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.426+0000 7fc945ffb640 1 -- 172.21.15.38:0/2834064455 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc93c004c00 con 0x7fc9480feaf0 2024-09-13T18:29:46.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.427+0000 7fc945ffb640 1 --2- 172.21.15.38:0/2834064455 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc93806cc50 0x7fc93806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:46.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.427+0000 7fc945ffb640 1 -- 172.21.15.38:0/2834064455 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc93c0ad250 con 0x7fc9480feaf0 2024-09-13T18:29:46.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.427+0000 7fc947fff640 1 --2- 172.21.15.38:0/2834064455 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc93806cc50 0x7fc93806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:46.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.428+0000 7fc947fff640 1 --2- 172.21.15.38:0/2834064455 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc93806cc50 0x7fc93806f110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc948196b20 tx=0x7fc934005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:46.438 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.436+0000 7fc945ffb640 1 -- 172.21.15.38:0/2834064455 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc93c0776f0 con 0x7fc9480feaf0 2024-09-13T18:29:46.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.651+0000 7fc94ece4640 1 -- 172.21.15.38:0/2834064455 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc94819b400 con 0x7fc93806cc50 2024-09-13T18:29:46.654 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:46 smithi038 ceph-mon[27689]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:46.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.662+0000 7fc945ffb640 1 -- 172.21.15.38:0/2834064455 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fc94819b400 con 0x7fc93806cc50 2024-09-13T18:29:46.665 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:29:46.665 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (6m) 93s ago 7m 24.6M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:29:46.665 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (7m) 93s ago 7m 7532k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:29:46.665 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (6m) 100s ago 6m 7516k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:29:46.665 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (7m) 93s ago 7m 6899k - 18.2.4-845-ge4e227b3 67ddd33fa72f 30c026e97a6b 2024-09-13T18:29:46.666 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (6m) 100s ago 6m 6895k - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c179d7df975 2024-09-13T18:29:46.666 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (5m) 93s ago 7m 87.5M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:29:46.666 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (112s) 93s ago 111s 15.8M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:29:46.666 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (119s) 93s ago 118s 12.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:29:46.666 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (116s) 100s ago 115s 15.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:29:46.666 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (109s) 100s ago 108s 14.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:29:46.666 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:9283,8765,8443 running (8m) 93s ago 8m 486M - 18.2.4-845-ge4e227b3 67ddd33fa72f 1cebd33ffd6a 2024-09-13T18:29:46.666 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 starting - - - - 2024-09-13T18:29:46.666 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (8m) 93s ago 9m 46.0M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f b654a36a9082 2024-09-13T18:29:46.666 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (6m) 100s ago 6m 35.6M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 0133a107f35d 2024-09-13T18:29:46.667 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (7m) 93s ago 7m 15.1M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:29:46.667 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (6m) 100s ago 6m 16.2M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:29:46.667 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (5m) 93s ago 5m 57.3M 3948M 18.2.4-845-ge4e227b3 67ddd33fa72f 69a9e66fb097 2024-09-13T18:29:46.667 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (5m) 93s ago 5m 56.6M 3948M 18.2.4-845-ge4e227b3 67ddd33fa72f 07986b4ba73b 2024-09-13T18:29:46.667 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (4m) 93s ago 4m 49.2M 3948M 18.2.4-845-ge4e227b3 67ddd33fa72f e44cdda01aee 2024-09-13T18:29:46.667 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (4m) 100s ago 4m 45.5M 1213M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:29:46.667 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (3m) 100s ago 3m 54.7M 1213M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:29:46.667 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (3m) 100s ago 3m 46.1M 1213M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:29:46.667 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (5m) 93s ago 6m 57.6M - 2.43.0 a07b618ecd1d 292b390ae245 2024-09-13T18:29:46.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.664+0000 7fc94ece4640 1 -- 172.21.15.38:0/2834064455 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc93806cc50 msgr2=0x7fc93806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:46.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.665+0000 7fc94ece4640 1 --2- 172.21.15.38:0/2834064455 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc93806cc50 0x7fc93806f110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc948196b20 tx=0x7fc934005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:46.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.665+0000 7fc94ece4640 1 -- 172.21.15.38:0/2834064455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9480feaf0 msgr2=0x7fc948195670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:46.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.665+0000 7fc94ece4640 1 --2- 172.21.15.38:0/2834064455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9480feaf0 0x7fc948195670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0055a0 tx=0x7fc93c0055d0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.665+0000 7fc94ece4640 1 -- 172.21.15.38:0/2834064455 shutdown_connections 2024-09-13T18:29:46.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.665+0000 7fc94ece4640 1 --2- 172.21.15.38:0/2834064455 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fc93806cc50 0x7fc93806f110 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.665+0000 7fc94ece4640 1 --2- 172.21.15.38:0/2834064455 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9480ffcf0 0x7fc948195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.665+0000 7fc94ece4640 1 --2- 172.21.15.38:0/2834064455 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc9480feaf0 0x7fc948195670 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.665+0000 7fc94ece4640 1 -- 172.21.15.38:0/2834064455 >> 172.21.15.38:0/2834064455 conn(0x7fc9480fa280 msgr2=0x7fc9480fbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:46.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.665+0000 7fc94ece4640 1 -- 172.21.15.38:0/2834064455 shutdown_connections 2024-09-13T18:29:46.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.665+0000 7fc94ece4640 1 -- 172.21.15.38:0/2834064455 wait complete. 2024-09-13T18:29:46.682 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:46 smithi149 ceph-mon[35845]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:46.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.750+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1383081451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa240fe470 msgr2=0x7ffa240fe870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:46.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.750+0000 7ffa2c7c2640 1 --2- 172.21.15.38:0/1383081451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa240fe470 0x7ffa240fe870 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009880 tx=0x7ffa2002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.750+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1383081451 shutdown_connections 2024-09-13T18:29:46.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.750+0000 7ffa2c7c2640 1 --2- 172.21.15.38:0/1383081451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa240fedb0 0x7ffa240ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.750+0000 7ffa2c7c2640 1 --2- 172.21.15.38:0/1383081451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa240fe470 0x7ffa240fe870 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.750+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1383081451 >> 172.21.15.38:0/1383081451 conn(0x7ffa240fa280 msgr2=0x7ffa240fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:46.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.751+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1383081451 shutdown_connections 2024-09-13T18:29:46.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.751+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1383081451 wait complete. 2024-09-13T18:29:46.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.751+0000 7ffa2c7c2640 1 Processor -- start 2024-09-13T18:29:46.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.751+0000 7ffa2c7c2640 1 -- start start 2024-09-13T18:29:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.751+0000 7ffa2c7c2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa240fe470 0x7ffa24197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.751+0000 7ffa2c7c2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa240fedb0 0x7ffa24197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.751+0000 7ffa2c7c2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa24198280 con 0x7ffa240fe470 2024-09-13T18:29:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.751+0000 7ffa2c7c2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa241983f0 con 0x7ffa240fedb0 2024-09-13T18:29:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.752+0000 7ffa2a55e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa240fe470 0x7ffa24197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.752+0000 7ffa2a55e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa240fe470 0x7ffa24197770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55754/0 (socket says 172.21.15.38:55754) 2024-09-13T18:29:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.752+0000 7ffa2a55e640 1 -- 172.21.15.38:0/1919030939 learned_addr learned my addr 172.21.15.38:0/1919030939 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.752+0000 7ffa29d5d640 1 --2- 172.21.15.38:0/1919030939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa240fedb0 0x7ffa24197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.752+0000 7ffa2a55e640 1 -- 172.21.15.38:0/1919030939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa240fedb0 msgr2=0x7ffa24197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.752+0000 7ffa2a55e640 1 --2- 172.21.15.38:0/1919030939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa240fedb0 0x7ffa24197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.752+0000 7ffa2a55e640 1 -- 172.21.15.38:0/1919030939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa20009560 con 0x7ffa240fe470 2024-09-13T18:29:46.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.752+0000 7ffa2a55e640 1 --2- 172.21.15.38:0/1919030939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa240fe470 0x7ffa24197770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffa20006010 tx=0x7ffa200055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:46.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.752+0000 7ffa1b7fe640 1 -- 172.21.15.38:0/1919030939 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa20004aa0 con 0x7ffa240fe470 2024-09-13T18:29:46.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.753+0000 7ffa1b7fe640 1 -- 172.21.15.38:0/1919030939 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffa20004c00 con 0x7ffa240fe470 2024-09-13T18:29:46.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.753+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1919030939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2419ce30 con 0x7ffa240fe470 2024-09-13T18:29:46.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.753+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1919030939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2419d2a0 con 0x7ffa240fe470 2024-09-13T18:29:46.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.753+0000 7ffa1b7fe640 1 -- 172.21.15.38:0/1919030939 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa20031990 con 0x7ffa240fe470 2024-09-13T18:29:46.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.754+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1919030939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa24191810 con 0x7ffa240fe470 2024-09-13T18:29:46.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.755+0000 7ffa1b7fe640 1 -- 172.21.15.38:0/1919030939 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffa20031af0 con 0x7ffa240fe470 2024-09-13T18:29:46.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.755+0000 7ffa1b7fe640 1 --2- 172.21.15.38:0/1919030939 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ffa1006cc50 0x7ffa1006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:46.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.756+0000 7ffa1b7fe640 1 -- 172.21.15.38:0/1919030939 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ffa200ad360 con 0x7ffa240fe470 2024-09-13T18:29:46.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.756+0000 7ffa29d5d640 1 --2- 172.21.15.38:0/1919030939 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ffa1006cc50 0x7ffa1006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:46.759 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.757+0000 7ffa29d5d640 1 --2- 172.21.15.38:0/1919030939 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ffa1006cc50 0x7ffa1006f110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffa24198c90 tx=0x7ffa14005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:46.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:46.763+0000 7ffa1b7fe640 1 -- 172.21.15.38:0/1919030939 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffa20077870 con 0x7ffa240fe470 2024-09-13T18:29:47.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.057+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1919030939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa2402c4e0 con 0x7ffa240fe470 2024-09-13T18:29:47.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.058+0000 7ffa1b7fe640 1 -- 172.21.15.38:0/1919030939 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7ffa2007ae90 con 0x7ffa240fe470 2024-09-13T18:29:47.060 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:29:47.061 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 14 2024-09-13T18:29:47.062 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:29:47.062 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:29:47.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.061+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1919030939 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ffa1006cc50 msgr2=0x7ffa1006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:47.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.061+0000 7ffa2c7c2640 1 --2- 172.21.15.38:0/1919030939 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ffa1006cc50 0x7ffa1006f110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffa24198c90 tx=0x7ffa14005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:47.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.061+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1919030939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa240fe470 msgr2=0x7ffa24197770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:47.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.061+0000 7ffa2c7c2640 1 --2- 172.21.15.38:0/1919030939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa240fe470 0x7ffa24197770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffa20006010 tx=0x7ffa200055a0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.061+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1919030939 shutdown_connections 2024-09-13T18:29:47.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.061+0000 7ffa2c7c2640 1 --2- 172.21.15.38:0/1919030939 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7ffa1006cc50 0x7ffa1006f110 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.061+0000 7ffa2c7c2640 1 --2- 172.21.15.38:0/1919030939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa240fedb0 0x7ffa24197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.061+0000 7ffa2c7c2640 1 --2- 172.21.15.38:0/1919030939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa240fe470 0x7ffa24197770 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.061+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1919030939 >> 172.21.15.38:0/1919030939 conn(0x7ffa240fa280 msgr2=0x7ffa24106fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:47.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.061+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1919030939 shutdown_connections 2024-09-13T18:29:47.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.061+0000 7ffa2c7c2640 1 -- 172.21.15.38:0/1919030939 wait complete. 2024-09-13T18:29:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.149+0000 7f5e4690f640 1 -- 172.21.15.38:0/935651313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e40100680 msgr2=0x7f5e40102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.149+0000 7f5e4690f640 1 --2- 172.21.15.38:0/935651313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e40100680 0x7f5e40102a70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5e300098b0 tx=0x7f5e3002a4d0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.149+0000 7f5e4690f640 1 -- 172.21.15.38:0/935651313 shutdown_connections 2024-09-13T18:29:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.149+0000 7f5e4690f640 1 --2- 172.21.15.38:0/935651313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40102fb0 0x7f5e401053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.149+0000 7f5e4690f640 1 --2- 172.21.15.38:0/935651313 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e40100680 0x7f5e40102a70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.149+0000 7f5e4690f640 1 -- 172.21.15.38:0/935651313 >> 172.21.15.38:0/935651313 conn(0x7f5e400fa280 msgr2=0x7f5e400fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.149+0000 7f5e4690f640 1 -- 172.21.15.38:0/935651313 shutdown_connections 2024-09-13T18:29:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.150+0000 7f5e4690f640 1 -- 172.21.15.38:0/935651313 wait complete. 2024-09-13T18:29:47.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.150+0000 7f5e4690f640 1 Processor -- start 2024-09-13T18:29:47.153 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.150+0000 7f5e4690f640 1 -- start start 2024-09-13T18:29:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.151+0000 7f5e4690f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e40100680 0x7f5e401955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.151+0000 7f5e4690f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40102fb0 0x7f5e40195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.151+0000 7f5e4690f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401960e0 con 0x7f5e40100680 2024-09-13T18:29:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.151+0000 7f5e4690f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40196250 con 0x7f5e40102fb0 2024-09-13T18:29:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.151+0000 7f5e3ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e40100680 0x7f5e401955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.151+0000 7f5e3ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e40100680 0x7f5e401955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55762/0 (socket says 172.21.15.38:55762) 2024-09-13T18:29:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.151+0000 7f5e3ffff640 1 -- 172.21.15.38:0/93510618 learned_addr learned my addr 172.21.15.38:0/93510618 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.151+0000 7f5e3f7fe640 1 --2- 172.21.15.38:0/93510618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40102fb0 0x7f5e40195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.151+0000 7f5e3ffff640 1 -- 172.21.15.38:0/93510618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40102fb0 msgr2=0x7f5e40195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.151+0000 7f5e3ffff640 1 --2- 172.21.15.38:0/93510618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40102fb0 0x7f5e40195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.151+0000 7f5e3ffff640 1 -- 172.21.15.38:0/93510618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30009560 con 0x7f5e40100680 2024-09-13T18:29:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.152+0000 7f5e3ffff640 1 --2- 172.21.15.38:0/93510618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e40100680 0x7f5e401955d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5e30006010 tx=0x7f5e300055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.152+0000 7f5e3d7fa640 1 -- 172.21.15.38:0/93510618 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e30004aa0 con 0x7f5e40100680 2024-09-13T18:29:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.152+0000 7f5e3d7fa640 1 -- 172.21.15.38:0/93510618 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5e30004c00 con 0x7f5e40100680 2024-09-13T18:29:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.152+0000 7f5e3d7fa640 1 -- 172.21.15.38:0/93510618 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e30031860 con 0x7f5e40100680 2024-09-13T18:29:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.153+0000 7f5e4690f640 1 -- 172.21.15.38:0/93510618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4019ac90 con 0x7f5e40100680 2024-09-13T18:29:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.153+0000 7f5e4690f640 1 -- 172.21.15.38:0/93510618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4019b130 con 0x7f5e40100680 2024-09-13T18:29:47.156 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.154+0000 7f5e4690f640 1 -- 172.21.15.38:0/93510618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e401086f0 con 0x7f5e40100680 2024-09-13T18:29:47.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.155+0000 7f5e3d7fa640 1 -- 172.21.15.38:0/93510618 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5e30003b90 con 0x7f5e40100680 2024-09-13T18:29:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.155+0000 7f5e3d7fa640 1 --2- 172.21.15.38:0/93510618 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f5e2806ccc0 0x7f5e2806f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.155+0000 7f5e3d7fa640 1 -- 172.21.15.38:0/93510618 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f5e300acef0 con 0x7f5e40100680 2024-09-13T18:29:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.156+0000 7f5e3f7fe640 1 --2- 172.21.15.38:0/93510618 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f5e2806ccc0 0x7f5e2806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.156+0000 7f5e3f7fe640 1 --2- 172.21.15.38:0/93510618 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f5e2806ccc0 0x7f5e2806f180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5e40196af0 tx=0x7f5e34005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:47.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.164+0000 7f5e3d7fa640 1 -- 172.21.15.38:0/93510618 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5e30077310 con 0x7f5e40100680 2024-09-13T18:29:47.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.372+0000 7f5e3d7fa640 1 -- 172.21.15.38:0/93510618 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 20) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5e300776e0 con 0x7f5e40100680 2024-09-13T18:29:47.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.401+0000 7f5e4690f640 1 -- 172.21.15.38:0/93510618 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5e4019b320 con 0x7f5e40100680 2024-09-13T18:29:47.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.402+0000 7f5e3d7fa640 1 -- 172.21.15.38:0/93510618 <== mon.0 v2:172.21.15.38:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7f5e30064cb0 con 0x7f5e40100680 2024-09-13T18:29:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:29:47.404 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:29:47.405 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:29:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:29:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:29:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:29:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:29:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:29:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:29:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:29:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:29:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:29:47.406 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:29:47.407 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:29:47.408 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:29:47.408 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:29:47.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.404+0000 7f5e4690f640 1 -- 172.21.15.38:0/93510618 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f5e2806ccc0 msgr2=0x7f5e2806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:47.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.404+0000 7f5e4690f640 1 --2- 172.21.15.38:0/93510618 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f5e2806ccc0 0x7f5e2806f180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5e40196af0 tx=0x7f5e34005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:47.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.404+0000 7f5e4690f640 1 -- 172.21.15.38:0/93510618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e40100680 msgr2=0x7f5e401955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:47.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.404+0000 7f5e4690f640 1 --2- 172.21.15.38:0/93510618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e40100680 0x7f5e401955d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5e30006010 tx=0x7f5e300055a0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.404+0000 7f5e4690f640 1 -- 172.21.15.38:0/93510618 shutdown_connections 2024-09-13T18:29:47.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.404+0000 7f5e4690f640 1 --2- 172.21.15.38:0/93510618 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f5e2806ccc0 0x7f5e2806f180 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.404+0000 7f5e4690f640 1 --2- 172.21.15.38:0/93510618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40102fb0 0x7f5e40195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.404+0000 7f5e4690f640 1 --2- 172.21.15.38:0/93510618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5e40100680 0x7f5e401955d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.404+0000 7f5e4690f640 1 -- 172.21.15.38:0/93510618 >> 172.21.15.38:0/93510618 conn(0x7f5e400fa280 msgr2=0x7f5e400fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:47.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.404+0000 7f5e4690f640 1 -- 172.21.15.38:0/93510618 shutdown_connections 2024-09-13T18:29:47.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.404+0000 7f5e4690f640 1 -- 172.21.15.38:0/93510618 wait complete. 2024-09-13T18:29:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.496+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1889918112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd600feaf0 msgr2=0x7fbd600feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.496+0000 7fbd65ebe640 1 --2- 172.21.15.38:0/1889918112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd600feaf0 0x7fbd600feef0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009880 tx=0x7fbd5002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.496+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1889918112 shutdown_connections 2024-09-13T18:29:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.496+0000 7fbd65ebe640 1 --2- 172.21.15.38:0/1889918112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd600ffcf0 0x7fbd60100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.496+0000 7fbd65ebe640 1 --2- 172.21.15.38:0/1889918112 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd600feaf0 0x7fbd600feef0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.496+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1889918112 >> 172.21.15.38:0/1889918112 conn(0x7fbd600fa280 msgr2=0x7fbd600fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.496+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1889918112 shutdown_connections 2024-09-13T18:29:47.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.496+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1889918112 wait complete. 2024-09-13T18:29:47.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.497+0000 7fbd65ebe640 1 Processor -- start 2024-09-13T18:29:47.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.497+0000 7fbd65ebe640 1 -- start start 2024-09-13T18:29:47.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.497+0000 7fbd65ebe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd600feaf0 0x7fbd60068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:47.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.497+0000 7fbd65ebe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd600ffcf0 0x7fbd6019a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:47.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.497+0000 7fbd65ebe640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6019a940 con 0x7fbd600ffcf0 2024-09-13T18:29:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.497+0000 7fbd65ebe640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6019aa80 con 0x7fbd600feaf0 2024-09-13T18:29:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.498+0000 7fbd5effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd600ffcf0 0x7fbd6019a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.498+0000 7fbd5effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd600ffcf0 0x7fbd6019a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55766/0 (socket says 172.21.15.38:55766) 2024-09-13T18:29:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.498+0000 7fbd5effd640 1 -- 172.21.15.38:0/1397478504 learned_addr learned my addr 172.21.15.38:0/1397478504 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.498+0000 7fbd5f7fe640 1 --2- 172.21.15.38:0/1397478504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd600feaf0 0x7fbd60068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.498+0000 7fbd5effd640 1 -- 172.21.15.38:0/1397478504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd600feaf0 msgr2=0x7fbd60068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.498+0000 7fbd5effd640 1 --2- 172.21.15.38:0/1397478504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd600feaf0 0x7fbd60068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.498+0000 7fbd5effd640 1 -- 172.21.15.38:0/1397478504 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd50009560 con 0x7fbd600ffcf0 2024-09-13T18:29:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.498+0000 7fbd5effd640 1 --2- 172.21.15.38:0/1397478504 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd600ffcf0 0x7fbd6019a370 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400b420 tx=0x7fbd5400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:47.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.498+0000 7fbd5cff9640 1 -- 172.21.15.38:0/1397478504 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd54011800 con 0x7fbd600ffcf0 2024-09-13T18:29:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.499+0000 7fbd5cff9640 1 -- 172.21.15.38:0/1397478504 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd54011e00 con 0x7fbd600ffcf0 2024-09-13T18:29:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.499+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1397478504 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6019ad30 con 0x7fbd600ffcf0 2024-09-13T18:29:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.499+0000 7fbd5cff9640 1 -- 172.21.15.38:0/1397478504 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd5400f2e0 con 0x7fbd600ffcf0 2024-09-13T18:29:47.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.499+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1397478504 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6019b300 con 0x7fbd600ffcf0 2024-09-13T18:29:47.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.500+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1397478504 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd60107620 con 0x7fbd600ffcf0 2024-09-13T18:29:47.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.500+0000 7fbd5cff9640 1 -- 172.21.15.38:0/1397478504 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbd54010380 con 0x7fbd600ffcf0 2024-09-13T18:29:47.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.501+0000 7fbd5cff9640 1 --2- 172.21.15.38:0/1397478504 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbd4806cc60 0x7fbd4806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:47.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.501+0000 7fbd5cff9640 1 -- 172.21.15.38:0/1397478504 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbd5408bb40 con 0x7fbd600ffcf0 2024-09-13T18:29:47.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.501+0000 7fbd5f7fe640 1 --2- 172.21.15.38:0/1397478504 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbd4806cc60 0x7fbd4806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:47.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.501+0000 7fbd5f7fe640 1 --2- 172.21.15.38:0/1397478504 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbd4806cc60 0x7fbd4806f120 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbd50000c00 tx=0x7fbd50031400 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:47.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.510+0000 7fbd5cff9640 1 -- 172.21.15.38:0/1397478504 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbd54055eb0 con 0x7fbd600ffcf0 2024-09-13T18:29:47.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.738+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1397478504 --> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd60104640 con 0x7fbd4806cc60 2024-09-13T18:29:47.741 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:47 smithi038 ceph-mon[27689]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:47.741 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:47 smithi038 ceph-mon[27689]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:47.741 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:47 smithi038 ceph-mon[27689]: Standby manager daemon smithi149.eabzne restarted 2024-09-13T18:29:47.742 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:47 smithi038 ceph-mon[27689]: Standby manager daemon smithi149.eabzne started 2024-09-13T18:29:47.742 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:47 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/crt"}]: dispatch 2024-09-13T18:29:47.742 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:47 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:29:47.742 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:47 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/key"}]: dispatch 2024-09-13T18:29:47.742 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:47 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:29:47.742 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:47 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1919030939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:29:47.742 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:47 smithi038 ceph-mon[27689]: pgmap v241: 65 pgs: 65 active+clean; 58 MiB data, 370 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 354 op/s 2024-09-13T18:29:47.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.740+0000 7fbd5cff9640 1 -- 172.21.15.38:0/1397478504 <== mgr.14213 v2:172.21.15.38:6800/2302807265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fbd60104640 con 0x7fbd4806cc60 2024-09-13T18:29:47.743 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:29:47.743 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:29:47.743 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:29:47.743 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:29:47.743 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [], 2024-09-13T18:29:47.743 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "", 2024-09-13T18:29:47.743 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T18:29:47.743 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:29:47.743 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:29:47.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.742+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1397478504 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbd4806cc60 msgr2=0x7fbd4806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:47.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.742+0000 7fbd65ebe640 1 --2- 172.21.15.38:0/1397478504 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbd4806cc60 0x7fbd4806f120 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbd50000c00 tx=0x7fbd50031400 comp rx=0 tx=0).stop 2024-09-13T18:29:47.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.742+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1397478504 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd600ffcf0 msgr2=0x7fbd6019a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:47.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.742+0000 7fbd65ebe640 1 --2- 172.21.15.38:0/1397478504 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd600ffcf0 0x7fbd6019a370 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400b420 tx=0x7fbd5400b8e0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.742+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1397478504 shutdown_connections 2024-09-13T18:29:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.742+0000 7fbd65ebe640 1 --2- 172.21.15.38:0/1397478504 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7fbd4806cc60 0x7fbd4806f120 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.742+0000 7fbd65ebe640 1 --2- 172.21.15.38:0/1397478504 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd600ffcf0 0x7fbd6019a370 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.742+0000 7fbd65ebe640 1 --2- 172.21.15.38:0/1397478504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd600feaf0 0x7fbd60068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.742+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1397478504 >> 172.21.15.38:0/1397478504 conn(0x7fbd600fa280 msgr2=0x7fbd60102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.742+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1397478504 shutdown_connections 2024-09-13T18:29:47.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.742+0000 7fbd65ebe640 1 -- 172.21.15.38:0/1397478504 wait complete. 2024-09-13T18:29:47.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:47 smithi149 ceph-mon[35845]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:47.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:47 smithi149 ceph-mon[35845]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:47.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:47 smithi149 ceph-mon[35845]: Standby manager daemon smithi149.eabzne restarted 2024-09-13T18:29:47.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:47 smithi149 ceph-mon[35845]: Standby manager daemon smithi149.eabzne started 2024-09-13T18:29:47.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:47 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/crt"}]: dispatch 2024-09-13T18:29:47.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:47 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:29:47.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:47 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/key"}]: dispatch 2024-09-13T18:29:47.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:47 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:29:47.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:47 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1919030939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:29:47.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:47 smithi149 ceph-mon[35845]: pgmap v241: 65 pgs: 65 active+clean; 58 MiB data, 370 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 354 op/s 2024-09-13T18:29:47.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.836+0000 7f11582b4640 1 -- 172.21.15.38:0/1259673590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1150100d80 msgr2=0x7f1150101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:47.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.836+0000 7f11582b4640 1 --2- 172.21.15.38:0/1259673590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1150100d80 0x7f1150101200 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1140009880 tx=0x7f114002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.836+0000 7f11582b4640 1 -- 172.21.15.38:0/1259673590 shutdown_connections 2024-09-13T18:29:47.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.837+0000 7f11582b4640 1 --2- 172.21.15.38:0/1259673590 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1150100d80 0x7f1150101200 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.837+0000 7f11582b4640 1 --2- 172.21.15.38:0/1259673590 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11500ffb80 0x7f11500fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.837+0000 7f11582b4640 1 -- 172.21.15.38:0/1259673590 >> 172.21.15.38:0/1259673590 conn(0x7f11500fb330 msgr2=0x7f11500fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:47.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.837+0000 7f11582b4640 1 -- 172.21.15.38:0/1259673590 shutdown_connections 2024-09-13T18:29:47.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.837+0000 7f11582b4640 1 -- 172.21.15.38:0/1259673590 wait complete. 2024-09-13T18:29:47.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.837+0000 7f11582b4640 1 Processor -- start 2024-09-13T18:29:47.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.837+0000 7f11582b4640 1 -- start start 2024-09-13T18:29:47.841 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.837+0000 7f11582b4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11500ffb80 0x7f1150074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:47.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.837+0000 7f11582b4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1150100d80 0x7f11500728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:47.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.838+0000 7f11582b4640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150072de0 con 0x7f1150100d80 2024-09-13T18:29:47.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.838+0000 7f11582b4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150072f50 con 0x7f11500ffb80 2024-09-13T18:29:47.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.838+0000 7f115584f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1150100d80 0x7f11500728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:47.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.838+0000 7f115584f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1150100d80 0x7f11500728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55776/0 (socket says 172.21.15.38:55776) 2024-09-13T18:29:47.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.838+0000 7f115584f640 1 -- 172.21.15.38:0/545567528 learned_addr learned my addr 172.21.15.38:0/545567528 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:29:47.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.838+0000 7f1156050640 1 --2- 172.21.15.38:0/545567528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11500ffb80 0x7f1150074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:47.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.838+0000 7f115584f640 1 -- 172.21.15.38:0/545567528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11500ffb80 msgr2=0x7f1150074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:47.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.838+0000 7f115584f640 1 --2- 172.21.15.38:0/545567528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11500ffb80 0x7f1150074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:47.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.838+0000 7f115584f640 1 -- 172.21.15.38:0/545567528 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1140009560 con 0x7f1150100d80 2024-09-13T18:29:47.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.838+0000 7f1156050640 1 --2- 172.21.15.38:0/545567528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11500ffb80 0x7f1150074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:29:47.842 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.838+0000 7f115584f640 1 --2- 172.21.15.38:0/545567528 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1150100d80 0x7f11500728a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f11400099a0 tx=0x7f11400055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:47.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.839+0000 7f11477fe640 1 -- 172.21.15.38:0/545567528 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1140004aa0 con 0x7f1150100d80 2024-09-13T18:29:47.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.839+0000 7f11477fe640 1 -- 172.21.15.38:0/545567528 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1140004c00 con 0x7f1150100d80 2024-09-13T18:29:47.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.839+0000 7f11582b4640 1 -- 172.21.15.38:0/545567528 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11500731d0 con 0x7f1150100d80 2024-09-13T18:29:47.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.839+0000 7f11477fe640 1 -- 172.21.15.38:0/545567528 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11400318f0 con 0x7f1150100d80 2024-09-13T18:29:47.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.839+0000 7f11582b4640 1 -- 172.21.15.38:0/545567528 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115019d5a0 con 0x7f1150100d80 2024-09-13T18:29:47.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.840+0000 7f11582b4640 1 -- 172.21.15.38:0/545567528 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11500fff80 con 0x7f1150100d80 2024-09-13T18:29:47.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.841+0000 7f11477fe640 1 -- 172.21.15.38:0/545567528 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 20) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1140031bb0 con 0x7f1150100d80 2024-09-13T18:29:47.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.841+0000 7f11477fe640 1 --2- 172.21.15.38:0/545567528 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f113c06cc60 0x7f113c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:29:47.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.841+0000 7f11477fe640 1 -- 172.21.15.38:0/545567528 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f11400ad360 con 0x7f1150100d80 2024-09-13T18:29:47.844 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.841+0000 7f1156050640 1 --2- 172.21.15.38:0/545567528 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f113c06cc60 0x7f113c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:29:47.845 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.842+0000 7f1156050640 1 --2- 172.21.15.38:0/545567528 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f113c06cc60 0x7f113c06f120 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1150100be0 tx=0x7f114c005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:29:47.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:47.846+0000 7f11477fe640 1 -- 172.21.15.38:0/545567528 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1140077780 con 0x7f1150100d80 2024-09-13T18:29:48.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.218+0000 7f11582b4640 1 -- 172.21.15.38:0/545567528 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f115002c3e0 con 0x7f1150100d80 2024-09-13T18:29:48.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.219+0000 7f11477fe640 1 -- 172.21.15.38:0/545567528 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1140031e60 con 0x7f1150100d80 2024-09-13T18:29:48.221 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:29:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.221+0000 7f11582b4640 1 -- 172.21.15.38:0/545567528 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f113c06cc60 msgr2=0x7f113c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.221+0000 7f11582b4640 1 --2- 172.21.15.38:0/545567528 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f113c06cc60 0x7f113c06f120 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1150100be0 tx=0x7f114c005f90 comp rx=0 tx=0).stop 2024-09-13T18:29:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.221+0000 7f11582b4640 1 -- 172.21.15.38:0/545567528 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1150100d80 msgr2=0x7f11500728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:29:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.221+0000 7f11582b4640 1 --2- 172.21.15.38:0/545567528 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1150100d80 0x7f11500728a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f11400099a0 tx=0x7f11400055a0 comp rx=0 tx=0).stop 2024-09-13T18:29:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.221+0000 7f11582b4640 1 -- 172.21.15.38:0/545567528 shutdown_connections 2024-09-13T18:29:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.221+0000 7f11582b4640 1 --2- 172.21.15.38:0/545567528 >> [v2:172.21.15.38:6800/2302807265,v1:172.21.15.38:6801/2302807265] conn(0x7f113c06cc60 0x7f113c06f120 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.221+0000 7f11582b4640 1 --2- 172.21.15.38:0/545567528 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1150100d80 0x7f11500728a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.221+0000 7f11582b4640 1 --2- 172.21.15.38:0/545567528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11500ffb80 0x7f1150074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:29:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.221+0000 7f11582b4640 1 -- 172.21.15.38:0/545567528 >> 172.21.15.38:0/545567528 conn(0x7f11500fb330 msgr2=0x7f11501044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:29:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.221+0000 7f11582b4640 1 -- 172.21.15.38:0/545567528 shutdown_connections 2024-09-13T18:29:48.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:29:48.221+0000 7f11582b4640 1 -- 172.21.15.38:0/545567528 wait complete. 2024-09-13T18:29:48.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:48 smithi149 ceph-mon[35845]: mgrmap e20: smithi038.jeygoq(active, since 6m), standbys: smithi149.eabzne 2024-09-13T18:29:48.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:48 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/93510618' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:29:48.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:48 smithi149 ceph-mon[35845]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:48.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:48 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/545567528' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:29:48.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:48 smithi038 ceph-mon[27689]: mgrmap e20: smithi038.jeygoq(active, since 6m), standbys: smithi149.eabzne 2024-09-13T18:29:48.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:48 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/93510618' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:29:48.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:48 smithi038 ceph-mon[27689]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:29:48.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:48 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/545567528' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:29:49.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:49 smithi149 ceph-mon[35845]: pgmap v242: 65 pgs: 65 active+clean; 68 MiB data, 412 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.8 MiB/s wr, 389 op/s 2024-09-13T18:29:49.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:49 smithi038 ceph-mon[27689]: pgmap v242: 65 pgs: 65 active+clean; 68 MiB data, 412 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.8 MiB/s wr, 389 op/s 2024-09-13T18:29:51.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:51 smithi149 ceph-mon[35845]: pgmap v243: 65 pgs: 65 active+clean; 80 MiB data, 447 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 424 op/s 2024-09-13T18:29:51.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:51 smithi038 ceph-mon[27689]: pgmap v243: 65 pgs: 65 active+clean; 80 MiB data, 447 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 424 op/s 2024-09-13T18:29:53.676 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:53 smithi149 ceph-mon[35845]: pgmap v244: 65 pgs: 65 active+clean; 80 MiB data, 451 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 421 op/s 2024-09-13T18:29:53.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:53 smithi038 ceph-mon[27689]: pgmap v244: 65 pgs: 65 active+clean; 80 MiB data, 451 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 421 op/s 2024-09-13T18:29:55.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:55 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:29:55.678 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:55 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:29:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:56 smithi038 ceph-mon[27689]: pgmap v245: 65 pgs: 65 active+clean; 94 MiB data, 518 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 7.5 MiB/s wr, 503 op/s 2024-09-13T18:29:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:56.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:56 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:56.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:56 smithi149 ceph-mon[35845]: pgmap v245: 65 pgs: 65 active+clean; 94 MiB data, 518 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 7.5 MiB/s wr, 503 op/s 2024-09-13T18:29:56.700 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:56.701 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:56 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:57.694 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:57 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:57.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:57 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:57.695 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:57 smithi149 ceph-mon[35845]: pgmap v246: 65 pgs: 65 active+clean; 104 MiB data, 534 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 394 op/s 2024-09-13T18:29:57.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:57 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:57.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:57 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:29:57.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:57 smithi038 ceph-mon[27689]: pgmap v246: 65 pgs: 65 active+clean; 104 MiB data, 534 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.2 MiB/s wr, 394 op/s 2024-09-13T18:29:59.623 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:29:59 smithi149 ceph-mon[35845]: pgmap v247: 65 pgs: 65 active+clean; 116 MiB data, 595 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 490 op/s 2024-09-13T18:29:59.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:29:59 smithi038 ceph-mon[27689]: pgmap v247: 65 pgs: 65 active+clean; 116 MiB data, 595 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 490 op/s 2024-09-13T18:30:00.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:00 smithi149 ceph-mon[35845]: overall HEALTH_OK 2024-09-13T18:30:00.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:00 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:30:00.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:00 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:30:00.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:00 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:30:00.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:00 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:30:00.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:00 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:30:00.631 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:00 smithi038 ceph-mon[27689]: overall HEALTH_OK 2024-09-13T18:30:00.631 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:30:00.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:30:00.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:30:00.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:30:00.632 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:00 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' 2024-09-13T18:30:01.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:30:01.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr fail", "who": "smithi038.jeygoq"}]: dispatch 2024-09-13T18:30:01.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: Activating manager daemon smithi149.eabzne 2024-09-13T18:30:01.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:30:01.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:30:01.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dtnkqo"}]: dispatch 2024-09-13T18:30:01.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:30:01.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:30:01.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:30:01.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mgr metadata", "who": "smithi149.eabzne", "id": "smithi149.eabzne"}]: dispatch 2024-09-13T18:30:01.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:30:01.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:30:01.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:30:01.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:30:01.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:30:01.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "mgr fail", "who": "smithi038.jeygoq"}]': finished 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: mgrmap e21: smithi149.eabzne(active, starting, since 0.0129815s) 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: Manager daemon smithi149.eabzne is now available 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.eabzne/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.eabzne/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.eabzne/trash_purge_schedule"}]: dispatch 2024-09-13T18:30:01.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:01 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.eabzne/trash_purge_schedule"}]: dispatch 2024-09-13T18:30:01.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:30:01.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr fail", "who": "smithi038.jeygoq"}]: dispatch 2024-09-13T18:30:01.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: Activating manager daemon smithi149.eabzne 2024-09-13T18:30:01.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:30:01.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:30:01.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dtnkqo"}]: dispatch 2024-09-13T18:30:01.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:30:01.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:30:01.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:30:01.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mgr metadata", "who": "smithi149.eabzne", "id": "smithi149.eabzne"}]: dispatch 2024-09-13T18:30:01.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:30:01.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:30:01.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:30:01.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:30:01.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:30:01.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:30:01.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: osdmap e48: 6 total, 6 up, 6 in 2024-09-13T18:30:01.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.14213 172.21.15.38:0/3378517987' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "mgr fail", "who": "smithi038.jeygoq"}]': finished 2024-09-13T18:30:01.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: mgrmap e21: smithi149.eabzne(active, starting, since 0.0129815s) 2024-09-13T18:30:01.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T18:30:01.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T18:30:01.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T18:30:01.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: Manager daemon smithi149.eabzne is now available 2024-09-13T18:30:01.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:30:01.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:30:01.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.eabzne/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:30:01.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.eabzne/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:30:01.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.eabzne/trash_purge_schedule"}]: dispatch 2024-09-13T18:30:01.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:01 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi149.eabzne/trash_purge_schedule"}]: dispatch 2024-09-13T18:30:02.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:02 smithi149 ceph-mon[35845]: Deploying cephadm binary to smithi038 2024-09-13T18:30:02.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:02 smithi149 ceph-mon[35845]: Deploying cephadm binary to smithi149 2024-09-13T18:30:02.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:02 smithi149 ceph-mon[35845]: mgrmap e22: smithi149.eabzne(active, since 1.00964s) 2024-09-13T18:30:02.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:02 smithi149 ceph-mon[35845]: pgmap v3: 65 pgs: 65 active+clean; 146 MiB data, 728 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:30:02.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:02 smithi149 ceph-mon[35845]: [13/Sep/2024:18:30:02] ENGINE Bus STARTING 2024-09-13T18:30:02.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:02 smithi038 ceph-mon[27689]: Deploying cephadm binary to smithi038 2024-09-13T18:30:02.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:02 smithi038 ceph-mon[27689]: Deploying cephadm binary to smithi149 2024-09-13T18:30:02.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:02 smithi038 ceph-mon[27689]: mgrmap e22: smithi149.eabzne(active, since 1.00964s) 2024-09-13T18:30:02.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:02 smithi038 ceph-mon[27689]: pgmap v3: 65 pgs: 65 active+clean; 146 MiB data, 728 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:30:02.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:02 smithi038 ceph-mon[27689]: [13/Sep/2024:18:30:02] ENGINE Bus STARTING 2024-09-13T18:30:03.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:03 smithi149 ceph-mon[35845]: [13/Sep/2024:18:30:02] ENGINE Serving on https://172.21.15.149:7150 2024-09-13T18:30:03.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:03 smithi149 ceph-mon[35845]: [13/Sep/2024:18:30:02] ENGINE Error in HTTPServer.serve 2024-09-13T18:30:03.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Traceback (most recent call last): 2024-09-13T18:30:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T18:30:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self._connections.run(self.expiration_interval) 2024-09-13T18:30:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T18:30:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self._run(expiration_interval) 2024-09-13T18:30:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T18:30:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T18:30:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T18:30:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T18:30:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T18:30:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: s = self.context.wrap_socket( 2024-09-13T18:30:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T18:30:03.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: return self.sslsocket_class._create( 2024-09-13T18:30:03.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T18:30:03.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self.do_handshake() 2024-09-13T18:30:03.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T18:30:03.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self._sslobj.do_handshake() 2024-09-13T18:30:03.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T18:30:03.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:03 smithi149 ceph-mon[35845]: [13/Sep/2024:18:30:02] ENGINE Serving on http://172.21.15.149:8765 2024-09-13T18:30:03.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:03 smithi149 ceph-mon[35845]: [13/Sep/2024:18:30:02] ENGINE Bus STARTED 2024-09-13T18:30:03.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:03 smithi149 ceph-mon[35845]: pgmap v4: 65 pgs: 65 active+clean; 146 MiB data, 728 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:30:03.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:03 smithi038 ceph-mon[27689]: [13/Sep/2024:18:30:02] ENGINE Serving on https://172.21.15.149:7150 2024-09-13T18:30:03.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:03 smithi038 ceph-mon[27689]: [13/Sep/2024:18:30:02] ENGINE Error in HTTPServer.serve 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Traceback (most recent call last): 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._connections.run(self.expiration_interval) 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._run(expiration_interval) 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: s = self.context.wrap_socket( 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: return self.sslsocket_class._create( 2024-09-13T18:30:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T18:30:03.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self.do_handshake() 2024-09-13T18:30:03.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T18:30:03.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._sslobj.do_handshake() 2024-09-13T18:30:03.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T18:30:03.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:03 smithi038 ceph-mon[27689]: [13/Sep/2024:18:30:02] ENGINE Serving on http://172.21.15.149:8765 2024-09-13T18:30:03.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:03 smithi038 ceph-mon[27689]: [13/Sep/2024:18:30:02] ENGINE Bus STARTED 2024-09-13T18:30:03.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:03 smithi038 ceph-mon[27689]: pgmap v4: 65 pgs: 65 active+clean; 146 MiB data, 728 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:30:04.727 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:04 smithi149 ceph-mon[35845]: mgrmap e23: smithi149.eabzne(active, since 3s) 2024-09-13T18:30:04.813 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:04 smithi038 ceph-mon[27689]: mgrmap e23: smithi149.eabzne(active, since 3s) 2024-09-13T18:30:05.882 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:05 smithi149 ceph-mon[35845]: pgmap v5: 65 pgs: 65 active+clean; 146 MiB data, 728 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:30:05.882 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:05 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:05.882 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:05 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:05.882 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:05 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:05.882 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:05 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:05.942 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:05 smithi038 ceph-mon[27689]: pgmap v5: 65 pgs: 65 active+clean; 146 MiB data, 728 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:30:05.942 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:05 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:05.942 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:05 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:05.943 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:05 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:05.943 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:05 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:06.884 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:06 smithi149 ceph-mon[35845]: mgrmap e24: smithi149.eabzne(active, since 5s) 2024-09-13T18:30:07.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:06 smithi038 ceph-mon[27689]: mgrmap e24: smithi149.eabzne(active, since 5s) 2024-09-13T18:30:07.959 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:07 smithi038 ceph-mon[27689]: pgmap v6: 65 pgs: 65 active+clean; 146 MiB data, 728 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:30:07.959 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:07 smithi038 ceph-mon[27689]: Standby manager daemon smithi038.jeygoq started 2024-09-13T18:30:07.959 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:07 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.38:0/2781861187' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.jeygoq/crt"}]: dispatch 2024-09-13T18:30:07.959 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:07 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.38:0/2781861187' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:30:07.959 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:07 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.38:0/2781861187' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.jeygoq/key"}]: dispatch 2024-09-13T18:30:07.959 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:07 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.38:0/2781861187' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:30:08.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:07 smithi149 ceph-mon[35845]: pgmap v6: 65 pgs: 65 active+clean; 146 MiB data, 728 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:30:08.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:07 smithi149 ceph-mon[35845]: Standby manager daemon smithi038.jeygoq started 2024-09-13T18:30:08.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:07 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.38:0/2781861187' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.jeygoq/crt"}]: dispatch 2024-09-13T18:30:08.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:07 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.38:0/2781861187' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:30:08.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:07 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.38:0/2781861187' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.jeygoq/key"}]: dispatch 2024-09-13T18:30:08.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:07 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.38:0/2781861187' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:30:09.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:08 smithi149 ceph-mon[35845]: mgrmap e25: smithi149.eabzne(active, since 7s), standbys: smithi038.jeygoq 2024-09-13T18:30:09.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:08 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mgr metadata", "who": "smithi038.jeygoq", "id": "smithi038.jeygoq"}]: dispatch 2024-09-13T18:30:09.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:08 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:09.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:08 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:09.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:08 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:09.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:08 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:09.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:08 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd='[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]': finished 2024-09-13T18:30:09.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:08 smithi038 ceph-mon[27689]: mgrmap e25: smithi149.eabzne(active, since 7s), standbys: smithi038.jeygoq 2024-09-13T18:30:09.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:08 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mgr metadata", "who": "smithi038.jeygoq", "id": "smithi038.jeygoq"}]: dispatch 2024-09-13T18:30:09.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:08 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:09.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:08 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:09.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:08 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:09.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:08 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:09.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:08 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd='[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]': finished 2024-09-13T18:30:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:09 smithi149 ceph-mon[35845]: pgmap v7: 65 pgs: 65 active+clean; 181 MiB data, 834 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 634 op/s 2024-09-13T18:30:10.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:09 smithi038 ceph-mon[27689]: pgmap v7: 65 pgs: 65 active+clean; 181 MiB data, 834 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 634 op/s 2024-09-13T18:30:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:11 smithi149 ceph-mon[35845]: pgmap v8: 65 pgs: 65 active+clean; 181 MiB data, 834 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 493 op/s 2024-09-13T18:30:12.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:11 smithi038 ceph-mon[27689]: pgmap v8: 65 pgs: 65 active+clean; 181 MiB data, 834 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 493 op/s 2024-09-13T18:30:12.599 INFO:tasks.workunit.client.1.smithi149.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T18:30:12.618 INFO:tasks.workunit.client.1.smithi149.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T18:30:12.618 INFO:tasks.workunit.client.1.smithi149.stderr:+ make 2024-09-13T18:30:13.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:13.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:13.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:13.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:13.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:13.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:13.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:30:13.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:12 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:30:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:30:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:30:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:12 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:30:13.414 INFO:tasks.workunit.client.0.smithi038.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T18:30:13.414 INFO:tasks.workunit.client.0.smithi038.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T18:30:13.414 INFO:tasks.workunit.client.0.smithi038.stderr:+ make 2024-09-13T18:30:13.425 INFO:tasks.workunit.client.1.smithi149.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T18:30:13.442 INFO:tasks.workunit.client.0.smithi038.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T18:30:13.692 INFO:tasks.workunit.client.1.smithi149.stderr:++ readlink -f fsstress 2024-09-13T18:30:13.693 INFO:tasks.workunit.client.1.smithi149.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T18:30:13.693 INFO:tasks.workunit.client.1.smithi149.stderr:+ popd 2024-09-13T18:30:13.693 INFO:tasks.workunit.client.1.smithi149.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T18:30:13.693 INFO:tasks.workunit.client.1.smithi149.stderr:+ popd 2024-09-13T18:30:13.694 INFO:tasks.workunit.client.1.smithi149.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-13T18:30:13.694 INFO:tasks.workunit.client.1.smithi149.stderr:++ mktemp -d -p . 2024-09-13T18:30:13.695 INFO:tasks.workunit.client.1.smithi149.stderr:+ T=./tmp.dntWNOK7cd 2024-09-13T18:30:13.695 INFO:tasks.workunit.client.1.smithi149.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.dntWNOK7cd -l 1 -n 1000 -p 10 -v 2024-09-13T18:30:13.696 INFO:tasks.workunit.client.1.smithi149.stdout:seed = 1726880109 2024-09-13T18:30:13.699 INFO:tasks.workunit.client.1.smithi149.stdout:0/0: rename - no filename 2024-09-13T18:30:13.701 INFO:tasks.workunit.client.1.smithi149.stdout:0/1: creat f0 x:0 0 0 2024-09-13T18:30:13.701 INFO:tasks.workunit.client.1.smithi149.stdout:0/2: chown f0 8044 1 2024-09-13T18:30:13.702 INFO:tasks.workunit.client.1.smithi149.stdout:2/0: chown . 325 1 2024-09-13T18:30:13.703 INFO:tasks.workunit.client.1.smithi149.stdout:2/1: fsync - no filename 2024-09-13T18:30:13.704 INFO:tasks.workunit.client.1.smithi149.stdout:1/0: creat f0 x:0 0 0 2024-09-13T18:30:13.704 INFO:tasks.workunit.client.1.smithi149.stdout:1/1: readlink - no filename 2024-09-13T18:30:13.704 INFO:tasks.workunit.client.1.smithi149.stdout:1/2: dread - f0 zero size 2024-09-13T18:30:13.704 INFO:tasks.workunit.client.1.smithi149.stdout:1/3: write f0 [387749,124777] 0 2024-09-13T18:30:13.705 INFO:tasks.workunit.client.1.smithi149.stdout:3/0: dwrite - no filename 2024-09-13T18:30:13.705 INFO:tasks.workunit.client.1.smithi149.stdout:3/1: readlink - no filename 2024-09-13T18:30:13.705 INFO:tasks.workunit.client.1.smithi149.stdout:3/2: unlink - no file 2024-09-13T18:30:13.705 INFO:tasks.workunit.client.1.smithi149.stdout:3/3: stat - no entries 2024-09-13T18:30:13.705 INFO:tasks.workunit.client.1.smithi149.stdout:3/4: truncate - no filename 2024-09-13T18:30:13.705 INFO:tasks.workunit.client.1.smithi149.stdout:3/5: truncate - no filename 2024-09-13T18:30:13.705 INFO:tasks.workunit.client.1.smithi149.stdout:3/6: dread - no filename 2024-09-13T18:30:13.705 INFO:tasks.workunit.client.1.smithi149.stdout:3/7: link - no file 2024-09-13T18:30:13.705 INFO:tasks.workunit.client.1.smithi149.stdout:3/8: readlink - no filename 2024-09-13T18:30:13.707 INFO:tasks.workunit.client.1.smithi149.stdout:2/2: creat f0 x:0 0 0 2024-09-13T18:30:13.707 INFO:tasks.workunit.client.1.smithi149.stdout:2/3: truncate f0 131234 0 2024-09-13T18:30:13.708 INFO:tasks.workunit.client.1.smithi149.stdout:4/0: write - no filename 2024-09-13T18:30:13.709 INFO:tasks.workunit.client.1.smithi149.stdout:3/9: creat f0 x:0 0 0 2024-09-13T18:30:13.711 INFO:tasks.workunit.client.1.smithi149.stdout:5/0: rename - no filename 2024-09-13T18:30:13.712 INFO:tasks.workunit.client.1.smithi149.stdout:4/1: creat f0 x:0 0 0 2024-09-13T18:30:13.712 INFO:tasks.workunit.client.1.smithi149.stdout:4/2: fdatasync f0 0 2024-09-13T18:30:13.712 INFO:tasks.workunit.client.1.smithi149.stdout:4/3: creat f1 x:0 0 0 2024-09-13T18:30:13.713 INFO:tasks.workunit.client.1.smithi149.stdout:4/4: truncate f0 803676 0 2024-09-13T18:30:13.713 INFO:tasks.workunit.client.1.smithi149.stdout:4/5: fdatasync f0 0 2024-09-13T18:30:13.713 INFO:tasks.workunit.client.1.smithi149.stdout:3/10: mkdir d1 0 2024-09-13T18:30:13.714 INFO:tasks.workunit.client.1.smithi149.stdout:0/3: fsync f0 0 2024-09-13T18:30:13.714 INFO:tasks.workunit.client.1.smithi149.stdout:0/4: fsync f0 0 2024-09-13T18:30:13.714 INFO:tasks.workunit.client.1.smithi149.stdout:0/5: dread - f0 zero size 2024-09-13T18:30:13.717 INFO:tasks.workunit.client.1.smithi149.stdout:6/0: dwrite - no filename 2024-09-13T18:30:13.717 INFO:tasks.workunit.client.1.smithi149.stdout:6/1: write - no filename 2024-09-13T18:30:13.717 INFO:tasks.workunit.client.1.smithi149.stdout:6/2: fsync - no filename 2024-09-13T18:30:13.717 INFO:tasks.workunit.client.1.smithi149.stdout:6/3: dread - no filename 2024-09-13T18:30:13.717 INFO:tasks.workunit.client.1.smithi149.stdout:6/4: stat - no entries 2024-09-13T18:30:13.717 INFO:tasks.workunit.client.1.smithi149.stdout:6/5: write - no filename 2024-09-13T18:30:13.722 INFO:tasks.workunit.client.1.smithi149.stdout:5/1: symlink l0 0 2024-09-13T18:30:13.722 INFO:tasks.workunit.client.1.smithi149.stdout:3/11: symlink d1/l2 0 2024-09-13T18:30:13.722 INFO:tasks.workunit.client.1.smithi149.stdout:7/0: write - no filename 2024-09-13T18:30:13.722 INFO:tasks.workunit.client.1.smithi149.stdout:7/1: dwrite - no filename 2024-09-13T18:30:13.722 INFO:tasks.workunit.client.1.smithi149.stdout:7/2: dwrite - no filename 2024-09-13T18:30:13.722 INFO:tasks.workunit.client.1.smithi149.stdout:7/3: unlink - no file 2024-09-13T18:30:13.723 INFO:tasks.workunit.client.1.smithi149.stdout:5/2: creat f1 x:0 0 0 2024-09-13T18:30:13.724 INFO:tasks.workunit.client.1.smithi149.stdout:3/12: mknod d1/c3 0 2024-09-13T18:30:13.724 INFO:tasks.workunit.client.1.smithi149.stdout:3/13: dread - f0 zero size 2024-09-13T18:30:13.727 INFO:tasks.workunit.client.1.smithi149.stdout:7/4: creat f0 x:0 0 0 2024-09-13T18:30:13.727 INFO:tasks.workunit.client.1.smithi149.stdout:7/5: truncate f0 223242 0 2024-09-13T18:30:13.731 INFO:tasks.workunit.client.1.smithi149.stdout:5/3: symlink l2 0 2024-09-13T18:30:13.731 INFO:tasks.workunit.client.1.smithi149.stdout:5/4: readlink l2 0 2024-09-13T18:30:13.740 INFO:tasks.workunit.client.1.smithi149.stdout:4/6: fsync f0 0 2024-09-13T18:30:13.740 INFO:tasks.workunit.client.1.smithi149.stdout:2/4: truncate f0 105750 0 2024-09-13T18:30:13.740 INFO:tasks.workunit.client.1.smithi149.stdout:2/5: creat f1 x:0 0 0 2024-09-13T18:30:13.743 INFO:tasks.workunit.client.1.smithi149.stdout:1/4: dwrite f0 [0,4194304] 0 2024-09-13T18:30:13.747 INFO:tasks.workunit.client.1.smithi149.stdout:1/5: symlink l1 0 2024-09-13T18:30:13.781 INFO:tasks.workunit.client.0.smithi038.stderr:++ readlink -f fsstress 2024-09-13T18:30:13.782 INFO:tasks.workunit.client.0.smithi038.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T18:30:13.783 INFO:tasks.workunit.client.0.smithi038.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-13T18:30:13.783 INFO:tasks.workunit.client.0.smithi038.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T18:30:13.783 INFO:tasks.workunit.client.0.smithi038.stderr:+ popd 2024-09-13T18:30:13.783 INFO:tasks.workunit.client.0.smithi038.stderr:+ popd 2024-09-13T18:30:13.783 INFO:tasks.workunit.client.0.smithi038.stderr:++ mktemp -d -p . 2024-09-13T18:30:13.785 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: Adjusting osd_memory_target on smithi038 to 1217M 2024-09-13T18:30:13.785 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-13T18:30:13.785 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T18:30:13.785 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: pgmap v9: 65 pgs: 65 active+clean; 202 MiB data, 953 MiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 520 op/s 2024-09-13T18:30:13.785 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: Updating smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:30:13.785 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: Updating smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:30:13.785 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:30:13.786 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:30:13.786 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: Updating smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:30:13.786 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: Updating smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:30:13.786 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.786 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.786 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.786 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.786 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:13 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:13.790 INFO:tasks.workunit.client.0.smithi038.stderr:+ T=./tmp.REO17CeZ0B 2024-09-13T18:30:13.790 INFO:tasks.workunit.client.0.smithi038.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.REO17CeZ0B -l 1 -n 1000 -p 10 -v 2024-09-13T18:30:13.793 INFO:tasks.workunit.client.0.smithi038.stdout:seed = 1726520510 2024-09-13T18:30:13.803 INFO:tasks.workunit.client.0.smithi038.stdout:1/0: read - no filename 2024-09-13T18:30:13.803 INFO:tasks.workunit.client.0.smithi038.stdout:1/1: dread - no filename 2024-09-13T18:30:13.803 INFO:tasks.workunit.client.0.smithi038.stdout:1/2: link - no file 2024-09-13T18:30:13.803 INFO:tasks.workunit.client.0.smithi038.stdout:1/3: stat - no entries 2024-09-13T18:30:13.803 INFO:tasks.workunit.client.0.smithi038.stdout:1/4: dwrite - no filename 2024-09-13T18:30:13.803 INFO:tasks.workunit.client.0.smithi038.stdout:1/5: dwrite - no filename 2024-09-13T18:30:13.803 INFO:tasks.workunit.client.0.smithi038.stdout:1/6: dwrite - no filename 2024-09-13T18:30:13.804 INFO:tasks.workunit.client.1.smithi149.stdout:0/6: dwrite f0 [0,4194304] 0 2024-09-13T18:30:13.805 INFO:tasks.workunit.client.0.smithi038.stdout:0/0: symlink l0 0 2024-09-13T18:30:13.805 INFO:tasks.workunit.client.0.smithi038.stdout:0/1: readlink l0 0 2024-09-13T18:30:13.805 INFO:tasks.workunit.client.0.smithi038.stdout:0/2: dwrite - no filename 2024-09-13T18:30:13.807 INFO:tasks.workunit.client.0.smithi038.stdout:1/7: creat f0 x:0 0 0 2024-09-13T18:30:13.808 INFO:tasks.workunit.client.0.smithi038.stdout:1/8: creat f1 x:0 0 0 2024-09-13T18:30:13.808 INFO:tasks.workunit.client.0.smithi038.stdout:1/9: creat f2 x:0 0 0 2024-09-13T18:30:13.810 INFO:tasks.workunit.client.0.smithi038.stdout:4/0: fdatasync - no filename 2024-09-13T18:30:13.811 INFO:tasks.workunit.client.0.smithi038.stdout:0/3: symlink l1 0 2024-09-13T18:30:13.817 INFO:tasks.workunit.client.0.smithi038.stdout:4/1: creat f0 x:0 0 0 2024-09-13T18:30:13.819 INFO:tasks.workunit.client.0.smithi038.stdout:0/4: mkdir d2 0 2024-09-13T18:30:13.819 INFO:tasks.workunit.client.0.smithi038.stdout:0/5: dwrite - no filename 2024-09-13T18:30:13.824 INFO:tasks.workunit.client.0.smithi038.stdout:1/10: unlink f2 0 2024-09-13T18:30:13.824 INFO:tasks.workunit.client.0.smithi038.stdout:1/11: truncate f1 461403 0 2024-09-13T18:30:13.824 INFO:tasks.workunit.client.0.smithi038.stdout:1/12: stat f0 0 2024-09-13T18:30:13.824 INFO:tasks.workunit.client.0.smithi038.stdout:1/13: creat f3 x:0 0 0 2024-09-13T18:30:13.824 INFO:tasks.workunit.client.0.smithi038.stdout:1/14: fdatasync f0 0 2024-09-13T18:30:13.828 INFO:tasks.workunit.client.0.smithi038.stdout:0/6: link l1 d2/l3 0 2024-09-13T18:30:13.828 INFO:tasks.workunit.client.0.smithi038.stdout:0/7: dread - no filename 2024-09-13T18:30:13.829 INFO:tasks.workunit.client.0.smithi038.stdout:2/0: symlink l0 0 2024-09-13T18:30:13.831 INFO:tasks.workunit.client.0.smithi038.stdout:3/0: rename - no filename 2024-09-13T18:30:13.831 INFO:tasks.workunit.client.0.smithi038.stdout:3/1: chown . 772 1 2024-09-13T18:30:13.831 INFO:tasks.workunit.client.0.smithi038.stdout:3/2: stat - no entries 2024-09-13T18:30:13.836 INFO:tasks.workunit.client.0.smithi038.stdout:1/15: rename f1 to f4 0 2024-09-13T18:30:13.836 INFO:tasks.workunit.client.0.smithi038.stdout:1/16: creat f5 x:0 0 0 2024-09-13T18:30:13.836 INFO:tasks.workunit.client.0.smithi038.stdout:1/17: creat f6 x:0 0 0 2024-09-13T18:30:13.842 INFO:tasks.workunit.client.0.smithi038.stdout:3/3: mkdir d0 0 2024-09-13T18:30:13.843 INFO:tasks.workunit.client.0.smithi038.stdout:3/4: write - no filename 2024-09-13T18:30:13.843 INFO:tasks.workunit.client.0.smithi038.stdout:0/8: rmdir d2 39 2024-09-13T18:30:13.843 INFO:tasks.workunit.client.0.smithi038.stdout:0/9: dread - no filename 2024-09-13T18:30:13.843 INFO:tasks.workunit.client.0.smithi038.stdout:2/1: rename l0 to l1 0 2024-09-13T18:30:13.843 INFO:tasks.workunit.client.0.smithi038.stdout:2/2: readlink l1 0 2024-09-13T18:30:13.843 INFO:tasks.workunit.client.0.smithi038.stdout:2/3: dwrite - no filename 2024-09-13T18:30:13.844 INFO:tasks.workunit.client.1.smithi149.stdout:0/7: mkdir d1 0 2024-09-13T18:30:13.844 INFO:tasks.workunit.client.1.smithi149.stdout:0/8: chown f0 2 1 2024-09-13T18:30:13.848 INFO:tasks.workunit.client.0.smithi038.stdout:6/0: creat f0 x:0 0 0 2024-09-13T18:30:13.848 INFO:tasks.workunit.client.0.smithi038.stdout:6/1: dread - f0 zero size 2024-09-13T18:30:13.848 INFO:tasks.workunit.client.0.smithi038.stdout:6/2: creat f1 x:0 0 0 2024-09-13T18:30:13.848 INFO:tasks.workunit.client.0.smithi038.stdout:6/3: write f0 [4102,96912] 0 2024-09-13T18:30:13.852 INFO:tasks.workunit.client.0.smithi038.stdout:3/5: symlink d0/l1 0 2024-09-13T18:30:13.861 INFO:tasks.workunit.client.0.smithi038.stdout:0/10: creat d2/f4 x:0 0 0 2024-09-13T18:30:13.861 INFO:tasks.workunit.client.0.smithi038.stdout:2/4: mkdir d2 0 2024-09-13T18:30:13.861 INFO:tasks.workunit.client.0.smithi038.stdout:0/11: write d2/f4 [363088,11629] 0 2024-09-13T18:30:13.861 INFO:tasks.workunit.client.0.smithi038.stdout:2/5: getdents d2 0 2024-09-13T18:30:13.861 INFO:tasks.workunit.client.0.smithi038.stdout:0/12: creat d2/f5 x:0 0 0 2024-09-13T18:30:13.884 INFO:tasks.workunit.client.0.smithi038.stdout:7/0: creat f0 x:0 0 0 2024-09-13T18:30:13.884 INFO:tasks.workunit.client.0.smithi038.stdout:0/13: mknod d2/c6 0 2024-09-13T18:30:13.885 INFO:tasks.workunit.client.0.smithi038.stdout:6/4: symlink l2 0 2024-09-13T18:30:13.895 INFO:tasks.workunit.client.0.smithi038.stdout:6/5: rename f0 to f3 0 2024-09-13T18:30:13.895 INFO:tasks.workunit.client.0.smithi038.stdout:6/6: creat f4 x:0 0 0 2024-09-13T18:30:13.919 INFO:tasks.workunit.client.1.smithi149.stdout:0/9: write f0 [540033,53775] 0 2024-09-13T18:30:13.919 INFO:tasks.workunit.client.1.smithi149.stdout:0/10: readlink - no filename 2024-09-13T18:30:13.931 INFO:tasks.workunit.client.0.smithi038.stdout:1/18: dwrite f0 [0,4194304] 0 2024-09-13T18:30:13.932 INFO:tasks.workunit.client.0.smithi038.stdout:1/19: dread - f6 zero size 2024-09-13T18:30:13.932 INFO:tasks.workunit.client.0.smithi038.stdout:1/20: truncate f5 741047 0 2024-09-13T18:30:13.945 INFO:tasks.workunit.client.1.smithi149.stdout:4/7: write f0 [571364,113813] 0 2024-09-13T18:30:13.946 INFO:tasks.workunit.client.1.smithi149.stdout:4/8: chown f1 773810 1 2024-09-13T18:30:13.998 INFO:tasks.workunit.client.1.smithi149.stdout:0/11: fsync f0 0 2024-09-13T18:30:13.998 INFO:tasks.workunit.client.1.smithi149.stdout:0/12: chown d1 10827612 1 2024-09-13T18:30:14.021 INFO:tasks.workunit.client.1.smithi149.stdout:0/13: dread f0 [0,4194304] 0 2024-09-13T18:30:14.065 INFO:tasks.workunit.client.1.smithi149.stdout:2/6: fsync f1 0 2024-09-13T18:30:14.065 INFO:tasks.workunit.client.1.smithi149.stdout:2/7: creat f2 x:0 0 0 2024-09-13T18:30:14.124 INFO:tasks.workunit.client.1.smithi149.stdout:3/14: dwrite f0 [0,4194304] 0 2024-09-13T18:30:14.195 INFO:tasks.workunit.client.1.smithi149.stdout:1/6: getdents . 0 2024-09-13T18:30:14.202 INFO:tasks.workunit.client.1.smithi149.stdout:8/0: truncate - no filename 2024-09-13T18:30:14.202 INFO:tasks.workunit.client.1.smithi149.stdout:9/0: chown . 975172 1 2024-09-13T18:30:14.203 INFO:tasks.workunit.client.1.smithi149.stdout:9/1: dwrite - no filename 2024-09-13T18:30:14.221 INFO:tasks.workunit.client.0.smithi038.stdout:4/2: getdents . 0 2024-09-13T18:30:14.248 INFO:tasks.workunit.client.1.smithi149.stdout:7/6: dwrite f0 [0,4194304] 0 2024-09-13T18:30:14.254 INFO:tasks.workunit.client.1.smithi149.stdout:4/9: fsync f0 0 2024-09-13T18:30:14.254 INFO:tasks.workunit.client.1.smithi149.stdout:4/10: chown f0 78411682 1 2024-09-13T18:30:14.254 INFO:tasks.workunit.client.1.smithi149.stdout:4/11: write f1 [1016821,81986] 0 2024-09-13T18:30:14.265 INFO:tasks.workunit.client.0.smithi038.stdout:6/7: rename f3 to f5 0 2024-09-13T18:30:14.265 INFO:tasks.workunit.client.0.smithi038.stdout:6/8: write f5 [567405,58367] 0 2024-09-13T18:30:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: Adjusting osd_memory_target on smithi038 to 1217M 2024-09-13T18:30:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-13T18:30:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T18:30:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: pgmap v9: 65 pgs: 65 active+clean; 202 MiB data, 953 MiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.3 MiB/s wr, 520 op/s 2024-09-13T18:30:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: Updating smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:30:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: Updating smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:30:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:30:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:30:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: Updating smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:30:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: Updating smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:30:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:13 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:14.277 INFO:tasks.workunit.client.0.smithi038.stdout:9/0: readlink - no filename 2024-09-13T18:30:14.277 INFO:tasks.workunit.client.0.smithi038.stdout:8/0: truncate - no filename 2024-09-13T18:30:14.277 INFO:tasks.workunit.client.0.smithi038.stdout:7/1: truncate f0 732968 0 2024-09-13T18:30:14.401 INFO:tasks.workunit.client.0.smithi038.stdout:0/14: dwrite d2/f4 [0,4194304] 0 2024-09-13T18:30:14.526 INFO:tasks.workunit.client.0.smithi038.stdout:1/21: dwrite f3 [0,4194304] 0 2024-09-13T18:30:14.526 INFO:tasks.workunit.client.0.smithi038.stdout:1/22: creat f7 x:0 0 0 2024-09-13T18:30:14.647 INFO:tasks.workunit.client.1.smithi149.stdout:0/14: mkdir d1/d2 0 2024-09-13T18:30:14.647 INFO:tasks.workunit.client.1.smithi149.stdout:0/15: write f0 [3383248,47477] 0 2024-09-13T18:30:14.648 INFO:tasks.workunit.client.1.smithi149.stdout:0/16: fdatasync f0 0 2024-09-13T18:30:14.659 INFO:tasks.workunit.client.0.smithi038.stdout:4/3: mknod c1 0 2024-09-13T18:30:14.659 INFO:tasks.workunit.client.0.smithi038.stdout:4/4: readlink - no filename 2024-09-13T18:30:14.671 INFO:tasks.workunit.client.1.smithi149.stdout:2/8: symlink l3 0 2024-09-13T18:30:14.671 INFO:tasks.workunit.client.1.smithi149.stdout:2/9: dread - f2 zero size 2024-09-13T18:30:14.691 INFO:tasks.workunit.client.1.smithi149.stdout:3/15: mkdir d1/d4 0 2024-09-13T18:30:14.695 INFO:tasks.workunit.client.1.smithi149.stdout:2/10: dwrite f1 [0,4194304] 0 2024-09-13T18:30:14.709 INFO:tasks.workunit.client.1.smithi149.stdout:1/7: creat f2 x:0 0 0 2024-09-13T18:30:14.709 INFO:tasks.workunit.client.1.smithi149.stdout:1/8: stat f2 0 2024-09-13T18:30:14.709 INFO:tasks.workunit.client.1.smithi149.stdout:2/11: dwrite f0 [0,4194304] 0 2024-09-13T18:30:14.709 INFO:tasks.workunit.client.1.smithi149.stdout:2/12: write f2 [683532,22863] 0 2024-09-13T18:30:14.709 INFO:tasks.workunit.client.1.smithi149.stdout:2/13: creat f4 x:0 0 0 2024-09-13T18:30:14.711 INFO:tasks.workunit.client.1.smithi149.stdout:5/5: mkdir d3 0 2024-09-13T18:30:14.713 INFO:tasks.workunit.client.1.smithi149.stdout:9/2: mkdir d0 0 2024-09-13T18:30:14.713 INFO:tasks.workunit.client.1.smithi149.stdout:9/3: write - no filename 2024-09-13T18:30:14.714 INFO:tasks.workunit.client.1.smithi149.stdout:8/1: mknod c0 0 2024-09-13T18:30:14.722 INFO:tasks.workunit.client.1.smithi149.stdout:7/7: link f0 f1 0 2024-09-13T18:30:14.724 INFO:tasks.workunit.client.1.smithi149.stdout:4/12: symlink l2 0 2024-09-13T18:30:14.725 INFO:tasks.workunit.client.1.smithi149.stdout:4/13: read f1 [746372,85221] 0 2024-09-13T18:30:14.732 INFO:tasks.workunit.client.1.smithi149.stdout:4/14: dread f1 [0,4194304] 0 2024-09-13T18:30:14.732 INFO:tasks.workunit.client.1.smithi149.stdout:4/15: truncate f0 1682280 0 2024-09-13T18:30:14.746 INFO:tasks.workunit.client.1.smithi149.stdout:3/16: unlink f0 0 2024-09-13T18:30:14.746 INFO:tasks.workunit.client.1.smithi149.stdout:3/17: truncate - no filename 2024-09-13T18:30:14.750 INFO:tasks.workunit.client.1.smithi149.stdout:1/9: readlink l1 0 2024-09-13T18:30:14.750 INFO:tasks.workunit.client.1.smithi149.stdout:1/10: fdatasync f2 0 2024-09-13T18:30:14.751 INFO:tasks.workunit.client.1.smithi149.stdout:4/16: dwrite f0 [0,4194304] 0 2024-09-13T18:30:14.756 INFO:tasks.workunit.client.1.smithi149.stdout:2/14: link l3 l5 0 2024-09-13T18:30:14.759 INFO:tasks.workunit.client.1.smithi149.stdout:5/6: creat d3/f4 x:0 0 0 2024-09-13T18:30:14.761 INFO:tasks.workunit.client.1.smithi149.stdout:9/4: creat d0/f1 x:0 0 0 2024-09-13T18:30:14.761 INFO:tasks.workunit.client.1.smithi149.stdout:9/5: dread - d0/f1 zero size 2024-09-13T18:30:14.762 INFO:tasks.workunit.client.1.smithi149.stdout:8/2: creat f1 x:0 0 0 2024-09-13T18:30:14.766 INFO:tasks.workunit.client.1.smithi149.stdout:7/8: symlink l2 0 2024-09-13T18:30:14.766 INFO:tasks.workunit.client.1.smithi149.stdout:7/9: creat f3 x:0 0 0 2024-09-13T18:30:14.766 INFO:tasks.workunit.client.1.smithi149.stdout:7/10: chown f0 0 1 2024-09-13T18:30:14.771 INFO:tasks.workunit.client.1.smithi149.stdout:3/18: unlink d1/c3 0 2024-09-13T18:30:14.771 INFO:tasks.workunit.client.1.smithi149.stdout:3/19: dwrite - no filename 2024-09-13T18:30:14.771 INFO:tasks.workunit.client.1.smithi149.stdout:3/20: dwrite - no filename 2024-09-13T18:30:14.771 INFO:tasks.workunit.client.1.smithi149.stdout:3/21: rename d1 to d1/d4/d5 22 2024-09-13T18:30:14.772 INFO:tasks.workunit.client.1.smithi149.stdout:7/11: write f0 [2541855,13108] 0 2024-09-13T18:30:14.772 INFO:tasks.workunit.client.1.smithi149.stdout:7/12: dread - f3 zero size 2024-09-13T18:30:14.774 INFO:tasks.workunit.client.1.smithi149.stdout:4/17: symlink l3 0 2024-09-13T18:30:14.774 INFO:tasks.workunit.client.1.smithi149.stdout:4/18: creat f4 x:0 0 0 2024-09-13T18:30:14.774 INFO:tasks.workunit.client.1.smithi149.stdout:4/19: write f1 [376357,121316] 0 2024-09-13T18:30:14.774 INFO:tasks.workunit.client.1.smithi149.stdout:4/20: creat f5 x:0 0 0 2024-09-13T18:30:14.777 INFO:tasks.workunit.client.1.smithi149.stdout:8/3: mkdir d2 0 2024-09-13T18:30:14.785 INFO:tasks.workunit.client.1.smithi149.stdout:2/15: dwrite f1 [0,4194304] 0 2024-09-13T18:30:14.785 INFO:tasks.workunit.client.1.smithi149.stdout:3/22: mknod d1/c6 0 2024-09-13T18:30:14.785 INFO:tasks.workunit.client.1.smithi149.stdout:4/21: dread f0 [0,4194304] 0 2024-09-13T18:30:14.785 INFO:tasks.workunit.client.1.smithi149.stdout:3/23: dread - no filename 2024-09-13T18:30:14.785 INFO:tasks.workunit.client.1.smithi149.stdout:3/24: fdatasync - no filename 2024-09-13T18:30:14.788 INFO:tasks.workunit.client.1.smithi149.stdout:1/11: link f2 f3 0 2024-09-13T18:30:14.793 INFO:tasks.workunit.client.1.smithi149.stdout:8/4: dwrite f1 [0,4194304] 0 2024-09-13T18:30:14.801 INFO:tasks.workunit.client.1.smithi149.stdout:4/22: symlink l6 0 2024-09-13T18:30:14.803 INFO:tasks.workunit.client.1.smithi149.stdout:3/25: symlink d1/l7 0 2024-09-13T18:30:14.803 INFO:tasks.workunit.client.1.smithi149.stdout:3/26: chown d1 4260088 1 2024-09-13T18:30:14.803 INFO:tasks.workunit.client.1.smithi149.stdout:3/27: write - no filename 2024-09-13T18:30:14.804 INFO:tasks.workunit.client.1.smithi149.stdout:8/5: dread f1 [0,4194304] 0 2024-09-13T18:30:14.807 INFO:tasks.workunit.client.1.smithi149.stdout:7/13: dwrite f1 [0,4194304] 0 2024-09-13T18:30:14.808 INFO:tasks.workunit.client.1.smithi149.stdout:7/14: creat f4 x:0 0 0 2024-09-13T18:30:14.812 INFO:tasks.workunit.client.1.smithi149.stdout:3/28: rename d1/c6 to d1/c8 0 2024-09-13T18:30:14.813 INFO:tasks.workunit.client.1.smithi149.stdout:1/12: mknod c4 0 2024-09-13T18:30:14.817 INFO:tasks.workunit.client.1.smithi149.stdout:3/29: mknod d1/d4/c9 0 2024-09-13T18:30:14.818 INFO:tasks.workunit.client.1.smithi149.stdout:1/13: creat f5 x:0 0 0 2024-09-13T18:30:14.818 INFO:tasks.workunit.client.1.smithi149.stdout:4/23: dwrite f0 [0,4194304] 0 2024-09-13T18:30:14.819 INFO:tasks.workunit.client.1.smithi149.stdout:4/24: dread - f4 zero size 2024-09-13T18:30:14.821 INFO:tasks.workunit.client.1.smithi149.stdout:3/30: mkdir d1/d4/da 0 2024-09-13T18:30:14.821 INFO:tasks.workunit.client.1.smithi149.stdout:3/31: dread - no filename 2024-09-13T18:30:14.825 INFO:tasks.workunit.client.1.smithi149.stdout:3/32: creat d1/fb x:0 0 0 2024-09-13T18:30:14.825 INFO:tasks.workunit.client.1.smithi149.stdout:3/33: write d1/fb [961406,105781] 0 2024-09-13T18:30:14.827 INFO:tasks.workunit.client.1.smithi149.stdout:3/34: write d1/fb [385577,22032] 0 2024-09-13T18:30:14.827 INFO:tasks.workunit.client.1.smithi149.stdout:3/35: write d1/fb [1328681,60040] 0 2024-09-13T18:30:14.829 INFO:tasks.workunit.client.1.smithi149.stdout:4/25: dread f0 [0,4194304] 0 2024-09-13T18:30:14.829 INFO:tasks.workunit.client.1.smithi149.stdout:4/26: fdatasync f1 0 2024-09-13T18:30:14.829 INFO:tasks.workunit.client.1.smithi149.stdout:4/27: readlink l3 0 2024-09-13T18:30:14.831 INFO:tasks.workunit.client.1.smithi149.stdout:3/36: fdatasync d1/fb 0 2024-09-13T18:30:14.831 INFO:tasks.workunit.client.1.smithi149.stdout:3/37: write d1/fb [933002,108961] 0 2024-09-13T18:30:14.831 INFO:tasks.workunit.client.1.smithi149.stdout:3/38: write d1/fb [559038,105622] 0 2024-09-13T18:30:14.831 INFO:tasks.workunit.client.1.smithi149.stdout:3/39: stat d1/l7 0 2024-09-13T18:30:14.831 INFO:tasks.workunit.client.1.smithi149.stdout:4/28: symlink l7 0 2024-09-13T18:30:14.833 INFO:tasks.workunit.client.1.smithi149.stdout:3/40: symlink d1/d4/lc 0 2024-09-13T18:30:14.834 INFO:tasks.workunit.client.1.smithi149.stdout:4/29: mknod c8 0 2024-09-13T18:30:14.834 INFO:tasks.workunit.client.1.smithi149.stdout:4/30: creat f9 x:0 0 0 2024-09-13T18:30:14.836 INFO:tasks.workunit.client.1.smithi149.stdout:3/41: creat d1/d4/fd x:0 0 0 2024-09-13T18:30:14.839 INFO:tasks.workunit.client.1.smithi149.stdout:1/14: dwrite f0 [4194304,4194304] 0 2024-09-13T18:30:14.845 INFO:tasks.workunit.client.1.smithi149.stdout:3/42: fdatasync d1/fb 0 2024-09-13T18:30:14.847 INFO:tasks.workunit.client.1.smithi149.stdout:3/43: symlink d1/d4/le 0 2024-09-13T18:30:14.848 INFO:tasks.workunit.client.1.smithi149.stdout:3/44: write d1/d4/fd [284841,119124] 0 2024-09-13T18:30:14.851 INFO:tasks.workunit.client.1.smithi149.stdout:3/45: dread d1/fb [0,4194304] 0 2024-09-13T18:30:14.852 INFO:tasks.workunit.client.1.smithi149.stdout:4/31: dwrite f0 [0,4194304] 0 2024-09-13T18:30:14.852 INFO:tasks.workunit.client.1.smithi149.stdout:4/32: read - f4 zero size 2024-09-13T18:30:14.852 INFO:tasks.workunit.client.1.smithi149.stdout:4/33: readlink l7 0 2024-09-13T18:30:14.852 INFO:tasks.workunit.client.1.smithi149.stdout:4/34: creat fa x:0 0 0 2024-09-13T18:30:14.853 INFO:tasks.workunit.client.1.smithi149.stdout:3/46: symlink d1/d4/da/lf 0 2024-09-13T18:30:14.853 INFO:tasks.workunit.client.1.smithi149.stdout:3/47: write d1/fb [2332756,30606] 0 2024-09-13T18:30:14.856 INFO:tasks.workunit.client.1.smithi149.stdout:4/35: symlink lb 0 2024-09-13T18:30:14.858 INFO:tasks.workunit.client.1.smithi149.stdout:1/15: dread f0 [0,4194304] 0 2024-09-13T18:30:14.860 INFO:tasks.workunit.client.1.smithi149.stdout:4/36: rename f1 to fc 0 2024-09-13T18:30:14.860 INFO:tasks.workunit.client.1.smithi149.stdout:4/37: dread - f4 zero size 2024-09-13T18:30:14.861 INFO:tasks.workunit.client.1.smithi149.stdout:4/38: creat fd x:0 0 0 2024-09-13T18:30:14.861 INFO:tasks.workunit.client.1.smithi149.stdout:4/39: chown f5 3147 1 2024-09-13T18:30:14.861 INFO:tasks.workunit.client.1.smithi149.stdout:4/40: dread - f9 zero size 2024-09-13T18:30:14.863 INFO:tasks.workunit.client.0.smithi038.stdout:9/1: mkdir d0 0 2024-09-13T18:30:14.863 INFO:tasks.workunit.client.0.smithi038.stdout:9/2: write - no filename 2024-09-13T18:30:14.864 INFO:tasks.workunit.client.0.smithi038.stdout:9/3: dread - no filename 2024-09-13T18:30:14.864 INFO:tasks.workunit.client.0.smithi038.stdout:9/4: truncate - no filename 2024-09-13T18:30:14.864 INFO:tasks.workunit.client.0.smithi038.stdout:9/5: write - no filename 2024-09-13T18:30:14.864 INFO:tasks.workunit.client.0.smithi038.stdout:9/6: truncate - no filename 2024-09-13T18:30:14.865 INFO:tasks.workunit.client.0.smithi038.stdout:5/0: creat f0 x:0 0 0 2024-09-13T18:30:14.867 INFO:tasks.workunit.client.0.smithi038.stdout:8/1: creat f0 x:0 0 0 2024-09-13T18:30:14.869 INFO:tasks.workunit.client.1.smithi149.stdout:1/16: symlink l6 0 2024-09-13T18:30:14.873 INFO:tasks.workunit.client.1.smithi149.stdout:1/17: mknod c7 0 2024-09-13T18:30:14.891 INFO:tasks.workunit.client.1.smithi149.stdout:1/18: dwrite f5 [0,4194304] 0 2024-09-13T18:30:14.893 INFO:tasks.workunit.client.1.smithi149.stdout:4/41: dwrite f4 [0,4194304] 0 2024-09-13T18:30:14.900 INFO:tasks.workunit.client.1.smithi149.stdout:4/42: rename f5 to fe 0 2024-09-13T18:30:14.902 INFO:tasks.workunit.client.1.smithi149.stdout:4/43: mkdir df 0 2024-09-13T18:30:14.902 INFO:tasks.workunit.client.1.smithi149.stdout:1/19: read f5 [3631448,19203] 0 2024-09-13T18:30:14.904 INFO:tasks.workunit.client.1.smithi149.stdout:4/44: creat df/f10 x:0 0 0 2024-09-13T18:30:14.907 INFO:tasks.workunit.client.1.smithi149.stdout:1/20: rename l1 to l8 0 2024-09-13T18:30:14.911 INFO:tasks.workunit.client.1.smithi149.stdout:1/21: unlink f0 0 2024-09-13T18:30:14.923 INFO:tasks.workunit.client.1.smithi149.stdout:4/45: dwrite fc [0,4194304] 0 2024-09-13T18:30:14.926 INFO:tasks.workunit.client.1.smithi149.stdout:4/46: mkdir df/d11 0 2024-09-13T18:30:14.941 INFO:tasks.workunit.client.1.smithi149.stdout:4/47: dread fc [0,4194304] 0 2024-09-13T18:30:14.943 INFO:tasks.workunit.client.1.smithi149.stdout:4/48: mkdir df/d11/d12 0 2024-09-13T18:30:14.945 INFO:tasks.workunit.client.1.smithi149.stdout:4/49: symlink df/l13 0 2024-09-13T18:30:14.947 INFO:tasks.workunit.client.1.smithi149.stdout:4/50: rename df/l13 to df/d11/d12/l14 0 2024-09-13T18:30:14.947 INFO:tasks.workunit.client.1.smithi149.stdout:4/51: readlink l3 0 2024-09-13T18:30:14.947 INFO:tasks.workunit.client.1.smithi149.stdout:4/52: creat df/f15 x:0 0 0 2024-09-13T18:30:14.956 INFO:tasks.workunit.client.1.smithi149.stdout:4/53: write f4 [3905539,123952] 0 2024-09-13T18:30:14.958 INFO:tasks.workunit.client.1.smithi149.stdout:4/54: unlink fd 0 2024-09-13T18:30:14.960 INFO:tasks.workunit.client.1.smithi149.stdout:4/55: creat df/d11/f16 x:0 0 0 2024-09-13T18:30:14.983 INFO:tasks.workunit.client.1.smithi149.stdout:4/56: dwrite f9 [0,4194304] 0 2024-09-13T18:30:14.989 INFO:tasks.workunit.client.1.smithi149.stdout:4/57: mkdir df/d11/d12/d17 0 2024-09-13T18:30:14.989 INFO:tasks.workunit.client.1.smithi149.stdout:4/58: dread - fe zero size 2024-09-13T18:30:15.002 INFO:tasks.workunit.client.1.smithi149.stdout:4/59: dwrite fa [0,4194304] 0 2024-09-13T18:30:15.002 INFO:tasks.workunit.client.1.smithi149.stdout:4/60: readlink lb 0 2024-09-13T18:30:15.002 INFO:tasks.workunit.client.1.smithi149.stdout:4/61: stat f0 0 2024-09-13T18:30:15.002 INFO:tasks.workunit.client.1.smithi149.stdout:4/62: creat df/f18 x:0 0 0 2024-09-13T18:30:15.022 INFO:tasks.workunit.client.1.smithi149.stdout:2/16: getdents . 0 2024-09-13T18:30:15.022 INFO:tasks.workunit.client.1.smithi149.stdout:2/17: chown f2 797234 1 2024-09-13T18:30:15.024 INFO:tasks.workunit.client.1.smithi149.stdout:5/7: fsync d3/f4 0 2024-09-13T18:30:15.024 INFO:tasks.workunit.client.1.smithi149.stdout:5/8: readlink l2 0 2024-09-13T18:30:15.024 INFO:tasks.workunit.client.1.smithi149.stdout:5/9: dread - d3/f4 zero size 2024-09-13T18:30:15.024 INFO:tasks.workunit.client.1.smithi149.stdout:5/10: chown f1 212023 1 2024-09-13T18:30:15.024 INFO:tasks.workunit.client.1.smithi149.stdout:5/11: write d3/f4 [222711,43789] 0 2024-09-13T18:30:15.024 INFO:tasks.workunit.client.1.smithi149.stdout:5/12: truncate d3/f4 791636 0 2024-09-13T18:30:15.024 INFO:tasks.workunit.client.1.smithi149.stdout:5/13: chown d3/f4 8 1 2024-09-13T18:30:15.028 INFO:tasks.workunit.client.1.smithi149.stdout:0/17: truncate f0 2061354 0 2024-09-13T18:30:15.032 INFO:tasks.workunit.client.1.smithi149.stdout:2/18: read f1 [2269051,31699] 0 2024-09-13T18:30:15.032 INFO:tasks.workunit.client.1.smithi149.stdout:2/19: fdatasync f4 0 2024-09-13T18:30:15.055 INFO:tasks.workunit.client.1.smithi149.stdout:8/6: truncate f1 3184200 0 2024-09-13T18:30:15.055 INFO:tasks.workunit.client.1.smithi149.stdout:8/7: stat d2 0 2024-09-13T18:30:15.055 INFO:tasks.workunit.client.1.smithi149.stdout:8/8: chown f1 1 1 2024-09-13T18:30:15.055 INFO:tasks.workunit.client.1.smithi149.stdout:8/9: fdatasync f1 0 2024-09-13T18:30:15.055 INFO:tasks.workunit.client.1.smithi149.stdout:8/10: stat d2 0 2024-09-13T18:30:15.059 INFO:tasks.workunit.client.1.smithi149.stdout:2/20: dwrite f1 [0,4194304] 0 2024-09-13T18:30:15.077 INFO:tasks.workunit.client.1.smithi149.stdout:2/21: dwrite f4 [0,4194304] 0 2024-09-13T18:30:15.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:14 smithi038 ceph-mon[27689]: Reconfiguring prometheus.smithi038 (dependencies changed)... 2024-09-13T18:30:15.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:14 smithi038 ceph-mon[27689]: Reconfiguring daemon prometheus.smithi038 on smithi038 2024-09-13T18:30:15.084 INFO:tasks.workunit.client.1.smithi149.stdout:2/22: dread f0 [0,4194304] 0 2024-09-13T18:30:15.109 INFO:tasks.workunit.client.1.smithi149.stdout:2/23: dwrite f0 [0,4194304] 0 2024-09-13T18:30:15.120 INFO:tasks.workunit.client.0.smithi038.stdout:0/15: mkdir d2/d7 0 2024-09-13T18:30:15.120 INFO:tasks.workunit.client.0.smithi038.stdout:0/16: readlink l0 0 2024-09-13T18:30:15.126 INFO:tasks.workunit.client.1.smithi149.stdout:3/48: rmdir d1 39 2024-09-13T18:30:15.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:14 smithi149 ceph-mon[35845]: Reconfiguring prometheus.smithi038 (dependencies changed)... 2024-09-13T18:30:15.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:14 smithi149 ceph-mon[35845]: Reconfiguring daemon prometheus.smithi038 on smithi038 2024-09-13T18:30:15.290 INFO:tasks.workunit.client.1.smithi149.stdout:1/22: getdents . 0 2024-09-13T18:30:15.291 INFO:tasks.workunit.client.1.smithi149.stdout:1/23: getdents . 0 2024-09-13T18:30:15.328 INFO:tasks.workunit.client.0.smithi038.stdout:1/23: rename f0 to f8 0 2024-09-13T18:30:15.343 INFO:tasks.workunit.client.0.smithi038.stdout:1/24: dwrite f7 [0,4194304] 0 2024-09-13T18:30:15.404 INFO:tasks.workunit.client.0.smithi038.stdout:4/5: getdents . 0 2024-09-13T18:30:15.406 INFO:tasks.workunit.client.0.smithi038.stdout:6/9: rename f4 to f6 0 2024-09-13T18:30:15.406 INFO:tasks.workunit.client.0.smithi038.stdout:6/10: chown f6 31 1 2024-09-13T18:30:15.408 INFO:tasks.workunit.client.0.smithi038.stdout:9/7: creat d0/f1 x:0 0 0 2024-09-13T18:30:15.408 INFO:tasks.workunit.client.0.smithi038.stdout:9/8: creat d0/f2 x:0 0 0 2024-09-13T18:30:15.408 INFO:tasks.workunit.client.0.smithi038.stdout:9/9: truncate d0/f1 291727 0 2024-09-13T18:30:15.411 INFO:tasks.workunit.client.0.smithi038.stdout:8/2: mkdir d1 0 2024-09-13T18:30:15.411 INFO:tasks.workunit.client.0.smithi038.stdout:8/3: fsync f0 0 2024-09-13T18:30:15.431 INFO:tasks.workunit.client.0.smithi038.stdout:0/17: symlink d2/l8 0 2024-09-13T18:30:15.439 INFO:tasks.workunit.client.0.smithi038.stdout:4/6: unlink f0 0 2024-09-13T18:30:15.441 INFO:tasks.workunit.client.0.smithi038.stdout:6/11: symlink l7 0 2024-09-13T18:30:15.441 INFO:tasks.workunit.client.0.smithi038.stdout:6/12: stat l2 0 2024-09-13T18:30:15.444 INFO:tasks.workunit.client.0.smithi038.stdout:9/10: symlink d0/l3 0 2024-09-13T18:30:15.446 INFO:tasks.workunit.client.0.smithi038.stdout:5/1: rename f0 to f1 0 2024-09-13T18:30:15.448 INFO:tasks.workunit.client.0.smithi038.stdout:8/4: symlink d1/l2 0 2024-09-13T18:30:15.448 INFO:tasks.workunit.client.0.smithi038.stdout:8/5: dread - f0 zero size 2024-09-13T18:30:15.453 INFO:tasks.workunit.client.0.smithi038.stdout:9/11: link d0/f2 d0/f4 0 2024-09-13T18:30:15.455 INFO:tasks.workunit.client.0.smithi038.stdout:8/6: creat d1/f3 x:0 0 0 2024-09-13T18:30:15.455 INFO:tasks.workunit.client.0.smithi038.stdout:8/7: chown d1/l2 114589491 1 2024-09-13T18:30:15.458 INFO:tasks.workunit.client.1.smithi149.stdout:8/11: dread f1 [0,4194304] 0 2024-09-13T18:30:15.458 INFO:tasks.workunit.client.0.smithi038.stdout:4/7: mkdir d2 0 2024-09-13T18:30:15.458 INFO:tasks.workunit.client.0.smithi038.stdout:4/8: fdatasync - no filename 2024-09-13T18:30:15.460 INFO:tasks.workunit.client.0.smithi038.stdout:0/18: dwrite d2/f4 [0,4194304] 0 2024-09-13T18:30:15.463 INFO:tasks.workunit.client.0.smithi038.stdout:4/9: mkdir d2/d3 0 2024-09-13T18:30:15.466 INFO:tasks.workunit.client.0.smithi038.stdout:6/13: dwrite f5 [0,4194304] 0 2024-09-13T18:30:15.466 INFO:tasks.workunit.client.0.smithi038.stdout:0/19: creat d2/d7/f9 x:0 0 0 2024-09-13T18:30:15.470 INFO:tasks.workunit.client.0.smithi038.stdout:4/10: rename d2/d3 to d2/d4 0 2024-09-13T18:30:15.470 INFO:tasks.workunit.client.0.smithi038.stdout:4/11: dwrite - no filename 2024-09-13T18:30:15.471 INFO:tasks.workunit.client.0.smithi038.stdout:9/12: dwrite d0/f1 [0,4194304] 0 2024-09-13T18:30:15.471 INFO:tasks.workunit.client.0.smithi038.stdout:9/13: chown d0/f4 431683 1 2024-09-13T18:30:15.475 INFO:tasks.workunit.client.0.smithi038.stdout:6/14: mknod c8 0 2024-09-13T18:30:15.475 INFO:tasks.workunit.client.0.smithi038.stdout:6/15: dread - f6 zero size 2024-09-13T18:30:15.482 INFO:tasks.workunit.client.0.smithi038.stdout:4/12: creat d2/d4/f5 x:0 0 0 2024-09-13T18:30:15.483 INFO:tasks.workunit.client.0.smithi038.stdout:0/20: dwrite d2/f5 [0,4194304] 0 2024-09-13T18:30:15.488 INFO:tasks.workunit.client.0.smithi038.stdout:9/14: symlink d0/l5 0 2024-09-13T18:30:15.488 INFO:tasks.workunit.client.0.smithi038.stdout:9/15: write d0/f2 [21669,61950] 0 2024-09-13T18:30:15.489 INFO:tasks.workunit.client.0.smithi038.stdout:9/16: truncate d0/f4 814757 0 2024-09-13T18:30:15.489 INFO:tasks.workunit.client.0.smithi038.stdout:9/17: creat d0/f6 x:0 0 0 2024-09-13T18:30:15.491 INFO:tasks.workunit.client.0.smithi038.stdout:4/13: chown c1 4 1 2024-09-13T18:30:15.494 INFO:tasks.workunit.client.0.smithi038.stdout:0/21: dread d2/f4 [0,4194304] 0 2024-09-13T18:30:15.494 INFO:tasks.workunit.client.0.smithi038.stdout:6/16: dwrite f6 [0,4194304] 0 2024-09-13T18:30:15.494 INFO:tasks.workunit.client.0.smithi038.stdout:6/17: creat f9 x:0 0 0 2024-09-13T18:30:15.495 INFO:tasks.workunit.client.0.smithi038.stdout:6/18: creat fa x:0 0 0 2024-09-13T18:30:15.499 INFO:tasks.workunit.client.0.smithi038.stdout:9/18: mkdir d0/d7 0 2024-09-13T18:30:15.501 INFO:tasks.workunit.client.0.smithi038.stdout:4/14: creat d2/f6 x:0 0 0 2024-09-13T18:30:15.501 INFO:tasks.workunit.client.0.smithi038.stdout:4/15: dread - d2/d4/f5 zero size 2024-09-13T18:30:15.506 INFO:tasks.workunit.client.0.smithi038.stdout:6/19: write f6 [826705,60592] 0 2024-09-13T18:30:15.509 INFO:tasks.workunit.client.0.smithi038.stdout:9/19: rename d0/f2 to d0/f8 0 2024-09-13T18:30:15.510 INFO:tasks.workunit.client.0.smithi038.stdout:9/20: creat d0/f9 x:0 0 0 2024-09-13T18:30:15.511 INFO:tasks.workunit.client.0.smithi038.stdout:4/16: unlink d2/f6 0 2024-09-13T18:30:15.511 INFO:tasks.workunit.client.0.smithi038.stdout:4/17: write d2/d4/f5 [751347,65180] 0 2024-09-13T18:30:15.511 INFO:tasks.workunit.client.0.smithi038.stdout:4/18: truncate d2/d4/f5 1089059 0 2024-09-13T18:30:15.512 INFO:tasks.workunit.client.0.smithi038.stdout:6/20: mknod cb 0 2024-09-13T18:30:15.516 INFO:tasks.workunit.client.0.smithi038.stdout:9/21: unlink d0/l3 0 2024-09-13T18:30:15.518 INFO:tasks.workunit.client.0.smithi038.stdout:6/21: mknod cc 0 2024-09-13T18:30:15.522 INFO:tasks.workunit.client.0.smithi038.stdout:6/22: mkdir dd 0 2024-09-13T18:30:15.524 INFO:tasks.workunit.client.0.smithi038.stdout:6/23: mkdir dd/de 0 2024-09-13T18:30:15.526 INFO:tasks.workunit.client.0.smithi038.stdout:4/19: dwrite d2/d4/f5 [0,4194304] 0 2024-09-13T18:30:15.527 INFO:tasks.workunit.client.0.smithi038.stdout:4/20: chown d2/d4 7209 1 2024-09-13T18:30:15.529 INFO:tasks.workunit.client.0.smithi038.stdout:6/24: link l7 dd/de/lf 0 2024-09-13T18:30:15.537 INFO:tasks.workunit.client.0.smithi038.stdout:9/22: dwrite d0/f9 [0,4194304] 0 2024-09-13T18:30:15.541 INFO:tasks.workunit.client.0.smithi038.stdout:4/21: write d2/d4/f5 [56735,88922] 0 2024-09-13T18:30:15.542 INFO:tasks.workunit.client.0.smithi038.stdout:9/23: rename d0/f9 to d0/d7/fa 0 2024-09-13T18:30:15.542 INFO:tasks.workunit.client.0.smithi038.stdout:9/24: creat d0/fb x:0 0 0 2024-09-13T18:30:15.545 INFO:tasks.workunit.client.0.smithi038.stdout:4/22: mkdir d2/d7 0 2024-09-13T18:30:15.550 INFO:tasks.workunit.client.0.smithi038.stdout:4/23: mkdir d2/d7/d8 0 2024-09-13T18:30:15.552 INFO:tasks.workunit.client.0.smithi038.stdout:9/25: read d0/d7/fa [1947010,101728] 0 2024-09-13T18:30:15.552 INFO:tasks.workunit.client.0.smithi038.stdout:4/24: symlink d2/d4/l9 0 2024-09-13T18:30:15.552 INFO:tasks.workunit.client.0.smithi038.stdout:4/25: truncate d2/d4/f5 5080448 0 2024-09-13T18:30:15.553 INFO:tasks.workunit.client.0.smithi038.stdout:6/25: dwrite f9 [0,4194304] 0 2024-09-13T18:30:15.561 INFO:tasks.workunit.client.0.smithi038.stdout:4/26: dread d2/d4/f5 [0,4194304] 0 2024-09-13T18:30:15.561 INFO:tasks.workunit.client.0.smithi038.stdout:4/27: fdatasync d2/d4/f5 0 2024-09-13T18:30:15.567 INFO:tasks.workunit.client.0.smithi038.stdout:4/28: dread d2/d4/f5 [0,4194304] 0 2024-09-13T18:30:15.567 INFO:tasks.workunit.client.0.smithi038.stdout:4/29: fdatasync d2/d4/f5 0 2024-09-13T18:30:15.569 INFO:tasks.workunit.client.0.smithi038.stdout:4/30: mkdir d2/d7/da 0 2024-09-13T18:30:15.569 INFO:tasks.workunit.client.0.smithi038.stdout:4/31: rename d2/d7/d8 to d2/d7/d8/db 22 2024-09-13T18:30:15.569 INFO:tasks.workunit.client.0.smithi038.stdout:4/32: chown c1 50 1 2024-09-13T18:30:15.582 INFO:tasks.workunit.client.0.smithi038.stdout:9/26: dwrite d0/f8 [0,4194304] 0 2024-09-13T18:30:15.582 INFO:tasks.workunit.client.0.smithi038.stdout:6/26: dwrite fa [0,4194304] 0 2024-09-13T18:30:15.583 INFO:tasks.workunit.client.0.smithi038.stdout:6/27: chown dd/de 6208 1 2024-09-13T18:30:15.584 INFO:tasks.workunit.client.0.smithi038.stdout:9/27: symlink d0/d7/lc 0 2024-09-13T18:30:15.587 INFO:tasks.workunit.client.0.smithi038.stdout:6/28: creat dd/f10 x:0 0 0 2024-09-13T18:30:15.636 INFO:tasks.workunit.client.0.smithi038.stdout:1/25: truncate f3 2081770 0 2024-09-13T18:30:15.654 INFO:tasks.workunit.client.0.smithi038.stdout:1/26: dwrite f6 [0,4194304] 0 2024-09-13T18:30:15.654 INFO:tasks.workunit.client.0.smithi038.stdout:1/27: chown f5 958530375 1 2024-09-13T18:30:15.660 INFO:tasks.workunit.client.0.smithi038.stdout:1/28: unlink f7 0 2024-09-13T18:30:15.660 INFO:tasks.workunit.client.0.smithi038.stdout:1/29: write f5 [295739,104440] 0 2024-09-13T18:30:15.660 INFO:tasks.workunit.client.0.smithi038.stdout:1/30: chown f3 384 1 2024-09-13T18:30:15.666 INFO:tasks.workunit.client.0.smithi038.stdout:1/31: read f8 [871675,104755] 0 2024-09-13T18:30:15.668 INFO:tasks.workunit.client.0.smithi038.stdout:1/32: rename f6 to f9 0 2024-09-13T18:30:15.750 INFO:tasks.workunit.client.0.smithi038.stdout:8/8: rmdir d1 39 2024-09-13T18:30:15.750 INFO:tasks.workunit.client.0.smithi038.stdout:8/9: fsync d1/f3 0 2024-09-13T18:30:15.752 INFO:tasks.workunit.client.0.smithi038.stdout:8/10: mkdir d1/d4 0 2024-09-13T18:30:15.752 INFO:tasks.workunit.client.0.smithi038.stdout:8/11: dread - d1/f3 zero size 2024-09-13T18:30:15.753 INFO:tasks.workunit.client.0.smithi038.stdout:8/12: mknod d1/d4/c5 0 2024-09-13T18:30:15.755 INFO:tasks.workunit.client.0.smithi038.stdout:8/13: symlink d1/l6 0 2024-09-13T18:30:15.755 INFO:tasks.workunit.client.0.smithi038.stdout:8/14: write f0 [709975,104043] 0 2024-09-13T18:30:15.791 INFO:tasks.workunit.client.0.smithi038.stdout:9/28: fsync d0/f8 0 2024-09-13T18:30:15.791 INFO:tasks.workunit.client.0.smithi038.stdout:9/29: stat d0/fb 0 2024-09-13T18:30:15.792 INFO:tasks.workunit.client.0.smithi038.stdout:8/15: dwrite f0 [0,4194304] 0 2024-09-13T18:30:15.793 INFO:tasks.workunit.client.0.smithi038.stdout:9/30: creat d0/d7/fd x:0 0 0 2024-09-13T18:30:15.796 INFO:tasks.workunit.client.0.smithi038.stdout:8/16: creat d1/f7 x:0 0 0 2024-09-13T18:30:15.798 INFO:tasks.workunit.client.0.smithi038.stdout:9/31: rename d0/d7/fd to d0/d7/fe 0 2024-09-13T18:30:15.801 INFO:tasks.workunit.client.0.smithi038.stdout:8/17: mkdir d1/d8 0 2024-09-13T18:30:15.801 INFO:tasks.workunit.client.0.smithi038.stdout:8/18: chown d1/d8 667 1 2024-09-13T18:30:15.801 INFO:tasks.workunit.client.0.smithi038.stdout:8/19: fsync d1/f3 0 2024-09-13T18:30:15.806 INFO:tasks.workunit.client.0.smithi038.stdout:6/29: getdents dd/de 0 2024-09-13T18:30:15.806 INFO:tasks.workunit.client.0.smithi038.stdout:6/30: chown dd/de 438163788 1 2024-09-13T18:30:15.815 INFO:tasks.workunit.client.0.smithi038.stdout:6/31: dread fa [0,4194304] 0 2024-09-13T18:30:15.837 INFO:tasks.workunit.client.0.smithi038.stdout:4/33: rename d2/d7 to d2/d4/dc 0 2024-09-13T18:30:15.842 INFO:tasks.workunit.client.0.smithi038.stdout:6/32: dwrite f9 [0,4194304] 0 2024-09-13T18:30:15.846 INFO:tasks.workunit.client.0.smithi038.stdout:4/34: dread d2/d4/f5 [0,4194304] 0 2024-09-13T18:30:15.846 INFO:tasks.workunit.client.0.smithi038.stdout:4/35: chown d2/d4/dc/d8 1189810 1 2024-09-13T18:30:15.854 INFO:tasks.workunit.client.0.smithi038.stdout:6/33: write f9 [1247901,21880] 0 2024-09-13T18:30:15.857 INFO:tasks.workunit.client.0.smithi038.stdout:6/34: link f6 dd/f11 0 2024-09-13T18:30:15.857 INFO:tasks.workunit.client.0.smithi038.stdout:6/35: truncate f5 4262287 0 2024-09-13T18:30:15.857 INFO:tasks.workunit.client.0.smithi038.stdout:6/36: stat cc 0 2024-09-13T18:30:15.864 INFO:tasks.workunit.client.0.smithi038.stdout:4/36: dwrite d2/d4/f5 [4194304,4194304] 0 2024-09-13T18:30:15.883 INFO:tasks.workunit.client.0.smithi038.stdout:4/37: dread d2/d4/f5 [4194304,4194304] 0 2024-09-13T18:30:15.890 INFO:tasks.workunit.client.0.smithi038.stdout:6/37: dwrite f9 [0,4194304] 0 2024-09-13T18:30:15.892 INFO:tasks.workunit.client.0.smithi038.stdout:6/38: symlink dd/de/l12 0 2024-09-13T18:30:15.892 INFO:tasks.workunit.client.0.smithi038.stdout:6/39: creat dd/f13 x:0 0 0 2024-09-13T18:30:15.905 INFO:tasks.workunit.client.0.smithi038.stdout:6/40: write f5 [3271199,51828] 0 2024-09-13T18:30:15.905 INFO:tasks.workunit.client.0.smithi038.stdout:6/41: chown fa 858221806 1 2024-09-13T18:30:15.905 INFO:tasks.workunit.client.0.smithi038.stdout:4/38: dwrite d2/d4/f5 [4194304,4194304] 0 2024-09-13T18:30:15.905 INFO:tasks.workunit.client.0.smithi038.stdout:4/39: fsync d2/d4/f5 0 2024-09-13T18:30:15.909 INFO:tasks.workunit.client.0.smithi038.stdout:6/42: write fa [731113,58499] 0 2024-09-13T18:30:15.909 INFO:tasks.workunit.client.0.smithi038.stdout:6/43: fdatasync f1 0 2024-09-13T18:30:15.909 INFO:tasks.workunit.client.0.smithi038.stdout:6/44: write f5 [4913144,57078] 0 2024-09-13T18:30:15.909 INFO:tasks.workunit.client.0.smithi038.stdout:6/45: creat dd/f14 x:0 0 0 2024-09-13T18:30:15.909 INFO:tasks.workunit.client.0.smithi038.stdout:4/40: dread d2/d4/f5 [0,4194304] 0 2024-09-13T18:30:15.915 INFO:tasks.workunit.client.0.smithi038.stdout:6/46: mknod dd/c15 0 2024-09-13T18:30:15.918 INFO:tasks.workunit.client.0.smithi038.stdout:4/41: creat d2/d4/dc/da/fd x:0 0 0 2024-09-13T18:30:15.922 INFO:tasks.workunit.client.0.smithi038.stdout:6/47: dread dd/f11 [0,4194304] 0 2024-09-13T18:30:15.922 INFO:tasks.workunit.client.0.smithi038.stdout:6/48: truncate dd/f13 1000869 0 2024-09-13T18:30:15.922 INFO:tasks.workunit.client.0.smithi038.stdout:6/49: dread - dd/f10 zero size 2024-09-13T18:30:15.922 INFO:tasks.workunit.client.0.smithi038.stdout:4/42: link d2/d4/dc/da/fd d2/fe 0 2024-09-13T18:30:15.925 INFO:tasks.workunit.client.0.smithi038.stdout:4/43: mkdir d2/df 0 2024-09-13T18:30:15.925 INFO:tasks.workunit.client.0.smithi038.stdout:4/44: dread - d2/d4/dc/da/fd zero size 2024-09-13T18:30:15.925 INFO:tasks.workunit.client.0.smithi038.stdout:4/45: chown d2/d4/dc/d8 504 1 2024-09-13T18:30:15.928 INFO:tasks.workunit.client.0.smithi038.stdout:4/46: mkdir d2/d4/dc/da/d10 0 2024-09-13T18:30:15.953 INFO:tasks.workunit.client.0.smithi038.stdout:6/50: dwrite dd/f13 [0,4194304] 0 2024-09-13T18:30:15.953 INFO:tasks.workunit.client.0.smithi038.stdout:6/51: creat dd/f16 x:0 0 0 2024-09-13T18:30:15.953 INFO:tasks.workunit.client.0.smithi038.stdout:4/47: dwrite d2/d4/dc/da/fd [0,4194304] 0 2024-09-13T18:30:15.962 INFO:tasks.workunit.client.0.smithi038.stdout:1/33: getdents . 0 2024-09-13T18:30:15.962 INFO:tasks.workunit.client.0.smithi038.stdout:1/34: chown f9 14915269 1 2024-09-13T18:30:15.962 INFO:tasks.workunit.client.0.smithi038.stdout:1/35: chown f8 44862 1 2024-09-13T18:30:15.962 INFO:tasks.workunit.client.0.smithi038.stdout:1/36: getdents . 0 2024-09-13T18:30:15.962 INFO:tasks.workunit.client.0.smithi038.stdout:1/37: getdents . 0 2024-09-13T18:30:15.967 INFO:tasks.workunit.client.0.smithi038.stdout:1/38: rename f5 to fa 0 2024-09-13T18:30:15.971 INFO:tasks.workunit.client.0.smithi038.stdout:6/52: dwrite f5 [4194304,4194304] 0 2024-09-13T18:30:15.980 INFO:tasks.workunit.client.0.smithi038.stdout:4/48: dwrite d2/d4/dc/da/fd [0,4194304] 0 2024-09-13T18:30:16.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:15 smithi038 ceph-mon[27689]: pgmap v10: 65 pgs: 65 active+clean; 202 MiB data, 953 MiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 476 op/s 2024-09-13T18:30:16.183 INFO:tasks.workunit.client.0.smithi038.stdout:4/49: getdents d2/d4/dc/da 0 2024-09-13T18:30:16.192 INFO:tasks.workunit.client.0.smithi038.stdout:4/50: write d2/d4/dc/da/fd [759212,56198] 0 2024-09-13T18:30:16.192 INFO:tasks.workunit.client.0.smithi038.stdout:4/51: chown d2/d4/dc/da/d10 1006 1 2024-09-13T18:30:16.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:15 smithi149 ceph-mon[35845]: pgmap v10: 65 pgs: 65 active+clean; 202 MiB data, 953 MiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 476 op/s 2024-09-13T18:30:16.342 INFO:tasks.workunit.client.0.smithi038.stdout:4/52: dwrite d2/fe [0,4194304] 0 2024-09-13T18:30:16.342 INFO:tasks.workunit.client.0.smithi038.stdout:4/53: readlink d2/d4/l9 0 2024-09-13T18:30:16.360 INFO:tasks.workunit.client.0.smithi038.stdout:4/54: dwrite d2/fe [0,4194304] 0 2024-09-13T18:30:16.362 INFO:tasks.workunit.client.1.smithi149.stdout:4/63: truncate f9 1334327 0 2024-09-13T18:30:16.363 INFO:tasks.workunit.client.1.smithi149.stdout:0/18: mknod d1/d2/c3 0 2024-09-13T18:30:16.369 INFO:tasks.workunit.client.0.smithi038.stdout:6/53: write dd/f13 [5164022,86516] 0 2024-09-13T18:30:16.369 INFO:tasks.workunit.client.0.smithi038.stdout:6/54: write f5 [9422181,65029] 0 2024-09-13T18:30:16.374 INFO:tasks.workunit.client.0.smithi038.stdout:6/55: mknod dd/c17 0 2024-09-13T18:30:16.381 INFO:tasks.workunit.client.0.smithi038.stdout:4/55: dwrite d2/fe [0,4194304] 0 2024-09-13T18:30:16.381 INFO:tasks.workunit.client.0.smithi038.stdout:4/56: write d2/d4/f5 [2042935,53545] 0 2024-09-13T18:30:16.381 INFO:tasks.workunit.client.0.smithi038.stdout:4/57: truncate d2/d4/f5 8731915 0 2024-09-13T18:30:16.382 INFO:tasks.workunit.client.0.smithi038.stdout:4/58: fdatasync d2/fe 0 2024-09-13T18:30:16.382 INFO:tasks.workunit.client.0.smithi038.stdout:4/59: chown d2/d4/dc/da/fd 14028764 1 2024-09-13T18:30:16.382 INFO:tasks.workunit.client.0.smithi038.stdout:4/60: rename d2 to d2/d4/dc/da/d10/d11 22 2024-09-13T18:30:16.382 INFO:tasks.workunit.client.0.smithi038.stdout:4/61: fdatasync d2/d4/dc/da/fd 0 2024-09-13T18:30:16.382 INFO:tasks.workunit.client.0.smithi038.stdout:1/39: getdents . 0 2024-09-13T18:30:16.385 INFO:tasks.workunit.client.0.smithi038.stdout:4/62: creat d2/d4/dc/d8/f12 x:0 0 0 2024-09-13T18:30:16.388 INFO:tasks.workunit.client.0.smithi038.stdout:1/40: creat fb x:0 0 0 2024-09-13T18:30:16.388 INFO:tasks.workunit.client.0.smithi038.stdout:1/41: rmdir - no directory 2024-09-13T18:30:16.390 INFO:tasks.workunit.client.0.smithi038.stdout:4/63: creat d2/d4/f13 x:0 0 0 2024-09-13T18:30:16.395 INFO:tasks.workunit.client.0.smithi038.stdout:4/64: creat d2/df/f14 x:0 0 0 2024-09-13T18:30:16.395 INFO:tasks.workunit.client.0.smithi038.stdout:4/65: truncate d2/d4/dc/d8/f12 858009 0 2024-09-13T18:30:16.396 INFO:tasks.workunit.client.1.smithi149.stdout:2/24: unlink l5 0 2024-09-13T18:30:16.397 INFO:tasks.workunit.client.1.smithi149.stdout:3/49: link d1/d4/da/lf d1/d4/da/l10 0 2024-09-13T18:30:16.399 INFO:tasks.workunit.client.0.smithi038.stdout:4/66: mknod d2/d4/dc/d8/c15 0 2024-09-13T18:30:16.399 INFO:tasks.workunit.client.0.smithi038.stdout:4/67: chown d2/d4/dc/da/fd 194463 1 2024-09-13T18:30:16.401 INFO:tasks.workunit.client.1.smithi149.stdout:1/24: mkdir d9 0 2024-09-13T18:30:16.401 INFO:tasks.workunit.client.1.smithi149.stdout:1/25: write f2 [170820,127051] 0 2024-09-13T18:30:16.402 INFO:tasks.workunit.client.0.smithi038.stdout:4/68: creat d2/d4/dc/f16 x:0 0 0 2024-09-13T18:30:16.402 INFO:tasks.workunit.client.0.smithi038.stdout:4/69: readlink d2/d4/l9 0 2024-09-13T18:30:16.402 INFO:tasks.workunit.client.0.smithi038.stdout:4/70: rename d2/d4/dc/da/d10 to d2/d4/dc/da/d10/d17 22 2024-09-13T18:30:16.405 INFO:tasks.workunit.client.1.smithi149.stdout:8/12: unlink f1 0 2024-09-13T18:30:16.406 INFO:tasks.workunit.client.1.smithi149.stdout:8/13: rename d2 to d2/d3 22 2024-09-13T18:30:16.406 INFO:tasks.workunit.client.1.smithi149.stdout:8/14: stat d2 0 2024-09-13T18:30:16.406 INFO:tasks.workunit.client.1.smithi149.stdout:3/50: dread d1/fb [0,4194304] 0 2024-09-13T18:30:16.406 INFO:tasks.workunit.client.1.smithi149.stdout:3/51: write d1/d4/fd [1439612,224] 0 2024-09-13T18:30:16.408 INFO:tasks.workunit.client.1.smithi149.stdout:5/14: getdents d3 0 2024-09-13T18:30:16.412 INFO:tasks.workunit.client.0.smithi038.stdout:6/56: dwrite f5 [0,4194304] 0 2024-09-13T18:30:16.413 INFO:tasks.workunit.client.1.smithi149.stdout:8/15: mknod d2/c4 0 2024-09-13T18:30:16.413 INFO:tasks.workunit.client.1.smithi149.stdout:3/52: creat d1/f11 x:0 0 0 2024-09-13T18:30:16.415 INFO:tasks.workunit.client.1.smithi149.stdout:5/15: creat d3/f5 x:0 0 0 2024-09-13T18:30:16.416 INFO:tasks.workunit.client.1.smithi149.stdout:8/16: rmdir d2 39 2024-09-13T18:30:16.417 INFO:tasks.workunit.client.1.smithi149.stdout:3/53: stat d1/d4/da/lf 0 2024-09-13T18:30:16.422 INFO:tasks.workunit.client.1.smithi149.stdout:8/17: mknod d2/c5 0 2024-09-13T18:30:16.424 INFO:tasks.workunit.client.1.smithi149.stdout:5/16: mknod d3/c6 0 2024-09-13T18:30:16.424 INFO:tasks.workunit.client.1.smithi149.stdout:5/17: dread - d3/f5 zero size 2024-09-13T18:30:16.424 INFO:tasks.workunit.client.1.smithi149.stdout:5/18: write f1 [445137,53275] 0 2024-09-13T18:30:16.424 INFO:tasks.workunit.client.1.smithi149.stdout:8/18: creat d2/f6 x:0 0 0 2024-09-13T18:30:16.425 INFO:tasks.workunit.client.1.smithi149.stdout:5/19: creat d3/f7 x:0 0 0 2024-09-13T18:30:16.427 INFO:tasks.workunit.client.1.smithi149.stdout:2/25: dwrite f1 [0,4194304] 0 2024-09-13T18:30:16.428 INFO:tasks.workunit.client.0.smithi038.stdout:4/71: dwrite d2/d4/dc/d8/f12 [0,4194304] 0 2024-09-13T18:30:16.429 INFO:tasks.workunit.client.1.smithi149.stdout:5/20: dread d3/f4 [0,4194304] 0 2024-09-13T18:30:16.440 INFO:tasks.workunit.client.0.smithi038.stdout:1/42: dwrite f4 [0,4194304] 0 2024-09-13T18:30:16.442 INFO:tasks.workunit.client.1.smithi149.stdout:3/54: fsync d1/d4/fd 0 2024-09-13T18:30:16.442 INFO:tasks.workunit.client.1.smithi149.stdout:2/26: dread f4 [0,4194304] 0 2024-09-13T18:30:16.444 INFO:tasks.workunit.client.1.smithi149.stdout:3/55: mkdir d1/d12 0 2024-09-13T18:30:16.444 INFO:tasks.workunit.client.1.smithi149.stdout:1/26: dwrite f5 [0,4194304] 0 2024-09-13T18:30:16.445 INFO:tasks.workunit.client.0.smithi038.stdout:6/57: dwrite dd/f16 [0,4194304] 0 2024-09-13T18:30:16.445 INFO:tasks.workunit.client.0.smithi038.stdout:6/58: chown f6 29536918 1 2024-09-13T18:30:16.446 INFO:tasks.workunit.client.0.smithi038.stdout:1/43: rename fa to fc 0 2024-09-13T18:30:16.449 INFO:tasks.workunit.client.0.smithi038.stdout:4/72: dwrite d2/df/f14 [0,4194304] 0 2024-09-13T18:30:16.450 INFO:tasks.workunit.client.1.smithi149.stdout:2/27: creat f6 x:0 0 0 2024-09-13T18:30:16.450 INFO:tasks.workunit.client.1.smithi149.stdout:2/28: creat f7 x:0 0 0 2024-09-13T18:30:16.450 INFO:tasks.workunit.client.1.smithi149.stdout:2/29: read - f6 zero size 2024-09-13T18:30:16.450 INFO:tasks.workunit.client.1.smithi149.stdout:2/30: readlink l3 0 2024-09-13T18:30:16.450 INFO:tasks.workunit.client.1.smithi149.stdout:1/27: fsync f3 0 2024-09-13T18:30:16.450 INFO:tasks.workunit.client.1.smithi149.stdout:3/56: dread d1/fb [0,4194304] 0 2024-09-13T18:30:16.452 INFO:tasks.workunit.client.0.smithi038.stdout:6/59: mkdir dd/de/d18 0 2024-09-13T18:30:16.454 INFO:tasks.workunit.client.1.smithi149.stdout:1/28: mknod d9/ca 0 2024-09-13T18:30:16.456 INFO:tasks.workunit.client.1.smithi149.stdout:3/57: symlink d1/d4/da/l13 0 2024-09-13T18:30:16.459 INFO:tasks.workunit.client.1.smithi149.stdout:1/29: rename l8 to d9/lb 0 2024-09-13T18:30:16.462 INFO:tasks.workunit.client.0.smithi038.stdout:6/60: symlink dd/l19 0 2024-09-13T18:30:16.464 INFO:tasks.workunit.client.1.smithi149.stdout:1/30: link c4 d9/cc 0 2024-09-13T18:30:16.466 INFO:tasks.workunit.client.0.smithi038.stdout:6/61: rename dd/f10 to dd/de/f1a 0 2024-09-13T18:30:16.467 INFO:tasks.workunit.client.1.smithi149.stdout:1/31: creat d9/fd x:0 0 0 2024-09-13T18:30:16.468 INFO:tasks.workunit.client.1.smithi149.stdout:1/32: chown f2 5794 1 2024-09-13T18:30:16.468 INFO:tasks.workunit.client.1.smithi149.stdout:1/33: read - d9/fd zero size 2024-09-13T18:30:16.468 INFO:tasks.workunit.client.1.smithi149.stdout:1/34: write d9/fd [522492,60927] 0 2024-09-13T18:30:16.468 INFO:tasks.workunit.client.1.smithi149.stdout:1/35: fsync f2 0 2024-09-13T18:30:16.468 INFO:tasks.workunit.client.0.smithi038.stdout:4/73: dwrite d2/d4/dc/f16 [0,4194304] 0 2024-09-13T18:30:16.469 INFO:tasks.workunit.client.0.smithi038.stdout:6/62: rmdir dd/de/d18 0 2024-09-13T18:30:16.475 INFO:tasks.workunit.client.1.smithi149.stdout:2/31: dwrite f1 [4194304,4194304] 0 2024-09-13T18:30:16.477 INFO:tasks.workunit.client.1.smithi149.stdout:2/32: rename f0 to f8 0 2024-09-13T18:30:16.481 INFO:tasks.workunit.client.1.smithi149.stdout:1/36: write f5 [2119678,20617] 0 2024-09-13T18:30:16.483 INFO:tasks.workunit.client.1.smithi149.stdout:1/37: mkdir d9/de 0 2024-09-13T18:30:16.483 INFO:tasks.workunit.client.0.smithi038.stdout:6/63: write dd/f13 [1736124,71106] 0 2024-09-13T18:30:16.484 INFO:tasks.workunit.client.1.smithi149.stdout:1/38: rmdir d9/de 0 2024-09-13T18:30:16.491 INFO:tasks.workunit.client.0.smithi038.stdout:4/74: dwrite d2/d4/dc/f16 [0,4194304] 0 2024-09-13T18:30:16.493 INFO:tasks.workunit.client.0.smithi038.stdout:4/75: rename d2/df/f14 to d2/d4/dc/f18 0 2024-09-13T18:30:16.504 INFO:tasks.workunit.client.0.smithi038.stdout:4/76: write d2/d4/dc/f18 [3313826,91470] 0 2024-09-13T18:30:16.508 INFO:tasks.workunit.client.0.smithi038.stdout:6/64: dwrite dd/f11 [0,4194304] 0 2024-09-13T18:30:16.508 INFO:tasks.workunit.client.0.smithi038.stdout:6/65: write fa [4787443,48357] 0 2024-09-13T18:30:16.509 INFO:tasks.workunit.client.0.smithi038.stdout:6/66: symlink dd/l1b 0 2024-09-13T18:30:16.509 INFO:tasks.workunit.client.0.smithi038.stdout:6/67: write fa [2612223,2360] 0 2024-09-13T18:30:16.509 INFO:tasks.workunit.client.0.smithi038.stdout:6/68: rmdir dd/de 39 2024-09-13T18:30:16.518 INFO:tasks.workunit.client.0.smithi038.stdout:6/69: fdatasync fa 0 2024-09-13T18:30:16.519 INFO:tasks.workunit.client.1.smithi149.stdout:1/39: dwrite f5 [0,4194304] 0 2024-09-13T18:30:16.541 INFO:tasks.workunit.client.1.smithi149.stdout:9/6: sync 2024-09-13T18:30:16.541 INFO:tasks.workunit.client.1.smithi149.stdout:7/15: sync 2024-09-13T18:30:16.541 INFO:tasks.workunit.client.1.smithi149.stdout:6/6: sync 2024-09-13T18:30:16.541 INFO:tasks.workunit.client.1.smithi149.stdout:6/7: rmdir - no directory 2024-09-13T18:30:16.541 INFO:tasks.workunit.client.1.smithi149.stdout:6/8: read - no filename 2024-09-13T18:30:16.541 INFO:tasks.workunit.client.1.smithi149.stdout:6/9: write - no filename 2024-09-13T18:30:16.541 INFO:tasks.workunit.client.1.smithi149.stdout:7/16: creat f5 x:0 0 0 2024-09-13T18:30:16.542 INFO:tasks.workunit.client.1.smithi149.stdout:9/7: rename d0/f1 to d0/f2 0 2024-09-13T18:30:16.545 INFO:tasks.workunit.client.1.smithi149.stdout:6/10: creat f0 x:0 0 0 2024-09-13T18:30:16.545 INFO:tasks.workunit.client.1.smithi149.stdout:9/8: symlink d0/l3 0 2024-09-13T18:30:16.545 INFO:tasks.workunit.client.1.smithi149.stdout:9/9: creat d0/f4 x:0 0 0 2024-09-13T18:30:16.545 INFO:tasks.workunit.client.1.smithi149.stdout:9/10: creat d0/f5 x:0 0 0 2024-09-13T18:30:16.546 INFO:tasks.workunit.client.1.smithi149.stdout:8/19: fsync d2/f6 0 2024-09-13T18:30:16.546 INFO:tasks.workunit.client.1.smithi149.stdout:5/21: fsync d3/f7 0 2024-09-13T18:30:16.546 INFO:tasks.workunit.client.1.smithi149.stdout:8/20: dread - d2/f6 zero size 2024-09-13T18:30:16.546 INFO:tasks.workunit.client.1.smithi149.stdout:8/21: dread - d2/f6 zero size 2024-09-13T18:30:16.546 INFO:tasks.workunit.client.1.smithi149.stdout:8/22: truncate d2/f6 160006 0 2024-09-13T18:30:16.585 INFO:tasks.workunit.client.1.smithi149.stdout:6/11: dwrite f0 [0,4194304] 0 2024-09-13T18:30:16.591 INFO:tasks.workunit.client.1.smithi149.stdout:6/12: dread f0 [0,4194304] 0 2024-09-13T18:30:16.592 INFO:tasks.workunit.client.1.smithi149.stdout:6/13: creat f1 x:0 0 0 2024-09-13T18:30:16.594 INFO:tasks.workunit.client.1.smithi149.stdout:6/14: write f0 [3252802,97832] 0 2024-09-13T18:30:16.594 INFO:tasks.workunit.client.1.smithi149.stdout:6/15: dread - f1 zero size 2024-09-13T18:30:16.595 INFO:tasks.workunit.client.1.smithi149.stdout:6/16: truncate f1 300672 0 2024-09-13T18:30:16.634 INFO:tasks.workunit.client.1.smithi149.stdout:7/17: dwrite f0 [0,4194304] 0 2024-09-13T18:30:16.634 INFO:tasks.workunit.client.1.smithi149.stdout:7/18: fsync f4 0 2024-09-13T18:30:16.634 INFO:tasks.workunit.client.1.smithi149.stdout:7/19: truncate f5 841551 0 2024-09-13T18:30:16.637 INFO:tasks.workunit.client.1.smithi149.stdout:6/17: rename f0 to f2 0 2024-09-13T18:30:16.638 INFO:tasks.workunit.client.1.smithi149.stdout:5/22: dwrite d3/f4 [0,4194304] 0 2024-09-13T18:30:16.638 INFO:tasks.workunit.client.1.smithi149.stdout:8/23: dwrite d2/f6 [0,4194304] 0 2024-09-13T18:30:16.638 INFO:tasks.workunit.client.1.smithi149.stdout:7/20: mknod c6 0 2024-09-13T18:30:16.639 INFO:tasks.workunit.client.1.smithi149.stdout:6/18: symlink l3 0 2024-09-13T18:30:16.639 INFO:tasks.workunit.client.1.smithi149.stdout:6/19: readlink l3 0 2024-09-13T18:30:16.640 INFO:tasks.workunit.client.1.smithi149.stdout:6/20: chown f1 34892137 1 2024-09-13T18:30:16.644 INFO:tasks.workunit.client.1.smithi149.stdout:3/58: getdents d1/d4/da 0 2024-09-13T18:30:16.645 INFO:tasks.workunit.client.1.smithi149.stdout:3/59: getdents d1/d4/da 0 2024-09-13T18:30:16.645 INFO:tasks.workunit.client.1.smithi149.stdout:8/24: read d2/f6 [4040791,99376] 0 2024-09-13T18:30:16.650 INFO:tasks.workunit.client.1.smithi149.stdout:7/21: mkdir d7 0 2024-09-13T18:30:16.650 INFO:tasks.workunit.client.1.smithi149.stdout:7/22: chown c6 13 1 2024-09-13T18:30:16.650 INFO:tasks.workunit.client.1.smithi149.stdout:1/40: fsync d9/fd 0 2024-09-13T18:30:16.651 INFO:tasks.workunit.client.1.smithi149.stdout:6/21: mknod c4 0 2024-09-13T18:30:16.651 INFO:tasks.workunit.client.1.smithi149.stdout:6/22: write f1 [962546,111382] 0 2024-09-13T18:30:16.657 INFO:tasks.workunit.client.1.smithi149.stdout:1/41: rmdir d9 39 2024-09-13T18:30:16.657 INFO:tasks.workunit.client.1.smithi149.stdout:1/42: chown c7 404 1 2024-09-13T18:30:16.658 INFO:tasks.workunit.client.1.smithi149.stdout:7/23: write f0 [1106063,96274] 0 2024-09-13T18:30:16.658 INFO:tasks.workunit.client.1.smithi149.stdout:7/24: truncate f3 954317 0 2024-09-13T18:30:16.658 INFO:tasks.workunit.client.1.smithi149.stdout:7/25: dread - f4 zero size 2024-09-13T18:30:16.659 INFO:tasks.workunit.client.1.smithi149.stdout:1/43: symlink d9/lf 0 2024-09-13T18:30:16.662 INFO:tasks.workunit.client.1.smithi149.stdout:8/25: dwrite d2/f6 [0,4194304] 0 2024-09-13T18:30:16.662 INFO:tasks.workunit.client.1.smithi149.stdout:1/44: read f3 [29612,71113] 0 2024-09-13T18:30:16.662 INFO:tasks.workunit.client.1.smithi149.stdout:1/45: write d9/fd [816504,97955] 0 2024-09-13T18:30:16.665 INFO:tasks.workunit.client.1.smithi149.stdout:1/46: mkdir d9/d10 0 2024-09-13T18:30:16.666 INFO:tasks.workunit.client.1.smithi149.stdout:1/47: creat d9/f11 x:0 0 0 2024-09-13T18:30:16.666 INFO:tasks.workunit.client.1.smithi149.stdout:1/48: readlink d9/lb 0 2024-09-13T18:30:16.667 INFO:tasks.workunit.client.1.smithi149.stdout:7/26: dread f1 [0,4194304] 0 2024-09-13T18:30:16.667 INFO:tasks.workunit.client.1.smithi149.stdout:9/11: getdents d0 0 2024-09-13T18:30:16.667 INFO:tasks.workunit.client.1.smithi149.stdout:9/12: chown d0 6 1 2024-09-13T18:30:16.668 INFO:tasks.workunit.client.1.smithi149.stdout:7/27: rename f0 to d7/f8 0 2024-09-13T18:30:16.670 INFO:tasks.workunit.client.1.smithi149.stdout:9/13: rename d0/l3 to d0/l6 0 2024-09-13T18:30:16.670 INFO:tasks.workunit.client.1.smithi149.stdout:9/14: write d0/f4 [43779,40172] 0 2024-09-13T18:30:16.670 INFO:tasks.workunit.client.0.smithi038.stdout:4/77: dwrite d2/d4/dc/f16 [4194304,4194304] 0 2024-09-13T18:30:16.671 INFO:tasks.workunit.client.1.smithi149.stdout:7/28: mkdir d7/d9 0 2024-09-13T18:30:16.672 INFO:tasks.workunit.client.1.smithi149.stdout:9/15: rename d0/f2 to d0/f7 0 2024-09-13T18:30:16.675 INFO:tasks.workunit.client.1.smithi149.stdout:7/29: rename f4 to d7/d9/fa 0 2024-09-13T18:30:16.677 INFO:tasks.workunit.client.1.smithi149.stdout:9/16: mknod d0/c8 0 2024-09-13T18:30:16.677 INFO:tasks.workunit.client.1.smithi149.stdout:9/17: readlink d0/l6 0 2024-09-13T18:30:16.681 INFO:tasks.workunit.client.1.smithi149.stdout:0/19: sync 2024-09-13T18:30:16.681 INFO:tasks.workunit.client.1.smithi149.stdout:4/64: sync 2024-09-13T18:30:16.681 INFO:tasks.workunit.client.1.smithi149.stdout:0/20: stat d1 0 2024-09-13T18:30:16.681 INFO:tasks.workunit.client.1.smithi149.stdout:0/21: read f0 [790333,67433] 0 2024-09-13T18:30:16.681 INFO:tasks.workunit.client.1.smithi149.stdout:0/22: write f0 [2003372,117119] 0 2024-09-13T18:30:16.681 INFO:tasks.workunit.client.1.smithi149.stdout:2/33: sync 2024-09-13T18:30:16.684 INFO:tasks.workunit.client.1.smithi149.stdout:0/23: getdents d1 0 2024-09-13T18:30:16.684 INFO:tasks.workunit.client.1.smithi149.stdout:0/24: write f0 [2909518,125633] 0 2024-09-13T18:30:16.689 INFO:tasks.workunit.client.1.smithi149.stdout:8/26: dwrite d2/f6 [0,4194304] 0 2024-09-13T18:30:16.690 INFO:tasks.workunit.client.1.smithi149.stdout:1/49: dwrite f3 [0,4194304] 0 2024-09-13T18:30:16.690 INFO:tasks.workunit.client.1.smithi149.stdout:1/50: fsync d9/f11 0 2024-09-13T18:30:16.690 INFO:tasks.workunit.client.0.smithi038.stdout:4/78: write d2/d4/dc/d8/f12 [3979072,117206] 0 2024-09-13T18:30:16.690 INFO:tasks.workunit.client.0.smithi038.stdout:4/79: chown d2/d4/f5 19 1 2024-09-13T18:30:16.691 INFO:tasks.workunit.client.1.smithi149.stdout:8/27: unlink c0 0 2024-09-13T18:30:16.694 INFO:tasks.workunit.client.0.smithi038.stdout:4/80: rename d2/fe to d2/f19 0 2024-09-13T18:30:16.695 INFO:tasks.workunit.client.1.smithi149.stdout:4/65: dread f4 [0,4194304] 0 2024-09-13T18:30:16.695 INFO:tasks.workunit.client.1.smithi149.stdout:4/66: write fc [4476461,104722] 0 2024-09-13T18:30:16.695 INFO:tasks.workunit.client.1.smithi149.stdout:4/67: chown df/f18 14 1 2024-09-13T18:30:16.695 INFO:tasks.workunit.client.1.smithi149.stdout:4/68: dread - fe zero size 2024-09-13T18:30:16.696 INFO:tasks.workunit.client.1.smithi149.stdout:4/69: chown df/d11/d12/d17 21 1 2024-09-13T18:30:16.696 INFO:tasks.workunit.client.1.smithi149.stdout:1/51: symlink d9/d10/l12 0 2024-09-13T18:30:16.696 INFO:tasks.workunit.client.1.smithi149.stdout:8/28: symlink d2/l7 0 2024-09-13T18:30:16.698 INFO:tasks.workunit.client.0.smithi038.stdout:4/81: link d2/d4/f5 d2/d4/dc/f1a 0 2024-09-13T18:30:16.698 INFO:tasks.workunit.client.0.smithi038.stdout:4/82: fdatasync d2/d4/dc/f1a 0 2024-09-13T18:30:16.698 INFO:tasks.workunit.client.0.smithi038.stdout:4/83: stat d2/d4/dc/f1a 0 2024-09-13T18:30:16.700 INFO:tasks.workunit.client.1.smithi149.stdout:1/52: rename d9/ca to d9/d10/c13 0 2024-09-13T18:30:16.700 INFO:tasks.workunit.client.1.smithi149.stdout:1/53: chown f2 3 1 2024-09-13T18:30:16.701 INFO:tasks.workunit.client.1.smithi149.stdout:8/29: symlink d2/l8 0 2024-09-13T18:30:16.701 INFO:tasks.workunit.client.1.smithi149.stdout:8/30: creat d2/f9 x:0 0 0 2024-09-13T18:30:16.701 INFO:tasks.workunit.client.1.smithi149.stdout:1/54: mknod d9/c14 0 2024-09-13T18:30:16.702 INFO:tasks.workunit.client.1.smithi149.stdout:0/25: dread f0 [0,4194304] 0 2024-09-13T18:30:16.702 INFO:tasks.workunit.client.1.smithi149.stdout:8/31: symlink d2/la 0 2024-09-13T18:30:16.703 INFO:tasks.workunit.client.1.smithi149.stdout:1/55: mkdir d9/d15 0 2024-09-13T18:30:16.703 INFO:tasks.workunit.client.1.smithi149.stdout:8/32: symlink d2/lb 0 2024-09-13T18:30:16.704 INFO:tasks.workunit.client.1.smithi149.stdout:1/56: mknod d9/d15/c16 0 2024-09-13T18:30:16.705 INFO:tasks.workunit.client.1.smithi149.stdout:4/70: dread f4 [0,4194304] 0 2024-09-13T18:30:16.705 INFO:tasks.workunit.client.1.smithi149.stdout:4/71: stat f4 0 2024-09-13T18:30:16.708 INFO:tasks.workunit.client.0.smithi038.stdout:4/84: fsync d2/d4/dc/f1a 0 2024-09-13T18:30:16.708 INFO:tasks.workunit.client.0.smithi038.stdout:4/85: fdatasync d2/d4/dc/f18 0 2024-09-13T18:30:16.711 INFO:tasks.workunit.client.1.smithi149.stdout:9/18: dwrite d0/f7 [0,4194304] 0 2024-09-13T18:30:16.712 INFO:tasks.workunit.client.1.smithi149.stdout:9/19: chown d0/f4 23927 1 2024-09-13T18:30:16.714 INFO:tasks.workunit.client.1.smithi149.stdout:2/34: dwrite f7 [0,4194304] 0 2024-09-13T18:30:16.714 INFO:tasks.workunit.client.1.smithi149.stdout:9/20: getdents d0 0 2024-09-13T18:30:16.715 INFO:tasks.workunit.client.1.smithi149.stdout:1/57: dread d9/fd [0,4194304] 0 2024-09-13T18:30:16.717 INFO:tasks.workunit.client.1.smithi149.stdout:2/35: mknod c9 0 2024-09-13T18:30:16.717 INFO:tasks.workunit.client.1.smithi149.stdout:2/36: creat fa x:0 0 0 2024-09-13T18:30:16.717 INFO:tasks.workunit.client.1.smithi149.stdout:9/21: creat d0/f9 x:0 0 0 2024-09-13T18:30:16.718 INFO:tasks.workunit.client.1.smithi149.stdout:9/22: creat d0/fa x:0 0 0 2024-09-13T18:30:16.718 INFO:tasks.workunit.client.1.smithi149.stdout:9/23: dread - d0/fa zero size 2024-09-13T18:30:16.718 INFO:tasks.workunit.client.1.smithi149.stdout:9/24: dread - d0/f9 zero size 2024-09-13T18:30:16.718 INFO:tasks.workunit.client.0.smithi038.stdout:4/86: dread d2/d4/dc/f1a [0,4194304] 0 2024-09-13T18:30:16.718 INFO:tasks.workunit.client.1.smithi149.stdout:1/58: symlink d9/l17 0 2024-09-13T18:30:16.720 INFO:tasks.workunit.client.1.smithi149.stdout:2/37: mkdir db 0 2024-09-13T18:30:16.723 INFO:tasks.workunit.client.1.smithi149.stdout:1/59: symlink d9/l18 0 2024-09-13T18:30:16.723 INFO:tasks.workunit.client.1.smithi149.stdout:2/38: rename f7 to db/fc 0 2024-09-13T18:30:16.726 INFO:tasks.workunit.client.1.smithi149.stdout:2/39: rename f2 to db/fd 0 2024-09-13T18:30:16.726 INFO:tasks.workunit.client.1.smithi149.stdout:2/40: dread - fa zero size 2024-09-13T18:30:16.726 INFO:tasks.workunit.client.1.smithi149.stdout:2/41: fdatasync f6 0 2024-09-13T18:30:16.738 INFO:tasks.workunit.client.0.smithi038.stdout:4/87: dread d2/f19 [0,4194304] 0 2024-09-13T18:30:16.740 INFO:tasks.workunit.client.0.smithi038.stdout:4/88: rename d2/d4/dc/da to d2/df/d1b 0 2024-09-13T18:30:16.741 INFO:tasks.workunit.client.0.smithi038.stdout:4/89: rename d2/d4/f5 to d2/df/d1b/d10/f1c 0 2024-09-13T18:30:16.747 INFO:tasks.workunit.client.1.smithi149.stdout:0/26: dwrite f0 [0,4194304] 0 2024-09-13T18:30:16.747 INFO:tasks.workunit.client.1.smithi149.stdout:8/33: dwrite d2/f6 [0,4194304] 0 2024-09-13T18:30:16.747 INFO:tasks.workunit.client.1.smithi149.stdout:8/34: creat d2/fc x:0 0 0 2024-09-13T18:30:16.748 INFO:tasks.workunit.client.1.smithi149.stdout:4/72: dwrite fe [0,4194304] 0 2024-09-13T18:30:16.748 INFO:tasks.workunit.client.1.smithi149.stdout:1/60: dwrite f3 [0,4194304] 0 2024-09-13T18:30:16.748 INFO:tasks.workunit.client.1.smithi149.stdout:4/73: write df/d11/f16 [419211,19390] 0 2024-09-13T18:30:16.748 INFO:tasks.workunit.client.1.smithi149.stdout:4/74: chown fc 25074154 1 2024-09-13T18:30:16.749 INFO:tasks.workunit.client.1.smithi149.stdout:0/27: creat d1/d2/f4 x:0 0 0 2024-09-13T18:30:16.750 INFO:tasks.workunit.client.1.smithi149.stdout:8/35: symlink d2/ld 0 2024-09-13T18:30:16.750 INFO:tasks.workunit.client.1.smithi149.stdout:8/36: truncate d2/fc 338293 0 2024-09-13T18:30:16.750 INFO:tasks.workunit.client.1.smithi149.stdout:8/37: creat d2/fe x:0 0 0 2024-09-13T18:30:16.754 INFO:tasks.workunit.client.1.smithi149.stdout:8/38: dread d2/fc [0,4194304] 0 2024-09-13T18:30:16.754 INFO:tasks.workunit.client.1.smithi149.stdout:1/61: unlink c7 0 2024-09-13T18:30:16.754 INFO:tasks.workunit.client.1.smithi149.stdout:1/62: readlink d9/d10/l12 0 2024-09-13T18:30:16.754 INFO:tasks.workunit.client.1.smithi149.stdout:1/63: dread - d9/f11 zero size 2024-09-13T18:30:16.755 INFO:tasks.workunit.client.1.smithi149.stdout:0/28: rename f0 to d1/f5 0 2024-09-13T18:30:16.757 INFO:tasks.workunit.client.1.smithi149.stdout:8/39: mknod d2/cf 0 2024-09-13T18:30:16.757 INFO:tasks.workunit.client.1.smithi149.stdout:8/40: dread - d2/fe zero size 2024-09-13T18:30:16.758 INFO:tasks.workunit.client.1.smithi149.stdout:8/41: symlink d2/l10 0 2024-09-13T18:30:16.758 INFO:tasks.workunit.client.1.smithi149.stdout:8/42: dread - d2/f9 zero size 2024-09-13T18:30:16.760 INFO:tasks.workunit.client.1.smithi149.stdout:8/43: rename d2/lb to d2/l11 0 2024-09-13T18:30:16.761 INFO:tasks.workunit.client.1.smithi149.stdout:9/25: getdents d0 0 2024-09-13T18:30:16.762 INFO:tasks.workunit.client.1.smithi149.stdout:8/44: mkdir d2/d12 0 2024-09-13T18:30:16.762 INFO:tasks.workunit.client.1.smithi149.stdout:8/45: chown d2/d12 9636616 1 2024-09-13T18:30:16.764 INFO:tasks.workunit.client.1.smithi149.stdout:9/26: mknod d0/cb 0 2024-09-13T18:30:16.764 INFO:tasks.workunit.client.1.smithi149.stdout:9/27: write d0/fa [182558,14840] 0 2024-09-13T18:30:16.764 INFO:tasks.workunit.client.1.smithi149.stdout:2/42: getdents db 0 2024-09-13T18:30:16.765 INFO:tasks.workunit.client.1.smithi149.stdout:9/28: mknod d0/cc 0 2024-09-13T18:30:16.767 INFO:tasks.workunit.client.1.smithi149.stdout:9/29: mkdir d0/dd 0 2024-09-13T18:30:16.767 INFO:tasks.workunit.client.1.smithi149.stdout:9/30: read - d0/f9 zero size 2024-09-13T18:30:16.769 INFO:tasks.workunit.client.1.smithi149.stdout:0/29: dread d1/f5 [0,4194304] 0 2024-09-13T18:30:16.770 INFO:tasks.workunit.client.1.smithi149.stdout:9/31: rename d0/f5 to d0/fe 0 2024-09-13T18:30:16.772 INFO:tasks.workunit.client.1.smithi149.stdout:4/75: dwrite fe [0,4194304] 0 2024-09-13T18:30:16.772 INFO:tasks.workunit.client.1.smithi149.stdout:4/76: creat df/f19 x:0 0 0 2024-09-13T18:30:16.772 INFO:tasks.workunit.client.0.smithi038.stdout:4/90: rename d2/df/d1b/d10/f1c to d2/d4/f1d 0 2024-09-13T18:30:16.773 INFO:tasks.workunit.client.1.smithi149.stdout:1/64: dwrite d9/fd [0,4194304] 0 2024-09-13T18:30:16.773 INFO:tasks.workunit.client.1.smithi149.stdout:1/65: chown f2 112171689 1 2024-09-13T18:30:16.773 INFO:tasks.workunit.client.1.smithi149.stdout:0/30: unlink d1/d2/f4 0 2024-09-13T18:30:16.773 INFO:tasks.workunit.client.1.smithi149.stdout:0/31: truncate d1/f5 4718582 0 2024-09-13T18:30:16.774 INFO:tasks.workunit.client.1.smithi149.stdout:9/32: rename d0/f7 to d0/ff 0 2024-09-13T18:30:16.775 INFO:tasks.workunit.client.0.smithi038.stdout:4/91: link d2/df/d1b/fd d2/d4/dc/f1e 0 2024-09-13T18:30:16.778 INFO:tasks.workunit.client.1.smithi149.stdout:0/32: write d1/f5 [1758633,120576] 0 2024-09-13T18:30:16.778 INFO:tasks.workunit.client.1.smithi149.stdout:4/77: creat df/d11/d12/d17/f1a x:0 0 0 2024-09-13T18:30:16.781 INFO:tasks.workunit.client.1.smithi149.stdout:8/46: dwrite d2/f6 [4194304,4194304] 0 2024-09-13T18:30:16.782 INFO:tasks.workunit.client.1.smithi149.stdout:4/78: unlink c8 0 2024-09-13T18:30:16.782 INFO:tasks.workunit.client.1.smithi149.stdout:4/79: readlink l3 0 2024-09-13T18:30:16.782 INFO:tasks.workunit.client.1.smithi149.stdout:4/80: chown lb 803123118 1 2024-09-13T18:30:16.784 INFO:tasks.workunit.client.1.smithi149.stdout:8/47: mkdir d2/d13 0 2024-09-13T18:30:16.784 INFO:tasks.workunit.client.1.smithi149.stdout:8/48: readlink d2/l11 0 2024-09-13T18:30:16.788 INFO:tasks.workunit.client.1.smithi149.stdout:8/49: unlink d2/f6 0 2024-09-13T18:30:16.788 INFO:tasks.workunit.client.1.smithi149.stdout:8/50: dread - d2/fe zero size 2024-09-13T18:30:16.788 INFO:tasks.workunit.client.1.smithi149.stdout:8/51: write d2/f9 [884183,126445] 0 2024-09-13T18:30:16.790 INFO:tasks.workunit.client.1.smithi149.stdout:8/52: link d2/c5 d2/d12/c14 0 2024-09-13T18:30:16.791 INFO:tasks.workunit.client.1.smithi149.stdout:8/53: fdatasync d2/fc 0 2024-09-13T18:30:16.794 INFO:tasks.workunit.client.1.smithi149.stdout:4/81: dread f4 [0,4194304] 0 2024-09-13T18:30:16.794 INFO:tasks.workunit.client.1.smithi149.stdout:4/82: chown df/f18 39017209 1 2024-09-13T18:30:16.799 INFO:tasks.workunit.client.1.smithi149.stdout:4/83: dread fc [0,4194304] 0 2024-09-13T18:30:16.799 INFO:tasks.workunit.client.1.smithi149.stdout:4/84: write fa [4273476,56530] 0 2024-09-13T18:30:16.806 INFO:tasks.workunit.client.1.smithi149.stdout:5/23: sync 2024-09-13T18:30:16.806 INFO:tasks.workunit.client.1.smithi149.stdout:3/60: sync 2024-09-13T18:30:16.806 INFO:tasks.workunit.client.1.smithi149.stdout:3/61: write d1/d4/fd [328789,12154] 0 2024-09-13T18:30:16.812 INFO:tasks.workunit.client.1.smithi149.stdout:3/62: fdatasync d1/d4/fd 0 2024-09-13T18:30:16.812 INFO:tasks.workunit.client.1.smithi149.stdout:3/63: dread - d1/f11 zero size 2024-09-13T18:30:16.812 INFO:tasks.workunit.client.1.smithi149.stdout:3/64: stat d1/d4/da/l13 0 2024-09-13T18:30:16.813 INFO:tasks.workunit.client.1.smithi149.stdout:3/65: creat d1/d4/da/f14 x:0 0 0 2024-09-13T18:30:16.813 INFO:tasks.workunit.client.1.smithi149.stdout:3/66: dread - d1/d4/da/f14 zero size 2024-09-13T18:30:16.817 INFO:tasks.workunit.client.1.smithi149.stdout:3/67: write d1/d4/fd [1056249,72125] 0 2024-09-13T18:30:16.817 INFO:tasks.workunit.client.1.smithi149.stdout:8/54: dread d2/f9 [0,4194304] 0 2024-09-13T18:30:16.817 INFO:tasks.workunit.client.1.smithi149.stdout:8/55: chown d2/ld 2825 1 2024-09-13T18:30:16.818 INFO:tasks.workunit.client.1.smithi149.stdout:3/68: mknod d1/d4/da/c15 0 2024-09-13T18:30:16.820 INFO:tasks.workunit.client.1.smithi149.stdout:1/66: dwrite f5 [0,4194304] 0 2024-09-13T18:30:16.820 INFO:tasks.workunit.client.1.smithi149.stdout:8/56: link d2/fc d2/f15 0 2024-09-13T18:30:16.820 INFO:tasks.workunit.client.1.smithi149.stdout:8/57: truncate d2/fe 185243 0 2024-09-13T18:30:16.821 INFO:tasks.workunit.client.1.smithi149.stdout:3/69: symlink d1/d4/l16 0 2024-09-13T18:30:16.821 INFO:tasks.workunit.client.1.smithi149.stdout:3/70: write d1/d4/da/f14 [565966,26902] 0 2024-09-13T18:30:16.821 INFO:tasks.workunit.client.1.smithi149.stdout:3/71: creat d1/d4/da/f17 x:0 0 0 2024-09-13T18:30:16.822 INFO:tasks.workunit.client.1.smithi149.stdout:8/58: creat d2/d12/f16 x:0 0 0 2024-09-13T18:30:16.823 INFO:tasks.workunit.client.1.smithi149.stdout:3/72: mknod d1/c18 0 2024-09-13T18:30:16.824 INFO:tasks.workunit.client.1.smithi149.stdout:3/73: write d1/d4/da/f17 [310473,112237] 0 2024-09-13T18:30:16.824 INFO:tasks.workunit.client.1.smithi149.stdout:3/74: fsync d1/fb 0 2024-09-13T18:30:16.824 INFO:tasks.workunit.client.1.smithi149.stdout:3/75: creat d1/f19 x:0 0 0 2024-09-13T18:30:16.824 INFO:tasks.workunit.client.1.smithi149.stdout:8/59: creat d2/d13/f17 x:0 0 0 2024-09-13T18:30:16.829 INFO:tasks.workunit.client.1.smithi149.stdout:8/60: mknod d2/d12/c18 0 2024-09-13T18:30:16.829 INFO:tasks.workunit.client.1.smithi149.stdout:8/61: chown d2/d12/c18 1048832691 1 2024-09-13T18:30:16.829 INFO:tasks.workunit.client.1.smithi149.stdout:8/62: read d2/fe [179310,106879] 0 2024-09-13T18:30:16.829 INFO:tasks.workunit.client.1.smithi149.stdout:8/63: fdatasync d2/f15 0 2024-09-13T18:30:16.830 INFO:tasks.workunit.client.1.smithi149.stdout:8/64: readlink d2/l7 0 2024-09-13T18:30:16.830 INFO:tasks.workunit.client.1.smithi149.stdout:8/65: symlink d2/d12/l19 0 2024-09-13T18:30:16.830 INFO:tasks.workunit.client.0.smithi038.stdout:4/92: dwrite d2/d4/f1d [4194304,4194304] 0 2024-09-13T18:30:16.832 INFO:tasks.workunit.client.1.smithi149.stdout:4/85: dwrite df/d11/f16 [0,4194304] 0 2024-09-13T18:30:16.832 INFO:tasks.workunit.client.1.smithi149.stdout:1/67: write d9/fd [880803,116956] 0 2024-09-13T18:30:16.833 INFO:tasks.workunit.client.1.smithi149.stdout:5/24: dwrite d3/f4 [0,4194304] 0 2024-09-13T18:30:16.837 INFO:tasks.workunit.client.1.smithi149.stdout:4/86: dread f9 [0,4194304] 0 2024-09-13T18:30:16.837 INFO:tasks.workunit.client.1.smithi149.stdout:5/25: dread f1 [0,4194304] 0 2024-09-13T18:30:16.837 INFO:tasks.workunit.client.1.smithi149.stdout:5/26: readlink l0 0 2024-09-13T18:30:16.838 INFO:tasks.workunit.client.1.smithi149.stdout:5/27: dread - d3/f7 zero size 2024-09-13T18:30:16.838 INFO:tasks.workunit.client.1.smithi149.stdout:3/76: dread d1/d4/fd [0,4194304] 0 2024-09-13T18:30:16.842 INFO:tasks.workunit.client.1.smithi149.stdout:5/28: rmdir d3 39 2024-09-13T18:30:16.848 INFO:tasks.workunit.client.0.smithi038.stdout:4/93: dread d2/d4/dc/d8/f12 [0,4194304] 0 2024-09-13T18:30:16.848 INFO:tasks.workunit.client.0.smithi038.stdout:4/94: chown d2/d4/dc/d8/c15 0 1 2024-09-13T18:30:16.849 INFO:tasks.workunit.client.1.smithi149.stdout:1/68: dread f3 [0,4194304] 0 2024-09-13T18:30:16.850 INFO:tasks.workunit.client.1.smithi149.stdout:7/30: sync 2024-09-13T18:30:16.850 INFO:tasks.workunit.client.1.smithi149.stdout:6/23: sync 2024-09-13T18:30:16.850 INFO:tasks.workunit.client.1.smithi149.stdout:7/31: dread - d7/d9/fa zero size 2024-09-13T18:30:16.851 INFO:tasks.workunit.client.1.smithi149.stdout:7/32: truncate d7/d9/fa 890730 0 2024-09-13T18:30:16.851 INFO:tasks.workunit.client.1.smithi149.stdout:7/33: write f1 [1910841,943] 0 2024-09-13T18:30:16.851 INFO:tasks.workunit.client.0.smithi038.stdout:4/95: symlink d2/d4/l1f 0 2024-09-13T18:30:16.851 INFO:tasks.workunit.client.0.smithi038.stdout:4/96: truncate d2/df/d1b/fd 1120388 0 2024-09-13T18:30:16.852 INFO:tasks.workunit.client.1.smithi149.stdout:5/29: read d3/f4 [1440810,54518] 0 2024-09-13T18:30:16.854 INFO:tasks.workunit.client.1.smithi149.stdout:6/24: unlink c4 0 2024-09-13T18:30:16.854 INFO:tasks.workunit.client.1.smithi149.stdout:7/34: symlink d7/lb 0 2024-09-13T18:30:16.854 INFO:tasks.workunit.client.1.smithi149.stdout:6/25: creat f5 x:0 0 0 2024-09-13T18:30:16.855 INFO:tasks.workunit.client.1.smithi149.stdout:5/30: unlink l0 0 2024-09-13T18:30:16.858 INFO:tasks.workunit.client.1.smithi149.stdout:7/35: symlink d7/lc 0 2024-09-13T18:30:16.859 INFO:tasks.workunit.client.1.smithi149.stdout:7/36: stat d7/lc 0 2024-09-13T18:30:16.859 INFO:tasks.workunit.client.1.smithi149.stdout:6/26: mknod c6 0 2024-09-13T18:30:16.860 INFO:tasks.workunit.client.1.smithi149.stdout:5/31: getdents d3 0 2024-09-13T18:30:16.862 INFO:tasks.workunit.client.1.smithi149.stdout:5/32: mkdir d3/d8 0 2024-09-13T18:30:16.864 INFO:tasks.workunit.client.1.smithi149.stdout:5/33: write d3/f5 [271557,6270] 0 2024-09-13T18:30:16.874 INFO:tasks.workunit.client.0.smithi038.stdout:4/97: write d2/f19 [851505,107269] 0 2024-09-13T18:30:16.875 INFO:tasks.workunit.client.0.smithi038.stdout:4/98: symlink d2/df/l20 0 2024-09-13T18:30:16.875 INFO:tasks.workunit.client.0.smithi038.stdout:4/99: truncate d2/f19 1418177 0 2024-09-13T18:30:16.875 INFO:tasks.workunit.client.0.smithi038.stdout:4/100: creat d2/d4/dc/d8/f21 x:0 0 0 2024-09-13T18:30:16.884 INFO:tasks.workunit.client.1.smithi149.stdout:4/87: dwrite f0 [0,4194304] 0 2024-09-13T18:30:16.884 INFO:tasks.workunit.client.1.smithi149.stdout:3/77: dwrite d1/f19 [0,4194304] 0 2024-09-13T18:30:16.885 INFO:tasks.workunit.client.1.smithi149.stdout:3/78: dread - d1/f11 zero size 2024-09-13T18:30:16.885 INFO:tasks.workunit.client.1.smithi149.stdout:1/69: dwrite f2 [0,4194304] 0 2024-09-13T18:30:16.885 INFO:tasks.workunit.client.1.smithi149.stdout:1/70: fsync d9/f11 0 2024-09-13T18:30:16.886 INFO:tasks.workunit.client.1.smithi149.stdout:6/27: dwrite f5 [0,4194304] 0 2024-09-13T18:30:16.888 INFO:tasks.workunit.client.1.smithi149.stdout:4/88: getdents df 0 2024-09-13T18:30:16.888 INFO:tasks.workunit.client.1.smithi149.stdout:4/89: dread - df/d11/d12/d17/f1a zero size 2024-09-13T18:30:16.892 INFO:tasks.workunit.client.1.smithi149.stdout:7/37: dread f1 [0,4194304] 0 2024-09-13T18:30:16.894 INFO:tasks.workunit.client.0.smithi038.stdout:4/101: rename d2/d4 to d2/df/d22 0 2024-09-13T18:30:16.898 INFO:tasks.workunit.client.0.smithi038.stdout:4/102: rename d2/df/d22/f13 to d2/df/d22/dc/d8/f23 0 2024-09-13T18:30:16.898 INFO:tasks.workunit.client.0.smithi038.stdout:4/103: rename d2/df to d2/df/d1b/d10/d24 22 2024-09-13T18:30:16.900 INFO:tasks.workunit.client.1.smithi149.stdout:4/90: rename f9 to df/f1b 0 2024-09-13T18:30:16.903 INFO:tasks.workunit.client.1.smithi149.stdout:6/28: write f5 [5126084,19640] 0 2024-09-13T18:30:16.903 INFO:tasks.workunit.client.1.smithi149.stdout:6/29: write f2 [3128018,6893] 0 2024-09-13T18:30:16.903 INFO:tasks.workunit.client.1.smithi149.stdout:6/30: chown c6 39334140 1 2024-09-13T18:30:16.903 INFO:tasks.workunit.client.1.smithi149.stdout:6/31: creat f7 x:0 0 0 2024-09-13T18:30:16.903 INFO:tasks.workunit.client.1.smithi149.stdout:6/32: truncate f1 1344030 0 2024-09-13T18:30:16.911 INFO:tasks.workunit.client.1.smithi149.stdout:7/38: dwrite f3 [0,4194304] 0 2024-09-13T18:30:16.916 INFO:tasks.workunit.client.1.smithi149.stdout:9/33: sync 2024-09-13T18:30:16.916 INFO:tasks.workunit.client.1.smithi149.stdout:2/43: sync 2024-09-13T18:30:16.919 INFO:tasks.workunit.client.1.smithi149.stdout:2/44: link f1 db/fe 0 2024-09-13T18:30:16.919 INFO:tasks.workunit.client.1.smithi149.stdout:9/34: symlink d0/l10 0 2024-09-13T18:30:16.919 INFO:tasks.workunit.client.1.smithi149.stdout:9/35: fdatasync d0/f4 0 2024-09-13T18:30:16.920 INFO:tasks.workunit.client.1.smithi149.stdout:5/34: dwrite d3/f5 [0,4194304] 0 2024-09-13T18:30:16.924 INFO:tasks.workunit.client.1.smithi149.stdout:5/35: link d3/f7 d3/d8/f9 0 2024-09-13T18:30:16.925 INFO:tasks.workunit.client.1.smithi149.stdout:5/36: mknod d3/d8/ca 0 2024-09-13T18:30:16.925 INFO:tasks.workunit.client.1.smithi149.stdout:5/37: fdatasync f1 0 2024-09-13T18:30:16.926 INFO:tasks.workunit.client.1.smithi149.stdout:5/38: read d3/f4 [887675,35806] 0 2024-09-13T18:30:16.927 INFO:tasks.workunit.client.1.smithi149.stdout:5/39: symlink d3/d8/lb 0 2024-09-13T18:30:16.929 INFO:tasks.workunit.client.1.smithi149.stdout:5/40: rename d3/f5 to d3/fc 0 2024-09-13T18:30:16.930 INFO:tasks.workunit.client.1.smithi149.stdout:5/41: read - d3/f7 zero size 2024-09-13T18:30:16.930 INFO:tasks.workunit.client.1.smithi149.stdout:5/42: chown d3/d8/f9 4733443 1 2024-09-13T18:30:16.930 INFO:tasks.workunit.client.1.smithi149.stdout:7/39: dread f3 [0,4194304] 0 2024-09-13T18:30:16.931 INFO:tasks.workunit.client.1.smithi149.stdout:5/43: unlink d3/c6 0 2024-09-13T18:30:16.931 INFO:tasks.workunit.client.1.smithi149.stdout:5/44: chown d3/f4 968 1 2024-09-13T18:30:16.931 INFO:tasks.workunit.client.1.smithi149.stdout:5/45: creat d3/fd x:0 0 0 2024-09-13T18:30:16.932 INFO:tasks.workunit.client.1.smithi149.stdout:5/46: creat d3/d8/fe x:0 0 0 2024-09-13T18:30:16.933 INFO:tasks.workunit.client.1.smithi149.stdout:9/36: read d0/ff [1117899,72396] 0 2024-09-13T18:30:16.933 INFO:tasks.workunit.client.1.smithi149.stdout:9/37: read - d0/f9 zero size 2024-09-13T18:30:16.933 INFO:tasks.workunit.client.1.smithi149.stdout:9/38: stat d0/cb 0 2024-09-13T18:30:16.934 INFO:tasks.workunit.client.1.smithi149.stdout:1/71: dwrite d9/fd [0,4194304] 0 2024-09-13T18:30:16.934 INFO:tasks.workunit.client.1.smithi149.stdout:9/39: write d0/f9 [99818,73703] 0 2024-09-13T18:30:16.935 INFO:tasks.workunit.client.1.smithi149.stdout:5/47: link d3/d8/lb d3/lf 0 2024-09-13T18:30:16.935 INFO:tasks.workunit.client.1.smithi149.stdout:7/40: dread d7/f8 [0,4194304] 0 2024-09-13T18:30:16.935 INFO:tasks.workunit.client.1.smithi149.stdout:1/72: mknod d9/d10/c19 0 2024-09-13T18:30:16.936 INFO:tasks.workunit.client.1.smithi149.stdout:5/48: write d3/fc [5020404,96615] 0 2024-09-13T18:30:16.937 INFO:tasks.workunit.client.1.smithi149.stdout:7/41: getdents d7/d9 0 2024-09-13T18:30:16.939 INFO:tasks.workunit.client.0.smithi038.stdout:4/104: dwrite d2/df/d22/f1d [4194304,4194304] 0 2024-09-13T18:30:16.939 INFO:tasks.workunit.client.1.smithi149.stdout:7/42: creat d7/fd x:0 0 0 2024-09-13T18:30:16.940 INFO:tasks.workunit.client.1.smithi149.stdout:6/33: dwrite f5 [0,4194304] 0 2024-09-13T18:30:16.940 INFO:tasks.workunit.client.1.smithi149.stdout:4/91: dwrite df/d11/d12/d17/f1a [0,4194304] 0 2024-09-13T18:30:16.941 INFO:tasks.workunit.client.1.smithi149.stdout:6/34: unlink c6 0 2024-09-13T18:30:16.942 INFO:tasks.workunit.client.1.smithi149.stdout:6/35: fdatasync f7 0 2024-09-13T18:30:16.942 INFO:tasks.workunit.client.1.smithi149.stdout:2/45: dread db/fe [4194304,4194304] 0 2024-09-13T18:30:16.942 INFO:tasks.workunit.client.1.smithi149.stdout:2/46: readlink l3 0 2024-09-13T18:30:16.946 INFO:tasks.workunit.client.1.smithi149.stdout:2/47: rename f8 to db/ff 0 2024-09-13T18:30:16.948 INFO:tasks.workunit.client.1.smithi149.stdout:2/48: mkdir db/d10 0 2024-09-13T18:30:16.948 INFO:tasks.workunit.client.1.smithi149.stdout:2/49: chown db/fd 13736015 1 2024-09-13T18:30:16.951 INFO:tasks.workunit.client.1.smithi149.stdout:2/50: creat db/d10/f11 x:0 0 0 2024-09-13T18:30:16.952 INFO:tasks.workunit.client.1.smithi149.stdout:4/92: dread fa [0,4194304] 0 2024-09-13T18:30:16.952 INFO:tasks.workunit.client.1.smithi149.stdout:4/93: write df/d11/f16 [4873963,67732] 0 2024-09-13T18:30:16.953 INFO:tasks.workunit.client.1.smithi149.stdout:2/51: rmdir db 39 2024-09-13T18:30:16.953 INFO:tasks.workunit.client.1.smithi149.stdout:2/52: fsync fa 0 2024-09-13T18:30:16.955 INFO:tasks.workunit.client.1.smithi149.stdout:4/94: mkdir df/d11/d1c 0 2024-09-13T18:30:16.955 INFO:tasks.workunit.client.1.smithi149.stdout:4/95: rename df/d11 to df/d11/d12/d17/d1d 22 2024-09-13T18:30:16.957 INFO:tasks.workunit.client.1.smithi149.stdout:4/96: symlink df/d11/d1c/l1e 0 2024-09-13T18:30:16.957 INFO:tasks.workunit.client.1.smithi149.stdout:4/97: rename df/d11/d12/d17 to df/d11/d12/d17/d1f 22 2024-09-13T18:30:16.957 INFO:tasks.workunit.client.1.smithi149.stdout:4/98: readlink l2 0 2024-09-13T18:30:16.957 INFO:tasks.workunit.client.1.smithi149.stdout:4/99: readlink l7 0 2024-09-13T18:30:16.958 INFO:tasks.workunit.client.1.smithi149.stdout:5/49: getdents d3 0 2024-09-13T18:30:16.958 INFO:tasks.workunit.client.1.smithi149.stdout:5/50: fsync d3/d8/fe 0 2024-09-13T18:30:16.958 INFO:tasks.workunit.client.1.smithi149.stdout:5/51: write f1 [1235272,70286] 0 2024-09-13T18:30:16.959 INFO:tasks.workunit.client.1.smithi149.stdout:4/100: link df/d11/f16 df/f20 0 2024-09-13T18:30:16.962 INFO:tasks.workunit.client.1.smithi149.stdout:7/43: getdents d7 0 2024-09-13T18:30:16.962 INFO:tasks.workunit.client.1.smithi149.stdout:7/44: rename d7 to d7/de 22 2024-09-13T18:30:16.964 INFO:tasks.workunit.client.1.smithi149.stdout:6/36: write f5 [2204696,24364] 0 2024-09-13T18:30:16.964 INFO:tasks.workunit.client.1.smithi149.stdout:1/73: dwrite f3 [4194304,4194304] 0 2024-09-13T18:30:16.965 INFO:tasks.workunit.client.1.smithi149.stdout:7/45: creat d7/ff x:0 0 0 2024-09-13T18:30:16.967 INFO:tasks.workunit.client.1.smithi149.stdout:1/74: rename d9/fd to d9/d10/f1a 0 2024-09-13T18:30:16.970 INFO:tasks.workunit.client.1.smithi149.stdout:1/75: rename d9/d10/c13 to d9/d15/c1b 0 2024-09-13T18:30:16.971 INFO:tasks.workunit.client.1.smithi149.stdout:9/40: dwrite d0/fe [0,4194304] 0 2024-09-13T18:30:16.971 INFO:tasks.workunit.client.1.smithi149.stdout:6/37: dread f1 [0,4194304] 0 2024-09-13T18:30:16.977 INFO:tasks.workunit.client.1.smithi149.stdout:9/41: symlink d0/l11 0 2024-09-13T18:30:16.977 INFO:tasks.workunit.client.1.smithi149.stdout:6/38: rename f7 to f8 0 2024-09-13T18:30:16.979 INFO:tasks.workunit.client.1.smithi149.stdout:9/42: creat d0/f12 x:0 0 0 2024-09-13T18:30:16.981 INFO:tasks.workunit.client.1.smithi149.stdout:9/43: rmdir d0/dd 0 2024-09-13T18:30:16.981 INFO:tasks.workunit.client.1.smithi149.stdout:9/44: dread - d0/f12 zero size 2024-09-13T18:30:16.982 INFO:tasks.workunit.client.1.smithi149.stdout:9/45: symlink d0/l13 0 2024-09-13T18:30:16.986 INFO:tasks.workunit.client.1.smithi149.stdout:6/39: dread f2 [0,4194304] 0 2024-09-13T18:30:16.986 INFO:tasks.workunit.client.1.smithi149.stdout:6/40: creat f9 x:0 0 0 2024-09-13T18:30:16.986 INFO:tasks.workunit.client.1.smithi149.stdout:6/41: readlink l3 0 2024-09-13T18:30:16.986 INFO:tasks.workunit.client.1.smithi149.stdout:5/52: dwrite d3/d8/fe [0,4194304] 0 2024-09-13T18:30:16.986 INFO:tasks.workunit.client.1.smithi149.stdout:5/53: write d3/f4 [631513,16338] 0 2024-09-13T18:30:16.987 INFO:tasks.workunit.client.1.smithi149.stdout:5/54: read - d3/fd zero size 2024-09-13T18:30:16.987 INFO:tasks.workunit.client.0.smithi038.stdout:4/105: dwrite d2/df/d1b/fd [0,4194304] 0 2024-09-13T18:30:16.987 INFO:tasks.workunit.client.1.smithi149.stdout:2/53: dwrite db/fd [0,4194304] 0 2024-09-13T18:30:16.988 INFO:tasks.workunit.client.1.smithi149.stdout:4/101: getdents df/d11/d1c 0 2024-09-13T18:30:16.990 INFO:tasks.workunit.client.0.smithi038.stdout:4/106: getdents d2/df 0 2024-09-13T18:30:16.992 INFO:tasks.workunit.client.0.smithi038.stdout:4/107: link d2/df/d22/dc/f1e d2/df/d1b/d10/f25 0 2024-09-13T18:30:16.996 INFO:tasks.workunit.client.1.smithi149.stdout:1/76: truncate f2 2571059 0 2024-09-13T18:30:16.996 INFO:tasks.workunit.client.1.smithi149.stdout:1/77: truncate d9/f11 846157 0 2024-09-13T18:30:16.996 INFO:tasks.workunit.client.1.smithi149.stdout:1/78: fdatasync d9/f11 0 2024-09-13T18:30:16.997 INFO:tasks.workunit.client.1.smithi149.stdout:1/79: creat d9/f1c x:0 0 0 2024-09-13T18:30:16.997 INFO:tasks.workunit.client.1.smithi149.stdout:5/55: dread f1 [0,4194304] 0 2024-09-13T18:30:16.997 INFO:tasks.workunit.client.1.smithi149.stdout:1/80: write d9/d10/f1a [4462909,122771] 0 2024-09-13T18:30:16.999 INFO:tasks.workunit.client.1.smithi149.stdout:2/54: mkdir db/d10/d12 0 2024-09-13T18:30:16.999 INFO:tasks.workunit.client.1.smithi149.stdout:6/42: truncate f1 189805 0 2024-09-13T18:30:17.001 INFO:tasks.workunit.client.0.smithi038.stdout:4/108: dread d2/df/d22/dc/f18 [0,4194304] 0 2024-09-13T18:30:17.001 INFO:tasks.workunit.client.0.smithi038.stdout:4/109: truncate d2/df/d1b/d10/f25 5181712 0 2024-09-13T18:30:17.001 INFO:tasks.workunit.client.1.smithi149.stdout:5/56: rmdir d3 39 2024-09-13T18:30:17.001 INFO:tasks.workunit.client.1.smithi149.stdout:5/57: getdents d3 0 2024-09-13T18:30:17.001 INFO:tasks.workunit.client.1.smithi149.stdout:5/58: write f1 [2135704,48662] 0 2024-09-13T18:30:17.003 INFO:tasks.workunit.client.0.smithi038.stdout:4/110: symlink d2/l26 0 2024-09-13T18:30:17.003 INFO:tasks.workunit.client.1.smithi149.stdout:2/55: unlink db/fc 0 2024-09-13T18:30:17.003 INFO:tasks.workunit.client.1.smithi149.stdout:2/56: stat db/ff 0 2024-09-13T18:30:17.003 INFO:tasks.workunit.client.1.smithi149.stdout:2/57: stat c9 0 2024-09-13T18:30:17.003 INFO:tasks.workunit.client.1.smithi149.stdout:2/58: chown fa 1 1 2024-09-13T18:30:17.004 INFO:tasks.workunit.client.1.smithi149.stdout:5/59: mkdir d3/d10 0 2024-09-13T18:30:17.005 INFO:tasks.workunit.client.0.smithi038.stdout:4/111: creat d2/df/d22/dc/d8/f27 x:0 0 0 2024-09-13T18:30:17.006 INFO:tasks.workunit.client.1.smithi149.stdout:5/60: link d3/d8/f9 d3/d8/f11 0 2024-09-13T18:30:17.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:16 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:30:17.099 INFO:tasks.workunit.client.1.smithi149.stdout:5/61: mkdir d3/d8/d12 0 2024-09-13T18:30:17.100 INFO:tasks.workunit.client.1.smithi149.stdout:5/62: mkdir d3/d8/d13 0 2024-09-13T18:30:17.100 INFO:tasks.workunit.client.1.smithi149.stdout:5/63: dread - d3/d8/f9 zero size 2024-09-13T18:30:17.104 INFO:tasks.workunit.client.0.smithi038.stdout:4/112: dread d2/df/d22/dc/f1a [0,4194304] 0 2024-09-13T18:30:17.108 INFO:tasks.workunit.client.1.smithi149.stdout:4/102: dwrite fa [4194304,4194304] 0 2024-09-13T18:30:17.110 INFO:tasks.workunit.client.1.smithi149.stdout:2/59: rmdir db 39 2024-09-13T18:30:17.111 INFO:tasks.workunit.client.1.smithi149.stdout:4/103: rmdir df 39 2024-09-13T18:30:17.113 INFO:tasks.workunit.client.0.smithi038.stdout:4/113: dread d2/f19 [0,4194304] 0 2024-09-13T18:30:17.113 INFO:tasks.workunit.client.1.smithi149.stdout:9/46: dwrite d0/f9 [0,4194304] 0 2024-09-13T18:30:17.116 INFO:tasks.workunit.client.1.smithi149.stdout:6/43: dwrite f5 [0,4194304] 0 2024-09-13T18:30:17.116 INFO:tasks.workunit.client.1.smithi149.stdout:6/44: creat fa x:0 0 0 2024-09-13T18:30:17.121 INFO:tasks.workunit.client.1.smithi149.stdout:6/45: symlink lb 0 2024-09-13T18:30:17.121 INFO:tasks.workunit.client.1.smithi149.stdout:6/46: write f5 [5711061,89779] 0 2024-09-13T18:30:17.121 INFO:tasks.workunit.client.1.smithi149.stdout:6/47: chown l3 19117 1 2024-09-13T18:30:17.122 INFO:tasks.workunit.client.1.smithi149.stdout:9/47: dread d0/ff [0,4194304] 0 2024-09-13T18:30:17.125 INFO:tasks.workunit.client.1.smithi149.stdout:0/33: sync 2024-09-13T18:30:17.125 INFO:tasks.workunit.client.1.smithi149.stdout:8/66: sync 2024-09-13T18:30:17.125 INFO:tasks.workunit.client.1.smithi149.stdout:3/79: sync 2024-09-13T18:30:17.125 INFO:tasks.workunit.client.1.smithi149.stdout:5/64: write d3/d8/fe [2594458,42644] 0 2024-09-13T18:30:17.125 INFO:tasks.workunit.client.1.smithi149.stdout:5/65: write d3/d8/f11 [138797,123288] 0 2024-09-13T18:30:17.126 INFO:tasks.workunit.client.1.smithi149.stdout:0/34: link d1/d2/c3 d1/c6 0 2024-09-13T18:30:17.127 INFO:tasks.workunit.client.1.smithi149.stdout:3/80: truncate d1/d4/fd 451687 0 2024-09-13T18:30:17.127 INFO:tasks.workunit.client.1.smithi149.stdout:2/60: write db/ff [48227,20928] 0 2024-09-13T18:30:17.127 INFO:tasks.workunit.client.1.smithi149.stdout:2/61: truncate fa 429766 0 2024-09-13T18:30:17.130 INFO:tasks.workunit.client.1.smithi149.stdout:5/66: mknod d3/d10/c14 0 2024-09-13T18:30:17.130 INFO:tasks.workunit.client.1.smithi149.stdout:5/67: write d3/f7 [1004968,96610] 0 2024-09-13T18:30:17.131 INFO:tasks.workunit.client.1.smithi149.stdout:0/35: truncate d1/f5 965869 0 2024-09-13T18:30:17.136 INFO:tasks.workunit.client.1.smithi149.stdout:3/81: dread d1/fb [0,4194304] 0 2024-09-13T18:30:17.136 INFO:tasks.workunit.client.1.smithi149.stdout:3/82: dread - d1/f11 zero size 2024-09-13T18:30:17.137 INFO:tasks.workunit.client.1.smithi149.stdout:3/83: creat d1/d12/f1a x:0 0 0 2024-09-13T18:30:17.141 INFO:tasks.workunit.client.1.smithi149.stdout:1/81: truncate f2 976703 0 2024-09-13T18:30:17.142 INFO:tasks.workunit.client.0.smithi038.stdout:4/114: dwrite d2/df/d22/dc/f1a [0,4194304] 0 2024-09-13T18:30:17.143 INFO:tasks.workunit.client.0.smithi038.stdout:4/115: write d2/df/d22/dc/f18 [4558264,113689] 0 2024-09-13T18:30:17.148 INFO:tasks.workunit.client.1.smithi149.stdout:4/104: dwrite fe [4194304,4194304] 0 2024-09-13T18:30:17.150 INFO:tasks.workunit.client.1.smithi149.stdout:4/105: mkdir df/d11/d12/d21 0 2024-09-13T18:30:17.155 INFO:tasks.workunit.client.1.smithi149.stdout:6/48: dread f5 [0,4194304] 0 2024-09-13T18:30:17.158 INFO:tasks.workunit.client.1.smithi149.stdout:6/49: mkdir dc 0 2024-09-13T18:30:17.158 INFO:tasks.workunit.client.1.smithi149.stdout:6/50: truncate fa 14168 0 2024-09-13T18:30:17.160 INFO:tasks.workunit.client.1.smithi149.stdout:8/67: dwrite d2/d13/f17 [0,4194304] 0 2024-09-13T18:30:17.160 INFO:tasks.workunit.client.1.smithi149.stdout:6/51: symlink dc/ld 0 2024-09-13T18:30:17.161 INFO:tasks.workunit.client.1.smithi149.stdout:6/52: write f1 [1207083,128001] 0 2024-09-13T18:30:17.162 INFO:tasks.workunit.client.1.smithi149.stdout:5/68: truncate d3/d8/fe 2171764 0 2024-09-13T18:30:17.164 INFO:tasks.workunit.client.1.smithi149.stdout:7/46: sync 2024-09-13T18:30:17.164 INFO:tasks.workunit.client.1.smithi149.stdout:7/47: readlink d7/lb 0 2024-09-13T18:30:17.166 INFO:tasks.workunit.client.1.smithi149.stdout:7/48: truncate f1 1258375 0 2024-09-13T18:30:17.166 INFO:tasks.workunit.client.0.smithi038.stdout:4/116: dwrite d2/df/d22/dc/d8/f27 [0,4194304] 0 2024-09-13T18:30:17.167 INFO:tasks.workunit.client.1.smithi149.stdout:9/48: dwrite d0/f12 [0,4194304] 0 2024-09-13T18:30:17.169 INFO:tasks.workunit.client.1.smithi149.stdout:7/49: symlink d7/d9/l10 0 2024-09-13T18:30:17.169 INFO:tasks.workunit.client.1.smithi149.stdout:7/50: fsync d7/ff 0 2024-09-13T18:30:17.171 INFO:tasks.workunit.client.1.smithi149.stdout:7/51: mkdir d7/d9/d11 0 2024-09-13T18:30:17.175 INFO:tasks.workunit.client.1.smithi149.stdout:3/84: write d1/f19 [3683673,107789] 0 2024-09-13T18:30:17.175 INFO:tasks.workunit.client.1.smithi149.stdout:4/106: dread fe [0,4194304] 0 2024-09-13T18:30:17.175 INFO:tasks.workunit.client.1.smithi149.stdout:2/62: dwrite f1 [0,4194304] 0 2024-09-13T18:30:17.175 INFO:tasks.workunit.client.1.smithi149.stdout:4/107: dread - df/f15 zero size 2024-09-13T18:30:17.175 INFO:tasks.workunit.client.1.smithi149.stdout:4/108: fsync df/f10 0 2024-09-13T18:30:17.175 INFO:tasks.workunit.client.1.smithi149.stdout:4/109: write df/f15 [6407,64430] 0 2024-09-13T18:30:17.175 INFO:tasks.workunit.client.1.smithi149.stdout:7/52: readlink d7/lc 0 2024-09-13T18:30:17.176 INFO:tasks.workunit.client.1.smithi149.stdout:9/49: read d0/fa [154281,56480] 0 2024-09-13T18:30:17.176 INFO:tasks.workunit.client.1.smithi149.stdout:9/50: truncate d0/fa 1062220 0 2024-09-13T18:30:17.176 INFO:tasks.workunit.client.1.smithi149.stdout:9/51: stat d0/l11 0 2024-09-13T18:30:17.177 INFO:tasks.workunit.client.1.smithi149.stdout:6/53: write f5 [1983518,90396] 0 2024-09-13T18:30:17.177 INFO:tasks.workunit.client.1.smithi149.stdout:9/52: link d0/fe d0/f14 0 2024-09-13T18:30:17.177 INFO:tasks.workunit.client.1.smithi149.stdout:1/82: write f2 [782966,114374] 0 2024-09-13T18:30:17.178 INFO:tasks.workunit.client.1.smithi149.stdout:6/54: mknod dc/ce 0 2024-09-13T18:30:17.178 INFO:tasks.workunit.client.1.smithi149.stdout:1/83: read - d9/f1c zero size 2024-09-13T18:30:17.178 INFO:tasks.workunit.client.1.smithi149.stdout:9/53: symlink d0/l15 0 2024-09-13T18:30:17.179 INFO:tasks.workunit.client.1.smithi149.stdout:6/55: rename f2 to dc/ff 0 2024-09-13T18:30:17.179 INFO:tasks.workunit.client.1.smithi149.stdout:6/56: fdatasync dc/ff 0 2024-09-13T18:30:17.179 INFO:tasks.workunit.client.1.smithi149.stdout:3/85: dread d1/d4/da/f14 [0,4194304] 0 2024-09-13T18:30:17.179 INFO:tasks.workunit.client.1.smithi149.stdout:3/86: chown d1/d4/l16 3 1 2024-09-13T18:30:17.180 INFO:tasks.workunit.client.1.smithi149.stdout:9/54: rename d0/l11 to d0/l16 0 2024-09-13T18:30:17.180 INFO:tasks.workunit.client.1.smithi149.stdout:6/57: symlink dc/l10 0 2024-09-13T18:30:17.181 INFO:tasks.workunit.client.1.smithi149.stdout:6/58: truncate dc/ff 3330598 0 2024-09-13T18:30:17.184 INFO:tasks.workunit.client.1.smithi149.stdout:6/59: symlink dc/l11 0 2024-09-13T18:30:17.184 INFO:tasks.workunit.client.1.smithi149.stdout:6/60: fsync f8 0 2024-09-13T18:30:17.185 INFO:tasks.workunit.client.1.smithi149.stdout:8/68: write d2/d13/f17 [2318266,581] 0 2024-09-13T18:30:17.186 INFO:tasks.workunit.client.1.smithi149.stdout:6/61: mknod dc/c12 0 2024-09-13T18:30:17.189 INFO:tasks.workunit.client.1.smithi149.stdout:8/69: rename d2/d12/l19 to d2/l1a 0 2024-09-13T18:30:17.189 INFO:tasks.workunit.client.1.smithi149.stdout:3/87: dread d1/d4/da/f17 [0,4194304] 0 2024-09-13T18:30:17.191 INFO:tasks.workunit.client.0.smithi038.stdout:4/117: write d2/df/d22/dc/f16 [3422839,28839] 0 2024-09-13T18:30:17.191 INFO:tasks.workunit.client.0.smithi038.stdout:4/118: truncate d2/df/d22/dc/d8/f21 493554 0 2024-09-13T18:30:17.192 INFO:tasks.workunit.client.1.smithi149.stdout:6/62: rename dc/ce to dc/c13 0 2024-09-13T18:30:17.194 INFO:tasks.workunit.client.1.smithi149.stdout:2/63: dwrite db/d10/f11 [0,4194304] 0 2024-09-13T18:30:17.195 INFO:tasks.workunit.client.1.smithi149.stdout:7/53: write f1 [1102662,63847] 0 2024-09-13T18:30:17.195 INFO:tasks.workunit.client.1.smithi149.stdout:7/54: fsync d7/ff 0 2024-09-13T18:30:17.198 INFO:tasks.workunit.client.1.smithi149.stdout:2/64: mkdir db/d13 0 2024-09-13T18:30:17.198 INFO:tasks.workunit.client.1.smithi149.stdout:2/65: readlink l3 0 2024-09-13T18:30:17.200 INFO:tasks.workunit.client.1.smithi149.stdout:2/66: creat db/d10/f14 x:0 0 0 2024-09-13T18:30:17.200 INFO:tasks.workunit.client.1.smithi149.stdout:7/55: dread f3 [0,4194304] 0 2024-09-13T18:30:17.201 INFO:tasks.workunit.client.1.smithi149.stdout:0/36: dwrite d1/f5 [0,4194304] 0 2024-09-13T18:30:17.201 INFO:tasks.workunit.client.1.smithi149.stdout:0/37: chown d1/c6 11134 1 2024-09-13T18:30:17.201 INFO:tasks.workunit.client.0.smithi038.stdout:4/119: dread d2/df/d1b/d10/f25 [0,4194304] 0 2024-09-13T18:30:17.204 INFO:tasks.workunit.client.1.smithi149.stdout:7/56: unlink f1 0 2024-09-13T18:30:17.208 INFO:tasks.workunit.client.1.smithi149.stdout:7/57: mkdir d7/d12 0 2024-09-13T18:30:17.214 INFO:tasks.workunit.client.1.smithi149.stdout:8/70: getdents d2/d12 0 2024-09-13T18:30:17.214 INFO:tasks.workunit.client.1.smithi149.stdout:8/71: write d2/f9 [1720804,113738] 0 2024-09-13T18:30:17.215 INFO:tasks.workunit.client.1.smithi149.stdout:6/63: getdents dc 0 2024-09-13T18:30:17.215 INFO:tasks.workunit.client.1.smithi149.stdout:0/38: dread d1/f5 [0,4194304] 0 2024-09-13T18:30:17.215 INFO:tasks.workunit.client.1.smithi149.stdout:0/39: fsync d1/f5 0 2024-09-13T18:30:17.216 INFO:tasks.workunit.client.1.smithi149.stdout:8/72: mkdir d2/d12/d1b 0 2024-09-13T18:30:17.225 INFO:tasks.workunit.client.1.smithi149.stdout:6/64: rmdir dc 39 2024-09-13T18:30:17.226 INFO:tasks.workunit.client.1.smithi149.stdout:6/65: chown dc/ld 28954549 1 2024-09-13T18:30:17.226 INFO:tasks.workunit.client.1.smithi149.stdout:6/66: readlink dc/l10 0 2024-09-13T18:30:17.226 INFO:tasks.workunit.client.1.smithi149.stdout:6/67: write f9 [812509,112793] 0 2024-09-13T18:30:17.226 INFO:tasks.workunit.client.1.smithi149.stdout:0/40: symlink d1/l7 0 2024-09-13T18:30:17.226 INFO:tasks.workunit.client.1.smithi149.stdout:8/73: mkdir d2/d1c 0 2024-09-13T18:30:17.226 INFO:tasks.workunit.client.1.smithi149.stdout:4/110: dwrite df/f10 [0,4194304] 0 2024-09-13T18:30:17.226 INFO:tasks.workunit.client.1.smithi149.stdout:4/111: mkdir df/d11/d12/d21/d22 0 2024-09-13T18:30:17.226 INFO:tasks.workunit.client.1.smithi149.stdout:4/112: stat df/f15 0 2024-09-13T18:30:17.237 INFO:tasks.workunit.client.1.smithi149.stdout:5/69: dwrite d3/f4 [0,4194304] 0 2024-09-13T18:30:17.239 INFO:tasks.workunit.client.1.smithi149.stdout:3/88: dwrite d1/f11 [0,4194304] 0 2024-09-13T18:30:17.242 INFO:tasks.workunit.client.1.smithi149.stdout:3/89: link d1/d4/l16 d1/d4/da/l1b 0 2024-09-13T18:30:17.242 INFO:tasks.workunit.client.1.smithi149.stdout:3/90: fdatasync d1/f11 0 2024-09-13T18:30:17.242 INFO:tasks.workunit.client.1.smithi149.stdout:3/91: stat d1/l7 0 2024-09-13T18:30:17.242 INFO:tasks.workunit.client.1.smithi149.stdout:3/92: fsync d1/f19 0 2024-09-13T18:30:17.243 INFO:tasks.workunit.client.1.smithi149.stdout:7/58: getdents d7 0 2024-09-13T18:30:17.244 INFO:tasks.workunit.client.1.smithi149.stdout:3/93: mknod d1/d4/da/c1c 0 2024-09-13T18:30:17.244 INFO:tasks.workunit.client.1.smithi149.stdout:3/94: chown d1/f19 3 1 2024-09-13T18:30:17.246 INFO:tasks.workunit.client.1.smithi149.stdout:7/59: mknod d7/d12/c13 0 2024-09-13T18:30:17.246 INFO:tasks.workunit.client.1.smithi149.stdout:7/60: readlink d7/lb 0 2024-09-13T18:30:17.246 INFO:tasks.workunit.client.1.smithi149.stdout:7/61: readlink d7/d9/l10 0 2024-09-13T18:30:17.249 INFO:tasks.workunit.client.1.smithi149.stdout:1/84: dread d9/d10/f1a [0,4194304] 0 2024-09-13T18:30:17.249 INFO:tasks.workunit.client.1.smithi149.stdout:1/85: truncate f5 4745069 0 2024-09-13T18:30:17.249 INFO:tasks.workunit.client.1.smithi149.stdout:1/86: dread - d9/f1c zero size 2024-09-13T18:30:17.251 INFO:tasks.workunit.client.1.smithi149.stdout:5/70: read d3/fc [2109590,3248] 0 2024-09-13T18:30:17.252 INFO:tasks.workunit.client.0.smithi038.stdout:4/120: dwrite d2/df/d1b/d10/f25 [0,4194304] 0 2024-09-13T18:30:17.252 INFO:tasks.workunit.client.0.smithi038.stdout:4/121: chown d2/df/d1b/fd 2323432 1 2024-09-13T18:30:17.253 INFO:tasks.workunit.client.1.smithi149.stdout:7/62: dread d7/f8 [0,4194304] 0 2024-09-13T18:30:17.254 INFO:tasks.workunit.client.1.smithi149.stdout:5/71: write f1 [1931130,116764] 0 2024-09-13T18:30:17.256 INFO:tasks.workunit.client.1.smithi149.stdout:7/63: link d7/lc d7/l14 0 2024-09-13T18:30:17.256 INFO:tasks.workunit.client.1.smithi149.stdout:7/64: stat d7 0 2024-09-13T18:30:17.256 INFO:tasks.workunit.client.0.smithi038.stdout:4/122: rmdir d2/df/d22/dc/d8 39 2024-09-13T18:30:17.258 INFO:tasks.workunit.client.1.smithi149.stdout:6/68: dwrite dc/ff [0,4194304] 0 2024-09-13T18:30:17.259 INFO:tasks.workunit.client.1.smithi149.stdout:5/72: rmdir d3/d8/d12 0 2024-09-13T18:30:17.259 INFO:tasks.workunit.client.0.smithi038.stdout:4/123: mknod d2/df/c28 0 2024-09-13T18:30:17.260 INFO:tasks.workunit.client.1.smithi149.stdout:7/65: mkdir d7/d9/d15 0 2024-09-13T18:30:17.261 INFO:tasks.workunit.client.1.smithi149.stdout:6/69: rmdir dc 39 2024-09-13T18:30:17.261 INFO:tasks.workunit.client.1.smithi149.stdout:6/70: getdents dc 0 2024-09-13T18:30:17.261 INFO:tasks.workunit.client.0.smithi038.stdout:4/124: rename d2/df/d22/dc/d8/f21 to d2/df/d22/f29 0 2024-09-13T18:30:17.262 INFO:tasks.workunit.client.1.smithi149.stdout:5/73: mknod d3/d10/c15 0 2024-09-13T18:30:17.262 INFO:tasks.workunit.client.1.smithi149.stdout:5/74: chown d3/fc 257739270 1 2024-09-13T18:30:17.263 INFO:tasks.workunit.client.1.smithi149.stdout:0/41: dwrite d1/f5 [0,4194304] 0 2024-09-13T18:30:17.263 INFO:tasks.workunit.client.1.smithi149.stdout:8/74: dwrite d2/fe [0,4194304] 0 2024-09-13T18:30:17.263 INFO:tasks.workunit.client.1.smithi149.stdout:7/66: unlink d7/l14 0 2024-09-13T18:30:17.264 INFO:tasks.workunit.client.1.smithi149.stdout:6/71: unlink dc/ff 0 2024-09-13T18:30:17.265 INFO:tasks.workunit.client.1.smithi149.stdout:1/87: dread f5 [0,4194304] 0 2024-09-13T18:30:17.266 INFO:tasks.workunit.client.1.smithi149.stdout:3/95: dwrite d1/f19 [0,4194304] 0 2024-09-13T18:30:17.266 INFO:tasks.workunit.client.1.smithi149.stdout:3/96: write d1/d4/da/f14 [860103,15066] 0 2024-09-13T18:30:17.266 INFO:tasks.workunit.client.1.smithi149.stdout:3/97: read d1/d4/fd [311800,44048] 0 2024-09-13T18:30:17.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:16 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:30:17.270 INFO:tasks.workunit.client.1.smithi149.stdout:5/75: mknod d3/d8/d13/c16 0 2024-09-13T18:30:17.271 INFO:tasks.workunit.client.0.smithi038.stdout:4/125: getdents d2/df 0 2024-09-13T18:30:17.273 INFO:tasks.workunit.client.1.smithi149.stdout:0/42: creat d1/f8 x:0 0 0 2024-09-13T18:30:17.273 INFO:tasks.workunit.client.0.smithi038.stdout:4/126: dread d2/df/d22/f29 [0,4194304] 0 2024-09-13T18:30:17.275 INFO:tasks.workunit.client.1.smithi149.stdout:8/75: mknod d2/d12/c1d 0 2024-09-13T18:30:17.277 INFO:tasks.workunit.client.1.smithi149.stdout:7/67: mknod d7/c16 0 2024-09-13T18:30:17.278 INFO:tasks.workunit.client.1.smithi149.stdout:6/72: mknod dc/c14 0 2024-09-13T18:30:17.280 INFO:tasks.workunit.client.1.smithi149.stdout:5/76: rmdir d3 39 2024-09-13T18:30:17.280 INFO:tasks.workunit.client.1.smithi149.stdout:5/77: rename d3 to d3/d8/d13/d17 22 2024-09-13T18:30:17.281 INFO:tasks.workunit.client.1.smithi149.stdout:0/43: symlink d1/l9 0 2024-09-13T18:30:17.281 INFO:tasks.workunit.client.1.smithi149.stdout:0/44: chown d1/c6 22 1 2024-09-13T18:30:17.281 INFO:tasks.workunit.client.1.smithi149.stdout:0/45: creat d1/d2/fa x:0 0 0 2024-09-13T18:30:17.282 INFO:tasks.workunit.client.1.smithi149.stdout:6/73: mkdir dc/d15 0 2024-09-13T18:30:17.282 INFO:tasks.workunit.client.1.smithi149.stdout:6/74: getdents dc/d15 0 2024-09-13T18:30:17.282 INFO:tasks.workunit.client.1.smithi149.stdout:6/75: chown dc/ld 6324211 1 2024-09-13T18:30:17.282 INFO:tasks.workunit.client.1.smithi149.stdout:3/98: getdents d1 0 2024-09-13T18:30:17.282 INFO:tasks.workunit.client.1.smithi149.stdout:5/78: getdents d3/d10 0 2024-09-13T18:30:17.283 INFO:tasks.workunit.client.0.smithi038.stdout:4/127: dread d2/df/d22/dc/f16 [4194304,4194304] 0 2024-09-13T18:30:17.283 INFO:tasks.workunit.client.1.smithi149.stdout:6/76: truncate f5 3222492 0 2024-09-13T18:30:17.284 INFO:tasks.workunit.client.1.smithi149.stdout:5/79: creat d3/d8/d13/f18 x:0 0 0 2024-09-13T18:30:17.284 INFO:tasks.workunit.client.1.smithi149.stdout:5/80: write d3/d8/fe [2744521,34006] 0 2024-09-13T18:30:17.284 INFO:tasks.workunit.client.0.smithi038.stdout:4/128: symlink d2/df/d22/l2a 0 2024-09-13T18:30:17.286 INFO:tasks.workunit.client.1.smithi149.stdout:6/77: creat dc/f16 x:0 0 0 2024-09-13T18:30:17.286 INFO:tasks.workunit.client.0.smithi038.stdout:4/129: creat d2/df/d1b/f2b x:0 0 0 2024-09-13T18:30:17.291 INFO:tasks.workunit.client.1.smithi149.stdout:1/88: dwrite d9/f1c [0,4194304] 0 2024-09-13T18:30:17.309 INFO:tasks.workunit.client.1.smithi149.stdout:0/46: write d1/f5 [3792578,121571] 0 2024-09-13T18:30:17.309 INFO:tasks.workunit.client.1.smithi149.stdout:0/47: creat d1/d2/fb x:0 0 0 2024-09-13T18:30:17.312 INFO:tasks.workunit.client.1.smithi149.stdout:7/68: dwrite f5 [0,4194304] 0 2024-09-13T18:30:17.312 INFO:tasks.workunit.client.1.smithi149.stdout:7/69: stat d7/c16 0 2024-09-13T18:30:17.314 INFO:tasks.workunit.client.1.smithi149.stdout:8/76: dwrite d2/fe [0,4194304] 0 2024-09-13T18:30:17.314 INFO:tasks.workunit.client.1.smithi149.stdout:8/77: chown d2/d12/f16 228136 1 2024-09-13T18:30:17.314 INFO:tasks.workunit.client.1.smithi149.stdout:8/78: truncate d2/d12/f16 760494 0 2024-09-13T18:30:17.315 INFO:tasks.workunit.client.1.smithi149.stdout:7/70: creat d7/d12/f17 x:0 0 0 2024-09-13T18:30:17.315 INFO:tasks.workunit.client.1.smithi149.stdout:7/71: write d7/f8 [629291,64368] 0 2024-09-13T18:30:17.316 INFO:tasks.workunit.client.1.smithi149.stdout:8/79: dread d2/fc [0,4194304] 0 2024-09-13T18:30:17.317 INFO:tasks.workunit.client.1.smithi149.stdout:7/72: creat d7/d9/d15/f18 x:0 0 0 2024-09-13T18:30:17.337 INFO:tasks.workunit.client.1.smithi149.stdout:1/89: dwrite d9/f1c [0,4194304] 0 2024-09-13T18:30:17.338 INFO:tasks.workunit.client.1.smithi149.stdout:8/80: dwrite d2/f9 [0,4194304] 0 2024-09-13T18:30:17.341 INFO:tasks.workunit.client.1.smithi149.stdout:8/81: mknod d2/d12/d1b/c1e 0 2024-09-13T18:30:17.358 INFO:tasks.workunit.client.1.smithi149.stdout:1/90: dwrite f2 [0,4194304] 0 2024-09-13T18:30:17.359 INFO:tasks.workunit.client.1.smithi149.stdout:1/91: creat d9/d10/f1d x:0 0 0 2024-09-13T18:30:17.361 INFO:tasks.workunit.client.1.smithi149.stdout:1/92: symlink d9/d10/l1e 0 2024-09-13T18:30:17.376 INFO:tasks.workunit.client.1.smithi149.stdout:1/93: dwrite d9/d10/f1a [0,4194304] 0 2024-09-13T18:30:17.377 INFO:tasks.workunit.client.1.smithi149.stdout:1/94: mknod d9/c1f 0 2024-09-13T18:30:17.386 INFO:tasks.workunit.client.1.smithi149.stdout:1/95: read f2 [277384,119592] 0 2024-09-13T18:30:17.386 INFO:tasks.workunit.client.1.smithi149.stdout:1/96: chown d9/c1f 9 1 2024-09-13T18:30:17.388 INFO:tasks.workunit.client.1.smithi149.stdout:1/97: creat d9/d15/f20 x:0 0 0 2024-09-13T18:30:17.389 INFO:tasks.workunit.client.1.smithi149.stdout:1/98: mknod d9/d15/c21 0 2024-09-13T18:30:17.416 INFO:tasks.workunit.client.1.smithi149.stdout:1/99: dwrite d9/f1c [0,4194304] 0 2024-09-13T18:30:17.417 INFO:tasks.workunit.client.1.smithi149.stdout:1/100: chown d9/f11 37737786 1 2024-09-13T18:30:17.474 INFO:tasks.workunit.client.1.smithi149.stdout:5/81: dwrite d3/d8/d13/f18 [0,4194304] 0 2024-09-13T18:30:17.474 INFO:tasks.workunit.client.1.smithi149.stdout:5/82: truncate d3/d8/f9 2082507 0 2024-09-13T18:30:17.474 INFO:tasks.workunit.client.1.smithi149.stdout:5/83: fsync d3/f7 0 2024-09-13T18:30:17.474 INFO:tasks.workunit.client.1.smithi149.stdout:3/99: dwrite d1/f11 [0,4194304] 0 2024-09-13T18:30:17.474 INFO:tasks.workunit.client.1.smithi149.stdout:8/82: dwrite d2/fc [0,4194304] 0 2024-09-13T18:30:17.474 INFO:tasks.workunit.client.1.smithi149.stdout:6/78: dwrite f5 [0,4194304] 0 2024-09-13T18:30:17.475 INFO:tasks.workunit.client.1.smithi149.stdout:5/84: dread d3/f7 [0,4194304] 0 2024-09-13T18:30:17.476 INFO:tasks.workunit.client.1.smithi149.stdout:5/85: chown d3/f7 207616997 1 2024-09-13T18:30:17.477 INFO:tasks.workunit.client.1.smithi149.stdout:3/100: getdents d1/d4 0 2024-09-13T18:30:17.479 INFO:tasks.workunit.client.1.smithi149.stdout:1/101: rmdir d9/d10 39 2024-09-13T18:30:17.481 INFO:tasks.workunit.client.1.smithi149.stdout:8/83: rename d2/d12/c18 to d2/c1f 0 2024-09-13T18:30:17.482 INFO:tasks.workunit.client.1.smithi149.stdout:3/101: truncate d1/d4/da/f14 43633 0 2024-09-13T18:30:17.483 INFO:tasks.workunit.client.1.smithi149.stdout:1/102: unlink d9/cc 0 2024-09-13T18:30:17.484 INFO:tasks.workunit.client.1.smithi149.stdout:6/79: rename l3 to dc/l17 0 2024-09-13T18:30:17.485 INFO:tasks.workunit.client.1.smithi149.stdout:3/102: mkdir d1/d4/da/d1d 0 2024-09-13T18:30:17.485 INFO:tasks.workunit.client.1.smithi149.stdout:3/103: write d1/d4/da/f17 [393122,37103] 0 2024-09-13T18:30:17.486 INFO:tasks.workunit.client.1.smithi149.stdout:6/80: truncate f9 186554 0 2024-09-13T18:30:17.487 INFO:tasks.workunit.client.1.smithi149.stdout:3/104: rename d1/d4/l16 to d1/d4/l1e 0 2024-09-13T18:30:17.488 INFO:tasks.workunit.client.1.smithi149.stdout:5/86: write d3/d8/d13/f18 [4559541,23134] 0 2024-09-13T18:30:17.491 INFO:tasks.workunit.client.1.smithi149.stdout:4/113: sync 2024-09-13T18:30:17.491 INFO:tasks.workunit.client.1.smithi149.stdout:2/67: sync 2024-09-13T18:30:17.491 INFO:tasks.workunit.client.1.smithi149.stdout:9/55: sync 2024-09-13T18:30:17.491 INFO:tasks.workunit.client.1.smithi149.stdout:5/87: truncate d3/fc 831429 0 2024-09-13T18:30:17.494 INFO:tasks.workunit.client.1.smithi149.stdout:4/114: rename df/f19 to df/d11/d1c/f23 0 2024-09-13T18:30:17.494 INFO:tasks.workunit.client.1.smithi149.stdout:4/115: fsync df/f18 0 2024-09-13T18:30:17.494 INFO:tasks.workunit.client.1.smithi149.stdout:4/116: read - df/d11/d1c/f23 zero size 2024-09-13T18:30:17.494 INFO:tasks.workunit.client.1.smithi149.stdout:4/117: stat df/d11/d1c 0 2024-09-13T18:30:17.496 INFO:tasks.workunit.client.1.smithi149.stdout:2/68: link db/d10/f14 db/d10/f15 0 2024-09-13T18:30:17.503 INFO:tasks.workunit.client.1.smithi149.stdout:5/88: rename d3/d8/d13/c16 to d3/d10/c19 0 2024-09-13T18:30:17.504 INFO:tasks.workunit.client.1.smithi149.stdout:9/56: dread d0/f4 [0,4194304] 0 2024-09-13T18:30:17.505 INFO:tasks.workunit.client.1.smithi149.stdout:4/118: creat df/d11/d12/d21/f24 x:0 0 0 2024-09-13T18:30:17.505 INFO:tasks.workunit.client.1.smithi149.stdout:4/119: fsync df/d11/d12/d17/f1a 0 2024-09-13T18:30:17.506 INFO:tasks.workunit.client.1.smithi149.stdout:4/120: chown l2 883 1 2024-09-13T18:30:17.508 INFO:tasks.workunit.client.1.smithi149.stdout:2/69: unlink db/fe 0 2024-09-13T18:30:17.508 INFO:tasks.workunit.client.1.smithi149.stdout:2/70: dread - db/d10/f15 zero size 2024-09-13T18:30:17.509 INFO:tasks.workunit.client.1.smithi149.stdout:5/89: rmdir d3/d10 39 2024-09-13T18:30:17.510 INFO:tasks.workunit.client.1.smithi149.stdout:9/57: truncate d0/f14 124847 0 2024-09-13T18:30:17.510 INFO:tasks.workunit.client.1.smithi149.stdout:9/58: chown d0/cc 63991698 1 2024-09-13T18:30:17.511 INFO:tasks.workunit.client.1.smithi149.stdout:2/71: symlink db/l16 0 2024-09-13T18:30:17.512 INFO:tasks.workunit.client.1.smithi149.stdout:5/90: symlink d3/l1a 0 2024-09-13T18:30:17.512 INFO:tasks.workunit.client.1.smithi149.stdout:5/91: read f1 [1701949,78132] 0 2024-09-13T18:30:17.513 INFO:tasks.workunit.client.1.smithi149.stdout:5/92: write d3/d8/f11 [368628,26597] 0 2024-09-13T18:30:17.514 INFO:tasks.workunit.client.1.smithi149.stdout:9/59: rename d0/f12 to d0/f17 0 2024-09-13T18:30:17.515 INFO:tasks.workunit.client.1.smithi149.stdout:2/72: creat db/f17 x:0 0 0 2024-09-13T18:30:17.516 INFO:tasks.workunit.client.1.smithi149.stdout:2/73: chown l3 649 1 2024-09-13T18:30:17.518 INFO:tasks.workunit.client.1.smithi149.stdout:1/103: dwrite f2 [0,4194304] 0 2024-09-13T18:30:17.518 INFO:tasks.workunit.client.1.smithi149.stdout:1/104: write d9/d10/f1d [948303,32654] 0 2024-09-13T18:30:17.518 INFO:tasks.workunit.client.1.smithi149.stdout:1/105: write d9/d15/f20 [825105,85646] 0 2024-09-13T18:30:17.518 INFO:tasks.workunit.client.1.smithi149.stdout:5/93: symlink d3/d8/d13/l1b 0 2024-09-13T18:30:17.518 INFO:tasks.workunit.client.1.smithi149.stdout:6/81: dwrite f5 [0,4194304] 0 2024-09-13T18:30:17.519 INFO:tasks.workunit.client.1.smithi149.stdout:9/60: mkdir d0/d18 0 2024-09-13T18:30:17.519 INFO:tasks.workunit.client.1.smithi149.stdout:9/61: chown d0/f14 309 1 2024-09-13T18:30:17.520 INFO:tasks.workunit.client.1.smithi149.stdout:3/105: dwrite d1/f19 [0,4194304] 0 2024-09-13T18:30:17.520 INFO:tasks.workunit.client.1.smithi149.stdout:2/74: link f4 db/d13/f18 0 2024-09-13T18:30:17.525 INFO:tasks.workunit.client.1.smithi149.stdout:1/106: creat d9/d10/f22 x:0 0 0 2024-09-13T18:30:17.526 INFO:tasks.workunit.client.1.smithi149.stdout:5/94: truncate d3/f4 3793508 0 2024-09-13T18:30:17.528 INFO:tasks.workunit.client.1.smithi149.stdout:6/82: rename dc/c13 to dc/d15/c18 0 2024-09-13T18:30:17.528 INFO:tasks.workunit.client.1.smithi149.stdout:9/62: dread d0/ff [0,4194304] 0 2024-09-13T18:30:17.528 INFO:tasks.workunit.client.1.smithi149.stdout:9/63: fdatasync d0/f14 0 2024-09-13T18:30:17.529 INFO:tasks.workunit.client.1.smithi149.stdout:4/121: dwrite df/f15 [0,4194304] 0 2024-09-13T18:30:17.530 INFO:tasks.workunit.client.1.smithi149.stdout:3/106: rmdir d1 39 2024-09-13T18:30:17.530 INFO:tasks.workunit.client.1.smithi149.stdout:3/107: fsync d1/f19 0 2024-09-13T18:30:17.533 INFO:tasks.workunit.client.1.smithi149.stdout:1/107: symlink d9/l23 0 2024-09-13T18:30:17.537 INFO:tasks.workunit.client.1.smithi149.stdout:5/95: rename d3/d8/f11 to d3/d10/f1c 0 2024-09-13T18:30:17.538 INFO:tasks.workunit.client.1.smithi149.stdout:9/64: mkdir d0/d18/d19 0 2024-09-13T18:30:17.539 INFO:tasks.workunit.client.1.smithi149.stdout:0/48: sync 2024-09-13T18:30:17.539 INFO:tasks.workunit.client.1.smithi149.stdout:7/73: sync 2024-09-13T18:30:17.539 INFO:tasks.workunit.client.1.smithi149.stdout:7/74: write d7/f8 [2299815,101520] 0 2024-09-13T18:30:17.539 INFO:tasks.workunit.client.1.smithi149.stdout:7/75: readlink d7/lb 0 2024-09-13T18:30:17.539 INFO:tasks.workunit.client.1.smithi149.stdout:7/76: write d7/d9/fa [1294742,4314] 0 2024-09-13T18:30:17.539 INFO:tasks.workunit.client.1.smithi149.stdout:7/77: chown f5 926865964 1 2024-09-13T18:30:17.540 INFO:tasks.workunit.client.1.smithi149.stdout:7/78: read d7/f8 [2066714,59627] 0 2024-09-13T18:30:17.540 INFO:tasks.workunit.client.1.smithi149.stdout:7/79: write d7/d9/d15/f18 [187353,17536] 0 2024-09-13T18:30:17.540 INFO:tasks.workunit.client.1.smithi149.stdout:3/108: rmdir d1 39 2024-09-13T18:30:17.542 INFO:tasks.workunit.client.1.smithi149.stdout:2/75: truncate f1 742537 0 2024-09-13T18:30:17.545 INFO:tasks.workunit.client.1.smithi149.stdout:1/108: symlink d9/l24 0 2024-09-13T18:30:17.545 INFO:tasks.workunit.client.1.smithi149.stdout:5/96: getdents d3 0 2024-09-13T18:30:17.546 INFO:tasks.workunit.client.1.smithi149.stdout:5/97: fsync f1 0 2024-09-13T18:30:17.546 INFO:tasks.workunit.client.1.smithi149.stdout:7/80: mknod d7/c19 0 2024-09-13T18:30:17.546 INFO:tasks.workunit.client.1.smithi149.stdout:7/81: chown d7/f8 42130866 1 2024-09-13T18:30:17.546 INFO:tasks.workunit.client.1.smithi149.stdout:7/82: write d7/f8 [3445213,93555] 0 2024-09-13T18:30:17.546 INFO:tasks.workunit.client.1.smithi149.stdout:7/83: chown d7/d12/f17 2790 1 2024-09-13T18:30:17.547 INFO:tasks.workunit.client.1.smithi149.stdout:3/109: rename d1/d4/le to d1/d4/da/d1d/l1f 0 2024-09-13T18:30:17.547 INFO:tasks.workunit.client.1.smithi149.stdout:2/76: mknod db/d10/d12/c19 0 2024-09-13T18:30:17.548 INFO:tasks.workunit.client.1.smithi149.stdout:2/77: readlink db/l16 0 2024-09-13T18:30:17.548 INFO:tasks.workunit.client.1.smithi149.stdout:1/109: mkdir d9/d15/d25 0 2024-09-13T18:30:17.550 INFO:tasks.workunit.client.1.smithi149.stdout:3/110: dread d1/d4/da/f14 [0,4194304] 0 2024-09-13T18:30:17.550 INFO:tasks.workunit.client.1.smithi149.stdout:7/84: creat d7/d9/d11/f1a x:0 0 0 2024-09-13T18:30:17.551 INFO:tasks.workunit.client.1.smithi149.stdout:2/78: getdents db/d13 0 2024-09-13T18:30:17.551 INFO:tasks.workunit.client.1.smithi149.stdout:2/79: creat db/d10/f1a x:0 0 0 2024-09-13T18:30:17.552 INFO:tasks.workunit.client.1.smithi149.stdout:2/80: fsync fa 0 2024-09-13T18:30:17.553 INFO:tasks.workunit.client.1.smithi149.stdout:5/98: dread d3/f7 [0,4194304] 0 2024-09-13T18:30:17.553 INFO:tasks.workunit.client.1.smithi149.stdout:1/110: mknod d9/d15/c26 0 2024-09-13T18:30:17.553 INFO:tasks.workunit.client.1.smithi149.stdout:1/111: chown d9/d10/c19 2198 1 2024-09-13T18:30:17.555 INFO:tasks.workunit.client.1.smithi149.stdout:3/111: mkdir d1/d12/d20 0 2024-09-13T18:30:17.557 INFO:tasks.workunit.client.1.smithi149.stdout:7/85: mkdir d7/d9/d1b 0 2024-09-13T18:30:17.559 INFO:tasks.workunit.client.1.smithi149.stdout:2/81: mkdir db/d1b 0 2024-09-13T18:30:17.561 INFO:tasks.workunit.client.1.smithi149.stdout:5/99: symlink d3/l1d 0 2024-09-13T18:30:17.561 INFO:tasks.workunit.client.1.smithi149.stdout:5/100: chown f1 1167 1 2024-09-13T18:30:17.562 INFO:tasks.workunit.client.1.smithi149.stdout:7/86: mkdir d7/d9/d1c 0 2024-09-13T18:30:17.562 INFO:tasks.workunit.client.1.smithi149.stdout:7/87: chown d7/c19 87 1 2024-09-13T18:30:17.568 INFO:tasks.workunit.client.1.smithi149.stdout:1/112: dread d9/d10/f1a [0,4194304] 0 2024-09-13T18:30:17.569 INFO:tasks.workunit.client.1.smithi149.stdout:0/49: dwrite d1/d2/fb [0,4194304] 0 2024-09-13T18:30:17.569 INFO:tasks.workunit.client.1.smithi149.stdout:0/50: stat d1/d2 0 2024-09-13T18:30:17.570 INFO:tasks.workunit.client.1.smithi149.stdout:1/113: read d9/d15/f20 [187417,73674] 0 2024-09-13T18:30:17.570 INFO:tasks.workunit.client.1.smithi149.stdout:5/101: dread f1 [0,4194304] 0 2024-09-13T18:30:17.571 INFO:tasks.workunit.client.1.smithi149.stdout:4/122: dwrite fe [8388608,4194304] 0 2024-09-13T18:30:17.571 INFO:tasks.workunit.client.1.smithi149.stdout:5/102: truncate d3/fc 1430389 0 2024-09-13T18:30:17.571 INFO:tasks.workunit.client.1.smithi149.stdout:5/103: creat d3/d8/f1e x:0 0 0 2024-09-13T18:30:17.571 INFO:tasks.workunit.client.1.smithi149.stdout:4/123: creat df/d11/d12/d21/f25 x:0 0 0 2024-09-13T18:30:17.571 INFO:tasks.workunit.client.1.smithi149.stdout:9/65: dwrite d0/fa [0,4194304] 0 2024-09-13T18:30:17.574 INFO:tasks.workunit.client.1.smithi149.stdout:0/51: mknod d1/cc 0 2024-09-13T18:30:17.574 INFO:tasks.workunit.client.1.smithi149.stdout:0/52: write d1/d2/fa [980374,126744] 0 2024-09-13T18:30:17.574 INFO:tasks.workunit.client.1.smithi149.stdout:6/83: dwrite f8 [0,4194304] 0 2024-09-13T18:30:17.576 INFO:tasks.workunit.client.1.smithi149.stdout:1/114: unlink f5 0 2024-09-13T18:30:17.579 INFO:tasks.workunit.client.1.smithi149.stdout:5/104: creat d3/d10/f1f x:0 0 0 2024-09-13T18:30:17.582 INFO:tasks.workunit.client.1.smithi149.stdout:9/66: rename d0/f14 to d0/f1a 0 2024-09-13T18:30:17.583 INFO:tasks.workunit.client.1.smithi149.stdout:0/53: unlink d1/f8 0 2024-09-13T18:30:17.583 INFO:tasks.workunit.client.1.smithi149.stdout:0/54: readlink d1/l7 0 2024-09-13T18:30:17.583 INFO:tasks.workunit.client.1.smithi149.stdout:0/55: creat d1/d2/fd x:0 0 0 2024-09-13T18:30:17.584 INFO:tasks.workunit.client.1.smithi149.stdout:6/84: mknod dc/c19 0 2024-09-13T18:30:17.584 INFO:tasks.workunit.client.1.smithi149.stdout:6/85: creat dc/f1a x:0 0 0 2024-09-13T18:30:17.585 INFO:tasks.workunit.client.1.smithi149.stdout:1/115: link d9/f1c d9/d10/f27 0 2024-09-13T18:30:17.585 INFO:tasks.workunit.client.1.smithi149.stdout:1/116: dread - d9/d10/f22 zero size 2024-09-13T18:30:17.586 INFO:tasks.workunit.client.1.smithi149.stdout:4/124: rmdir df/d11/d12/d17 39 2024-09-13T18:30:17.587 INFO:tasks.workunit.client.1.smithi149.stdout:4/125: fsync f0 0 2024-09-13T18:30:17.587 INFO:tasks.workunit.client.1.smithi149.stdout:9/67: creat d0/d18/d19/f1b x:0 0 0 2024-09-13T18:30:17.587 INFO:tasks.workunit.client.1.smithi149.stdout:4/126: chown df/f20 488566 1 2024-09-13T18:30:17.587 INFO:tasks.workunit.client.1.smithi149.stdout:4/127: dread - df/d11/d12/d21/f24 zero size 2024-09-13T18:30:17.587 INFO:tasks.workunit.client.1.smithi149.stdout:3/112: dwrite d1/f11 [0,4194304] 0 2024-09-13T18:30:17.588 INFO:tasks.workunit.client.1.smithi149.stdout:0/56: truncate d1/f5 2065959 0 2024-09-13T18:30:17.588 INFO:tasks.workunit.client.1.smithi149.stdout:0/57: chown d1/l7 265 1 2024-09-13T18:30:17.588 INFO:tasks.workunit.client.1.smithi149.stdout:0/58: readlink d1/l9 0 2024-09-13T18:30:17.588 INFO:tasks.workunit.client.1.smithi149.stdout:0/59: readlink d1/l7 0 2024-09-13T18:30:17.590 INFO:tasks.workunit.client.1.smithi149.stdout:1/117: mknod d9/d15/d25/c28 0 2024-09-13T18:30:17.591 INFO:tasks.workunit.client.1.smithi149.stdout:1/118: creat d9/d15/f29 x:0 0 0 2024-09-13T18:30:17.591 INFO:tasks.workunit.client.1.smithi149.stdout:5/105: read d3/f4 [2206969,92782] 0 2024-09-13T18:30:17.591 INFO:tasks.workunit.client.1.smithi149.stdout:5/106: write d3/d10/f1c [325712,96679] 0 2024-09-13T18:30:17.591 INFO:tasks.workunit.client.1.smithi149.stdout:5/107: read - d3/fd zero size 2024-09-13T18:30:17.593 INFO:tasks.workunit.client.1.smithi149.stdout:4/128: mknod df/d11/d12/d21/d22/c26 0 2024-09-13T18:30:17.596 INFO:tasks.workunit.client.1.smithi149.stdout:2/82: dwrite db/d10/f14 [0,4194304] 0 2024-09-13T18:30:17.596 INFO:tasks.workunit.client.1.smithi149.stdout:2/83: truncate db/f17 729781 0 2024-09-13T18:30:17.597 INFO:tasks.workunit.client.1.smithi149.stdout:7/88: dwrite f5 [0,4194304] 0 2024-09-13T18:30:17.597 INFO:tasks.workunit.client.1.smithi149.stdout:3/113: unlink d1/fb 0 2024-09-13T18:30:17.597 INFO:tasks.workunit.client.1.smithi149.stdout:3/114: fdatasync d1/d12/f1a 0 2024-09-13T18:30:17.599 INFO:tasks.workunit.client.1.smithi149.stdout:1/119: truncate f2 3563839 0 2024-09-13T18:30:17.602 INFO:tasks.workunit.client.1.smithi149.stdout:4/129: rename df/f10 to df/d11/d12/d17/f27 0 2024-09-13T18:30:17.602 INFO:tasks.workunit.client.1.smithi149.stdout:4/130: fdatasync df/d11/f16 0 2024-09-13T18:30:17.602 INFO:tasks.workunit.client.1.smithi149.stdout:7/89: dread f3 [0,4194304] 0 2024-09-13T18:30:17.604 INFO:tasks.workunit.client.1.smithi149.stdout:6/86: dwrite f5 [0,4194304] 0 2024-09-13T18:30:17.612 INFO:tasks.workunit.client.1.smithi149.stdout:2/84: write db/d10/f11 [1468307,43297] 0 2024-09-13T18:30:17.613 INFO:tasks.workunit.client.1.smithi149.stdout:9/68: rmdir d0 39 2024-09-13T18:30:17.613 INFO:tasks.workunit.client.1.smithi149.stdout:9/69: read d0/ff [964129,123586] 0 2024-09-13T18:30:17.616 INFO:tasks.workunit.client.1.smithi149.stdout:1/120: unlink d9/f11 0 2024-09-13T18:30:17.617 INFO:tasks.workunit.client.1.smithi149.stdout:5/108: rmdir d3/d8/d13 39 2024-09-13T18:30:17.617 INFO:tasks.workunit.client.1.smithi149.stdout:5/109: chown d3/d10 3994870 1 2024-09-13T18:30:17.617 INFO:tasks.workunit.client.1.smithi149.stdout:4/131: symlink df/l28 0 2024-09-13T18:30:17.619 INFO:tasks.workunit.client.1.smithi149.stdout:6/87: symlink dc/l1b 0 2024-09-13T18:30:17.619 INFO:tasks.workunit.client.1.smithi149.stdout:6/88: fdatasync f8 0 2024-09-13T18:30:17.621 INFO:tasks.workunit.client.1.smithi149.stdout:2/85: mkdir db/d1b/d1c 0 2024-09-13T18:30:17.622 INFO:tasks.workunit.client.1.smithi149.stdout:7/90: dwrite f5 [0,4194304] 0 2024-09-13T18:30:17.622 INFO:tasks.workunit.client.1.smithi149.stdout:9/70: symlink d0/d18/d19/l1c 0 2024-09-13T18:30:17.623 INFO:tasks.workunit.client.1.smithi149.stdout:3/115: getdents d1/d12 0 2024-09-13T18:30:17.626 INFO:tasks.workunit.client.1.smithi149.stdout:5/110: creat d3/f20 x:0 0 0 2024-09-13T18:30:17.627 INFO:tasks.workunit.client.1.smithi149.stdout:4/132: rename f4 to df/f29 0 2024-09-13T18:30:17.627 INFO:tasks.workunit.client.1.smithi149.stdout:4/133: chown df/f20 13057411 1 2024-09-13T18:30:17.631 INFO:tasks.workunit.client.1.smithi149.stdout:2/86: creat db/d1b/d1c/f1d x:0 0 0 2024-09-13T18:30:17.631 INFO:tasks.workunit.client.1.smithi149.stdout:2/87: stat db/d10/f14 0 2024-09-13T18:30:17.631 INFO:tasks.workunit.client.1.smithi149.stdout:3/116: mkdir d1/d21 0 2024-09-13T18:30:17.631 INFO:tasks.workunit.client.1.smithi149.stdout:3/117: chown d1/d12/f1a 15 1 2024-09-13T18:30:17.632 INFO:tasks.workunit.client.1.smithi149.stdout:5/111: symlink d3/d10/l21 0 2024-09-13T18:30:17.632 INFO:tasks.workunit.client.1.smithi149.stdout:5/112: readlink d3/l1d 0 2024-09-13T18:30:17.633 INFO:tasks.workunit.client.1.smithi149.stdout:5/113: dread - d3/fd zero size 2024-09-13T18:30:17.634 INFO:tasks.workunit.client.1.smithi149.stdout:4/134: rename df/f18 to df/d11/f2a 0 2024-09-13T18:30:17.634 INFO:tasks.workunit.client.1.smithi149.stdout:4/135: fsync df/f15 0 2024-09-13T18:30:17.634 INFO:tasks.workunit.client.1.smithi149.stdout:4/136: truncate df/d11/d1c/f23 206655 0 2024-09-13T18:30:17.634 INFO:tasks.workunit.client.1.smithi149.stdout:4/137: fdatasync df/d11/d1c/f23 0 2024-09-13T18:30:17.634 INFO:tasks.workunit.client.1.smithi149.stdout:4/138: chown df/d11/f16 16117 1 2024-09-13T18:30:17.634 INFO:tasks.workunit.client.1.smithi149.stdout:8/84: sync 2024-09-13T18:30:17.635 INFO:tasks.workunit.client.1.smithi149.stdout:3/118: symlink d1/d4/l22 0 2024-09-13T18:30:17.637 INFO:tasks.workunit.client.1.smithi149.stdout:7/91: dread f5 [0,4194304] 0 2024-09-13T18:30:17.637 INFO:tasks.workunit.client.1.smithi149.stdout:5/114: unlink f1 0 2024-09-13T18:30:17.637 INFO:tasks.workunit.client.1.smithi149.stdout:5/115: dread - d3/d8/f1e zero size 2024-09-13T18:30:17.637 INFO:tasks.workunit.client.1.smithi149.stdout:5/116: dread - d3/fd zero size 2024-09-13T18:30:17.637 INFO:tasks.workunit.client.1.smithi149.stdout:2/88: rename db/d10/f11 to db/d1b/d1c/f1e 0 2024-09-13T18:30:17.638 INFO:tasks.workunit.client.1.smithi149.stdout:8/85: link d2/d12/c1d d2/d13/c20 0 2024-09-13T18:30:17.640 INFO:tasks.workunit.client.1.smithi149.stdout:5/117: dread d3/f7 [0,4194304] 0 2024-09-13T18:30:17.641 INFO:tasks.workunit.client.1.smithi149.stdout:7/92: creat d7/d9/f1d x:0 0 0 2024-09-13T18:30:17.641 INFO:tasks.workunit.client.1.smithi149.stdout:7/93: chown d7/d9/f1d 180 1 2024-09-13T18:30:17.643 INFO:tasks.workunit.client.1.smithi149.stdout:1/121: getdents d9 0 2024-09-13T18:30:17.650 INFO:tasks.workunit.client.1.smithi149.stdout:7/94: mknod d7/d12/c1e 0 2024-09-13T18:30:17.650 INFO:tasks.workunit.client.1.smithi149.stdout:6/89: getdents dc 0 2024-09-13T18:30:17.650 INFO:tasks.workunit.client.1.smithi149.stdout:6/90: stat f9 0 2024-09-13T18:30:17.650 INFO:tasks.workunit.client.1.smithi149.stdout:2/89: truncate db/d1b/d1c/f1e 1692551 0 2024-09-13T18:30:17.650 INFO:tasks.workunit.client.1.smithi149.stdout:2/90: fdatasync db/d1b/d1c/f1d 0 2024-09-13T18:30:17.650 INFO:tasks.workunit.client.1.smithi149.stdout:2/91: fsync f6 0 2024-09-13T18:30:17.650 INFO:tasks.workunit.client.1.smithi149.stdout:2/92: fdatasync db/d10/f14 0 2024-09-13T18:30:17.650 INFO:tasks.workunit.client.1.smithi149.stdout:2/93: creat db/d1b/d1c/f1f x:0 0 0 2024-09-13T18:30:17.650 INFO:tasks.workunit.client.1.smithi149.stdout:2/94: chown db/fd 744 1 2024-09-13T18:30:17.651 INFO:tasks.workunit.client.1.smithi149.stdout:2/95: dread - db/d10/f1a zero size 2024-09-13T18:30:17.651 INFO:tasks.workunit.client.1.smithi149.stdout:7/95: mkdir d7/d9/d1c/d1f 0 2024-09-13T18:30:17.651 INFO:tasks.workunit.client.1.smithi149.stdout:2/96: mkdir db/d1b/d1c/d20 0 2024-09-13T18:30:17.651 INFO:tasks.workunit.client.1.smithi149.stdout:2/97: truncate db/f17 1541447 0 2024-09-13T18:30:17.652 INFO:tasks.workunit.client.1.smithi149.stdout:9/71: dwrite d0/fa [0,4194304] 0 2024-09-13T18:30:17.652 INFO:tasks.workunit.client.1.smithi149.stdout:3/119: dread d1/f19 [0,4194304] 0 2024-09-13T18:30:17.656 INFO:tasks.workunit.client.1.smithi149.stdout:7/96: write f3 [4137721,126001] 0 2024-09-13T18:30:17.658 INFO:tasks.workunit.client.1.smithi149.stdout:7/97: dread d7/d9/d15/f18 [0,4194304] 0 2024-09-13T18:30:17.659 INFO:tasks.workunit.client.1.smithi149.stdout:7/98: truncate d7/d9/d15/f18 905099 0 2024-09-13T18:30:17.660 INFO:tasks.workunit.client.1.smithi149.stdout:9/72: unlink d0/f17 0 2024-09-13T18:30:17.660 INFO:tasks.workunit.client.1.smithi149.stdout:9/73: fdatasync d0/f4 0 2024-09-13T18:30:17.661 INFO:tasks.workunit.client.1.smithi149.stdout:3/120: creat d1/d4/da/d1d/f23 x:0 0 0 2024-09-13T18:30:17.662 INFO:tasks.workunit.client.1.smithi149.stdout:7/99: mknod d7/d12/c20 0 2024-09-13T18:30:17.664 INFO:tasks.workunit.client.1.smithi149.stdout:9/74: unlink d0/d18/d19/f1b 0 2024-09-13T18:30:17.665 INFO:tasks.workunit.client.1.smithi149.stdout:3/121: truncate d1/d4/fd 77097 0 2024-09-13T18:30:17.665 INFO:tasks.workunit.client.1.smithi149.stdout:3/122: chown d1/f19 52 1 2024-09-13T18:30:17.666 INFO:tasks.workunit.client.1.smithi149.stdout:9/75: link d0/c8 d0/d18/c1d 0 2024-09-13T18:30:17.667 INFO:tasks.workunit.client.1.smithi149.stdout:1/122: dread f3 [0,4194304] 0 2024-09-13T18:30:17.667 INFO:tasks.workunit.client.1.smithi149.stdout:4/139: dwrite df/d11/f2a [0,4194304] 0 2024-09-13T18:30:17.668 INFO:tasks.workunit.client.1.smithi149.stdout:9/76: dread d0/f4 [0,4194304] 0 2024-09-13T18:30:17.669 INFO:tasks.workunit.client.1.smithi149.stdout:1/123: mkdir d9/d10/d2a 0 2024-09-13T18:30:17.669 INFO:tasks.workunit.client.1.smithi149.stdout:1/124: chown c4 7788 1 2024-09-13T18:30:17.670 INFO:tasks.workunit.client.1.smithi149.stdout:5/118: dwrite d3/f7 [0,4194304] 0 2024-09-13T18:30:17.673 INFO:tasks.workunit.client.1.smithi149.stdout:4/140: rename df/f1b to df/f2b 0 2024-09-13T18:30:17.673 INFO:tasks.workunit.client.1.smithi149.stdout:4/141: fsync fa 0 2024-09-13T18:30:17.677 INFO:tasks.workunit.client.1.smithi149.stdout:4/142: symlink df/d11/d12/l2c 0 2024-09-13T18:30:17.677 INFO:tasks.workunit.client.1.smithi149.stdout:4/143: truncate df/d11/d1c/f23 787313 0 2024-09-13T18:30:17.677 INFO:tasks.workunit.client.1.smithi149.stdout:4/144: chown fc 0 1 2024-09-13T18:30:17.678 INFO:tasks.workunit.client.1.smithi149.stdout:4/145: rename l2 to df/l2d 0 2024-09-13T18:30:17.679 INFO:tasks.workunit.client.1.smithi149.stdout:4/146: chown df/d11/f16 25252817 1 2024-09-13T18:30:17.689 INFO:tasks.workunit.client.1.smithi149.stdout:3/123: write d1/f19 [4108532,120235] 0 2024-09-13T18:30:17.692 INFO:tasks.workunit.client.1.smithi149.stdout:2/98: dwrite db/f17 [0,4194304] 0 2024-09-13T18:30:17.692 INFO:tasks.workunit.client.1.smithi149.stdout:2/99: readlink db/l16 0 2024-09-13T18:30:17.696 INFO:tasks.workunit.client.1.smithi149.stdout:3/124: creat d1/f24 x:0 0 0 2024-09-13T18:30:17.699 INFO:tasks.workunit.client.1.smithi149.stdout:2/100: creat db/d1b/f21 x:0 0 0 2024-09-13T18:30:17.700 INFO:tasks.workunit.client.1.smithi149.stdout:2/101: truncate db/f17 4524307 0 2024-09-13T18:30:17.700 INFO:tasks.workunit.client.1.smithi149.stdout:2/102: write fa [1189455,1593] 0 2024-09-13T18:30:17.700 INFO:tasks.workunit.client.1.smithi149.stdout:2/103: getdents db/d1b/d1c/d20 0 2024-09-13T18:30:17.700 INFO:tasks.workunit.client.1.smithi149.stdout:2/104: readlink l3 0 2024-09-13T18:30:17.701 INFO:tasks.workunit.client.1.smithi149.stdout:2/105: symlink db/d1b/d1c/l22 0 2024-09-13T18:30:17.701 INFO:tasks.workunit.client.1.smithi149.stdout:2/106: chown db 215550 1 2024-09-13T18:30:17.703 INFO:tasks.workunit.client.1.smithi149.stdout:7/100: dwrite f3 [0,4194304] 0 2024-09-13T18:30:17.704 INFO:tasks.workunit.client.1.smithi149.stdout:7/101: dread - d7/d12/f17 zero size 2024-09-13T18:30:17.704 INFO:tasks.workunit.client.1.smithi149.stdout:2/107: mkdir db/d1b/d1c/d23 0 2024-09-13T18:30:17.704 INFO:tasks.workunit.client.1.smithi149.stdout:2/108: chown db/l16 405550319 1 2024-09-13T18:30:17.705 INFO:tasks.workunit.client.1.smithi149.stdout:2/109: getdents db/d1b/d1c/d20 0 2024-09-13T18:30:17.705 INFO:tasks.workunit.client.1.smithi149.stdout:2/110: chown db/ff 1 1 2024-09-13T18:30:17.705 INFO:tasks.workunit.client.1.smithi149.stdout:2/111: chown db/d1b/d1c/d20 20 1 2024-09-13T18:30:17.705 INFO:tasks.workunit.client.1.smithi149.stdout:2/112: fdatasync db/d10/f1a 0 2024-09-13T18:30:17.705 INFO:tasks.workunit.client.1.smithi149.stdout:2/113: dread - db/d10/f1a zero size 2024-09-13T18:30:17.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/102: mkdir d7/d9/d1c/d1f/d21 0 2024-09-13T18:30:17.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/103: write d7/d9/fa [1377400,41185] 0 2024-09-13T18:30:17.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/104: chown c6 10847186 1 2024-09-13T18:30:17.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/105: stat d7/c19 0 2024-09-13T18:30:17.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/106: chown f3 212 1 2024-09-13T18:30:17.706 INFO:tasks.workunit.client.1.smithi149.stdout:2/114: mkdir db/d10/d12/d24 0 2024-09-13T18:30:17.706 INFO:tasks.workunit.client.1.smithi149.stdout:2/115: fdatasync f4 0 2024-09-13T18:30:17.707 INFO:tasks.workunit.client.1.smithi149.stdout:7/107: creat d7/f22 x:0 0 0 2024-09-13T18:30:17.707 INFO:tasks.workunit.client.1.smithi149.stdout:7/108: rmdir d7/d9/d11 39 2024-09-13T18:30:17.708 INFO:tasks.workunit.client.1.smithi149.stdout:1/125: dwrite d9/f1c [0,4194304] 0 2024-09-13T18:30:17.709 INFO:tasks.workunit.client.1.smithi149.stdout:1/126: mknod d9/c2b 0 2024-09-13T18:30:17.719 INFO:tasks.workunit.client.1.smithi149.stdout:5/119: dwrite d3/f7 [0,4194304] 0 2024-09-13T18:30:17.720 INFO:tasks.workunit.client.1.smithi149.stdout:3/125: rmdir d1 39 2024-09-13T18:30:17.723 INFO:tasks.workunit.client.1.smithi149.stdout:2/116: write db/fd [4075668,49824] 0 2024-09-13T18:30:17.723 INFO:tasks.workunit.client.1.smithi149.stdout:3/126: mkdir d1/d4/da/d25 0 2024-09-13T18:30:17.723 INFO:tasks.workunit.client.1.smithi149.stdout:3/127: truncate d1/d4/da/d1d/f23 784544 0 2024-09-13T18:30:17.725 INFO:tasks.workunit.client.1.smithi149.stdout:3/128: creat d1/d4/da/d25/f26 x:0 0 0 2024-09-13T18:30:17.725 INFO:tasks.workunit.client.1.smithi149.stdout:3/129: chown d1/c18 2 1 2024-09-13T18:30:17.725 INFO:tasks.workunit.client.1.smithi149.stdout:2/117: getdents db/d1b/d1c 0 2024-09-13T18:30:17.725 INFO:tasks.workunit.client.1.smithi149.stdout:2/118: truncate db/d10/f1a 772491 0 2024-09-13T18:30:17.726 INFO:tasks.workunit.client.1.smithi149.stdout:2/119: creat db/d10/f25 x:0 0 0 2024-09-13T18:30:17.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/130: creat d1/d21/f27 x:0 0 0 2024-09-13T18:30:17.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/131: chown d1/d4/l1e 491764702 1 2024-09-13T18:30:17.727 INFO:tasks.workunit.client.1.smithi149.stdout:2/120: rmdir db/d1b/d1c/d23 0 2024-09-13T18:30:17.728 INFO:tasks.workunit.client.1.smithi149.stdout:3/132: mknod d1/d4/da/c28 0 2024-09-13T18:30:17.730 INFO:tasks.workunit.client.1.smithi149.stdout:3/133: mknod d1/d12/c29 0 2024-09-13T18:30:17.731 INFO:tasks.workunit.client.1.smithi149.stdout:3/134: dread d1/d4/da/f14 [0,4194304] 0 2024-09-13T18:30:17.731 INFO:tasks.workunit.client.1.smithi149.stdout:3/135: chown d1/d12/c29 1 1 2024-09-13T18:30:17.732 INFO:tasks.workunit.client.1.smithi149.stdout:3/136: dread d1/d4/da/f14 [0,4194304] 0 2024-09-13T18:30:17.732 INFO:tasks.workunit.client.1.smithi149.stdout:3/137: truncate d1/f11 3454413 0 2024-09-13T18:30:17.733 INFO:tasks.workunit.client.1.smithi149.stdout:4/147: dwrite df/f20 [0,4194304] 0 2024-09-13T18:30:17.734 INFO:tasks.workunit.client.1.smithi149.stdout:3/138: rename d1/d4/da/c28 to d1/d4/da/d25/c2a 0 2024-09-13T18:30:17.736 INFO:tasks.workunit.client.1.smithi149.stdout:4/148: rmdir df/d11/d1c 39 2024-09-13T18:30:17.737 INFO:tasks.workunit.client.1.smithi149.stdout:3/139: link d1/d21/f27 d1/d4/da/d1d/f2b 0 2024-09-13T18:30:17.737 INFO:tasks.workunit.client.1.smithi149.stdout:3/140: write d1/d4/da/d1d/f23 [1283709,24893] 0 2024-09-13T18:30:17.739 INFO:tasks.workunit.client.1.smithi149.stdout:3/141: mkdir d1/d2c 0 2024-09-13T18:30:17.739 INFO:tasks.workunit.client.1.smithi149.stdout:3/142: truncate d1/d4/da/f14 238906 0 2024-09-13T18:30:17.739 INFO:tasks.workunit.client.1.smithi149.stdout:2/121: write db/d10/f14 [2498463,36786] 0 2024-09-13T18:30:17.740 INFO:tasks.workunit.client.1.smithi149.stdout:3/143: mknod d1/d4/da/d1d/c2d 0 2024-09-13T18:30:17.740 INFO:tasks.workunit.client.1.smithi149.stdout:3/144: readlink d1/l7 0 2024-09-13T18:30:17.743 INFO:tasks.workunit.client.1.smithi149.stdout:9/77: dwrite d0/fe [0,4194304] 0 2024-09-13T18:30:17.746 INFO:tasks.workunit.client.1.smithi149.stdout:7/109: dwrite d7/d9/f1d [0,4194304] 0 2024-09-13T18:30:17.746 INFO:tasks.workunit.client.1.smithi149.stdout:5/120: dwrite d3/f4 [4194304,4194304] 0 2024-09-13T18:30:17.746 INFO:tasks.workunit.client.1.smithi149.stdout:1/127: dwrite d9/d10/f1d [0,4194304] 0 2024-09-13T18:30:17.753 INFO:tasks.workunit.client.1.smithi149.stdout:2/122: dread f4 [0,4194304] 0 2024-09-13T18:30:17.754 INFO:tasks.workunit.client.1.smithi149.stdout:9/78: dread d0/f9 [0,4194304] 0 2024-09-13T18:30:17.754 INFO:tasks.workunit.client.1.smithi149.stdout:4/149: dwrite df/d11/f16 [0,4194304] 0 2024-09-13T18:30:17.758 INFO:tasks.workunit.client.1.smithi149.stdout:5/121: creat d3/d8/d13/f22 x:0 0 0 2024-09-13T18:30:17.764 INFO:tasks.workunit.client.1.smithi149.stdout:3/145: rename d1/d4/da to d1/d2e 0 2024-09-13T18:30:17.764 INFO:tasks.workunit.client.1.smithi149.stdout:1/128: getdents d9 0 2024-09-13T18:30:17.765 INFO:tasks.workunit.client.1.smithi149.stdout:5/122: write d3/f4 [4379380,100833] 0 2024-09-13T18:30:17.765 INFO:tasks.workunit.client.1.smithi149.stdout:5/123: creat d3/d10/f23 x:0 0 0 2024-09-13T18:30:17.767 INFO:tasks.workunit.client.1.smithi149.stdout:9/79: rename d0/cb to d0/d18/d19/c1e 0 2024-09-13T18:30:17.767 INFO:tasks.workunit.client.1.smithi149.stdout:9/80: truncate d0/f1a 4735587 0 2024-09-13T18:30:17.769 INFO:tasks.workunit.client.1.smithi149.stdout:3/146: creat d1/d4/f2f x:0 0 0 2024-09-13T18:30:17.769 INFO:tasks.workunit.client.1.smithi149.stdout:3/147: chown d1/d2e/l10 0 1 2024-09-13T18:30:17.772 INFO:tasks.workunit.client.1.smithi149.stdout:9/81: symlink d0/l1f 0 2024-09-13T18:30:17.772 INFO:tasks.workunit.client.1.smithi149.stdout:1/129: rmdir d9/d15 39 2024-09-13T18:30:17.772 INFO:tasks.workunit.client.1.smithi149.stdout:1/130: fdatasync d9/f1c 0 2024-09-13T18:30:17.773 INFO:tasks.workunit.client.1.smithi149.stdout:1/131: symlink d9/d10/l2c 0 2024-09-13T18:30:17.774 INFO:tasks.workunit.client.1.smithi149.stdout:1/132: truncate d9/d10/f27 2898771 0 2024-09-13T18:30:17.775 INFO:tasks.workunit.client.1.smithi149.stdout:7/110: truncate d7/d9/d15/f18 93067 0 2024-09-13T18:30:17.775 INFO:tasks.workunit.client.1.smithi149.stdout:7/111: chown d7/fd 2404580 1 2024-09-13T18:30:17.777 INFO:tasks.workunit.client.1.smithi149.stdout:5/124: write d3/f7 [185488,47639] 0 2024-09-13T18:30:17.777 INFO:tasks.workunit.client.1.smithi149.stdout:5/125: fsync d3/d8/fe 0 2024-09-13T18:30:17.777 INFO:tasks.workunit.client.1.smithi149.stdout:5/126: dread - d3/d10/f1f zero size 2024-09-13T18:30:17.778 INFO:tasks.workunit.client.1.smithi149.stdout:5/127: symlink d3/d10/l24 0 2024-09-13T18:30:17.779 INFO:tasks.workunit.client.1.smithi149.stdout:5/128: symlink d3/d8/l25 0 2024-09-13T18:30:17.781 INFO:tasks.workunit.client.1.smithi149.stdout:5/129: symlink d3/d8/d13/l26 0 2024-09-13T18:30:17.782 INFO:tasks.workunit.client.1.smithi149.stdout:9/82: rmdir d0/d18/d19 39 2024-09-13T18:30:17.782 INFO:tasks.workunit.client.1.smithi149.stdout:0/60: sync 2024-09-13T18:30:17.786 INFO:tasks.workunit.client.1.smithi149.stdout:9/83: dread d0/f4 [0,4194304] 0 2024-09-13T18:30:17.786 INFO:tasks.workunit.client.1.smithi149.stdout:9/84: chown d0/l1f 1692001 1 2024-09-13T18:30:17.788 INFO:tasks.workunit.client.1.smithi149.stdout:9/85: mkdir d0/d18/d20 0 2024-09-13T18:30:17.788 INFO:tasks.workunit.client.1.smithi149.stdout:9/86: readlink d0/l13 0 2024-09-13T18:30:17.788 INFO:tasks.workunit.client.1.smithi149.stdout:2/123: dwrite db/d1b/f21 [0,4194304] 0 2024-09-13T18:30:17.790 INFO:tasks.workunit.client.1.smithi149.stdout:9/87: rename d0/l13 to d0/d18/l21 0 2024-09-13T18:30:17.790 INFO:tasks.workunit.client.1.smithi149.stdout:9/88: chown d0/f1a 7 1 2024-09-13T18:30:17.793 INFO:tasks.workunit.client.1.smithi149.stdout:4/150: dwrite df/f20 [0,4194304] 0 2024-09-13T18:30:17.793 INFO:tasks.workunit.client.1.smithi149.stdout:9/89: link d0/fe d0/f22 0 2024-09-13T18:30:17.798 INFO:tasks.workunit.client.1.smithi149.stdout:8/86: sync 2024-09-13T18:30:17.799 INFO:tasks.workunit.client.1.smithi149.stdout:2/124: dread db/d13/f18 [0,4194304] 0 2024-09-13T18:30:17.801 INFO:tasks.workunit.client.1.smithi149.stdout:2/125: dread db/f17 [4194304,4194304] 0 2024-09-13T18:30:17.802 INFO:tasks.workunit.client.1.smithi149.stdout:2/126: mkdir db/d10/d12/d26 0 2024-09-13T18:30:17.803 INFO:tasks.workunit.client.1.smithi149.stdout:2/127: mknod db/d10/d12/c27 0 2024-09-13T18:30:17.807 INFO:tasks.workunit.client.1.smithi149.stdout:3/148: dwrite d1/d2e/f14 [0,4194304] 0 2024-09-13T18:30:17.807 INFO:tasks.workunit.client.1.smithi149.stdout:6/91: sync 2024-09-13T18:30:17.811 INFO:tasks.workunit.client.1.smithi149.stdout:4/151: write fa [7505186,108188] 0 2024-09-13T18:30:17.811 INFO:tasks.workunit.client.1.smithi149.stdout:4/152: write df/f2b [1441770,65474] 0 2024-09-13T18:30:17.813 INFO:tasks.workunit.client.1.smithi149.stdout:6/92: mknod dc/d15/c1c 0 2024-09-13T18:30:17.813 INFO:tasks.workunit.client.1.smithi149.stdout:6/93: fsync f9 0 2024-09-13T18:30:17.819 INFO:tasks.workunit.client.1.smithi149.stdout:8/87: write d2/f15 [2201041,11711] 0 2024-09-13T18:30:17.819 INFO:tasks.workunit.client.1.smithi149.stdout:8/88: write d2/f15 [1957988,66747] 0 2024-09-13T18:30:17.821 INFO:tasks.workunit.client.1.smithi149.stdout:7/112: dwrite d7/f22 [0,4194304] 0 2024-09-13T18:30:17.821 INFO:tasks.workunit.client.1.smithi149.stdout:7/113: chown f5 28167125 1 2024-09-13T18:30:17.821 INFO:tasks.workunit.client.1.smithi149.stdout:6/94: dread f1 [0,4194304] 0 2024-09-13T18:30:17.825 INFO:tasks.workunit.client.1.smithi149.stdout:7/114: mkdir d7/d9/d1b/d23 0 2024-09-13T18:30:17.825 INFO:tasks.workunit.client.1.smithi149.stdout:5/130: dwrite d3/d10/f1c [0,4194304] 0 2024-09-13T18:30:17.825 INFO:tasks.workunit.client.1.smithi149.stdout:7/115: creat d7/d9/d15/f24 x:0 0 0 2024-09-13T18:30:17.825 INFO:tasks.workunit.client.1.smithi149.stdout:7/116: chown d7/d9/d1c 250537 1 2024-09-13T18:30:17.825 INFO:tasks.workunit.client.1.smithi149.stdout:7/117: dread - d7/d9/d11/f1a zero size 2024-09-13T18:30:17.827 INFO:tasks.workunit.client.1.smithi149.stdout:9/90: dwrite d0/fe [0,4194304] 0 2024-09-13T18:30:17.827 INFO:tasks.workunit.client.1.smithi149.stdout:9/91: fsync d0/f4 0 2024-09-13T18:30:17.827 INFO:tasks.workunit.client.1.smithi149.stdout:9/92: fsync d0/f22 0 2024-09-13T18:30:17.827 INFO:tasks.workunit.client.1.smithi149.stdout:9/93: getdents d0/d18/d20 0 2024-09-13T18:30:17.833 INFO:tasks.workunit.client.1.smithi149.stdout:8/89: dread d2/d13/f17 [0,4194304] 0 2024-09-13T18:30:17.834 INFO:tasks.workunit.client.1.smithi149.stdout:8/90: chown d2/l1a 0 1 2024-09-13T18:30:17.834 INFO:tasks.workunit.client.1.smithi149.stdout:5/131: stat d3/d8/lb 0 2024-09-13T18:30:17.834 INFO:tasks.workunit.client.1.smithi149.stdout:5/132: chown d3/d8/l25 15228 1 2024-09-13T18:30:17.835 INFO:tasks.workunit.client.1.smithi149.stdout:5/133: chown d3/d8/l25 72 1 2024-09-13T18:30:17.835 INFO:tasks.workunit.client.1.smithi149.stdout:1/133: dread d9/d10/f27 [0,4194304] 0 2024-09-13T18:30:17.835 INFO:tasks.workunit.client.1.smithi149.stdout:7/118: creat d7/d9/d1c/d1f/f25 x:0 0 0 2024-09-13T18:30:17.835 INFO:tasks.workunit.client.1.smithi149.stdout:3/149: dwrite d1/d4/f2f [0,4194304] 0 2024-09-13T18:30:17.838 INFO:tasks.workunit.client.1.smithi149.stdout:5/134: rename d3/f7 to d3/d8/f27 0 2024-09-13T18:30:17.839 INFO:tasks.workunit.client.1.smithi149.stdout:5/135: truncate d3/f4 8936646 0 2024-09-13T18:30:17.839 INFO:tasks.workunit.client.1.smithi149.stdout:1/134: rmdir d9/d15 39 2024-09-13T18:30:17.839 INFO:tasks.workunit.client.1.smithi149.stdout:1/135: readlink d9/l17 0 2024-09-13T18:30:17.840 INFO:tasks.workunit.client.1.smithi149.stdout:7/119: truncate f3 376263 0 2024-09-13T18:30:17.840 INFO:tasks.workunit.client.1.smithi149.stdout:7/120: chown f5 2484 1 2024-09-13T18:30:17.840 INFO:tasks.workunit.client.1.smithi149.stdout:7/121: read - d7/d12/f17 zero size 2024-09-13T18:30:17.841 INFO:tasks.workunit.client.1.smithi149.stdout:7/122: dread d7/d9/d15/f18 [0,4194304] 0 2024-09-13T18:30:17.842 INFO:tasks.workunit.client.1.smithi149.stdout:3/150: mkdir d1/d2e/d25/d30 0 2024-09-13T18:30:17.844 INFO:tasks.workunit.client.1.smithi149.stdout:5/136: mkdir d3/d8/d28 0 2024-09-13T18:30:17.844 INFO:tasks.workunit.client.1.smithi149.stdout:5/137: readlink d3/lf 0 2024-09-13T18:30:17.845 INFO:tasks.workunit.client.1.smithi149.stdout:1/136: symlink d9/l2d 0 2024-09-13T18:30:17.846 INFO:tasks.workunit.client.1.smithi149.stdout:1/137: dread - d9/d10/f22 zero size 2024-09-13T18:30:17.846 INFO:tasks.workunit.client.1.smithi149.stdout:3/151: dread d1/d2e/d1d/f23 [0,4194304] 0 2024-09-13T18:30:17.846 INFO:tasks.workunit.client.1.smithi149.stdout:7/123: mknod d7/d9/c26 0 2024-09-13T18:30:17.846 INFO:tasks.workunit.client.1.smithi149.stdout:7/124: chown d7/d9/d1c/d1f/f25 135341 1 2024-09-13T18:30:17.853 INFO:tasks.workunit.client.1.smithi149.stdout:6/95: dwrite dc/f1a [0,4194304] 0 2024-09-13T18:30:17.853 INFO:tasks.workunit.client.1.smithi149.stdout:9/94: rmdir d0/d18/d20 0 2024-09-13T18:30:17.853 INFO:tasks.workunit.client.1.smithi149.stdout:4/153: dwrite fc [4194304,4194304] 0 2024-09-13T18:30:17.853 INFO:tasks.workunit.client.1.smithi149.stdout:6/96: dread fa [0,4194304] 0 2024-09-13T18:30:17.855 INFO:tasks.workunit.client.1.smithi149.stdout:9/95: creat d0/d18/d19/f23 x:0 0 0 2024-09-13T18:30:17.855 INFO:tasks.workunit.client.1.smithi149.stdout:3/152: write d1/d4/f2f [779002,85191] 0 2024-09-13T18:30:17.856 INFO:tasks.workunit.client.1.smithi149.stdout:3/153: readlink d1/d2e/l10 0 2024-09-13T18:30:17.857 INFO:tasks.workunit.client.1.smithi149.stdout:4/154: mknod df/d11/d12/d17/c2e 0 2024-09-13T18:30:17.859 INFO:tasks.workunit.client.1.smithi149.stdout:6/97: symlink dc/d15/l1d 0 2024-09-13T18:30:17.861 INFO:tasks.workunit.client.1.smithi149.stdout:3/154: unlink d1/d2e/d1d/l1f 0 2024-09-13T18:30:17.865 INFO:tasks.workunit.client.1.smithi149.stdout:6/98: creat dc/f1e x:0 0 0 2024-09-13T18:30:17.866 INFO:tasks.workunit.client.1.smithi149.stdout:8/91: truncate d2/fc 3659560 0 2024-09-13T18:30:17.868 INFO:tasks.workunit.client.1.smithi149.stdout:5/138: dwrite d3/d10/f23 [0,4194304] 0 2024-09-13T18:30:17.868 INFO:tasks.workunit.client.1.smithi149.stdout:5/139: chown d3/d8/f1e 161 1 2024-09-13T18:30:17.868 INFO:tasks.workunit.client.1.smithi149.stdout:5/140: dread - d3/fd zero size 2024-09-13T18:30:17.868 INFO:tasks.workunit.client.1.smithi149.stdout:6/99: dread f9 [0,4194304] 0 2024-09-13T18:30:17.870 INFO:tasks.workunit.client.1.smithi149.stdout:8/92: mknod d2/c21 0 2024-09-13T18:30:17.870 INFO:tasks.workunit.client.1.smithi149.stdout:7/125: write d7/f22 [740774,81983] 0 2024-09-13T18:30:17.871 INFO:tasks.workunit.client.1.smithi149.stdout:9/96: write d0/fe [2853477,91586] 0 2024-09-13T18:30:17.871 INFO:tasks.workunit.client.1.smithi149.stdout:5/141: rename d3/d8/f9 to d3/f29 0 2024-09-13T18:30:17.871 INFO:tasks.workunit.client.1.smithi149.stdout:5/142: chown d3/d10/l21 35742937 1 2024-09-13T18:30:17.872 INFO:tasks.workunit.client.1.smithi149.stdout:6/100: rename dc/c14 to dc/c1f 0 2024-09-13T18:30:17.872 INFO:tasks.workunit.client.1.smithi149.stdout:6/101: chown f1 117826 1 2024-09-13T18:30:17.873 INFO:tasks.workunit.client.1.smithi149.stdout:8/93: symlink d2/d12/l22 0 2024-09-13T18:30:17.874 INFO:tasks.workunit.client.1.smithi149.stdout:7/126: symlink d7/d9/d1c/d1f/d21/l27 0 2024-09-13T18:30:17.875 INFO:tasks.workunit.client.1.smithi149.stdout:7/127: write d7/fd [579698,67089] 0 2024-09-13T18:30:17.878 INFO:tasks.workunit.client.1.smithi149.stdout:9/97: rename d0/fa to d0/d18/d19/f24 0 2024-09-13T18:30:17.878 INFO:tasks.workunit.client.1.smithi149.stdout:9/98: write d0/d18/d19/f23 [258007,57335] 0 2024-09-13T18:30:17.879 INFO:tasks.workunit.client.1.smithi149.stdout:1/138: dwrite f2 [0,4194304] 0 2024-09-13T18:30:17.880 INFO:tasks.workunit.client.1.smithi149.stdout:4/155: dwrite fe [4194304,4194304] 0 2024-09-13T18:30:17.881 INFO:tasks.workunit.client.1.smithi149.stdout:8/94: creat d2/d12/d1b/f23 x:0 0 0 2024-09-13T18:30:17.883 INFO:tasks.workunit.client.1.smithi149.stdout:7/128: rename d7/d12/c13 to d7/d9/d15/c28 0 2024-09-13T18:30:17.884 INFO:tasks.workunit.client.1.smithi149.stdout:9/99: mknod d0/d18/c25 0 2024-09-13T18:30:17.886 INFO:tasks.workunit.client.1.smithi149.stdout:4/156: truncate df/d11/d12/d17/f1a 2900603 0 2024-09-13T18:30:17.889 INFO:tasks.workunit.client.1.smithi149.stdout:8/95: link d2/d12/l22 d2/d12/d1b/l24 0 2024-09-13T18:30:17.889 INFO:tasks.workunit.client.1.smithi149.stdout:8/96: truncate d2/fe 4998613 0 2024-09-13T18:30:17.889 INFO:tasks.workunit.client.1.smithi149.stdout:8/97: write d2/f9 [5008653,9395] 0 2024-09-13T18:30:17.891 INFO:tasks.workunit.client.1.smithi149.stdout:9/100: dread d0/ff [0,4194304] 0 2024-09-13T18:30:17.895 INFO:tasks.workunit.client.1.smithi149.stdout:1/139: rename d9/c14 to d9/d10/d2a/c2e 0 2024-09-13T18:30:17.895 INFO:tasks.workunit.client.1.smithi149.stdout:1/140: chown d9/d10/l1e 66065 1 2024-09-13T18:30:17.895 INFO:tasks.workunit.client.1.smithi149.stdout:1/141: dread - d9/d10/f22 zero size 2024-09-13T18:30:17.895 INFO:tasks.workunit.client.1.smithi149.stdout:7/129: creat d7/d9/d1c/f29 x:0 0 0 2024-09-13T18:30:17.896 INFO:tasks.workunit.client.1.smithi149.stdout:5/143: truncate d3/d10/f23 3178489 0 2024-09-13T18:30:17.897 INFO:tasks.workunit.client.1.smithi149.stdout:8/98: rmdir d2/d1c 0 2024-09-13T18:30:17.899 INFO:tasks.workunit.client.1.smithi149.stdout:9/101: unlink d0/d18/l21 0 2024-09-13T18:30:17.899 INFO:tasks.workunit.client.1.smithi149.stdout:4/157: write df/d11/f16 [3424502,24435] 0 2024-09-13T18:30:17.899 INFO:tasks.workunit.client.1.smithi149.stdout:6/102: rmdir dc 39 2024-09-13T18:30:17.899 INFO:tasks.workunit.client.1.smithi149.stdout:6/103: chown f8 6918 1 2024-09-13T18:30:17.900 INFO:tasks.workunit.client.1.smithi149.stdout:7/130: mknod d7/d9/d1b/c2a 0 2024-09-13T18:30:17.901 INFO:tasks.workunit.client.1.smithi149.stdout:8/99: mknod d2/c25 0 2024-09-13T18:30:17.902 INFO:tasks.workunit.client.1.smithi149.stdout:4/158: symlink df/d11/d1c/l2f 0 2024-09-13T18:30:17.902 INFO:tasks.workunit.client.1.smithi149.stdout:1/142: read d9/d10/f27 [2308146,38054] 0 2024-09-13T18:30:17.903 INFO:tasks.workunit.client.1.smithi149.stdout:8/100: symlink d2/l26 0 2024-09-13T18:30:17.903 INFO:tasks.workunit.client.1.smithi149.stdout:8/101: readlink d2/l10 0 2024-09-13T18:30:17.904 INFO:tasks.workunit.client.1.smithi149.stdout:8/102: chown d2/f9 311 1 2024-09-13T18:30:17.904 INFO:tasks.workunit.client.1.smithi149.stdout:8/103: chown d2/d12/d1b/f23 0 1 2024-09-13T18:30:17.904 INFO:tasks.workunit.client.1.smithi149.stdout:4/159: mkdir df/d11/d12/d21/d22/d30 0 2024-09-13T18:30:17.905 INFO:tasks.workunit.client.1.smithi149.stdout:1/143: symlink d9/d15/l2f 0 2024-09-13T18:30:17.907 INFO:tasks.workunit.client.1.smithi149.stdout:4/160: rename df/d11/d12/d21/f25 to df/d11/f31 0 2024-09-13T18:30:17.909 INFO:tasks.workunit.client.1.smithi149.stdout:1/144: link d9/d10/f1d d9/d15/d25/f30 0 2024-09-13T18:30:17.909 INFO:tasks.workunit.client.1.smithi149.stdout:1/145: fdatasync d9/f1c 0 2024-09-13T18:30:17.911 INFO:tasks.workunit.client.1.smithi149.stdout:1/146: creat d9/d10/d2a/f31 x:0 0 0 2024-09-13T18:30:17.911 INFO:tasks.workunit.client.1.smithi149.stdout:1/147: write d9/f1c [2433368,5651] 0 2024-09-13T18:30:17.911 INFO:tasks.workunit.client.1.smithi149.stdout:1/148: write d9/d15/f20 [1071613,127339] 0 2024-09-13T18:30:17.912 INFO:tasks.workunit.client.1.smithi149.stdout:6/104: dread f8 [0,4194304] 0 2024-09-13T18:30:17.914 INFO:tasks.workunit.client.1.smithi149.stdout:6/105: dread fa [0,4194304] 0 2024-09-13T18:30:17.914 INFO:tasks.workunit.client.1.smithi149.stdout:6/106: stat dc/l1b 0 2024-09-13T18:30:17.916 INFO:tasks.workunit.client.1.smithi149.stdout:6/107: unlink dc/c12 0 2024-09-13T18:30:17.918 INFO:tasks.workunit.client.1.smithi149.stdout:7/131: dread d7/f22 [0,4194304] 0 2024-09-13T18:30:17.918 INFO:tasks.workunit.client.1.smithi149.stdout:7/132: fsync d7/d9/fa 0 2024-09-13T18:30:17.918 INFO:tasks.workunit.client.1.smithi149.stdout:7/133: stat d7/d9/d15 0 2024-09-13T18:30:17.919 INFO:tasks.workunit.client.1.smithi149.stdout:7/134: link d7/d12/c20 d7/d12/c2b 0 2024-09-13T18:30:17.919 INFO:tasks.workunit.client.1.smithi149.stdout:7/135: fdatasync d7/d9/f1d 0 2024-09-13T18:30:17.923 INFO:tasks.workunit.client.1.smithi149.stdout:0/61: sync 2024-09-13T18:30:17.924 INFO:tasks.workunit.client.1.smithi149.stdout:4/161: dread fa [0,4194304] 0 2024-09-13T18:30:17.925 INFO:tasks.workunit.client.1.smithi149.stdout:0/62: link d1/cc d1/d2/ce 0 2024-09-13T18:30:17.925 INFO:tasks.workunit.client.1.smithi149.stdout:0/63: truncate d1/d2/fb 4954624 0 2024-09-13T18:30:17.926 INFO:tasks.workunit.client.1.smithi149.stdout:4/162: creat df/d11/d1c/f32 x:0 0 0 2024-09-13T18:30:17.927 INFO:tasks.workunit.client.1.smithi149.stdout:8/104: dwrite d2/fe [0,4194304] 0 2024-09-13T18:30:17.927 INFO:tasks.workunit.client.1.smithi149.stdout:1/149: write d9/d10/f1d [2030458,47663] 0 2024-09-13T18:30:17.929 INFO:tasks.workunit.client.1.smithi149.stdout:4/163: link l3 df/d11/d12/d17/l33 0 2024-09-13T18:30:17.931 INFO:tasks.workunit.client.1.smithi149.stdout:7/136: dread d7/f22 [0,4194304] 0 2024-09-13T18:30:17.931 INFO:tasks.workunit.client.1.smithi149.stdout:1/150: creat d9/d15/d25/f32 x:0 0 0 2024-09-13T18:30:17.931 INFO:tasks.workunit.client.1.smithi149.stdout:1/151: chown d9/d10/l1e 13556 1 2024-09-13T18:30:17.935 INFO:tasks.workunit.client.1.smithi149.stdout:5/144: write d3/d10/f23 [759309,91602] 0 2024-09-13T18:30:17.938 INFO:tasks.workunit.client.1.smithi149.stdout:6/108: dwrite dc/f16 [0,4194304] 0 2024-09-13T18:30:17.938 INFO:tasks.workunit.client.1.smithi149.stdout:8/105: write d2/fe [2630037,55866] 0 2024-09-13T18:30:17.941 INFO:tasks.workunit.client.1.smithi149.stdout:0/64: dread d1/d2/fb [0,4194304] 0 2024-09-13T18:30:17.941 INFO:tasks.workunit.client.1.smithi149.stdout:0/65: readlink d1/l9 0 2024-09-13T18:30:17.941 INFO:tasks.workunit.client.1.smithi149.stdout:7/137: rename d7/d9/d15 to d7/d9/d1c/d2c 0 2024-09-13T18:30:17.941 INFO:tasks.workunit.client.1.smithi149.stdout:7/138: chown d7/d9/d11/f1a 0 1 2024-09-13T18:30:17.942 INFO:tasks.workunit.client.1.smithi149.stdout:8/106: symlink d2/d12/d1b/l27 0 2024-09-13T18:30:17.942 INFO:tasks.workunit.client.1.smithi149.stdout:8/107: readlink d2/d12/l22 0 2024-09-13T18:30:17.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/109: getdents dc 0 2024-09-13T18:30:17.946 INFO:tasks.workunit.client.1.smithi149.stdout:0/66: truncate d1/d2/fa 182959 0 2024-09-13T18:30:17.946 INFO:tasks.workunit.client.1.smithi149.stdout:6/110: creat dc/d15/f20 x:0 0 0 2024-09-13T18:30:17.947 INFO:tasks.workunit.client.1.smithi149.stdout:6/111: truncate dc/d15/f20 242493 0 2024-09-13T18:30:17.947 INFO:tasks.workunit.client.1.smithi149.stdout:6/112: creat dc/d15/f21 x:0 0 0 2024-09-13T18:30:17.947 INFO:tasks.workunit.client.1.smithi149.stdout:5/145: dread d3/d10/f23 [0,4194304] 0 2024-09-13T18:30:17.947 INFO:tasks.workunit.client.1.smithi149.stdout:5/146: write d3/d8/d13/f22 [683653,48531] 0 2024-09-13T18:30:17.947 INFO:tasks.workunit.client.1.smithi149.stdout:5/147: chown d3/d8/f27 4191 1 2024-09-13T18:30:17.949 INFO:tasks.workunit.client.1.smithi149.stdout:6/113: truncate f1 230699 0 2024-09-13T18:30:17.950 INFO:tasks.workunit.client.1.smithi149.stdout:5/148: creat d3/d8/d28/f2a x:0 0 0 2024-09-13T18:30:17.950 INFO:tasks.workunit.client.1.smithi149.stdout:5/149: chown d3/f29 644 1 2024-09-13T18:30:17.952 INFO:tasks.workunit.client.1.smithi149.stdout:5/150: unlink d3/d10/f1f 0 2024-09-13T18:30:17.952 INFO:tasks.workunit.client.1.smithi149.stdout:5/151: fdatasync d3/f20 0 2024-09-13T18:30:17.953 INFO:tasks.workunit.client.1.smithi149.stdout:4/164: write fe [8204305,5052] 0 2024-09-13T18:30:17.953 INFO:tasks.workunit.client.1.smithi149.stdout:4/165: creat df/d11/f34 x:0 0 0 2024-09-13T18:30:17.957 INFO:tasks.workunit.client.1.smithi149.stdout:5/152: getdents d3/d8/d13 0 2024-09-13T18:30:17.957 INFO:tasks.workunit.client.1.smithi149.stdout:5/153: readlink d3/d10/l24 0 2024-09-13T18:30:17.957 INFO:tasks.workunit.client.1.smithi149.stdout:5/154: dread - d3/f20 zero size 2024-09-13T18:30:17.959 INFO:tasks.workunit.client.1.smithi149.stdout:0/67: unlink d1/d2/fa 0 2024-09-13T18:30:17.968 INFO:tasks.workunit.client.1.smithi149.stdout:4/166: write fc [1278344,71968] 0 2024-09-13T18:30:17.969 INFO:tasks.workunit.client.1.smithi149.stdout:4/167: mkdir df/d11/d1c/d35 0 2024-09-13T18:30:17.971 INFO:tasks.workunit.client.1.smithi149.stdout:4/168: link df/d11/d12/l2c df/d11/l36 0 2024-09-13T18:30:17.972 INFO:tasks.workunit.client.1.smithi149.stdout:4/169: unlink df/d11/d12/d17/f27 0 2024-09-13T18:30:17.973 INFO:tasks.workunit.client.1.smithi149.stdout:8/108: dwrite d2/f15 [0,4194304] 0 2024-09-13T18:30:17.973 INFO:tasks.workunit.client.1.smithi149.stdout:4/170: rename df/d11/f31 to df/d11/d12/d21/d22/d30/f37 0 2024-09-13T18:30:17.981 INFO:tasks.workunit.client.1.smithi149.stdout:1/152: dwrite d9/d15/d25/f30 [4194304,4194304] 0 2024-09-13T18:30:17.982 INFO:tasks.workunit.client.1.smithi149.stdout:0/68: rmdir d1 39 2024-09-13T18:30:17.982 INFO:tasks.workunit.client.1.smithi149.stdout:0/69: fdatasync d1/f5 0 2024-09-13T18:30:17.984 INFO:tasks.workunit.client.1.smithi149.stdout:0/70: mknod d1/d2/cf 0 2024-09-13T18:30:17.984 INFO:tasks.workunit.client.1.smithi149.stdout:8/109: dread d2/f15 [0,4194304] 0 2024-09-13T18:30:17.984 INFO:tasks.workunit.client.1.smithi149.stdout:6/114: dwrite dc/d15/f20 [0,4194304] 0 2024-09-13T18:30:17.984 INFO:tasks.workunit.client.1.smithi149.stdout:6/115: dread - dc/d15/f21 zero size 2024-09-13T18:30:17.985 INFO:tasks.workunit.client.1.smithi149.stdout:1/153: dread d9/d15/f20 [0,4194304] 0 2024-09-13T18:30:17.986 INFO:tasks.workunit.client.1.smithi149.stdout:8/110: symlink d2/d13/l28 0 2024-09-13T18:30:17.989 INFO:tasks.workunit.client.1.smithi149.stdout:6/116: rename f1 to dc/f22 0 2024-09-13T18:30:17.990 INFO:tasks.workunit.client.1.smithi149.stdout:6/117: mkdir dc/d15/d23 0 2024-09-13T18:30:17.991 INFO:tasks.workunit.client.1.smithi149.stdout:6/118: dread fa [0,4194304] 0 2024-09-13T18:30:17.991 INFO:tasks.workunit.client.1.smithi149.stdout:6/119: truncate dc/f16 4769661 0 2024-09-13T18:30:17.995 INFO:tasks.workunit.client.1.smithi149.stdout:2/128: sync 2024-09-13T18:30:17.995 INFO:tasks.workunit.client.1.smithi149.stdout:2/129: stat db/d10/f25 0 2024-09-13T18:30:17.996 INFO:tasks.workunit.client.1.smithi149.stdout:8/111: write d2/f9 [2304779,103717] 0 2024-09-13T18:30:17.996 INFO:tasks.workunit.client.1.smithi149.stdout:2/130: truncate db/ff 3811391 0 2024-09-13T18:30:18.002 INFO:tasks.workunit.client.1.smithi149.stdout:1/154: dread f3 [0,4194304] 0 2024-09-13T18:30:18.006 INFO:tasks.workunit.client.1.smithi149.stdout:8/112: write d2/f15 [3253369,87192] 0 2024-09-13T18:30:18.006 INFO:tasks.workunit.client.1.smithi149.stdout:8/113: creat d2/d13/f29 x:0 0 0 2024-09-13T18:30:18.015 INFO:tasks.workunit.client.1.smithi149.stdout:0/71: dwrite d1/d2/fd [0,4194304] 0 2024-09-13T18:30:18.015 INFO:tasks.workunit.client.1.smithi149.stdout:0/72: write d1/f5 [54203,119345] 0 2024-09-13T18:30:18.018 INFO:tasks.workunit.client.1.smithi149.stdout:1/155: dread d9/d10/f1d [4194304,4194304] 0 2024-09-13T18:30:18.018 INFO:tasks.workunit.client.1.smithi149.stdout:0/73: creat d1/f10 x:0 0 0 2024-09-13T18:30:18.018 INFO:tasks.workunit.client.1.smithi149.stdout:0/74: dread - d1/f10 zero size 2024-09-13T18:30:18.019 INFO:tasks.workunit.client.1.smithi149.stdout:1/156: getdents d9/d15 0 2024-09-13T18:30:18.020 INFO:tasks.workunit.client.1.smithi149.stdout:0/75: symlink d1/l11 0 2024-09-13T18:30:18.020 INFO:tasks.workunit.client.1.smithi149.stdout:1/157: mkdir d9/d15/d33 0 2024-09-13T18:30:18.021 INFO:tasks.workunit.client.1.smithi149.stdout:1/158: chown d9/d15/f29 402306 1 2024-09-13T18:30:18.021 INFO:tasks.workunit.client.1.smithi149.stdout:0/76: creat d1/d2/f12 x:0 0 0 2024-09-13T18:30:18.021 INFO:tasks.workunit.client.1.smithi149.stdout:0/77: chown d1/d2/fd 30462 1 2024-09-13T18:30:18.021 INFO:tasks.workunit.client.1.smithi149.stdout:0/78: creat d1/f13 x:0 0 0 2024-09-13T18:30:18.021 INFO:tasks.workunit.client.1.smithi149.stdout:0/79: write d1/f13 [537064,591] 0 2024-09-13T18:30:18.021 INFO:tasks.workunit.client.1.smithi149.stdout:0/80: creat d1/f14 x:0 0 0 2024-09-13T18:30:18.022 INFO:tasks.workunit.client.1.smithi149.stdout:1/159: unlink d9/l2d 0 2024-09-13T18:30:18.022 INFO:tasks.workunit.client.1.smithi149.stdout:1/160: chown d9/d15/d25/c28 263 1 2024-09-13T18:30:18.022 INFO:tasks.workunit.client.1.smithi149.stdout:6/120: dwrite dc/d15/f21 [0,4194304] 0 2024-09-13T18:30:18.024 INFO:tasks.workunit.client.1.smithi149.stdout:2/131: dwrite f4 [0,4194304] 0 2024-09-13T18:30:18.025 INFO:tasks.workunit.client.1.smithi149.stdout:0/81: fsync d1/f5 0 2024-09-13T18:30:18.026 INFO:tasks.workunit.client.1.smithi149.stdout:6/121: mknod dc/d15/d23/c24 0 2024-09-13T18:30:18.030 INFO:tasks.workunit.client.1.smithi149.stdout:0/82: symlink d1/d2/l15 0 2024-09-13T18:30:18.030 INFO:tasks.workunit.client.1.smithi149.stdout:1/161: dread d9/d10/f27 [0,4194304] 0 2024-09-13T18:30:18.031 INFO:tasks.workunit.client.1.smithi149.stdout:0/83: link d1/f5 d1/d2/f16 0 2024-09-13T18:30:18.032 INFO:tasks.workunit.client.1.smithi149.stdout:1/162: mkdir d9/d10/d34 0 2024-09-13T18:30:18.035 INFO:tasks.workunit.client.1.smithi149.stdout:8/114: dwrite d2/fc [0,4194304] 0 2024-09-13T18:30:18.035 INFO:tasks.workunit.client.1.smithi149.stdout:8/115: dread - d2/d13/f29 zero size 2024-09-13T18:30:18.035 INFO:tasks.workunit.client.1.smithi149.stdout:2/132: write db/d13/f18 [1334647,94176] 0 2024-09-13T18:30:18.035 INFO:tasks.workunit.client.1.smithi149.stdout:2/133: dread - db/d10/f25 zero size 2024-09-13T18:30:18.037 INFO:tasks.workunit.client.1.smithi149.stdout:1/163: dread d9/d15/f20 [0,4194304] 0 2024-09-13T18:30:18.037 INFO:tasks.workunit.client.1.smithi149.stdout:8/116: dread d2/d12/f16 [0,4194304] 0 2024-09-13T18:30:18.041 INFO:tasks.workunit.client.1.smithi149.stdout:6/122: dread dc/f16 [0,4194304] 0 2024-09-13T18:30:18.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:17 smithi038 ceph-mon[27689]: pgmap v11: 65 pgs: 65 active+clean; 202 MiB data, 953 MiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 476 op/s 2024-09-13T18:30:18.084 INFO:tasks.workunit.client.1.smithi149.stdout:0/84: link d1/l7 d1/d2/l17 0 2024-09-13T18:30:18.088 INFO:tasks.workunit.client.1.smithi149.stdout:8/117: mkdir d2/d12/d2a 0 2024-09-13T18:30:18.090 INFO:tasks.workunit.client.1.smithi149.stdout:6/123: symlink dc/l25 0 2024-09-13T18:30:18.090 INFO:tasks.workunit.client.1.smithi149.stdout:6/124: rename dc to dc/d26 22 2024-09-13T18:30:18.090 INFO:tasks.workunit.client.1.smithi149.stdout:0/85: stat d1/d2/l17 0 2024-09-13T18:30:18.090 INFO:tasks.workunit.client.1.smithi149.stdout:0/86: fsync d1/f10 0 2024-09-13T18:30:18.090 INFO:tasks.workunit.client.1.smithi149.stdout:0/87: write d1/f10 [499129,104056] 0 2024-09-13T18:30:18.090 INFO:tasks.workunit.client.1.smithi149.stdout:0/88: fdatasync d1/d2/fd 0 2024-09-13T18:30:18.090 INFO:tasks.workunit.client.1.smithi149.stdout:0/89: chown d1/c6 416128 1 2024-09-13T18:30:18.090 INFO:tasks.workunit.client.1.smithi149.stdout:8/118: symlink d2/d12/d1b/l2b 0 2024-09-13T18:30:18.091 INFO:tasks.workunit.client.1.smithi149.stdout:0/90: mknod d1/c18 0 2024-09-13T18:30:18.091 INFO:tasks.workunit.client.1.smithi149.stdout:0/91: write d1/f10 [1624275,77438] 0 2024-09-13T18:30:18.091 INFO:tasks.workunit.client.1.smithi149.stdout:8/119: creat d2/d12/d2a/f2c x:0 0 0 2024-09-13T18:30:18.093 INFO:tasks.workunit.client.1.smithi149.stdout:1/164: dwrite d9/d15/f20 [0,4194304] 0 2024-09-13T18:30:18.096 INFO:tasks.workunit.client.1.smithi149.stdout:9/102: sync 2024-09-13T18:30:18.096 INFO:tasks.workunit.client.1.smithi149.stdout:3/155: sync 2024-09-13T18:30:18.097 INFO:tasks.workunit.client.1.smithi149.stdout:2/134: dwrite db/ff [0,4194304] 0 2024-09-13T18:30:18.099 INFO:tasks.workunit.client.1.smithi149.stdout:9/103: unlink d0/d18/c1d 0 2024-09-13T18:30:18.099 INFO:tasks.workunit.client.1.smithi149.stdout:9/104: fsync d0/f9 0 2024-09-13T18:30:18.099 INFO:tasks.workunit.client.1.smithi149.stdout:9/105: write d0/d18/d19/f23 [620131,70083] 0 2024-09-13T18:30:18.099 INFO:tasks.workunit.client.1.smithi149.stdout:3/156: creat d1/d12/f31 x:0 0 0 2024-09-13T18:30:18.107 INFO:tasks.workunit.client.1.smithi149.stdout:2/135: mkdir db/d10/d12/d24/d28 0 2024-09-13T18:30:18.107 INFO:tasks.workunit.client.1.smithi149.stdout:2/136: truncate db/d10/f25 515225 0 2024-09-13T18:30:18.109 INFO:tasks.workunit.client.1.smithi149.stdout:9/106: rename d0/c8 to d0/d18/c26 0 2024-09-13T18:30:18.109 INFO:tasks.workunit.client.1.smithi149.stdout:1/165: write d9/d15/f20 [49082,103426] 0 2024-09-13T18:30:18.110 INFO:tasks.workunit.client.1.smithi149.stdout:3/157: truncate d1/d2e/f17 380495 0 2024-09-13T18:30:18.111 INFO:tasks.workunit.client.1.smithi149.stdout:2/137: creat db/d1b/d1c/d20/f29 x:0 0 0 2024-09-13T18:30:18.111 INFO:tasks.workunit.client.1.smithi149.stdout:2/138: chown fa 215 1 2024-09-13T18:30:18.113 INFO:tasks.workunit.client.1.smithi149.stdout:1/166: link d9/d10/d2a/c2e d9/d15/c35 0 2024-09-13T18:30:18.113 INFO:tasks.workunit.client.1.smithi149.stdout:1/167: chown d9/d10/d2a/c2e 501 1 2024-09-13T18:30:18.114 INFO:tasks.workunit.client.1.smithi149.stdout:1/168: readlink d9/l18 0 2024-09-13T18:30:18.114 INFO:tasks.workunit.client.1.smithi149.stdout:6/125: dwrite f9 [0,4194304] 0 2024-09-13T18:30:18.116 INFO:tasks.workunit.client.1.smithi149.stdout:7/139: sync 2024-09-13T18:30:18.116 INFO:tasks.workunit.client.1.smithi149.stdout:7/140: creat d7/d12/f2d x:0 0 0 2024-09-13T18:30:18.116 INFO:tasks.workunit.client.1.smithi149.stdout:7/141: write d7/d9/d1c/f29 [882822,46763] 0 2024-09-13T18:30:18.116 INFO:tasks.workunit.client.1.smithi149.stdout:7/142: truncate d7/d9/d11/f1a 770315 0 2024-09-13T18:30:18.116 INFO:tasks.workunit.client.1.smithi149.stdout:4/171: sync 2024-09-13T18:30:18.117 INFO:tasks.workunit.client.1.smithi149.stdout:5/155: sync 2024-09-13T18:30:18.117 INFO:tasks.workunit.client.1.smithi149.stdout:4/172: chown l6 444508 1 2024-09-13T18:30:18.120 INFO:tasks.workunit.client.1.smithi149.stdout:7/143: rename d7/d9/d1c/d2c/c28 to d7/d9/d1c/c2e 0 2024-09-13T18:30:18.122 INFO:tasks.workunit.client.1.smithi149.stdout:4/173: unlink df/d11/d12/d17/c2e 0 2024-09-13T18:30:18.123 INFO:tasks.workunit.client.1.smithi149.stdout:5/156: mkdir d3/d8/d28/d2b 0 2024-09-13T18:30:18.124 INFO:tasks.workunit.client.1.smithi149.stdout:6/126: write dc/d15/f21 [1603670,76711] 0 2024-09-13T18:30:18.125 INFO:tasks.workunit.client.1.smithi149.stdout:4/174: symlink df/d11/d1c/d35/l38 0 2024-09-13T18:30:18.126 INFO:tasks.workunit.client.1.smithi149.stdout:5/157: rename d3/d10/c14 to d3/c2c 0 2024-09-13T18:30:18.127 INFO:tasks.workunit.client.1.smithi149.stdout:8/120: dwrite d2/d12/d1b/f23 [0,4194304] 0 2024-09-13T18:30:18.128 INFO:tasks.workunit.client.1.smithi149.stdout:6/127: creat dc/d15/d23/f27 x:0 0 0 2024-09-13T18:30:18.129 INFO:tasks.workunit.client.1.smithi149.stdout:4/175: dread fa [4194304,4194304] 0 2024-09-13T18:30:18.131 INFO:tasks.workunit.client.1.smithi149.stdout:0/92: dwrite d1/d2/f12 [0,4194304] 0 2024-09-13T18:30:18.131 INFO:tasks.workunit.client.1.smithi149.stdout:0/93: creat d1/f19 x:0 0 0 2024-09-13T18:30:18.131 INFO:tasks.workunit.client.1.smithi149.stdout:0/94: fdatasync d1/d2/f12 0 2024-09-13T18:30:18.131 INFO:tasks.workunit.client.1.smithi149.stdout:0/95: creat d1/f1a x:0 0 0 2024-09-13T18:30:18.132 INFO:tasks.workunit.client.1.smithi149.stdout:6/128: symlink dc/l28 0 2024-09-13T18:30:18.132 INFO:tasks.workunit.client.1.smithi149.stdout:6/129: readlink dc/l11 0 2024-09-13T18:30:18.132 INFO:tasks.workunit.client.1.smithi149.stdout:6/130: write dc/f22 [437668,13170] 0 2024-09-13T18:30:18.133 INFO:tasks.workunit.client.1.smithi149.stdout:4/176: unlink fa 0 2024-09-13T18:30:18.133 INFO:tasks.workunit.client.1.smithi149.stdout:4/177: readlink l3 0 2024-09-13T18:30:18.134 INFO:tasks.workunit.client.1.smithi149.stdout:1/169: write f3 [1644956,107375] 0 2024-09-13T18:30:18.138 INFO:tasks.workunit.client.1.smithi149.stdout:9/107: dwrite d0/f4 [0,4194304] 0 2024-09-13T18:30:18.140 INFO:tasks.workunit.client.1.smithi149.stdout:0/96: mkdir d1/d1b 0 2024-09-13T18:30:18.140 INFO:tasks.workunit.client.1.smithi149.stdout:0/97: dread - d1/f1a zero size 2024-09-13T18:30:18.142 INFO:tasks.workunit.client.1.smithi149.stdout:8/121: getdents d2 0 2024-09-13T18:30:18.144 INFO:tasks.workunit.client.1.smithi149.stdout:6/131: creat dc/f29 x:0 0 0 2024-09-13T18:30:18.144 INFO:tasks.workunit.client.1.smithi149.stdout:6/132: stat dc/l25 0 2024-09-13T18:30:18.145 INFO:tasks.workunit.client.1.smithi149.stdout:4/178: truncate df/f20 480243 0 2024-09-13T18:30:18.145 INFO:tasks.workunit.client.1.smithi149.stdout:4/179: chown df/d11/d12/l2c 15121 1 2024-09-13T18:30:18.145 INFO:tasks.workunit.client.1.smithi149.stdout:4/180: fsync fc 0 2024-09-13T18:30:18.147 INFO:tasks.workunit.client.1.smithi149.stdout:9/108: mkdir d0/d18/d27 0 2024-09-13T18:30:18.148 INFO:tasks.workunit.client.1.smithi149.stdout:3/158: dwrite d1/d4/f2f [4194304,4194304] 0 2024-09-13T18:30:18.148 INFO:tasks.workunit.client.1.smithi149.stdout:0/98: rename d1/cc to d1/c1c 0 2024-09-13T18:30:18.148 INFO:tasks.workunit.client.1.smithi149.stdout:0/99: chown d1/l9 84504754 1 2024-09-13T18:30:18.149 INFO:tasks.workunit.client.1.smithi149.stdout:0/100: dread - d1/f19 zero size 2024-09-13T18:30:18.149 INFO:tasks.workunit.client.1.smithi149.stdout:0/101: chown d1/d2/cf 518249 1 2024-09-13T18:30:18.149 INFO:tasks.workunit.client.1.smithi149.stdout:2/139: dwrite db/d10/f25 [0,4194304] 0 2024-09-13T18:30:18.149 INFO:tasks.workunit.client.1.smithi149.stdout:7/144: getdents d7/d12 0 2024-09-13T18:30:18.150 INFO:tasks.workunit.client.1.smithi149.stdout:4/181: truncate df/f29 2293971 0 2024-09-13T18:30:18.150 INFO:tasks.workunit.client.1.smithi149.stdout:4/182: readlink l3 0 2024-09-13T18:30:18.151 INFO:tasks.workunit.client.1.smithi149.stdout:7/145: read d7/fd [401291,123454] 0 2024-09-13T18:30:18.152 INFO:tasks.workunit.client.1.smithi149.stdout:5/158: dwrite d3/fc [0,4194304] 0 2024-09-13T18:30:18.153 INFO:tasks.workunit.client.1.smithi149.stdout:3/159: symlink d1/d2e/d1d/l32 0 2024-09-13T18:30:18.153 INFO:tasks.workunit.client.1.smithi149.stdout:3/160: chown d1/d2e/d1d/f23 60937314 1 2024-09-13T18:30:18.153 INFO:tasks.workunit.client.1.smithi149.stdout:3/161: chown d1/d2e/d25 2756243 1 2024-09-13T18:30:18.154 INFO:tasks.workunit.client.1.smithi149.stdout:3/162: read d1/d2e/f17 [59704,78127] 0 2024-09-13T18:30:18.155 INFO:tasks.workunit.client.1.smithi149.stdout:3/163: write d1/d4/fd [520140,31932] 0 2024-09-13T18:30:18.155 INFO:tasks.workunit.client.1.smithi149.stdout:3/164: readlink d1/d4/lc 0 2024-09-13T18:30:18.157 INFO:tasks.workunit.client.1.smithi149.stdout:0/102: unlink d1/d2/ce 0 2024-09-13T18:30:18.159 INFO:tasks.workunit.client.1.smithi149.stdout:8/122: read d2/fc [4125388,3811] 0 2024-09-13T18:30:18.159 INFO:tasks.workunit.client.1.smithi149.stdout:8/123: dread - d2/d13/f29 zero size 2024-09-13T18:30:18.160 INFO:tasks.workunit.client.1.smithi149.stdout:7/146: mkdir d7/d9/d1c/d2f 0 2024-09-13T18:30:18.160 INFO:tasks.workunit.client.1.smithi149.stdout:2/140: creat db/d10/d12/f2a x:0 0 0 2024-09-13T18:30:18.161 INFO:tasks.workunit.client.1.smithi149.stdout:5/159: unlink d3/fc 0 2024-09-13T18:30:18.162 INFO:tasks.workunit.client.1.smithi149.stdout:1/170: dread f2 [0,4194304] 0 2024-09-13T18:30:18.162 INFO:tasks.workunit.client.1.smithi149.stdout:1/171: write d9/f1c [508945,53622] 0 2024-09-13T18:30:18.162 INFO:tasks.workunit.client.1.smithi149.stdout:1/172: creat d9/d15/d25/f36 x:0 0 0 2024-09-13T18:30:18.162 INFO:tasks.workunit.client.1.smithi149.stdout:1/173: chown d9/d10/d2a 24570 1 2024-09-13T18:30:18.162 INFO:tasks.workunit.client.1.smithi149.stdout:1/174: write f3 [5120411,44386] 0 2024-09-13T18:30:18.165 INFO:tasks.workunit.client.1.smithi149.stdout:3/165: rename d1/d4/c9 to d1/d2e/d25/d30/c33 0 2024-09-13T18:30:18.165 INFO:tasks.workunit.client.1.smithi149.stdout:3/166: write d1/d2e/d25/f26 [320012,73631] 0 2024-09-13T18:30:18.166 INFO:tasks.workunit.client.1.smithi149.stdout:8/124: symlink d2/d12/d2a/l2d 0 2024-09-13T18:30:18.168 INFO:tasks.workunit.client.1.smithi149.stdout:2/141: unlink db/d1b/d1c/f1d 0 2024-09-13T18:30:18.169 INFO:tasks.workunit.client.1.smithi149.stdout:5/160: unlink d3/l1a 0 2024-09-13T18:30:18.169 INFO:tasks.workunit.client.1.smithi149.stdout:5/161: write d3/d8/d28/f2a [3876,48235] 0 2024-09-13T18:30:18.169 INFO:tasks.workunit.client.1.smithi149.stdout:5/162: read d3/d10/f23 [2644791,129016] 0 2024-09-13T18:30:18.171 INFO:tasks.workunit.client.1.smithi149.stdout:0/103: dread d1/d2/fb [0,4194304] 0 2024-09-13T18:30:18.171 INFO:tasks.workunit.client.1.smithi149.stdout:0/104: dread - d1/f14 zero size 2024-09-13T18:30:18.171 INFO:tasks.workunit.client.1.smithi149.stdout:0/105: dread - d1/f19 zero size 2024-09-13T18:30:18.172 INFO:tasks.workunit.client.1.smithi149.stdout:3/167: symlink d1/d21/l34 0 2024-09-13T18:30:18.172 INFO:tasks.workunit.client.1.smithi149.stdout:6/133: dwrite dc/f22 [0,4194304] 0 2024-09-13T18:30:18.172 INFO:tasks.workunit.client.1.smithi149.stdout:9/109: truncate d0/f4 3693541 0 2024-09-13T18:30:18.173 INFO:tasks.workunit.client.1.smithi149.stdout:9/110: fdatasync d0/d18/d19/f24 0 2024-09-13T18:30:18.173 INFO:tasks.workunit.client.1.smithi149.stdout:2/142: write fa [1130572,41455] 0 2024-09-13T18:30:18.173 INFO:tasks.workunit.client.1.smithi149.stdout:8/125: symlink d2/d12/l2e 0 2024-09-13T18:30:18.173 INFO:tasks.workunit.client.1.smithi149.stdout:8/126: chown d2/l10 4015670 1 2024-09-13T18:30:18.174 INFO:tasks.workunit.client.1.smithi149.stdout:7/147: write d7/d9/f1d [4052358,29347] 0 2024-09-13T18:30:18.174 INFO:tasks.workunit.client.1.smithi149.stdout:8/127: write d2/d13/f29 [604393,121896] 0 2024-09-13T18:30:18.174 INFO:tasks.workunit.client.1.smithi149.stdout:8/128: chown d2/d13/l28 207975 1 2024-09-13T18:30:18.176 INFO:tasks.workunit.client.1.smithi149.stdout:7/148: write f3 [85643,38061] 0 2024-09-13T18:30:18.184 INFO:tasks.workunit.client.1.smithi149.stdout:6/134: mknod dc/d15/c2a 0 2024-09-13T18:30:18.184 INFO:tasks.workunit.client.1.smithi149.stdout:6/135: creat dc/d15/f2b x:0 0 0 2024-09-13T18:30:18.185 INFO:tasks.workunit.client.1.smithi149.stdout:7/149: dread f3 [0,4194304] 0 2024-09-13T18:30:18.185 INFO:tasks.workunit.client.1.smithi149.stdout:3/168: symlink d1/d2e/d25/l35 0 2024-09-13T18:30:18.185 INFO:tasks.workunit.client.1.smithi149.stdout:3/169: write d1/d2e/d1d/f23 [2153433,24592] 0 2024-09-13T18:30:18.186 INFO:tasks.workunit.client.1.smithi149.stdout:9/111: mknod d0/d18/c28 0 2024-09-13T18:30:18.186 INFO:tasks.workunit.client.1.smithi149.stdout:9/112: chown d0/f4 251 1 2024-09-13T18:30:18.186 INFO:tasks.workunit.client.1.smithi149.stdout:9/113: write d0/d18/d19/f24 [5121451,67322] 0 2024-09-13T18:30:18.186 INFO:tasks.workunit.client.1.smithi149.stdout:9/114: chown d0/cc 4407868 1 2024-09-13T18:30:18.189 INFO:tasks.workunit.client.1.smithi149.stdout:8/129: creat d2/d12/f2f x:0 0 0 2024-09-13T18:30:18.190 INFO:tasks.workunit.client.1.smithi149.stdout:5/163: dwrite d3/d8/fe [0,4194304] 0 2024-09-13T18:30:18.191 INFO:tasks.workunit.client.1.smithi149.stdout:9/115: creat d0/f29 x:0 0 0 2024-09-13T18:30:18.191 INFO:tasks.workunit.client.1.smithi149.stdout:8/130: unlink d2/c25 0 2024-09-13T18:30:18.193 INFO:tasks.workunit.client.1.smithi149.stdout:5/164: unlink d3/f29 0 2024-09-13T18:30:18.195 INFO:tasks.workunit.client.1.smithi149.stdout:5/165: mkdir d3/d2d 0 2024-09-13T18:30:18.210 INFO:tasks.workunit.client.1.smithi149.stdout:0/106: dwrite d1/f13 [0,4194304] 0 2024-09-13T18:30:18.210 INFO:tasks.workunit.client.1.smithi149.stdout:0/107: chown d1/d2/l15 192 1 2024-09-13T18:30:18.210 INFO:tasks.workunit.client.1.smithi149.stdout:0/108: write d1/f14 [667205,98734] 0 2024-09-13T18:30:18.210 INFO:tasks.workunit.client.1.smithi149.stdout:0/109: dread - d1/f1a zero size 2024-09-13T18:30:18.210 INFO:tasks.workunit.client.1.smithi149.stdout:0/110: dread - d1/f1a zero size 2024-09-13T18:30:18.213 INFO:tasks.workunit.client.1.smithi149.stdout:2/143: dwrite db/d10/f1a [0,4194304] 0 2024-09-13T18:30:18.213 INFO:tasks.workunit.client.1.smithi149.stdout:0/111: mknod d1/d2/c1d 0 2024-09-13T18:30:18.213 INFO:tasks.workunit.client.1.smithi149.stdout:0/112: getdents d1/d1b 0 2024-09-13T18:30:18.217 INFO:tasks.workunit.client.1.smithi149.stdout:2/144: mkdir db/d1b/d1c/d20/d2b 0 2024-09-13T18:30:18.218 INFO:tasks.workunit.client.1.smithi149.stdout:0/113: stat d1/d2/l17 0 2024-09-13T18:30:18.218 INFO:tasks.workunit.client.1.smithi149.stdout:0/114: chown d1/f10 110156230 1 2024-09-13T18:30:18.219 INFO:tasks.workunit.client.1.smithi149.stdout:0/115: chown d1/l9 64157 1 2024-09-13T18:30:18.222 INFO:tasks.workunit.client.1.smithi149.stdout:0/116: mknod d1/c1e 0 2024-09-13T18:30:18.222 INFO:tasks.workunit.client.1.smithi149.stdout:2/145: getdents db/d1b/d1c 0 2024-09-13T18:30:18.224 INFO:tasks.workunit.client.1.smithi149.stdout:0/117: rename d1/c1e to d1/d2/c1f 0 2024-09-13T18:30:18.224 INFO:tasks.workunit.client.1.smithi149.stdout:0/118: chown d1 45279705 1 2024-09-13T18:30:18.226 INFO:tasks.workunit.client.1.smithi149.stdout:2/146: unlink db/l16 0 2024-09-13T18:30:18.227 INFO:tasks.workunit.client.1.smithi149.stdout:2/147: rename db/d1b/d1c/f1e to db/d10/f2c 0 2024-09-13T18:30:18.227 INFO:tasks.workunit.client.1.smithi149.stdout:2/148: chown db/d10/f2c 128066 1 2024-09-13T18:30:18.228 INFO:tasks.workunit.client.1.smithi149.stdout:2/149: write f6 [909845,82735] 0 2024-09-13T18:30:18.236 INFO:tasks.workunit.client.1.smithi149.stdout:7/150: dwrite d7/f22 [4194304,4194304] 0 2024-09-13T18:30:18.236 INFO:tasks.workunit.client.1.smithi149.stdout:7/151: write d7/d9/d1c/d2c/f24 [118812,128203] 0 2024-09-13T18:30:18.237 INFO:tasks.workunit.client.1.smithi149.stdout:7/152: symlink d7/d9/d1c/d2c/l30 0 2024-09-13T18:30:18.239 INFO:tasks.workunit.client.1.smithi149.stdout:7/153: mkdir d7/d9/d1c/d2f/d31 0 2024-09-13T18:30:18.240 INFO:tasks.workunit.client.1.smithi149.stdout:7/154: write d7/d9/d1c/d2c/f24 [312223,49115] 0 2024-09-13T18:30:18.240 INFO:tasks.workunit.client.1.smithi149.stdout:7/155: mknod d7/d9/c32 0 2024-09-13T18:30:18.241 INFO:tasks.workunit.client.1.smithi149.stdout:2/150: dread db/d10/f25 [0,4194304] 0 2024-09-13T18:30:18.242 INFO:tasks.workunit.client.1.smithi149.stdout:3/170: dwrite d1/f24 [0,4194304] 0 2024-09-13T18:30:18.243 INFO:tasks.workunit.client.1.smithi149.stdout:6/136: dwrite f5 [4194304,4194304] 0 2024-09-13T18:30:18.244 INFO:tasks.workunit.client.1.smithi149.stdout:8/131: dwrite d2/fc [0,4194304] 0 2024-09-13T18:30:18.245 INFO:tasks.workunit.client.1.smithi149.stdout:3/171: symlink d1/d12/l36 0 2024-09-13T18:30:18.245 INFO:tasks.workunit.client.1.smithi149.stdout:2/151: write db/d10/f25 [224378,37684] 0 2024-09-13T18:30:18.245 INFO:tasks.workunit.client.1.smithi149.stdout:2/152: rename db to db/d10/d12/d2d 22 2024-09-13T18:30:18.245 INFO:tasks.workunit.client.1.smithi149.stdout:5/166: dwrite d3/d8/d13/f18 [0,4194304] 0 2024-09-13T18:30:18.247 INFO:tasks.workunit.client.1.smithi149.stdout:0/119: dwrite d1/d2/f16 [0,4194304] 0 2024-09-13T18:30:18.248 INFO:tasks.workunit.client.1.smithi149.stdout:8/132: write d2/d12/f16 [481168,41950] 0 2024-09-13T18:30:18.249 INFO:tasks.workunit.client.1.smithi149.stdout:3/172: creat d1/d2e/f37 x:0 0 0 2024-09-13T18:30:18.250 INFO:tasks.workunit.client.1.smithi149.stdout:7/156: dread d7/d9/d1c/d2c/f24 [0,4194304] 0 2024-09-13T18:30:18.251 INFO:tasks.workunit.client.1.smithi149.stdout:7/157: stat d7/d9/d1c/d2c/f24 0 2024-09-13T18:30:18.251 INFO:tasks.workunit.client.1.smithi149.stdout:7/158: creat d7/d9/f33 x:0 0 0 2024-09-13T18:30:18.252 INFO:tasks.workunit.client.1.smithi149.stdout:2/153: unlink db/f17 0 2024-09-13T18:30:18.252 INFO:tasks.workunit.client.1.smithi149.stdout:5/167: dread d3/d8/d13/f22 [0,4194304] 0 2024-09-13T18:30:18.260 INFO:tasks.workunit.client.1.smithi149.stdout:0/120: symlink d1/d2/l20 0 2024-09-13T18:30:18.260 INFO:tasks.workunit.client.1.smithi149.stdout:0/121: chown d1/d2/fb 72820 1 2024-09-13T18:30:18.265 INFO:tasks.workunit.client.1.smithi149.stdout:7/159: mkdir d7/d9/d1c/d34 0 2024-09-13T18:30:18.265 INFO:tasks.workunit.client.1.smithi149.stdout:2/154: unlink db/d1b/d1c/d20/f29 0 2024-09-13T18:30:18.265 INFO:tasks.workunit.client.1.smithi149.stdout:2/155: fsync db/d10/f14 0 2024-09-13T18:30:18.265 INFO:tasks.workunit.client.1.smithi149.stdout:5/168: rmdir d3/d8/d28/d2b 0 2024-09-13T18:30:18.265 INFO:tasks.workunit.client.1.smithi149.stdout:5/169: write d3/d8/d28/f2a [943506,110233] 0 2024-09-13T18:30:18.265 INFO:tasks.workunit.client.1.smithi149.stdout:5/170: write d3/d8/fe [4909663,92092] 0 2024-09-13T18:30:18.266 INFO:tasks.workunit.client.1.smithi149.stdout:0/122: unlink d1/f19 0 2024-09-13T18:30:18.266 INFO:tasks.workunit.client.1.smithi149.stdout:3/173: truncate d1/f24 2666486 0 2024-09-13T18:30:18.266 INFO:tasks.workunit.client.1.smithi149.stdout:3/174: chown d1/d2e/f37 1 1 2024-09-13T18:30:18.266 INFO:tasks.workunit.client.1.smithi149.stdout:3/175: read d1/d4/f2f [2519144,48575] 0 2024-09-13T18:30:18.266 INFO:tasks.workunit.client.1.smithi149.stdout:7/160: symlink d7/d9/d1b/d23/l35 0 2024-09-13T18:30:18.267 INFO:tasks.workunit.client.1.smithi149.stdout:2/156: creat db/d10/d12/d24/f2e x:0 0 0 2024-09-13T18:30:18.268 INFO:tasks.workunit.client.1.smithi149.stdout:3/176: mkdir d1/d2c/d38 0 2024-09-13T18:30:18.268 INFO:tasks.workunit.client.1.smithi149.stdout:3/177: chown d1 204188 1 2024-09-13T18:30:18.269 INFO:tasks.workunit.client.1.smithi149.stdout:0/123: dread d1/f14 [0,4194304] 0 2024-09-13T18:30:18.269 INFO:tasks.workunit.client.1.smithi149.stdout:6/137: dwrite fa [0,4194304] 0 2024-09-13T18:30:18.270 INFO:tasks.workunit.client.1.smithi149.stdout:6/138: fsync f9 0 2024-09-13T18:30:18.270 INFO:tasks.workunit.client.1.smithi149.stdout:0/124: creat d1/f21 x:0 0 0 2024-09-13T18:30:18.270 INFO:tasks.workunit.client.1.smithi149.stdout:7/161: rename d7/d9/f33 to d7/d9/d1b/f36 0 2024-09-13T18:30:18.270 INFO:tasks.workunit.client.1.smithi149.stdout:7/162: read d7/fd [104193,9373] 0 2024-09-13T18:30:18.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:17 smithi149 ceph-mon[35845]: pgmap v11: 65 pgs: 65 active+clean; 202 MiB data, 953 MiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 476 op/s 2024-09-13T18:30:18.270 INFO:tasks.workunit.client.1.smithi149.stdout:3/178: mkdir d1/d4/d39 0 2024-09-13T18:30:18.274 INFO:tasks.workunit.client.1.smithi149.stdout:6/139: link fa dc/f2c 0 2024-09-13T18:30:18.274 INFO:tasks.workunit.client.1.smithi149.stdout:6/140: write dc/d15/f2b [958683,47706] 0 2024-09-13T18:30:18.274 INFO:tasks.workunit.client.1.smithi149.stdout:6/141: write dc/f1e [49279,101551] 0 2024-09-13T18:30:18.274 INFO:tasks.workunit.client.1.smithi149.stdout:0/125: link d1/c18 d1/d2/c22 0 2024-09-13T18:30:18.274 INFO:tasks.workunit.client.1.smithi149.stdout:0/126: truncate d1/f10 1781681 0 2024-09-13T18:30:18.275 INFO:tasks.workunit.client.1.smithi149.stdout:7/163: mkdir d7/d9/d1c/d2c/d37 0 2024-09-13T18:30:18.275 INFO:tasks.workunit.client.1.smithi149.stdout:8/133: dwrite d2/f9 [0,4194304] 0 2024-09-13T18:30:18.275 INFO:tasks.workunit.client.1.smithi149.stdout:8/134: dread - d2/d12/f2f zero size 2024-09-13T18:30:18.275 INFO:tasks.workunit.client.1.smithi149.stdout:8/135: chown d2/d13/c20 366 1 2024-09-13T18:30:18.275 INFO:tasks.workunit.client.1.smithi149.stdout:5/171: fsync d3/d8/d28/f2a 0 2024-09-13T18:30:18.275 INFO:tasks.workunit.client.1.smithi149.stdout:3/179: symlink d1/d2e/d25/l3a 0 2024-09-13T18:30:18.276 INFO:tasks.workunit.client.1.smithi149.stdout:0/127: symlink d1/d1b/l23 0 2024-09-13T18:30:18.278 INFO:tasks.workunit.client.1.smithi149.stdout:8/136: unlink d2/l1a 0 2024-09-13T18:30:18.280 INFO:tasks.workunit.client.1.smithi149.stdout:5/172: creat d3/d2d/f2e x:0 0 0 2024-09-13T18:30:18.281 INFO:tasks.workunit.client.1.smithi149.stdout:3/180: symlink d1/d2c/d38/l3b 0 2024-09-13T18:30:18.282 INFO:tasks.workunit.client.1.smithi149.stdout:2/157: read db/ff [2771029,20921] 0 2024-09-13T18:30:18.283 INFO:tasks.workunit.client.1.smithi149.stdout:0/128: symlink d1/l24 0 2024-09-13T18:30:18.284 INFO:tasks.workunit.client.1.smithi149.stdout:4/183: sync 2024-09-13T18:30:18.284 INFO:tasks.workunit.client.1.smithi149.stdout:1/175: sync 2024-09-13T18:30:18.285 INFO:tasks.workunit.client.1.smithi149.stdout:0/129: dread d1/f14 [0,4194304] 0 2024-09-13T18:30:18.285 INFO:tasks.workunit.client.1.smithi149.stdout:0/130: chown d1/d2/c1d 290029864 1 2024-09-13T18:30:18.285 INFO:tasks.workunit.client.1.smithi149.stdout:0/131: write d1/f10 [1883687,116666] 0 2024-09-13T18:30:18.286 INFO:tasks.workunit.client.1.smithi149.stdout:5/173: mknod d3/d8/d28/c2f 0 2024-09-13T18:30:18.289 INFO:tasks.workunit.client.1.smithi149.stdout:3/181: creat d1/d2e/d25/d30/f3c x:0 0 0 2024-09-13T18:30:18.289 INFO:tasks.workunit.client.1.smithi149.stdout:3/182: dread - d1/d21/f27 zero size 2024-09-13T18:30:18.290 INFO:tasks.workunit.client.1.smithi149.stdout:2/158: mkdir db/d1b/d2f 0 2024-09-13T18:30:18.290 INFO:tasks.workunit.client.1.smithi149.stdout:2/159: write fa [1345742,58589] 0 2024-09-13T18:30:18.294 INFO:tasks.workunit.client.1.smithi149.stdout:8/137: getdents d2/d13 0 2024-09-13T18:30:18.299 INFO:tasks.workunit.client.1.smithi149.stdout:1/176: mkdir d9/d10/d37 0 2024-09-13T18:30:18.300 INFO:tasks.workunit.client.1.smithi149.stdout:4/184: getdents df/d11/d12/d21/d22 0 2024-09-13T18:30:18.300 INFO:tasks.workunit.client.1.smithi149.stdout:4/185: chown df/d11 424 1 2024-09-13T18:30:18.302 INFO:tasks.workunit.client.1.smithi149.stdout:5/174: mknod d3/d2d/c30 0 2024-09-13T18:30:18.302 INFO:tasks.workunit.client.1.smithi149.stdout:8/138: symlink d2/d13/l30 0 2024-09-13T18:30:18.304 INFO:tasks.workunit.client.1.smithi149.stdout:6/142: dwrite dc/f22 [0,4194304] 0 2024-09-13T18:30:18.304 INFO:tasks.workunit.client.1.smithi149.stdout:6/143: stat dc/l28 0 2024-09-13T18:30:18.304 INFO:tasks.workunit.client.1.smithi149.stdout:6/144: chown dc/d15/l1d 27 1 2024-09-13T18:30:18.304 INFO:tasks.workunit.client.1.smithi149.stdout:6/145: creat dc/f2d x:0 0 0 2024-09-13T18:30:18.305 INFO:tasks.workunit.client.1.smithi149.stdout:6/146: truncate dc/f2d 385094 0 2024-09-13T18:30:18.305 INFO:tasks.workunit.client.1.smithi149.stdout:7/164: link d7/d9/d1b/f36 d7/d9/d1c/d2c/f38 0 2024-09-13T18:30:18.308 INFO:tasks.workunit.client.1.smithi149.stdout:7/165: write d7/d9/fa [123295,109020] 0 2024-09-13T18:30:18.308 INFO:tasks.workunit.client.1.smithi149.stdout:7/166: dread - d7/d9/d1c/d2c/f38 zero size 2024-09-13T18:30:18.309 INFO:tasks.workunit.client.1.smithi149.stdout:0/132: dwrite d1/f14 [0,4194304] 0 2024-09-13T18:30:18.309 INFO:tasks.workunit.client.1.smithi149.stdout:1/177: rename d9/d15/d33 to d9/d10/d37/d38 0 2024-09-13T18:30:18.312 INFO:tasks.workunit.client.1.smithi149.stdout:4/186: unlink df/d11/d12/d17/f1a 0 2024-09-13T18:30:18.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/183: dwrite d1/d2e/f17 [0,4194304] 0 2024-09-13T18:30:18.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/184: write d1/d2e/d1d/f2b [1030588,13653] 0 2024-09-13T18:30:18.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/185: readlink d1/d4/lc 0 2024-09-13T18:30:18.320 INFO:tasks.workunit.client.1.smithi149.stdout:3/186: write d1/d2e/d25/f26 [687090,125810] 0 2024-09-13T18:30:18.323 INFO:tasks.workunit.client.1.smithi149.stdout:7/167: symlink d7/d12/l39 0 2024-09-13T18:30:18.327 INFO:tasks.workunit.client.1.smithi149.stdout:0/133: mknod d1/c25 0 2024-09-13T18:30:18.329 INFO:tasks.workunit.client.1.smithi149.stdout:4/187: mknod df/c39 0 2024-09-13T18:30:18.335 INFO:tasks.workunit.client.1.smithi149.stdout:4/188: link df/f15 df/d11/d12/d17/f3a 0 2024-09-13T18:30:18.335 INFO:tasks.workunit.client.1.smithi149.stdout:4/189: chown df 1469190182 1 2024-09-13T18:30:18.338 INFO:tasks.workunit.client.1.smithi149.stdout:7/168: write f5 [141335,80643] 0 2024-09-13T18:30:18.338 INFO:tasks.workunit.client.1.smithi149.stdout:5/175: dwrite d3/d8/d13/f18 [0,4194304] 0 2024-09-13T18:30:18.338 INFO:tasks.workunit.client.1.smithi149.stdout:7/169: chown d7/d12 115070272 1 2024-09-13T18:30:18.338 INFO:tasks.workunit.client.1.smithi149.stdout:4/190: symlink df/d11/d12/d21/d22/d30/l3b 0 2024-09-13T18:30:18.338 INFO:tasks.workunit.client.1.smithi149.stdout:8/139: truncate d2/f9 972891 0 2024-09-13T18:30:18.339 INFO:tasks.workunit.client.1.smithi149.stdout:1/178: dwrite d9/d15/d25/f30 [0,4194304] 0 2024-09-13T18:30:18.339 INFO:tasks.workunit.client.1.smithi149.stdout:0/134: dread d1/d2/f12 [0,4194304] 0 2024-09-13T18:30:18.339 INFO:tasks.workunit.client.1.smithi149.stdout:7/170: rename d7/d9/d1c/d2c/l30 to d7/d9/d1c/l3a 0 2024-09-13T18:30:18.340 INFO:tasks.workunit.client.1.smithi149.stdout:4/191: creat df/d11/d12/f3c x:0 0 0 2024-09-13T18:30:18.341 INFO:tasks.workunit.client.1.smithi149.stdout:8/140: truncate d2/fe 2318664 0 2024-09-13T18:30:18.341 INFO:tasks.workunit.client.1.smithi149.stdout:8/141: fsync d2/d12/f2f 0 2024-09-13T18:30:18.342 INFO:tasks.workunit.client.1.smithi149.stdout:0/135: truncate d1/f13 2645934 0 2024-09-13T18:30:18.342 INFO:tasks.workunit.client.1.smithi149.stdout:0/136: chown d1/c6 32387298 1 2024-09-13T18:30:18.342 INFO:tasks.workunit.client.1.smithi149.stdout:3/187: dwrite d1/d2e/f37 [0,4194304] 0 2024-09-13T18:30:18.343 INFO:tasks.workunit.client.1.smithi149.stdout:3/188: truncate d1/d21/f27 1638322 0 2024-09-13T18:30:18.344 INFO:tasks.workunit.client.1.smithi149.stdout:1/179: symlink d9/d10/d2a/l39 0 2024-09-13T18:30:18.344 INFO:tasks.workunit.client.1.smithi149.stdout:7/171: mknod d7/d9/d1b/c3b 0 2024-09-13T18:30:18.344 INFO:tasks.workunit.client.1.smithi149.stdout:7/172: chown d7/d9/d1c/d2c/f24 119257010 1 2024-09-13T18:30:18.345 INFO:tasks.workunit.client.1.smithi149.stdout:4/192: unlink df/d11/f2a 0 2024-09-13T18:30:18.345 INFO:tasks.workunit.client.1.smithi149.stdout:4/193: write df/d11/d1c/f32 [821344,61606] 0 2024-09-13T18:30:18.345 INFO:tasks.workunit.client.1.smithi149.stdout:4/194: chown df/d11/d12/d21/d22/d30/f37 643 1 2024-09-13T18:30:18.346 INFO:tasks.workunit.client.1.smithi149.stdout:8/142: symlink d2/d12/d2a/l31 0 2024-09-13T18:30:18.348 INFO:tasks.workunit.client.1.smithi149.stdout:5/176: dread d3/f4 [4194304,4194304] 0 2024-09-13T18:30:18.348 INFO:tasks.workunit.client.1.smithi149.stdout:5/177: creat d3/d8/d28/f31 x:0 0 0 2024-09-13T18:30:18.349 INFO:tasks.workunit.client.1.smithi149.stdout:5/178: fdatasync d3/d8/fe 0 2024-09-13T18:30:18.349 INFO:tasks.workunit.client.1.smithi149.stdout:5/179: truncate d3/d8/d28/f31 1862 0 2024-09-13T18:30:18.349 INFO:tasks.workunit.client.1.smithi149.stdout:5/180: write d3/d8/d28/f31 [492608,74521] 0 2024-09-13T18:30:18.349 INFO:tasks.workunit.client.1.smithi149.stdout:1/180: rmdir d9/d10/d37 39 2024-09-13T18:30:18.351 INFO:tasks.workunit.client.1.smithi149.stdout:4/195: mkdir df/d11/d12/d17/d3d 0 2024-09-13T18:30:18.352 INFO:tasks.workunit.client.1.smithi149.stdout:8/143: symlink d2/d13/l32 0 2024-09-13T18:30:18.355 INFO:tasks.workunit.client.1.smithi149.stdout:6/147: truncate dc/f2d 238282 0 2024-09-13T18:30:18.356 INFO:tasks.workunit.client.1.smithi149.stdout:6/148: truncate dc/d15/d23/f27 711725 0 2024-09-13T18:30:18.356 INFO:tasks.workunit.client.1.smithi149.stdout:6/149: fdatasync f9 0 2024-09-13T18:30:18.356 INFO:tasks.workunit.client.1.smithi149.stdout:6/150: truncate dc/d15/f2b 1034912 0 2024-09-13T18:30:18.356 INFO:tasks.workunit.client.1.smithi149.stdout:3/189: dread d1/d2e/d25/f26 [0,4194304] 0 2024-09-13T18:30:18.356 INFO:tasks.workunit.client.1.smithi149.stdout:9/116: sync 2024-09-13T18:30:18.359 INFO:tasks.workunit.client.1.smithi149.stdout:1/181: unlink d9/l24 0 2024-09-13T18:30:18.360 INFO:tasks.workunit.client.1.smithi149.stdout:4/196: symlink df/d11/d12/d17/d3d/l3e 0 2024-09-13T18:30:18.362 INFO:tasks.workunit.client.1.smithi149.stdout:8/144: symlink d2/d12/d1b/l33 0 2024-09-13T18:30:18.362 INFO:tasks.workunit.client.1.smithi149.stdout:8/145: chown d2/l11 320188 1 2024-09-13T18:30:18.364 INFO:tasks.workunit.client.1.smithi149.stdout:0/137: dwrite d1/d2/fd [0,4194304] 0 2024-09-13T18:30:18.364 INFO:tasks.workunit.client.1.smithi149.stdout:6/151: symlink dc/d15/l2e 0 2024-09-13T18:30:18.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.363+0000 7fc6667fc640 1 -- 172.21.15.38:0/396570473 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6580317d0 con 0x7fc6680ffb90 2024-09-13T18:30:18.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.363+0000 7fc66d2cc640 1 -- 172.21.15.38:0/396570473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6680ffb90 msgr2=0x7fc6680fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.363+0000 7fc66d2cc640 1 --2- 172.21.15.38:0/396570473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6680ffb90 0x7fc6680fff90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc658009880 tx=0x7fc65802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.364+0000 7fc66d2cc640 1 -- 172.21.15.38:0/396570473 shutdown_connections 2024-09-13T18:30:18.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.364+0000 7fc66d2cc640 1 --2- 172.21.15.38:0/396570473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc668100d90 0x7fc668101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.364+0000 7fc66d2cc640 1 --2- 172.21.15.38:0/396570473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6680ffb90 0x7fc6680fff90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.364+0000 7fc66d2cc640 1 -- 172.21.15.38:0/396570473 >> 172.21.15.38:0/396570473 conn(0x7fc6680fb320 msgr2=0x7fc6680fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:18.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.364+0000 7fc66d2cc640 1 -- 172.21.15.38:0/396570473 shutdown_connections 2024-09-13T18:30:18.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.364+0000 7fc66d2cc640 1 -- 172.21.15.38:0/396570473 wait complete. 2024-09-13T18:30:18.368 INFO:tasks.workunit.client.1.smithi149.stdout:3/190: mknod d1/d4/d39/c3d 0 2024-09-13T18:30:18.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.365+0000 7fc66d2cc640 1 Processor -- start 2024-09-13T18:30:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.365+0000 7fc66d2cc640 1 -- start start 2024-09-13T18:30:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.365+0000 7fc66d2cc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6680ffb90 0x7fc668195550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.365+0000 7fc66d2cc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc668100d90 0x7fc668195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.365+0000 7fc66d2cc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc668196060 con 0x7fc6680ffb90 2024-09-13T18:30:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.365+0000 7fc66d2cc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6681961d0 con 0x7fc668100d90 2024-09-13T18:30:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.365+0000 7fc666ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6680ffb90 0x7fc668195550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.365+0000 7fc666ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6680ffb90 0x7fc668195550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45352/0 (socket says 172.21.15.38:45352) 2024-09-13T18:30:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.365+0000 7fc666ffd640 1 -- 172.21.15.38:0/1005341257 learned_addr learned my addr 172.21.15.38:0/1005341257 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.366+0000 7fc65ffff640 1 --2- 172.21.15.38:0/1005341257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc668100d90 0x7fc668195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.366+0000 7fc666ffd640 1 -- 172.21.15.38:0/1005341257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc668100d90 msgr2=0x7fc668195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.370 INFO:tasks.workunit.client.1.smithi149.stdout:5/181: write d3/d8/f27 [279405,26042] 0 2024-09-13T18:30:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.366+0000 7fc666ffd640 1 --2- 172.21.15.38:0/1005341257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc668100d90 0x7fc668195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.366+0000 7fc666ffd640 1 -- 172.21.15.38:0/1005341257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc658009560 con 0x7fc6680ffb90 2024-09-13T18:30:18.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.367+0000 7fc666ffd640 1 --2- 172.21.15.38:0/1005341257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6680ffb90 0x7fc668195550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc6580055f0 tx=0x7fc658005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:18.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.367+0000 7fc664ff9640 1 -- 172.21.15.38:0/1005341257 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc658004b20 con 0x7fc6680ffb90 2024-09-13T18:30:18.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.367+0000 7fc664ff9640 1 -- 172.21.15.38:0/1005341257 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc658004c80 con 0x7fc6680ffb90 2024-09-13T18:30:18.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.367+0000 7fc66d2cc640 1 -- 172.21.15.38:0/1005341257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66819ac10 con 0x7fc6680ffb90 2024-09-13T18:30:18.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.368+0000 7fc66d2cc640 1 -- 172.21.15.38:0/1005341257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66819b180 con 0x7fc6680ffb90 2024-09-13T18:30:18.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.368+0000 7fc664ff9640 1 -- 172.21.15.38:0/1005341257 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc658031af0 con 0x7fc6680ffb90 2024-09-13T18:30:18.371 INFO:tasks.workunit.client.1.smithi149.stdout:1/182: rename d9/d15/l2f to d9/d10/d34/l3a 0 2024-09-13T18:30:18.372 INFO:tasks.workunit.client.1.smithi149.stdout:8/146: creat d2/f34 x:0 0 0 2024-09-13T18:30:18.372 INFO:tasks.workunit.client.1.smithi149.stdout:8/147: readlink d2/l11 0 2024-09-13T18:30:18.372 INFO:tasks.workunit.client.1.smithi149.stdout:8/148: fsync d2/fc 0 2024-09-13T18:30:18.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.370+0000 7fc66d2cc640 1 -- 172.21.15.38:0/1005341257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc648005280 con 0x7fc6680ffb90 2024-09-13T18:30:18.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.371+0000 7fc664ff9640 1 -- 172.21.15.38:0/1005341257 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fc658031c50 con 0x7fc6680ffb90 2024-09-13T18:30:18.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.372+0000 7fc664ff9640 1 --2- 172.21.15.38:0/1005341257 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fc65406cd80 0x7fc65406f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.373+0000 7fc664ff9640 1 -- 172.21.15.38:0/1005341257 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc6580ad720 con 0x7fc6680ffb90 2024-09-13T18:30:18.376 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.374+0000 7fc65ffff640 1 --2- 172.21.15.38:0/1005341257 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fc65406cd80 0x7fc65406f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.377 INFO:tasks.workunit.client.1.smithi149.stdout:6/152: mkdir dc/d2f 0 2024-09-13T18:30:18.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.375+0000 7fc65ffff640 1 --2- 172.21.15.38:0/1005341257 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fc65406cd80 0x7fc65406f240 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc668196a70 tx=0x7fc65000a250 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:18.379 INFO:tasks.workunit.client.1.smithi149.stdout:3/191: symlink d1/d4/d39/l3e 0 2024-09-13T18:30:18.379 INFO:tasks.workunit.client.1.smithi149.stdout:9/117: getdents d0/d18 0 2024-09-13T18:30:18.379 INFO:tasks.workunit.client.1.smithi149.stdout:9/118: fsync d0/f1a 0 2024-09-13T18:30:18.379 INFO:tasks.workunit.client.1.smithi149.stdout:9/119: creat d0/f2a x:0 0 0 2024-09-13T18:30:18.379 INFO:tasks.workunit.client.1.smithi149.stdout:9/120: write d0/f22 [4078860,39482] 0 2024-09-13T18:30:18.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.379+0000 7fc664ff9640 1 -- 172.21.15.38:0/1005341257 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc6580778a0 con 0x7fc6680ffb90 2024-09-13T18:30:18.384 INFO:tasks.workunit.client.1.smithi149.stdout:1/183: rename d9/l18 to d9/l3b 0 2024-09-13T18:30:18.384 INFO:tasks.workunit.client.1.smithi149.stdout:3/192: symlink d1/d2e/d1d/l3f 0 2024-09-13T18:30:18.384 INFO:tasks.workunit.client.1.smithi149.stdout:3/193: chown d1/d4/f2f 91 1 2024-09-13T18:30:18.384 INFO:tasks.workunit.client.1.smithi149.stdout:3/194: truncate d1/f24 3200130 0 2024-09-13T18:30:18.384 INFO:tasks.workunit.client.1.smithi149.stdout:3/195: fdatasync d1/d21/f27 0 2024-09-13T18:30:18.387 INFO:tasks.workunit.client.1.smithi149.stdout:5/182: rename d3/d2d to d3/d10/d32 0 2024-09-13T18:30:18.397 INFO:tasks.workunit.client.1.smithi149.stdout:3/196: dread d1/f11 [0,4194304] 0 2024-09-13T18:30:18.397 INFO:tasks.workunit.client.1.smithi149.stdout:3/197: fdatasync d1/d2e/d25/f26 0 2024-09-13T18:30:18.398 INFO:tasks.workunit.client.1.smithi149.stdout:3/198: rename d1/c8 to d1/d2e/c40 0 2024-09-13T18:30:18.400 INFO:tasks.workunit.client.1.smithi149.stdout:6/153: dread dc/d15/f20 [0,4194304] 0 2024-09-13T18:30:18.400 INFO:tasks.workunit.client.1.smithi149.stdout:3/199: truncate d1/f11 1617106 0 2024-09-13T18:30:18.402 INFO:tasks.workunit.client.1.smithi149.stdout:6/154: rename dc/f16 to dc/d15/f30 0 2024-09-13T18:30:18.403 INFO:tasks.workunit.client.1.smithi149.stdout:3/200: mkdir d1/d2e/d25/d30/d41 0 2024-09-13T18:30:18.411 INFO:tasks.workunit.client.1.smithi149.stdout:8/149: dwrite d2/d13/f17 [0,4194304] 0 2024-09-13T18:30:18.412 INFO:tasks.workunit.client.1.smithi149.stdout:8/150: symlink d2/d13/l35 0 2024-09-13T18:30:18.413 INFO:tasks.workunit.client.1.smithi149.stdout:8/151: mknod d2/d12/d2a/c36 0 2024-09-13T18:30:18.413 INFO:tasks.workunit.client.1.smithi149.stdout:6/155: dread f8 [0,4194304] 0 2024-09-13T18:30:18.413 INFO:tasks.workunit.client.1.smithi149.stdout:6/156: creat dc/d15/d23/f31 x:0 0 0 2024-09-13T18:30:18.413 INFO:tasks.workunit.client.1.smithi149.stdout:6/157: chown dc/d15/c18 3579997 1 2024-09-13T18:30:18.415 INFO:tasks.workunit.client.1.smithi149.stdout:6/158: truncate f5 266178 0 2024-09-13T18:30:18.415 INFO:tasks.workunit.client.1.smithi149.stdout:6/159: creat dc/d2f/f32 x:0 0 0 2024-09-13T18:30:18.416 INFO:tasks.workunit.client.1.smithi149.stdout:0/138: dwrite d1/f21 [0,4194304] 0 2024-09-13T18:30:18.416 INFO:tasks.workunit.client.1.smithi149.stdout:4/197: dwrite df/f2b [0,4194304] 0 2024-09-13T18:30:18.417 INFO:tasks.workunit.client.1.smithi149.stdout:9/121: dwrite d0/fe [0,4194304] 0 2024-09-13T18:30:18.420 INFO:tasks.workunit.client.1.smithi149.stdout:9/122: link d0/l15 d0/d18/d27/l2b 0 2024-09-13T18:30:18.421 INFO:tasks.workunit.client.1.smithi149.stdout:9/123: mknod d0/d18/d27/c2c 0 2024-09-13T18:30:18.421 INFO:tasks.workunit.client.1.smithi149.stdout:9/124: chown d0/l15 38544 1 2024-09-13T18:30:18.423 INFO:tasks.workunit.client.1.smithi149.stdout:9/125: rename d0/ff to d0/d18/f2d 0 2024-09-13T18:30:18.423 INFO:tasks.workunit.client.1.smithi149.stdout:9/126: write d0/f2a [909796,25808] 0 2024-09-13T18:30:18.425 INFO:tasks.workunit.client.1.smithi149.stdout:1/184: dwrite d9/d15/f29 [0,4194304] 0 2024-09-13T18:30:18.425 INFO:tasks.workunit.client.1.smithi149.stdout:5/183: rmdir d3/d10 39 2024-09-13T18:30:18.430 INFO:tasks.workunit.client.1.smithi149.stdout:1/185: mkdir d9/d10/d34/d3c 0 2024-09-13T18:30:18.430 INFO:tasks.workunit.client.1.smithi149.stdout:1/186: write f2 [5424089,103981] 0 2024-09-13T18:30:18.430 INFO:tasks.workunit.client.1.smithi149.stdout:1/187: dread - d9/d10/f22 zero size 2024-09-13T18:30:18.432 INFO:tasks.workunit.client.1.smithi149.stdout:4/198: write fc [5147736,19705] 0 2024-09-13T18:30:18.433 INFO:tasks.workunit.client.1.smithi149.stdout:1/188: creat d9/f3d x:0 0 0 2024-09-13T18:30:18.433 INFO:tasks.workunit.client.1.smithi149.stdout:1/189: truncate d9/f1c 3626629 0 2024-09-13T18:30:18.434 INFO:tasks.workunit.client.1.smithi149.stdout:6/160: getdents dc 0 2024-09-13T18:30:18.435 INFO:tasks.workunit.client.1.smithi149.stdout:4/199: link df/f2b df/d11/d1c/f3f 0 2024-09-13T18:30:18.439 INFO:tasks.workunit.client.1.smithi149.stdout:1/190: link d9/l23 d9/d15/d25/l3e 0 2024-09-13T18:30:18.439 INFO:tasks.workunit.client.1.smithi149.stdout:1/191: chown d9/d15/d25 123 1 2024-09-13T18:30:18.443 INFO:tasks.workunit.client.1.smithi149.stdout:8/152: dwrite d2/d12/d2a/f2c [0,4194304] 0 2024-09-13T18:30:18.443 INFO:tasks.workunit.client.1.smithi149.stdout:0/139: dwrite d1/f13 [0,4194304] 0 2024-09-13T18:30:18.443 INFO:tasks.workunit.client.1.smithi149.stdout:6/161: unlink dc/d15/c18 0 2024-09-13T18:30:18.444 INFO:tasks.workunit.client.1.smithi149.stdout:6/162: chown f8 515 1 2024-09-13T18:30:18.448 INFO:tasks.workunit.client.1.smithi149.stdout:9/127: write d0/f4 [2567724,65522] 0 2024-09-13T18:30:18.453 INFO:tasks.workunit.client.1.smithi149.stdout:0/140: mknod d1/d1b/c26 0 2024-09-13T18:30:18.456 INFO:tasks.workunit.client.1.smithi149.stdout:9/128: truncate d0/d18/f2d 1680887 0 2024-09-13T18:30:18.459 INFO:tasks.workunit.client.1.smithi149.stdout:0/141: link d1/d2/fb d1/f27 0 2024-09-13T18:30:18.465 INFO:tasks.workunit.client.1.smithi149.stdout:0/142: rename d1/l24 to d1/l28 0 2024-09-13T18:30:18.465 INFO:tasks.workunit.client.1.smithi149.stdout:2/160: sync 2024-09-13T18:30:18.466 INFO:tasks.workunit.client.1.smithi149.stdout:0/143: mkdir d1/d29 0 2024-09-13T18:30:18.466 INFO:tasks.workunit.client.1.smithi149.stdout:0/144: readlink d1/l28 0 2024-09-13T18:30:18.466 INFO:tasks.workunit.client.1.smithi149.stdout:2/161: mkdir db/d1b/d2f/d30 0 2024-09-13T18:30:18.467 INFO:tasks.workunit.client.1.smithi149.stdout:0/145: mknod d1/d1b/c2a 0 2024-09-13T18:30:18.467 INFO:tasks.workunit.client.1.smithi149.stdout:0/146: write d1/f5 [4296559,97965] 0 2024-09-13T18:30:18.468 INFO:tasks.workunit.client.1.smithi149.stdout:4/200: dwrite df/f15 [0,4194304] 0 2024-09-13T18:30:18.468 INFO:tasks.workunit.client.1.smithi149.stdout:5/184: dwrite d3/d8/d13/f22 [0,4194304] 0 2024-09-13T18:30:18.468 INFO:tasks.workunit.client.1.smithi149.stdout:4/201: chown df/d11/d12 28905763 1 2024-09-13T18:30:18.468 INFO:tasks.workunit.client.1.smithi149.stdout:2/162: symlink db/d10/d12/d24/d28/l31 0 2024-09-13T18:30:18.470 INFO:tasks.workunit.client.1.smithi149.stdout:9/129: dread d0/f2a [0,4194304] 0 2024-09-13T18:30:18.470 INFO:tasks.workunit.client.1.smithi149.stdout:9/130: chown d0/f29 61 1 2024-09-13T18:30:18.471 INFO:tasks.workunit.client.1.smithi149.stdout:4/202: creat df/d11/d12/d17/d3d/f40 x:0 0 0 2024-09-13T18:30:18.472 INFO:tasks.workunit.client.1.smithi149.stdout:2/163: truncate db/d1b/f21 1750417 0 2024-09-13T18:30:18.472 INFO:tasks.workunit.client.1.smithi149.stdout:8/153: dwrite d2/d13/f17 [4194304,4194304] 0 2024-09-13T18:30:18.473 INFO:tasks.workunit.client.1.smithi149.stdout:9/131: mkdir d0/d2e 0 2024-09-13T18:30:18.475 INFO:tasks.workunit.client.1.smithi149.stdout:4/203: unlink df/d11/d1c/l2f 0 2024-09-13T18:30:18.477 INFO:tasks.workunit.client.1.smithi149.stdout:9/132: rename d0/d18/d27/c2c to d0/d18/d19/c2f 0 2024-09-13T18:30:18.478 INFO:tasks.workunit.client.1.smithi149.stdout:4/204: mkdir df/d11/d12/d21/d22/d30/d41 0 2024-09-13T18:30:18.478 INFO:tasks.workunit.client.1.smithi149.stdout:1/192: dwrite f2 [0,4194304] 0 2024-09-13T18:30:18.479 INFO:tasks.workunit.client.1.smithi149.stdout:4/205: dread - df/d11/f34 zero size 2024-09-13T18:30:18.479 INFO:tasks.workunit.client.1.smithi149.stdout:1/193: chown d9/d10/d2a 0 1 2024-09-13T18:30:18.480 INFO:tasks.workunit.client.1.smithi149.stdout:6/163: dwrite dc/f29 [0,4194304] 0 2024-09-13T18:30:18.482 INFO:tasks.workunit.client.1.smithi149.stdout:4/206: link df/d11/d12/d17/d3d/f40 df/d11/d1c/f42 0 2024-09-13T18:30:18.482 INFO:tasks.workunit.client.1.smithi149.stdout:4/207: truncate df/d11/d12/f3c 880057 0 2024-09-13T18:30:18.484 INFO:tasks.workunit.client.1.smithi149.stdout:2/164: dread db/d10/f15 [0,4194304] 0 2024-09-13T18:30:18.489 INFO:tasks.workunit.client.1.smithi149.stdout:6/164: rename dc/d15/l1d to dc/d15/l33 0 2024-09-13T18:30:18.495 INFO:tasks.workunit.client.1.smithi149.stdout:2/165: dread db/d10/f14 [0,4194304] 0 2024-09-13T18:30:18.497 INFO:tasks.workunit.client.1.smithi149.stdout:2/166: truncate db/fd 2103670 0 2024-09-13T18:30:18.499 INFO:tasks.workunit.client.1.smithi149.stdout:1/194: truncate f3 3041981 0 2024-09-13T18:30:18.500 INFO:tasks.workunit.client.1.smithi149.stdout:1/195: mkdir d9/d10/d3f 0 2024-09-13T18:30:18.501 INFO:tasks.workunit.client.1.smithi149.stdout:1/196: mkdir d9/d15/d40 0 2024-09-13T18:30:18.501 INFO:tasks.workunit.client.1.smithi149.stdout:1/197: write d9/d15/d25/f36 [991214,94130] 0 2024-09-13T18:30:18.502 INFO:tasks.workunit.client.1.smithi149.stdout:2/167: dread db/d10/f25 [0,4194304] 0 2024-09-13T18:30:18.503 INFO:tasks.workunit.client.1.smithi149.stdout:6/165: write dc/f22 [562923,80266] 0 2024-09-13T18:30:18.503 INFO:tasks.workunit.client.1.smithi149.stdout:2/168: getdents db 0 2024-09-13T18:30:18.503 INFO:tasks.workunit.client.1.smithi149.stdout:2/169: fdatasync db/d13/f18 0 2024-09-13T18:30:18.505 INFO:tasks.workunit.client.1.smithi149.stdout:2/170: link l3 db/d1b/d2f/d30/l32 0 2024-09-13T18:30:18.505 INFO:tasks.workunit.client.1.smithi149.stdout:2/171: readlink db/d1b/d2f/d30/l32 0 2024-09-13T18:30:18.505 INFO:tasks.workunit.client.1.smithi149.stdout:2/172: readlink db/d10/d12/d24/d28/l31 0 2024-09-13T18:30:18.505 INFO:tasks.workunit.client.1.smithi149.stdout:2/173: stat db/ff 0 2024-09-13T18:30:18.506 INFO:tasks.workunit.client.1.smithi149.stdout:2/174: rename fa to db/d1b/f33 0 2024-09-13T18:30:18.506 INFO:tasks.workunit.client.1.smithi149.stdout:2/175: write db/ff [3178892,48953] 0 2024-09-13T18:30:18.509 INFO:tasks.workunit.client.1.smithi149.stdout:6/166: write dc/d15/f20 [652059,68218] 0 2024-09-13T18:30:18.509 INFO:tasks.workunit.client.1.smithi149.stdout:6/167: dread - dc/d15/d23/f31 zero size 2024-09-13T18:30:18.512 INFO:tasks.workunit.client.1.smithi149.stdout:8/154: dwrite d2/fe [0,4194304] 0 2024-09-13T18:30:18.513 INFO:tasks.workunit.client.1.smithi149.stdout:0/147: dwrite d1/f21 [0,4194304] 0 2024-09-13T18:30:18.513 INFO:tasks.workunit.client.1.smithi149.stdout:9/133: dwrite d0/f2a [0,4194304] 0 2024-09-13T18:30:18.518 INFO:tasks.workunit.client.1.smithi149.stdout:9/134: truncate d0/f9 2771472 0 2024-09-13T18:30:18.522 INFO:tasks.workunit.client.1.smithi149.stdout:9/135: mknod d0/d18/d27/c30 0 2024-09-13T18:30:18.525 INFO:tasks.workunit.client.1.smithi149.stdout:7/173: sync 2024-09-13T18:30:18.525 INFO:tasks.workunit.client.1.smithi149.stdout:7/174: creat d7/f3c x:0 0 0 2024-09-13T18:30:18.529 INFO:tasks.workunit.client.1.smithi149.stdout:6/168: truncate dc/f22 3022481 0 2024-09-13T18:30:18.530 INFO:tasks.workunit.client.1.smithi149.stdout:9/136: creat d0/d18/f31 x:0 0 0 2024-09-13T18:30:18.532 INFO:tasks.workunit.client.1.smithi149.stdout:7/175: mkdir d7/d9/d1c/d1f/d3d 0 2024-09-13T18:30:18.532 INFO:tasks.workunit.client.1.smithi149.stdout:7/176: write f5 [195634,72485] 0 2024-09-13T18:30:18.534 INFO:tasks.workunit.client.1.smithi149.stdout:6/169: truncate dc/f2c 595577 0 2024-09-13T18:30:18.534 INFO:tasks.workunit.client.1.smithi149.stdout:6/170: creat dc/d2f/f34 x:0 0 0 2024-09-13T18:30:18.536 INFO:tasks.workunit.client.1.smithi149.stdout:9/137: unlink d0/d18/f2d 0 2024-09-13T18:30:18.537 INFO:tasks.workunit.client.1.smithi149.stdout:1/198: dwrite d9/d10/d2a/f31 [0,4194304] 0 2024-09-13T18:30:18.538 INFO:tasks.workunit.client.1.smithi149.stdout:7/177: rmdir d7/d12 39 2024-09-13T18:30:18.539 INFO:tasks.workunit.client.1.smithi149.stdout:9/138: write d0/f9 [1204536,18294] 0 2024-09-13T18:30:18.543 INFO:tasks.workunit.client.1.smithi149.stdout:2/176: dwrite db/d10/f14 [0,4194304] 0 2024-09-13T18:30:18.544 INFO:tasks.workunit.client.1.smithi149.stdout:2/177: mknod db/d1b/d2f/d30/c34 0 2024-09-13T18:30:18.546 INFO:tasks.workunit.client.1.smithi149.stdout:2/178: unlink db/d1b/d1c/l22 0 2024-09-13T18:30:18.552 INFO:tasks.workunit.client.1.smithi149.stdout:9/139: read d0/f1a [3221392,62627] 0 2024-09-13T18:30:18.552 INFO:tasks.workunit.client.1.smithi149.stdout:9/140: creat d0/d18/d19/f32 x:0 0 0 2024-09-13T18:30:18.552 INFO:tasks.workunit.client.1.smithi149.stdout:8/155: dwrite d2/d13/f29 [0,4194304] 0 2024-09-13T18:30:18.553 INFO:tasks.workunit.client.1.smithi149.stdout:8/156: write d2/d12/f2f [45521,22690] 0 2024-09-13T18:30:18.553 INFO:tasks.workunit.client.1.smithi149.stdout:2/179: dread db/fd [0,4194304] 0 2024-09-13T18:30:18.555 INFO:tasks.workunit.client.1.smithi149.stdout:1/199: read d9/d10/f1d [2922364,31810] 0 2024-09-13T18:30:18.555 INFO:tasks.workunit.client.1.smithi149.stdout:1/200: chown d9/f3d 14 1 2024-09-13T18:30:18.555 INFO:tasks.workunit.client.1.smithi149.stdout:1/201: write d9/d10/f27 [1701014,76717] 0 2024-09-13T18:30:18.555 INFO:tasks.workunit.client.1.smithi149.stdout:9/141: unlink d0/l15 0 2024-09-13T18:30:18.557 INFO:tasks.workunit.client.1.smithi149.stdout:1/202: mknod d9/d10/d34/c41 0 2024-09-13T18:30:18.558 INFO:tasks.workunit.client.1.smithi149.stdout:9/142: mkdir d0/d33 0 2024-09-13T18:30:18.558 INFO:tasks.workunit.client.1.smithi149.stdout:9/143: truncate d0/f29 522384 0 2024-09-13T18:30:18.558 INFO:tasks.workunit.client.1.smithi149.stdout:9/144: chown d0/l16 1 1 2024-09-13T18:30:18.558 INFO:tasks.workunit.client.1.smithi149.stdout:1/203: mkdir d9/d10/d2a/d42 0 2024-09-13T18:30:18.559 INFO:tasks.workunit.client.1.smithi149.stdout:9/145: truncate d0/f9 955423 0 2024-09-13T18:30:18.564 INFO:tasks.workunit.client.1.smithi149.stdout:3/201: sync 2024-09-13T18:30:18.564 INFO:tasks.workunit.client.1.smithi149.stdout:3/202: readlink d1/d2e/d25/l35 0 2024-09-13T18:30:18.565 INFO:tasks.workunit.client.1.smithi149.stdout:3/203: mkdir d1/d2c/d42 0 2024-09-13T18:30:18.565 INFO:tasks.workunit.client.1.smithi149.stdout:3/204: fsync d1/f11 0 2024-09-13T18:30:18.567 INFO:tasks.workunit.client.1.smithi149.stdout:2/180: dread db/ff [0,4194304] 0 2024-09-13T18:30:18.567 INFO:tasks.workunit.client.1.smithi149.stdout:2/181: fdatasync db/d1b/f33 0 2024-09-13T18:30:18.567 INFO:tasks.workunit.client.1.smithi149.stdout:2/182: chown db 20749970 1 2024-09-13T18:30:18.567 INFO:tasks.workunit.client.1.smithi149.stdout:2/183: stat db/d10/f1a 0 2024-09-13T18:30:18.567 INFO:tasks.workunit.client.1.smithi149.stdout:8/157: dread d2/fc [0,4194304] 0 2024-09-13T18:30:18.567 INFO:tasks.workunit.client.1.smithi149.stdout:6/171: dwrite dc/d15/f20 [0,4194304] 0 2024-09-13T18:30:18.568 INFO:tasks.workunit.client.1.smithi149.stdout:1/204: fsync d9/f1c 0 2024-09-13T18:30:18.569 INFO:tasks.workunit.client.1.smithi149.stdout:6/172: dread dc/f1e [0,4194304] 0 2024-09-13T18:30:18.569 INFO:tasks.workunit.client.1.smithi149.stdout:6/173: write dc/d15/d23/f27 [377411,39699] 0 2024-09-13T18:30:18.570 INFO:tasks.workunit.client.1.smithi149.stdout:2/184: rename db/d10/d12/d24/d28/l31 to db/d10/d12/l35 0 2024-09-13T18:30:18.572 INFO:tasks.workunit.client.1.smithi149.stdout:9/146: dread d0/f2a [0,4194304] 0 2024-09-13T18:30:18.574 INFO:tasks.workunit.client.1.smithi149.stdout:1/205: mkdir d9/d10/d43 0 2024-09-13T18:30:18.574 INFO:tasks.workunit.client.1.smithi149.stdout:1/206: fdatasync d9/f3d 0 2024-09-13T18:30:18.576 INFO:tasks.workunit.client.1.smithi149.stdout:6/174: link dc/d15/d23/f31 dc/d15/f35 0 2024-09-13T18:30:18.576 INFO:tasks.workunit.client.1.smithi149.stdout:6/175: readlink dc/l11 0 2024-09-13T18:30:18.576 INFO:tasks.workunit.client.1.smithi149.stdout:6/176: creat dc/d15/f36 x:0 0 0 2024-09-13T18:30:18.576 INFO:tasks.workunit.client.1.smithi149.stdout:6/177: write f5 [789138,26740] 0 2024-09-13T18:30:18.576 INFO:tasks.workunit.client.1.smithi149.stdout:6/178: write dc/d15/d23/f31 [950267,116053] 0 2024-09-13T18:30:18.577 INFO:tasks.workunit.client.1.smithi149.stdout:8/158: rename d2/d12/l2e to d2/l37 0 2024-09-13T18:30:18.578 INFO:tasks.workunit.client.1.smithi149.stdout:2/185: mknod db/d10/d12/d24/d28/c36 0 2024-09-13T18:30:18.579 INFO:tasks.workunit.client.1.smithi149.stdout:1/207: link d9/d15/c16 d9/d10/d34/d3c/c44 0 2024-09-13T18:30:18.583 INFO:tasks.workunit.client.1.smithi149.stdout:6/179: write dc/d15/f2b [601190,123346] 0 2024-09-13T18:30:18.583 INFO:tasks.workunit.client.1.smithi149.stdout:8/159: dread d2/d12/f16 [0,4194304] 0 2024-09-13T18:30:18.584 INFO:tasks.workunit.client.1.smithi149.stdout:6/180: rmdir dc 39 2024-09-13T18:30:18.585 INFO:tasks.workunit.client.1.smithi149.stdout:6/181: creat dc/f37 x:0 0 0 2024-09-13T18:30:18.585 INFO:tasks.workunit.client.1.smithi149.stdout:6/182: truncate dc/f29 4707968 0 2024-09-13T18:30:18.587 INFO:tasks.workunit.client.1.smithi149.stdout:2/186: dread db/fd [0,4194304] 0 2024-09-13T18:30:18.587 INFO:tasks.workunit.client.1.smithi149.stdout:2/187: write db/fd [2983834,21822] 0 2024-09-13T18:30:18.596 INFO:tasks.workunit.client.1.smithi149.stdout:8/160: write d2/d13/f17 [3147495,81547] 0 2024-09-13T18:30:18.598 INFO:tasks.workunit.client.1.smithi149.stdout:3/205: dwrite d1/d4/fd [0,4194304] 0 2024-09-13T18:30:18.598 INFO:tasks.workunit.client.1.smithi149.stdout:3/206: chown d1/d4/l1e 277013 1 2024-09-13T18:30:18.602 INFO:tasks.workunit.client.1.smithi149.stdout:9/147: dwrite d0/f4 [4194304,4194304] 0 2024-09-13T18:30:18.603 INFO:tasks.workunit.client.1.smithi149.stdout:3/207: mkdir d1/d2e/d25/d30/d43 0 2024-09-13T18:30:18.606 INFO:tasks.workunit.client.1.smithi149.stdout:3/208: symlink d1/d2c/l44 0 2024-09-13T18:30:18.606 INFO:tasks.workunit.client.1.smithi149.stdout:9/148: truncate d0/f22 2548388 0 2024-09-13T18:30:18.606 INFO:tasks.workunit.client.1.smithi149.stdout:9/149: fdatasync d0/f2a 0 2024-09-13T18:30:18.607 INFO:tasks.workunit.client.1.smithi149.stdout:3/209: creat d1/d12/d20/f45 x:0 0 0 2024-09-13T18:30:18.609 INFO:tasks.workunit.client.1.smithi149.stdout:3/210: mkdir d1/d2e/d25/d30/d46 0 2024-09-13T18:30:18.618 INFO:tasks.workunit.client.1.smithi149.stdout:1/208: dwrite d9/d10/f1d [4194304,4194304] 0 2024-09-13T18:30:18.618 INFO:tasks.workunit.client.1.smithi149.stdout:1/209: creat d9/f45 x:0 0 0 2024-09-13T18:30:18.620 INFO:tasks.workunit.client.1.smithi149.stdout:1/210: mknod d9/d15/c46 0 2024-09-13T18:30:18.627 INFO:tasks.workunit.client.1.smithi149.stdout:6/183: dwrite f5 [0,4194304] 0 2024-09-13T18:30:18.627 INFO:tasks.workunit.client.1.smithi149.stdout:8/161: dwrite d2/f9 [0,4194304] 0 2024-09-13T18:30:18.627 INFO:tasks.workunit.client.1.smithi149.stdout:2/188: dwrite f1 [0,4194304] 0 2024-09-13T18:30:18.631 INFO:tasks.workunit.client.1.smithi149.stdout:9/150: fsync d0/f22 0 2024-09-13T18:30:18.635 INFO:tasks.workunit.client.1.smithi149.stdout:3/211: rename d1/d2e/d25 to d1/d47 0 2024-09-13T18:30:18.638 INFO:tasks.workunit.client.1.smithi149.stdout:2/189: dread db/fd [0,4194304] 0 2024-09-13T18:30:18.638 INFO:tasks.workunit.client.1.smithi149.stdout:2/190: stat db/d1b/d2f 0 2024-09-13T18:30:18.638 INFO:tasks.workunit.client.1.smithi149.stdout:2/191: chown c9 5327134 1 2024-09-13T18:30:18.639 INFO:tasks.workunit.client.1.smithi149.stdout:9/151: creat d0/d33/f34 x:0 0 0 2024-09-13T18:30:18.639 INFO:tasks.workunit.client.1.smithi149.stdout:9/152: readlink d0/l16 0 2024-09-13T18:30:18.639 INFO:tasks.workunit.client.1.smithi149.stdout:1/211: rename d9/d15/d25/f36 to d9/d15/f47 0 2024-09-13T18:30:18.640 INFO:tasks.workunit.client.1.smithi149.stdout:3/212: unlink d1/l2 0 2024-09-13T18:30:18.640 INFO:tasks.workunit.client.1.smithi149.stdout:8/162: dread d2/d12/d2a/f2c [0,4194304] 0 2024-09-13T18:30:18.642 INFO:tasks.workunit.client.1.smithi149.stdout:2/192: link db/d10/f15 db/d1b/d2f/d30/f37 0 2024-09-13T18:30:18.642 INFO:tasks.workunit.client.1.smithi149.stdout:2/193: stat db/d10/f15 0 2024-09-13T18:30:18.642 INFO:tasks.workunit.client.1.smithi149.stdout:9/153: mkdir d0/d18/d19/d35 0 2024-09-13T18:30:18.643 INFO:tasks.workunit.client.1.smithi149.stdout:9/154: read d0/f29 [40402,118282] 0 2024-09-13T18:30:18.643 INFO:tasks.workunit.client.1.smithi149.stdout:2/194: mknod db/d1b/d1c/d20/d2b/c38 0 2024-09-13T18:30:18.643 INFO:tasks.workunit.client.1.smithi149.stdout:2/195: write db/d10/f2c [476617,48707] 0 2024-09-13T18:30:18.643 INFO:tasks.workunit.client.1.smithi149.stdout:2/196: read f4 [252536,6048] 0 2024-09-13T18:30:18.644 INFO:tasks.workunit.client.1.smithi149.stdout:9/155: truncate d0/f1a 2161056 0 2024-09-13T18:30:18.644 INFO:tasks.workunit.client.1.smithi149.stdout:9/156: read - d0/d18/d19/f32 zero size 2024-09-13T18:30:18.644 INFO:tasks.workunit.client.1.smithi149.stdout:2/197: mknod db/d1b/c39 0 2024-09-13T18:30:18.645 INFO:tasks.workunit.client.1.smithi149.stdout:2/198: fdatasync db/d10/d12/d24/f2e 0 2024-09-13T18:30:18.646 INFO:tasks.workunit.client.1.smithi149.stdout:9/157: rmdir d0/d18/d19/d35 0 2024-09-13T18:30:18.650 INFO:tasks.workunit.client.1.smithi149.stdout:1/212: dread d9/d15/d25/f30 [4194304,4194304] 0 2024-09-13T18:30:18.651 INFO:tasks.workunit.client.1.smithi149.stdout:1/213: mknod d9/d15/c48 0 2024-09-13T18:30:18.652 INFO:tasks.workunit.client.1.smithi149.stdout:3/213: write d1/d2e/f14 [1989374,46629] 0 2024-09-13T18:30:18.652 INFO:tasks.workunit.client.1.smithi149.stdout:6/184: dwrite dc/d15/f21 [0,4194304] 0 2024-09-13T18:30:18.655 INFO:tasks.workunit.client.1.smithi149.stdout:1/214: read d9/d15/f47 [270781,78659] 0 2024-09-13T18:30:18.655 INFO:tasks.workunit.client.1.smithi149.stdout:3/214: mkdir d1/d48 0 2024-09-13T18:30:18.655 INFO:tasks.workunit.client.1.smithi149.stdout:1/215: chown d9/d10/f1d 1 1 2024-09-13T18:30:18.655 INFO:tasks.workunit.client.1.smithi149.stdout:1/216: write d9/d15/d25/f32 [475459,116942] 0 2024-09-13T18:30:18.657 INFO:tasks.workunit.client.1.smithi149.stdout:3/215: mkdir d1/d2e/d1d/d49 0 2024-09-13T18:30:18.662 INFO:tasks.workunit.client.1.smithi149.stdout:7/178: sync 2024-09-13T18:30:18.662 INFO:tasks.workunit.client.1.smithi149.stdout:4/208: sync 2024-09-13T18:30:18.662 INFO:tasks.workunit.client.1.smithi149.stdout:5/185: sync 2024-09-13T18:30:18.662 INFO:tasks.workunit.client.1.smithi149.stdout:0/148: sync 2024-09-13T18:30:18.662 INFO:tasks.workunit.client.1.smithi149.stdout:8/163: dread d2/d13/f29 [0,4194304] 0 2024-09-13T18:30:18.663 INFO:tasks.workunit.client.1.smithi149.stdout:9/158: rmdir d0 39 2024-09-13T18:30:18.663 INFO:tasks.workunit.client.1.smithi149.stdout:2/199: write db/d1b/d2f/d30/f37 [3726682,128065] 0 2024-09-13T18:30:18.663 INFO:tasks.workunit.client.1.smithi149.stdout:7/179: rmdir d7/d9/d1c/d2c 39 2024-09-13T18:30:18.663 INFO:tasks.workunit.client.1.smithi149.stdout:7/180: fsync d7/f8 0 2024-09-13T18:30:18.663 INFO:tasks.workunit.client.1.smithi149.stdout:7/181: dread - d7/d9/d1c/d2c/f38 zero size 2024-09-13T18:30:18.666 INFO:tasks.workunit.client.1.smithi149.stdout:8/164: mknod d2/d12/d2a/c38 0 2024-09-13T18:30:18.666 INFO:tasks.workunit.client.1.smithi149.stdout:8/165: write d2/d13/f17 [1998401,42734] 0 2024-09-13T18:30:18.666 INFO:tasks.workunit.client.1.smithi149.stdout:1/217: dread d9/d10/f27 [0,4194304] 0 2024-09-13T18:30:18.666 INFO:tasks.workunit.client.1.smithi149.stdout:4/209: mknod df/d11/d12/d17/d3d/c43 0 2024-09-13T18:30:18.667 INFO:tasks.workunit.client.1.smithi149.stdout:7/182: unlink d7/d9/d1c/d2c/f18 0 2024-09-13T18:30:18.668 INFO:tasks.workunit.client.1.smithi149.stdout:2/200: truncate db/d13/f18 1388672 0 2024-09-13T18:30:18.668 INFO:tasks.workunit.client.1.smithi149.stdout:2/201: stat db/d10/f15 0 2024-09-13T18:30:18.670 INFO:tasks.workunit.client.1.smithi149.stdout:1/218: mknod d9/d15/d25/c49 0 2024-09-13T18:30:18.670 INFO:tasks.workunit.client.1.smithi149.stdout:4/210: mknod df/c44 0 2024-09-13T18:30:18.671 INFO:tasks.workunit.client.1.smithi149.stdout:9/159: rename d0/d18/d27/l2b to d0/d18/d19/l36 0 2024-09-13T18:30:18.673 INFO:tasks.workunit.client.1.smithi149.stdout:7/183: creat d7/d9/d1b/d23/f3e x:0 0 0 2024-09-13T18:30:18.674 INFO:tasks.workunit.client.1.smithi149.stdout:4/211: truncate df/f29 317071 0 2024-09-13T18:30:18.676 INFO:tasks.workunit.client.1.smithi149.stdout:8/166: write d2/d12/d2a/f2c [1595223,44854] 0 2024-09-13T18:30:18.676 INFO:tasks.workunit.client.1.smithi149.stdout:8/167: creat d2/d12/f39 x:0 0 0 2024-09-13T18:30:18.677 INFO:tasks.workunit.client.1.smithi149.stdout:6/185: dwrite dc/f2c [0,4194304] 0 2024-09-13T18:30:18.678 INFO:tasks.workunit.client.1.smithi149.stdout:6/186: stat dc/l11 0 2024-09-13T18:30:18.679 INFO:tasks.workunit.client.1.smithi149.stdout:7/184: creat d7/d9/d1c/d2f/d31/f3f x:0 0 0 2024-09-13T18:30:18.679 INFO:tasks.workunit.client.1.smithi149.stdout:7/185: read - d7/d9/d1c/d1f/f25 zero size 2024-09-13T18:30:18.679 INFO:tasks.workunit.client.1.smithi149.stdout:7/186: dread - d7/d9/d1b/f36 zero size 2024-09-13T18:30:18.679 INFO:tasks.workunit.client.1.smithi149.stdout:7/187: stat d7/d9/d1c/d1f/f25 0 2024-09-13T18:30:18.679 INFO:tasks.workunit.client.1.smithi149.stdout:7/188: fdatasync d7/f22 0 2024-09-13T18:30:18.680 INFO:tasks.workunit.client.1.smithi149.stdout:4/212: symlink df/l45 0 2024-09-13T18:30:18.682 INFO:tasks.workunit.client.1.smithi149.stdout:8/168: mkdir d2/d13/d3a 0 2024-09-13T18:30:18.682 INFO:tasks.workunit.client.1.smithi149.stdout:8/169: read d2/d12/f16 [689670,18271] 0 2024-09-13T18:30:18.683 INFO:tasks.workunit.client.1.smithi149.stdout:6/187: mknod dc/c38 0 2024-09-13T18:30:18.683 INFO:tasks.workunit.client.1.smithi149.stdout:6/188: write dc/f22 [990582,80266] 0 2024-09-13T18:30:18.684 INFO:tasks.workunit.client.1.smithi149.stdout:4/213: unlink df/d11/d12/l14 0 2024-09-13T18:30:18.684 INFO:tasks.workunit.client.1.smithi149.stdout:1/219: write d9/d10/d2a/f31 [4187535,17280] 0 2024-09-13T18:30:18.685 INFO:tasks.workunit.client.1.smithi149.stdout:2/202: rename db/d10/d12/d24 to db/d1b/d1c/d20/d3a 0 2024-09-13T18:30:18.685 INFO:tasks.workunit.client.1.smithi149.stdout:2/203: read db/d10/f14 [2174013,40468] 0 2024-09-13T18:30:18.690 INFO:tasks.workunit.client.1.smithi149.stdout:4/214: symlink df/d11/d12/l46 0 2024-09-13T18:30:18.690 INFO:tasks.workunit.client.1.smithi149.stdout:4/215: readlink l6 0 2024-09-13T18:30:18.690 INFO:tasks.workunit.client.1.smithi149.stdout:5/186: dwrite d3/d8/d28/f31 [0,4194304] 0 2024-09-13T18:30:18.693 INFO:tasks.workunit.client.1.smithi149.stdout:8/170: getdents d2/d12/d2a 0 2024-09-13T18:30:18.693 INFO:tasks.workunit.client.1.smithi149.stdout:1/220: dread d9/f1c [0,4194304] 0 2024-09-13T18:30:18.693 INFO:tasks.workunit.client.1.smithi149.stdout:3/216: dwrite d1/d4/f2f [0,4194304] 0 2024-09-13T18:30:18.694 INFO:tasks.workunit.client.1.smithi149.stdout:2/204: mkdir db/d1b/d3b 0 2024-09-13T18:30:18.699 INFO:tasks.workunit.client.1.smithi149.stdout:5/187: mkdir d3/d10/d33 0 2024-09-13T18:30:18.699 INFO:tasks.workunit.client.1.smithi149.stdout:5/188: write d3/d8/d28/f2a [1353982,54876] 0 2024-09-13T18:30:18.699 INFO:tasks.workunit.client.1.smithi149.stdout:5/189: truncate d3/d8/f27 4848068 0 2024-09-13T18:30:18.699 INFO:tasks.workunit.client.1.smithi149.stdout:5/190: write d3/d10/d32/f2e [642554,122248] 0 2024-09-13T18:30:18.704 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.701+0000 7fc66d2cc640 1 -- 172.21.15.38:0/1005341257 --> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc648000bf0 con 0x7fc65406cd80 2024-09-13T18:30:18.707 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.705+0000 7fc664ff9640 1 -- 172.21.15.38:0/1005341257 <== mgr.24387 v2:172.21.15.149:6828/2070517292 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fc648000bf0 con 0x7fc65406cd80 2024-09-13T18:30:18.708 INFO:tasks.workunit.client.1.smithi149.stdout:8/171: rmdir d2/d12/d2a 39 2024-09-13T18:30:18.709 INFO:tasks.workunit.client.1.smithi149.stdout:7/189: rename d7/d9/d1b/d23 to d7/d9/d40 0 2024-09-13T18:30:18.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.708+0000 7fc66d2cc640 1 -- 172.21.15.38:0/1005341257 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fc65406cd80 msgr2=0x7fc65406f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.708+0000 7fc66d2cc640 1 --2- 172.21.15.38:0/1005341257 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fc65406cd80 0x7fc65406f240 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc668196a70 tx=0x7fc65000a250 comp rx=0 tx=0).stop 2024-09-13T18:30:18.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.708+0000 7fc66d2cc640 1 -- 172.21.15.38:0/1005341257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6680ffb90 msgr2=0x7fc668195550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.711 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.708+0000 7fc66d2cc640 1 --2- 172.21.15.38:0/1005341257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6680ffb90 0x7fc668195550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc6580055f0 tx=0x7fc658005620 comp rx=0 tx=0).stop 2024-09-13T18:30:18.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.709+0000 7fc66d2cc640 1 -- 172.21.15.38:0/1005341257 shutdown_connections 2024-09-13T18:30:18.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.709+0000 7fc66d2cc640 1 --2- 172.21.15.38:0/1005341257 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fc65406cd80 0x7fc65406f240 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc668196a70 tx=0x7fc65000a250 comp rx=0 tx=0).stop 2024-09-13T18:30:18.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.709+0000 7fc66d2cc640 1 --2- 172.21.15.38:0/1005341257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc668100d90 0x7fc668195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.709+0000 7fc66d2cc640 1 --2- 172.21.15.38:0/1005341257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6680ffb90 0x7fc668195550 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.712 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.709+0000 7fc66d2cc640 1 -- 172.21.15.38:0/1005341257 >> 172.21.15.38:0/1005341257 conn(0x7fc6680fb320 msgr2=0x7fc668103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:18.713 INFO:tasks.workunit.client.1.smithi149.stdout:3/217: rename d1/c18 to d1/d48/c4a 0 2024-09-13T18:30:18.713 INFO:tasks.workunit.client.1.smithi149.stdout:3/218: dread - d1/d12/d20/f45 zero size 2024-09-13T18:30:18.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.710+0000 7fc66d2cc640 1 -- 172.21.15.38:0/1005341257 shutdown_connections 2024-09-13T18:30:18.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.710+0000 7fc66d2cc640 1 -- 172.21.15.38:0/1005341257 wait complete. 2024-09-13T18:30:18.714 INFO:tasks.workunit.client.1.smithi149.stdout:7/190: symlink d7/d9/d1c/d1f/d3d/l41 0 2024-09-13T18:30:18.717 INFO:tasks.workunit.client.1.smithi149.stdout:5/191: dread d3/d8/d13/f22 [0,4194304] 0 2024-09-13T18:30:18.717 INFO:tasks.workunit.client.1.smithi149.stdout:5/192: dread - d3/f20 zero size 2024-09-13T18:30:18.717 INFO:tasks.workunit.client.1.smithi149.stdout:5/193: creat d3/f34 x:0 0 0 2024-09-13T18:30:18.718 INFO:tasks.workunit.client.1.smithi149.stdout:8/172: dread d2/d13/f29 [0,4194304] 0 2024-09-13T18:30:18.719 INFO:tasks.workunit.client.1.smithi149.stdout:7/191: rename d7/d9/d40/f3e to d7/d9/d11/f42 0 2024-09-13T18:30:18.719 INFO:tasks.workunit.client.1.smithi149.stdout:4/216: dwrite df/d11/d1c/f42 [0,4194304] 0 2024-09-13T18:30:18.723 INFO:tasks.workunit.client.1.smithi149.stdout:8/173: truncate d2/f9 1133150 0 2024-09-13T18:30:18.723 INFO:tasks.workunit.client.1.smithi149.stdout:8/174: getdents d2/d13/d3a 0 2024-09-13T18:30:18.725 INFO:tasks.workunit.client.1.smithi149.stdout:7/192: creat d7/d9/d40/f43 x:0 0 0 2024-09-13T18:30:18.725 INFO:tasks.workunit.client.1.smithi149.stdout:7/193: write d7/d9/d11/f42 [853187,49102] 0 2024-09-13T18:30:18.725 INFO:tasks.workunit.client.1.smithi149.stdout:7/194: chown d7/d9/d1c/d2f/d31/f3f 1 1 2024-09-13T18:30:18.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/219: write d1/d2e/f17 [2241088,103110] 0 2024-09-13T18:30:18.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/220: fdatasync d1/d2e/d1d/f23 0 2024-09-13T18:30:18.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/221: fdatasync d1/f24 0 2024-09-13T18:30:18.726 INFO:tasks.workunit.client.1.smithi149.stdout:3/222: chown d1/d47/d30/d43 52934750 1 2024-09-13T18:30:18.727 INFO:tasks.workunit.client.1.smithi149.stdout:8/175: dread d2/f15 [0,4194304] 0 2024-09-13T18:30:18.727 INFO:tasks.workunit.client.1.smithi149.stdout:8/176: write d2/d13/f17 [2679443,74794] 0 2024-09-13T18:30:18.729 INFO:tasks.workunit.client.1.smithi149.stdout:7/195: truncate f3 62287 0 2024-09-13T18:30:18.729 INFO:tasks.workunit.client.1.smithi149.stdout:7/196: readlink l2 0 2024-09-13T18:30:18.731 INFO:tasks.workunit.client.1.smithi149.stdout:3/223: creat d1/d48/f4b x:0 0 0 2024-09-13T18:30:18.731 INFO:tasks.workunit.client.1.smithi149.stdout:1/221: dwrite d9/d15/d25/f30 [0,4194304] 0 2024-09-13T18:30:18.731 INFO:tasks.workunit.client.1.smithi149.stdout:1/222: chown d9/f3d 223 1 2024-09-13T18:30:18.732 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:30:18.733 INFO:tasks.workunit.client.1.smithi149.stdout:2/205: dwrite db/d10/f1a [0,4194304] 0 2024-09-13T18:30:18.733 INFO:tasks.workunit.client.1.smithi149.stdout:2/206: write db/d1b/f33 [1626260,63271] 0 2024-09-13T18:30:18.733 INFO:tasks.workunit.client.1.smithi149.stdout:8/177: rename d2/c21 to d2/d13/d3a/c3b 0 2024-09-13T18:30:18.734 INFO:tasks.workunit.client.1.smithi149.stdout:8/178: creat d2/d12/d1b/f3c x:0 0 0 2024-09-13T18:30:18.734 INFO:tasks.workunit.client.1.smithi149.stdout:5/194: truncate d3/d8/d28/f2a 350835 0 2024-09-13T18:30:18.734 INFO:tasks.workunit.client.1.smithi149.stdout:5/195: creat d3/f35 x:0 0 0 2024-09-13T18:30:18.734 INFO:tasks.workunit.client.1.smithi149.stdout:5/196: rename d3 to d3/d8/d36 22 2024-09-13T18:30:18.737 INFO:tasks.workunit.client.1.smithi149.stdout:4/217: dwrite df/d11/d1c/f42 [0,4194304] 0 2024-09-13T18:30:18.739 INFO:tasks.workunit.client.1.smithi149.stdout:3/224: write d1/d2e/f37 [552459,122108] 0 2024-09-13T18:30:18.739 INFO:tasks.workunit.client.1.smithi149.stdout:2/207: creat db/d1b/d1c/f3c x:0 0 0 2024-09-13T18:30:18.741 INFO:tasks.workunit.client.1.smithi149.stdout:8/179: truncate d2/d12/d2a/f2c 1301177 0 2024-09-13T18:30:18.741 INFO:tasks.workunit.client.1.smithi149.stdout:8/180: readlink d2/l11 0 2024-09-13T18:30:18.742 INFO:tasks.workunit.client.1.smithi149.stdout:7/197: getdents d7/d9/d1c/d1f 0 2024-09-13T18:30:18.743 INFO:tasks.workunit.client.1.smithi149.stdout:1/223: getdents d9/d10 0 2024-09-13T18:30:18.744 INFO:tasks.workunit.client.1.smithi149.stdout:1/224: stat d9/d10/d2a 0 2024-09-13T18:30:18.744 INFO:tasks.workunit.client.1.smithi149.stdout:1/225: getdents d9/d10/d3f 0 2024-09-13T18:30:18.744 INFO:tasks.workunit.client.1.smithi149.stdout:8/181: dread d2/d12/f16 [0,4194304] 0 2024-09-13T18:30:18.745 INFO:tasks.workunit.client.1.smithi149.stdout:4/218: symlink df/l47 0 2024-09-13T18:30:18.745 INFO:tasks.workunit.client.1.smithi149.stdout:4/219: chown df/d11/d1c/f23 0 1 2024-09-13T18:30:18.747 INFO:tasks.workunit.client.1.smithi149.stdout:3/225: unlink d1/d12/f31 0 2024-09-13T18:30:18.747 INFO:tasks.workunit.client.1.smithi149.stdout:3/226: chown d1/d2c/d38 210773313 1 2024-09-13T18:30:18.747 INFO:tasks.workunit.client.1.smithi149.stdout:3/227: creat d1/d12/f4c x:0 0 0 2024-09-13T18:30:18.750 INFO:tasks.workunit.client.1.smithi149.stdout:2/208: rmdir db/d1b/d3b 0 2024-09-13T18:30:18.750 INFO:tasks.workunit.client.1.smithi149.stdout:2/209: fsync f1 0 2024-09-13T18:30:18.751 INFO:tasks.workunit.client.1.smithi149.stdout:2/210: creat db/d10/d12/f3d x:0 0 0 2024-09-13T18:30:18.751 INFO:tasks.workunit.client.1.smithi149.stdout:2/211: dread - db/d1b/d1c/f1f zero size 2024-09-13T18:30:18.753 INFO:tasks.workunit.client.1.smithi149.stdout:7/198: rename d7/c19 to d7/d9/d40/c44 0 2024-09-13T18:30:18.753 INFO:tasks.workunit.client.1.smithi149.stdout:7/199: chown d7/d9/d1c/d2f/d31/f3f 388 1 2024-09-13T18:30:18.753 INFO:tasks.workunit.client.1.smithi149.stdout:5/197: write d3/d8/d28/f2a [537673,108719] 0 2024-09-13T18:30:18.756 INFO:tasks.workunit.client.1.smithi149.stdout:3/228: symlink d1/d2e/d1d/l4d 0 2024-09-13T18:30:18.758 INFO:tasks.workunit.client.1.smithi149.stdout:2/212: mkdir db/d1b/d1c/d20/d2b/d3e 0 2024-09-13T18:30:18.761 INFO:tasks.workunit.client.1.smithi149.stdout:7/200: creat d7/d9/d40/f45 x:0 0 0 2024-09-13T18:30:18.761 INFO:tasks.workunit.client.1.smithi149.stdout:1/226: dwrite d9/d10/f1a [0,4194304] 0 2024-09-13T18:30:18.762 INFO:tasks.workunit.client.1.smithi149.stdout:5/198: mknod d3/d10/d32/c37 0 2024-09-13T18:30:18.763 INFO:tasks.workunit.client.1.smithi149.stdout:8/182: rmdir d2/d12 39 2024-09-13T18:30:18.763 INFO:tasks.workunit.client.1.smithi149.stdout:3/229: symlink d1/d4/l4e 0 2024-09-13T18:30:18.766 INFO:tasks.workunit.client.1.smithi149.stdout:2/213: rename db/d10/f15 to db/d1b/d1c/d20/d3a/f3f 0 2024-09-13T18:30:18.766 INFO:tasks.workunit.client.1.smithi149.stdout:2/214: write db/d10/f1a [4421414,83019] 0 2024-09-13T18:30:18.768 INFO:tasks.workunit.client.1.smithi149.stdout:7/201: link d7/ff d7/d9/f46 0 2024-09-13T18:30:18.768 INFO:tasks.workunit.client.1.smithi149.stdout:7/202: readlink d7/d9/d1c/l3a 0 2024-09-13T18:30:18.768 INFO:tasks.workunit.client.1.smithi149.stdout:7/203: write d7/d9/d1b/f36 [515120,83627] 0 2024-09-13T18:30:18.770 INFO:tasks.workunit.client.1.smithi149.stdout:5/199: dread d3/d8/d13/f22 [0,4194304] 0 2024-09-13T18:30:18.770 INFO:tasks.workunit.client.1.smithi149.stdout:3/230: read d1/f24 [1712093,116016] 0 2024-09-13T18:30:18.771 INFO:tasks.workunit.client.1.smithi149.stdout:2/215: write db/d1b/f33 [1247684,82769] 0 2024-09-13T18:30:18.775 INFO:tasks.workunit.client.1.smithi149.stdout:8/183: rmdir d2/d12/d1b 39 2024-09-13T18:30:18.777 INFO:tasks.workunit.client.1.smithi149.stdout:7/204: mkdir d7/d9/d1c/d1f/d47 0 2024-09-13T18:30:18.778 INFO:tasks.workunit.client.1.smithi149.stdout:5/200: creat d3/d10/d32/f38 x:0 0 0 2024-09-13T18:30:18.778 INFO:tasks.workunit.client.1.smithi149.stdout:5/201: creat d3/d8/f39 x:0 0 0 2024-09-13T18:30:18.779 INFO:tasks.workunit.client.1.smithi149.stdout:3/231: symlink d1/d48/l4f 0 2024-09-13T18:30:18.780 INFO:tasks.workunit.client.1.smithi149.stdout:2/216: mknod db/d10/c40 0 2024-09-13T18:30:18.780 INFO:tasks.workunit.client.1.smithi149.stdout:2/217: fdatasync db/d13/f18 0 2024-09-13T18:30:18.781 INFO:tasks.workunit.client.1.smithi149.stdout:8/184: creat d2/d12/f3d x:0 0 0 2024-09-13T18:30:18.782 INFO:tasks.workunit.client.1.smithi149.stdout:7/205: symlink d7/d9/d1c/d34/l48 0 2024-09-13T18:30:18.782 INFO:tasks.workunit.client.1.smithi149.stdout:7/206: dread - d7/d9/d40/f43 zero size 2024-09-13T18:30:18.784 INFO:tasks.workunit.client.1.smithi149.stdout:3/232: mknod d1/d2c/c50 0 2024-09-13T18:30:18.784 INFO:tasks.workunit.client.1.smithi149.stdout:3/233: fsync d1/d47/f26 0 2024-09-13T18:30:18.784 INFO:tasks.workunit.client.1.smithi149.stdout:3/234: stat d1/f11 0 2024-09-13T18:30:18.784 INFO:tasks.workunit.client.1.smithi149.stdout:3/235: write d1/d2e/f14 [1616725,11505] 0 2024-09-13T18:30:18.785 INFO:tasks.workunit.client.1.smithi149.stdout:1/227: dwrite d9/d10/f1d [4194304,4194304] 0 2024-09-13T18:30:18.787 INFO:tasks.workunit.client.1.smithi149.stdout:8/185: link d2/c5 d2/d12/c3e 0 2024-09-13T18:30:18.787 INFO:tasks.workunit.client.1.smithi149.stdout:8/186: readlink d2/d12/d2a/l31 0 2024-09-13T18:30:18.787 INFO:tasks.workunit.client.1.smithi149.stdout:8/187: creat d2/d12/f3f x:0 0 0 2024-09-13T18:30:18.788 INFO:tasks.workunit.client.1.smithi149.stdout:3/236: dread d1/d2e/d1d/f2b [0,4194304] 0 2024-09-13T18:30:18.788 INFO:tasks.workunit.client.1.smithi149.stdout:7/207: rename d7/d9/d1c/d2c/d37 to d7/d9/d1c/d1f/d21/d49 0 2024-09-13T18:30:18.788 INFO:tasks.workunit.client.1.smithi149.stdout:3/237: write d1/d2e/d1d/f2b [2100915,68911] 0 2024-09-13T18:30:18.792 INFO:tasks.workunit.client.1.smithi149.stdout:7/208: truncate d7/d9/f1d 746360 0 2024-09-13T18:30:18.792 INFO:tasks.workunit.client.1.smithi149.stdout:7/209: fdatasync d7/d9/d1c/d1f/f25 0 2024-09-13T18:30:18.794 INFO:tasks.workunit.client.1.smithi149.stdout:7/210: link l2 d7/d9/d1c/l4a 0 2024-09-13T18:30:18.801 INFO:tasks.workunit.client.1.smithi149.stdout:1/228: dread d9/d15/d25/f30 [0,4194304] 0 2024-09-13T18:30:18.801 INFO:tasks.workunit.client.1.smithi149.stdout:5/202: dwrite d3/d10/f23 [0,4194304] 0 2024-09-13T18:30:18.806 INFO:tasks.workunit.client.1.smithi149.stdout:1/229: mkdir d9/d15/d40/d4a 0 2024-09-13T18:30:18.806 INFO:tasks.workunit.client.1.smithi149.stdout:1/230: read d9/d15/f20 [3830521,71598] 0 2024-09-13T18:30:18.806 INFO:tasks.workunit.client.1.smithi149.stdout:1/231: write d9/d10/f27 [2715361,128064] 0 2024-09-13T18:30:18.806 INFO:tasks.workunit.client.1.smithi149.stdout:1/232: truncate d9/f45 358087 0 2024-09-13T18:30:18.808 INFO:tasks.workunit.client.1.smithi149.stdout:1/233: read d9/d15/d25/f32 [69615,118568] 0 2024-09-13T18:30:18.811 INFO:tasks.workunit.client.1.smithi149.stdout:2/218: dwrite db/d1b/d1c/f3c [0,4194304] 0 2024-09-13T18:30:18.818 INFO:tasks.workunit.client.1.smithi149.stdout:2/219: rename db/d1b/c39 to db/d1b/c41 0 2024-09-13T18:30:18.823 INFO:tasks.workunit.client.1.smithi149.stdout:1/234: dread d9/d10/f1d [4194304,4194304] 0 2024-09-13T18:30:18.828 INFO:tasks.workunit.client.1.smithi149.stdout:5/203: dwrite d3/f4 [0,4194304] 0 2024-09-13T18:30:18.828 INFO:tasks.workunit.client.1.smithi149.stdout:0/149: sync 2024-09-13T18:30:18.828 INFO:tasks.workunit.client.1.smithi149.stdout:0/150: chown d1/d2/l15 704073 1 2024-09-13T18:30:18.829 INFO:tasks.workunit.client.1.smithi149.stdout:0/151: chown d1/f21 13827 1 2024-09-13T18:30:18.829 INFO:tasks.workunit.client.1.smithi149.stdout:0/152: creat d1/f2b x:0 0 0 2024-09-13T18:30:18.830 INFO:tasks.workunit.client.1.smithi149.stdout:0/153: rename d1/d2/f16 to d1/f2c 0 2024-09-13T18:30:18.831 INFO:tasks.workunit.client.1.smithi149.stdout:7/211: dwrite d7/d9/f1d [0,4194304] 0 2024-09-13T18:30:18.832 INFO:tasks.workunit.client.1.smithi149.stdout:1/235: dread d9/d10/d2a/f31 [0,4194304] 0 2024-09-13T18:30:18.832 INFO:tasks.workunit.client.1.smithi149.stdout:7/212: write d7/d9/d1c/d2c/f24 [214730,63998] 0 2024-09-13T18:30:18.832 INFO:tasks.workunit.client.1.smithi149.stdout:7/213: write d7/d9/d1c/f29 [1580448,113809] 0 2024-09-13T18:30:18.832 INFO:tasks.workunit.client.1.smithi149.stdout:7/214: chown d7/d9/f1d 17342134 1 2024-09-13T18:30:18.833 INFO:tasks.workunit.client.1.smithi149.stdout:1/236: dread d9/f45 [0,4194304] 0 2024-09-13T18:30:18.833 INFO:tasks.workunit.client.1.smithi149.stdout:1/237: chown d9/d10/l12 61 1 2024-09-13T18:30:18.833 INFO:tasks.workunit.client.1.smithi149.stdout:1/238: chown d9/d10/d34/l3a 291014 1 2024-09-13T18:30:18.833 INFO:tasks.workunit.client.1.smithi149.stdout:7/215: creat d7/d9/d1c/d1f/d21/f4b x:0 0 0 2024-09-13T18:30:18.833 INFO:tasks.workunit.client.1.smithi149.stdout:7/216: fsync d7/fd 0 2024-09-13T18:30:18.834 INFO:tasks.workunit.client.1.smithi149.stdout:1/239: symlink d9/d10/d43/l4b 0 2024-09-13T18:30:18.834 INFO:tasks.workunit.client.1.smithi149.stdout:7/217: link d7/f8 d7/f4c 0 2024-09-13T18:30:18.835 INFO:tasks.workunit.client.1.smithi149.stdout:7/218: unlink d7/d9/c26 0 2024-09-13T18:30:18.836 INFO:tasks.workunit.client.1.smithi149.stdout:7/219: link d7/d12/c1e d7/d9/d11/c4d 0 2024-09-13T18:30:18.837 INFO:tasks.workunit.client.1.smithi149.stdout:7/220: mkdir d7/d9/d1c/d34/d4e 0 2024-09-13T18:30:18.837 INFO:tasks.workunit.client.1.smithi149.stdout:7/221: creat d7/d9/d1c/d2f/d31/f4f x:0 0 0 2024-09-13T18:30:18.838 INFO:tasks.workunit.client.1.smithi149.stdout:7/222: mkdir d7/d9/d11/d50 0 2024-09-13T18:30:18.841 INFO:tasks.workunit.client.1.smithi149.stdout:7/223: dread d7/d9/d11/f1a [0,4194304] 0 2024-09-13T18:30:18.841 INFO:tasks.workunit.client.1.smithi149.stdout:7/224: chown d7/lb 1845 1 2024-09-13T18:30:18.842 INFO:tasks.workunit.client.1.smithi149.stdout:7/225: mkdir d7/d9/d1c/d51 0 2024-09-13T18:30:18.842 INFO:tasks.workunit.client.1.smithi149.stdout:5/204: write d3/f4 [292816,59080] 0 2024-09-13T18:30:18.842 INFO:tasks.workunit.client.1.smithi149.stdout:5/205: creat d3/d10/d32/f3a x:0 0 0 2024-09-13T18:30:18.842 INFO:tasks.workunit.client.1.smithi149.stdout:5/206: creat d3/d8/d28/f3b x:0 0 0 2024-09-13T18:30:18.842 INFO:tasks.workunit.client.1.smithi149.stdout:5/207: write d3/d8/f1e [247050,29810] 0 2024-09-13T18:30:18.843 INFO:tasks.workunit.client.1.smithi149.stdout:7/226: mkdir d7/d9/d1c/d51/d52 0 2024-09-13T18:30:18.845 INFO:tasks.workunit.client.1.smithi149.stdout:7/227: mkdir d7/d9/d1c/d1f/d47/d53 0 2024-09-13T18:30:18.845 INFO:tasks.workunit.client.1.smithi149.stdout:7/228: getdents d7/d9/d1c/d34/d4e 0 2024-09-13T18:30:18.845 INFO:tasks.workunit.client.1.smithi149.stdout:7/229: chown d7/d9/d1c/d51 20955 1 2024-09-13T18:30:18.845 INFO:tasks.workunit.client.1.smithi149.stdout:0/154: dread d1/f5 [0,4194304] 0 2024-09-13T18:30:18.846 INFO:tasks.workunit.client.1.smithi149.stdout:7/230: mknod d7/d9/d1c/d1f/d21/d49/c54 0 2024-09-13T18:30:18.846 INFO:tasks.workunit.client.1.smithi149.stdout:7/231: readlink d7/d9/l10 0 2024-09-13T18:30:18.847 INFO:tasks.workunit.client.1.smithi149.stdout:0/155: rename d1/d2/l20 to d1/l2d 0 2024-09-13T18:30:18.847 INFO:tasks.workunit.client.1.smithi149.stdout:0/156: stat d1/l11 0 2024-09-13T18:30:18.848 INFO:tasks.workunit.client.1.smithi149.stdout:7/232: creat d7/d9/d1c/d34/f55 x:0 0 0 2024-09-13T18:30:18.848 INFO:tasks.workunit.client.1.smithi149.stdout:0/157: mknod d1/d29/c2e 0 2024-09-13T18:30:18.849 INFO:tasks.workunit.client.1.smithi149.stdout:0/158: chown d1/f13 1 1 2024-09-13T18:30:18.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.847+0000 7f8ff9d69640 1 -- 172.21.15.38:0/2358503399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ff40feb90 msgr2=0x7f8ff40ff010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.847+0000 7f8ff9d69640 1 --2- 172.21.15.38:0/2358503399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ff40feb90 0x7f8ff40ff010 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009880 tx=0x7f8fe802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.847+0000 7f8ff9d69640 1 -- 172.21.15.38:0/2358503399 shutdown_connections 2024-09-13T18:30:18.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.847+0000 7f8ff9d69640 1 --2- 172.21.15.38:0/2358503399 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ff40feb90 0x7f8ff40ff010 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.847+0000 7f8ff9d69640 1 --2- 172.21.15.38:0/2358503399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ff40fde20 0x7f8ff40fe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.847+0000 7f8ff9d69640 1 -- 172.21.15.38:0/2358503399 >> 172.21.15.38:0/2358503399 conn(0x7f8ff40f9950 msgr2=0x7f8ff40fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:18.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.847+0000 7f8ff9d69640 1 -- 172.21.15.38:0/2358503399 shutdown_connections 2024-09-13T18:30:18.850 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.847+0000 7f8ff9d69640 1 -- 172.21.15.38:0/2358503399 wait complete. 2024-09-13T18:30:18.850 INFO:tasks.workunit.client.1.smithi149.stdout:0/159: mknod d1/d1b/c2f 0 2024-09-13T18:30:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.847+0000 7f8ff9d69640 1 Processor -- start 2024-09-13T18:30:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.848+0000 7f8ff9d69640 1 -- start start 2024-09-13T18:30:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.848+0000 7f8ff9d69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ff40fde20 0x7f8ff419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.848+0000 7f8ff9d69640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ff40feb90 0x7f8ff419c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.848+0000 7f8ff9d69640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff419c660 con 0x7f8ff40fde20 2024-09-13T18:30:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.848+0000 7f8ff9d69640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff419c7d0 con 0x7f8ff40feb90 2024-09-13T18:30:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.848+0000 7f8ff37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ff40fde20 0x7f8ff419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.848+0000 7f8ff37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ff40fde20 0x7f8ff419bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45376/0 (socket says 172.21.15.38:45376) 2024-09-13T18:30:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.848+0000 7f8ff37fe640 1 -- 172.21.15.38:0/784682324 learned_addr learned my addr 172.21.15.38:0/784682324 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.848+0000 7f8ff2ffd640 1 --2- 172.21.15.38:0/784682324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ff40feb90 0x7f8ff419c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.849+0000 7f8ff37fe640 1 -- 172.21.15.38:0/784682324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ff40feb90 msgr2=0x7f8ff419c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.849+0000 7f8ff37fe640 1 --2- 172.21.15.38:0/784682324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ff40feb90 0x7f8ff419c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.849+0000 7f8ff37fe640 1 -- 172.21.15.38:0/784682324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8009560 con 0x7f8ff40fde20 2024-09-13T18:30:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.849+0000 7f8ff37fe640 1 --2- 172.21.15.38:0/784682324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ff40fde20 0x7f8ff419bb50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400d900 tx=0x7f8fe400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.849+0000 7f8ff0ff9640 1 -- 172.21.15.38:0/784682324 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe4009c00 con 0x7f8ff40fde20 2024-09-13T18:30:18.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.849+0000 7f8ff0ff9640 1 -- 172.21.15.38:0/784682324 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8fe40044c0 con 0x7f8ff40fde20 2024-09-13T18:30:18.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.849+0000 7f8ff0ff9640 1 -- 172.21.15.38:0/784682324 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe40049d0 con 0x7f8ff40fde20 2024-09-13T18:30:18.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.849+0000 7f8ff9d69640 1 -- 172.21.15.38:0/784682324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff41a1270 con 0x7f8ff40fde20 2024-09-13T18:30:18.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.849+0000 7f8ff9d69640 1 -- 172.21.15.38:0/784682324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff41a17c0 con 0x7f8ff40fde20 2024-09-13T18:30:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.850+0000 7f8ff9d69640 1 -- 172.21.15.38:0/784682324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff410ec10 con 0x7f8ff40fde20 2024-09-13T18:30:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.851+0000 7f8ff0ff9640 1 -- 172.21.15.38:0/784682324 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f8fe40050b0 con 0x7f8ff40fde20 2024-09-13T18:30:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.852+0000 7f8ff0ff9640 1 --2- 172.21.15.38:0/784682324 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f8fdc06cd90 0x7f8fdc06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.852+0000 7f8ff0ff9640 1 -- 172.21.15.38:0/784682324 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f8fe408c2f0 con 0x7f8ff40fde20 2024-09-13T18:30:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.852+0000 7f8ff2ffd640 1 --2- 172.21.15.38:0/784682324 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f8fdc06cd90 0x7f8fdc06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:18.855 INFO:tasks.workunit.client.1.smithi149.stdout:1/240: dwrite d9/d15/d25/f32 [0,4194304] 0 2024-09-13T18:30:18.855 INFO:tasks.workunit.client.1.smithi149.stdout:1/241: creat d9/d15/d25/f4c x:0 0 0 2024-09-13T18:30:18.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.855+0000 7f8ff2ffd640 1 --2- 172.21.15.38:0/784682324 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f8fdc06cd90 0x7f8fdc06f250 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8031460 tx=0x7f8fe8000bc0 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:18.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:18.857+0000 7f8ff0ff9640 1 -- 172.21.15.38:0/784682324 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8fe40563c0 con 0x7f8ff40fde20 2024-09-13T18:30:18.860 INFO:tasks.workunit.client.1.smithi149.stdout:5/208: dread d3/d10/f23 [0,4194304] 0 2024-09-13T18:30:18.861 INFO:tasks.workunit.client.1.smithi149.stdout:5/209: creat d3/d10/d32/f3c x:0 0 0 2024-09-13T18:30:18.861 INFO:tasks.workunit.client.1.smithi149.stdout:0/160: write d1/f21 [4074851,65537] 0 2024-09-13T18:30:18.863 INFO:tasks.workunit.client.1.smithi149.stdout:1/242: dread d9/d15/f47 [0,4194304] 0 2024-09-13T18:30:18.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/210: rename d3/d8/d28/f3b to d3/f3d 0 2024-09-13T18:30:18.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/211: fsync d3/fd 0 2024-09-13T18:30:18.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/212: write d3/f20 [555421,30412] 0 2024-09-13T18:30:18.863 INFO:tasks.workunit.client.1.smithi149.stdout:1/243: unlink d9/c2b 0 2024-09-13T18:30:18.864 INFO:tasks.workunit.client.1.smithi149.stdout:7/233: dwrite d7/d9/d1b/f36 [0,4194304] 0 2024-09-13T18:30:18.865 INFO:tasks.workunit.client.1.smithi149.stdout:5/213: rename d3/d8/l25 to d3/d8/l3e 0 2024-09-13T18:30:18.865 INFO:tasks.workunit.client.1.smithi149.stdout:5/214: truncate d3/f3d 110200 0 2024-09-13T18:30:18.865 INFO:tasks.workunit.client.1.smithi149.stdout:5/215: creat d3/d8/f3f x:0 0 0 2024-09-13T18:30:18.865 INFO:tasks.workunit.client.1.smithi149.stdout:1/244: mknod d9/d10/d34/c4d 0 2024-09-13T18:30:18.872 INFO:tasks.workunit.client.1.smithi149.stdout:7/234: unlink d7/d9/d40/f43 0 2024-09-13T18:30:18.873 INFO:tasks.workunit.client.1.smithi149.stdout:1/245: rename d9/d15/d25/f30 to d9/d10/d37/d38/f4e 0 2024-09-13T18:30:18.875 INFO:tasks.workunit.client.1.smithi149.stdout:7/235: creat d7/d9/d1c/d1f/d21/d49/f56 x:0 0 0 2024-09-13T18:30:18.875 INFO:tasks.workunit.client.1.smithi149.stdout:7/236: readlink d7/d12/l39 0 2024-09-13T18:30:18.875 INFO:tasks.workunit.client.1.smithi149.stdout:7/237: write d7/d12/f2d [852862,22378] 0 2024-09-13T18:30:18.876 INFO:tasks.workunit.client.1.smithi149.stdout:7/238: write d7/d9/d11/f42 [698762,41070] 0 2024-09-13T18:30:18.876 INFO:tasks.workunit.client.1.smithi149.stdout:1/246: unlink d9/d15/c1b 0 2024-09-13T18:30:18.876 INFO:tasks.workunit.client.1.smithi149.stdout:1/247: chown d9/f3d 107977316 1 2024-09-13T18:30:18.877 INFO:tasks.workunit.client.1.smithi149.stdout:5/216: write d3/d8/d13/f22 [2594330,32106] 0 2024-09-13T18:30:18.877 INFO:tasks.workunit.client.1.smithi149.stdout:5/217: creat d3/d10/d32/f40 x:0 0 0 2024-09-13T18:30:18.877 INFO:tasks.workunit.client.1.smithi149.stdout:5/218: creat d3/f41 x:0 0 0 2024-09-13T18:30:18.878 INFO:tasks.workunit.client.1.smithi149.stdout:7/239: creat d7/d9/d1b/f57 x:0 0 0 2024-09-13T18:30:18.884 INFO:tasks.workunit.client.1.smithi149.stdout:1/248: dread d9/d15/d25/f32 [0,4194304] 0 2024-09-13T18:30:18.894 INFO:tasks.workunit.client.1.smithi149.stdout:1/249: dread d9/d10/f27 [0,4194304] 0 2024-09-13T18:30:18.894 INFO:tasks.workunit.client.1.smithi149.stdout:1/250: chown d9/f1c 0 1 2024-09-13T18:30:18.894 INFO:tasks.workunit.client.1.smithi149.stdout:1/251: write d9/d15/f47 [1562675,54451] 0 2024-09-13T18:30:18.897 INFO:tasks.workunit.client.1.smithi149.stdout:1/252: unlink d9/d10/l2c 0 2024-09-13T18:30:18.901 INFO:tasks.workunit.client.1.smithi149.stdout:0/161: dwrite d1/f27 [0,4194304] 0 2024-09-13T18:30:18.906 INFO:tasks.workunit.client.1.smithi149.stdout:5/219: dwrite d3/f4 [4194304,4194304] 0 2024-09-13T18:30:18.907 INFO:tasks.workunit.client.1.smithi149.stdout:7/240: dwrite f5 [0,4194304] 0 2024-09-13T18:30:18.907 INFO:tasks.workunit.client.1.smithi149.stdout:7/241: readlink d7/d12/l39 0 2024-09-13T18:30:18.907 INFO:tasks.workunit.client.1.smithi149.stdout:7/242: chown d7/d9 4046884 1 2024-09-13T18:30:18.915 INFO:tasks.workunit.client.1.smithi149.stdout:0/162: dread d1/f14 [0,4194304] 0 2024-09-13T18:30:18.915 INFO:tasks.workunit.client.1.smithi149.stdout:0/163: chown d1/c6 111 1 2024-09-13T18:30:18.915 INFO:tasks.workunit.client.1.smithi149.stdout:0/164: chown d1/f21 254 1 2024-09-13T18:30:18.918 INFO:tasks.workunit.client.1.smithi149.stdout:1/253: dwrite f2 [0,4194304] 0 2024-09-13T18:30:18.920 INFO:tasks.workunit.client.1.smithi149.stdout:1/254: mkdir d9/d10/d34/d4f 0 2024-09-13T18:30:18.920 INFO:tasks.workunit.client.1.smithi149.stdout:1/255: truncate d9/f3d 515372 0 2024-09-13T18:30:18.922 INFO:tasks.workunit.client.1.smithi149.stdout:5/220: write d3/d8/fe [3442558,39927] 0 2024-09-13T18:30:18.923 INFO:tasks.workunit.client.1.smithi149.stdout:1/256: getdents d9/d15/d25 0 2024-09-13T18:30:18.925 INFO:tasks.workunit.client.1.smithi149.stdout:1/257: mkdir d9/d10/d34/d3c/d50 0 2024-09-13T18:30:18.927 INFO:tasks.workunit.client.1.smithi149.stdout:7/243: dwrite f3 [0,4194304] 0 2024-09-13T18:30:18.927 INFO:tasks.workunit.client.1.smithi149.stdout:7/244: readlink d7/d9/d1c/l3a 0 2024-09-13T18:30:18.927 INFO:tasks.workunit.client.1.smithi149.stdout:7/245: stat d7/f4c 0 2024-09-13T18:30:18.927 INFO:tasks.workunit.client.1.smithi149.stdout:1/258: creat d9/d10/d34/f51 x:0 0 0 2024-09-13T18:30:18.927 INFO:tasks.workunit.client.1.smithi149.stdout:1/259: readlink d9/d10/d43/l4b 0 2024-09-13T18:30:18.928 INFO:tasks.workunit.client.1.smithi149.stdout:0/165: write d1/d2/fd [2214258,29992] 0 2024-09-13T18:30:18.931 INFO:tasks.workunit.client.1.smithi149.stdout:7/246: rmdir d7/d12 39 2024-09-13T18:30:18.932 INFO:tasks.workunit.client.1.smithi149.stdout:1/260: mknod d9/d15/d40/c52 0 2024-09-13T18:30:18.932 INFO:tasks.workunit.client.1.smithi149.stdout:1/261: stat d9/d15/d40/d4a 0 2024-09-13T18:30:18.933 INFO:tasks.workunit.client.1.smithi149.stdout:0/166: mknod d1/d2/c30 0 2024-09-13T18:30:18.933 INFO:tasks.workunit.client.1.smithi149.stdout:7/247: mknod d7/d12/c58 0 2024-09-13T18:30:18.933 INFO:tasks.workunit.client.1.smithi149.stdout:7/248: dread - d7/d9/d1c/d1f/d21/d49/f56 zero size 2024-09-13T18:30:18.935 INFO:tasks.workunit.client.1.smithi149.stdout:7/249: getdents d7/d9/d1c/d1f/d21/d49 0 2024-09-13T18:30:18.937 INFO:tasks.workunit.client.1.smithi149.stdout:9/160: sync 2024-09-13T18:30:18.937 INFO:tasks.workunit.client.1.smithi149.stdout:6/189: sync 2024-09-13T18:30:18.937 INFO:tasks.workunit.client.1.smithi149.stdout:4/220: sync 2024-09-13T18:30:18.942 INFO:tasks.workunit.client.1.smithi149.stdout:9/161: mkdir d0/d18/d19/d37 0 2024-09-13T18:30:18.942 INFO:tasks.workunit.client.1.smithi149.stdout:9/162: truncate d0/d18/d19/f32 13933 0 2024-09-13T18:30:18.942 INFO:tasks.workunit.client.1.smithi149.stdout:9/163: readlink d0/l6 0 2024-09-13T18:30:18.943 INFO:tasks.workunit.client.1.smithi149.stdout:8/188: sync 2024-09-13T18:30:18.947 INFO:tasks.workunit.client.1.smithi149.stdout:8/189: mkdir d2/d12/d40 0 2024-09-13T18:30:18.948 INFO:tasks.workunit.client.1.smithi149.stdout:1/262: write d9/d10/d37/d38/f4e [8327888,8066] 0 2024-09-13T18:30:18.949 INFO:tasks.workunit.client.1.smithi149.stdout:1/263: chown d9/l3b 1084013230 1 2024-09-13T18:30:18.949 INFO:tasks.workunit.client.1.smithi149.stdout:1/264: read d9/d10/d37/d38/f4e [5226689,120131] 0 2024-09-13T18:30:18.950 INFO:tasks.workunit.client.1.smithi149.stdout:1/265: mkdir d9/d10/d34/d53 0 2024-09-13T18:30:18.951 INFO:tasks.workunit.client.1.smithi149.stdout:0/167: dread d1/d2/fb [0,4194304] 0 2024-09-13T18:30:18.951 INFO:tasks.workunit.client.1.smithi149.stdout:9/164: dread d0/f29 [0,4194304] 0 2024-09-13T18:30:18.951 INFO:tasks.workunit.client.1.smithi149.stdout:9/165: getdents d0/d18/d19/d37 0 2024-09-13T18:30:18.952 INFO:tasks.workunit.client.1.smithi149.stdout:7/250: dread d7/f8 [0,4194304] 0 2024-09-13T18:30:18.952 INFO:tasks.workunit.client.1.smithi149.stdout:0/168: mkdir d1/d29/d31 0 2024-09-13T18:30:18.953 INFO:tasks.workunit.client.1.smithi149.stdout:7/251: readlink d7/d9/d1c/l4a 0 2024-09-13T18:30:18.953 INFO:tasks.workunit.client.1.smithi149.stdout:7/252: readlink d7/d12/l39 0 2024-09-13T18:30:18.953 INFO:tasks.workunit.client.1.smithi149.stdout:0/169: readlink d1/d2/l17 0 2024-09-13T18:30:18.953 INFO:tasks.workunit.client.1.smithi149.stdout:7/253: truncate d7/d9/d1b/f57 434469 0 2024-09-13T18:30:18.953 INFO:tasks.workunit.client.1.smithi149.stdout:9/166: rmdir d0/d33 39 2024-09-13T18:30:18.954 INFO:tasks.workunit.client.1.smithi149.stdout:8/190: dread d2/f9 [0,4194304] 0 2024-09-13T18:30:18.954 INFO:tasks.workunit.client.1.smithi149.stdout:0/170: rename d1/d2/c1f to d1/d29/d31/c32 0 2024-09-13T18:30:18.955 INFO:tasks.workunit.client.1.smithi149.stdout:7/254: link d7/d9/d1c/d1f/d21/f4b d7/f59 0 2024-09-13T18:30:18.956 INFO:tasks.workunit.client.1.smithi149.stdout:9/167: rename d0/f4 to d0/f38 0 2024-09-13T18:30:18.958 INFO:tasks.workunit.client.1.smithi149.stdout:9/168: dread d0/f9 [0,4194304] 0 2024-09-13T18:30:18.959 INFO:tasks.workunit.client.1.smithi149.stdout:9/169: truncate d0/fe 2668307 0 2024-09-13T18:30:18.959 INFO:tasks.workunit.client.1.smithi149.stdout:9/170: fsync d0/d18/d19/f32 0 2024-09-13T18:30:18.959 INFO:tasks.workunit.client.1.smithi149.stdout:7/255: unlink d7/d9/d1c/d2c/f24 0 2024-09-13T18:30:18.959 INFO:tasks.workunit.client.1.smithi149.stdout:7/256: chown d7/d9/d1c/d2c 40704 1 2024-09-13T18:30:18.961 INFO:tasks.workunit.client.1.smithi149.stdout:8/191: getdents d2 0 2024-09-13T18:30:18.964 INFO:tasks.workunit.client.1.smithi149.stdout:8/192: dread d2/f9 [0,4194304] 0 2024-09-13T18:30:18.964 INFO:tasks.workunit.client.1.smithi149.stdout:7/257: symlink d7/d9/d1c/d1f/l5a 0 2024-09-13T18:30:18.966 INFO:tasks.workunit.client.1.smithi149.stdout:5/221: dwrite d3/d8/d28/f2a [0,4194304] 0 2024-09-13T18:30:18.966 INFO:tasks.workunit.client.1.smithi149.stdout:5/222: dread - d3/fd zero size 2024-09-13T18:30:18.966 INFO:tasks.workunit.client.1.smithi149.stdout:9/171: rename d0/l10 to d0/d18/d27/l39 0 2024-09-13T18:30:18.971 INFO:tasks.workunit.client.1.smithi149.stdout:1/266: read d9/d10/d37/d38/f4e [3362215,128021] 0 2024-09-13T18:30:18.979 INFO:tasks.workunit.client.1.smithi149.stdout:4/221: dwrite df/d11/d12/d21/f24 [0,4194304] 0 2024-09-13T18:30:18.980 INFO:tasks.workunit.client.1.smithi149.stdout:5/223: rename d3/d8/d28 to d3/d8/d13/d42 0 2024-09-13T18:30:18.980 INFO:tasks.workunit.client.1.smithi149.stdout:0/171: dread d1/d2/f12 [0,4194304] 0 2024-09-13T18:30:18.980 INFO:tasks.workunit.client.1.smithi149.stdout:0/172: write d1/f13 [4306814,17142] 0 2024-09-13T18:30:18.980 INFO:tasks.workunit.client.1.smithi149.stdout:6/190: dwrite dc/f22 [0,4194304] 0 2024-09-13T18:30:18.984 INFO:tasks.workunit.client.1.smithi149.stdout:8/193: dread d2/fe [0,4194304] 0 2024-09-13T18:30:18.984 INFO:tasks.workunit.client.1.smithi149.stdout:8/194: dread - d2/d12/f3d zero size 2024-09-13T18:30:18.987 INFO:tasks.workunit.client.1.smithi149.stdout:5/224: symlink d3/d10/d33/l43 0 2024-09-13T18:30:18.987 INFO:tasks.workunit.client.1.smithi149.stdout:5/225: dread - d3/f34 zero size 2024-09-13T18:30:18.988 INFO:tasks.workunit.client.1.smithi149.stdout:8/195: link d2/f15 d2/d13/f41 0 2024-09-13T18:30:18.991 INFO:tasks.workunit.client.1.smithi149.stdout:5/226: mkdir d3/d10/d33/d44 0 2024-09-13T18:30:18.991 INFO:tasks.workunit.client.1.smithi149.stdout:4/222: dread f0 [0,4194304] 0 2024-09-13T18:30:18.991 INFO:tasks.workunit.client.1.smithi149.stdout:5/227: creat d3/d10/d32/f45 x:0 0 0 2024-09-13T18:30:18.992 INFO:tasks.workunit.client.1.smithi149.stdout:8/196: creat d2/f42 x:0 0 0 2024-09-13T18:30:18.993 INFO:tasks.workunit.client.1.smithi149.stdout:8/197: creat d2/d12/f43 x:0 0 0 2024-09-13T18:30:18.993 INFO:tasks.workunit.client.1.smithi149.stdout:6/191: dread dc/f2c [0,4194304] 0 2024-09-13T18:30:18.994 INFO:tasks.workunit.client.1.smithi149.stdout:6/192: truncate dc/d2f/f32 561865 0 2024-09-13T18:30:18.995 INFO:tasks.workunit.client.1.smithi149.stdout:0/173: read d1/f14 [1201263,26333] 0 2024-09-13T18:30:18.995 INFO:tasks.workunit.client.1.smithi149.stdout:4/223: rename df/d11/d12/l2c to df/d11/d12/d21/d22/d30/d41/l48 0 2024-09-13T18:30:18.998 INFO:tasks.workunit.client.1.smithi149.stdout:5/228: creat d3/d8/d13/f46 x:0 0 0 2024-09-13T18:30:18.999 INFO:tasks.workunit.client.1.smithi149.stdout:2/220: sync 2024-09-13T18:30:18.999 INFO:tasks.workunit.client.1.smithi149.stdout:3/238: sync 2024-09-13T18:30:18.999 INFO:tasks.workunit.client.1.smithi149.stdout:2/221: read - db/d1b/d1c/f1f zero size 2024-09-13T18:30:18.999 INFO:tasks.workunit.client.1.smithi149.stdout:2/222: chown db/d10/d12/d26 83021951 1 2024-09-13T18:30:18.999 INFO:tasks.workunit.client.1.smithi149.stdout:3/239: read d1/d21/f27 [2099113,14817] 0 2024-09-13T18:30:18.999 INFO:tasks.workunit.client.1.smithi149.stdout:5/229: dread d3/d8/f27 [4194304,4194304] 0 2024-09-13T18:30:18.999 INFO:tasks.workunit.client.1.smithi149.stdout:3/240: readlink d1/d4/l1e 0 2024-09-13T18:30:18.999 INFO:tasks.workunit.client.1.smithi149.stdout:2/223: creat db/d1b/f42 x:0 0 0 2024-09-13T18:30:19.002 INFO:tasks.workunit.client.1.smithi149.stdout:9/172: dwrite d0/d33/f34 [0,4194304] 0 2024-09-13T18:30:19.003 INFO:tasks.workunit.client.1.smithi149.stdout:1/267: dwrite d9/d15/d25/f32 [4194304,4194304] 0 2024-09-13T18:30:19.006 INFO:tasks.workunit.client.1.smithi149.stdout:0/174: link d1/d2/l15 d1/d29/d31/l33 0 2024-09-13T18:30:19.006 INFO:tasks.workunit.client.1.smithi149.stdout:8/198: unlink d2/d12/d1b/c1e 0 2024-09-13T18:30:19.009 INFO:tasks.workunit.client.1.smithi149.stdout:5/230: creat d3/d8/d13/d42/f47 x:0 0 0 2024-09-13T18:30:19.010 INFO:tasks.workunit.client.1.smithi149.stdout:5/231: fsync d3/f34 0 2024-09-13T18:30:19.010 INFO:tasks.workunit.client.1.smithi149.stdout:5/232: fdatasync d3/d8/d13/f22 0 2024-09-13T18:30:19.010 INFO:tasks.workunit.client.1.smithi149.stdout:5/233: write d3/d8/d13/d42/f47 [378543,67416] 0 2024-09-13T18:30:19.010 INFO:tasks.workunit.client.1.smithi149.stdout:5/234: creat d3/d8/d13/d42/f48 x:0 0 0 2024-09-13T18:30:19.010 INFO:tasks.workunit.client.1.smithi149.stdout:5/235: dread - d3/d10/d32/f38 zero size 2024-09-13T18:30:19.010 INFO:tasks.workunit.client.1.smithi149.stdout:5/236: stat l2 0 2024-09-13T18:30:19.014 INFO:tasks.workunit.client.1.smithi149.stdout:0/175: rename d1/c1c to d1/c34 0 2024-09-13T18:30:19.015 INFO:tasks.workunit.client.1.smithi149.stdout:9/173: stat d0/d18/d19/c2f 0 2024-09-13T18:30:19.015 INFO:tasks.workunit.client.1.smithi149.stdout:1/268: mknod d9/d10/d37/c54 0 2024-09-13T18:30:19.015 INFO:tasks.workunit.client.1.smithi149.stdout:9/174: mknod d0/c3a 0 2024-09-13T18:30:19.017 INFO:tasks.workunit.client.1.smithi149.stdout:0/176: creat d1/d29/d31/f35 x:0 0 0 2024-09-13T18:30:19.017 INFO:tasks.workunit.client.1.smithi149.stdout:0/177: dread - d1/d29/d31/f35 zero size 2024-09-13T18:30:19.017 INFO:tasks.workunit.client.1.smithi149.stdout:0/178: stat d1/f2c 0 2024-09-13T18:30:19.018 INFO:tasks.workunit.client.1.smithi149.stdout:6/193: dwrite f8 [0,4194304] 0 2024-09-13T18:30:19.018 INFO:tasks.workunit.client.1.smithi149.stdout:6/194: creat dc/d15/d23/f39 x:0 0 0 2024-09-13T18:30:19.019 INFO:tasks.workunit.client.1.smithi149.stdout:4/224: write df/f15 [3552417,19452] 0 2024-09-13T18:30:19.021 INFO:tasks.workunit.client.1.smithi149.stdout:0/179: creat d1/d29/f36 x:0 0 0 2024-09-13T18:30:19.021 INFO:tasks.workunit.client.1.smithi149.stdout:0/180: chown d1/l7 14204895 1 2024-09-13T18:30:19.021 INFO:tasks.workunit.client.1.smithi149.stdout:0/181: readlink d1/d2/l15 0 2024-09-13T18:30:19.021 INFO:tasks.workunit.client.1.smithi149.stdout:0/182: truncate d1/d29/f36 148940 0 2024-09-13T18:30:19.024 INFO:tasks.workunit.client.1.smithi149.stdout:0/183: symlink d1/d1b/l37 0 2024-09-13T18:30:19.025 INFO:tasks.workunit.client.1.smithi149.stdout:1/269: write d9/d15/d25/f32 [2168733,105725] 0 2024-09-13T18:30:19.025 INFO:tasks.workunit.client.1.smithi149.stdout:9/175: mkdir d0/d18/d19/d3b 0 2024-09-13T18:30:19.025 INFO:tasks.workunit.client.1.smithi149.stdout:1/270: creat d9/d10/d34/f55 x:0 0 0 2024-09-13T18:30:19.026 INFO:tasks.workunit.client.1.smithi149.stdout:0/184: creat d1/d1b/f38 x:0 0 0 2024-09-13T18:30:19.027 INFO:tasks.workunit.client.1.smithi149.stdout:9/176: creat d0/f3c x:0 0 0 2024-09-13T18:30:19.027 INFO:tasks.workunit.client.1.smithi149.stdout:9/177: chown d0/d33/f34 1913 1 2024-09-13T18:30:19.027 INFO:tasks.workunit.client.1.smithi149.stdout:9/178: chown d0/fe 169099190 1 2024-09-13T18:30:19.030 INFO:tasks.workunit.client.1.smithi149.stdout:1/271: creat d9/d10/d34/d3c/d50/f56 x:0 0 0 2024-09-13T18:30:19.031 INFO:tasks.workunit.client.1.smithi149.stdout:2/224: write f1 [1491927,42446] 0 2024-09-13T18:30:19.033 INFO:tasks.workunit.client.1.smithi149.stdout:2/225: creat db/d10/d12/f43 x:0 0 0 2024-09-13T18:30:19.033 INFO:tasks.workunit.client.1.smithi149.stdout:7/258: dwrite d7/d9/fa [0,4194304] 0 2024-09-13T18:30:19.033 INFO:tasks.workunit.client.1.smithi149.stdout:7/259: dread - d7/d9/d1c/d34/f55 zero size 2024-09-13T18:30:19.033 INFO:tasks.workunit.client.1.smithi149.stdout:7/260: creat d7/d9/d1c/d2f/d31/f5b x:0 0 0 2024-09-13T18:30:19.034 INFO:tasks.workunit.client.1.smithi149.stdout:0/185: link d1/f5 d1/d29/d31/f39 0 2024-09-13T18:30:19.037 INFO:tasks.workunit.client.1.smithi149.stdout:4/225: dread df/d11/d1c/f32 [0,4194304] 0 2024-09-13T18:30:19.037 INFO:tasks.workunit.client.1.smithi149.stdout:2/226: symlink db/d1b/d1c/l44 0 2024-09-13T18:30:19.037 INFO:tasks.workunit.client.1.smithi149.stdout:2/227: chown db/d1b/f21 79250 1 2024-09-13T18:30:19.037 INFO:tasks.workunit.client.1.smithi149.stdout:2/228: truncate db/d10/f14 5223581 0 2024-09-13T18:30:19.038 INFO:tasks.workunit.client.1.smithi149.stdout:2/229: chown db/d1b/d1c/d20/d3a/d28 10155062 1 2024-09-13T18:30:19.041 INFO:tasks.workunit.client.1.smithi149.stdout:8/199: dwrite d2/f42 [0,4194304] 0 2024-09-13T18:30:19.044 INFO:tasks.workunit.client.1.smithi149.stdout:7/261: rename d7/d9/d1c/d1f/l5a to d7/d9/d1c/d1f/d21/d49/l5c 0 2024-09-13T18:30:19.044 INFO:tasks.workunit.client.1.smithi149.stdout:7/262: stat d7/d9/d1c/d2f/d31/f4f 0 2024-09-13T18:30:19.046 INFO:tasks.workunit.client.1.smithi149.stdout:4/226: creat df/d11/d12/d17/f49 x:0 0 0 2024-09-13T18:30:19.049 INFO:tasks.workunit.client.1.smithi149.stdout:7/263: dread d7/d9/d1c/f29 [0,4194304] 0 2024-09-13T18:30:19.049 INFO:tasks.workunit.client.1.smithi149.stdout:7/264: creat d7/d9/d1c/d34/f5d x:0 0 0 2024-09-13T18:30:19.049 INFO:tasks.workunit.client.1.smithi149.stdout:8/200: link d2/d12/d1b/l33 d2/d13/l44 0 2024-09-13T18:30:19.049 INFO:tasks.workunit.client.1.smithi149.stdout:8/201: readlink d2/d13/l35 0 2024-09-13T18:30:19.055 INFO:tasks.workunit.client.1.smithi149.stdout:3/241: dwrite d1/d4/fd [0,4194304] 0 2024-09-13T18:30:19.055 INFO:tasks.workunit.client.1.smithi149.stdout:3/242: write d1/d48/f4b [1844,82331] 0 2024-09-13T18:30:19.057 INFO:tasks.workunit.client.1.smithi149.stdout:3/243: creat d1/d2e/d1d/f51 x:0 0 0 2024-09-13T18:30:19.063 INFO:tasks.workunit.client.1.smithi149.stdout:5/237: dwrite d3/d10/d32/f3c [0,4194304] 0 2024-09-13T18:30:19.066 INFO:tasks.workunit.client.1.smithi149.stdout:3/244: dread d1/f24 [0,4194304] 0 2024-09-13T18:30:19.066 INFO:tasks.workunit.client.1.smithi149.stdout:3/245: dread - d1/d47/d30/f3c zero size 2024-09-13T18:30:19.066 INFO:tasks.workunit.client.1.smithi149.stdout:3/246: chown d1/d12/c29 100 1 2024-09-13T18:30:19.066 INFO:tasks.workunit.client.1.smithi149.stdout:3/247: fsync d1/f11 0 2024-09-13T18:30:19.067 INFO:tasks.workunit.client.1.smithi149.stdout:7/265: write d7/d9/fa [2336527,104800] 0 2024-09-13T18:30:19.067 INFO:tasks.workunit.client.1.smithi149.stdout:7/266: fdatasync d7/d9/d1c/d2c/f38 0 2024-09-13T18:30:19.067 INFO:tasks.workunit.client.1.smithi149.stdout:5/238: symlink d3/d8/d13/l49 0 2024-09-13T18:30:19.067 INFO:tasks.workunit.client.1.smithi149.stdout:6/195: dwrite dc/d15/d23/f39 [0,4194304] 0 2024-09-13T18:30:19.068 INFO:tasks.workunit.client.1.smithi149.stdout:6/196: write f5 [4799793,105285] 0 2024-09-13T18:30:19.068 INFO:tasks.workunit.client.1.smithi149.stdout:9/179: dwrite d0/d18/d19/f23 [0,4194304] 0 2024-09-13T18:30:19.081 INFO:tasks.workunit.client.1.smithi149.stdout:3/248: write d1/d4/fd [1029689,9551] 0 2024-09-13T18:30:19.083 INFO:tasks.workunit.client.1.smithi149.stdout:5/239: symlink d3/d10/d32/l4a 0 2024-09-13T18:30:19.083 INFO:tasks.workunit.client.1.smithi149.stdout:4/227: dwrite df/d11/d12/d17/d3d/f40 [4194304,4194304] 0 2024-09-13T18:30:19.083 INFO:tasks.workunit.client.1.smithi149.stdout:4/228: creat df/d11/d12/d21/f4a x:0 0 0 2024-09-13T18:30:19.083 INFO:tasks.workunit.client.1.smithi149.stdout:9/180: creat d0/d18/d19/d3b/f3d x:0 0 0 2024-09-13T18:30:19.083 INFO:tasks.workunit.client.1.smithi149.stdout:7/267: rmdir d7/d9/d1b 39 2024-09-13T18:30:19.083 INFO:tasks.workunit.client.1.smithi149.stdout:7/268: write d7/d9/d1c/d2f/d31/f5b [1024375,89756] 0 2024-09-13T18:30:19.083 INFO:tasks.workunit.client.1.smithi149.stdout:7/269: chown d7/d9/d1b/c3b 179 1 2024-09-13T18:30:19.083 INFO:tasks.workunit.client.1.smithi149.stdout:3/249: creat d1/d47/d30/d46/f52 x:0 0 0 2024-09-13T18:30:19.084 INFO:tasks.workunit.client.1.smithi149.stdout:5/240: unlink d3/d10/d33/l43 0 2024-09-13T18:30:19.085 INFO:tasks.workunit.client.1.smithi149.stdout:8/202: dwrite d2/d12/d2a/f2c [0,4194304] 0 2024-09-13T18:30:19.085 INFO:tasks.workunit.client.1.smithi149.stdout:6/197: rmdir dc/d15/d23 39 2024-09-13T18:30:19.085 INFO:tasks.workunit.client.1.smithi149.stdout:0/186: dwrite d1/d2/fd [0,4194304] 0 2024-09-13T18:30:19.089 INFO:tasks.workunit.client.1.smithi149.stdout:4/229: symlink df/d11/d1c/l4b 0 2024-09-13T18:30:19.091 INFO:tasks.workunit.client.1.smithi149.stdout:3/250: symlink d1/d12/d20/l53 0 2024-09-13T18:30:19.093 INFO:tasks.workunit.client.1.smithi149.stdout:5/241: rmdir d3/d10/d33/d44 0 2024-09-13T18:30:19.093 INFO:tasks.workunit.client.1.smithi149.stdout:7/270: dread d7/f22 [0,4194304] 0 2024-09-13T18:30:19.093 INFO:tasks.workunit.client.1.smithi149.stdout:7/271: fsync d7/f8 0 2024-09-13T18:30:19.095 INFO:tasks.workunit.client.1.smithi149.stdout:8/203: rename d2/c1f to d2/d12/d2a/c45 0 2024-09-13T18:30:19.095 INFO:tasks.workunit.client.1.smithi149.stdout:0/187: rename d1/d29/d31 to d1/d29/d31/d3a 22 2024-09-13T18:30:19.096 INFO:tasks.workunit.client.1.smithi149.stdout:0/188: chown d1/c18 213 1 2024-09-13T18:30:19.098 INFO:tasks.workunit.client.1.smithi149.stdout:6/198: link dc/f37 dc/d2f/f3a 0 2024-09-13T18:30:19.099 INFO:tasks.workunit.client.1.smithi149.stdout:8/204: read d2/fe [4085309,50831] 0 2024-09-13T18:30:19.100 INFO:tasks.workunit.client.1.smithi149.stdout:3/251: mkdir d1/d12/d20/d54 0 2024-09-13T18:30:19.102 INFO:tasks.workunit.client.1.smithi149.stdout:5/242: unlink d3/f35 0 2024-09-13T18:30:19.102 INFO:tasks.workunit.client.1.smithi149.stdout:5/243: stat d3 0 2024-09-13T18:30:19.103 INFO:tasks.workunit.client.1.smithi149.stdout:7/272: symlink d7/d9/d11/l5e 0 2024-09-13T18:30:19.104 INFO:tasks.workunit.client.1.smithi149.stdout:0/189: mkdir d1/d3b 0 2024-09-13T18:30:19.104 INFO:tasks.workunit.client.1.smithi149.stdout:0/190: chown d1/f21 40573831 1 2024-09-13T18:30:19.104 INFO:tasks.workunit.client.1.smithi149.stdout:0/191: write d1/f1a [333280,117749] 0 2024-09-13T18:30:19.105 INFO:tasks.workunit.client.1.smithi149.stdout:7/273: symlink d7/d9/d1c/d1f/d3d/l5f 0 2024-09-13T18:30:19.105 INFO:tasks.workunit.client.1.smithi149.stdout:7/274: fsync d7/d9/d1c/d1f/f25 0 2024-09-13T18:30:19.105 INFO:tasks.workunit.client.1.smithi149.stdout:7/275: write d7/f3c [581181,27848] 0 2024-09-13T18:30:19.108 INFO:tasks.workunit.client.1.smithi149.stdout:0/192: getdents d1/d29/d31 0 2024-09-13T18:30:19.110 INFO:tasks.workunit.client.1.smithi149.stdout:0/193: stat d1/d2/l15 0 2024-09-13T18:30:19.110 INFO:tasks.workunit.client.1.smithi149.stdout:0/194: dread - d1/d1b/f38 zero size 2024-09-13T18:30:19.110 INFO:tasks.workunit.client.1.smithi149.stdout:7/276: dread d7/d12/f2d [0,4194304] 0 2024-09-13T18:30:19.112 INFO:tasks.workunit.client.1.smithi149.stdout:9/181: getdents d0/d18/d19/d3b 0 2024-09-13T18:30:19.116 INFO:tasks.workunit.client.1.smithi149.stdout:7/277: dread d7/f4c [0,4194304] 0 2024-09-13T18:30:19.121 INFO:tasks.workunit.client.1.smithi149.stdout:3/252: dread d1/d48/f4b [0,4194304] 0 2024-09-13T18:30:19.121 INFO:tasks.workunit.client.1.smithi149.stdout:3/253: creat d1/d2e/f55 x:0 0 0 2024-09-13T18:30:19.121 INFO:tasks.workunit.client.1.smithi149.stdout:3/254: chown d1/d2e/d1d 5740 1 2024-09-13T18:30:19.122 INFO:tasks.workunit.client.1.smithi149.stdout:9/182: dread d0/f2a [0,4194304] 0 2024-09-13T18:30:19.124 INFO:tasks.workunit.client.1.smithi149.stdout:3/255: rename d1/d47/d30/d43 to d1/d2c/d56 0 2024-09-13T18:30:19.125 INFO:tasks.workunit.client.1.smithi149.stdout:9/183: creat d0/d18/d27/f3e x:0 0 0 2024-09-13T18:30:19.126 INFO:tasks.workunit.client.1.smithi149.stdout:9/184: read d0/f22 [947631,43711] 0 2024-09-13T18:30:19.127 INFO:tasks.workunit.client.1.smithi149.stdout:4/230: dwrite df/d11/d1c/f23 [0,4194304] 0 2024-09-13T18:30:19.129 INFO:tasks.workunit.client.1.smithi149.stdout:0/195: dread d1/f13 [0,4194304] 0 2024-09-13T18:30:19.129 INFO:tasks.workunit.client.1.smithi149.stdout:0/196: readlink d1/l2d 0 2024-09-13T18:30:19.131 INFO:tasks.workunit.client.1.smithi149.stdout:8/205: dwrite d2/f15 [0,4194304] 0 2024-09-13T18:30:19.131 INFO:tasks.workunit.client.1.smithi149.stdout:7/278: dread d7/f22 [4194304,4194304] 0 2024-09-13T18:30:19.131 INFO:tasks.workunit.client.1.smithi149.stdout:8/206: creat d2/d12/f46 x:0 0 0 2024-09-13T18:30:19.131 INFO:tasks.workunit.client.1.smithi149.stdout:8/207: chown d2/d12/d40 12 1 2024-09-13T18:30:19.131 INFO:tasks.workunit.client.1.smithi149.stdout:8/208: fsync d2/d12/d1b/f3c 0 2024-09-13T18:30:19.133 INFO:tasks.workunit.client.1.smithi149.stdout:6/199: fsync dc/f37 0 2024-09-13T18:30:19.135 INFO:tasks.workunit.client.1.smithi149.stdout:9/185: dread d0/f22 [0,4194304] 0 2024-09-13T18:30:19.135 INFO:tasks.workunit.client.1.smithi149.stdout:5/244: dwrite d3/d10/d32/f38 [0,4194304] 0 2024-09-13T18:30:19.135 INFO:tasks.workunit.client.1.smithi149.stdout:5/245: write d3/f34 [280671,121230] 0 2024-09-13T18:30:19.135 INFO:tasks.workunit.client.1.smithi149.stdout:5/246: fdatasync d3/d8/f39 0 2024-09-13T18:30:19.135 INFO:tasks.workunit.client.1.smithi149.stdout:5/247: chown d3/d8/f1e 603746924 1 2024-09-13T18:30:19.135 INFO:tasks.workunit.client.1.smithi149.stdout:5/248: read d3/f3d [30178,25029] 0 2024-09-13T18:30:19.137 INFO:tasks.workunit.client.1.smithi149.stdout:4/231: creat df/d11/d12/d21/d22/f4c x:0 0 0 2024-09-13T18:30:19.137 INFO:tasks.workunit.client.1.smithi149.stdout:4/232: read df/f15 [67641,53486] 0 2024-09-13T18:30:19.139 INFO:tasks.workunit.client.1.smithi149.stdout:0/197: mknod d1/d3b/c3c 0 2024-09-13T18:30:19.139 INFO:tasks.workunit.client.1.smithi149.stdout:0/198: dread - d1/d1b/f38 zero size 2024-09-13T18:30:19.140 INFO:tasks.workunit.client.1.smithi149.stdout:7/279: mkdir d7/d9/d1c/d2c/d60 0 2024-09-13T18:30:19.140 INFO:tasks.workunit.client.1.smithi149.stdout:7/280: truncate d7/d9/d1c/d2c/f38 4195735 0 2024-09-13T18:30:19.144 INFO:tasks.workunit.client.1.smithi149.stdout:6/200: mknod dc/d2f/c3b 0 2024-09-13T18:30:19.144 INFO:tasks.workunit.client.1.smithi149.stdout:6/201: chown dc/d15/f2b 488490373 1 2024-09-13T18:30:19.144 INFO:tasks.workunit.client.1.smithi149.stdout:8/209: read d2/d13/f29 [2634689,102499] 0 2024-09-13T18:30:19.144 INFO:tasks.workunit.client.1.smithi149.stdout:8/210: chown d2/f42 7743 1 2024-09-13T18:30:19.144 INFO:tasks.workunit.client.1.smithi149.stdout:8/211: fdatasync d2/d12/d1b/f3c 0 2024-09-13T18:30:19.148 INFO:tasks.workunit.client.1.smithi149.stdout:4/233: mknod df/d11/d12/d21/c4d 0 2024-09-13T18:30:19.148 INFO:tasks.workunit.client.1.smithi149.stdout:4/234: rename df to df/d11/d12/d4e 22 2024-09-13T18:30:19.148 INFO:tasks.workunit.client.1.smithi149.stdout:4/235: chown df/l45 10212473 1 2024-09-13T18:30:19.151 INFO:tasks.workunit.client.1.smithi149.stdout:9/186: write d0/f38 [8118127,119252] 0 2024-09-13T18:30:19.152 INFO:tasks.workunit.client.1.smithi149.stdout:4/236: dread df/d11/f16 [0,4194304] 0 2024-09-13T18:30:19.152 INFO:tasks.workunit.client.1.smithi149.stdout:7/281: link d7/d9/d1c/d1f/d21/f4b d7/d9/d1c/d51/f61 0 2024-09-13T18:30:19.152 INFO:tasks.workunit.client.1.smithi149.stdout:4/237: creat df/d11/d1c/f4f x:0 0 0 2024-09-13T18:30:19.152 INFO:tasks.workunit.client.1.smithi149.stdout:7/282: write d7/d9/d11/f42 [1449323,72658] 0 2024-09-13T18:30:19.153 INFO:tasks.workunit.client.1.smithi149.stdout:7/283: getdents d7/d9/d1c/d2c/d60 0 2024-09-13T18:30:19.153 INFO:tasks.workunit.client.1.smithi149.stdout:5/249: getdents d3/d8/d13/d42 0 2024-09-13T18:30:19.154 INFO:tasks.workunit.client.1.smithi149.stdout:2/230: sync 2024-09-13T18:30:19.154 INFO:tasks.workunit.client.1.smithi149.stdout:1/272: sync 2024-09-13T18:30:19.154 INFO:tasks.workunit.client.1.smithi149.stdout:1/273: write d9/d15/f47 [1810277,106279] 0 2024-09-13T18:30:19.155 INFO:tasks.workunit.client.1.smithi149.stdout:0/199: rmdir d1/d2 39 2024-09-13T18:30:19.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.157+0000 7f8ff9d69640 1 -- 172.21.15.38:0/784682324 --> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ff41034e0 con 0x7f8fdc06cd90 2024-09-13T18:30:19.160 INFO:tasks.workunit.client.1.smithi149.stdout:9/187: rename d0/d18/f31 to d0/d18/d19/f3f 0 2024-09-13T18:30:19.160 INFO:tasks.workunit.client.1.smithi149.stdout:9/188: readlink d0/l16 0 2024-09-13T18:30:19.161 INFO:tasks.workunit.client.1.smithi149.stdout:3/256: dwrite d1/d2e/d1d/f2b [0,4194304] 0 2024-09-13T18:30:19.162 INFO:tasks.workunit.client.1.smithi149.stdout:6/202: dread f9 [0,4194304] 0 2024-09-13T18:30:19.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.162+0000 7f8ff0ff9640 1 -- 172.21.15.38:0/784682324 <== mgr.24387 v2:172.21.15.149:6828/2070517292 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8ff41034e0 con 0x7f8fdc06cd90 2024-09-13T18:30:19.165 INFO:tasks.workunit.client.1.smithi149.stdout:4/238: creat df/d11/d12/d21/d22/d30/d41/f50 x:0 0 0 2024-09-13T18:30:19.165 INFO:tasks.workunit.client.1.smithi149.stdout:4/239: read - df/d11/d12/d21/d22/d30/d41/f50 zero size 2024-09-13T18:30:19.165 INFO:tasks.workunit.client.1.smithi149.stdout:5/250: mknod d3/d8/c4b 0 2024-09-13T18:30:19.165 INFO:tasks.workunit.client.1.smithi149.stdout:5/251: fsync d3/d8/d13/f46 0 2024-09-13T18:30:19.165 INFO:tasks.workunit.client.1.smithi149.stdout:5/252: chown d3/fd 182604 1 2024-09-13T18:30:19.165 INFO:tasks.workunit.client.1.smithi149.stdout:5/253: chown d3/d8/d13/d42/f2a 1 1 2024-09-13T18:30:19.167 INFO:tasks.workunit.client.1.smithi149.stdout:4/240: unlink f0 0 2024-09-13T18:30:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.166+0000 7f8ff9d69640 1 -- 172.21.15.38:0/784682324 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f8fdc06cd90 msgr2=0x7f8fdc06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:19.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.166+0000 7f8ff9d69640 1 --2- 172.21.15.38:0/784682324 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f8fdc06cd90 0x7f8fdc06f250 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8031460 tx=0x7f8fe8000bc0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.166+0000 7f8ff9d69640 1 -- 172.21.15.38:0/784682324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ff40fde20 msgr2=0x7f8ff419bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:19.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.166+0000 7f8ff9d69640 1 --2- 172.21.15.38:0/784682324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ff40fde20 0x7f8ff419bb50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400d900 tx=0x7f8fe400ddc0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.166+0000 7f8ff9d69640 1 -- 172.21.15.38:0/784682324 shutdown_connections 2024-09-13T18:30:19.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.166+0000 7f8ff9d69640 1 --2- 172.21.15.38:0/784682324 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f8fdc06cd90 0x7f8fdc06f250 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.166+0000 7f8ff9d69640 1 --2- 172.21.15.38:0/784682324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ff40feb90 0x7f8ff419c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.166+0000 7f8ff9d69640 1 --2- 172.21.15.38:0/784682324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8ff40fde20 0x7f8ff419bb50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.166+0000 7f8ff9d69640 1 -- 172.21.15.38:0/784682324 >> 172.21.15.38:0/784682324 conn(0x7f8ff40f9950 msgr2=0x7f8ff4101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:19.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.166+0000 7f8ff9d69640 1 -- 172.21.15.38:0/784682324 shutdown_connections 2024-09-13T18:30:19.169 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.166+0000 7f8ff9d69640 1 -- 172.21.15.38:0/784682324 wait complete. 2024-09-13T18:30:19.169 INFO:tasks.workunit.client.1.smithi149.stdout:4/241: unlink df/d11/d12/d21/d22/d30/d41/l48 0 2024-09-13T18:30:19.170 INFO:tasks.workunit.client.1.smithi149.stdout:4/242: chown df/d11 1132911 1 2024-09-13T18:30:19.170 INFO:tasks.workunit.client.1.smithi149.stdout:4/243: write df/d11/d12/f3c [1879069,107998] 0 2024-09-13T18:30:19.171 INFO:tasks.workunit.client.1.smithi149.stdout:7/284: dread d7/d9/d11/f42 [0,4194304] 0 2024-09-13T18:30:19.171 INFO:tasks.workunit.client.1.smithi149.stdout:2/231: rename db/d10/d12/f2a to db/d1b/d1c/d20/f45 0 2024-09-13T18:30:19.177 INFO:tasks.workunit.client.1.smithi149.stdout:2/232: link db/d1b/d1c/d20/d3a/f2e db/d1b/d1c/d20/d2b/d3e/f46 0 2024-09-13T18:30:19.177 INFO:tasks.workunit.client.1.smithi149.stdout:2/233: write db/d10/d12/f3d [473433,107036] 0 2024-09-13T18:30:19.177 INFO:tasks.workunit.client.1.smithi149.stdout:2/234: dread - db/d1b/d1c/d20/d3a/f2e zero size 2024-09-13T18:30:19.177 INFO:tasks.workunit.client.1.smithi149.stdout:7/285: dread d7/d9/d1c/f29 [0,4194304] 0 2024-09-13T18:30:19.179 INFO:tasks.workunit.client.1.smithi149.stdout:6/203: dread dc/d15/f21 [0,4194304] 0 2024-09-13T18:30:19.179 INFO:tasks.workunit.client.1.smithi149.stdout:8/212: dwrite d2/fc [0,4194304] 0 2024-09-13T18:30:19.179 INFO:tasks.workunit.client.1.smithi149.stdout:8/213: dread - d2/f34 zero size 2024-09-13T18:30:19.179 INFO:tasks.workunit.client.1.smithi149.stdout:2/235: creat db/d1b/d1c/d20/d3a/f47 x:0 0 0 2024-09-13T18:30:19.182 INFO:tasks.workunit.client.1.smithi149.stdout:7/286: rename d7/lb to d7/d9/d40/l62 0 2024-09-13T18:30:19.185 INFO:tasks.workunit.client.1.smithi149.stdout:8/214: mknod d2/d12/d40/c47 0 2024-09-13T18:30:19.186 INFO:tasks.workunit.client.1.smithi149.stdout:1/274: dwrite d9/f3d [0,4194304] 0 2024-09-13T18:30:19.186 INFO:tasks.workunit.client.1.smithi149.stdout:6/204: symlink dc/d2f/l3c 0 2024-09-13T18:30:19.187 INFO:tasks.workunit.client.1.smithi149.stdout:4/244: rmdir df/d11/d1c 39 2024-09-13T18:30:19.187 INFO:tasks.workunit.client.1.smithi149.stdout:4/245: chown df/c44 37 1 2024-09-13T18:30:19.193 INFO:tasks.workunit.client.1.smithi149.stdout:9/189: dwrite d0/f22 [0,4194304] 0 2024-09-13T18:30:19.193 INFO:tasks.workunit.client.1.smithi149.stdout:2/236: mkdir db/d1b/d48 0 2024-09-13T18:30:19.194 INFO:tasks.workunit.client.1.smithi149.stdout:3/257: dwrite d1/d2e/f37 [0,4194304] 0 2024-09-13T18:30:19.195 INFO:tasks.workunit.client.1.smithi149.stdout:7/287: symlink d7/d9/d1c/d34/d4e/l63 0 2024-09-13T18:30:19.199 INFO:tasks.workunit.client.1.smithi149.stdout:1/275: truncate d9/d15/f20 2089153 0 2024-09-13T18:30:19.199 INFO:tasks.workunit.client.1.smithi149.stdout:1/276: readlink d9/d10/l12 0 2024-09-13T18:30:19.201 INFO:tasks.workunit.client.1.smithi149.stdout:6/205: rename dc/f1e to dc/d15/f3d 0 2024-09-13T18:30:19.201 INFO:tasks.workunit.client.1.smithi149.stdout:9/190: mknod d0/c40 0 2024-09-13T18:30:19.201 INFO:tasks.workunit.client.1.smithi149.stdout:9/191: chown d0/d33 138847 1 2024-09-13T18:30:19.201 INFO:tasks.workunit.client.1.smithi149.stdout:4/246: mknod df/d11/d12/c51 0 2024-09-13T18:30:19.201 INFO:tasks.workunit.client.1.smithi149.stdout:9/192: write d0/d18/d19/f3f [295480,127518] 0 2024-09-13T18:30:19.202 INFO:tasks.workunit.client.1.smithi149.stdout:2/237: rmdir db/d10/d12/d26 0 2024-09-13T18:30:19.203 INFO:tasks.workunit.client.1.smithi149.stdout:8/215: dwrite d2/d12/f39 [0,4194304] 0 2024-09-13T18:30:19.205 INFO:tasks.workunit.client.1.smithi149.stdout:3/258: symlink d1/d12/d20/d54/l57 0 2024-09-13T18:30:19.210 INFO:tasks.workunit.client.1.smithi149.stdout:1/277: dread d9/d15/f47 [0,4194304] 0 2024-09-13T18:30:19.210 INFO:tasks.workunit.client.1.smithi149.stdout:1/278: readlink d9/lb 0 2024-09-13T18:30:19.210 INFO:tasks.workunit.client.1.smithi149.stdout:6/206: creat dc/d15/d23/f3e x:0 0 0 2024-09-13T18:30:19.210 INFO:tasks.workunit.client.1.smithi149.stdout:6/207: creat dc/f3f x:0 0 0 2024-09-13T18:30:19.212 INFO:tasks.workunit.client.1.smithi149.stdout:9/193: creat d0/d18/f41 x:0 0 0 2024-09-13T18:30:19.212 INFO:tasks.workunit.client.1.smithi149.stdout:9/194: chown d0/d18/c28 18 1 2024-09-13T18:30:19.213 INFO:tasks.workunit.client.1.smithi149.stdout:7/288: dwrite d7/d9/d1c/d2f/d31/f4f [0,4194304] 0 2024-09-13T18:30:19.213 INFO:tasks.workunit.client.1.smithi149.stdout:7/289: truncate d7/d9/d1b/f36 4683415 0 2024-09-13T18:30:19.213 INFO:tasks.workunit.client.1.smithi149.stdout:7/290: readlink d7/d9/d40/l62 0 2024-09-13T18:30:19.215 INFO:tasks.workunit.client.1.smithi149.stdout:3/259: creat d1/f58 x:0 0 0 2024-09-13T18:30:19.218 INFO:tasks.workunit.client.1.smithi149.stdout:1/279: mkdir d9/d10/d34/d53/d57 0 2024-09-13T18:30:19.224 INFO:tasks.workunit.client.1.smithi149.stdout:7/291: link d7/d12/c20 d7/d9/d1c/d2f/c64 0 2024-09-13T18:30:19.224 INFO:tasks.workunit.client.1.smithi149.stdout:7/292: truncate d7/d9/d1c/d1f/d21/d49/f56 53620 0 2024-09-13T18:30:19.225 INFO:tasks.workunit.client.1.smithi149.stdout:1/280: mkdir d9/d58 0 2024-09-13T18:30:19.225 INFO:tasks.workunit.client.1.smithi149.stdout:1/281: fsync d9/d10/d34/f55 0 2024-09-13T18:30:19.229 INFO:tasks.workunit.client.1.smithi149.stdout:7/293: rename d7/d9/c32 to d7/d9/d1b/c65 0 2024-09-13T18:30:19.229 INFO:tasks.workunit.client.1.smithi149.stdout:8/216: dwrite d2/f42 [0,4194304] 0 2024-09-13T18:30:19.230 INFO:tasks.workunit.client.1.smithi149.stdout:1/282: getdents d9/d10/d43 0 2024-09-13T18:30:19.230 INFO:tasks.workunit.client.1.smithi149.stdout:1/283: write d9/d10/f22 [503879,44476] 0 2024-09-13T18:30:19.231 INFO:tasks.workunit.client.1.smithi149.stdout:1/284: write d9/f1c [3145259,100971] 0 2024-09-13T18:30:19.234 INFO:tasks.workunit.client.1.smithi149.stdout:4/247: mknod df/d11/c52 0 2024-09-13T18:30:19.236 INFO:tasks.workunit.client.1.smithi149.stdout:6/208: rmdir dc/d15/d23 39 2024-09-13T18:30:19.240 INFO:tasks.workunit.client.1.smithi149.stdout:6/209: rename dc/d15/f30 to dc/d15/d23/f40 0 2024-09-13T18:30:19.240 INFO:tasks.workunit.client.1.smithi149.stdout:6/210: write dc/d2f/f34 [719449,126020] 0 2024-09-13T18:30:19.242 INFO:tasks.workunit.client.1.smithi149.stdout:4/248: rename df/d11/d12/d21/d22/c26 to df/d11/d12/d21/d22/d30/c53 0 2024-09-13T18:30:19.245 INFO:tasks.workunit.client.1.smithi149.stdout:7/294: read d7/d9/d1c/d2f/d31/f4f [3779315,80042] 0 2024-09-13T18:30:19.245 INFO:tasks.workunit.client.1.smithi149.stdout:4/249: link df/d11/c52 df/d11/d12/d21/c54 0 2024-09-13T18:30:19.246 INFO:tasks.workunit.client.1.smithi149.stdout:4/250: symlink df/d11/d12/d17/l55 0 2024-09-13T18:30:19.246 INFO:tasks.workunit.client.1.smithi149.stdout:6/211: dread dc/f2c [0,4194304] 0 2024-09-13T18:30:19.246 INFO:tasks.workunit.client.1.smithi149.stdout:6/212: fdatasync dc/d15/f20 0 2024-09-13T18:30:19.246 INFO:tasks.workunit.client.1.smithi149.stdout:7/295: mknod d7/d9/d1c/d2c/d60/c66 0 2024-09-13T18:30:19.247 INFO:tasks.workunit.client.1.smithi149.stdout:6/213: symlink dc/d15/d23/l41 0 2024-09-13T18:30:19.248 INFO:tasks.workunit.client.1.smithi149.stdout:7/296: mknod d7/d9/d1b/c67 0 2024-09-13T18:30:19.248 INFO:tasks.workunit.client.1.smithi149.stdout:7/297: read - d7/d9/d1c/d34/f55 zero size 2024-09-13T18:30:19.250 INFO:tasks.workunit.client.1.smithi149.stdout:4/251: rename df/d11/d1c/d35 to df/d11/d12/d21/d22/d30/d56 0 2024-09-13T18:30:19.250 INFO:tasks.workunit.client.1.smithi149.stdout:6/214: mkdir dc/d15/d23/d42 0 2024-09-13T18:30:19.251 INFO:tasks.workunit.client.1.smithi149.stdout:7/298: mknod d7/d9/d1c/d1f/d47/d53/c68 0 2024-09-13T18:30:19.254 INFO:tasks.workunit.client.1.smithi149.stdout:7/299: dread d7/d9/d11/f42 [0,4194304] 0 2024-09-13T18:30:19.256 INFO:tasks.workunit.client.1.smithi149.stdout:6/215: dread fa [0,4194304] 0 2024-09-13T18:30:19.257 INFO:tasks.workunit.client.1.smithi149.stdout:2/238: dwrite db/fd [0,4194304] 0 2024-09-13T18:30:19.257 INFO:tasks.workunit.client.1.smithi149.stdout:2/239: write db/ff [1395612,1419] 0 2024-09-13T18:30:19.257 INFO:tasks.workunit.client.1.smithi149.stdout:6/216: rename dc/c1f to dc/d2f/c43 0 2024-09-13T18:30:19.259 INFO:tasks.workunit.client.1.smithi149.stdout:2/240: mkdir db/d1b/d1c/d20/d49 0 2024-09-13T18:30:19.259 INFO:tasks.workunit.client.1.smithi149.stdout:9/195: dwrite d0/f2a [0,4194304] 0 2024-09-13T18:30:19.259 INFO:tasks.workunit.client.1.smithi149.stdout:1/285: dwrite d9/f3d [0,4194304] 0 2024-09-13T18:30:19.260 INFO:tasks.workunit.client.1.smithi149.stdout:8/217: dwrite d2/f34 [0,4194304] 0 2024-09-13T18:30:19.262 INFO:tasks.workunit.client.1.smithi149.stdout:3/260: dwrite d1/d47/f26 [0,4194304] 0 2024-09-13T18:30:19.262 INFO:tasks.workunit.client.1.smithi149.stdout:3/261: chown d1/d12/d20/f45 7442224 1 2024-09-13T18:30:19.262 INFO:tasks.workunit.client.1.smithi149.stdout:3/262: write d1/d2e/f17 [4443600,123531] 0 2024-09-13T18:30:19.268 INFO:tasks.workunit.client.1.smithi149.stdout:6/217: dread dc/d15/f2b [0,4194304] 0 2024-09-13T18:30:19.281 INFO:tasks.workunit.client.1.smithi149.stdout:4/252: dwrite df/d11/d12/d21/d22/d30/f37 [0,4194304] 0 2024-09-13T18:30:19.282 INFO:tasks.workunit.client.1.smithi149.stdout:1/286: dread d9/f3d [0,4194304] 0 2024-09-13T18:30:19.282 INFO:tasks.workunit.client.1.smithi149.stdout:1/287: fdatasync d9/d10/f1a 0 2024-09-13T18:30:19.282 INFO:tasks.workunit.client.1.smithi149.stdout:3/263: creat d1/d47/d30/f59 x:0 0 0 2024-09-13T18:30:19.283 INFO:tasks.workunit.client.1.smithi149.stdout:6/218: unlink dc/f29 0 2024-09-13T18:30:19.284 INFO:tasks.workunit.client.1.smithi149.stdout:6/219: dread dc/d2f/f32 [0,4194304] 0 2024-09-13T18:30:19.284 INFO:tasks.workunit.client.1.smithi149.stdout:6/220: creat dc/d15/f44 x:0 0 0 2024-09-13T18:30:19.284 INFO:tasks.workunit.client.1.smithi149.stdout:6/221: chown dc/c38 8 1 2024-09-13T18:30:19.285 INFO:tasks.workunit.client.1.smithi149.stdout:6/222: chown dc/d2f/f34 2367559 1 2024-09-13T18:30:19.285 INFO:tasks.workunit.client.1.smithi149.stdout:4/253: truncate df/d11/d1c/f3f 1739859 0 2024-09-13T18:30:19.285 INFO:tasks.workunit.client.1.smithi149.stdout:4/254: write df/f20 [386662,59156] 0 2024-09-13T18:30:19.286 INFO:tasks.workunit.client.1.smithi149.stdout:1/288: rename d9/d15/d25/c28 to d9/d10/d34/c59 0 2024-09-13T18:30:19.286 INFO:tasks.workunit.client.1.smithi149.stdout:3/264: truncate d1/d21/f27 2269654 0 2024-09-13T18:30:19.287 INFO:tasks.workunit.client.1.smithi149.stdout:3/265: readlink d1/d4/l4e 0 2024-09-13T18:30:19.287 INFO:tasks.workunit.client.1.smithi149.stdout:3/266: chown d1/d4/l1e 6292292 1 2024-09-13T18:30:19.287 INFO:tasks.workunit.client.1.smithi149.stdout:6/223: mknod dc/d15/c45 0 2024-09-13T18:30:19.287 INFO:tasks.workunit.client.1.smithi149.stdout:7/300: dwrite d7/d9/d1c/d1f/d21/d49/f56 [0,4194304] 0 2024-09-13T18:30:19.287 INFO:tasks.workunit.client.1.smithi149.stdout:4/255: mkdir df/d11/d12/d21/d22/d30/d41/d57 0 2024-09-13T18:30:19.291 INFO:tasks.workunit.client.1.smithi149.stdout:1/289: unlink d9/d15/d25/f4c 0 2024-09-13T18:30:19.291 INFO:tasks.workunit.client.1.smithi149.stdout:6/224: symlink dc/l46 0 2024-09-13T18:30:19.291 INFO:tasks.workunit.client.1.smithi149.stdout:4/256: mknod df/d11/d12/d21/d22/c58 0 2024-09-13T18:30:19.291 INFO:tasks.workunit.client.1.smithi149.stdout:3/267: rmdir d1/d12/d20 39 2024-09-13T18:30:19.293 INFO:tasks.workunit.client.1.smithi149.stdout:4/257: unlink df/d11/d12/d21/d22/f4c 0 2024-09-13T18:30:19.293 INFO:tasks.workunit.client.1.smithi149.stdout:4/258: write df/d11/d12/d17/f3a [3686742,33131] 0 2024-09-13T18:30:19.294 INFO:tasks.workunit.client.1.smithi149.stdout:3/268: mkdir d1/d47/d30/d5a 0 2024-09-13T18:30:19.298 INFO:tasks.workunit.client.1.smithi149.stdout:4/259: dread df/f29 [0,4194304] 0 2024-09-13T18:30:19.299 INFO:tasks.workunit.client.1.smithi149.stdout:8/218: dwrite d2/f9 [0,4194304] 0 2024-09-13T18:30:19.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.298+0000 7f1052a1a640 1 -- 172.21.15.38:0/1648188631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f104c0ffb90 msgr2=0x7f104c0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:19.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.298+0000 7f1052a1a640 1 --2- 172.21.15.38:0/1648188631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f104c0ffb90 0x7f104c0fff90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f103c009880 tx=0x7f103c02a4b0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.298+0000 7f1052a1a640 1 -- 172.21.15.38:0/1648188631 shutdown_connections 2024-09-13T18:30:19.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.298+0000 7f1052a1a640 1 --2- 172.21.15.38:0/1648188631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f104c100d90 0x7f104c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.298+0000 7f1052a1a640 1 --2- 172.21.15.38:0/1648188631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f104c0ffb90 0x7f104c0fff90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.298+0000 7f1052a1a640 1 -- 172.21.15.38:0/1648188631 >> 172.21.15.38:0/1648188631 conn(0x7f104c0fb360 msgr2=0x7f104c0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:19.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.298+0000 7f1052a1a640 1 -- 172.21.15.38:0/1648188631 shutdown_connections 2024-09-13T18:30:19.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.298+0000 7f1052a1a640 1 -- 172.21.15.38:0/1648188631 wait complete. 2024-09-13T18:30:19.301 INFO:tasks.workunit.client.1.smithi149.stdout:4/260: rename df/d11/d12/d17/l55 to df/d11/d12/d21/d22/d30/d41/d57/l59 0 2024-09-13T18:30:19.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.299+0000 7f1052a1a640 1 Processor -- start 2024-09-13T18:30:19.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.299+0000 7f1052a1a640 1 -- start start 2024-09-13T18:30:19.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.300+0000 7f1052a1a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f104c0ffb90 0x7f104c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:19.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.300+0000 7f1052a1a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f104c100d90 0x7f104c0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:19.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.300+0000 7f1052a1a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c072de0 con 0x7f104c0ffb90 2024-09-13T18:30:19.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.300+0000 7f1052a1a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c072f50 con 0x7f104c100d90 2024-09-13T18:30:19.303 INFO:tasks.workunit.client.1.smithi149.stdout:8/219: symlink d2/d12/l48 0 2024-09-13T18:30:19.304 INFO:tasks.workunit.client.1.smithi149.stdout:8/220: readlink d2/la 0 2024-09-13T18:30:19.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.300+0000 7f104bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f104c0ffb90 0x7f104c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:19.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.300+0000 7f104bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f104c0ffb90 0x7f104c074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45390/0 (socket says 172.21.15.38:45390) 2024-09-13T18:30:19.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.300+0000 7f104bfff640 1 -- 172.21.15.38:0/2262878870 learned_addr learned my addr 172.21.15.38:0/2262878870 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:19.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.301+0000 7f104bfff640 1 -- 172.21.15.38:0/2262878870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f104c100d90 msgr2=0x7f104c0728a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:30:19.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.301+0000 7f104bfff640 1 --2- 172.21.15.38:0/2262878870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f104c100d90 0x7f104c0728a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.301+0000 7f104bfff640 1 -- 172.21.15.38:0/2262878870 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c009560 con 0x7f104c0ffb90 2024-09-13T18:30:19.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.301+0000 7f104bfff640 1 --2- 172.21.15.38:0/2262878870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f104c0ffb90 0x7f104c074250 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f103c005610 tx=0x7f103c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:19.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.301+0000 7f10497fa640 1 -- 172.21.15.38:0/2262878870 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103c004be0 con 0x7f104c0ffb90 2024-09-13T18:30:19.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.301+0000 7f1052a1a640 1 -- 172.21.15.38:0/2262878870 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104c0731d0 con 0x7f104c0ffb90 2024-09-13T18:30:19.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.301+0000 7f10497fa640 1 -- 172.21.15.38:0/2262878870 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f103c004d40 con 0x7f104c0ffb90 2024-09-13T18:30:19.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.301+0000 7f10497fa640 1 -- 172.21.15.38:0/2262878870 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103c031b60 con 0x7f104c0ffb90 2024-09-13T18:30:19.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.302+0000 7f1052a1a640 1 -- 172.21.15.38:0/2262878870 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104c19d670 con 0x7f104c0ffb90 2024-09-13T18:30:19.305 INFO:tasks.workunit.client.1.smithi149.stdout:4/261: creat df/d11/d12/d21/d22/d30/d56/f5a x:0 0 0 2024-09-13T18:30:19.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.305+0000 7f1052a1a640 1 -- 172.21.15.38:0/2262878870 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104c100010 con 0x7f104c0ffb90 2024-09-13T18:30:19.308 INFO:tasks.workunit.client.1.smithi149.stdout:9/196: dwrite d0/f1a [0,4194304] 0 2024-09-13T18:30:19.308 INFO:tasks.workunit.client.1.smithi149.stdout:9/197: chown d0/d33 406 1 2024-09-13T18:30:19.309 INFO:tasks.workunit.client.1.smithi149.stdout:8/221: mkdir d2/d13/d49 0 2024-09-13T18:30:19.309 INFO:tasks.workunit.client.1.smithi149.stdout:2/241: dwrite f4 [0,4194304] 0 2024-09-13T18:30:19.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.306+0000 7f10497fa640 1 -- 172.21.15.38:0/2262878870 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f103c031cc0 con 0x7f104c0ffb90 2024-09-13T18:30:19.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.307+0000 7f10497fa640 1 --2- 172.21.15.38:0/2262878870 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f103406cde0 0x7f103406f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:19.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.308+0000 7f10497fa640 1 -- 172.21.15.38:0/2262878870 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f103c0ad940 con 0x7f104c0ffb90 2024-09-13T18:30:19.313 INFO:tasks.workunit.client.1.smithi149.stdout:2/242: link f6 db/d13/f4a 0 2024-09-13T18:30:19.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.311+0000 7f104b7fe640 1 --2- 172.21.15.38:0/2262878870 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f103406cde0 0x7f103406f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:19.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.313+0000 7f104b7fe640 1 --2- 172.21.15.38:0/2262878870 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f103406cde0 0x7f103406f2a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f104c073fd0 tx=0x7f1040006c20 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:19.316 INFO:tasks.workunit.client.1.smithi149.stdout:0/200: sync 2024-09-13T18:30:19.316 INFO:tasks.workunit.client.1.smithi149.stdout:5/254: sync 2024-09-13T18:30:19.317 INFO:tasks.workunit.client.1.smithi149.stdout:5/255: chown d3/d10/f1c 31790566 1 2024-09-13T18:30:19.317 INFO:tasks.workunit.client.1.smithi149.stdout:5/256: truncate d3/d10/d32/f45 1017912 0 2024-09-13T18:30:19.317 INFO:tasks.workunit.client.1.smithi149.stdout:0/201: creat d1/d1b/f3d x:0 0 0 2024-09-13T18:30:19.319 INFO:tasks.workunit.client.1.smithi149.stdout:8/222: dread d2/d12/f16 [0,4194304] 0 2024-09-13T18:30:19.319 INFO:tasks.workunit.client.1.smithi149.stdout:8/223: write d2/d12/f3d [224665,126599] 0 2024-09-13T18:30:19.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.317+0000 7f10497fa640 1 -- 172.21.15.38:0/2262878870 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f103c0778f0 con 0x7f104c0ffb90 2024-09-13T18:30:19.320 INFO:tasks.workunit.client.1.smithi149.stdout:0/202: mkdir d1/d29/d31/d3e 0 2024-09-13T18:30:19.322 INFO:tasks.workunit.client.1.smithi149.stdout:0/203: unlink d1/l7 0 2024-09-13T18:30:19.322 INFO:tasks.workunit.client.1.smithi149.stdout:0/204: truncate d1/d2/fd 4223772 0 2024-09-13T18:30:19.322 INFO:tasks.workunit.client.1.smithi149.stdout:0/205: stat d1/d2/l15 0 2024-09-13T18:30:19.323 INFO:tasks.workunit.client.1.smithi149.stdout:0/206: unlink d1/f14 0 2024-09-13T18:30:19.325 INFO:tasks.workunit.client.1.smithi149.stdout:0/207: mkdir d1/d29/d31/d3e/d3f 0 2024-09-13T18:30:19.330 INFO:tasks.workunit.client.1.smithi149.stdout:4/262: write df/d11/d12/d21/f24 [2525344,118777] 0 2024-09-13T18:30:19.330 INFO:tasks.workunit.client.1.smithi149.stdout:4/263: dread - df/d11/d1c/f4f zero size 2024-09-13T18:30:19.330 INFO:tasks.workunit.client.1.smithi149.stdout:4/264: read - df/d11/d1c/f4f zero size 2024-09-13T18:30:19.330 INFO:tasks.workunit.client.1.smithi149.stdout:4/265: creat df/d11/d12/d17/f5b x:0 0 0 2024-09-13T18:30:19.331 INFO:tasks.workunit.client.1.smithi149.stdout:6/225: dwrite dc/d2f/f32 [0,4194304] 0 2024-09-13T18:30:19.331 INFO:tasks.workunit.client.1.smithi149.stdout:7/301: dwrite d7/d9/f1d [0,4194304] 0 2024-09-13T18:30:19.334 INFO:tasks.workunit.client.1.smithi149.stdout:4/266: truncate fc 975800 0 2024-09-13T18:30:19.335 INFO:tasks.workunit.client.1.smithi149.stdout:4/267: write df/d11/f16 [1001613,103223] 0 2024-09-13T18:30:19.338 INFO:tasks.workunit.client.1.smithi149.stdout:2/243: dread db/d1b/f33 [0,4194304] 0 2024-09-13T18:30:19.338 INFO:tasks.workunit.client.1.smithi149.stdout:2/244: truncate db/d1b/f42 446522 0 2024-09-13T18:30:19.338 INFO:tasks.workunit.client.1.smithi149.stdout:4/268: mknod df/d11/d12/d21/d22/d30/d56/c5c 0 2024-09-13T18:30:19.339 INFO:tasks.workunit.client.1.smithi149.stdout:2/245: mknod db/d1b/d2f/d30/c4b 0 2024-09-13T18:30:19.339 INFO:tasks.workunit.client.1.smithi149.stdout:4/269: rmdir df/d11/d1c 39 2024-09-13T18:30:19.340 INFO:tasks.workunit.client.1.smithi149.stdout:4/270: truncate df/d11/d12/d21/d22/d30/d41/f50 332118 0 2024-09-13T18:30:19.340 INFO:tasks.workunit.client.1.smithi149.stdout:2/246: mknod db/d1b/d1c/d20/c4c 0 2024-09-13T18:30:19.341 INFO:tasks.workunit.client.1.smithi149.stdout:4/271: truncate df/d11/d1c/f23 101812 0 2024-09-13T18:30:19.342 INFO:tasks.workunit.client.1.smithi149.stdout:8/224: dread d2/f34 [0,4194304] 0 2024-09-13T18:30:19.342 INFO:tasks.workunit.client.1.smithi149.stdout:8/225: write d2/d12/f43 [882092,16790] 0 2024-09-13T18:30:19.344 INFO:tasks.workunit.client.1.smithi149.stdout:8/226: symlink d2/d13/d3a/l4a 0 2024-09-13T18:30:19.359 INFO:tasks.workunit.client.1.smithi149.stdout:4/272: dwrite df/d11/f34 [0,4194304] 0 2024-09-13T18:30:19.361 INFO:tasks.workunit.client.1.smithi149.stdout:4/273: rmdir df/d11/d12/d21/d22/d30 39 2024-09-13T18:30:19.382 INFO:tasks.workunit.client.1.smithi149.stdout:4/274: dwrite df/d11/d12/d21/f4a [0,4194304] 0 2024-09-13T18:30:19.384 INFO:tasks.workunit.client.1.smithi149.stdout:4/275: read df/d11/d1c/f32 [695265,53509] 0 2024-09-13T18:30:19.384 INFO:tasks.workunit.client.1.smithi149.stdout:4/276: chown df/d11/d12/d17/d3d 4035477 1 2024-09-13T18:30:19.384 INFO:tasks.workunit.client.1.smithi149.stdout:4/277: creat df/d11/d12/d17/d3d/f5d x:0 0 0 2024-09-13T18:30:19.384 INFO:tasks.workunit.client.1.smithi149.stdout:4/278: creat df/d11/d12/d21/d22/f5e x:0 0 0 2024-09-13T18:30:19.384 INFO:tasks.workunit.client.1.smithi149.stdout:4/279: fsync df/d11/d12/d17/f3a 0 2024-09-13T18:30:19.462 INFO:tasks.workunit.client.1.smithi149.stdout:9/198: fsync d0/d18/d19/f3f 0 2024-09-13T18:30:19.462 INFO:tasks.workunit.client.1.smithi149.stdout:1/290: dwrite f3 [0,4194304] 0 2024-09-13T18:30:19.462 INFO:tasks.workunit.client.1.smithi149.stdout:1/291: dread - d9/d10/d34/f55 zero size 2024-09-13T18:30:19.462 INFO:tasks.workunit.client.1.smithi149.stdout:1/292: fdatasync d9/f3d 0 2024-09-13T18:30:19.462 INFO:tasks.workunit.client.1.smithi149.stdout:1/293: write d9/d10/d37/d38/f4e [8593257,7040] 0 2024-09-13T18:30:19.466 INFO:tasks.workunit.client.1.smithi149.stdout:9/199: mkdir d0/d2e/d42 0 2024-09-13T18:30:19.466 INFO:tasks.workunit.client.1.smithi149.stdout:5/257: dwrite d3/f4 [8388608,4194304] 0 2024-09-13T18:30:19.466 INFO:tasks.workunit.client.1.smithi149.stdout:5/258: write d3/d10/d32/f3a [432851,61565] 0 2024-09-13T18:30:19.468 INFO:tasks.workunit.client.1.smithi149.stdout:1/294: creat d9/d10/d37/f5a x:0 0 0 2024-09-13T18:30:19.468 INFO:tasks.workunit.client.1.smithi149.stdout:1/295: stat d9/d10/d34/f55 0 2024-09-13T18:30:19.468 INFO:tasks.workunit.client.1.smithi149.stdout:1/296: truncate d9/d10/d34/f55 619472 0 2024-09-13T18:30:19.469 INFO:tasks.workunit.client.1.smithi149.stdout:0/208: write d1/d2/fd [596594,7925] 0 2024-09-13T18:30:19.469 INFO:tasks.workunit.client.1.smithi149.stdout:3/269: dwrite d1/d12/f4c [0,4194304] 0 2024-09-13T18:30:19.470 INFO:tasks.workunit.client.1.smithi149.stdout:9/200: write d0/d18/d19/f3f [34772,122929] 0 2024-09-13T18:30:19.470 INFO:tasks.workunit.client.1.smithi149.stdout:9/201: dread - d0/d18/d27/f3e zero size 2024-09-13T18:30:19.475 INFO:tasks.workunit.client.1.smithi149.stdout:0/209: rename d1/d29/f36 to d1/d1b/f40 0 2024-09-13T18:30:19.475 INFO:tasks.workunit.client.1.smithi149.stdout:0/210: write d1/d1b/f40 [3228,117216] 0 2024-09-13T18:30:19.478 INFO:tasks.workunit.client.1.smithi149.stdout:3/270: rmdir d1/d47/d30/d41 0 2024-09-13T18:30:19.485 INFO:tasks.workunit.client.1.smithi149.stdout:6/226: dwrite dc/d15/f36 [0,4194304] 0 2024-09-13T18:30:19.485 INFO:tasks.workunit.client.1.smithi149.stdout:0/211: unlink d1/d29/d31/l33 0 2024-09-13T18:30:19.485 INFO:tasks.workunit.client.1.smithi149.stdout:3/271: rename d1/d12/d20/f45 to d1/d47/d30/f5b 0 2024-09-13T18:30:19.485 INFO:tasks.workunit.client.1.smithi149.stdout:3/272: dread - d1/d2e/d1d/f51 zero size 2024-09-13T18:30:19.486 INFO:tasks.workunit.client.1.smithi149.stdout:9/202: dread d0/f22 [0,4194304] 0 2024-09-13T18:30:19.486 INFO:tasks.workunit.client.1.smithi149.stdout:5/259: rename d3/d10/d33 to d3/d10/d4c 0 2024-09-13T18:30:19.486 INFO:tasks.workunit.client.1.smithi149.stdout:2/247: dwrite db/d1b/d1c/d20/d3a/f2e [0,4194304] 0 2024-09-13T18:30:19.489 INFO:tasks.workunit.client.1.smithi149.stdout:4/280: dwrite df/d11/d12/d21/d22/f5e [0,4194304] 0 2024-09-13T18:30:19.490 INFO:tasks.workunit.client.1.smithi149.stdout:4/281: chown df/d11/d12/d21/d22/d30/l3b 3 1 2024-09-13T18:30:19.490 INFO:tasks.workunit.client.1.smithi149.stdout:8/227: dwrite d2/d12/f16 [0,4194304] 0 2024-09-13T18:30:19.490 INFO:tasks.workunit.client.1.smithi149.stdout:1/297: dread d9/d10/d37/d38/f4e [8388608,4194304] 0 2024-09-13T18:30:19.490 INFO:tasks.workunit.client.1.smithi149.stdout:8/228: creat d2/d12/f4b x:0 0 0 2024-09-13T18:30:19.490 INFO:tasks.workunit.client.1.smithi149.stdout:3/273: dread d1/d2e/d1d/f2b [0,4194304] 0 2024-09-13T18:30:19.501 INFO:tasks.workunit.client.1.smithi149.stdout:3/274: dread d1/d47/f26 [0,4194304] 0 2024-09-13T18:30:19.501 INFO:tasks.workunit.client.1.smithi149.stdout:3/275: truncate d1/f58 898247 0 2024-09-13T18:30:19.501 INFO:tasks.workunit.client.1.smithi149.stdout:3/276: write d1/d4/fd [2938428,102340] 0 2024-09-13T18:30:19.502 INFO:tasks.workunit.client.1.smithi149.stdout:3/277: creat d1/d2e/d1d/f5c x:0 0 0 2024-09-13T18:30:19.504 INFO:tasks.workunit.client.1.smithi149.stdout:6/227: rename dc/f2c to dc/f47 0 2024-09-13T18:30:19.504 INFO:tasks.workunit.client.1.smithi149.stdout:6/228: dread - dc/f3f zero size 2024-09-13T18:30:19.504 INFO:tasks.workunit.client.1.smithi149.stdout:6/229: chown dc/d15/d23/f27 48 1 2024-09-13T18:30:19.508 INFO:tasks.workunit.client.1.smithi149.stdout:2/248: symlink db/d1b/d1c/d20/d2b/d3e/l4d 0 2024-09-13T18:30:19.509 INFO:tasks.workunit.client.1.smithi149.stdout:2/249: write db/d1b/f42 [427557,76833] 0 2024-09-13T18:30:19.509 INFO:tasks.workunit.client.1.smithi149.stdout:3/278: write d1/d2e/f37 [695192,92728] 0 2024-09-13T18:30:19.510 INFO:tasks.workunit.client.1.smithi149.stdout:2/250: creat db/d10/f4e x:0 0 0 2024-09-13T18:30:19.510 INFO:tasks.workunit.client.1.smithi149.stdout:2/251: write db/d13/f18 [4504059,2016] 0 2024-09-13T18:30:19.510 INFO:tasks.workunit.client.1.smithi149.stdout:2/252: fdatasync db/d10/d12/f43 0 2024-09-13T18:30:19.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.538+0000 7f1052a1a640 1 -- 172.21.15.38:0/2262878870 --> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f104c1056e0 con 0x7f103406cde0 2024-09-13T18:30:19.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.547+0000 7f10497fa640 1 -- 172.21.15.38:0/2262878870 <== mgr.24387 v2:172.21.15.149:6828/2070517292 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f104c1056e0 con 0x7f103406cde0 2024-09-13T18:30:19.550 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:30:19.550 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (6m) 7s ago 7m 24.1M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:30:19.550 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (8m) 7s ago 8m 7864k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:30:19.550 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (7m) 14s ago 7m 7708k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:30:19.550 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (8m) 7s ago 8m 6899k - 18.2.4-845-ge4e227b3 67ddd33fa72f 30c026e97a6b 2024-09-13T18:30:19.550 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (7m) 14s ago 7m 6895k - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c179d7df975 2024-09-13T18:30:19.550 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (6m) 7s ago 7m 87.4M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:30:19.550 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (2m) 7s ago 2m 154M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (2m) 7s ago 2m 87.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (2m) 14s ago 2m 20.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (2m) 14s ago 2m 20.5M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:9283,8765,8443 running (9m) 7s ago 9m 127M - 18.2.4-845-ge4e227b3 67ddd33fa72f 1cebd33ffd6a 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (38s) 14s ago 7m 463M - 18.2.4-860-g6c6b083f 8a91f241d7d4 49cdb3f4164b 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (9m) 7s ago 9m 51.0M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f b654a36a9082 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (6m) 14s ago 6m 42.7M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 0133a107f35d 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (8m) 7s ago 8m 15.6M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (7m) 14s ago 7m 16.0M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (6m) 7s ago 6m 108M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 69a9e66fb097 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (5m) 7s ago 5m 120M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 07986b4ba73b 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (5m) 7s ago 5m 98.6M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f e44cdda01aee 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (4m) 14s ago 4m 112M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:30:19.551 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (4m) 14s ago 4m 114M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:30:19.552 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (4m) 14s ago 4m 109M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:30:19.552 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (6m) 7s ago 7m 61.9M - 2.43.0 a07b618ecd1d 292b390ae245 2024-09-13T18:30:19.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.549+0000 7f1052a1a640 1 -- 172.21.15.38:0/2262878870 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f103406cde0 msgr2=0x7f103406f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:19.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.549+0000 7f1052a1a640 1 --2- 172.21.15.38:0/2262878870 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f103406cde0 0x7f103406f2a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f104c073fd0 tx=0x7f1040006c20 comp rx=0 tx=0).stop 2024-09-13T18:30:19.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.549+0000 7f1052a1a640 1 -- 172.21.15.38:0/2262878870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f104c0ffb90 msgr2=0x7f104c074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:19.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.549+0000 7f1052a1a640 1 --2- 172.21.15.38:0/2262878870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f104c0ffb90 0x7f104c074250 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f103c005610 tx=0x7f103c005640 comp rx=0 tx=0).stop 2024-09-13T18:30:19.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.549+0000 7f1052a1a640 1 -- 172.21.15.38:0/2262878870 shutdown_connections 2024-09-13T18:30:19.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.549+0000 7f1052a1a640 1 --2- 172.21.15.38:0/2262878870 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f103406cde0 0x7f103406f2a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.549+0000 7f1052a1a640 1 --2- 172.21.15.38:0/2262878870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f104c100d90 0x7f104c0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.549+0000 7f1052a1a640 1 --2- 172.21.15.38:0/2262878870 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f104c0ffb90 0x7f104c074250 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.549+0000 7f1052a1a640 1 -- 172.21.15.38:0/2262878870 >> 172.21.15.38:0/2262878870 conn(0x7f104c0fb360 msgr2=0x7f104c103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:19.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.550+0000 7f1052a1a640 1 -- 172.21.15.38:0/2262878870 shutdown_connections 2024-09-13T18:30:19.553 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.550+0000 7f1052a1a640 1 -- 172.21.15.38:0/2262878870 wait complete. 2024-09-13T18:30:19.609 INFO:tasks.workunit.client.1.smithi149.stdout:4/282: symlink df/d11/d12/d21/d22/d30/d56/l5f 0 2024-09-13T18:30:19.613 INFO:tasks.workunit.client.1.smithi149.stdout:1/298: creat d9/d10/d2a/d42/f5b x:0 0 0 2024-09-13T18:30:19.617 INFO:tasks.workunit.client.1.smithi149.stdout:0/212: mkdir d1/d2/d41 0 2024-09-13T18:30:19.618 INFO:tasks.workunit.client.1.smithi149.stdout:5/260: rmdir d3/d10/d32 39 2024-09-13T18:30:19.618 INFO:tasks.workunit.client.1.smithi149.stdout:5/261: chown d3/d10/d32/l4a 15106 1 2024-09-13T18:30:19.623 INFO:tasks.workunit.client.1.smithi149.stdout:2/253: rename db/d1b/d2f/d30/f37 to db/d1b/d2f/d30/f4f 0 2024-09-13T18:30:19.623 INFO:tasks.workunit.client.1.smithi149.stdout:2/254: creat db/d1b/d1c/d20/f50 x:0 0 0 2024-09-13T18:30:19.626 INFO:tasks.workunit.client.1.smithi149.stdout:4/283: dwrite df/d11/d12/d17/d3d/f40 [4194304,4194304] 0 2024-09-13T18:30:19.628 INFO:tasks.workunit.client.1.smithi149.stdout:1/299: rmdir d9/d10/d34/d4f 0 2024-09-13T18:30:19.628 INFO:tasks.workunit.client.1.smithi149.stdout:1/300: fsync d9/d10/f27 0 2024-09-13T18:30:19.630 INFO:tasks.workunit.client.1.smithi149.stdout:6/230: rename dc/f47 to dc/d2f/f48 0 2024-09-13T18:30:19.634 INFO:tasks.workunit.client.1.smithi149.stdout:4/284: mkdir df/d11/d12/d21/d22/d30/d41/d57/d60 0 2024-09-13T18:30:19.634 INFO:tasks.workunit.client.1.smithi149.stdout:4/285: chown df/d11/d1c/f42 2910848 1 2024-09-13T18:30:19.635 INFO:tasks.workunit.client.1.smithi149.stdout:6/231: rmdir dc/d15/d23 39 2024-09-13T18:30:19.636 INFO:tasks.workunit.client.1.smithi149.stdout:6/232: truncate dc/f37 38514 0 2024-09-13T18:30:19.636 INFO:tasks.workunit.client.1.smithi149.stdout:2/255: dread db/d1b/d1c/f3c [0,4194304] 0 2024-09-13T18:30:19.637 INFO:tasks.workunit.client.1.smithi149.stdout:2/256: write db/d1b/d1c/d20/f45 [723200,128795] 0 2024-09-13T18:30:19.637 INFO:tasks.workunit.client.1.smithi149.stdout:6/233: getdents dc/d15/d23 0 2024-09-13T18:30:19.637 INFO:tasks.workunit.client.1.smithi149.stdout:6/234: creat dc/d15/f49 x:0 0 0 2024-09-13T18:30:19.639 INFO:tasks.workunit.client.1.smithi149.stdout:2/257: rename db/d10/c40 to db/d10/c51 0 2024-09-13T18:30:19.641 INFO:tasks.workunit.client.1.smithi149.stdout:6/235: truncate dc/d15/f2b 424422 0 2024-09-13T18:30:19.641 INFO:tasks.workunit.client.1.smithi149.stdout:8/229: rmdir d2 39 2024-09-13T18:30:19.643 INFO:tasks.workunit.client.1.smithi149.stdout:2/258: creat db/d1b/d2f/f52 x:0 0 0 2024-09-13T18:30:19.644 INFO:tasks.workunit.client.1.smithi149.stdout:2/259: dread - db/d10/f4e zero size 2024-09-13T18:30:19.644 INFO:tasks.workunit.client.1.smithi149.stdout:2/260: creat db/d1b/d1c/d20/d3a/f53 x:0 0 0 2024-09-13T18:30:19.644 INFO:tasks.workunit.client.1.smithi149.stdout:2/261: dread - db/d10/d12/f43 zero size 2024-09-13T18:30:19.645 INFO:tasks.workunit.client.1.smithi149.stdout:6/236: rename dc/d15/d23/l41 to dc/d2f/l4a 0 2024-09-13T18:30:19.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.643+0000 7fa4bffff640 1 -- 172.21.15.38:0/2855648289 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4b80317d0 con 0x7fa4c8102fb0 2024-09-13T18:30:19.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.644+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2855648289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c8102fb0 msgr2=0x7fa4c81053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:19.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.644+0000 7fa4cf55d640 1 --2- 172.21.15.38:0/2855648289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c8102fb0 0x7fa4c81053a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80098b0 tx=0x7fa4b802a4f0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.644+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2855648289 shutdown_connections 2024-09-13T18:30:19.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.644+0000 7fa4cf55d640 1 --2- 172.21.15.38:0/2855648289 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c8102fb0 0x7fa4c81053a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.644+0000 7fa4cf55d640 1 --2- 172.21.15.38:0/2855648289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c8100680 0x7fa4c8102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.644+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2855648289 >> 172.21.15.38:0/2855648289 conn(0x7fa4c80fa280 msgr2=0x7fa4c80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:19.647 INFO:tasks.workunit.client.1.smithi149.stdout:8/230: creat d2/d12/d1b/f4c x:0 0 0 2024-09-13T18:30:19.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.644+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2855648289 shutdown_connections 2024-09-13T18:30:19.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.644+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2855648289 wait complete. 2024-09-13T18:30:19.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.645+0000 7fa4cf55d640 1 Processor -- start 2024-09-13T18:30:19.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.646+0000 7fa4cf55d640 1 -- start start 2024-09-13T18:30:19.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.646+0000 7fa4cf55d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c8100680 0x7fa4c819bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:19.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.646+0000 7fa4cf55d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c8102fb0 0x7fa4c819c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:19.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.646+0000 7fa4cf55d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c819c7e0 con 0x7fa4c8100680 2024-09-13T18:30:19.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.646+0000 7fa4cf55d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c819c950 con 0x7fa4c8102fb0 2024-09-13T18:30:19.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.646+0000 7fa4cd2f9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c8100680 0x7fa4c819bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:19.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.646+0000 7fa4cd2f9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c8100680 0x7fa4c819bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45416/0 (socket says 172.21.15.38:45416) 2024-09-13T18:30:19.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.646+0000 7fa4cd2f9640 1 -- 172.21.15.38:0/2905579974 learned_addr learned my addr 172.21.15.38:0/2905579974 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:19.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.647+0000 7fa4cd2f9640 1 -- 172.21.15.38:0/2905579974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c8102fb0 msgr2=0x7fa4c819c1e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:30:19.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.647+0000 7fa4cd2f9640 1 --2- 172.21.15.38:0/2905579974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c8102fb0 0x7fa4c819c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:19.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.647+0000 7fa4cd2f9640 1 -- 172.21.15.38:0/2905579974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8009560 con 0x7fa4c8100680 2024-09-13T18:30:19.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.647+0000 7fa4cd2f9640 1 --2- 172.21.15.38:0/2905579974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c8100680 0x7fa4c819bca0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000b3d0 tx=0x7fa4c000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:19.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.649+0000 7fa4be7fc640 1 -- 172.21.15.38:0/2905579974 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c0011800 con 0x7fa4c8100680 2024-09-13T18:30:19.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.649+0000 7fa4be7fc640 1 -- 172.21.15.38:0/2905579974 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa4c0011e00 con 0x7fa4c8100680 2024-09-13T18:30:19.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.649+0000 7fa4be7fc640 1 -- 172.21.15.38:0/2905579974 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c000f2e0 con 0x7fa4c8100680 2024-09-13T18:30:19.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.649+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2905579974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c81a13e0 con 0x7fa4c8100680 2024-09-13T18:30:19.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.649+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2905579974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c81a19b0 con 0x7fa4c8100680 2024-09-13T18:30:19.652 INFO:tasks.workunit.client.1.smithi149.stdout:6/237: mknod dc/d15/d23/d42/c4b 0 2024-09-13T18:30:19.652 INFO:tasks.workunit.client.1.smithi149.stdout:6/238: chown dc/l10 898 1 2024-09-13T18:30:19.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.650+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2905579974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ac005280 con 0x7fa4c8100680 2024-09-13T18:30:19.653 INFO:tasks.workunit.client.1.smithi149.stdout:1/301: dwrite d9/d10/f1d [0,4194304] 0 2024-09-13T18:30:19.654 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.652+0000 7fa4be7fc640 1 -- 172.21.15.38:0/2905579974 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fa4c0011960 con 0x7fa4c8100680 2024-09-13T18:30:19.655 INFO:tasks.workunit.client.1.smithi149.stdout:3/279: truncate d1/d2e/f37 3656038 0 2024-09-13T18:30:19.655 INFO:tasks.workunit.client.1.smithi149.stdout:3/280: fdatasync d1/f24 0 2024-09-13T18:30:19.655 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.653+0000 7fa4be7fc640 1 --2- 172.21.15.38:0/2905579974 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fa4b406ce20 0x7fa4b406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:19.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.653+0000 7fa4be7fc640 1 -- 172.21.15.38:0/2905579974 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fa4c008bf60 con 0x7fa4c8100680 2024-09-13T18:30:19.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.654+0000 7fa4ccaf8640 1 --2- 172.21.15.38:0/2905579974 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fa4b406ce20 0x7fa4b406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:19.656 INFO:tasks.workunit.client.1.smithi149.stdout:6/239: write dc/d15/f21 [1612261,22701] 0 2024-09-13T18:30:19.656 INFO:tasks.workunit.client.1.smithi149.stdout:6/240: stat dc/f3f 0 2024-09-13T18:30:19.657 INFO:tasks.workunit.client.1.smithi149.stdout:2/262: dread db/d1b/d1c/d20/d3a/f3f [0,4194304] 0 2024-09-13T18:30:19.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.655+0000 7fa4ccaf8640 1 --2- 172.21.15.38:0/2905579974 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fa4b406ce20 0x7fa4b406f2e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009230 tx=0x7fa4b8000bc0 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:19.658 INFO:tasks.workunit.client.1.smithi149.stdout:3/281: creat d1/d4/d39/f5d x:0 0 0 2024-09-13T18:30:19.658 INFO:tasks.workunit.client.1.smithi149.stdout:3/282: write d1/d2e/f14 [3228984,53833] 0 2024-09-13T18:30:19.660 INFO:tasks.workunit.client.1.smithi149.stdout:6/241: write dc/d15/f35 [112264,27839] 0 2024-09-13T18:30:19.660 INFO:tasks.workunit.client.1.smithi149.stdout:6/242: chown dc/d15/f21 462662196 1 2024-09-13T18:30:19.660 INFO:tasks.workunit.client.1.smithi149.stdout:2/263: mkdir db/d54 0 2024-09-13T18:30:19.660 INFO:tasks.workunit.client.1.smithi149.stdout:2/264: creat db/d10/f55 x:0 0 0 2024-09-13T18:30:19.661 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:19.658+0000 7fa4be7fc640 1 -- 172.21.15.38:0/2905579974 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa4c00bfe20 con 0x7fa4c8100680 2024-09-13T18:30:19.662 INFO:tasks.workunit.client.1.smithi149.stdout:3/283: rename d1/d4/d39/l3e to d1/d12/l5e 0 2024-09-13T18:30:19.662 INFO:tasks.workunit.client.1.smithi149.stdout:4/286: dwrite df/d11/d12/d17/d3d/f5d [0,4194304] 0 2024-09-13T18:30:19.665 INFO:tasks.workunit.client.1.smithi149.stdout:2/265: creat db/d1b/d48/f56 x:0 0 0 2024-09-13T18:30:19.666 INFO:tasks.workunit.client.1.smithi149.stdout:8/231: dread d2/d13/f29 [0,4194304] 0 2024-09-13T18:30:19.666 INFO:tasks.workunit.client.1.smithi149.stdout:8/232: write d2/d12/f3f [637131,102105] 0 2024-09-13T18:30:19.669 INFO:tasks.workunit.client.1.smithi149.stdout:4/287: creat df/d11/f61 x:0 0 0 2024-09-13T18:30:19.669 INFO:tasks.workunit.client.1.smithi149.stdout:4/288: creat df/d11/d12/d21/d22/f62 x:0 0 0 2024-09-13T18:30:19.670 INFO:tasks.workunit.client.1.smithi149.stdout:6/243: rmdir dc/d2f 39 2024-09-13T18:30:19.671 INFO:tasks.workunit.client.1.smithi149.stdout:2/266: creat db/d1b/d1c/d20/d2b/f57 x:0 0 0 2024-09-13T18:30:19.672 INFO:tasks.workunit.client.1.smithi149.stdout:8/233: mkdir d2/d12/d2a/d4d 0 2024-09-13T18:30:19.674 INFO:tasks.workunit.client.1.smithi149.stdout:3/284: dread d1/f19 [0,4194304] 0 2024-09-13T18:30:19.674 INFO:tasks.workunit.client.1.smithi149.stdout:4/289: symlink df/d11/d12/d21/d22/d30/d56/l63 0 2024-09-13T18:30:19.675 INFO:tasks.workunit.client.1.smithi149.stdout:7/302: sync 2024-09-13T18:30:19.675 INFO:tasks.workunit.client.1.smithi149.stdout:9/203: sync 2024-09-13T18:30:19.677 INFO:tasks.workunit.client.1.smithi149.stdout:6/244: rename dc/d2f/f32 to dc/d15/d23/f4c 0 2024-09-13T18:30:19.679 INFO:tasks.workunit.client.1.smithi149.stdout:2/267: symlink db/d1b/l58 0 2024-09-13T18:30:19.679 INFO:tasks.workunit.client.1.smithi149.stdout:6/245: write f5 [4305031,45370] 0 2024-09-13T18:30:19.679 INFO:tasks.workunit.client.1.smithi149.stdout:6/246: read - dc/f3f zero size 2024-09-13T18:30:19.679 INFO:tasks.workunit.client.1.smithi149.stdout:6/247: write dc/d15/d23/f3e [573774,88326] 0 2024-09-13T18:30:19.679 INFO:tasks.workunit.client.1.smithi149.stdout:6/248: chown dc/d15/d23/d42/c4b 1 1 2024-09-13T18:30:19.679 INFO:tasks.workunit.client.1.smithi149.stdout:6/249: readlink lb 0 2024-09-13T18:30:19.679 INFO:tasks.workunit.client.1.smithi149.stdout:1/302: dwrite d9/d10/d2a/f31 [0,4194304] 0 2024-09-13T18:30:19.680 INFO:tasks.workunit.client.1.smithi149.stdout:8/234: symlink d2/d12/l4e 0 2024-09-13T18:30:19.680 INFO:tasks.workunit.client.1.smithi149.stdout:4/290: mknod df/d11/d12/d21/d22/d30/d41/d57/c64 0 2024-09-13T18:30:19.682 INFO:tasks.workunit.client.1.smithi149.stdout:7/303: link d7/d9/d11/l5e d7/d9/d1c/d34/d4e/l69 0 2024-09-13T18:30:19.682 INFO:tasks.workunit.client.1.smithi149.stdout:7/304: fsync d7/f8 0 2024-09-13T18:30:19.682 INFO:tasks.workunit.client.1.smithi149.stdout:7/305: chown d7/d9/d1c/d1f/d21/f4b 33 1 2024-09-13T18:30:19.683 INFO:tasks.workunit.client.1.smithi149.stdout:9/204: creat d0/d2e/f43 x:0 0 0 2024-09-13T18:30:19.689 INFO:tasks.workunit.client.1.smithi149.stdout:7/306: dread d7/d9/d1c/f29 [0,4194304] 0 2024-09-13T18:30:19.690 INFO:tasks.workunit.client.1.smithi149.stdout:7/307: fsync d7/d9/d1c/d1f/d21/f4b 0 2024-09-13T18:30:19.690 INFO:tasks.workunit.client.1.smithi149.stdout:7/308: write d7/f8 [1925484,44079] 0 2024-09-13T18:30:19.690 INFO:tasks.workunit.client.1.smithi149.stdout:7/309: write d7/d9/d1c/d2f/d31/f3f [471429,26324] 0 2024-09-13T18:30:19.690 INFO:tasks.workunit.client.1.smithi149.stdout:7/310: creat d7/d9/d1c/f6a x:0 0 0 2024-09-13T18:30:19.690 INFO:tasks.workunit.client.1.smithi149.stdout:7/311: creat d7/f6b x:0 0 0 2024-09-13T18:30:19.690 INFO:tasks.workunit.client.1.smithi149.stdout:7/312: creat d7/d9/d1c/d2f/d31/f6c x:0 0 0 2024-09-13T18:30:19.690 INFO:tasks.workunit.client.1.smithi149.stdout:4/291: rename df/d11/d1c/f4f to df/d11/d1c/f65 0 2024-09-13T18:30:19.691 INFO:tasks.workunit.client.1.smithi149.stdout:8/235: creat d2/d13/d3a/f4f x:0 0 0 2024-09-13T18:30:19.695 INFO:tasks.workunit.client.1.smithi149.stdout:1/303: write d9/d10/f1a [802390,69522] 0 2024-09-13T18:30:19.700 INFO:tasks.workunit.client.1.smithi149.stdout:1/304: symlink d9/d10/l5c 0 2024-09-13T18:30:19.700 INFO:tasks.workunit.client.1.smithi149.stdout:1/305: write d9/d10/d37/d38/f4e [5166244,62418] 0 2024-09-13T18:30:19.700 INFO:tasks.workunit.client.1.smithi149.stdout:1/306: truncate d9/d15/f29 4270493 0 2024-09-13T18:30:19.704 INFO:tasks.workunit.client.1.smithi149.stdout:4/292: link df/d11/d12/d21/d22/d30/d41/d57/l59 df/d11/l66 0 2024-09-13T18:30:19.704 INFO:tasks.workunit.client.1.smithi149.stdout:9/205: rmdir d0/d18/d19/d37 0 2024-09-13T18:30:19.708 INFO:tasks.workunit.client.1.smithi149.stdout:6/250: dwrite dc/d15/f49 [0,4194304] 0 2024-09-13T18:30:19.716 INFO:tasks.workunit.client.1.smithi149.stdout:2/268: dwrite db/d1b/d1c/d20/d3a/f3f [0,4194304] 0 2024-09-13T18:30:19.718 INFO:tasks.workunit.client.1.smithi149.stdout:2/269: symlink db/l59 0 2024-09-13T18:30:19.719 INFO:tasks.workunit.client.1.smithi149.stdout:2/270: symlink db/d1b/d1c/d20/d49/l5a 0 2024-09-13T18:30:19.721 INFO:tasks.workunit.client.1.smithi149.stdout:7/313: dwrite d7/d9/d1c/d34/f5d [0,4194304] 0 2024-09-13T18:30:19.724 INFO:tasks.workunit.client.1.smithi149.stdout:7/314: link d7/d9/d1c/d34/d4e/l63 d7/d12/l6d 0 2024-09-13T18:30:19.728 INFO:tasks.workunit.client.1.smithi149.stdout:7/315: rename d7/f3c to d7/d9/d1c/d1f/d3d/f6e 0 2024-09-13T18:30:19.730 INFO:tasks.workunit.client.1.smithi149.stdout:2/271: write db/d13/f18 [1263137,106173] 0 2024-09-13T18:30:19.730 INFO:tasks.workunit.client.1.smithi149.stdout:2/272: chown db/d1b/d1c/d20/d2b/d3e/l4d 9643458 1 2024-09-13T18:30:19.730 INFO:tasks.workunit.client.1.smithi149.stdout:7/316: unlink d7/d9/d1c/d2f/d31/f6c 0 2024-09-13T18:30:19.730 INFO:tasks.workunit.client.1.smithi149.stdout:7/317: chown d7/d9/d1c/d1f/d21/d49/c54 6741 1 2024-09-13T18:30:19.730 INFO:tasks.workunit.client.1.smithi149.stdout:7/318: write d7/ff [262529,43470] 0 2024-09-13T18:30:19.731 INFO:tasks.workunit.client.1.smithi149.stdout:2/273: link f1 db/d1b/d1c/f5b 0 2024-09-13T18:30:19.733 INFO:tasks.workunit.client.1.smithi149.stdout:2/274: creat db/d1b/d1c/d20/d3a/d28/f5c x:0 0 0 2024-09-13T18:30:19.734 INFO:tasks.workunit.client.1.smithi149.stdout:9/206: dwrite d0/d33/f34 [0,4194304] 0 2024-09-13T18:30:19.734 INFO:tasks.workunit.client.1.smithi149.stdout:9/207: truncate d0/d18/d27/f3e 248625 0 2024-09-13T18:30:19.734 INFO:tasks.workunit.client.1.smithi149.stdout:2/275: read db/d1b/f33 [1356570,125960] 0 2024-09-13T18:30:19.734 INFO:tasks.workunit.client.1.smithi149.stdout:8/236: dwrite d2/d13/f17 [4194304,4194304] 0 2024-09-13T18:30:19.735 INFO:tasks.workunit.client.1.smithi149.stdout:8/237: chown d2/fc 2768846 1 2024-09-13T18:30:19.735 INFO:tasks.workunit.client.1.smithi149.stdout:1/307: dwrite f2 [0,4194304] 0 2024-09-13T18:30:19.735 INFO:tasks.workunit.client.1.smithi149.stdout:6/251: fdatasync f5 0 2024-09-13T18:30:19.737 INFO:tasks.workunit.client.1.smithi149.stdout:9/208: truncate d0/f38 7221238 0 2024-09-13T18:30:19.739 INFO:tasks.workunit.client.1.smithi149.stdout:2/276: mkdir db/d1b/d1c/d20/d3a/d5d 0 2024-09-13T18:30:19.739 INFO:tasks.workunit.client.1.smithi149.stdout:2/277: dread - db/d1b/d48/f56 zero size 2024-09-13T18:30:19.740 INFO:tasks.workunit.client.1.smithi149.stdout:8/238: creat d2/d13/f50 x:0 0 0 2024-09-13T18:30:19.741 INFO:tasks.workunit.client.1.smithi149.stdout:8/239: write d2/d13/d3a/f4f [962765,119732] 0 2024-09-13T18:30:19.742 INFO:tasks.workunit.client.1.smithi149.stdout:1/308: truncate d9/d10/f1a 1946939 0 2024-09-13T18:30:19.744 INFO:tasks.workunit.client.1.smithi149.stdout:8/240: dread d2/d12/f3f [0,4194304] 0 2024-09-13T18:30:19.744 INFO:tasks.workunit.client.1.smithi149.stdout:8/241: creat d2/d12/d1b/f51 x:0 0 0 2024-09-13T18:30:19.745 INFO:tasks.workunit.client.1.smithi149.stdout:7/319: rename d7/d9/d40 to d7/d9/d1c/d2f/d6f 0 2024-09-13T18:30:19.750 INFO:tasks.workunit.client.1.smithi149.stdout:8/242: mkdir d2/d52 0 2024-09-13T18:30:19.750 INFO:tasks.workunit.client.1.smithi149.stdout:7/320: symlink d7/d9/d1c/d51/l70 0 2024-09-13T18:30:19.751 INFO:tasks.workunit.client.1.smithi149.stdout:7/321: fdatasync d7/d9/d11/f1a 0 2024-09-13T18:30:19.752 INFO:tasks.workunit.client.1.smithi149.stdout:9/209: link d0/cc d0/d18/d27/c44 0 2024-09-13T18:30:19.752 INFO:tasks.workunit.client.1.smithi149.stdout:9/210: stat d0/d18/d19 0 2024-09-13T18:30:19.761 INFO:tasks.workunit.client.1.smithi149.stdout:1/309: read f2 [3727496,516] 0 2024-09-13T18:30:19.761 INFO:tasks.workunit.client.1.smithi149.stdout:1/310: write d9/d10/f27 [1967122,121026] 0 2024-09-13T18:30:19.761 INFO:tasks.workunit.client.1.smithi149.stdout:1/311: read d9/d10/f1d [5241103,34474] 0 2024-09-13T18:30:19.764 INFO:tasks.workunit.client.1.smithi149.stdout:6/252: dwrite dc/d15/f49 [0,4194304] 0 2024-09-13T18:30:19.764 INFO:tasks.workunit.client.1.smithi149.stdout:6/253: creat dc/d15/f4d x:0 0 0 2024-09-13T18:30:19.766 INFO:tasks.workunit.client.1.smithi149.stdout:2/278: dwrite db/d1b/d1c/d20/f50 [0,4194304] 0 2024-09-13T18:30:19.766 INFO:tasks.workunit.client.1.smithi149.stdout:2/279: write db/d1b/d1c/f1f [1024101,71548] 0 2024-09-13T18:30:19.767 INFO:tasks.workunit.client.1.smithi149.stdout:2/280: chown db/d10/f1a 2405944 1 2024-09-13T18:30:19.767 INFO:tasks.workunit.client.1.smithi149.stdout:6/254: unlink dc/l25 0 2024-09-13T18:30:19.767 INFO:tasks.workunit.client.1.smithi149.stdout:8/243: write d2/d12/f16 [3589195,111998] 0 2024-09-13T18:30:19.767 INFO:tasks.workunit.client.1.smithi149.stdout:8/244: getdents d2/d52 0 2024-09-13T18:30:19.772 INFO:tasks.workunit.client.1.smithi149.stdout:6/255: rename dc/ld to dc/l4e 0 2024-09-13T18:30:19.772 INFO:tasks.workunit.client.1.smithi149.stdout:6/256: fdatasync f5 0 2024-09-13T18:30:19.772 INFO:tasks.workunit.client.1.smithi149.stdout:6/257: stat f8 0 2024-09-13T18:30:19.772 INFO:tasks.workunit.client.1.smithi149.stdout:6/258: dread - dc/d15/f44 zero size 2024-09-13T18:30:19.772 INFO:tasks.workunit.client.1.smithi149.stdout:6/259: write dc/d15/d23/f39 [4414895,115151] 0 2024-09-13T18:30:19.772 INFO:tasks.workunit.client.1.smithi149.stdout:6/260: truncate dc/f3f 83571 0 2024-09-13T18:30:19.772 INFO:tasks.workunit.client.1.smithi149.stdout:6/261: write dc/d15/f4d [989305,93367] 0 2024-09-13T18:30:19.772 INFO:tasks.workunit.client.1.smithi149.stdout:6/262: write dc/d15/f2b [1068195,8634] 0 2024-09-13T18:30:19.772 INFO:tasks.workunit.client.1.smithi149.stdout:6/263: chown dc/d2f/l4a 0 1 2024-09-13T18:30:19.773 INFO:tasks.workunit.client.1.smithi149.stdout:2/281: getdents db/d1b/d1c/d20/d3a/d28 0 2024-09-13T18:30:19.773 INFO:tasks.workunit.client.1.smithi149.stdout:2/282: chown db/d13/f4a 8 1 2024-09-13T18:30:19.774 INFO:tasks.workunit.client.1.smithi149.stdout:7/322: dwrite d7/d9/d11/f42 [0,4194304] 0 2024-09-13T18:30:19.774 INFO:tasks.workunit.client.1.smithi149.stdout:6/264: mknod dc/d15/d23/c4f 0 2024-09-13T18:30:19.776 INFO:tasks.workunit.client.1.smithi149.stdout:2/283: symlink db/d1b/d1c/l5e 0 2024-09-13T18:30:19.779 INFO:tasks.workunit.client.1.smithi149.stdout:7/323: mkdir d7/d9/d1b/d71 0 2024-09-13T18:30:19.779 INFO:tasks.workunit.client.1.smithi149.stdout:7/324: readlink d7/d9/d1c/d34/l48 0 2024-09-13T18:30:19.779 INFO:tasks.workunit.client.1.smithi149.stdout:7/325: write d7/d9/d1c/d1f/d3d/f6e [1456630,98792] 0 2024-09-13T18:30:19.779 INFO:tasks.workunit.client.1.smithi149.stdout:7/326: write d7/f22 [2321781,99067] 0 2024-09-13T18:30:19.787 INFO:tasks.workunit.client.1.smithi149.stdout:8/245: dread d2/d12/f16 [0,4194304] 0 2024-09-13T18:30:19.788 INFO:tasks.workunit.client.1.smithi149.stdout:6/265: truncate dc/d15/f35 986907 0 2024-09-13T18:30:19.788 INFO:tasks.workunit.client.1.smithi149.stdout:6/266: dread - dc/d15/f44 zero size 2024-09-13T18:30:19.790 INFO:tasks.workunit.client.1.smithi149.stdout:2/284: rmdir db/d1b/d1c/d20/d3a/d5d 0 2024-09-13T18:30:19.790 INFO:tasks.workunit.client.1.smithi149.stdout:2/285: chown db/d1b/d2f/d30/f4f 690 1 2024-09-13T18:30:19.791 INFO:tasks.workunit.client.1.smithi149.stdout:6/267: mknod dc/d2f/c50 0 2024-09-13T18:30:19.791 INFO:tasks.workunit.client.1.smithi149.stdout:6/268: creat dc/f51 x:0 0 0 2024-09-13T18:30:19.792 INFO:tasks.workunit.client.1.smithi149.stdout:2/286: mknod db/d1b/d1c/d20/d2b/c5f 0 2024-09-13T18:30:19.794 INFO:tasks.workunit.client.1.smithi149.stdout:1/312: dwrite d9/d10/d34/f51 [0,4194304] 0 2024-09-13T18:30:19.794 INFO:tasks.workunit.client.1.smithi149.stdout:9/211: dwrite d0/d33/f34 [0,4194304] 0 2024-09-13T18:30:19.794 INFO:tasks.workunit.client.1.smithi149.stdout:1/313: write d9/d10/f1a [1785741,118223] 0 2024-09-13T18:30:19.794 INFO:tasks.workunit.client.1.smithi149.stdout:2/287: symlink db/d1b/d1c/d20/d3a/l60 0 2024-09-13T18:30:19.802 INFO:tasks.workunit.client.1.smithi149.stdout:8/246: write d2/d12/f39 [2244016,6458] 0 2024-09-13T18:30:19.804 INFO:tasks.workunit.client.1.smithi149.stdout:8/247: mknod d2/c53 0 2024-09-13T18:30:19.804 INFO:tasks.workunit.client.1.smithi149.stdout:8/248: stat d2/f9 0 2024-09-13T18:30:19.804 INFO:tasks.workunit.client.1.smithi149.stdout:8/249: dread - d2/d12/f46 zero size 2024-09-13T18:30:19.812 INFO:tasks.workunit.client.1.smithi149.stdout:1/314: truncate d9/d15/f29 873557 0 2024-09-13T18:30:19.814 INFO:tasks.workunit.client.1.smithi149.stdout:1/315: symlink d9/d10/d43/l5d 0 2024-09-13T18:30:19.814 INFO:tasks.workunit.client.1.smithi149.stdout:1/316: write f3 [610263,60108] 0 2024-09-13T18:30:19.816 INFO:tasks.workunit.client.1.smithi149.stdout:1/317: creat d9/d15/f5e x:0 0 0 2024-09-13T18:30:19.817 INFO:tasks.workunit.client.1.smithi149.stdout:1/318: creat d9/d10/d34/d53/f5f x:0 0 0 2024-09-13T18:30:19.817 INFO:tasks.workunit.client.1.smithi149.stdout:1/319: truncate d9/d10/d2a/d42/f5b 136686 0 2024-09-13T18:30:19.817 INFO:tasks.workunit.client.1.smithi149.stdout:1/320: fsync d9/d15/d25/f32 0 2024-09-13T18:30:19.818 INFO:tasks.workunit.client.1.smithi149.stdout:1/321: mkdir d9/d15/d60 0 2024-09-13T18:30:19.819 INFO:tasks.workunit.client.1.smithi149.stdout:1/322: creat d9/d58/f61 x:0 0 0 2024-09-13T18:30:19.820 INFO:tasks.workunit.client.1.smithi149.stdout:6/269: dwrite dc/f37 [0,4194304] 0 2024-09-13T18:30:19.820 INFO:tasks.workunit.client.1.smithi149.stdout:6/270: chown dc/f22 1 1 2024-09-13T18:30:19.820 INFO:tasks.workunit.client.1.smithi149.stdout:9/212: dwrite d0/d18/d19/d3b/f3d [0,4194304] 0 2024-09-13T18:30:19.820 INFO:tasks.workunit.client.1.smithi149.stdout:9/213: stat d0/d18/d19 0 2024-09-13T18:30:19.820 INFO:tasks.workunit.client.1.smithi149.stdout:9/214: write d0/d33/f34 [5168738,34015] 0 2024-09-13T18:30:19.820 INFO:tasks.workunit.client.1.smithi149.stdout:9/215: stat d0/f2a 0 2024-09-13T18:30:19.826 INFO:tasks.workunit.client.1.smithi149.stdout:9/216: link d0/d18/d19/l1c d0/d18/d19/l45 0 2024-09-13T18:30:19.829 INFO:tasks.workunit.client.1.smithi149.stdout:5/262: sync 2024-09-13T18:30:19.829 INFO:tasks.workunit.client.1.smithi149.stdout:0/213: sync 2024-09-13T18:30:19.829 INFO:tasks.workunit.client.1.smithi149.stdout:5/263: write d3/d8/d13/f22 [5017067,51906] 0 2024-09-13T18:30:19.831 INFO:tasks.workunit.client.1.smithi149.stdout:6/271: write f8 [4088895,106003] 0 2024-09-13T18:30:19.832 INFO:tasks.workunit.client.1.smithi149.stdout:1/323: dread d9/d15/f29 [0,4194304] 0 2024-09-13T18:30:19.832 INFO:tasks.workunit.client.1.smithi149.stdout:5/264: getdents d3 0 2024-09-13T18:30:19.835 INFO:tasks.workunit.client.1.smithi149.stdout:1/324: mkdir d9/d10/d62 0 2024-09-13T18:30:19.835 INFO:tasks.workunit.client.1.smithi149.stdout:6/272: dread dc/d15/f2b [0,4194304] 0 2024-09-13T18:30:19.837 INFO:tasks.workunit.client.1.smithi149.stdout:0/214: write d1/f5 [3919163,96764] 0 2024-09-13T18:30:19.837 INFO:tasks.workunit.client.1.smithi149.stdout:0/215: creat d1/f42 x:0 0 0 2024-09-13T18:30:19.837 INFO:tasks.workunit.client.1.smithi149.stdout:5/265: unlink d3/d8/f3f 0 2024-09-13T18:30:19.837 INFO:tasks.workunit.client.1.smithi149.stdout:5/266: read - d3/d8/d13/f46 zero size 2024-09-13T18:30:19.839 INFO:tasks.workunit.client.1.smithi149.stdout:6/273: creat dc/d15/d23/d42/f52 x:0 0 0 2024-09-13T18:30:19.843 INFO:tasks.workunit.client.1.smithi149.stdout:0/216: unlink d1/d29/d31/c32 0 2024-09-13T18:30:19.846 INFO:tasks.workunit.client.1.smithi149.stdout:5/267: mknod d3/d10/c4d 0 2024-09-13T18:30:19.846 INFO:tasks.workunit.client.1.smithi149.stdout:5/268: chown d3/d8/l3e 174422563 1 2024-09-13T18:30:19.846 INFO:tasks.workunit.client.1.smithi149.stdout:5/269: write d3/d8/d13/f22 [5338540,128675] 0 2024-09-13T18:30:19.848 INFO:tasks.workunit.client.1.smithi149.stdout:9/217: dwrite d0/f22 [0,4194304] 0 2024-09-13T18:30:19.848 INFO:tasks.workunit.client.1.smithi149.stdout:9/218: readlink d0/d18/d19/l45 0 2024-09-13T18:30:19.848 INFO:tasks.workunit.client.1.smithi149.stdout:9/219: dread - d0/f3c zero size 2024-09-13T18:30:19.849 INFO:tasks.workunit.client.1.smithi149.stdout:5/270: unlink d3/d10/d32/f3a 0 2024-09-13T18:30:19.851 INFO:tasks.workunit.client.1.smithi149.stdout:5/271: mkdir d3/d10/d4c/d4e 0 2024-09-13T18:30:19.852 INFO:tasks.workunit.client.1.smithi149.stdout:9/220: symlink d0/d18/d27/l46 0 2024-09-13T18:30:19.854 INFO:tasks.workunit.client.1.smithi149.stdout:5/272: link d3/d8/d13/f22 d3/f4f 0 2024-09-13T18:30:19.854 INFO:tasks.workunit.client.1.smithi149.stdout:5/273: chown d3/d8/d13/d42/c2f 56332 1 2024-09-13T18:30:19.854 INFO:tasks.workunit.client.1.smithi149.stdout:9/221: dread d0/f9 [0,4194304] 0 2024-09-13T18:30:19.855 INFO:tasks.workunit.client.1.smithi149.stdout:5/274: write d3/d10/d32/f2e [161063,67458] 0 2024-09-13T18:30:19.857 INFO:tasks.workunit.client.1.smithi149.stdout:6/274: rmdir dc/d15/d23/d42 39 2024-09-13T18:30:19.857 INFO:tasks.workunit.client.1.smithi149.stdout:1/325: dwrite d9/d15/f47 [0,4194304] 0 2024-09-13T18:30:19.858 INFO:tasks.workunit.client.1.smithi149.stdout:5/275: dread d3/d8/f1e [0,4194304] 0 2024-09-13T18:30:19.858 INFO:tasks.workunit.client.1.smithi149.stdout:6/275: unlink dc/d15/f49 0 2024-09-13T18:30:19.861 INFO:tasks.workunit.client.1.smithi149.stdout:1/326: mknod d9/d10/d37/d38/c63 0 2024-09-13T18:30:19.862 INFO:tasks.workunit.client.1.smithi149.stdout:5/276: creat d3/d10/d4c/d4e/f50 x:0 0 0 2024-09-13T18:30:19.862 INFO:tasks.workunit.client.1.smithi149.stdout:1/327: creat d9/d10/d34/d53/d57/f64 x:0 0 0 2024-09-13T18:30:19.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/277: mknod d3/d8/d13/d42/c51 0 2024-09-13T18:30:19.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/278: fdatasync d3/d8/f1e 0 2024-09-13T18:30:19.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/279: write d3/d10/d4c/d4e/f50 [574925,53145] 0 2024-09-13T18:30:19.866 INFO:tasks.workunit.client.1.smithi149.stdout:6/276: dread f9 [0,4194304] 0 2024-09-13T18:30:19.874 INFO:tasks.workunit.client.1.smithi149.stdout:1/328: dread d9/d15/d25/f32 [4194304,4194304] 0 2024-09-13T18:30:19.874 INFO:tasks.workunit.client.1.smithi149.stdout:1/329: chown d9/d15/c46 124 1 2024-09-13T18:30:19.874 INFO:tasks.workunit.client.1.smithi149.stdout:1/330: creat d9/d10/d34/d53/d57/f65 x:0 0 0 2024-09-13T18:30:19.878 INFO:tasks.workunit.client.1.smithi149.stdout:9/222: dread d0/d18/d19/f23 [0,4194304] 0 2024-09-13T18:30:19.879 INFO:tasks.workunit.client.1.smithi149.stdout:0/217: dwrite d1/d29/d31/f39 [4194304,4194304] 0 2024-09-13T18:30:19.882 INFO:tasks.workunit.client.1.smithi149.stdout:0/218: symlink d1/d29/d31/d3e/d3f/l43 0 2024-09-13T18:30:19.882 INFO:tasks.workunit.client.1.smithi149.stdout:0/219: fsync d1/d1b/f3d 0 2024-09-13T18:30:19.882 INFO:tasks.workunit.client.1.smithi149.stdout:0/220: truncate d1/f42 533773 0 2024-09-13T18:30:19.882 INFO:tasks.workunit.client.1.smithi149.stdout:0/221: getdents d1/d2/d41 0 2024-09-13T18:30:19.882 INFO:tasks.workunit.client.1.smithi149.stdout:0/222: chown d1/f1a 1700747 1 2024-09-13T18:30:19.882 INFO:tasks.workunit.client.1.smithi149.stdout:0/223: write d1/d1b/f3d [209509,31590] 0 2024-09-13T18:30:19.883 INFO:tasks.workunit.client.1.smithi149.stdout:0/224: rmdir d1/d1b 39 2024-09-13T18:30:19.884 INFO:tasks.workunit.client.1.smithi149.stdout:0/225: mkdir d1/d29/d31/d44 0 2024-09-13T18:30:19.890 INFO:tasks.workunit.client.1.smithi149.stdout:9/223: write d0/f22 [1591428,118729] 0 2024-09-13T18:30:19.895 INFO:tasks.workunit.client.1.smithi149.stdout:5/280: dwrite d3/d10/d32/f40 [0,4194304] 0 2024-09-13T18:30:19.895 INFO:tasks.workunit.client.1.smithi149.stdout:5/281: creat d3/d8/d13/f52 x:0 0 0 2024-09-13T18:30:19.896 INFO:tasks.workunit.client.1.smithi149.stdout:5/282: symlink d3/d10/d32/l53 0 2024-09-13T18:30:19.902 INFO:tasks.workunit.client.1.smithi149.stdout:6/277: dwrite dc/d15/f35 [0,4194304] 0 2024-09-13T18:30:19.902 INFO:tasks.workunit.client.1.smithi149.stdout:1/331: dwrite d9/d15/f5e [0,4194304] 0 2024-09-13T18:30:19.938 INFO:tasks.workunit.client.1.smithi149.stdout:6/278: dwrite dc/d15/d23/f4c [4194304,4194304] 0 2024-09-13T18:30:19.939 INFO:tasks.workunit.client.1.smithi149.stdout:1/332: mknod d9/d15/d60/c66 0 2024-09-13T18:30:19.939 INFO:tasks.workunit.client.1.smithi149.stdout:1/333: dread - d9/d10/d34/d53/d57/f65 zero size 2024-09-13T18:30:19.941 INFO:tasks.workunit.client.1.smithi149.stdout:1/334: unlink d9/d10/f1d 0 2024-09-13T18:30:19.943 INFO:tasks.workunit.client.1.smithi149.stdout:1/335: creat d9/d10/d3f/f67 x:0 0 0 2024-09-13T18:30:19.943 INFO:tasks.workunit.client.1.smithi149.stdout:1/336: creat d9/d10/d34/d53/d57/f68 x:0 0 0 2024-09-13T18:30:19.944 INFO:tasks.workunit.client.1.smithi149.stdout:5/283: rename d3/d8/d13/d42 to d3/d10/d32/d54 0 2024-09-13T18:30:19.947 INFO:tasks.workunit.client.1.smithi149.stdout:1/337: creat d9/d15/d40/d4a/f69 x:0 0 0 2024-09-13T18:30:19.949 INFO:tasks.workunit.client.1.smithi149.stdout:6/279: rename dc/d2f/f34 to dc/f53 0 2024-09-13T18:30:19.949 INFO:tasks.workunit.client.1.smithi149.stdout:6/280: stat dc/d15/d23/f40 0 2024-09-13T18:30:19.949 INFO:tasks.workunit.client.1.smithi149.stdout:6/281: fdatasync dc/d15/f4d 0 2024-09-13T18:30:19.949 INFO:tasks.workunit.client.1.smithi149.stdout:4/293: sync 2024-09-13T18:30:19.949 INFO:tasks.workunit.client.1.smithi149.stdout:7/327: sync 2024-09-13T18:30:19.949 INFO:tasks.workunit.client.1.smithi149.stdout:3/285: sync 2024-09-13T18:30:19.950 INFO:tasks.workunit.client.1.smithi149.stdout:6/282: write dc/d15/f44 [609210,124751] 0 2024-09-13T18:30:19.950 INFO:tasks.workunit.client.1.smithi149.stdout:5/284: symlink d3/d10/d4c/l55 0 2024-09-13T18:30:19.952 INFO:tasks.workunit.client.1.smithi149.stdout:4/294: creat df/d11/d1c/f67 x:0 0 0 2024-09-13T18:30:19.954 INFO:tasks.workunit.client.1.smithi149.stdout:5/285: symlink d3/d8/l56 0 2024-09-13T18:30:19.954 INFO:tasks.workunit.client.1.smithi149.stdout:5/286: read - d3/d8/d13/f46 zero size 2024-09-13T18:30:19.954 INFO:tasks.workunit.client.1.smithi149.stdout:5/287: truncate d3/d8/d13/f22 5911485 0 2024-09-13T18:30:19.956 INFO:tasks.workunit.client.1.smithi149.stdout:4/295: link l3 df/d11/d1c/l68 0 2024-09-13T18:30:19.957 INFO:tasks.workunit.client.1.smithi149.stdout:5/288: truncate d3/d10/d32/f40 2133315 0 2024-09-13T18:30:19.961 INFO:tasks.workunit.client.1.smithi149.stdout:5/289: link d3/d10/c19 d3/d10/d4c/c57 0 2024-09-13T18:30:19.961 INFO:tasks.workunit.client.1.smithi149.stdout:5/290: fdatasync d3/d10/d32/f45 0 2024-09-13T18:30:19.962 INFO:tasks.workunit.client.1.smithi149.stdout:1/338: getdents d9/d15/d60 0 2024-09-13T18:30:19.962 INFO:tasks.workunit.client.1.smithi149.stdout:1/339: fdatasync d9/d15/d40/d4a/f69 0 2024-09-13T18:30:19.963 INFO:tasks.workunit.client.1.smithi149.stdout:4/296: dread df/d11/f16 [0,4194304] 0 2024-09-13T18:30:19.963 INFO:tasks.workunit.client.1.smithi149.stdout:1/340: unlink d9/d10/d34/c41 0 2024-09-13T18:30:19.963 INFO:tasks.workunit.client.1.smithi149.stdout:1/341: stat d9/d15/c46 0 2024-09-13T18:30:19.964 INFO:tasks.workunit.client.1.smithi149.stdout:1/342: creat d9/d10/d2a/d42/f6a x:0 0 0 2024-09-13T18:30:19.964 INFO:tasks.workunit.client.1.smithi149.stdout:8/250: sync 2024-09-13T18:30:19.965 INFO:tasks.workunit.client.1.smithi149.stdout:2/288: sync 2024-09-13T18:30:19.965 INFO:tasks.workunit.client.1.smithi149.stdout:8/251: write d2/d13/f17 [8619106,1222] 0 2024-09-13T18:30:19.965 INFO:tasks.workunit.client.1.smithi149.stdout:8/252: write d2/fe [1768301,84348] 0 2024-09-13T18:30:19.965 INFO:tasks.workunit.client.1.smithi149.stdout:4/297: mkdir df/d11/d1c/d69 0 2024-09-13T18:30:19.968 INFO:tasks.workunit.client.1.smithi149.stdout:3/286: dwrite d1/f11 [0,4194304] 0 2024-09-13T18:30:19.968 INFO:tasks.workunit.client.1.smithi149.stdout:6/283: fsync dc/f53 0 2024-09-13T18:30:19.973 INFO:tasks.workunit.client.1.smithi149.stdout:2/289: unlink db/d1b/f33 0 2024-09-13T18:30:19.974 INFO:tasks.workunit.client.1.smithi149.stdout:4/298: dread df/d11/d1c/f3f [0,4194304] 0 2024-09-13T18:30:19.975 INFO:tasks.workunit.client.1.smithi149.stdout:8/253: unlink d2/d13/l28 0 2024-09-13T18:30:19.977 INFO:tasks.workunit.client.1.smithi149.stdout:2/290: dread db/d1b/f42 [0,4194304] 0 2024-09-13T18:30:19.977 INFO:tasks.workunit.client.1.smithi149.stdout:2/291: creat db/d10/f61 x:0 0 0 2024-09-13T18:30:19.977 INFO:tasks.workunit.client.1.smithi149.stdout:2/292: truncate db/d1b/d1c/d20/d3a/f47 243091 0 2024-09-13T18:30:19.977 INFO:tasks.workunit.client.1.smithi149.stdout:2/293: fdatasync db/d1b/f21 0 2024-09-13T18:30:19.977 INFO:tasks.workunit.client.1.smithi149.stdout:5/291: dwrite d3/d10/d32/d54/f47 [0,4194304] 0 2024-09-13T18:30:19.977 INFO:tasks.workunit.client.1.smithi149.stdout:6/284: unlink dc/d15/d23/c4f 0 2024-09-13T18:30:19.980 INFO:tasks.workunit.client.1.smithi149.stdout:4/299: link df/d11/d12/d21/d22/d30/d56/f5a df/d11/d12/d21/d22/d30/d41/d57/f6a 0 2024-09-13T18:30:19.981 INFO:tasks.workunit.client.1.smithi149.stdout:6/285: write f9 [1285573,52375] 0 2024-09-13T18:30:19.981 INFO:tasks.workunit.client.1.smithi149.stdout:8/254: rmdir d2/d13/d49 0 2024-09-13T18:30:19.983 INFO:tasks.workunit.client.1.smithi149.stdout:6/286: dread dc/d15/d23/f3e [0,4194304] 0 2024-09-13T18:30:19.985 INFO:tasks.workunit.client.1.smithi149.stdout:2/294: dread db/d13/f18 [0,4194304] 0 2024-09-13T18:30:19.986 INFO:tasks.workunit.client.1.smithi149.stdout:5/292: mkdir d3/d8/d13/d58 0 2024-09-13T18:30:19.986 INFO:tasks.workunit.client.1.smithi149.stdout:4/300: symlink df/d11/d12/d21/l6b 0 2024-09-13T18:30:19.988 INFO:tasks.workunit.client.1.smithi149.stdout:8/255: truncate d2/d13/d3a/f4f 672663 0 2024-09-13T18:30:19.988 INFO:tasks.workunit.client.1.smithi149.stdout:8/256: stat d2/d12/l48 0 2024-09-13T18:30:19.989 INFO:tasks.workunit.client.1.smithi149.stdout:6/287: mkdir dc/d15/d54 0 2024-09-13T18:30:19.991 INFO:tasks.workunit.client.1.smithi149.stdout:1/343: rename d9/d10/d2a to d9/d15/d40/d4a/d6b 0 2024-09-13T18:30:19.993 INFO:tasks.workunit.client.1.smithi149.stdout:2/295: mknod db/d10/d12/c62 0 2024-09-13T18:30:19.993 INFO:tasks.workunit.client.1.smithi149.stdout:2/296: readlink db/d1b/d1c/d20/d2b/d3e/l4d 0 2024-09-13T18:30:19.994 INFO:tasks.workunit.client.1.smithi149.stdout:5/293: creat d3/d10/d4c/f59 x:0 0 0 2024-09-13T18:30:20.001 INFO:tasks.workunit.client.1.smithi149.stdout:4/301: link df/d11/d12/d17/f3a df/d11/d12/d17/d3d/f6c 0 2024-09-13T18:30:20.001 INFO:tasks.workunit.client.1.smithi149.stdout:4/302: write df/f29 [894880,19377] 0 2024-09-13T18:30:20.001 INFO:tasks.workunit.client.1.smithi149.stdout:4/303: fdatasync df/d11/d12/d21/d22/d30/d56/f5a 0 2024-09-13T18:30:20.002 INFO:tasks.workunit.client.1.smithi149.stdout:1/344: mkdir d9/d10/d34/d53/d57/d6c 0 2024-09-13T18:30:20.002 INFO:tasks.workunit.client.1.smithi149.stdout:1/345: readlink d9/lf 0 2024-09-13T18:30:20.002 INFO:tasks.workunit.client.1.smithi149.stdout:1/346: chown d9/d10/d43 185 1 2024-09-13T18:30:20.002 INFO:tasks.workunit.client.1.smithi149.stdout:2/297: truncate db/d1b/d1c/d20/d3a/f3f 24356 0 2024-09-13T18:30:20.004 INFO:tasks.workunit.client.1.smithi149.stdout:4/304: mknod df/d11/d12/d21/d22/c6d 0 2024-09-13T18:30:20.004 INFO:tasks.workunit.client.1.smithi149.stdout:4/305: fdatasync df/d11/d12/f3c 0 2024-09-13T18:30:20.004 INFO:tasks.workunit.client.1.smithi149.stdout:1/347: symlink d9/d15/d40/d4a/d6b/d42/l6d 0 2024-09-13T18:30:20.006 INFO:tasks.workunit.client.1.smithi149.stdout:1/348: mknod d9/c6e 0 2024-09-13T18:30:20.016 INFO:tasks.workunit.client.1.smithi149.stdout:1/349: dread d9/d15/f20 [0,4194304] 0 2024-09-13T18:30:20.017 INFO:tasks.workunit.client.1.smithi149.stdout:1/350: mkdir d9/d10/d3f/d6f 0 2024-09-13T18:30:20.020 INFO:tasks.workunit.client.1.smithi149.stdout:6/288: dwrite dc/f1a [0,4194304] 0 2024-09-13T18:30:20.020 INFO:tasks.workunit.client.1.smithi149.stdout:8/257: dwrite d2/d12/f16 [0,4194304] 0 2024-09-13T18:30:20.020 INFO:tasks.workunit.client.1.smithi149.stdout:8/258: dread - d2/d12/d1b/f4c zero size 2024-09-13T18:30:20.021 INFO:tasks.workunit.client.1.smithi149.stdout:8/259: fdatasync d2/d13/f50 0 2024-09-13T18:30:20.021 INFO:tasks.workunit.client.1.smithi149.stdout:5/294: dwrite d3/d10/d32/f45 [0,4194304] 0 2024-09-13T18:30:20.025 INFO:tasks.workunit.client.1.smithi149.stdout:9/224: sync 2024-09-13T18:30:20.026 INFO:tasks.workunit.client.1.smithi149.stdout:0/226: sync 2024-09-13T18:30:20.029 INFO:tasks.workunit.client.1.smithi149.stdout:0/227: link d1/f2c d1/d29/d31/d3e/f45 0 2024-09-13T18:30:20.032 INFO:tasks.workunit.client.1.smithi149.stdout:9/225: mkdir d0/d47 0 2024-09-13T18:30:20.032 INFO:tasks.workunit.client.1.smithi149.stdout:1/351: dread d9/d15/f47 [0,4194304] 0 2024-09-13T18:30:20.033 INFO:tasks.workunit.client.1.smithi149.stdout:0/228: mkdir d1/d2/d41/d46 0 2024-09-13T18:30:20.034 INFO:tasks.workunit.client.1.smithi149.stdout:0/229: fdatasync d1/d2/f12 0 2024-09-13T18:30:20.035 INFO:tasks.workunit.client.1.smithi149.stdout:6/289: read dc/d15/d23/f4c [6816416,47040] 0 2024-09-13T18:30:20.037 INFO:tasks.workunit.client.1.smithi149.stdout:0/230: rename d1/d3b to d1/d29/d31/d44/d47 0 2024-09-13T18:30:20.039 INFO:tasks.workunit.client.1.smithi149.stdout:6/290: link dc/f2d dc/d15/f55 0 2024-09-13T18:30:20.039 INFO:tasks.workunit.client.1.smithi149.stdout:6/291: dread - dc/f51 zero size 2024-09-13T18:30:20.039 INFO:tasks.workunit.client.1.smithi149.stdout:6/292: fsync f8 0 2024-09-13T18:30:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.036+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2905579974 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa4ac005800 con 0x7fa4c8100680 2024-09-13T18:30:20.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.037+0000 7fa4be7fc640 1 -- 172.21.15.38:0/2905579974 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+838 (secure 0 0 0) 0x7fa4c00561e0 con 0x7fa4c8100680 2024-09-13T18:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T18:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 1, 2024-09-13T18:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 1 2024-09-13T18:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T18:30:20.040 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 13, 2024-09-13T18:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 1 2024-09-13T18:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:30:20.041 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:30:20.042 INFO:tasks.workunit.client.1.smithi149.stdout:1/352: dread d9/d10/f1a [0,4194304] 0 2024-09-13T18:30:20.042 INFO:tasks.workunit.client.1.smithi149.stdout:0/231: mkdir d1/d48 0 2024-09-13T18:30:20.042 INFO:tasks.workunit.client.1.smithi149.stdout:2/298: read db/d1b/d1c/d20/d3a/f3f [5296,18686] 0 2024-09-13T18:30:20.042 INFO:tasks.workunit.client.1.smithi149.stdout:2/299: symlink db/d13/l63 0 2024-09-13T18:30:20.042 INFO:tasks.workunit.client.1.smithi149.stdout:6/293: dread dc/f53 [0,4194304] 0 2024-09-13T18:30:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.040+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2905579974 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fa4b406ce20 msgr2=0x7fa4b406f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.040+0000 7fa4cf55d640 1 --2- 172.21.15.38:0/2905579974 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fa4b406ce20 0x7fa4b406f2e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009230 tx=0x7fa4b8000bc0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.040+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2905579974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c8100680 msgr2=0x7fa4c819bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.040+0000 7fa4cf55d640 1 --2- 172.21.15.38:0/2905579974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c8100680 0x7fa4c819bca0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000b3d0 tx=0x7fa4c000b890 comp rx=0 tx=0).stop 2024-09-13T18:30:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.040+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2905579974 shutdown_connections 2024-09-13T18:30:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.040+0000 7fa4cf55d640 1 --2- 172.21.15.38:0/2905579974 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fa4b406ce20 0x7fa4b406f2e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.040+0000 7fa4cf55d640 1 --2- 172.21.15.38:0/2905579974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c8102fb0 0x7fa4c819c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.040+0000 7fa4cf55d640 1 --2- 172.21.15.38:0/2905579974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa4c8100680 0x7fa4c819bca0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.040+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2905579974 >> 172.21.15.38:0/2905579974 conn(0x7fa4c80fa280 msgr2=0x7fa4c80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:20.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.040+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2905579974 shutdown_connections 2024-09-13T18:30:20.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.041+0000 7fa4cf55d640 1 -- 172.21.15.38:0/2905579974 wait complete. 2024-09-13T18:30:20.044 INFO:tasks.workunit.client.1.smithi149.stdout:0/232: rename d1/d1b/l23 to d1/d2/l49 0 2024-09-13T18:30:20.044 INFO:tasks.workunit.client.1.smithi149.stdout:2/300: symlink db/d1b/d2f/d30/l64 0 2024-09-13T18:30:20.045 INFO:tasks.workunit.client.1.smithi149.stdout:6/294: rename dc/c19 to dc/d15/d54/c56 0 2024-09-13T18:30:20.046 INFO:tasks.workunit.client.1.smithi149.stdout:0/233: symlink d1/d2/d41/l4a 0 2024-09-13T18:30:20.048 INFO:tasks.workunit.client.1.smithi149.stdout:0/234: symlink d1/d2/d41/d46/l4b 0 2024-09-13T18:30:20.050 INFO:tasks.workunit.client.1.smithi149.stdout:0/235: mknod d1/d2/d41/d46/c4c 0 2024-09-13T18:30:20.051 INFO:tasks.workunit.client.1.smithi149.stdout:8/260: dwrite d2/f34 [0,4194304] 0 2024-09-13T18:30:20.052 INFO:tasks.workunit.client.1.smithi149.stdout:6/295: getdents dc/d15 0 2024-09-13T18:30:20.052 INFO:tasks.workunit.client.1.smithi149.stdout:6/296: chown dc/d15/f36 412608358 1 2024-09-13T18:30:20.052 INFO:tasks.workunit.client.1.smithi149.stdout:6/297: stat dc/d15/d23/f40 0 2024-09-13T18:30:20.053 INFO:tasks.workunit.client.1.smithi149.stdout:6/298: chown dc/l17 0 1 2024-09-13T18:30:20.054 INFO:tasks.workunit.client.1.smithi149.stdout:8/261: mknod d2/d13/d3a/c54 0 2024-09-13T18:30:20.055 INFO:tasks.workunit.client.1.smithi149.stdout:2/301: read db/d10/f1a [1588597,73106] 0 2024-09-13T18:30:20.055 INFO:tasks.workunit.client.1.smithi149.stdout:6/299: mkdir dc/d15/d23/d57 0 2024-09-13T18:30:20.055 INFO:tasks.workunit.client.1.smithi149.stdout:5/295: dwrite d3/f34 [0,4194304] 0 2024-09-13T18:30:20.056 INFO:tasks.workunit.client.1.smithi149.stdout:8/262: mknod d2/d12/d1b/c55 0 2024-09-13T18:30:20.058 INFO:tasks.workunit.client.1.smithi149.stdout:2/302: link db/d1b/d2f/f52 db/d1b/d1c/d20/d2b/f65 0 2024-09-13T18:30:20.068 INFO:tasks.workunit.client.1.smithi149.stdout:5/296: dread d3/d10/d32/d54/f47 [0,4194304] 0 2024-09-13T18:30:20.068 INFO:tasks.workunit.client.1.smithi149.stdout:5/297: fsync d3/d8/d13/f22 0 2024-09-13T18:30:20.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:19 smithi038 ceph-mon[27689]: pgmap v12: 65 pgs: 65 active+clean; 407 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 28 MiB/s wr, 810 op/s 2024-09-13T18:30:20.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:19 smithi038 ceph-mon[27689]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:20.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:19 smithi038 ceph-mon[27689]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:20.091 INFO:tasks.workunit.client.1.smithi149.stdout:8/263: dwrite d2/d13/f29 [4194304,4194304] 0 2024-09-13T18:30:20.091 INFO:tasks.workunit.client.1.smithi149.stdout:2/303: dwrite db/d1b/d1c/d20/d2b/f57 [0,4194304] 0 2024-09-13T18:30:20.091 INFO:tasks.workunit.client.1.smithi149.stdout:6/300: dwrite dc/d15/f20 [4194304,4194304] 0 2024-09-13T18:30:20.102 INFO:tasks.workunit.client.1.smithi149.stdout:7/328: sync 2024-09-13T18:30:20.102 INFO:tasks.workunit.client.1.smithi149.stdout:7/329: dread d7/ff [0,4194304] 0 2024-09-13T18:30:20.102 INFO:tasks.workunit.client.1.smithi149.stdout:7/330: creat d7/d9/f72 x:0 0 0 2024-09-13T18:30:20.137 INFO:tasks.workunit.client.1.smithi149.stdout:8/264: mknod d2/d12/c56 0 2024-09-13T18:30:20.137 INFO:tasks.workunit.client.1.smithi149.stdout:8/265: chown d2/f34 36 1 2024-09-13T18:30:20.137 INFO:tasks.workunit.client.1.smithi149.stdout:8/266: chown d2/d12/c1d 1 1 2024-09-13T18:30:20.141 INFO:tasks.workunit.client.1.smithi149.stdout:6/301: creat dc/d15/d23/f58 x:0 0 0 2024-09-13T18:30:20.152 INFO:tasks.workunit.client.1.smithi149.stdout:7/331: dwrite d7/d9/d1c/d34/f55 [0,4194304] 0 2024-09-13T18:30:20.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.155+0000 7f381293a640 1 -- 172.21.15.38:0/2596819986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f380c100e00 msgr2=0x7f380c101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.155+0000 7f381293a640 1 --2- 172.21.15.38:0/2596819986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f380c100e00 0x7f380c101280 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009880 tx=0x7f37fc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.155+0000 7f381293a640 1 -- 172.21.15.38:0/2596819986 shutdown_connections 2024-09-13T18:30:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.155+0000 7f381293a640 1 --2- 172.21.15.38:0/2596819986 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f380c100e00 0x7f380c101280 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.155+0000 7f381293a640 1 --2- 172.21.15.38:0/2596819986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f380c0fde20 0x7f380c0fe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.155+0000 7f381293a640 1 -- 172.21.15.38:0/2596819986 >> 172.21.15.38:0/2596819986 conn(0x7f380c0f9950 msgr2=0x7f380c0fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.155+0000 7f381293a640 1 -- 172.21.15.38:0/2596819986 shutdown_connections 2024-09-13T18:30:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.155+0000 7f381293a640 1 -- 172.21.15.38:0/2596819986 wait complete. 2024-09-13T18:30:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.156+0000 7f381293a640 1 Processor -- start 2024-09-13T18:30:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.156+0000 7f381293a640 1 -- start start 2024-09-13T18:30:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.156+0000 7f381293a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f380c0fde20 0x7f380c19bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.156+0000 7f381293a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f380c100e00 0x7f380c19c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.156+0000 7f381293a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c19c620 con 0x7f380c100e00 2024-09-13T18:30:20.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.156+0000 7f381293a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c19c790 con 0x7f380c0fde20 2024-09-13T18:30:20.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.156+0000 7f380bfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f380c0fde20 0x7f380c19bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.156+0000 7f380bfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f380c0fde20 0x7f380c19bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.38:43342/0 (socket says 172.21.15.38:43342) 2024-09-13T18:30:20.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.157+0000 7f380bfff640 1 -- 172.21.15.38:0/1439672496 learned_addr learned my addr 172.21.15.38:0/1439672496 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:20.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.157+0000 7f38037fe640 1 --2- 172.21.15.38:0/1439672496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f380c100e00 0x7f380c19c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.157+0000 7f380bfff640 1 -- 172.21.15.38:0/1439672496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f380c100e00 msgr2=0x7f380c19c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.157+0000 7f380bfff640 1 --2- 172.21.15.38:0/1439672496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f380c100e00 0x7f380c19c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.157+0000 7f380bfff640 1 -- 172.21.15.38:0/1439672496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc009560 con 0x7f380c0fde20 2024-09-13T18:30:20.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.157+0000 7f38037fe640 1 --2- 172.21.15.38:0/1439672496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f380c100e00 0x7f380c19c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:20.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.157+0000 7f380bfff640 1 --2- 172.21.15.38:0/1439672496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f380c0fde20 0x7f380c19bb10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f37f400eaf0 tx=0x7f37f400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:20.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.158+0000 7f3809ffb640 1 -- 172.21.15.38:0/1439672496 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37f4003970 con 0x7f380c0fde20 2024-09-13T18:30:20.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.158+0000 7f381293a640 1 -- 172.21.15.38:0/1439672496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c1a1230 con 0x7f380c0fde20 2024-09-13T18:30:20.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.158+0000 7f3809ffb640 1 -- 172.21.15.38:0/1439672496 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f37f4004020 con 0x7f380c0fde20 2024-09-13T18:30:20.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.158+0000 7f3809ffb640 1 -- 172.21.15.38:0/1439672496 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37f4010640 con 0x7f380c0fde20 2024-09-13T18:30:20.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.158+0000 7f381293a640 1 -- 172.21.15.38:0/1439672496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c1a1800 con 0x7f380c0fde20 2024-09-13T18:30:20.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.159+0000 7f381293a640 1 -- 172.21.15.38:0/1439672496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380c105360 con 0x7f380c0fde20 2024-09-13T18:30:20.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.161+0000 7f3809ffb640 1 -- 172.21.15.38:0/1439672496 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f37f4004190 con 0x7f380c0fde20 2024-09-13T18:30:20.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.161+0000 7f3809ffb640 1 --2- 172.21.15.38:0/1439672496 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f37ec06cde0 0x7f37ec06f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.162+0000 7f3809ffb640 1 -- 172.21.15.38:0/1439672496 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f37f4014070 con 0x7f380c0fde20 2024-09-13T18:30:20.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.162+0000 7f38037fe640 1 --2- 172.21.15.38:0/1439672496 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f37ec06cde0 0x7f37ec06f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.163+0000 7f38037fe640 1 --2- 172.21.15.38:0/1439672496 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f37ec06cde0 0x7f37ec06f2a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f380c19d030 tx=0x7f37fc031400 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:20.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.168+0000 7f3809ffb640 1 -- 172.21.15.38:0/1439672496 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f37f4056d60 con 0x7f380c0fde20 2024-09-13T18:30:20.184 INFO:tasks.workunit.client.1.smithi149.stdout:8/267: creat d2/d12/f57 x:0 0 0 2024-09-13T18:30:20.185 INFO:tasks.workunit.client.1.smithi149.stdout:6/302: creat dc/d15/d23/d57/f59 x:0 0 0 2024-09-13T18:30:20.185 INFO:tasks.workunit.client.1.smithi149.stdout:6/303: creat dc/f5a x:0 0 0 2024-09-13T18:30:20.185 INFO:tasks.workunit.client.1.smithi149.stdout:6/304: write dc/f2d [1260733,55156] 0 2024-09-13T18:30:20.188 INFO:tasks.workunit.client.1.smithi149.stdout:7/332: creat d7/d9/d1c/d1f/f73 x:0 0 0 2024-09-13T18:30:20.188 INFO:tasks.workunit.client.1.smithi149.stdout:7/333: write d7/f59 [230974,102781] 0 2024-09-13T18:30:20.188 INFO:tasks.workunit.client.1.smithi149.stdout:7/334: chown d7/d9/d1c/f6a 4 1 2024-09-13T18:30:20.188 INFO:tasks.workunit.client.1.smithi149.stdout:8/268: mkdir d2/d12/d1b/d58 0 2024-09-13T18:30:20.193 INFO:tasks.workunit.client.1.smithi149.stdout:6/305: rename dc/d15/d23/d42 to dc/d15/d23/d5b 0 2024-09-13T18:30:20.193 INFO:tasks.workunit.client.1.smithi149.stdout:6/306: fdatasync dc/d15/d23/f58 0 2024-09-13T18:30:20.194 INFO:tasks.workunit.client.1.smithi149.stdout:7/335: symlink d7/d9/l74 0 2024-09-13T18:30:20.194 INFO:tasks.workunit.client.1.smithi149.stdout:7/336: chown d7/d12/f2d 291853450 1 2024-09-13T18:30:20.197 INFO:tasks.workunit.client.1.smithi149.stdout:6/307: mkdir dc/d15/d23/d57/d5c 0 2024-09-13T18:30:20.197 INFO:tasks.workunit.client.1.smithi149.stdout:6/308: write dc/f3f [798781,103231] 0 2024-09-13T18:30:20.226 INFO:tasks.workunit.client.1.smithi149.stdout:7/337: dwrite d7/fd [0,4194304] 0 2024-09-13T18:30:20.229 INFO:tasks.workunit.client.1.smithi149.stdout:6/309: dwrite dc/f37 [0,4194304] 0 2024-09-13T18:30:20.244 INFO:tasks.workunit.client.1.smithi149.stdout:6/310: getdents dc/d15/d23/d57 0 2024-09-13T18:30:20.246 INFO:tasks.workunit.client.1.smithi149.stdout:6/311: link dc/d15/d23/d5b/c4b dc/d15/d23/d5b/c5d 0 2024-09-13T18:30:20.252 INFO:tasks.workunit.client.1.smithi149.stdout:7/338: dwrite d7/d9/d11/f42 [0,4194304] 0 2024-09-13T18:30:20.257 INFO:tasks.workunit.client.1.smithi149.stdout:7/339: rename d7/lc to d7/d9/d1c/d1f/d21/d49/l75 0 2024-09-13T18:30:20.259 INFO:tasks.workunit.client.1.smithi149.stdout:7/340: mkdir d7/d76 0 2024-09-13T18:30:20.259 INFO:tasks.workunit.client.1.smithi149.stdout:7/341: creat d7/d9/d1c/d1f/d21/f77 x:0 0 0 2024-09-13T18:30:20.260 INFO:tasks.workunit.client.1.smithi149.stdout:7/342: chown d7/d9/d1c 13 1 2024-09-13T18:30:20.260 INFO:tasks.workunit.client.1.smithi149.stdout:7/343: write d7/d9/f1d [4744033,116706] 0 2024-09-13T18:30:20.262 INFO:tasks.workunit.client.1.smithi149.stdout:7/344: symlink d7/d12/l78 0 2024-09-13T18:30:20.263 INFO:tasks.workunit.client.1.smithi149.stdout:7/345: symlink d7/d9/l79 0 2024-09-13T18:30:20.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:19 smithi149 ceph-mon[35845]: pgmap v12: 65 pgs: 65 active+clean; 407 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 28 MiB/s wr, 810 op/s 2024-09-13T18:30:20.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:19 smithi149 ceph-mon[35845]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:20.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:19 smithi149 ceph-mon[35845]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:20.270 INFO:tasks.workunit.client.1.smithi149.stdout:6/312: dwrite dc/d15/f4d [0,4194304] 0 2024-09-13T18:30:20.270 INFO:tasks.workunit.client.1.smithi149.stdout:6/313: write dc/f53 [1716328,74059] 0 2024-09-13T18:30:20.270 INFO:tasks.workunit.client.1.smithi149.stdout:6/314: write dc/d15/d23/d57/f59 [810101,32609] 0 2024-09-13T18:30:20.271 INFO:tasks.workunit.client.1.smithi149.stdout:4/306: sync 2024-09-13T18:30:20.272 INFO:tasks.workunit.client.1.smithi149.stdout:3/287: sync 2024-09-13T18:30:20.272 INFO:tasks.workunit.client.1.smithi149.stdout:9/226: sync 2024-09-13T18:30:20.272 INFO:tasks.workunit.client.1.smithi149.stdout:9/227: fdatasync d0/d18/f41 0 2024-09-13T18:30:20.272 INFO:tasks.workunit.client.1.smithi149.stdout:4/307: dread - df/d11/d12/d21/d22/d30/d41/d57/f6a zero size 2024-09-13T18:30:20.275 INFO:tasks.workunit.client.1.smithi149.stdout:6/315: mkdir dc/d15/d54/d5e 0 2024-09-13T18:30:20.277 INFO:tasks.workunit.client.1.smithi149.stdout:7/346: write d7/d9/d1b/f36 [487399,55893] 0 2024-09-13T18:30:20.277 INFO:tasks.workunit.client.1.smithi149.stdout:3/288: rename d1/d48/f4b to d1/d4/f5f 0 2024-09-13T18:30:20.279 INFO:tasks.workunit.client.1.smithi149.stdout:6/316: mkdir dc/d15/d23/d5f 0 2024-09-13T18:30:20.279 INFO:tasks.workunit.client.1.smithi149.stdout:4/308: symlink df/d11/l6e 0 2024-09-13T18:30:20.280 INFO:tasks.workunit.client.1.smithi149.stdout:3/289: mknod d1/d47/d30/d46/c60 0 2024-09-13T18:30:20.280 INFO:tasks.workunit.client.1.smithi149.stdout:3/290: write d1/d4/fd [2686119,88133] 0 2024-09-13T18:30:20.283 INFO:tasks.workunit.client.1.smithi149.stdout:3/291: symlink d1/d12/d20/l61 0 2024-09-13T18:30:20.284 INFO:tasks.workunit.client.1.smithi149.stdout:4/309: symlink df/d11/l6f 0 2024-09-13T18:30:20.284 INFO:tasks.workunit.client.1.smithi149.stdout:6/317: dread dc/d15/f2b [0,4194304] 0 2024-09-13T18:30:20.284 INFO:tasks.workunit.client.1.smithi149.stdout:4/310: readlink df/l2d 0 2024-09-13T18:30:20.284 INFO:tasks.workunit.client.1.smithi149.stdout:6/318: write dc/f51 [399398,105944] 0 2024-09-13T18:30:20.285 INFO:tasks.workunit.client.1.smithi149.stdout:6/319: chown dc/d2f/c3b 6257026 1 2024-09-13T18:30:20.285 INFO:tasks.workunit.client.1.smithi149.stdout:6/320: truncate dc/d15/d23/f58 532255 0 2024-09-13T18:30:20.287 INFO:tasks.workunit.client.1.smithi149.stdout:6/321: truncate dc/d15/f55 321271 0 2024-09-13T18:30:20.302 INFO:tasks.workunit.client.1.smithi149.stdout:4/311: read df/d11/d12/d21/d22/d30/f37 [2713539,94841] 0 2024-09-13T18:30:20.302 INFO:tasks.workunit.client.1.smithi149.stdout:9/228: dwrite d0/f38 [0,4194304] 0 2024-09-13T18:30:20.307 INFO:tasks.workunit.client.1.smithi149.stdout:4/312: mkdir df/d11/d70 0 2024-09-13T18:30:20.307 INFO:tasks.workunit.client.1.smithi149.stdout:4/313: chown df/d11/d12/d21/d22/d30/l3b 56 1 2024-09-13T18:30:20.308 INFO:tasks.workunit.client.1.smithi149.stdout:9/229: getdents d0/d18 0 2024-09-13T18:30:20.309 INFO:tasks.workunit.client.1.smithi149.stdout:4/314: mknod df/d11/d12/c71 0 2024-09-13T18:30:20.309 INFO:tasks.workunit.client.1.smithi149.stdout:4/315: fdatasync df/d11/f61 0 2024-09-13T18:30:20.309 INFO:tasks.workunit.client.1.smithi149.stdout:9/230: creat d0/d18/f48 x:0 0 0 2024-09-13T18:30:20.311 INFO:tasks.workunit.client.1.smithi149.stdout:9/231: unlink d0/f22 0 2024-09-13T18:30:20.311 INFO:tasks.workunit.client.1.smithi149.stdout:9/232: truncate d0/d18/d19/d3b/f3d 4976351 0 2024-09-13T18:30:20.318 INFO:tasks.workunit.client.1.smithi149.stdout:6/322: dwrite fa [0,4194304] 0 2024-09-13T18:30:20.318 INFO:tasks.workunit.client.1.smithi149.stdout:6/323: chown dc/f51 4443631 1 2024-09-13T18:30:20.319 INFO:tasks.workunit.client.1.smithi149.stdout:3/292: dwrite d1/d47/d30/f5b [0,4194304] 0 2024-09-13T18:30:20.320 INFO:tasks.workunit.client.1.smithi149.stdout:6/324: mknod dc/d15/d23/d57/d5c/c60 0 2024-09-13T18:30:20.325 INFO:tasks.workunit.client.1.smithi149.stdout:6/325: mknod dc/d15/d23/c61 0 2024-09-13T18:30:20.326 INFO:tasks.workunit.client.1.smithi149.stdout:3/293: getdents d1/d4/d39 0 2024-09-13T18:30:20.326 INFO:tasks.workunit.client.1.smithi149.stdout:6/326: write dc/d15/d23/f58 [220728,107204] 0 2024-09-13T18:30:20.327 INFO:tasks.workunit.client.1.smithi149.stdout:3/294: symlink d1/d2c/l62 0 2024-09-13T18:30:20.328 INFO:tasks.workunit.client.1.smithi149.stdout:3/295: read d1/f58 [882207,105231] 0 2024-09-13T18:30:20.328 INFO:tasks.workunit.client.1.smithi149.stdout:3/296: creat d1/d21/f63 x:0 0 0 2024-09-13T18:30:20.328 INFO:tasks.workunit.client.1.smithi149.stdout:3/297: write d1/d2e/f55 [940760,105041] 0 2024-09-13T18:30:20.328 INFO:tasks.workunit.client.1.smithi149.stdout:6/327: mknod dc/d15/d54/c62 0 2024-09-13T18:30:20.328 INFO:tasks.workunit.client.1.smithi149.stdout:6/328: chown fa 550814 1 2024-09-13T18:30:20.329 INFO:tasks.workunit.client.1.smithi149.stdout:3/298: mknod d1/d2c/d56/c64 0 2024-09-13T18:30:20.339 INFO:tasks.workunit.client.1.smithi149.stdout:9/233: dwrite d0/d18/d19/f24 [4194304,4194304] 0 2024-09-13T18:30:20.344 INFO:tasks.workunit.client.1.smithi149.stdout:3/299: dread d1/d2e/f14 [0,4194304] 0 2024-09-13T18:30:20.346 INFO:tasks.workunit.client.1.smithi149.stdout:3/300: link d1/d2e/d1d/l3f d1/d2e/d1d/d49/l65 0 2024-09-13T18:30:20.346 INFO:tasks.workunit.client.1.smithi149.stdout:3/301: chown d1/d2c/d56/c64 1257 1 2024-09-13T18:30:20.346 INFO:tasks.workunit.client.1.smithi149.stdout:4/316: dwrite df/d11/d12/f3c [0,4194304] 0 2024-09-13T18:30:20.347 INFO:tasks.workunit.client.1.smithi149.stdout:3/302: rename d1/d21/l34 to d1/d2e/d1d/d49/l66 0 2024-09-13T18:30:20.349 INFO:tasks.workunit.client.1.smithi149.stdout:4/317: mkdir df/d11/d12/d21/d22/d72 0 2024-09-13T18:30:20.349 INFO:tasks.workunit.client.1.smithi149.stdout:9/234: dread d0/f1a [0,4194304] 0 2024-09-13T18:30:20.350 INFO:tasks.workunit.client.1.smithi149.stdout:3/303: mknod d1/d47/d30/c67 0 2024-09-13T18:30:20.351 INFO:tasks.workunit.client.1.smithi149.stdout:6/329: dwrite dc/d15/d23/f4c [8388608,4194304] 0 2024-09-13T18:30:20.352 INFO:tasks.workunit.client.1.smithi149.stdout:3/304: rename d1/d47/c2a to d1/d2c/c68 0 2024-09-13T18:30:20.356 INFO:tasks.workunit.client.1.smithi149.stdout:0/236: sync 2024-09-13T18:30:20.356 INFO:tasks.workunit.client.1.smithi149.stdout:1/353: sync 2024-09-13T18:30:20.356 INFO:tasks.workunit.client.1.smithi149.stdout:5/298: sync 2024-09-13T18:30:20.356 INFO:tasks.workunit.client.1.smithi149.stdout:2/304: sync 2024-09-13T18:30:20.361 INFO:tasks.workunit.client.1.smithi149.stdout:0/237: creat d1/d2/d41/f4d x:0 0 0 2024-09-13T18:30:20.363 INFO:tasks.workunit.client.1.smithi149.stdout:1/354: rmdir d9/d15/d25 39 2024-09-13T18:30:20.367 INFO:tasks.workunit.client.1.smithi149.stdout:0/238: mkdir d1/d2/d4e 0 2024-09-13T18:30:20.367 INFO:tasks.workunit.client.1.smithi149.stdout:5/299: write d3/d10/d32/d54/f31 [838394,11167] 0 2024-09-13T18:30:20.369 INFO:tasks.workunit.client.1.smithi149.stdout:0/239: mknod d1/d29/c4f 0 2024-09-13T18:30:20.370 INFO:tasks.workunit.client.1.smithi149.stdout:5/300: symlink d3/d8/l5a 0 2024-09-13T18:30:20.370 INFO:tasks.workunit.client.1.smithi149.stdout:5/301: dread - d3/d8/f39 zero size 2024-09-13T18:30:20.370 INFO:tasks.workunit.client.1.smithi149.stdout:5/302: creat d3/d8/d13/f5b x:0 0 0 2024-09-13T18:30:20.371 INFO:tasks.workunit.client.1.smithi149.stdout:0/240: symlink d1/d29/d31/l50 0 2024-09-13T18:30:20.375 INFO:tasks.workunit.client.1.smithi149.stdout:5/303: getdents d3 0 2024-09-13T18:30:20.377 INFO:tasks.workunit.client.1.smithi149.stdout:2/305: dread f1 [0,4194304] 0 2024-09-13T18:30:20.377 INFO:tasks.workunit.client.1.smithi149.stdout:5/304: rmdir d3/d10/d4c/d4e 39 2024-09-13T18:30:20.387 INFO:tasks.workunit.client.1.smithi149.stdout:0/241: dread d1/f27 [0,4194304] 0 2024-09-13T18:30:20.389 INFO:tasks.workunit.client.1.smithi149.stdout:4/318: dwrite df/d11/d12/d21/d22/d30/f37 [4194304,4194304] 0 2024-09-13T18:30:20.389 INFO:tasks.workunit.client.1.smithi149.stdout:9/235: dwrite d0/d18/d19/f24 [0,4194304] 0 2024-09-13T18:30:20.390 INFO:tasks.workunit.client.1.smithi149.stdout:4/319: write df/d11/d12/d21/d22/d30/f37 [8441788,74496] 0 2024-09-13T18:30:20.390 INFO:tasks.workunit.client.1.smithi149.stdout:6/330: dwrite dc/d15/f44 [0,4194304] 0 2024-09-13T18:30:20.392 INFO:tasks.workunit.client.1.smithi149.stdout:9/236: link d0/f2a d0/d2e/d42/f49 0 2024-09-13T18:30:20.395 INFO:tasks.workunit.client.1.smithi149.stdout:9/237: fdatasync d0/d18/f41 0 2024-09-13T18:30:20.399 INFO:tasks.workunit.client.1.smithi149.stdout:0/242: write d1/f2c [8223296,89865] 0 2024-09-13T18:30:20.399 INFO:tasks.workunit.client.1.smithi149.stdout:9/238: dread d0/d18/d27/f3e [0,4194304] 0 2024-09-13T18:30:20.400 INFO:tasks.workunit.client.1.smithi149.stdout:1/355: dwrite d9/d10/d34/d53/d57/f65 [0,4194304] 0 2024-09-13T18:30:20.400 INFO:tasks.workunit.client.1.smithi149.stdout:9/239: stat d0/l16 0 2024-09-13T18:30:20.401 INFO:tasks.workunit.client.1.smithi149.stdout:0/243: rename d1/c34 to d1/c51 0 2024-09-13T18:30:20.402 INFO:tasks.workunit.client.1.smithi149.stdout:1/356: symlink d9/l70 0 2024-09-13T18:30:20.402 INFO:tasks.workunit.client.1.smithi149.stdout:9/240: symlink d0/d47/l4a 0 2024-09-13T18:30:20.404 INFO:tasks.workunit.client.1.smithi149.stdout:2/306: dwrite f6 [0,4194304] 0 2024-09-13T18:30:20.404 INFO:tasks.workunit.client.1.smithi149.stdout:2/307: write db/d1b/d1c/f1f [1546033,39941] 0 2024-09-13T18:30:20.404 INFO:tasks.workunit.client.1.smithi149.stdout:2/308: truncate db/d1b/d1c/d20/d2b/f65 515530 0 2024-09-13T18:30:20.404 INFO:tasks.workunit.client.1.smithi149.stdout:0/244: creat d1/d29/d31/f52 x:0 0 0 2024-09-13T18:30:20.404 INFO:tasks.workunit.client.1.smithi149.stdout:9/241: rmdir d0/d18/d19/d3b 39 2024-09-13T18:30:20.407 INFO:tasks.workunit.client.1.smithi149.stdout:2/309: link db/d1b/c41 db/d1b/d2f/d30/c66 0 2024-09-13T18:30:20.408 INFO:tasks.workunit.client.1.smithi149.stdout:0/245: symlink d1/d1b/l53 0 2024-09-13T18:30:20.408 INFO:tasks.workunit.client.1.smithi149.stdout:2/310: mknod db/d1b/d1c/d20/d2b/d3e/c67 0 2024-09-13T18:30:20.409 INFO:tasks.workunit.client.1.smithi149.stdout:6/331: dread dc/d15/f4d [0,4194304] 0 2024-09-13T18:30:20.409 INFO:tasks.workunit.client.1.smithi149.stdout:6/332: fdatasync dc/d15/f55 0 2024-09-13T18:30:20.410 INFO:tasks.workunit.client.1.smithi149.stdout:2/311: creat db/d1b/d1c/d20/d2b/d3e/f68 x:0 0 0 2024-09-13T18:30:20.410 INFO:tasks.workunit.client.1.smithi149.stdout:2/312: chown db/d1b/d2f/d30/l32 25 1 2024-09-13T18:30:20.413 INFO:tasks.workunit.client.1.smithi149.stdout:2/313: rename db/d1b/d1c/d20/d3a/d28 to db/d1b/d2f/d69 0 2024-09-13T18:30:20.413 INFO:tasks.workunit.client.1.smithi149.stdout:2/314: rename db/d1b/d2f to db/d1b/d2f/d69/d6a 22 2024-09-13T18:30:20.417 INFO:tasks.workunit.client.1.smithi149.stdout:2/315: rename db/d1b/f21 to db/d1b/d1c/d20/d2b/f6b 0 2024-09-13T18:30:20.420 INFO:tasks.workunit.client.1.smithi149.stdout:2/316: unlink db/d1b/d1c/f1f 0 2024-09-13T18:30:20.424 INFO:tasks.workunit.client.1.smithi149.stdout:6/333: dread f8 [0,4194304] 0 2024-09-13T18:30:20.428 INFO:tasks.workunit.client.1.smithi149.stdout:6/334: dread dc/d15/d23/f4c [4194304,4194304] 0 2024-09-13T18:30:20.429 INFO:tasks.workunit.client.1.smithi149.stdout:6/335: mknod dc/d15/d54/c63 0 2024-09-13T18:30:20.429 INFO:tasks.workunit.client.1.smithi149.stdout:6/336: chown f5 3797204 1 2024-09-13T18:30:20.430 INFO:tasks.workunit.client.1.smithi149.stdout:6/337: write dc/d15/d23/d57/f59 [637222,95405] 0 2024-09-13T18:30:20.431 INFO:tasks.workunit.client.1.smithi149.stdout:6/338: mkdir dc/d15/d23/d57/d5c/d64 0 2024-09-13T18:30:20.431 INFO:tasks.workunit.client.1.smithi149.stdout:6/339: readlink lb 0 2024-09-13T18:30:20.431 INFO:tasks.workunit.client.1.smithi149.stdout:6/340: write dc/d15/d23/f39 [5190620,82269] 0 2024-09-13T18:30:20.431 INFO:tasks.workunit.client.1.smithi149.stdout:6/341: dread - dc/d15/d23/d5b/f52 zero size 2024-09-13T18:30:20.432 INFO:tasks.workunit.client.1.smithi149.stdout:6/342: mknod dc/d15/d54/c65 0 2024-09-13T18:30:20.432 INFO:tasks.workunit.client.1.smithi149.stdout:2/317: read db/d1b/d1c/d20/f50 [2668615,28486] 0 2024-09-13T18:30:20.432 INFO:tasks.workunit.client.1.smithi149.stdout:8/269: sync 2024-09-13T18:30:20.432 INFO:tasks.workunit.client.1.smithi149.stdout:8/270: chown d2/d12/l4e 0 1 2024-09-13T18:30:20.433 INFO:tasks.workunit.client.1.smithi149.stdout:6/343: truncate fa 107321 0 2024-09-13T18:30:20.434 INFO:tasks.workunit.client.1.smithi149.stdout:2/318: mkdir db/d1b/d6c 0 2024-09-13T18:30:20.435 INFO:tasks.workunit.client.1.smithi149.stdout:8/271: creat d2/d12/d2a/f59 x:0 0 0 2024-09-13T18:30:20.436 INFO:tasks.workunit.client.1.smithi149.stdout:2/319: creat db/d1b/d1c/d20/d49/f6d x:0 0 0 2024-09-13T18:30:20.437 INFO:tasks.workunit.client.1.smithi149.stdout:2/320: symlink db/d13/l6e 0 2024-09-13T18:30:20.438 INFO:tasks.workunit.client.1.smithi149.stdout:8/272: dread d2/d12/f3f [0,4194304] 0 2024-09-13T18:30:20.438 INFO:tasks.workunit.client.1.smithi149.stdout:8/273: creat d2/d12/f5a x:0 0 0 2024-09-13T18:30:20.438 INFO:tasks.workunit.client.1.smithi149.stdout:8/274: read - d2/d12/d2a/f59 zero size 2024-09-13T18:30:20.438 INFO:tasks.workunit.client.1.smithi149.stdout:8/275: dread - d2/d12/f57 zero size 2024-09-13T18:30:20.438 INFO:tasks.workunit.client.1.smithi149.stdout:8/276: chown d2/d12/f5a 15094 1 2024-09-13T18:30:20.440 INFO:tasks.workunit.client.1.smithi149.stdout:0/246: dwrite d1/d29/d31/f52 [0,4194304] 0 2024-09-13T18:30:20.445 INFO:tasks.workunit.client.1.smithi149.stdout:0/247: mkdir d1/d29/d31/d3e/d54 0 2024-09-13T18:30:20.445 INFO:tasks.workunit.client.1.smithi149.stdout:0/248: readlink d1/l11 0 2024-09-13T18:30:20.445 INFO:tasks.workunit.client.1.smithi149.stdout:0/249: write d1/f42 [1229632,108046] 0 2024-09-13T18:30:20.445 INFO:tasks.workunit.client.1.smithi149.stdout:0/250: write d1/f1a [716008,75456] 0 2024-09-13T18:30:20.448 INFO:tasks.workunit.client.1.smithi149.stdout:8/277: dread d2/d13/f41 [0,4194304] 0 2024-09-13T18:30:20.448 INFO:tasks.workunit.client.1.smithi149.stdout:8/278: write d2/d12/f3d [790226,2451] 0 2024-09-13T18:30:20.451 INFO:tasks.workunit.client.1.smithi149.stdout:8/279: mkdir d2/d5b 0 2024-09-13T18:30:20.452 INFO:tasks.workunit.client.1.smithi149.stdout:6/344: read dc/d15/d23/f40 [2562722,61455] 0 2024-09-13T18:30:20.452 INFO:tasks.workunit.client.1.smithi149.stdout:1/357: dwrite d9/d10/d34/d53/d57/f65 [0,4194304] 0 2024-09-13T18:30:20.452 INFO:tasks.workunit.client.1.smithi149.stdout:9/242: dwrite d0/d18/d19/f23 [0,4194304] 0 2024-09-13T18:30:20.460 INFO:tasks.workunit.client.1.smithi149.stdout:6/345: rename dc/d2f/c50 to dc/d15/d23/d57/c66 0 2024-09-13T18:30:20.460 INFO:tasks.workunit.client.1.smithi149.stdout:6/346: stat dc/d15 0 2024-09-13T18:30:20.461 INFO:tasks.workunit.client.1.smithi149.stdout:6/347: dread dc/d15/f55 [0,4194304] 0 2024-09-13T18:30:20.461 INFO:tasks.workunit.client.1.smithi149.stdout:6/348: chown dc/d15/d23/f3e 124 1 2024-09-13T18:30:20.462 INFO:tasks.workunit.client.1.smithi149.stdout:6/349: readlink dc/l28 0 2024-09-13T18:30:20.462 INFO:tasks.workunit.client.1.smithi149.stdout:6/350: creat dc/d15/d23/d5f/f67 x:0 0 0 2024-09-13T18:30:20.462 INFO:tasks.workunit.client.1.smithi149.stdout:6/351: fdatasync dc/f2d 0 2024-09-13T18:30:20.464 INFO:tasks.workunit.client.1.smithi149.stdout:6/352: link dc/l28 dc/d15/d23/d57/d5c/l68 0 2024-09-13T18:30:20.464 INFO:tasks.workunit.client.1.smithi149.stdout:6/353: mknod dc/d15/d23/d57/d5c/d64/c69 0 2024-09-13T18:30:20.465 INFO:tasks.workunit.client.1.smithi149.stdout:9/243: dread d0/d18/d19/f24 [0,4194304] 0 2024-09-13T18:30:20.465 INFO:tasks.workunit.client.1.smithi149.stdout:6/354: rename dc/d15/c45 to dc/d15/d23/d5f/c6a 0 2024-09-13T18:30:20.466 INFO:tasks.workunit.client.1.smithi149.stdout:6/355: dread - dc/d15/d23/d5f/f67 zero size 2024-09-13T18:30:20.466 INFO:tasks.workunit.client.1.smithi149.stdout:9/244: rename d0/d33/f34 to d0/f4b 0 2024-09-13T18:30:20.467 INFO:tasks.workunit.client.1.smithi149.stdout:9/245: mknod d0/d18/d19/c4c 0 2024-09-13T18:30:20.467 INFO:tasks.workunit.client.1.smithi149.stdout:9/246: symlink d0/d2e/d42/l4d 0 2024-09-13T18:30:20.469 INFO:tasks.workunit.client.1.smithi149.stdout:2/321: dwrite db/d1b/d1c/d20/d3a/f53 [0,4194304] 0 2024-09-13T18:30:20.469 INFO:tasks.workunit.client.1.smithi149.stdout:2/322: creat db/d1b/d48/f6f x:0 0 0 2024-09-13T18:30:20.472 INFO:tasks.workunit.client.1.smithi149.stdout:1/358: write d9/d10/d37/d38/f4e [3874593,28067] 0 2024-09-13T18:30:20.474 INFO:tasks.workunit.client.1.smithi149.stdout:6/356: fsync dc/d15/d23/d5f/f67 0 2024-09-13T18:30:20.476 INFO:tasks.workunit.client.1.smithi149.stdout:6/357: link dc/d2f/c43 dc/d15/c6b 0 2024-09-13T18:30:20.478 INFO:tasks.workunit.client.1.smithi149.stdout:6/358: creat dc/d2f/f6c x:0 0 0 2024-09-13T18:30:20.479 INFO:tasks.workunit.client.1.smithi149.stdout:2/323: write db/d1b/d1c/d20/d2b/f57 [1997442,14732] 0 2024-09-13T18:30:20.482 INFO:tasks.workunit.client.1.smithi149.stdout:7/347: sync 2024-09-13T18:30:20.482 INFO:tasks.workunit.client.1.smithi149.stdout:3/305: sync 2024-09-13T18:30:20.482 INFO:tasks.workunit.client.1.smithi149.stdout:3/306: write d1/f58 [1588863,13671] 0 2024-09-13T18:30:20.482 INFO:tasks.workunit.client.1.smithi149.stdout:3/307: chown d1/d2e/l10 1067255 1 2024-09-13T18:30:20.482 INFO:tasks.workunit.client.1.smithi149.stdout:2/324: mkdir db/d13/d70 0 2024-09-13T18:30:20.482 INFO:tasks.workunit.client.1.smithi149.stdout:2/325: read - db/d1b/d1c/d20/d2b/d3e/f68 zero size 2024-09-13T18:30:20.483 INFO:tasks.workunit.client.1.smithi149.stdout:1/359: dread d9/d15/f47 [0,4194304] 0 2024-09-13T18:30:20.484 INFO:tasks.workunit.client.1.smithi149.stdout:1/360: chown d9/d15/d60/c66 3106 1 2024-09-13T18:30:20.486 INFO:tasks.workunit.client.1.smithi149.stdout:2/326: symlink db/d1b/d2f/d30/l71 0 2024-09-13T18:30:20.486 INFO:tasks.workunit.client.1.smithi149.stdout:2/327: chown db/d13/l6e 1188052 1 2024-09-13T18:30:20.487 INFO:tasks.workunit.client.1.smithi149.stdout:2/328: creat db/d10/f72 x:0 0 0 2024-09-13T18:30:20.488 INFO:tasks.workunit.client.1.smithi149.stdout:3/308: getdents d1/d47/d30/d46 0 2024-09-13T18:30:20.488 INFO:tasks.workunit.client.1.smithi149.stdout:6/359: write dc/d15/f36 [344143,7647] 0 2024-09-13T18:30:20.490 INFO:tasks.workunit.client.1.smithi149.stdout:1/361: mknod d9/d58/c71 0 2024-09-13T18:30:20.495 INFO:tasks.workunit.client.1.smithi149.stdout:6/360: rename f9 to dc/d15/d23/d57/d5c/f6d 0 2024-09-13T18:30:20.495 INFO:tasks.workunit.client.1.smithi149.stdout:6/361: chown dc/d15/f2b 1079226 1 2024-09-13T18:30:20.521 INFO:tasks.workunit.client.1.smithi149.stdout:6/362: dwrite dc/f5a [0,4194304] 0 2024-09-13T18:30:20.522 INFO:tasks.workunit.client.1.smithi149.stdout:6/363: write dc/d15/d23/d57/d5c/f6d [3389773,83643] 0 2024-09-13T18:30:20.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.519+0000 7f381293a640 1 -- 172.21.15.38:0/1439672496 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f380c1088d0 con 0x7f380c0fde20 2024-09-13T18:30:20.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.520+0000 7f3809ffb640 1 -- 172.21.15.38:0/1439672496 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7f37f405a380 con 0x7f380c0fde20 2024-09-13T18:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:30:20.523 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:30:20.524 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:30:20.525 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:30:20.526 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:30:20.526 INFO:tasks.workunit.client.1.smithi149.stdout:7/348: dwrite d7/d9/d1c/d1f/d3d/f6e [0,4194304] 0 2024-09-13T18:30:20.526 INFO:tasks.workunit.client.1.smithi149.stdout:2/329: dwrite db/d1b/d1c/d20/d3a/f2e [0,4194304] 0 2024-09-13T18:30:20.527 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:30:20.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.522+0000 7f381293a640 1 -- 172.21.15.38:0/1439672496 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f37ec06cde0 msgr2=0x7f37ec06f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.522+0000 7f381293a640 1 --2- 172.21.15.38:0/1439672496 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f37ec06cde0 0x7f37ec06f2a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f380c19d030 tx=0x7f37fc031400 comp rx=0 tx=0).stop 2024-09-13T18:30:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.522+0000 7f381293a640 1 -- 172.21.15.38:0/1439672496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f380c0fde20 msgr2=0x7f380c19bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.522+0000 7f381293a640 1 --2- 172.21.15.38:0/1439672496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f380c0fde20 0x7f380c19bb10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f37f400eaf0 tx=0x7f37f400c2d0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.522+0000 7f381293a640 1 -- 172.21.15.38:0/1439672496 shutdown_connections 2024-09-13T18:30:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.522+0000 7f381293a640 1 --2- 172.21.15.38:0/1439672496 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f37ec06cde0 0x7f37ec06f2a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.522+0000 7f381293a640 1 --2- 172.21.15.38:0/1439672496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f380c100e00 0x7f380c19c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.522+0000 7f381293a640 1 --2- 172.21.15.38:0/1439672496 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f380c0fde20 0x7f380c19bb10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.522+0000 7f381293a640 1 -- 172.21.15.38:0/1439672496 >> 172.21.15.38:0/1439672496 conn(0x7f380c0f9950 msgr2=0x7f380c102530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.522+0000 7f381293a640 1 -- 172.21.15.38:0/1439672496 shutdown_connections 2024-09-13T18:30:20.528 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.523+0000 7f381293a640 1 -- 172.21.15.38:0/1439672496 wait complete. 2024-09-13T18:30:20.529 INFO:tasks.workunit.client.1.smithi149.stdout:2/330: creat db/d1b/d6c/f73 x:0 0 0 2024-09-13T18:30:20.529 INFO:tasks.workunit.client.1.smithi149.stdout:6/364: rmdir dc/d15/d23/d5f 39 2024-09-13T18:30:20.529 INFO:tasks.workunit.client.1.smithi149.stdout:6/365: getdents dc/d15/d54/d5e 0 2024-09-13T18:30:20.529 INFO:tasks.workunit.client.1.smithi149.stdout:2/331: link db/d1b/d1c/d20/f50 db/d1b/d48/f74 0 2024-09-13T18:30:20.530 INFO:tasks.workunit.client.1.smithi149.stdout:6/366: creat dc/d15/d23/d57/d5c/d64/f6e x:0 0 0 2024-09-13T18:30:20.531 INFO:tasks.workunit.client.1.smithi149.stdout:4/320: sync 2024-09-13T18:30:20.531 INFO:tasks.workunit.client.1.smithi149.stdout:5/305: sync 2024-09-13T18:30:20.532 INFO:tasks.workunit.client.1.smithi149.stdout:6/367: symlink dc/l6f 0 2024-09-13T18:30:20.532 INFO:tasks.workunit.client.1.smithi149.stdout:6/368: stat dc/d15/f2b 0 2024-09-13T18:30:20.532 INFO:tasks.workunit.client.1.smithi149.stdout:6/369: readlink dc/l4e 0 2024-09-13T18:30:20.532 INFO:tasks.workunit.client.1.smithi149.stdout:6/370: write dc/d15/d23/f31 [4439320,45295] 0 2024-09-13T18:30:20.534 INFO:tasks.workunit.client.1.smithi149.stdout:6/371: mkdir dc/d70 0 2024-09-13T18:30:20.534 INFO:tasks.workunit.client.1.smithi149.stdout:7/349: dread d7/f22 [0,4194304] 0 2024-09-13T18:30:20.534 INFO:tasks.workunit.client.1.smithi149.stdout:6/372: write dc/d15/f21 [35327,83610] 0 2024-09-13T18:30:20.535 INFO:tasks.workunit.client.1.smithi149.stdout:7/350: write d7/f22 [4092538,66785] 0 2024-09-13T18:30:20.535 INFO:tasks.workunit.client.1.smithi149.stdout:7/351: dread - d7/d9/d1c/d1f/f73 zero size 2024-09-13T18:30:20.536 INFO:tasks.workunit.client.1.smithi149.stdout:6/373: link dc/d15/l33 dc/d15/l71 0 2024-09-13T18:30:20.536 INFO:tasks.workunit.client.1.smithi149.stdout:6/374: write dc/d15/f20 [8838320,77850] 0 2024-09-13T18:30:20.537 INFO:tasks.workunit.client.1.smithi149.stdout:7/352: mknod d7/d9/d1c/d34/d4e/c7a 0 2024-09-13T18:30:20.537 INFO:tasks.workunit.client.1.smithi149.stdout:7/353: readlink d7/d9/d1c/d51/l70 0 2024-09-13T18:30:20.540 INFO:tasks.workunit.client.1.smithi149.stdout:6/375: symlink dc/d15/d23/d57/d5c/d64/l72 0 2024-09-13T18:30:20.541 INFO:tasks.workunit.client.1.smithi149.stdout:7/354: mkdir d7/d9/d1c/d1f/d21/d7b 0 2024-09-13T18:30:20.541 INFO:tasks.workunit.client.1.smithi149.stdout:6/376: dread fa [0,4194304] 0 2024-09-13T18:30:20.543 INFO:tasks.workunit.client.1.smithi149.stdout:7/355: rename d7/d9/d1c/d1f/d21/l27 to d7/d9/d1c/d34/l7c 0 2024-09-13T18:30:20.544 INFO:tasks.workunit.client.1.smithi149.stdout:6/377: link lb dc/d2f/l73 0 2024-09-13T18:30:20.544 INFO:tasks.workunit.client.1.smithi149.stdout:6/378: fsync dc/f5a 0 2024-09-13T18:30:20.545 INFO:tasks.workunit.client.1.smithi149.stdout:6/379: stat dc/d15/d54/c62 0 2024-09-13T18:30:20.545 INFO:tasks.workunit.client.1.smithi149.stdout:7/356: mknod d7/d9/d1c/c7d 0 2024-09-13T18:30:20.546 INFO:tasks.workunit.client.1.smithi149.stdout:2/332: write db/d1b/d1c/d20/d3a/f2e [731791,113612] 0 2024-09-13T18:30:20.553 INFO:tasks.workunit.client.1.smithi149.stdout:4/321: read df/d11/f34 [4006465,57839] 0 2024-09-13T18:30:20.553 INFO:tasks.workunit.client.1.smithi149.stdout:6/380: fsync dc/d15/d23/f31 0 2024-09-13T18:30:20.553 INFO:tasks.workunit.client.1.smithi149.stdout:6/381: chown dc/d15/f2b 148293 1 2024-09-13T18:30:20.553 INFO:tasks.workunit.client.1.smithi149.stdout:6/382: getdents dc/d70 0 2024-09-13T18:30:20.553 INFO:tasks.workunit.client.1.smithi149.stdout:4/322: creat df/d11/d12/d17/d3d/f73 x:0 0 0 2024-09-13T18:30:20.553 INFO:tasks.workunit.client.1.smithi149.stdout:4/323: write df/d11/d1c/f42 [8463902,26588] 0 2024-09-13T18:30:20.557 INFO:tasks.workunit.client.1.smithi149.stdout:6/383: mknod dc/d15/d54/c74 0 2024-09-13T18:30:20.558 INFO:tasks.workunit.client.1.smithi149.stdout:6/384: mkdir dc/d2f/d75 0 2024-09-13T18:30:20.560 INFO:tasks.workunit.client.1.smithi149.stdout:6/385: unlink dc/f37 0 2024-09-13T18:30:20.571 INFO:tasks.workunit.client.1.smithi149.stdout:7/357: dwrite d7/d9/f72 [0,4194304] 0 2024-09-13T18:30:20.571 INFO:tasks.workunit.client.1.smithi149.stdout:7/358: chown d7/d9/d11/l5e 1 1 2024-09-13T18:30:20.573 INFO:tasks.workunit.client.1.smithi149.stdout:5/306: dwrite d3/d8/f27 [4194304,4194304] 0 2024-09-13T18:30:20.573 INFO:tasks.workunit.client.1.smithi149.stdout:5/307: read d3/d10/d4c/d4e/f50 [583990,30220] 0 2024-09-13T18:30:20.574 INFO:tasks.workunit.client.1.smithi149.stdout:7/359: mknod d7/d9/d1c/d1f/d21/d49/c7e 0 2024-09-13T18:30:20.575 INFO:tasks.workunit.client.1.smithi149.stdout:5/308: rename d3/d10/d32/d54/f48 to d3/f5c 0 2024-09-13T18:30:20.577 INFO:tasks.workunit.client.1.smithi149.stdout:7/360: rename d7/d12/l39 to d7/d9/d1b/d71/l7f 0 2024-09-13T18:30:20.579 INFO:tasks.workunit.client.1.smithi149.stdout:7/361: mknod d7/d9/d1c/d2c/c80 0 2024-09-13T18:30:20.582 INFO:tasks.workunit.client.1.smithi149.stdout:7/362: rename d7/d9/d1c/d2f/c64 to d7/d9/d1c/d1f/d47/c81 0 2024-09-13T18:30:20.589 INFO:tasks.workunit.client.1.smithi149.stdout:6/386: dwrite dc/d15/f55 [0,4194304] 0 2024-09-13T18:30:20.598 INFO:tasks.workunit.client.1.smithi149.stdout:2/333: dwrite db/d10/d12/f3d [0,4194304] 0 2024-09-13T18:30:20.598 INFO:tasks.workunit.client.1.smithi149.stdout:4/324: dwrite df/d11/d12/d21/f24 [0,4194304] 0 2024-09-13T18:30:20.598 INFO:tasks.workunit.client.1.smithi149.stdout:4/325: stat df/d11/d12/d17/d3d 0 2024-09-13T18:30:20.599 INFO:tasks.workunit.client.1.smithi149.stdout:5/309: dwrite d3/d10/d32/f45 [0,4194304] 0 2024-09-13T18:30:20.602 INFO:tasks.workunit.client.1.smithi149.stdout:6/387: dread dc/d2f/f3a [0,4194304] 0 2024-09-13T18:30:20.609 INFO:tasks.workunit.client.1.smithi149.stdout:4/326: rename df/d11/d12/l46 to df/d11/d12/d21/d22/d30/d41/d57/d60/l74 0 2024-09-13T18:30:20.611 INFO:tasks.workunit.client.1.smithi149.stdout:5/310: creat d3/d10/f5d x:0 0 0 2024-09-13T18:30:20.613 INFO:tasks.workunit.client.1.smithi149.stdout:6/388: mkdir dc/d76 0 2024-09-13T18:30:20.614 INFO:tasks.workunit.client.1.smithi149.stdout:5/311: dread d3/f4 [0,4194304] 0 2024-09-13T18:30:20.620 INFO:tasks.workunit.client.1.smithi149.stdout:0/251: sync 2024-09-13T18:30:20.620 INFO:tasks.workunit.client.1.smithi149.stdout:9/247: sync 2024-09-13T18:30:20.620 INFO:tasks.workunit.client.1.smithi149.stdout:1/362: sync 2024-09-13T18:30:20.620 INFO:tasks.workunit.client.1.smithi149.stdout:3/309: sync 2024-09-13T18:30:20.620 INFO:tasks.workunit.client.1.smithi149.stdout:8/280: sync 2024-09-13T18:30:20.620 INFO:tasks.workunit.client.1.smithi149.stdout:3/310: chown d1/d2e/d1d/f2b 7406 1 2024-09-13T18:30:20.621 INFO:tasks.workunit.client.1.smithi149.stdout:9/248: creat d0/f4e x:0 0 0 2024-09-13T18:30:20.621 INFO:tasks.workunit.client.1.smithi149.stdout:9/249: dread - d0/f4e zero size 2024-09-13T18:30:20.621 INFO:tasks.workunit.client.1.smithi149.stdout:0/252: symlink d1/d1b/l55 0 2024-09-13T18:30:20.623 INFO:tasks.workunit.client.1.smithi149.stdout:8/281: link d2/d13/f50 d2/d12/f5c 0 2024-09-13T18:30:20.623 INFO:tasks.workunit.client.1.smithi149.stdout:1/363: dread d9/f3d [0,4194304] 0 2024-09-13T18:30:20.623 INFO:tasks.workunit.client.1.smithi149.stdout:8/282: creat d2/d13/f5d x:0 0 0 2024-09-13T18:30:20.623 INFO:tasks.workunit.client.1.smithi149.stdout:1/364: creat d9/d10/d34/d53/f72 x:0 0 0 2024-09-13T18:30:20.624 INFO:tasks.workunit.client.1.smithi149.stdout:8/283: write d2/d12/f46 [996892,110447] 0 2024-09-13T18:30:20.624 INFO:tasks.workunit.client.1.smithi149.stdout:3/311: symlink d1/d2e/d1d/d49/l69 0 2024-09-13T18:30:20.624 INFO:tasks.workunit.client.1.smithi149.stdout:3/312: readlink d1/d2c/d38/l3b 0 2024-09-13T18:30:20.625 INFO:tasks.workunit.client.1.smithi149.stdout:3/313: fsync d1/f58 0 2024-09-13T18:30:20.625 INFO:tasks.workunit.client.1.smithi149.stdout:3/314: write d1/d4/fd [1161624,82469] 0 2024-09-13T18:30:20.627 INFO:tasks.workunit.client.1.smithi149.stdout:9/250: rename d0/f2a to d0/d18/d19/d3b/f4f 0 2024-09-13T18:30:20.628 INFO:tasks.workunit.client.1.smithi149.stdout:1/365: dread d9/f3d [0,4194304] 0 2024-09-13T18:30:20.628 INFO:tasks.workunit.client.1.smithi149.stdout:6/389: mknod dc/d2f/c77 0 2024-09-13T18:30:20.629 INFO:tasks.workunit.client.1.smithi149.stdout:0/253: creat d1/d1b/f56 x:0 0 0 2024-09-13T18:30:20.629 INFO:tasks.workunit.client.1.smithi149.stdout:0/254: truncate d1/d1b/f38 498515 0 2024-09-13T18:30:20.630 INFO:tasks.workunit.client.1.smithi149.stdout:3/315: creat d1/d12/d20/d54/f6a x:0 0 0 2024-09-13T18:30:20.630 INFO:tasks.workunit.client.1.smithi149.stdout:1/366: rmdir d9/d10/d43 39 2024-09-13T18:30:20.632 INFO:tasks.workunit.client.1.smithi149.stdout:0/255: unlink d1/c25 0 2024-09-13T18:30:20.632 INFO:tasks.workunit.client.1.smithi149.stdout:3/316: dread d1/d2e/d1d/f2b [0,4194304] 0 2024-09-13T18:30:20.632 INFO:tasks.workunit.client.1.smithi149.stdout:3/317: creat d1/d2e/d1d/f6b x:0 0 0 2024-09-13T18:30:20.633 INFO:tasks.workunit.client.1.smithi149.stdout:1/367: mkdir d9/d15/d73 0 2024-09-13T18:30:20.633 INFO:tasks.workunit.client.1.smithi149.stdout:6/390: link dc/d15/d23/d57/d5c/d64/f6e dc/d2f/f78 0 2024-09-13T18:30:20.634 INFO:tasks.workunit.client.1.smithi149.stdout:0/256: link d1/d29/c4f d1/d2/d41/d46/c57 0 2024-09-13T18:30:20.634 INFO:tasks.workunit.client.1.smithi149.stdout:0/257: creat d1/d29/f58 x:0 0 0 2024-09-13T18:30:20.636 INFO:tasks.workunit.client.1.smithi149.stdout:3/318: mkdir d1/d2e/d1d/d6c 0 2024-09-13T18:30:20.637 INFO:tasks.workunit.client.1.smithi149.stdout:1/368: link d9/d15/d40/d4a/d6b/l39 d9/d15/l74 0 2024-09-13T18:30:20.637 INFO:tasks.workunit.client.1.smithi149.stdout:1/369: read - d9/d10/d34/d53/f5f zero size 2024-09-13T18:30:20.637 INFO:tasks.workunit.client.1.smithi149.stdout:1/370: creat d9/d10/d34/d53/d57/f75 x:0 0 0 2024-09-13T18:30:20.637 INFO:tasks.workunit.client.1.smithi149.stdout:1/371: fdatasync d9/d10/d37/f5a 0 2024-09-13T18:30:20.637 INFO:tasks.workunit.client.1.smithi149.stdout:1/372: stat d9/d10/d34/f55 0 2024-09-13T18:30:20.638 INFO:tasks.workunit.client.1.smithi149.stdout:6/391: unlink dc/d15/l2e 0 2024-09-13T18:30:20.639 INFO:tasks.workunit.client.1.smithi149.stdout:1/373: mkdir d9/d10/d3f/d76 0 2024-09-13T18:30:20.641 INFO:tasks.workunit.client.1.smithi149.stdout:6/392: mkdir dc/d15/d54/d5e/d79 0 2024-09-13T18:30:20.644 INFO:tasks.workunit.client.1.smithi149.stdout:6/393: rename dc/f51 to dc/d15/d54/f7a 0 2024-09-13T18:30:20.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.643+0000 7f7d37aef640 1 -- 172.21.15.38:0/3624467969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d300ffb90 msgr2=0x7f7d300fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.643+0000 7f7d37aef640 1 --2- 172.21.15.38:0/3624467969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d300ffb90 0x7f7d300fff90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009880 tx=0x7f7d2c02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.644+0000 7f7d37aef640 1 -- 172.21.15.38:0/3624467969 shutdown_connections 2024-09-13T18:30:20.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.644+0000 7f7d37aef640 1 --2- 172.21.15.38:0/3624467969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d30100d90 0x7f7d30101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.644+0000 7f7d37aef640 1 --2- 172.21.15.38:0/3624467969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d300ffb90 0x7f7d300fff90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.644+0000 7f7d37aef640 1 -- 172.21.15.38:0/3624467969 >> 172.21.15.38:0/3624467969 conn(0x7f7d300fb360 msgr2=0x7f7d300fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:20.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.644+0000 7f7d37aef640 1 -- 172.21.15.38:0/3624467969 shutdown_connections 2024-09-13T18:30:20.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.644+0000 7f7d37aef640 1 -- 172.21.15.38:0/3624467969 wait complete. 2024-09-13T18:30:20.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.645+0000 7f7d37aef640 1 Processor -- start 2024-09-13T18:30:20.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.645+0000 7f7d37aef640 1 -- start start 2024-09-13T18:30:20.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.645+0000 7f7d37aef640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d300ffb90 0x7f7d30195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.645+0000 7f7d37aef640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d30100d90 0x7f7d30195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.645+0000 7f7d37aef640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d301961a0 con 0x7f7d30100d90 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.645+0000 7f7d37aef640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30196310 con 0x7f7d300ffb90 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.645+0000 7f7d3508a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d30100d90 0x7f7d30195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.645+0000 7f7d3508a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d30100d90 0x7f7d30195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45452/0 (socket says 172.21.15.38:45452) 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.645+0000 7f7d3508a640 1 -- 172.21.15.38:0/933208009 learned_addr learned my addr 172.21.15.38:0/933208009 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.646+0000 7f7d3508a640 1 -- 172.21.15.38:0/933208009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d300ffb90 msgr2=0x7f7d30195690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.646+0000 7f7d3508a640 1 --2- 172.21.15.38:0/933208009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d300ffb90 0x7f7d30195690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.646+0000 7f7d3508a640 1 -- 172.21.15.38:0/933208009 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c009560 con 0x7f7d30100d90 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.646+0000 7f7d3508a640 1 --2- 172.21.15.38:0/933208009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d30100d90 0x7f7d30195bd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000b400 tx=0x7f7d2000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.646+0000 7f7d26ffd640 1 -- 172.21.15.38:0/933208009 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d20011800 con 0x7f7d30100d90 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.646+0000 7f7d37aef640 1 -- 172.21.15.38:0/933208009 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3019ad60 con 0x7f7d30100d90 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.646+0000 7f7d26ffd640 1 -- 172.21.15.38:0/933208009 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d20011e00 con 0x7f7d30100d90 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.646+0000 7f7d26ffd640 1 -- 172.21.15.38:0/933208009 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d2000f2e0 con 0x7f7d30100d90 2024-09-13T18:30:20.649 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.646+0000 7f7d37aef640 1 -- 172.21.15.38:0/933208009 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3019b2d0 con 0x7f7d30100d90 2024-09-13T18:30:20.650 INFO:tasks.workunit.client.1.smithi149.stdout:3/319: dread d1/f58 [0,4194304] 0 2024-09-13T18:30:20.650 INFO:tasks.workunit.client.1.smithi149.stdout:3/320: readlink d1/d47/l3a 0 2024-09-13T18:30:20.650 INFO:tasks.workunit.client.1.smithi149.stdout:3/321: fdatasync d1/d21/f27 0 2024-09-13T18:30:20.650 INFO:tasks.workunit.client.1.smithi149.stdout:6/394: truncate dc/d15/f21 2706453 0 2024-09-13T18:30:20.650 INFO:tasks.workunit.client.1.smithi149.stdout:6/395: creat dc/d76/f7b x:0 0 0 2024-09-13T18:30:20.650 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.647+0000 7f7d37aef640 1 -- 172.21.15.38:0/933208009 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d301086e0 con 0x7f7d30100d90 2024-09-13T18:30:20.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.648+0000 7f7d26ffd640 1 -- 172.21.15.38:0/933208009 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f7d20010380 con 0x7f7d30100d90 2024-09-13T18:30:20.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.649+0000 7f7d26ffd640 1 --2- 172.21.15.38:0/933208009 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f7d1c06cd80 0x7f7d1c06f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:20.651 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.649+0000 7f7d26ffd640 1 -- 172.21.15.38:0/933208009 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7d2008c120 con 0x7f7d30100d90 2024-09-13T18:30:20.652 INFO:tasks.workunit.client.1.smithi149.stdout:6/396: truncate dc/d15/f20 4345199 0 2024-09-13T18:30:20.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.651+0000 7f7d3588b640 1 --2- 172.21.15.38:0/933208009 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f7d1c06cd80 0x7f7d1c06f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:20.654 INFO:tasks.workunit.client.1.smithi149.stdout:6/397: mknod dc/d15/c7c 0 2024-09-13T18:30:20.656 INFO:tasks.workunit.client.1.smithi149.stdout:9/251: dread d0/f38 [0,4194304] 0 2024-09-13T18:30:20.656 INFO:tasks.workunit.client.1.smithi149.stdout:9/252: truncate d0/d18/f48 274902 0 2024-09-13T18:30:20.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.654+0000 7f7d3588b640 1 --2- 172.21.15.38:0/933208009 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f7d1c06cd80 0x7f7d1c06f240 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c02a9f0 tx=0x7f7d2c005fd0 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:20.658 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.655+0000 7f7d26ffd640 1 -- 172.21.15.38:0/933208009 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7d20056300 con 0x7f7d30100d90 2024-09-13T18:30:20.663 INFO:tasks.workunit.client.1.smithi149.stdout:8/284: dwrite d2/f9 [4194304,4194304] 0 2024-09-13T18:30:20.663 INFO:tasks.workunit.client.1.smithi149.stdout:0/258: dwrite d1/d1b/f56 [0,4194304] 0 2024-09-13T18:30:20.664 INFO:tasks.workunit.client.1.smithi149.stdout:1/374: dwrite d9/d10/d37/f5a [0,4194304] 0 2024-09-13T18:30:20.669 INFO:tasks.workunit.client.1.smithi149.stdout:9/253: dread d0/d18/d19/f23 [0,4194304] 0 2024-09-13T18:30:20.669 INFO:tasks.workunit.client.1.smithi149.stdout:9/254: readlink d0/l1f 0 2024-09-13T18:30:20.671 INFO:tasks.workunit.client.1.smithi149.stdout:0/259: unlink d1/f2c 0 2024-09-13T18:30:20.673 INFO:tasks.workunit.client.1.smithi149.stdout:1/375: read d9/d15/d40/d4a/d6b/f31 [2060517,122190] 0 2024-09-13T18:30:20.674 INFO:tasks.workunit.client.1.smithi149.stdout:6/398: dwrite dc/d15/d23/f39 [4194304,4194304] 0 2024-09-13T18:30:20.674 INFO:tasks.workunit.client.1.smithi149.stdout:3/322: dwrite d1/d2e/d1d/f6b [0,4194304] 0 2024-09-13T18:30:20.674 INFO:tasks.workunit.client.1.smithi149.stdout:3/323: fdatasync d1/f19 0 2024-09-13T18:30:20.674 INFO:tasks.workunit.client.1.smithi149.stdout:3/324: fdatasync d1/d2e/f55 0 2024-09-13T18:30:20.674 INFO:tasks.workunit.client.1.smithi149.stdout:3/325: write d1/d12/d20/d54/f6a [527071,41948] 0 2024-09-13T18:30:20.675 INFO:tasks.workunit.client.1.smithi149.stdout:8/285: rmdir d2/d12/d2a 39 2024-09-13T18:30:20.675 INFO:tasks.workunit.client.1.smithi149.stdout:9/255: rename d0/d18/d27/l39 to d0/d2e/l50 0 2024-09-13T18:30:20.676 INFO:tasks.workunit.client.1.smithi149.stdout:0/260: creat d1/d29/d31/d44/d47/f59 x:0 0 0 2024-09-13T18:30:20.677 INFO:tasks.workunit.client.1.smithi149.stdout:6/399: readlink dc/d2f/l4a 0 2024-09-13T18:30:20.680 INFO:tasks.workunit.client.1.smithi149.stdout:3/326: truncate d1/f11 471792 0 2024-09-13T18:30:20.680 INFO:tasks.workunit.client.1.smithi149.stdout:3/327: readlink d1/d2e/d1d/l3f 0 2024-09-13T18:30:20.681 INFO:tasks.workunit.client.1.smithi149.stdout:8/286: creat d2/d12/d40/f5e x:0 0 0 2024-09-13T18:30:20.682 INFO:tasks.workunit.client.1.smithi149.stdout:1/376: rename d9/d58/c71 to d9/d10/d43/c77 0 2024-09-13T18:30:20.683 INFO:tasks.workunit.client.1.smithi149.stdout:9/256: creat d0/d18/d19/f51 x:0 0 0 2024-09-13T18:30:20.685 INFO:tasks.workunit.client.1.smithi149.stdout:3/328: mkdir d1/d12/d20/d54/d6d 0 2024-09-13T18:30:20.685 INFO:tasks.workunit.client.1.smithi149.stdout:3/329: fdatasync d1/d47/d30/f5b 0 2024-09-13T18:30:20.687 INFO:tasks.workunit.client.1.smithi149.stdout:9/257: rename d0/c40 to d0/d18/d19/c52 0 2024-09-13T18:30:20.689 INFO:tasks.workunit.client.1.smithi149.stdout:0/261: mkdir d1/d2/d5a 0 2024-09-13T18:30:20.693 INFO:tasks.workunit.client.1.smithi149.stdout:8/287: dread d2/d12/f16 [0,4194304] 0 2024-09-13T18:30:20.699 INFO:tasks.workunit.client.1.smithi149.stdout:3/330: rename d1/d2c/d56/c64 to d1/d12/d20/d54/c6e 0 2024-09-13T18:30:20.700 INFO:tasks.workunit.client.1.smithi149.stdout:9/258: link d0/f3c d0/d18/d19/d3b/f53 0 2024-09-13T18:30:20.701 INFO:tasks.workunit.client.1.smithi149.stdout:0/262: read d1/d29/d31/f39 [1224328,5795] 0 2024-09-13T18:30:20.701 INFO:tasks.workunit.client.1.smithi149.stdout:0/263: write d1/d1b/f38 [930045,105618] 0 2024-09-13T18:30:20.702 INFO:tasks.workunit.client.1.smithi149.stdout:1/377: dwrite d9/d10/d37/d38/f4e [0,4194304] 0 2024-09-13T18:30:20.702 INFO:tasks.workunit.client.1.smithi149.stdout:8/288: truncate d2/fe 4100008 0 2024-09-13T18:30:20.702 INFO:tasks.workunit.client.1.smithi149.stdout:8/289: dread - d2/d12/d1b/f4c zero size 2024-09-13T18:30:20.703 INFO:tasks.workunit.client.1.smithi149.stdout:0/264: truncate d1/d2/f12 3218043 0 2024-09-13T18:30:20.705 INFO:tasks.workunit.client.1.smithi149.stdout:1/378: symlink d9/d15/d40/d4a/l78 0 2024-09-13T18:30:20.705 INFO:tasks.workunit.client.1.smithi149.stdout:1/379: fdatasync d9/d10/d37/d38/f4e 0 2024-09-13T18:30:20.709 INFO:tasks.workunit.client.1.smithi149.stdout:6/400: read dc/d15/f20 [1807080,82512] 0 2024-09-13T18:30:20.709 INFO:tasks.workunit.client.1.smithi149.stdout:6/401: fdatasync dc/f3f 0 2024-09-13T18:30:20.710 INFO:tasks.workunit.client.1.smithi149.stdout:6/402: mknod dc/d15/d23/c7d 0 2024-09-13T18:30:20.717 INFO:tasks.workunit.client.1.smithi149.stdout:6/403: creat dc/d2f/d75/f7e x:0 0 0 2024-09-13T18:30:20.718 INFO:tasks.workunit.client.1.smithi149.stdout:6/404: unlink fa 0 2024-09-13T18:30:20.718 INFO:tasks.workunit.client.1.smithi149.stdout:6/405: stat f5 0 2024-09-13T18:30:20.719 INFO:tasks.workunit.client.1.smithi149.stdout:3/331: dread d1/d2e/d1d/f6b [0,4194304] 0 2024-09-13T18:30:20.720 INFO:tasks.workunit.client.1.smithi149.stdout:6/406: creat dc/d15/d23/d5b/f7f x:0 0 0 2024-09-13T18:30:20.722 INFO:tasks.workunit.client.1.smithi149.stdout:9/259: dread d0/f1a [0,4194304] 0 2024-09-13T18:30:20.722 INFO:tasks.workunit.client.1.smithi149.stdout:9/260: chown d0/d18/d19/c1e 70 1 2024-09-13T18:30:20.722 INFO:tasks.workunit.client.1.smithi149.stdout:9/261: fsync d0/d18/d19/f51 0 2024-09-13T18:30:20.722 INFO:tasks.workunit.client.1.smithi149.stdout:9/262: dread - d0/f4e zero size 2024-09-13T18:30:20.722 INFO:tasks.workunit.client.1.smithi149.stdout:9/263: write d0/d18/d19/f32 [8520,117227] 0 2024-09-13T18:30:20.726 INFO:tasks.workunit.client.1.smithi149.stdout:9/264: rmdir d0/d33 0 2024-09-13T18:30:20.727 INFO:tasks.workunit.client.1.smithi149.stdout:8/290: dwrite d2/d12/f3d [0,4194304] 0 2024-09-13T18:30:20.730 INFO:tasks.workunit.client.1.smithi149.stdout:9/265: mkdir d0/d47/d54 0 2024-09-13T18:30:20.731 INFO:tasks.workunit.client.1.smithi149.stdout:9/266: write d0/fe [3827671,91294] 0 2024-09-13T18:30:20.731 INFO:tasks.workunit.client.1.smithi149.stdout:8/291: mknod d2/d12/d2a/d4d/c5f 0 2024-09-13T18:30:20.731 INFO:tasks.workunit.client.1.smithi149.stdout:3/332: write d1/d4/f2f [3813726,56447] 0 2024-09-13T18:30:20.734 INFO:tasks.workunit.client.1.smithi149.stdout:9/267: unlink d0/d18/f48 0 2024-09-13T18:30:20.736 INFO:tasks.workunit.client.1.smithi149.stdout:8/292: creat d2/d12/d2a/d4d/f60 x:0 0 0 2024-09-13T18:30:20.736 INFO:tasks.workunit.client.1.smithi149.stdout:8/293: read - d2/d12/d40/f5e zero size 2024-09-13T18:30:20.736 INFO:tasks.workunit.client.1.smithi149.stdout:8/294: write d2/d12/f2f [712607,122226] 0 2024-09-13T18:30:20.737 INFO:tasks.workunit.client.1.smithi149.stdout:3/333: mkdir d1/d2e/d6f 0 2024-09-13T18:30:20.739 INFO:tasks.workunit.client.1.smithi149.stdout:9/268: rename d0/d2e/d42/f49 to d0/d47/d54/f55 0 2024-09-13T18:30:20.739 INFO:tasks.workunit.client.1.smithi149.stdout:0/265: dwrite d1/f21 [0,4194304] 0 2024-09-13T18:30:20.739 INFO:tasks.workunit.client.1.smithi149.stdout:6/407: dwrite dc/f3f [0,4194304] 0 2024-09-13T18:30:20.740 INFO:tasks.workunit.client.1.smithi149.stdout:3/334: unlink d1/d47/d30/f59 0 2024-09-13T18:30:20.743 INFO:tasks.workunit.client.1.smithi149.stdout:9/269: rename d0/f1a to d0/d18/d19/f56 0 2024-09-13T18:30:20.747 INFO:tasks.workunit.client.1.smithi149.stdout:3/335: rename d1/d2e/c40 to d1/d2c/d56/c70 0 2024-09-13T18:30:20.748 INFO:tasks.workunit.client.1.smithi149.stdout:0/266: write d1/d1b/f56 [1027439,26713] 0 2024-09-13T18:30:20.749 INFO:tasks.workunit.client.1.smithi149.stdout:9/270: mknod d0/d2e/c57 0 2024-09-13T18:30:20.750 INFO:tasks.workunit.client.1.smithi149.stdout:8/295: dread d2/f34 [0,4194304] 0 2024-09-13T18:30:20.750 INFO:tasks.workunit.client.1.smithi149.stdout:8/296: creat d2/d13/d3a/f61 x:0 0 0 2024-09-13T18:30:20.751 INFO:tasks.workunit.client.1.smithi149.stdout:6/408: write dc/d2f/f48 [23765,121989] 0 2024-09-13T18:30:20.751 INFO:tasks.workunit.client.1.smithi149.stdout:6/409: fdatasync dc/f53 0 2024-09-13T18:30:20.751 INFO:tasks.workunit.client.1.smithi149.stdout:6/410: chown dc/d15/d23/d57/d5c 782045 1 2024-09-13T18:30:20.752 INFO:tasks.workunit.client.1.smithi149.stdout:0/267: creat d1/d2/f5b x:0 0 0 2024-09-13T18:30:20.755 INFO:tasks.workunit.client.1.smithi149.stdout:8/297: mkdir d2/d62 0 2024-09-13T18:30:20.757 INFO:tasks.workunit.client.1.smithi149.stdout:6/411: mknod dc/d15/d54/c80 0 2024-09-13T18:30:20.761 INFO:tasks.workunit.client.1.smithi149.stdout:0/268: rename d1/d2/d41/d46/c57 to d1/d29/d31/c5c 0 2024-09-13T18:30:20.763 INFO:tasks.workunit.client.1.smithi149.stdout:0/269: unlink d1/d1b/f38 0 2024-09-13T18:30:20.765 INFO:tasks.workunit.client.1.smithi149.stdout:3/336: dwrite d1/d47/d30/f3c [0,4194304] 0 2024-09-13T18:30:20.766 INFO:tasks.workunit.client.1.smithi149.stdout:9/271: write d0/d18/d19/f23 [1382461,87143] 0 2024-09-13T18:30:20.770 INFO:tasks.workunit.client.1.smithi149.stdout:9/272: creat d0/d2e/f58 x:0 0 0 2024-09-13T18:30:20.778 INFO:tasks.workunit.client.1.smithi149.stdout:8/298: dwrite d2/f42 [4194304,4194304] 0 2024-09-13T18:30:20.780 INFO:tasks.workunit.client.1.smithi149.stdout:3/337: dread d1/d4/fd [0,4194304] 0 2024-09-13T18:30:20.781 INFO:tasks.workunit.client.1.smithi149.stdout:8/299: creat d2/f63 x:0 0 0 2024-09-13T18:30:20.781 INFO:tasks.workunit.client.1.smithi149.stdout:8/300: fsync d2/fc 0 2024-09-13T18:30:20.782 INFO:tasks.workunit.client.1.smithi149.stdout:8/301: mknod d2/d52/c64 0 2024-09-13T18:30:20.784 INFO:tasks.workunit.client.1.smithi149.stdout:8/302: rmdir d2/d12/d2a 39 2024-09-13T18:30:20.784 INFO:tasks.workunit.client.1.smithi149.stdout:8/303: chown d2/d13/f50 106 1 2024-09-13T18:30:20.784 INFO:tasks.workunit.client.1.smithi149.stdout:8/304: write d2/d12/f5a [805986,8593] 0 2024-09-13T18:30:20.784 INFO:tasks.workunit.client.1.smithi149.stdout:8/305: chown d2/d12/d1b/l27 655 1 2024-09-13T18:30:20.792 INFO:tasks.workunit.client.1.smithi149.stdout:6/412: dwrite dc/f5a [0,4194304] 0 2024-09-13T18:30:20.792 INFO:tasks.workunit.client.1.smithi149.stdout:0/270: dwrite d1/f13 [0,4194304] 0 2024-09-13T18:30:20.798 INFO:tasks.workunit.client.1.smithi149.stdout:8/306: rmdir d2 39 2024-09-13T18:30:20.804 INFO:tasks.workunit.client.1.smithi149.stdout:9/273: dwrite d0/d18/d19/f32 [0,4194304] 0 2024-09-13T18:30:20.811 INFO:tasks.workunit.client.1.smithi149.stdout:0/271: write d1/f13 [3988029,30009] 0 2024-09-13T18:30:20.812 INFO:tasks.workunit.client.1.smithi149.stdout:0/272: chown d1/d2/c1d 29 1 2024-09-13T18:30:20.813 INFO:tasks.workunit.client.1.smithi149.stdout:0/273: symlink d1/d2/l5d 0 2024-09-13T18:30:20.818 INFO:tasks.workunit.client.1.smithi149.stdout:9/274: dread d0/d18/d19/f24 [4194304,4194304] 0 2024-09-13T18:30:20.819 INFO:tasks.workunit.client.1.smithi149.stdout:9/275: mkdir d0/d2e/d42/d59 0 2024-09-13T18:30:20.819 INFO:tasks.workunit.client.1.smithi149.stdout:9/276: write d0/f9 [1956081,16953] 0 2024-09-13T18:30:20.820 INFO:tasks.workunit.client.1.smithi149.stdout:9/277: dread - d0/f3c zero size 2024-09-13T18:30:20.820 INFO:tasks.workunit.client.1.smithi149.stdout:9/278: read d0/fe [946404,113136] 0 2024-09-13T18:30:20.820 INFO:tasks.workunit.client.1.smithi149.stdout:3/338: dwrite d1/d21/f63 [0,4194304] 0 2024-09-13T18:30:20.820 INFO:tasks.workunit.client.1.smithi149.stdout:3/339: creat d1/d47/d30/f71 x:0 0 0 2024-09-13T18:30:20.821 INFO:tasks.workunit.client.1.smithi149.stdout:6/413: dwrite dc/d2f/f6c [0,4194304] 0 2024-09-13T18:30:20.827 INFO:tasks.workunit.client.1.smithi149.stdout:8/307: dwrite d2/d12/f5c [0,4194304] 0 2024-09-13T18:30:20.827 INFO:tasks.workunit.client.1.smithi149.stdout:0/274: truncate d1/f21 2620383 0 2024-09-13T18:30:20.828 INFO:tasks.workunit.client.1.smithi149.stdout:6/414: dread dc/d15/d23/f4c [4194304,4194304] 0 2024-09-13T18:30:20.829 INFO:tasks.workunit.client.1.smithi149.stdout:6/415: dread - dc/d15/d23/d5b/f7f zero size 2024-09-13T18:30:20.831 INFO:tasks.workunit.client.1.smithi149.stdout:8/308: rename d2/d12/d2a/l2d to d2/d13/d3a/l65 0 2024-09-13T18:30:20.832 INFO:tasks.workunit.client.1.smithi149.stdout:0/275: rmdir d1/d2/d41/d46 39 2024-09-13T18:30:20.832 INFO:tasks.workunit.client.1.smithi149.stdout:0/276: write d1/d29/f58 [623936,68681] 0 2024-09-13T18:30:20.833 INFO:tasks.workunit.client.1.smithi149.stdout:6/416: rename dc/d15/d23/d57/d5c/f6d to dc/d15/d23/d5b/f81 0 2024-09-13T18:30:20.834 INFO:tasks.workunit.client.1.smithi149.stdout:8/309: mkdir d2/d12/d1b/d66 0 2024-09-13T18:30:20.835 INFO:tasks.workunit.client.1.smithi149.stdout:6/417: symlink dc/d15/d23/d5b/l82 0 2024-09-13T18:30:20.835 INFO:tasks.workunit.client.1.smithi149.stdout:6/418: truncate dc/d15/d23/d5b/f7f 427528 0 2024-09-13T18:30:20.836 INFO:tasks.workunit.client.1.smithi149.stdout:8/310: mknod d2/d62/c67 0 2024-09-13T18:30:20.836 INFO:tasks.workunit.client.1.smithi149.stdout:8/311: stat d2/d12/d40/f5e 0 2024-09-13T18:30:20.836 INFO:tasks.workunit.client.1.smithi149.stdout:0/277: symlink d1/d2/l5e 0 2024-09-13T18:30:20.837 INFO:tasks.workunit.client.1.smithi149.stdout:0/278: creat d1/f5f x:0 0 0 2024-09-13T18:30:20.837 INFO:tasks.workunit.client.1.smithi149.stdout:4/327: sync 2024-09-13T18:30:20.837 INFO:tasks.workunit.client.1.smithi149.stdout:5/312: sync 2024-09-13T18:30:20.837 INFO:tasks.workunit.client.1.smithi149.stdout:7/363: sync 2024-09-13T18:30:20.837 INFO:tasks.workunit.client.1.smithi149.stdout:2/334: sync 2024-09-13T18:30:20.837 INFO:tasks.workunit.client.1.smithi149.stdout:4/328: fdatasync df/d11/d12/d21/d22/f62 0 2024-09-13T18:30:20.840 INFO:tasks.workunit.client.1.smithi149.stdout:0/279: mknod d1/d29/d31/c60 0 2024-09-13T18:30:20.840 INFO:tasks.workunit.client.1.smithi149.stdout:3/340: write d1/d47/d30/f5b [4117720,49086] 0 2024-09-13T18:30:20.841 INFO:tasks.workunit.client.1.smithi149.stdout:3/341: write d1/d2e/f37 [452801,51080] 0 2024-09-13T18:30:20.841 INFO:tasks.workunit.client.1.smithi149.stdout:3/342: write d1/f19 [2277452,31567] 0 2024-09-13T18:30:20.841 INFO:tasks.workunit.client.1.smithi149.stdout:3/343: readlink d1/d2c/l44 0 2024-09-13T18:30:20.841 INFO:tasks.workunit.client.1.smithi149.stdout:2/335: rmdir db/d54 0 2024-09-13T18:30:20.841 INFO:tasks.workunit.client.1.smithi149.stdout:7/364: mknod d7/d76/c82 0 2024-09-13T18:30:20.841 INFO:tasks.workunit.client.1.smithi149.stdout:7/365: getdents d7/d9/d1c/d1f/d21/d7b 0 2024-09-13T18:30:20.842 INFO:tasks.workunit.client.1.smithi149.stdout:7/366: dread - d7/d9/d1c/d1f/d21/f77 zero size 2024-09-13T18:30:20.843 INFO:tasks.workunit.client.1.smithi149.stdout:0/280: rmdir d1/d29/d31/d44 39 2024-09-13T18:30:20.843 INFO:tasks.workunit.client.1.smithi149.stdout:3/344: creat d1/d12/d20/d54/d6d/f72 x:0 0 0 2024-09-13T18:30:20.846 INFO:tasks.workunit.client.1.smithi149.stdout:6/419: rmdir dc/d2f/d75 39 2024-09-13T18:30:20.846 INFO:tasks.workunit.client.1.smithi149.stdout:6/420: truncate dc/d15/d54/f7a 1282909 0 2024-09-13T18:30:20.846 INFO:tasks.workunit.client.1.smithi149.stdout:6/421: read dc/d15/f36 [4184853,36116] 0 2024-09-13T18:30:20.849 INFO:tasks.workunit.client.1.smithi149.stdout:2/336: getdents db/d1b/d1c/d20/d2b/d3e 0 2024-09-13T18:30:20.850 INFO:tasks.workunit.client.1.smithi149.stdout:0/281: link d1/d29/d31/f52 d1/d2/f61 0 2024-09-13T18:30:20.850 INFO:tasks.workunit.client.1.smithi149.stdout:7/367: dread d7/d9/d1c/d51/f61 [0,4194304] 0 2024-09-13T18:30:20.851 INFO:tasks.workunit.client.1.smithi149.stdout:6/422: mknod dc/d15/d23/d57/c83 0 2024-09-13T18:30:20.852 INFO:tasks.workunit.client.1.smithi149.stdout:6/423: chown dc/d2f/f48 10 1 2024-09-13T18:30:20.852 INFO:tasks.workunit.client.1.smithi149.stdout:2/337: mkdir db/d1b/d1c/d20/d3a/d75 0 2024-09-13T18:30:20.856 INFO:tasks.workunit.client.1.smithi149.stdout:2/338: mknod db/d1b/d1c/d20/d3a/d75/c76 0 2024-09-13T18:30:20.857 INFO:tasks.workunit.client.1.smithi149.stdout:7/368: getdents d7/d9 0 2024-09-13T18:30:20.857 INFO:tasks.workunit.client.1.smithi149.stdout:7/369: write d7/d9/d1c/d2c/f38 [3557800,73629] 0 2024-09-13T18:30:20.857 INFO:tasks.workunit.client.1.smithi149.stdout:7/370: fsync d7/ff 0 2024-09-13T18:30:20.857 INFO:tasks.workunit.client.1.smithi149.stdout:7/371: truncate d7/d9/f46 620552 0 2024-09-13T18:30:20.858 INFO:tasks.workunit.client.1.smithi149.stdout:2/339: symlink db/d10/d12/l77 0 2024-09-13T18:30:20.861 INFO:tasks.workunit.client.1.smithi149.stdout:2/340: unlink db/d1b/d1c/d20/d2b/c5f 0 2024-09-13T18:30:20.870 INFO:tasks.workunit.client.1.smithi149.stdout:3/345: dread d1/f19 [0,4194304] 0 2024-09-13T18:30:20.870 INFO:tasks.workunit.client.1.smithi149.stdout:3/346: write d1/d4/f2f [8960829,85767] 0 2024-09-13T18:30:20.870 INFO:tasks.workunit.client.1.smithi149.stdout:3/347: chown d1/d47 2535137 1 2024-09-13T18:30:20.870 INFO:tasks.workunit.client.1.smithi149.stdout:3/348: chown d1/l7 340 1 2024-09-13T18:30:20.871 INFO:tasks.workunit.client.1.smithi149.stdout:8/312: dwrite d2/d12/f57 [0,4194304] 0 2024-09-13T18:30:20.871 INFO:tasks.workunit.client.1.smithi149.stdout:8/313: chown d2/d13/d3a/f61 0 1 2024-09-13T18:30:20.871 INFO:tasks.workunit.client.1.smithi149.stdout:8/314: fdatasync d2/d12/d40/f5e 0 2024-09-13T18:30:20.873 INFO:tasks.workunit.client.1.smithi149.stdout:3/349: mknod d1/d2c/d56/c73 0 2024-09-13T18:30:20.879 INFO:tasks.workunit.client.1.smithi149.stdout:5/313: dwrite d3/d10/d32/f2e [0,4194304] 0 2024-09-13T18:30:20.883 INFO:tasks.workunit.client.1.smithi149.stdout:2/341: dread db/d1b/d48/f74 [0,4194304] 0 2024-09-13T18:30:20.884 INFO:tasks.workunit.client.1.smithi149.stdout:2/342: symlink db/d1b/d2f/l78 0 2024-09-13T18:30:20.884 INFO:tasks.workunit.client.1.smithi149.stdout:2/343: write db/d1b/d2f/f52 [723028,63367] 0 2024-09-13T18:30:20.888 INFO:tasks.workunit.client.1.smithi149.stdout:6/424: dwrite dc/d15/f3d [0,4194304] 0 2024-09-13T18:30:20.891 INFO:tasks.workunit.client.1.smithi149.stdout:6/425: creat dc/d15/d23/d57/d5c/f84 x:0 0 0 2024-09-13T18:30:20.893 INFO:tasks.workunit.client.1.smithi149.stdout:6/426: getdents dc/d2f 0 2024-09-13T18:30:20.894 INFO:tasks.workunit.client.1.smithi149.stdout:0/282: dwrite d1/d2/fb [0,4194304] 0 2024-09-13T18:30:20.894 INFO:tasks.workunit.client.1.smithi149.stdout:3/350: dread d1/d47/f26 [0,4194304] 0 2024-09-13T18:30:20.894 INFO:tasks.workunit.client.1.smithi149.stdout:4/329: dwrite df/d11/d12/d17/d3d/f40 [0,4194304] 0 2024-09-13T18:30:20.894 INFO:tasks.workunit.client.1.smithi149.stdout:3/351: fdatasync d1/d2e/f17 0 2024-09-13T18:30:20.899 INFO:tasks.workunit.client.1.smithi149.stdout:7/372: dwrite d7/d9/f1d [0,4194304] 0 2024-09-13T18:30:20.899 INFO:tasks.workunit.client.1.smithi149.stdout:0/283: mkdir d1/d2/d5a/d62 0 2024-09-13T18:30:20.899 INFO:tasks.workunit.client.1.smithi149.stdout:7/373: chown d7/d9/d1c/d34/d4e/c7a 5521464 1 2024-09-13T18:30:20.899 INFO:tasks.workunit.client.1.smithi149.stdout:0/284: fdatasync d1/f13 0 2024-09-13T18:30:20.903 INFO:tasks.workunit.client.1.smithi149.stdout:0/285: unlink d1/d2/c1d 0 2024-09-13T18:30:20.903 INFO:tasks.workunit.client.1.smithi149.stdout:0/286: chown d1/d48 270343353 1 2024-09-13T18:30:20.906 INFO:tasks.workunit.client.1.smithi149.stdout:3/352: write d1/d21/f27 [2158139,92519] 0 2024-09-13T18:30:20.908 INFO:tasks.workunit.client.1.smithi149.stdout:3/353: link d1/d2e/l13 d1/d2e/d6f/l74 0 2024-09-13T18:30:20.910 INFO:tasks.workunit.client.1.smithi149.stdout:3/354: mkdir d1/d48/d75 0 2024-09-13T18:30:20.910 INFO:tasks.workunit.client.1.smithi149.stdout:3/355: chown d1/d12/d20/d54/c6e 483250987 1 2024-09-13T18:30:20.912 INFO:tasks.workunit.client.1.smithi149.stdout:3/356: creat d1/d2c/d56/f76 x:0 0 0 2024-09-13T18:30:20.913 INFO:tasks.workunit.client.1.smithi149.stdout:3/357: creat d1/d12/f77 x:0 0 0 2024-09-13T18:30:20.915 INFO:tasks.workunit.client.1.smithi149.stdout:3/358: mknod d1/d47/d30/d5a/c78 0 2024-09-13T18:30:20.916 INFO:tasks.workunit.client.1.smithi149.stdout:7/374: dread d7/f22 [0,4194304] 0 2024-09-13T18:30:20.916 INFO:tasks.workunit.client.1.smithi149.stdout:7/375: readlink d7/d9/d1c/d34/d4e/l63 0 2024-09-13T18:30:20.916 INFO:tasks.workunit.client.1.smithi149.stdout:7/376: chown d7/d12/c1e 228083 1 2024-09-13T18:30:20.916 INFO:tasks.workunit.client.1.smithi149.stdout:7/377: write d7/d9/d1c/d1f/d21/f4b [669938,93286] 0 2024-09-13T18:30:20.916 INFO:tasks.workunit.client.1.smithi149.stdout:8/315: dwrite d2/d12/f5c [0,4194304] 0 2024-09-13T18:30:20.917 INFO:tasks.workunit.client.1.smithi149.stdout:8/316: dread - d2/d12/d1b/f51 zero size 2024-09-13T18:30:20.917 INFO:tasks.workunit.client.1.smithi149.stdout:8/317: fsync d2/d12/d1b/f4c 0 2024-09-13T18:30:20.917 INFO:tasks.workunit.client.1.smithi149.stdout:8/318: dread - d2/d13/f5d zero size 2024-09-13T18:30:20.919 INFO:tasks.workunit.client.1.smithi149.stdout:7/378: dread d7/d9/d1c/d2f/d31/f3f [0,4194304] 0 2024-09-13T18:30:20.919 INFO:tasks.workunit.client.1.smithi149.stdout:7/379: write d7/d9/d1c/f6a [782358,104668] 0 2024-09-13T18:30:20.919 INFO:tasks.workunit.client.1.smithi149.stdout:7/380: readlink d7/d9/d1c/d2f/d6f/l62 0 2024-09-13T18:30:20.919 INFO:tasks.workunit.client.1.smithi149.stdout:7/381: creat d7/d9/d1c/d1f/d21/f83 x:0 0 0 2024-09-13T18:30:20.919 INFO:tasks.workunit.client.1.smithi149.stdout:7/382: creat d7/f84 x:0 0 0 2024-09-13T18:30:20.920 INFO:tasks.workunit.client.1.smithi149.stdout:7/383: stat d7/d9/d1c/d1f/f25 0 2024-09-13T18:30:20.920 INFO:tasks.workunit.client.1.smithi149.stdout:7/384: creat d7/d9/d1c/d2f/d31/f85 x:0 0 0 2024-09-13T18:30:20.920 INFO:tasks.workunit.client.1.smithi149.stdout:8/319: dread d2/d12/f43 [0,4194304] 0 2024-09-13T18:30:20.921 INFO:tasks.workunit.client.1.smithi149.stdout:8/320: write d2/d12/f43 [795894,95581] 0 2024-09-13T18:30:20.921 INFO:tasks.workunit.client.1.smithi149.stdout:8/321: chown d2/f15 1 1 2024-09-13T18:30:20.921 INFO:tasks.workunit.client.1.smithi149.stdout:8/322: write d2/d12/d1b/f4c [869163,115537] 0 2024-09-13T18:30:20.922 INFO:tasks.workunit.client.1.smithi149.stdout:7/385: mkdir d7/d9/d1c/d51/d52/d86 0 2024-09-13T18:30:20.922 INFO:tasks.workunit.client.1.smithi149.stdout:8/323: creat d2/d12/d1b/f68 x:0 0 0 2024-09-13T18:30:20.923 INFO:tasks.workunit.client.1.smithi149.stdout:7/386: symlink d7/d9/d1c/d1f/d3d/l87 0 2024-09-13T18:30:20.923 INFO:tasks.workunit.client.1.smithi149.stdout:8/324: rmdir d2/d62 39 2024-09-13T18:30:20.934 INFO:tasks.workunit.client.1.smithi149.stdout:2/344: dwrite db/d1b/d1c/d20/d49/f6d [0,4194304] 0 2024-09-13T18:30:20.935 INFO:tasks.workunit.client.1.smithi149.stdout:7/387: dread f5 [0,4194304] 0 2024-09-13T18:30:20.935 INFO:tasks.workunit.client.1.smithi149.stdout:5/314: dwrite d3/fd [0,4194304] 0 2024-09-13T18:30:20.935 INFO:tasks.workunit.client.1.smithi149.stdout:5/315: write d3/d10/f1c [8675259,110238] 0 2024-09-13T18:30:20.936 INFO:tasks.workunit.client.1.smithi149.stdout:2/345: creat db/d13/f79 x:0 0 0 2024-09-13T18:30:20.937 INFO:tasks.workunit.client.1.smithi149.stdout:4/330: dwrite df/d11/d12/d17/d3d/f5d [4194304,4194304] 0 2024-09-13T18:30:20.937 INFO:tasks.workunit.client.1.smithi149.stdout:4/331: chown df/d11/d1c/l1e 1 1 2024-09-13T18:30:20.938 INFO:tasks.workunit.client.1.smithi149.stdout:8/325: write d2/fc [3156657,78396] 0 2024-09-13T18:30:20.938 INFO:tasks.workunit.client.1.smithi149.stdout:6/427: dwrite dc/d15/f55 [0,4194304] 0 2024-09-13T18:30:20.938 INFO:tasks.workunit.client.1.smithi149.stdout:6/428: chown dc/d15/d23/d57/d5c/d64/f6e 31 1 2024-09-13T18:30:20.938 INFO:tasks.workunit.client.1.smithi149.stdout:7/388: symlink d7/d9/d1c/d2f/d31/l88 0 2024-09-13T18:30:20.944 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.941+0000 7f7d37aef640 1 -- 172.21.15.38:0/933208009 --> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d3019b570 con 0x7f7d1c06cd80 2024-09-13T18:30:20.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.943+0000 7f7d26ffd640 1 -- 172.21.15.38:0/933208009 <== mgr.24387 v2:172.21.15.149:6828/2070517292 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f7d3019b570 con 0x7f7d1c06cd80 2024-09-13T18:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [], 2024-09-13T18:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "1/23 daemons upgraded", 2024-09-13T18:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "", 2024-09-13T18:30:20.946 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:30:20.947 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:30:20.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.947+0000 7f7d37aef640 1 -- 172.21.15.38:0/933208009 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f7d1c06cd80 msgr2=0x7f7d1c06f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.947+0000 7f7d37aef640 1 --2- 172.21.15.38:0/933208009 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f7d1c06cd80 0x7f7d1c06f240 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c02a9f0 tx=0x7f7d2c005fd0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.947+0000 7f7d37aef640 1 -- 172.21.15.38:0/933208009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d30100d90 msgr2=0x7f7d30195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.947+0000 7f7d37aef640 1 --2- 172.21.15.38:0/933208009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d30100d90 0x7f7d30195bd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000b400 tx=0x7f7d2000b8c0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.947+0000 7f7d37aef640 1 -- 172.21.15.38:0/933208009 shutdown_connections 2024-09-13T18:30:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.947+0000 7f7d37aef640 1 --2- 172.21.15.38:0/933208009 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f7d1c06cd80 0x7f7d1c06f240 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.947+0000 7f7d37aef640 1 --2- 172.21.15.38:0/933208009 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d30100d90 0x7f7d30195bd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.947+0000 7f7d37aef640 1 --2- 172.21.15.38:0/933208009 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d300ffb90 0x7f7d30195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.947+0000 7f7d37aef640 1 -- 172.21.15.38:0/933208009 >> 172.21.15.38:0/933208009 conn(0x7f7d300fb360 msgr2=0x7f7d30103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.947+0000 7f7d37aef640 1 -- 172.21.15.38:0/933208009 shutdown_connections 2024-09-13T18:30:20.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:20.947+0000 7f7d37aef640 1 -- 172.21.15.38:0/933208009 wait complete. 2024-09-13T18:30:20.951 INFO:tasks.workunit.client.1.smithi149.stdout:8/326: rmdir d2/d12 39 2024-09-13T18:30:20.952 INFO:tasks.workunit.client.1.smithi149.stdout:6/429: mkdir dc/d15/d54/d85 0 2024-09-13T18:30:20.954 INFO:tasks.workunit.client.1.smithi149.stdout:7/389: unlink d7/ff 0 2024-09-13T18:30:20.955 INFO:tasks.workunit.client.1.smithi149.stdout:5/316: getdents d3/d8 0 2024-09-13T18:30:20.955 INFO:tasks.workunit.client.1.smithi149.stdout:5/317: fsync d3/d8/d13/f52 0 2024-09-13T18:30:20.956 INFO:tasks.workunit.client.1.smithi149.stdout:6/430: stat dc/d15/c6b 0 2024-09-13T18:30:20.957 INFO:tasks.workunit.client.1.smithi149.stdout:7/390: symlink d7/d9/d1c/d2f/d6f/l89 0 2024-09-13T18:30:20.957 INFO:tasks.workunit.client.1.smithi149.stdout:7/391: write d7/d9/d1c/d2f/d31/f4f [2613133,11979] 0 2024-09-13T18:30:20.957 INFO:tasks.workunit.client.1.smithi149.stdout:5/318: mkdir d3/d5e 0 2024-09-13T18:30:20.958 INFO:tasks.workunit.client.1.smithi149.stdout:5/319: chown d3/d8/d13/f52 0 1 2024-09-13T18:30:20.958 INFO:tasks.workunit.client.1.smithi149.stdout:5/320: fsync d3/f3d 0 2024-09-13T18:30:20.959 INFO:tasks.workunit.client.1.smithi149.stdout:7/392: creat d7/d76/f8a x:0 0 0 2024-09-13T18:30:20.959 INFO:tasks.workunit.client.1.smithi149.stdout:7/393: fsync d7/d9/d1c/d1f/d21/f77 0 2024-09-13T18:30:20.960 INFO:tasks.workunit.client.1.smithi149.stdout:5/321: rename d3/d8/d13/l26 to d3/d8/d13/l5f 0 2024-09-13T18:30:20.961 INFO:tasks.workunit.client.1.smithi149.stdout:7/394: rename d7/d9/d1b/c2a to d7/c8b 0 2024-09-13T18:30:20.963 INFO:tasks.workunit.client.1.smithi149.stdout:7/395: rename d7/d9/d1c/d1f/d21/d49/l5c to d7/d9/d1c/d2f/d31/l8c 0 2024-09-13T18:30:20.963 INFO:tasks.workunit.client.1.smithi149.stdout:8/327: dread d2/f9 [0,4194304] 0 2024-09-13T18:30:20.963 INFO:tasks.workunit.client.1.smithi149.stdout:2/346: dwrite db/d1b/d2f/f52 [0,4194304] 0 2024-09-13T18:30:20.963 INFO:tasks.workunit.client.1.smithi149.stdout:8/328: truncate d2/d12/d40/f5e 667084 0 2024-09-13T18:30:20.963 INFO:tasks.workunit.client.1.smithi149.stdout:2/347: readlink db/d1b/d2f/d30/l32 0 2024-09-13T18:30:20.963 INFO:tasks.workunit.client.1.smithi149.stdout:8/329: fdatasync d2/d12/d1b/f51 0 2024-09-13T18:30:20.964 INFO:tasks.workunit.client.1.smithi149.stdout:7/396: creat d7/d9/d1c/d1f/d47/f8d x:0 0 0 2024-09-13T18:30:20.965 INFO:tasks.workunit.client.1.smithi149.stdout:8/330: symlink d2/d5b/l69 0 2024-09-13T18:30:20.966 INFO:tasks.workunit.client.1.smithi149.stdout:7/397: symlink d7/d9/d1c/d51/d52/d86/l8e 0 2024-09-13T18:30:20.966 INFO:tasks.workunit.client.1.smithi149.stdout:7/398: write d7/d9/d1c/f29 [2413569,82481] 0 2024-09-13T18:30:20.968 INFO:tasks.workunit.client.1.smithi149.stdout:6/431: read dc/f5a [1831198,16762] 0 2024-09-13T18:30:20.972 INFO:tasks.workunit.client.1.smithi149.stdout:8/331: dread d2/d12/f43 [0,4194304] 0 2024-09-13T18:30:20.972 INFO:tasks.workunit.client.1.smithi149.stdout:7/399: read d7/d12/f2d [756565,23659] 0 2024-09-13T18:30:20.972 INFO:tasks.workunit.client.1.smithi149.stdout:7/400: read - d7/d9/d1c/d2f/d31/f85 zero size 2024-09-13T18:30:20.972 INFO:tasks.workunit.client.1.smithi149.stdout:6/432: rmdir dc/d15/d23/d5b 39 2024-09-13T18:30:20.977 INFO:tasks.workunit.client.1.smithi149.stdout:1/380: sync 2024-09-13T18:30:20.978 INFO:tasks.workunit.client.1.smithi149.stdout:1/381: dread - d9/d10/d34/d53/d57/f64 zero size 2024-09-13T18:30:20.980 INFO:tasks.workunit.client.1.smithi149.stdout:1/382: mkdir d9/d10/d34/d3c/d79 0 2024-09-13T18:30:20.983 INFO:tasks.workunit.client.1.smithi149.stdout:1/383: rename d9/d15/f20 to d9/d10/d3f/f7a 0 2024-09-13T18:30:20.983 INFO:tasks.workunit.client.1.smithi149.stdout:1/384: read - d9/d15/d40/d4a/f69 zero size 2024-09-13T18:30:20.983 INFO:tasks.workunit.client.1.smithi149.stdout:1/385: stat d9/d10/d34/d53/d57/d6c 0 2024-09-13T18:30:20.987 INFO:tasks.workunit.client.1.smithi149.stdout:5/322: dwrite d3/d10/f1c [0,4194304] 0 2024-09-13T18:30:20.987 INFO:tasks.workunit.client.1.smithi149.stdout:5/323: chown d3/d8/c4b 1883 1 2024-09-13T18:30:20.990 INFO:tasks.workunit.client.1.smithi149.stdout:5/324: dread d3/f3d [0,4194304] 0 2024-09-13T18:30:20.993 INFO:tasks.workunit.client.1.smithi149.stdout:1/386: dread d9/d15/f47 [0,4194304] 0 2024-09-13T18:30:20.995 INFO:tasks.workunit.client.1.smithi149.stdout:5/325: mknod d3/d5e/c60 0 2024-09-13T18:30:21.000 INFO:tasks.workunit.client.1.smithi149.stdout:1/387: mkdir d9/d10/d34/d53/d7b 0 2024-09-13T18:30:21.000 INFO:tasks.workunit.client.1.smithi149.stdout:1/388: write d9/d15/d25/f32 [8651524,42948] 0 2024-09-13T18:30:21.001 INFO:tasks.workunit.client.1.smithi149.stdout:1/389: symlink d9/d10/d34/d53/l7c 0 2024-09-13T18:30:21.002 INFO:tasks.workunit.client.1.smithi149.stdout:5/326: dread d3/d10/d32/d54/f31 [0,4194304] 0 2024-09-13T18:30:21.002 INFO:tasks.workunit.client.1.smithi149.stdout:1/390: getdents d9/d10/d37/d38 0 2024-09-13T18:30:21.002 INFO:tasks.workunit.client.1.smithi149.stdout:1/391: fsync d9/d10/d34/d53/f72 0 2024-09-13T18:30:21.003 INFO:tasks.workunit.client.1.smithi149.stdout:5/327: unlink d3/d10/d32/d54/f31 0 2024-09-13T18:30:21.005 INFO:tasks.workunit.client.1.smithi149.stdout:1/392: rename d9/d10/d34/f55 to d9/d10/d34/d53/f7d 0 2024-09-13T18:30:21.005 INFO:tasks.workunit.client.1.smithi149.stdout:1/393: write d9/d15/d40/d4a/d6b/d42/f5b [965525,114680] 0 2024-09-13T18:30:21.005 INFO:tasks.workunit.client.1.smithi149.stdout:1/394: fdatasync d9/d15/f29 0 2024-09-13T18:30:21.005 INFO:tasks.workunit.client.1.smithi149.stdout:1/395: read - d9/d10/d34/d53/d57/f64 zero size 2024-09-13T18:30:21.005 INFO:tasks.workunit.client.1.smithi149.stdout:1/396: write d9/f1c [865299,103016] 0 2024-09-13T18:30:21.006 INFO:tasks.workunit.client.1.smithi149.stdout:1/397: read - d9/d10/d34/d3c/d50/f56 zero size 2024-09-13T18:30:21.006 INFO:tasks.workunit.client.1.smithi149.stdout:5/328: mkdir d3/d10/d4c/d4e/d61 0 2024-09-13T18:30:21.006 INFO:tasks.workunit.client.1.smithi149.stdout:7/401: dwrite d7/d9/d1c/d1f/f73 [0,4194304] 0 2024-09-13T18:30:21.006 INFO:tasks.workunit.client.1.smithi149.stdout:1/398: mknod d9/d10/d34/d53/d57/c7e 0 2024-09-13T18:30:21.007 INFO:tasks.workunit.client.1.smithi149.stdout:6/433: dwrite dc/d15/f35 [0,4194304] 0 2024-09-13T18:30:21.007 INFO:tasks.workunit.client.1.smithi149.stdout:8/332: dwrite d2/d13/f41 [0,4194304] 0 2024-09-13T18:30:21.008 INFO:tasks.workunit.client.1.smithi149.stdout:7/402: write d7/d9/fa [3730386,87024] 0 2024-09-13T18:30:21.008 INFO:tasks.workunit.client.1.smithi149.stdout:6/434: symlink dc/d2f/l86 0 2024-09-13T18:30:21.009 INFO:tasks.workunit.client.1.smithi149.stdout:6/435: dread dc/d15/d23/f40 [4194304,4194304] 0 2024-09-13T18:30:21.010 INFO:tasks.workunit.client.1.smithi149.stdout:7/403: dread d7/d9/d1b/f57 [0,4194304] 0 2024-09-13T18:30:21.011 INFO:tasks.workunit.client.1.smithi149.stdout:9/279: sync 2024-09-13T18:30:21.011 INFO:tasks.workunit.client.1.smithi149.stdout:7/404: chown d7/d9/d1c/d2f/d6f/f45 19 1 2024-09-13T18:30:21.021 INFO:tasks.workunit.client.1.smithi149.stdout:5/329: dread d3/f4 [8388608,4194304] 0 2024-09-13T18:30:21.027 INFO:tasks.workunit.client.1.smithi149.stdout:1/399: dread f2 [0,4194304] 0 2024-09-13T18:30:21.028 INFO:tasks.workunit.client.1.smithi149.stdout:8/333: dread d2/fc [0,4194304] 0 2024-09-13T18:30:21.029 INFO:tasks.workunit.client.1.smithi149.stdout:9/280: dread d0/f38 [0,4194304] 0 2024-09-13T18:30:21.029 INFO:tasks.workunit.client.1.smithi149.stdout:9/281: truncate d0/d18/d19/f24 8785216 0 2024-09-13T18:30:21.030 INFO:tasks.workunit.client.1.smithi149.stdout:5/330: getdents d3 0 2024-09-13T18:30:21.030 INFO:tasks.workunit.client.1.smithi149.stdout:5/331: chown d3/d10/d32/d54/f47 0 1 2024-09-13T18:30:21.031 INFO:tasks.workunit.client.1.smithi149.stdout:1/400: creat d9/d10/d34/d53/d57/d6c/f7f x:0 0 0 2024-09-13T18:30:21.033 INFO:tasks.workunit.client.1.smithi149.stdout:8/334: rename d2/d12/d1b/l2b to d2/d62/l6a 0 2024-09-13T18:30:21.034 INFO:tasks.workunit.client.1.smithi149.stdout:5/332: creat d3/d10/d4c/d4e/f62 x:0 0 0 2024-09-13T18:30:21.035 INFO:tasks.workunit.client.1.smithi149.stdout:9/282: symlink d0/d18/d27/l5a 0 2024-09-13T18:30:21.037 INFO:tasks.workunit.client.1.smithi149.stdout:5/333: unlink d3/c2c 0 2024-09-13T18:30:21.037 INFO:tasks.workunit.client.1.smithi149.stdout:9/283: mknod d0/d47/c5b 0 2024-09-13T18:30:21.038 INFO:tasks.workunit.client.1.smithi149.stdout:6/436: dwrite dc/d2f/f48 [0,4194304] 0 2024-09-13T18:30:21.039 INFO:tasks.workunit.client.1.smithi149.stdout:5/334: mkdir d3/d10/d4c/d4e/d61/d63 0 2024-09-13T18:30:21.039 INFO:tasks.workunit.client.1.smithi149.stdout:5/335: creat d3/d10/f64 x:0 0 0 2024-09-13T18:30:21.040 INFO:tasks.workunit.client.1.smithi149.stdout:6/437: mknod dc/d15/d23/d57/c87 0 2024-09-13T18:30:21.041 INFO:tasks.workunit.client.1.smithi149.stdout:7/405: dwrite d7/d9/d1c/d34/f55 [0,4194304] 0 2024-09-13T18:30:21.044 INFO:tasks.workunit.client.1.smithi149.stdout:6/438: unlink dc/d15/f2b 0 2024-09-13T18:30:21.044 INFO:tasks.workunit.client.1.smithi149.stdout:6/439: readlink dc/d2f/l73 0 2024-09-13T18:30:21.045 INFO:tasks.workunit.client.1.smithi149.stdout:6/440: dread - dc/d15/d23/d5b/f52 zero size 2024-09-13T18:30:21.046 INFO:tasks.workunit.client.1.smithi149.stdout:7/406: symlink d7/d9/d1c/d1f/d47/d53/l8f 0 2024-09-13T18:30:21.048 INFO:tasks.workunit.client.1.smithi149.stdout:7/407: unlink d7/d9/d1b/c65 0 2024-09-13T18:30:21.049 INFO:tasks.workunit.client.1.smithi149.stdout:8/335: dwrite d2/d12/d1b/f4c [0,4194304] 0 2024-09-13T18:30:21.050 INFO:tasks.workunit.client.1.smithi149.stdout:7/408: truncate d7/d9/d1c/d2f/d31/f4f 3231847 0 2024-09-13T18:30:21.054 INFO:tasks.workunit.client.1.smithi149.stdout:8/336: getdents d2/d12 0 2024-09-13T18:30:21.054 INFO:tasks.workunit.client.1.smithi149.stdout:5/336: write d3/d10/f1c [7892237,100626] 0 2024-09-13T18:30:21.057 INFO:tasks.workunit.client.1.smithi149.stdout:8/337: creat d2/d12/d2a/d4d/f6b x:0 0 0 2024-09-13T18:30:21.059 INFO:tasks.workunit.client.1.smithi149.stdout:7/409: rename d7/d12/f2d to d7/d9/d11/d50/f90 0 2024-09-13T18:30:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.057+0000 7f5f25b28640 1 -- 172.21.15.38:0/3591975841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f200fe1e0 msgr2=0x7f5f200fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.057+0000 7f5f25b28640 1 --2- 172.21.15.38:0/3591975841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f200fe1e0 0x7f5f200fe5e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000a990 tx=0x7f5f1002b7d0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.057+0000 7f5f25b28640 1 -- 172.21.15.38:0/3591975841 shutdown_connections 2024-09-13T18:30:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.057+0000 7f5f25b28640 1 --2- 172.21.15.38:0/3591975841 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f200ff3e0 0x7f5f200ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.057+0000 7f5f25b28640 1 --2- 172.21.15.38:0/3591975841 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f200fe1e0 0x7f5f200fe5e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.057+0000 7f5f25b28640 1 -- 172.21.15.38:0/3591975841 >> 172.21.15.38:0/3591975841 conn(0x7f5f200f9950 msgr2=0x7f5f200fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:21.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.058+0000 7f5f25b28640 1 -- 172.21.15.38:0/3591975841 shutdown_connections 2024-09-13T18:30:21.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.058+0000 7f5f25b28640 1 -- 172.21.15.38:0/3591975841 wait complete. 2024-09-13T18:30:21.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.058+0000 7f5f25b28640 1 Processor -- start 2024-09-13T18:30:21.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.059+0000 7f5f25b28640 1 -- start start 2024-09-13T18:30:21.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.059+0000 7f5f25b28640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f200fe1e0 0x7f5f20193280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.059+0000 7f5f1f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f200fe1e0 0x7f5f20193280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.060+0000 7f5f1f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f200fe1e0 0x7f5f20193280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45478/0 (socket says 172.21.15.38:45478) 2024-09-13T18:30:21.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.060+0000 7f5f1f7fe640 1 -- 172.21.15.38:0/261882439 learned_addr learned my addr 172.21.15.38:0/261882439 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:21.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.060+0000 7f5f25b28640 1 --2- 172.21.15.38:0/261882439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f200ff3e0 0x7f5f201937c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.060+0000 7f5f25b28640 1 -- 172.21.15.38:0/261882439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20193d90 con 0x7f5f200fe1e0 2024-09-13T18:30:21.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.060+0000 7f5f25b28640 1 -- 172.21.15.38:0/261882439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20193f00 con 0x7f5f200ff3e0 2024-09-13T18:30:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.060+0000 7f5f1effd640 1 --2- 172.21.15.38:0/261882439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f200ff3e0 0x7f5f201937c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.060+0000 7f5f1f7fe640 1 -- 172.21.15.38:0/261882439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f200ff3e0 msgr2=0x7f5f201937c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.060+0000 7f5f1f7fe640 1 --2- 172.21.15.38:0/261882439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f200ff3e0 0x7f5f201937c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.060+0000 7f5f1f7fe640 1 -- 172.21.15.38:0/261882439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1000a670 con 0x7f5f200fe1e0 2024-09-13T18:30:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.060+0000 7f5f1f7fe640 1 --2- 172.21.15.38:0/261882439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f200fe1e0 0x7f5f20193280 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5f10004750 tx=0x7f5f10005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.061+0000 7f5f1cff9640 1 -- 172.21.15.38:0/261882439 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f100039d0 con 0x7f5f200fe1e0 2024-09-13T18:30:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.061+0000 7f5f1cff9640 1 -- 172.21.15.38:0/261882439 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f1003e4d0 con 0x7f5f200fe1e0 2024-09-13T18:30:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.061+0000 7f5f25b28640 1 -- 172.21.15.38:0/261882439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f20198940 con 0x7f5f200fe1e0 2024-09-13T18:30:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.062+0000 7f5f1cff9640 1 -- 172.21.15.38:0/261882439 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f10047690 con 0x7f5f200fe1e0 2024-09-13T18:30:21.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.062+0000 7f5f25b28640 1 -- 172.21.15.38:0/261882439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f20198e50 con 0x7f5f200fe1e0 2024-09-13T18:30:21.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.063+0000 7f5f1cff9640 1 -- 172.21.15.38:0/261882439 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f5f100477f0 con 0x7f5f200fe1e0 2024-09-13T18:30:21.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.064+0000 7f5f1cff9640 1 --2- 172.21.15.38:0/261882439 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f5f0806cd90 0x7f5f0806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:21.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.064+0000 7f5f1cff9640 1 -- 172.21.15.38:0/261882439 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5f100af090 con 0x7f5f200fe1e0 2024-09-13T18:30:21.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.064+0000 7f5f25b28640 1 -- 172.21.15.38:0/261882439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f20106390 con 0x7f5f200fe1e0 2024-09-13T18:30:21.069 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.066+0000 7f5f1effd640 1 --2- 172.21.15.38:0/261882439 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f5f0806cd90 0x7f5f0806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:21.069 INFO:tasks.workunit.client.1.smithi149.stdout:0/287: sync 2024-09-13T18:30:21.069 INFO:tasks.workunit.client.1.smithi149.stdout:4/332: sync 2024-09-13T18:30:21.069 INFO:tasks.workunit.client.1.smithi149.stdout:2/348: sync 2024-09-13T18:30:21.069 INFO:tasks.workunit.client.1.smithi149.stdout:4/333: chown df/d11/d12/d21/d22/d30/d41/d57/f6a 5207 1 2024-09-13T18:30:21.069 INFO:tasks.workunit.client.1.smithi149.stdout:4/334: chown df/d11/d12/d17/f3a 1505491 1 2024-09-13T18:30:21.069 INFO:tasks.workunit.client.1.smithi149.stdout:3/359: sync 2024-09-13T18:30:21.069 INFO:tasks.workunit.client.1.smithi149.stdout:5/337: read d3/d8/f27 [1339291,81744] 0 2024-09-13T18:30:21.070 INFO:tasks.workunit.client.1.smithi149.stdout:4/335: truncate df/d11/d12/d21/d22/f5e 1373415 0 2024-09-13T18:30:21.070 INFO:tasks.workunit.client.1.smithi149.stdout:4/336: chown df/d11/f34 320948 1 2024-09-13T18:30:21.070 INFO:tasks.workunit.client.1.smithi149.stdout:3/360: symlink d1/d2c/l79 0 2024-09-13T18:30:21.071 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.068+0000 7f5f1effd640 1 --2- 172.21.15.38:0/261882439 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f5f0806cd90 0x7f5f0806f250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5f14005fd0 tx=0x7f5f14005850 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:21.071 INFO:tasks.workunit.client.1.smithi149.stdout:2/349: dread db/d1b/d1c/d20/d3a/f3f [0,4194304] 0 2024-09-13T18:30:21.072 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.069+0000 7f5f1cff9640 1 -- 172.21.15.38:0/261882439 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5f100b4060 con 0x7f5f200fe1e0 2024-09-13T18:30:21.072 INFO:tasks.workunit.client.1.smithi149.stdout:3/361: getdents d1/d12 0 2024-09-13T18:30:21.075 INFO:tasks.workunit.client.1.smithi149.stdout:4/337: write df/f2b [815354,104464] 0 2024-09-13T18:30:21.075 INFO:tasks.workunit.client.1.smithi149.stdout:2/350: unlink db/d1b/d2f/d30/c34 0 2024-09-13T18:30:21.076 INFO:tasks.workunit.client.1.smithi149.stdout:8/338: truncate d2/d12/d1b/f4c 291081 0 2024-09-13T18:30:21.076 INFO:tasks.workunit.client.1.smithi149.stdout:8/339: write d2/d13/f17 [1640438,113574] 0 2024-09-13T18:30:21.079 INFO:tasks.workunit.client.1.smithi149.stdout:4/338: unlink df/d11/d12/d21/d22/d30/d41/d57/l59 0 2024-09-13T18:30:21.080 INFO:tasks.workunit.client.1.smithi149.stdout:2/351: creat db/f7a x:0 0 0 2024-09-13T18:30:21.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:20 smithi038 ceph-mon[27689]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:21.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:20 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2905579974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:30:21.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:20 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1439672496' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:30:21.082 INFO:tasks.workunit.client.1.smithi149.stdout:4/339: mkdir df/d11/d12/d21/d22/d30/d41/d57/d75 0 2024-09-13T18:30:21.085 INFO:tasks.workunit.client.1.smithi149.stdout:5/338: read d3/d10/d32/f38 [3821222,111787] 0 2024-09-13T18:30:21.087 INFO:tasks.workunit.client.1.smithi149.stdout:6/441: dwrite dc/d2f/f78 [0,4194304] 0 2024-09-13T18:30:21.089 INFO:tasks.workunit.client.1.smithi149.stdout:7/410: dwrite d7/d76/f8a [0,4194304] 0 2024-09-13T18:30:21.089 INFO:tasks.workunit.client.1.smithi149.stdout:7/411: write d7/d9/d11/d50/f90 [1670474,18797] 0 2024-09-13T18:30:21.089 INFO:tasks.workunit.client.1.smithi149.stdout:7/412: dread - d7/d9/d1c/d1f/d21/f83 zero size 2024-09-13T18:30:21.096 INFO:tasks.workunit.client.1.smithi149.stdout:6/442: rmdir dc/d15/d23/d5f 39 2024-09-13T18:30:21.096 INFO:tasks.workunit.client.1.smithi149.stdout:6/443: creat dc/d15/d23/d57/d5c/d64/f88 x:0 0 0 2024-09-13T18:30:21.097 INFO:tasks.workunit.client.1.smithi149.stdout:6/444: readlink dc/d2f/l86 0 2024-09-13T18:30:21.101 INFO:tasks.workunit.client.1.smithi149.stdout:6/445: creat dc/d15/d54/d85/f89 x:0 0 0 2024-09-13T18:30:21.104 INFO:tasks.workunit.client.1.smithi149.stdout:6/446: unlink lb 0 2024-09-13T18:30:21.104 INFO:tasks.workunit.client.1.smithi149.stdout:7/413: write d7/d76/f8a [3214903,78089] 0 2024-09-13T18:30:21.106 INFO:tasks.workunit.client.1.smithi149.stdout:6/447: mknod dc/d2f/c8a 0 2024-09-13T18:30:21.106 INFO:tasks.workunit.client.1.smithi149.stdout:7/414: creat d7/d9/d1c/d2c/d60/f91 x:0 0 0 2024-09-13T18:30:21.108 INFO:tasks.workunit.client.1.smithi149.stdout:6/448: creat dc/d15/d23/d5b/f8b x:0 0 0 2024-09-13T18:30:21.109 INFO:tasks.workunit.client.1.smithi149.stdout:7/415: rename d7/d9/d1c/d1f/d47/d53/c68 to d7/d76/c92 0 2024-09-13T18:30:21.110 INFO:tasks.workunit.client.1.smithi149.stdout:6/449: dread dc/d15/d23/f3e [0,4194304] 0 2024-09-13T18:30:21.111 INFO:tasks.workunit.client.1.smithi149.stdout:0/288: dwrite d1/d29/d31/d44/d47/f59 [0,4194304] 0 2024-09-13T18:30:21.111 INFO:tasks.workunit.client.1.smithi149.stdout:5/339: write d3/d10/d32/d54/f2a [1533197,103741] 0 2024-09-13T18:30:21.113 INFO:tasks.workunit.client.1.smithi149.stdout:7/416: mkdir d7/d9/d11/d93 0 2024-09-13T18:30:21.113 INFO:tasks.workunit.client.1.smithi149.stdout:6/450: mkdir dc/d8c 0 2024-09-13T18:30:21.114 INFO:tasks.workunit.client.1.smithi149.stdout:8/340: dwrite d2/f42 [4194304,4194304] 0 2024-09-13T18:30:21.116 INFO:tasks.workunit.client.1.smithi149.stdout:8/341: write d2/d12/f46 [437136,2985] 0 2024-09-13T18:30:21.116 INFO:tasks.workunit.client.1.smithi149.stdout:8/342: write d2/d12/f39 [1540971,93691] 0 2024-09-13T18:30:21.116 INFO:tasks.workunit.client.1.smithi149.stdout:8/343: chown d2/d12/f3f 374167789 1 2024-09-13T18:30:21.117 INFO:tasks.workunit.client.1.smithi149.stdout:8/344: readlink d2/ld 0 2024-09-13T18:30:21.117 INFO:tasks.workunit.client.1.smithi149.stdout:7/417: link d7/d9/d1c/d2f/d31/f85 d7/d9/d11/f94 0 2024-09-13T18:30:21.118 INFO:tasks.workunit.client.1.smithi149.stdout:8/345: symlink d2/d52/l6c 0 2024-09-13T18:30:21.125 INFO:tasks.workunit.client.1.smithi149.stdout:0/289: dread d1/d2/f12 [0,4194304] 0 2024-09-13T18:30:21.125 INFO:tasks.workunit.client.1.smithi149.stdout:3/362: dwrite d1/d4/f2f [4194304,4194304] 0 2024-09-13T18:30:21.125 INFO:tasks.workunit.client.1.smithi149.stdout:0/290: creat d1/d2/d5a/f63 x:0 0 0 2024-09-13T18:30:21.126 INFO:tasks.workunit.client.1.smithi149.stdout:2/352: dwrite db/d10/f14 [0,4194304] 0 2024-09-13T18:30:21.127 INFO:tasks.workunit.client.1.smithi149.stdout:3/363: rename d1/d4/l4e to d1/d12/l7a 0 2024-09-13T18:30:21.129 INFO:tasks.workunit.client.1.smithi149.stdout:2/353: link db/d1b/d1c/d20/d3a/d75/c76 db/d1b/d1c/d20/d49/c7b 0 2024-09-13T18:30:21.134 INFO:tasks.workunit.client.1.smithi149.stdout:6/451: rmdir dc/d15 39 2024-09-13T18:30:21.135 INFO:tasks.workunit.client.1.smithi149.stdout:4/340: dwrite df/d11/d1c/f23 [0,4194304] 0 2024-09-13T18:30:21.137 INFO:tasks.workunit.client.1.smithi149.stdout:7/418: read d7/d9/d1c/d34/f5d [337746,119986] 0 2024-09-13T18:30:21.138 INFO:tasks.workunit.client.1.smithi149.stdout:7/419: chown d7/d9/d1c/d1f/d3d/l41 721 1 2024-09-13T18:30:21.138 INFO:tasks.workunit.client.1.smithi149.stdout:7/420: fdatasync d7/d9/d1c/d1f/d21/d49/f56 0 2024-09-13T18:30:21.138 INFO:tasks.workunit.client.1.smithi149.stdout:7/421: chown d7/d12/c20 1292 1 2024-09-13T18:30:21.146 INFO:tasks.workunit.client.1.smithi149.stdout:4/341: truncate df/d11/d12/d17/f3a 5211394 0 2024-09-13T18:30:21.147 INFO:tasks.workunit.client.1.smithi149.stdout:4/342: truncate df/d11/d12/d21/d22/d30/d56/f5a 738446 0 2024-09-13T18:30:21.147 INFO:tasks.workunit.client.1.smithi149.stdout:4/343: chown df/d11/d12/d17/d3d/f73 2 1 2024-09-13T18:30:21.148 INFO:tasks.workunit.client.1.smithi149.stdout:7/422: mknod d7/d9/d1c/d2f/d6f/c95 0 2024-09-13T18:30:21.150 INFO:tasks.workunit.client.1.smithi149.stdout:7/423: unlink d7/d9/d1c/d2f/d31/f4f 0 2024-09-13T18:30:21.151 INFO:tasks.workunit.client.1.smithi149.stdout:7/424: unlink d7/d9/d1c/d2f/d31/f85 0 2024-09-13T18:30:21.151 INFO:tasks.workunit.client.1.smithi149.stdout:7/425: readlink d7/d9/d1c/l4a 0 2024-09-13T18:30:21.153 INFO:tasks.workunit.client.1.smithi149.stdout:7/426: rename d7/d9/d11/d93 to d7/d9/d1c/d1f/d21/d7b/d96 0 2024-09-13T18:30:21.153 INFO:tasks.workunit.client.1.smithi149.stdout:7/427: write d7/d9/d1b/f57 [689360,24927] 0 2024-09-13T18:30:21.153 INFO:tasks.workunit.client.1.smithi149.stdout:7/428: chown d7/d76/c92 0 1 2024-09-13T18:30:21.154 INFO:tasks.workunit.client.1.smithi149.stdout:2/354: dread db/d1b/d1c/f3c [0,4194304] 0 2024-09-13T18:30:21.155 INFO:tasks.workunit.client.1.smithi149.stdout:7/429: write d7/d9/d1c/d2f/d31/f5b [134233,100423] 0 2024-09-13T18:30:21.155 INFO:tasks.workunit.client.1.smithi149.stdout:2/355: rename db/ff to db/d13/d70/f7c 0 2024-09-13T18:30:21.156 INFO:tasks.workunit.client.1.smithi149.stdout:2/356: dread - db/d1b/d48/f56 zero size 2024-09-13T18:30:21.156 INFO:tasks.workunit.client.1.smithi149.stdout:2/357: rename db/d10/c51 to db/d1b/c7d 0 2024-09-13T18:30:21.167 INFO:tasks.workunit.client.1.smithi149.stdout:7/430: write f3 [81978,75782] 0 2024-09-13T18:30:21.173 INFO:tasks.workunit.client.1.smithi149.stdout:8/346: dwrite d2/d13/f17 [4194304,4194304] 0 2024-09-13T18:30:21.173 INFO:tasks.workunit.client.1.smithi149.stdout:0/291: dwrite d1/d29/d31/f52 [0,4194304] 0 2024-09-13T18:30:21.173 INFO:tasks.workunit.client.1.smithi149.stdout:0/292: stat d1/d1b/f56 0 2024-09-13T18:30:21.174 INFO:tasks.workunit.client.1.smithi149.stdout:4/344: dwrite df/d11/d12/d21/d22/f5e [0,4194304] 0 2024-09-13T18:30:21.174 INFO:tasks.workunit.client.1.smithi149.stdout:4/345: read - df/d11/d12/d17/f5b zero size 2024-09-13T18:30:21.175 INFO:tasks.workunit.client.1.smithi149.stdout:5/340: dwrite d3/d10/d32/f38 [0,4194304] 0 2024-09-13T18:30:21.175 INFO:tasks.workunit.client.1.smithi149.stdout:3/364: dwrite d1/d12/f77 [0,4194304] 0 2024-09-13T18:30:21.175 INFO:tasks.workunit.client.1.smithi149.stdout:5/341: getdents d3/d8 0 2024-09-13T18:30:21.177 INFO:tasks.workunit.client.1.smithi149.stdout:8/347: rename d2/d62 to d2/d13/d6d 0 2024-09-13T18:30:21.179 INFO:tasks.workunit.client.1.smithi149.stdout:6/452: unlink dc/d2f/f78 0 2024-09-13T18:30:21.185 INFO:tasks.workunit.client.1.smithi149.stdout:4/346: getdents df/d11/d12/d21/d22/d30/d56 0 2024-09-13T18:30:21.187 INFO:tasks.workunit.client.1.smithi149.stdout:4/347: chown df/d11/l6e 239 1 2024-09-13T18:30:21.187 INFO:tasks.workunit.client.1.smithi149.stdout:4/348: stat df/d11/d12/d21/f4a 0 2024-09-13T18:30:21.187 INFO:tasks.workunit.client.1.smithi149.stdout:4/349: chown df/d11/d12/d21/d22/d30/d41/d57/c64 17 1 2024-09-13T18:30:21.187 INFO:tasks.workunit.client.1.smithi149.stdout:1/401: sync 2024-09-13T18:30:21.188 INFO:tasks.workunit.client.1.smithi149.stdout:6/453: unlink dc/d2f/f48 0 2024-09-13T18:30:21.191 INFO:tasks.workunit.client.1.smithi149.stdout:1/402: unlink d9/d15/f47 0 2024-09-13T18:30:21.203 INFO:tasks.workunit.client.1.smithi149.stdout:7/431: getdents d7/d9/d1c/d2f/d31 0 2024-09-13T18:30:21.203 INFO:tasks.workunit.client.1.smithi149.stdout:7/432: creat d7/d9/d1c/d34/f97 x:0 0 0 2024-09-13T18:30:21.205 INFO:tasks.workunit.client.1.smithi149.stdout:1/403: dread d9/d15/d25/f32 [0,4194304] 0 2024-09-13T18:30:21.207 INFO:tasks.workunit.client.1.smithi149.stdout:7/433: symlink d7/d9/d1c/d34/l98 0 2024-09-13T18:30:21.207 INFO:tasks.workunit.client.1.smithi149.stdout:7/434: fdatasync d7/f4c 0 2024-09-13T18:30:21.207 INFO:tasks.workunit.client.1.smithi149.stdout:7/435: fsync d7/d9/d1c/d34/f55 0 2024-09-13T18:30:21.207 INFO:tasks.workunit.client.1.smithi149.stdout:1/404: truncate d9/d10/d34/d53/f7d 309732 0 2024-09-13T18:30:21.208 INFO:tasks.workunit.client.1.smithi149.stdout:7/436: mknod d7/c99 0 2024-09-13T18:30:21.209 INFO:tasks.workunit.client.1.smithi149.stdout:1/405: mkdir d9/d15/d60/d80 0 2024-09-13T18:30:21.210 INFO:tasks.workunit.client.1.smithi149.stdout:7/437: creat d7/d9/d1c/d2c/f9a x:0 0 0 2024-09-13T18:30:21.215 INFO:tasks.workunit.client.1.smithi149.stdout:0/293: dwrite d1/f27 [0,4194304] 0 2024-09-13T18:30:21.215 INFO:tasks.workunit.client.1.smithi149.stdout:0/294: dread - d1/d29/d31/f35 zero size 2024-09-13T18:30:21.219 INFO:tasks.workunit.client.1.smithi149.stdout:3/365: dwrite d1/d12/d20/d54/f6a [0,4194304] 0 2024-09-13T18:30:21.219 INFO:tasks.workunit.client.1.smithi149.stdout:3/366: write d1/d4/f2f [1192367,19947] 0 2024-09-13T18:30:21.219 INFO:tasks.workunit.client.1.smithi149.stdout:3/367: getdents d1/d47/d30/d46 0 2024-09-13T18:30:21.220 INFO:tasks.workunit.client.1.smithi149.stdout:1/406: write d9/d10/d37/f5a [1435371,115434] 0 2024-09-13T18:30:21.220 INFO:tasks.workunit.client.1.smithi149.stdout:1/407: write f2 [1594333,65856] 0 2024-09-13T18:30:21.221 INFO:tasks.workunit.client.1.smithi149.stdout:4/350: dwrite df/d11/f34 [4194304,4194304] 0 2024-09-13T18:30:21.221 INFO:tasks.workunit.client.1.smithi149.stdout:5/342: dwrite d3/d10/d32/f3c [0,4194304] 0 2024-09-13T18:30:21.221 INFO:tasks.workunit.client.1.smithi149.stdout:5/343: write d3/d10/d4c/f59 [204816,130612] 0 2024-09-13T18:30:21.228 INFO:tasks.workunit.client.1.smithi149.stdout:5/344: unlink d3/d10/d32/c37 0 2024-09-13T18:30:21.229 INFO:tasks.workunit.client.1.smithi149.stdout:9/284: sync 2024-09-13T18:30:21.229 INFO:tasks.workunit.client.1.smithi149.stdout:9/285: chown d0/f4b 83881663 1 2024-09-13T18:30:21.230 INFO:tasks.workunit.client.1.smithi149.stdout:5/345: symlink d3/d10/d4c/d4e/d61/l65 0 2024-09-13T18:30:21.232 INFO:tasks.workunit.client.1.smithi149.stdout:5/346: mknod d3/d10/d4c/d4e/d61/d63/c66 0 2024-09-13T18:30:21.235 INFO:tasks.workunit.client.1.smithi149.stdout:5/347: mkdir d3/d10/d32/d67 0 2024-09-13T18:30:21.237 INFO:tasks.workunit.client.1.smithi149.stdout:4/351: dread df/d11/d12/d21/d22/f5e [0,4194304] 0 2024-09-13T18:30:21.237 INFO:tasks.workunit.client.1.smithi149.stdout:4/352: stat df/l45 0 2024-09-13T18:30:21.237 INFO:tasks.workunit.client.1.smithi149.stdout:5/348: getdents d3/d10/d4c 0 2024-09-13T18:30:21.240 INFO:tasks.workunit.client.1.smithi149.stdout:4/353: creat df/d11/d1c/d69/f76 x:0 0 0 2024-09-13T18:30:21.244 INFO:tasks.workunit.client.1.smithi149.stdout:4/354: rename df/d11/c52 to df/d11/d12/c77 0 2024-09-13T18:30:21.244 INFO:tasks.workunit.client.1.smithi149.stdout:4/355: dread - df/d11/d1c/f67 zero size 2024-09-13T18:30:21.244 INFO:tasks.workunit.client.1.smithi149.stdout:4/356: fsync df/d11/d12/d17/f3a 0 2024-09-13T18:30:21.244 INFO:tasks.workunit.client.1.smithi149.stdout:9/286: write d0/d18/d19/d3b/f3d [1763611,5046] 0 2024-09-13T18:30:21.244 INFO:tasks.workunit.client.1.smithi149.stdout:4/357: write df/d11/d12/d21/d22/d30/f37 [3325256,65624] 0 2024-09-13T18:30:21.244 INFO:tasks.workunit.client.1.smithi149.stdout:4/358: fdatasync df/d11/f34 0 2024-09-13T18:30:21.246 INFO:tasks.workunit.client.1.smithi149.stdout:9/287: mkdir d0/d18/d27/d5c 0 2024-09-13T18:30:21.247 INFO:tasks.workunit.client.1.smithi149.stdout:9/288: symlink d0/d18/d19/d3b/l5d 0 2024-09-13T18:30:21.247 INFO:tasks.workunit.client.1.smithi149.stdout:9/289: write d0/d18/d19/d3b/f3d [831503,28673] 0 2024-09-13T18:30:21.247 INFO:tasks.workunit.client.1.smithi149.stdout:9/290: dread - d0/d2e/f43 zero size 2024-09-13T18:30:21.247 INFO:tasks.workunit.client.1.smithi149.stdout:0/295: dwrite d1/f1a [0,4194304] 0 2024-09-13T18:30:21.249 INFO:tasks.workunit.client.1.smithi149.stdout:3/368: dwrite d1/d47/d30/f71 [0,4194304] 0 2024-09-13T18:30:21.249 INFO:tasks.workunit.client.1.smithi149.stdout:1/408: dwrite d9/d15/d40/d4a/d6b/d42/f6a [0,4194304] 0 2024-09-13T18:30:21.249 INFO:tasks.workunit.client.1.smithi149.stdout:1/409: stat d9/d15/d40/d4a/d6b/d42/f5b 0 2024-09-13T18:30:21.250 INFO:tasks.workunit.client.1.smithi149.stdout:9/291: dread d0/d18/d19/f3f [0,4194304] 0 2024-09-13T18:30:21.251 INFO:tasks.workunit.client.1.smithi149.stdout:0/296: fsync d1/d2/fd 0 2024-09-13T18:30:21.264 INFO:tasks.workunit.client.1.smithi149.stdout:3/369: creat d1/d12/f7b x:0 0 0 2024-09-13T18:30:21.264 INFO:tasks.workunit.client.1.smithi149.stdout:3/370: creat d1/d2e/d1d/f7c x:0 0 0 2024-09-13T18:30:21.264 INFO:tasks.workunit.client.1.smithi149.stdout:3/371: chown d1/d4/f2f 2186 1 2024-09-13T18:30:21.266 INFO:tasks.workunit.client.1.smithi149.stdout:1/410: rename d9/d15/c48 to d9/d15/d40/c81 0 2024-09-13T18:30:21.267 INFO:tasks.workunit.client.1.smithi149.stdout:1/411: read d9/d10/d34/d53/f7d [86977,95741] 0 2024-09-13T18:30:21.268 INFO:tasks.workunit.client.1.smithi149.stdout:4/359: dwrite df/d11/d1c/f3f [0,4194304] 0 2024-09-13T18:30:21.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:20 smithi149 ceph-mon[35845]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:21.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:20 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/2905579974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:30:21.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:20 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1439672496' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:30:21.269 INFO:tasks.workunit.client.1.smithi149.stdout:3/372: rename d1/d12/d20/l53 to d1/d2c/d42/l7d 0 2024-09-13T18:30:21.270 INFO:tasks.workunit.client.1.smithi149.stdout:3/373: fdatasync d1/d2e/d1d/f23 0 2024-09-13T18:30:21.273 INFO:tasks.workunit.client.1.smithi149.stdout:4/360: creat df/d11/f78 x:0 0 0 2024-09-13T18:30:21.273 INFO:tasks.workunit.client.1.smithi149.stdout:4/361: fsync df/d11/d1c/f67 0 2024-09-13T18:30:21.274 INFO:tasks.workunit.client.1.smithi149.stdout:3/374: symlink d1/d2c/d42/l7e 0 2024-09-13T18:30:21.275 INFO:tasks.workunit.client.1.smithi149.stdout:3/375: mknod d1/d47/d30/c7f 0 2024-09-13T18:30:21.276 INFO:tasks.workunit.client.1.smithi149.stdout:3/376: truncate d1/d2e/f14 2179320 0 2024-09-13T18:30:21.282 INFO:tasks.workunit.client.1.smithi149.stdout:4/362: dread df/d11/d12/d17/d3d/f40 [4194304,4194304] 0 2024-09-13T18:30:21.289 INFO:tasks.workunit.client.1.smithi149.stdout:1/412: dwrite d9/d15/f5e [0,4194304] 0 2024-09-13T18:30:21.295 INFO:tasks.workunit.client.1.smithi149.stdout:3/377: dwrite d1/d2e/f55 [0,4194304] 0 2024-09-13T18:30:21.295 INFO:tasks.workunit.client.1.smithi149.stdout:3/378: getdents d1/d47/d30/d46 0 2024-09-13T18:30:21.295 INFO:tasks.workunit.client.1.smithi149.stdout:3/379: read - d1/d4/d39/f5d zero size 2024-09-13T18:30:21.301 INFO:tasks.workunit.client.1.smithi149.stdout:4/363: rename df/d11 to df/d79 0 2024-09-13T18:30:21.310 INFO:tasks.workunit.client.1.smithi149.stdout:3/380: dread d1/d2e/f55 [0,4194304] 0 2024-09-13T18:30:21.310 INFO:tasks.workunit.client.1.smithi149.stdout:3/381: write d1/f19 [4069854,31572] 0 2024-09-13T18:30:21.311 INFO:tasks.workunit.client.1.smithi149.stdout:1/413: dwrite d9/d10/d3f/f7a [0,4194304] 0 2024-09-13T18:30:21.313 INFO:tasks.workunit.client.1.smithi149.stdout:3/382: rename d1/d2c/d42/l7d to d1/d4/d39/l80 0 2024-09-13T18:30:21.316 INFO:tasks.workunit.client.1.smithi149.stdout:3/383: creat d1/d2c/d38/f81 x:0 0 0 2024-09-13T18:30:21.317 INFO:tasks.workunit.client.1.smithi149.stdout:3/384: read d1/d2e/d1d/f23 [1537459,106698] 0 2024-09-13T18:30:21.317 INFO:tasks.workunit.client.1.smithi149.stdout:3/385: fdatasync d1/d12/f77 0 2024-09-13T18:30:21.321 INFO:tasks.workunit.client.1.smithi149.stdout:4/364: dwrite df/d79/d1c/f65 [0,4194304] 0 2024-09-13T18:30:21.321 INFO:tasks.workunit.client.1.smithi149.stdout:4/365: getdents df/d79/d12/d21/d22/d72 0 2024-09-13T18:30:21.321 INFO:tasks.workunit.client.1.smithi149.stdout:4/366: chown df/d79/f34 129746 1 2024-09-13T18:30:21.327 INFO:tasks.workunit.client.1.smithi149.stdout:3/386: write d1/d12/f77 [741031,84943] 0 2024-09-13T18:30:21.327 INFO:tasks.workunit.client.1.smithi149.stdout:3/387: fdatasync d1/f58 0 2024-09-13T18:30:21.328 INFO:tasks.workunit.client.1.smithi149.stdout:2/358: sync 2024-09-13T18:30:21.328 INFO:tasks.workunit.client.1.smithi149.stdout:2/359: write db/d1b/d1c/f5b [1086627,61625] 0 2024-09-13T18:30:21.329 INFO:tasks.workunit.client.1.smithi149.stdout:3/388: creat d1/d4/f82 x:0 0 0 2024-09-13T18:30:21.329 INFO:tasks.workunit.client.1.smithi149.stdout:2/360: symlink db/d10/l7e 0 2024-09-13T18:30:21.331 INFO:tasks.workunit.client.1.smithi149.stdout:2/361: symlink db/d1b/d2f/d69/l7f 0 2024-09-13T18:30:21.331 INFO:tasks.workunit.client.1.smithi149.stdout:3/389: dread d1/d4/f5f [0,4194304] 0 2024-09-13T18:30:21.333 INFO:tasks.workunit.client.1.smithi149.stdout:4/367: dread df/d79/d1c/f3f [0,4194304] 0 2024-09-13T18:30:21.333 INFO:tasks.workunit.client.1.smithi149.stdout:4/368: write df/d79/d1c/f32 [1340480,71490] 0 2024-09-13T18:30:21.333 INFO:tasks.workunit.client.1.smithi149.stdout:4/369: chown df/d79/d1c/f67 2526 1 2024-09-13T18:30:21.333 INFO:tasks.workunit.client.1.smithi149.stdout:2/362: rename f1 to db/d10/d12/f80 0 2024-09-13T18:30:21.334 INFO:tasks.workunit.client.1.smithi149.stdout:3/390: creat d1/f83 x:0 0 0 2024-09-13T18:30:21.336 INFO:tasks.workunit.client.1.smithi149.stdout:4/370: mknod df/d79/d12/d21/d22/c7a 0 2024-09-13T18:30:21.337 INFO:tasks.workunit.client.1.smithi149.stdout:2/363: mknod db/d13/c81 0 2024-09-13T18:30:21.338 INFO:tasks.workunit.client.1.smithi149.stdout:3/391: mknod d1/d12/c84 0 2024-09-13T18:30:21.339 INFO:tasks.workunit.client.1.smithi149.stdout:4/371: creat df/d79/d12/d21/d22/f7b x:0 0 0 2024-09-13T18:30:21.339 INFO:tasks.workunit.client.1.smithi149.stdout:4/372: stat df 0 2024-09-13T18:30:21.341 INFO:tasks.workunit.client.1.smithi149.stdout:2/364: creat db/d1b/d1c/d20/d3a/d75/f82 x:0 0 0 2024-09-13T18:30:21.342 INFO:tasks.workunit.client.1.smithi149.stdout:3/392: link d1/d2e/f14 d1/f85 0 2024-09-13T18:30:21.344 INFO:tasks.workunit.client.1.smithi149.stdout:4/373: write df/d79/f16 [1723520,92184] 0 2024-09-13T18:30:21.346 INFO:tasks.workunit.client.1.smithi149.stdout:2/365: dread db/d10/f2c [0,4194304] 0 2024-09-13T18:30:21.354 INFO:tasks.workunit.client.1.smithi149.stdout:2/366: write db/d1b/d2f/f52 [3495193,9507] 0 2024-09-13T18:30:21.362 INFO:tasks.workunit.client.1.smithi149.stdout:3/393: dwrite d1/d12/f77 [0,4194304] 0 2024-09-13T18:30:21.363 INFO:tasks.workunit.client.1.smithi149.stdout:3/394: symlink d1/d2c/l86 0 2024-09-13T18:30:21.365 INFO:tasks.workunit.client.1.smithi149.stdout:3/395: unlink d1/d2e/d1d/c2d 0 2024-09-13T18:30:21.365 INFO:tasks.workunit.client.1.smithi149.stdout:3/396: creat d1/d2c/d38/f87 x:0 0 0 2024-09-13T18:30:21.368 INFO:tasks.workunit.client.1.smithi149.stdout:3/397: mkdir d1/d2c/d38/d88 0 2024-09-13T18:30:21.368 INFO:tasks.workunit.client.1.smithi149.stdout:3/398: creat d1/d2e/d1d/f89 x:0 0 0 2024-09-13T18:30:21.372 INFO:tasks.workunit.client.1.smithi149.stdout:3/399: creat d1/d2e/d1d/d49/f8a x:0 0 0 2024-09-13T18:30:21.373 INFO:tasks.workunit.client.1.smithi149.stdout:3/400: mkdir d1/d2c/d8b 0 2024-09-13T18:30:21.375 INFO:tasks.workunit.client.1.smithi149.stdout:3/401: rmdir d1/d12/d20/d54 39 2024-09-13T18:30:21.375 INFO:tasks.workunit.client.1.smithi149.stdout:4/374: dwrite df/d79/f16 [0,4194304] 0 2024-09-13T18:30:21.375 INFO:tasks.workunit.client.1.smithi149.stdout:4/375: chown df/l2d 244927178 1 2024-09-13T18:30:21.375 INFO:tasks.workunit.client.1.smithi149.stdout:4/376: write df/f29 [1866828,77625] 0 2024-09-13T18:30:21.376 INFO:tasks.workunit.client.1.smithi149.stdout:4/377: getdents df 0 2024-09-13T18:30:21.378 INFO:tasks.workunit.client.1.smithi149.stdout:3/402: read d1/f11 [371445,51590] 0 2024-09-13T18:30:21.386 INFO:tasks.workunit.client.1.smithi149.stdout:4/378: write df/d79/d12/d21/f4a [2869084,58085] 0 2024-09-13T18:30:21.386 INFO:tasks.workunit.client.1.smithi149.stdout:2/367: dwrite db/d1b/d1c/f5b [4194304,4194304] 0 2024-09-13T18:30:21.386 INFO:tasks.workunit.client.1.smithi149.stdout:4/379: chown df 162410591 1 2024-09-13T18:30:21.386 INFO:tasks.workunit.client.1.smithi149.stdout:4/380: stat df/d79/l66 0 2024-09-13T18:30:21.387 INFO:tasks.workunit.client.1.smithi149.stdout:2/368: getdents db/d1b/d2f/d69 0 2024-09-13T18:30:21.387 INFO:tasks.workunit.client.1.smithi149.stdout:2/369: chown db/d10/d12 43566924 1 2024-09-13T18:30:21.387 INFO:tasks.workunit.client.1.smithi149.stdout:2/370: write db/d13/d70/f7c [18877,35963] 0 2024-09-13T18:30:21.388 INFO:tasks.workunit.client.1.smithi149.stdout:4/381: unlink df/d79/d1c/f65 0 2024-09-13T18:30:21.389 INFO:tasks.workunit.client.1.smithi149.stdout:4/382: mkdir df/d79/d12/d7c 0 2024-09-13T18:30:21.389 INFO:tasks.workunit.client.1.smithi149.stdout:4/383: chown df/d79/d12/d21/d22/f5e 41 1 2024-09-13T18:30:21.389 INFO:tasks.workunit.client.1.smithi149.stdout:4/384: dread - df/d79/d12/d21/d22/f7b zero size 2024-09-13T18:30:21.390 INFO:tasks.workunit.client.1.smithi149.stdout:4/385: chown df/d79/l36 55999089 1 2024-09-13T18:30:21.390 INFO:tasks.workunit.client.1.smithi149.stdout:4/386: mknod df/d79/d70/c7d 0 2024-09-13T18:30:21.409 INFO:tasks.workunit.client.1.smithi149.stdout:4/387: dwrite df/d79/d12/d21/d22/d30/d56/f5a [0,4194304] 0 2024-09-13T18:30:21.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.429+0000 7f5f25b28640 1 -- 172.21.15.38:0/261882439 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5f20106570 con 0x7f5f200fe1e0 2024-09-13T18:30:21.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.430+0000 7f5f1cff9640 1 -- 172.21.15.38:0/261882439 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5f10042020 con 0x7f5f200fe1e0 2024-09-13T18:30:21.432 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:30:21.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.432+0000 7f5f25b28640 1 -- 172.21.15.38:0/261882439 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f5f0806cd90 msgr2=0x7f5f0806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.432+0000 7f5f25b28640 1 --2- 172.21.15.38:0/261882439 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f5f0806cd90 0x7f5f0806f250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5f14005fd0 tx=0x7f5f14005850 comp rx=0 tx=0).stop 2024-09-13T18:30:21.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.432+0000 7f5f25b28640 1 -- 172.21.15.38:0/261882439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f200fe1e0 msgr2=0x7f5f20193280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:21.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.432+0000 7f5f25b28640 1 --2- 172.21.15.38:0/261882439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f200fe1e0 0x7f5f20193280 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5f10004750 tx=0x7f5f10005e60 comp rx=0 tx=0).stop 2024-09-13T18:30:21.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.432+0000 7f5f25b28640 1 -- 172.21.15.38:0/261882439 shutdown_connections 2024-09-13T18:30:21.434 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.432+0000 7f5f25b28640 1 --2- 172.21.15.38:0/261882439 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f5f0806cd90 0x7f5f0806f250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.432+0000 7f5f25b28640 1 --2- 172.21.15.38:0/261882439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f200ff3e0 0x7f5f201937c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.432+0000 7f5f25b28640 1 --2- 172.21.15.38:0/261882439 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5f200fe1e0 0x7f5f20193280 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:21.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.432+0000 7f5f25b28640 1 -- 172.21.15.38:0/261882439 >> 172.21.15.38:0/261882439 conn(0x7f5f200f9950 msgr2=0x7f5f20102610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:21.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.432+0000 7f5f25b28640 1 -- 172.21.15.38:0/261882439 shutdown_connections 2024-09-13T18:30:21.435 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:21.432+0000 7f5f25b28640 1 -- 172.21.15.38:0/261882439 wait complete. 2024-09-13T18:30:21.489 INFO:tasks.workunit.client.1.smithi149.stdout:4/388: dread df/f29 [0,4194304] 0 2024-09-13T18:30:21.489 INFO:tasks.workunit.client.1.smithi149.stdout:4/389: stat df/d79/d12/d21/d22/f5e 0 2024-09-13T18:30:21.490 INFO:tasks.workunit.client.1.smithi149.stdout:4/390: unlink df/d79/d12/c71 0 2024-09-13T18:30:21.492 INFO:tasks.workunit.client.1.smithi149.stdout:2/371: dwrite db/d1b/d1c/d20/d2b/d3e/f46 [0,4194304] 0 2024-09-13T18:30:21.494 INFO:tasks.workunit.client.1.smithi149.stdout:2/372: link db/d10/f72 db/d1b/d1c/d20/d3a/d75/f83 0 2024-09-13T18:30:21.506 INFO:tasks.workunit.client.1.smithi149.stdout:4/391: dwrite df/d79/d12/d17/d3d/f73 [0,4194304] 0 2024-09-13T18:30:21.509 INFO:tasks.workunit.client.1.smithi149.stdout:4/392: mkdir df/d79/d1c/d7e 0 2024-09-13T18:30:21.511 INFO:tasks.workunit.client.1.smithi149.stdout:8/348: sync 2024-09-13T18:30:21.511 INFO:tasks.workunit.client.1.smithi149.stdout:6/454: sync 2024-09-13T18:30:21.512 INFO:tasks.workunit.client.1.smithi149.stdout:6/455: chown dc/d15/d54/f7a 1232230 1 2024-09-13T18:30:21.512 INFO:tasks.workunit.client.1.smithi149.stdout:6/456: fsync dc/d15/d54/d85/f89 0 2024-09-13T18:30:21.512 INFO:tasks.workunit.client.1.smithi149.stdout:6/457: fsync dc/d15/d23/d57/d5c/f84 0 2024-09-13T18:30:21.512 INFO:tasks.workunit.client.1.smithi149.stdout:6/458: creat dc/f8d x:0 0 0 2024-09-13T18:30:21.512 INFO:tasks.workunit.client.1.smithi149.stdout:8/349: mkdir d2/d12/d6e 0 2024-09-13T18:30:21.610 INFO:tasks.workunit.client.1.smithi149.stdout:6/459: rename dc/d15/d54/f7a to dc/d2f/d75/f8e 0 2024-09-13T18:30:21.610 INFO:tasks.workunit.client.1.smithi149.stdout:8/350: dwrite d2/fc [0,4194304] 0 2024-09-13T18:30:21.611 INFO:tasks.workunit.client.1.smithi149.stdout:8/351: creat d2/d12/d2a/d4d/f6f x:0 0 0 2024-09-13T18:30:21.611 INFO:tasks.workunit.client.1.smithi149.stdout:8/352: chown d2/f63 18215709 1 2024-09-13T18:30:21.611 INFO:tasks.workunit.client.1.smithi149.stdout:6/460: symlink dc/d15/d23/l8f 0 2024-09-13T18:30:21.611 INFO:tasks.workunit.client.1.smithi149.stdout:6/461: stat dc/d15/d23/d5b/l82 0 2024-09-13T18:30:21.611 INFO:tasks.workunit.client.1.smithi149.stdout:6/462: dread - dc/d15/d23/d57/d5c/f84 zero size 2024-09-13T18:30:21.624 INFO:tasks.workunit.client.1.smithi149.stdout:8/353: rename d2/d13/d3a/l4a to d2/d12/d2a/d4d/l70 0 2024-09-13T18:30:21.625 INFO:tasks.workunit.client.1.smithi149.stdout:2/373: dwrite db/d1b/d2f/d30/f4f [0,4194304] 0 2024-09-13T18:30:21.625 INFO:tasks.workunit.client.1.smithi149.stdout:2/374: dread - db/d1b/d1c/d20/d2b/d3e/f68 zero size 2024-09-13T18:30:21.625 INFO:tasks.workunit.client.1.smithi149.stdout:6/463: mknod dc/d15/d54/d85/c90 0 2024-09-13T18:30:21.629 INFO:tasks.workunit.client.1.smithi149.stdout:2/375: rename db/d1b/d1c/d20/d49/l5a to db/d1b/d48/l84 0 2024-09-13T18:30:21.629 INFO:tasks.workunit.client.1.smithi149.stdout:6/464: mkdir dc/d15/d23/d5b/d91 0 2024-09-13T18:30:21.631 INFO:tasks.workunit.client.1.smithi149.stdout:4/393: dread df/d79/d1c/f3f [0,4194304] 0 2024-09-13T18:30:21.631 INFO:tasks.workunit.client.1.smithi149.stdout:4/394: chown df/d79/d12/d21/f4a 785 1 2024-09-13T18:30:21.631 INFO:tasks.workunit.client.1.smithi149.stdout:6/465: mknod dc/d8c/c92 0 2024-09-13T18:30:21.631 INFO:tasks.workunit.client.1.smithi149.stdout:4/395: getdents df/d79/d12/d21/d22/d30/d41/d57 0 2024-09-13T18:30:21.634 INFO:tasks.workunit.client.1.smithi149.stdout:6/466: rename dc/d2f/c43 to dc/d15/d23/c93 0 2024-09-13T18:30:21.636 INFO:tasks.workunit.client.1.smithi149.stdout:6/467: link dc/d15/c2a dc/d2f/d75/c94 0 2024-09-13T18:30:21.637 INFO:tasks.workunit.client.1.smithi149.stdout:6/468: symlink dc/d15/d23/d5b/d91/l95 0 2024-09-13T18:30:21.639 INFO:tasks.workunit.client.1.smithi149.stdout:6/469: unlink dc/d15/d54/c56 0 2024-09-13T18:30:21.639 INFO:tasks.workunit.client.1.smithi149.stdout:8/354: dwrite d2/d12/d2a/d4d/f6f [0,4194304] 0 2024-09-13T18:30:21.643 INFO:tasks.workunit.client.1.smithi149.stdout:8/355: link d2/d13/l44 d2/d12/d2a/d4d/l71 0 2024-09-13T18:30:21.645 INFO:tasks.workunit.client.1.smithi149.stdout:8/356: unlink d2/d12/c1d 0 2024-09-13T18:30:21.645 INFO:tasks.workunit.client.1.smithi149.stdout:2/376: write db/d1b/d1c/f5b [8096534,9140] 0 2024-09-13T18:30:21.645 INFO:tasks.workunit.client.1.smithi149.stdout:8/357: chown d2/d13/d3a/c54 0 1 2024-09-13T18:30:21.647 INFO:tasks.workunit.client.1.smithi149.stdout:2/377: unlink db/d1b/d1c/d20/d3a/d75/c76 0 2024-09-13T18:30:21.648 INFO:tasks.workunit.client.1.smithi149.stdout:8/358: unlink d2/d12/d2a/c38 0 2024-09-13T18:30:21.650 INFO:tasks.workunit.client.1.smithi149.stdout:2/378: mkdir db/d1b/d1c/d85 0 2024-09-13T18:30:21.650 INFO:tasks.workunit.client.1.smithi149.stdout:2/379: chown db/d1b 8591826 1 2024-09-13T18:30:21.650 INFO:tasks.workunit.client.1.smithi149.stdout:2/380: chown db/d1b/d2f/d69/l7f 31 1 2024-09-13T18:30:21.650 INFO:tasks.workunit.client.1.smithi149.stdout:2/381: truncate db/d1b/d48/f56 943412 0 2024-09-13T18:30:21.650 INFO:tasks.workunit.client.1.smithi149.stdout:5/349: sync 2024-09-13T18:30:21.650 INFO:tasks.workunit.client.1.smithi149.stdout:0/297: sync 2024-09-13T18:30:21.650 INFO:tasks.workunit.client.1.smithi149.stdout:9/292: sync 2024-09-13T18:30:21.650 INFO:tasks.workunit.client.1.smithi149.stdout:3/403: sync 2024-09-13T18:30:21.650 INFO:tasks.workunit.client.1.smithi149.stdout:1/414: sync 2024-09-13T18:30:21.650 INFO:tasks.workunit.client.1.smithi149.stdout:7/438: sync 2024-09-13T18:30:21.651 INFO:tasks.workunit.client.1.smithi149.stdout:8/359: mknod d2/d13/d3a/c72 0 2024-09-13T18:30:21.651 INFO:tasks.workunit.client.1.smithi149.stdout:0/298: creat d1/d48/f64 x:0 0 0 2024-09-13T18:30:21.652 INFO:tasks.workunit.client.1.smithi149.stdout:7/439: symlink d7/d12/l9b 0 2024-09-13T18:30:21.652 INFO:tasks.workunit.client.1.smithi149.stdout:7/440: write d7/d9/d1c/d2f/d31/f3f [1310133,119377] 0 2024-09-13T18:30:21.653 INFO:tasks.workunit.client.1.smithi149.stdout:7/441: chown d7/d9/d1c/d2f/d31 55981385 1 2024-09-13T18:30:21.653 INFO:tasks.workunit.client.1.smithi149.stdout:9/293: creat d0/d2e/d42/f5e x:0 0 0 2024-09-13T18:30:21.655 INFO:tasks.workunit.client.1.smithi149.stdout:8/360: rename d2/l37 to d2/d12/d1b/d58/l73 0 2024-09-13T18:30:21.655 INFO:tasks.workunit.client.1.smithi149.stdout:8/361: read - d2/d12/d1b/f51 zero size 2024-09-13T18:30:21.655 INFO:tasks.workunit.client.1.smithi149.stdout:8/362: write d2/d13/d3a/f61 [915051,97897] 0 2024-09-13T18:30:21.657 INFO:tasks.workunit.client.1.smithi149.stdout:9/294: symlink d0/d2e/d42/l5f 0 2024-09-13T18:30:21.660 INFO:tasks.workunit.client.1.smithi149.stdout:0/299: rename d1/d1b/l37 to d1/d29/d31/l65 0 2024-09-13T18:30:21.661 INFO:tasks.workunit.client.1.smithi149.stdout:8/363: creat d2/d52/f74 x:0 0 0 2024-09-13T18:30:21.662 INFO:tasks.workunit.client.1.smithi149.stdout:2/382: dread db/d1b/d2f/f52 [0,4194304] 0 2024-09-13T18:30:21.662 INFO:tasks.workunit.client.1.smithi149.stdout:6/470: dwrite dc/d76/f7b [0,4194304] 0 2024-09-13T18:30:21.665 INFO:tasks.workunit.client.1.smithi149.stdout:0/300: creat d1/d2/f66 x:0 0 0 2024-09-13T18:30:21.667 INFO:tasks.workunit.client.1.smithi149.stdout:8/364: creat d2/d12/d40/f75 x:0 0 0 2024-09-13T18:30:21.667 INFO:tasks.workunit.client.1.smithi149.stdout:8/365: chown d2/d12/d2a/d4d/l70 593007689 1 2024-09-13T18:30:21.669 INFO:tasks.workunit.client.1.smithi149.stdout:8/366: truncate d2/f42 4866402 0 2024-09-13T18:30:21.672 INFO:tasks.workunit.client.1.smithi149.stdout:8/367: rename d2/c53 to d2/d12/d1b/d58/c76 0 2024-09-13T18:30:21.673 INFO:tasks.workunit.client.1.smithi149.stdout:3/404: dread d1/d2e/f37 [0,4194304] 0 2024-09-13T18:30:21.674 INFO:tasks.workunit.client.1.smithi149.stdout:8/368: symlink d2/d12/d1b/l77 0 2024-09-13T18:30:21.674 INFO:tasks.workunit.client.1.smithi149.stdout:8/369: creat d2/d12/d2a/d4d/f78 x:0 0 0 2024-09-13T18:30:21.680 INFO:tasks.workunit.client.1.smithi149.stdout:1/415: dread d9/d10/d34/f51 [0,4194304] 0 2024-09-13T18:30:21.680 INFO:tasks.workunit.client.1.smithi149.stdout:1/416: chown d9/d15/d60 1214 1 2024-09-13T18:30:21.680 INFO:tasks.workunit.client.1.smithi149.stdout:1/417: read - d9/d10/d34/d53/d57/d6c/f7f zero size 2024-09-13T18:30:21.680 INFO:tasks.workunit.client.1.smithi149.stdout:1/418: creat d9/d10/d34/d53/f82 x:0 0 0 2024-09-13T18:30:21.680 INFO:tasks.workunit.client.1.smithi149.stdout:1/419: stat d9/d10/l1e 0 2024-09-13T18:30:21.683 INFO:tasks.workunit.client.1.smithi149.stdout:1/420: mkdir d9/d10/d83 0 2024-09-13T18:30:21.683 INFO:tasks.workunit.client.1.smithi149.stdout:1/421: fdatasync d9/d10/d34/d3c/d50/f56 0 2024-09-13T18:30:21.683 INFO:tasks.workunit.client.1.smithi149.stdout:6/471: write dc/f22 [975086,68335] 0 2024-09-13T18:30:21.683 INFO:tasks.workunit.client.1.smithi149.stdout:5/350: dwrite d3/d10/f64 [0,4194304] 0 2024-09-13T18:30:21.684 INFO:tasks.workunit.client.1.smithi149.stdout:6/472: symlink dc/d15/d23/l96 0 2024-09-13T18:30:21.684 INFO:tasks.workunit.client.1.smithi149.stdout:6/473: truncate dc/f3f 4938734 0 2024-09-13T18:30:21.687 INFO:tasks.workunit.client.1.smithi149.stdout:3/405: read d1/d12/f77 [346344,55092] 0 2024-09-13T18:30:21.687 INFO:tasks.workunit.client.1.smithi149.stdout:1/422: read d9/d10/f27 [3613024,4750] 0 2024-09-13T18:30:21.687 INFO:tasks.workunit.client.1.smithi149.stdout:5/351: symlink d3/d10/d4c/d4e/d61/l68 0 2024-09-13T18:30:21.690 INFO:tasks.workunit.client.1.smithi149.stdout:1/423: truncate d9/d15/d40/d4a/d6b/d42/f5b 322555 0 2024-09-13T18:30:21.690 INFO:tasks.workunit.client.1.smithi149.stdout:1/424: readlink d9/d15/d40/d4a/l78 0 2024-09-13T18:30:21.693 INFO:tasks.workunit.client.1.smithi149.stdout:2/383: dwrite db/d1b/d48/f6f [0,4194304] 0 2024-09-13T18:30:21.693 INFO:tasks.workunit.client.1.smithi149.stdout:5/352: creat d3/d10/d4c/f69 x:0 0 0 2024-09-13T18:30:21.694 INFO:tasks.workunit.client.1.smithi149.stdout:0/301: dwrite d1/d29/f58 [0,4194304] 0 2024-09-13T18:30:21.696 INFO:tasks.workunit.client.1.smithi149.stdout:1/425: getdents d9/d15/d40/d4a/d6b 0 2024-09-13T18:30:21.702 INFO:tasks.workunit.client.1.smithi149.stdout:2/384: symlink db/d13/d70/l86 0 2024-09-13T18:30:21.703 INFO:tasks.workunit.client.1.smithi149.stdout:5/353: link d3/d10/d32/c30 d3/d10/d32/d67/c6a 0 2024-09-13T18:30:21.706 INFO:tasks.workunit.client.1.smithi149.stdout:0/302: rename d1/d29/f58 to d1/d1b/f67 0 2024-09-13T18:30:21.706 INFO:tasks.workunit.client.1.smithi149.stdout:0/303: chown d1/d29/d31/c60 3 1 2024-09-13T18:30:21.709 INFO:tasks.workunit.client.1.smithi149.stdout:3/406: dwrite d1/d2c/d56/f76 [0,4194304] 0 2024-09-13T18:30:21.709 INFO:tasks.workunit.client.1.smithi149.stdout:3/407: write d1/f24 [1989109,47573] 0 2024-09-13T18:30:21.709 INFO:tasks.workunit.client.1.smithi149.stdout:6/474: dwrite dc/d15/d23/d57/d5c/d64/f88 [0,4194304] 0 2024-09-13T18:30:21.710 INFO:tasks.workunit.client.1.smithi149.stdout:5/354: link d3/fd d3/d10/d4c/d4e/d61/d63/f6b 0 2024-09-13T18:30:21.711 INFO:tasks.workunit.client.1.smithi149.stdout:8/370: rmdir d2/d12/d2a/d4d 39 2024-09-13T18:30:21.713 INFO:tasks.workunit.client.1.smithi149.stdout:1/426: rename d9/d10/d34/d3c/d50/f56 to d9/d15/d60/d80/f84 0 2024-09-13T18:30:21.716 INFO:tasks.workunit.client.1.smithi149.stdout:0/304: readlink d1/d2/l17 0 2024-09-13T18:30:21.721 INFO:tasks.workunit.client.1.smithi149.stdout:8/371: creat d2/d12/d2a/d4d/f79 x:0 0 0 2024-09-13T18:30:21.722 INFO:tasks.workunit.client.1.smithi149.stdout:8/372: creat d2/d12/d40/f7a x:0 0 0 2024-09-13T18:30:21.723 INFO:tasks.workunit.client.1.smithi149.stdout:8/373: dread - d2/f63 zero size 2024-09-13T18:30:21.724 INFO:tasks.workunit.client.1.smithi149.stdout:0/305: truncate d1/d29/d31/d3e/f45 7909833 0 2024-09-13T18:30:21.727 INFO:tasks.workunit.client.1.smithi149.stdout:6/475: dread dc/d15/d23/d57/d5c/d64/f88 [0,4194304] 0 2024-09-13T18:30:21.727 INFO:tasks.workunit.client.1.smithi149.stdout:6/476: truncate dc/f8d 194651 0 2024-09-13T18:30:21.728 INFO:tasks.workunit.client.1.smithi149.stdout:0/306: creat d1/d29/d31/d3e/d3f/f68 x:0 0 0 2024-09-13T18:30:21.729 INFO:tasks.workunit.client.1.smithi149.stdout:2/385: rmdir db/d13 39 2024-09-13T18:30:21.729 INFO:tasks.workunit.client.1.smithi149.stdout:2/386: rename db/d1b to db/d1b/d1c/d20/d2b/d87 22 2024-09-13T18:30:21.730 INFO:tasks.workunit.client.1.smithi149.stdout:2/387: write db/d1b/d48/f56 [299056,66105] 0 2024-09-13T18:30:21.732 INFO:tasks.workunit.client.1.smithi149.stdout:6/477: creat dc/d70/f97 x:0 0 0 2024-09-13T18:30:21.734 INFO:tasks.workunit.client.1.smithi149.stdout:0/307: creat d1/d2/d41/d46/f69 x:0 0 0 2024-09-13T18:30:21.734 INFO:tasks.workunit.client.1.smithi149.stdout:6/478: readlink dc/d2f/l86 0 2024-09-13T18:30:21.735 INFO:tasks.workunit.client.1.smithi149.stdout:0/308: dread d1/d2/fb [4194304,4194304] 0 2024-09-13T18:30:21.736 INFO:tasks.workunit.client.1.smithi149.stdout:5/355: dwrite d3/f34 [0,4194304] 0 2024-09-13T18:30:21.736 INFO:tasks.workunit.client.1.smithi149.stdout:5/356: fdatasync d3/d8/f1e 0 2024-09-13T18:30:21.736 INFO:tasks.workunit.client.1.smithi149.stdout:5/357: chown d3/d10/d4c/c57 7774 1 2024-09-13T18:30:21.741 INFO:tasks.workunit.client.1.smithi149.stdout:8/374: write d2/f42 [122595,57124] 0 2024-09-13T18:30:21.741 INFO:tasks.workunit.client.1.smithi149.stdout:6/479: link dc/d2f/c77 dc/d76/c98 0 2024-09-13T18:30:21.742 INFO:tasks.workunit.client.1.smithi149.stdout:0/309: getdents d1/d2/d41 0 2024-09-13T18:30:21.742 INFO:tasks.workunit.client.1.smithi149.stdout:0/310: creat d1/f6a x:0 0 0 2024-09-13T18:30:21.744 INFO:tasks.workunit.client.1.smithi149.stdout:0/311: truncate d1/d29/d31/d44/d47/f59 1298264 0 2024-09-13T18:30:21.744 INFO:tasks.workunit.client.1.smithi149.stdout:3/408: dwrite d1/d2c/d38/f81 [0,4194304] 0 2024-09-13T18:30:21.744 INFO:tasks.workunit.client.1.smithi149.stdout:3/409: readlink d1/d2e/l10 0 2024-09-13T18:30:21.744 INFO:tasks.workunit.client.1.smithi149.stdout:3/410: chown d1/d47/f26 501 1 2024-09-13T18:30:21.745 INFO:tasks.workunit.client.1.smithi149.stdout:1/427: dwrite d9/d58/f61 [0,4194304] 0 2024-09-13T18:30:21.745 INFO:tasks.workunit.client.1.smithi149.stdout:0/312: dread d1/d2/fb [4194304,4194304] 0 2024-09-13T18:30:21.745 INFO:tasks.workunit.client.1.smithi149.stdout:0/313: write d1/d2/f12 [4057288,65498] 0 2024-09-13T18:30:21.748 INFO:tasks.workunit.client.1.smithi149.stdout:3/411: unlink d1/d2e/d1d/f5c 0 2024-09-13T18:30:21.748 INFO:tasks.workunit.client.1.smithi149.stdout:3/412: chown d1/d2e/d1d/d49/l66 843 1 2024-09-13T18:30:21.752 INFO:tasks.workunit.client.1.smithi149.stdout:0/314: creat d1/d29/d31/d3e/d54/f6b x:0 0 0 2024-09-13T18:30:21.752 INFO:tasks.workunit.client.1.smithi149.stdout:0/315: chown d1/f10 1055 1 2024-09-13T18:30:21.753 INFO:tasks.workunit.client.1.smithi149.stdout:6/480: dread dc/d15/f44 [0,4194304] 0 2024-09-13T18:30:21.754 INFO:tasks.workunit.client.1.smithi149.stdout:3/413: rename d1/d47/d30/f5b to d1/d2e/d1d/d6c/f8c 0 2024-09-13T18:30:21.754 INFO:tasks.workunit.client.1.smithi149.stdout:3/414: dread - d1/d12/f7b zero size 2024-09-13T18:30:21.754 INFO:tasks.workunit.client.1.smithi149.stdout:5/358: dwrite d3/d10/f5d [0,4194304] 0 2024-09-13T18:30:21.756 INFO:tasks.workunit.client.1.smithi149.stdout:5/359: rename d3/d10/d32/d54/f47 to d3/d8/d13/f6c 0 2024-09-13T18:30:21.756 INFO:tasks.workunit.client.1.smithi149.stdout:5/360: write d3/d10/d4c/f59 [686046,105074] 0 2024-09-13T18:30:21.759 INFO:tasks.workunit.client.1.smithi149.stdout:4/396: sync 2024-09-13T18:30:21.759 INFO:tasks.workunit.client.1.smithi149.stdout:4/397: getdents df/d79/d12/d21/d22/d72 0 2024-09-13T18:30:21.765 INFO:tasks.workunit.client.1.smithi149.stdout:6/481: read dc/f1a [1529594,121198] 0 2024-09-13T18:30:21.766 INFO:tasks.workunit.client.1.smithi149.stdout:6/482: symlink dc/d15/d23/d5b/d91/l99 0 2024-09-13T18:30:21.767 INFO:tasks.workunit.client.1.smithi149.stdout:6/483: dread - dc/d15/d23/d5f/f67 zero size 2024-09-13T18:30:21.768 INFO:tasks.workunit.client.1.smithi149.stdout:0/316: write d1/d2/fb [597275,7030] 0 2024-09-13T18:30:21.770 INFO:tasks.workunit.client.1.smithi149.stdout:6/484: rename dc/d15/d54/c74 to dc/d15/d54/d85/c9a 0 2024-09-13T18:30:21.770 INFO:tasks.workunit.client.1.smithi149.stdout:6/485: write dc/d15/d23/d57/f59 [1041957,35552] 0 2024-09-13T18:30:21.771 INFO:tasks.workunit.client.1.smithi149.stdout:6/486: rmdir dc/d15 39 2024-09-13T18:30:21.778 INFO:tasks.workunit.client.1.smithi149.stdout:5/361: dread d3/d8/d13/f18 [0,4194304] 0 2024-09-13T18:30:21.778 INFO:tasks.workunit.client.1.smithi149.stdout:5/362: chown d3/l1d 1408 1 2024-09-13T18:30:21.778 INFO:tasks.workunit.client.1.smithi149.stdout:5/363: truncate d3/d10/d32/f38 3670062 0 2024-09-13T18:30:21.780 INFO:tasks.workunit.client.1.smithi149.stdout:5/364: unlink d3/d10/d4c/d4e/d61/d63/c66 0 2024-09-13T18:30:21.780 INFO:tasks.workunit.client.1.smithi149.stdout:3/415: dwrite d1/d12/f7b [0,4194304] 0 2024-09-13T18:30:21.782 INFO:tasks.workunit.client.1.smithi149.stdout:3/416: unlink d1/d12/f7b 0 2024-09-13T18:30:21.782 INFO:tasks.workunit.client.1.smithi149.stdout:3/417: stat d1/d2e/d1d/d49 0 2024-09-13T18:30:21.784 INFO:tasks.workunit.client.1.smithi149.stdout:3/418: mkdir d1/d2c/d38/d8d 0 2024-09-13T18:30:21.789 INFO:tasks.workunit.client.1.smithi149.stdout:6/487: dread dc/f3f [0,4194304] 0 2024-09-13T18:30:21.791 INFO:tasks.workunit.client.1.smithi149.stdout:6/488: creat dc/d15/d23/d57/d5c/f9b x:0 0 0 2024-09-13T18:30:21.797 INFO:tasks.workunit.client.1.smithi149.stdout:0/317: dwrite d1/d2/d41/d46/f69 [0,4194304] 0 2024-09-13T18:30:21.797 INFO:tasks.workunit.client.1.smithi149.stdout:0/318: write d1/d2/fb [571837,99843] 0 2024-09-13T18:30:21.798 INFO:tasks.workunit.client.1.smithi149.stdout:4/398: dwrite df/d79/d12/d17/f3a [4194304,4194304] 0 2024-09-13T18:30:21.802 INFO:tasks.workunit.client.1.smithi149.stdout:0/319: link d1/f10 d1/d2/d5a/d62/f6c 0 2024-09-13T18:30:21.811 INFO:tasks.workunit.client.1.smithi149.stdout:3/419: dwrite d1/f24 [0,4194304] 0 2024-09-13T18:30:21.812 INFO:tasks.workunit.client.1.smithi149.stdout:6/489: dwrite dc/d15/d23/f3e [0,4194304] 0 2024-09-13T18:30:21.813 INFO:tasks.workunit.client.1.smithi149.stdout:3/420: link d1/d2c/d56/c73 d1/d2c/c8e 0 2024-09-13T18:30:21.815 INFO:tasks.workunit.client.1.smithi149.stdout:4/399: write df/d79/d12/d17/f3a [5412676,16880] 0 2024-09-13T18:30:21.822 INFO:tasks.workunit.client.1.smithi149.stdout:6/490: rename dc/d2f/c8a to dc/d15/d54/d85/c9c 0 2024-09-13T18:30:21.827 INFO:tasks.workunit.client.1.smithi149.stdout:0/320: dwrite d1/d29/d31/d3e/d54/f6b [0,4194304] 0 2024-09-13T18:30:21.827 INFO:tasks.workunit.client.1.smithi149.stdout:0/321: read - d1/f6a zero size 2024-09-13T18:30:21.828 INFO:tasks.workunit.client.1.smithi149.stdout:7/442: sync 2024-09-13T18:30:21.828 INFO:tasks.workunit.client.1.smithi149.stdout:7/443: fsync d7/d9/d1c/d51/f61 0 2024-09-13T18:30:21.828 INFO:tasks.workunit.client.1.smithi149.stdout:7/444: getdents d7/d9/d1c/d2f/d31 0 2024-09-13T18:30:21.832 INFO:tasks.workunit.client.1.smithi149.stdout:7/445: mkdir d7/d9/d11/d9c 0 2024-09-13T18:30:21.833 INFO:tasks.workunit.client.1.smithi149.stdout:7/446: mkdir d7/d9/d1c/d2f/d6f/d9d 0 2024-09-13T18:30:21.835 INFO:tasks.workunit.client.1.smithi149.stdout:7/447: mkdir d7/d9/d1c/d1f/d21/d7b/d96/d9e 0 2024-09-13T18:30:21.844 INFO:tasks.workunit.client.1.smithi149.stdout:6/491: dread dc/d15/d23/d57/d5c/d64/f6e [0,4194304] 0 2024-09-13T18:30:21.844 INFO:tasks.workunit.client.1.smithi149.stdout:3/421: dwrite d1/d2e/d1d/f51 [0,4194304] 0 2024-09-13T18:30:21.845 INFO:tasks.workunit.client.1.smithi149.stdout:3/422: write d1/d12/d20/d54/f6a [4910283,41022] 0 2024-09-13T18:30:21.845 INFO:tasks.workunit.client.1.smithi149.stdout:3/423: stat d1/d4 0 2024-09-13T18:30:21.845 INFO:tasks.workunit.client.1.smithi149.stdout:3/424: creat d1/d48/f8f x:0 0 0 2024-09-13T18:30:21.846 INFO:tasks.workunit.client.1.smithi149.stdout:6/492: chown dc/d2f/l4a 0 1 2024-09-13T18:30:21.846 INFO:tasks.workunit.client.1.smithi149.stdout:6/493: stat dc/d15/f20 0 2024-09-13T18:30:21.846 INFO:tasks.workunit.client.1.smithi149.stdout:4/400: dwrite df/d79/f78 [0,4194304] 0 2024-09-13T18:30:21.849 INFO:tasks.workunit.client.1.smithi149.stdout:3/425: mknod d1/d12/d20/d54/c90 0 2024-09-13T18:30:21.849 INFO:tasks.workunit.client.1.smithi149.stdout:3/426: fsync d1/d2e/d1d/f89 0 2024-09-13T18:30:21.849 INFO:tasks.workunit.client.1.smithi149.stdout:6/494: mknod dc/d15/d23/d57/d5c/c9d 0 2024-09-13T18:30:21.859 INFO:tasks.workunit.client.1.smithi149.stdout:4/401: read df/d79/f78 [1465883,70159] 0 2024-09-13T18:30:21.859 INFO:tasks.workunit.client.1.smithi149.stdout:3/427: mkdir d1/d12/d20/d91 0 2024-09-13T18:30:21.859 INFO:tasks.workunit.client.1.smithi149.stdout:4/402: stat df/d79/d12/d17/d3d/f73 0 2024-09-13T18:30:21.859 INFO:tasks.workunit.client.1.smithi149.stdout:3/428: write d1/d47/d30/f71 [4719611,43761] 0 2024-09-13T18:30:21.860 INFO:tasks.workunit.client.1.smithi149.stdout:4/403: truncate df/f2b 3057702 0 2024-09-13T18:30:21.861 INFO:tasks.workunit.client.1.smithi149.stdout:3/429: creat d1/d47/f92 x:0 0 0 2024-09-13T18:30:21.862 INFO:tasks.workunit.client.1.smithi149.stdout:4/404: rename df/d79/d12/c77 to df/d79/d12/d21/d22/d30/d41/c7f 0 2024-09-13T18:30:21.863 INFO:tasks.workunit.client.1.smithi149.stdout:3/430: mkdir d1/d2e/d93 0 2024-09-13T18:30:21.864 INFO:tasks.workunit.client.1.smithi149.stdout:4/405: creat df/d79/f80 x:0 0 0 2024-09-13T18:30:21.864 INFO:tasks.workunit.client.1.smithi149.stdout:4/406: readlink df/d79/d1c/l4b 0 2024-09-13T18:30:21.865 INFO:tasks.workunit.client.1.smithi149.stdout:4/407: dread - df/d79/f61 zero size 2024-09-13T18:30:21.869 INFO:tasks.workunit.client.1.smithi149.stdout:0/322: dwrite d1/d29/d31/d44/d47/f59 [0,4194304] 0 2024-09-13T18:30:21.869 INFO:tasks.workunit.client.1.smithi149.stdout:0/323: creat d1/d48/f6d x:0 0 0 2024-09-13T18:30:21.869 INFO:tasks.workunit.client.1.smithi149.stdout:0/324: fdatasync d1/d29/d31/d3e/f45 0 2024-09-13T18:30:21.871 INFO:tasks.workunit.client.1.smithi149.stdout:6/495: dwrite dc/d15/d23/f3e [0,4194304] 0 2024-09-13T18:30:21.871 INFO:tasks.workunit.client.1.smithi149.stdout:6/496: chown dc/d15 45840 1 2024-09-13T18:30:21.876 INFO:tasks.workunit.client.1.smithi149.stdout:7/448: dwrite d7/f4c [4194304,4194304] 0 2024-09-13T18:30:21.878 INFO:tasks.workunit.client.1.smithi149.stdout:7/449: getdents d7/d9/d1c/d51/d52/d86 0 2024-09-13T18:30:21.879 INFO:tasks.workunit.client.1.smithi149.stdout:7/450: dread - d7/d12/f17 zero size 2024-09-13T18:30:21.879 INFO:tasks.workunit.client.1.smithi149.stdout:3/431: dread d1/d47/f26 [0,4194304] 0 2024-09-13T18:30:21.888 INFO:tasks.workunit.client.1.smithi149.stdout:4/408: write df/d79/d1c/f23 [2869139,104626] 0 2024-09-13T18:30:21.888 INFO:tasks.workunit.client.1.smithi149.stdout:7/451: dread f3 [0,4194304] 0 2024-09-13T18:30:21.890 INFO:tasks.workunit.client.1.smithi149.stdout:4/409: mknod df/d79/d12/d17/d3d/c81 0 2024-09-13T18:30:21.890 INFO:tasks.workunit.client.1.smithi149.stdout:4/410: readlink df/l2d 0 2024-09-13T18:30:21.892 INFO:tasks.workunit.client.1.smithi149.stdout:0/325: dwrite d1/f1a [4194304,4194304] 0 2024-09-13T18:30:21.896 INFO:tasks.workunit.client.1.smithi149.stdout:0/326: symlink d1/d29/d31/d3e/d54/l6e 0 2024-09-13T18:30:21.896 INFO:tasks.workunit.client.1.smithi149.stdout:0/327: fdatasync d1/d2/fd 0 2024-09-13T18:30:21.896 INFO:tasks.workunit.client.1.smithi149.stdout:0/328: chown d1/d29/d31/d3e/d3f/l43 39399 1 2024-09-13T18:30:21.896 INFO:tasks.workunit.client.1.smithi149.stdout:0/329: write d1/f21 [3176499,118828] 0 2024-09-13T18:30:21.896 INFO:tasks.workunit.client.1.smithi149.stdout:0/330: readlink d1/d2/l49 0 2024-09-13T18:30:21.897 INFO:tasks.workunit.client.1.smithi149.stdout:0/331: chown d1/d29/d31/d44/d47/c3c 1193 1 2024-09-13T18:30:21.897 INFO:tasks.workunit.client.1.smithi149.stdout:0/332: chown d1/d2/d5a/f63 7486712 1 2024-09-13T18:30:21.898 INFO:tasks.workunit.client.1.smithi149.stdout:0/333: mknod d1/d29/d31/d44/d47/c6f 0 2024-09-13T18:30:21.898 INFO:tasks.workunit.client.1.smithi149.stdout:0/334: truncate d1/d29/d31/f35 289020 0 2024-09-13T18:30:21.898 INFO:tasks.workunit.client.1.smithi149.stdout:0/335: write d1/f6a [36832,64769] 0 2024-09-13T18:30:21.900 INFO:tasks.workunit.client.1.smithi149.stdout:4/411: dread df/d79/f78 [0,4194304] 0 2024-09-13T18:30:21.900 INFO:tasks.workunit.client.1.smithi149.stdout:6/497: dwrite dc/f2d [4194304,4194304] 0 2024-09-13T18:30:21.903 INFO:tasks.workunit.client.1.smithi149.stdout:4/412: symlink df/d79/d12/d21/d22/d72/l82 0 2024-09-13T18:30:21.913 INFO:tasks.workunit.client.1.smithi149.stdout:4/413: dread df/d79/d1c/f32 [0,4194304] 0 2024-09-13T18:30:21.913 INFO:tasks.workunit.client.1.smithi149.stdout:4/414: rename df/d79/d12/d21/d22/d30 to df/d79/d12/d21/d22/d30/d56/d83 22 2024-09-13T18:30:21.915 INFO:tasks.workunit.client.1.smithi149.stdout:4/415: getdents df/d79/d12/d17/d3d 0 2024-09-13T18:30:21.915 INFO:tasks.workunit.client.1.smithi149.stdout:4/416: write df/d79/f80 [1030625,126917] 0 2024-09-13T18:30:21.915 INFO:tasks.workunit.client.1.smithi149.stdout:7/452: dwrite d7/d9/d1c/d2f/d31/f5b [0,4194304] 0 2024-09-13T18:30:21.915 INFO:tasks.workunit.client.1.smithi149.stdout:7/453: chown d7/d9/d1c/d2f/d6f/d9d 228150 1 2024-09-13T18:30:21.916 INFO:tasks.workunit.client.1.smithi149.stdout:4/417: mknod df/d79/d12/c84 0 2024-09-13T18:30:21.918 INFO:tasks.workunit.client.1.smithi149.stdout:7/454: mkdir d7/d9/d1c/d51/d52/d86/d9f 0 2024-09-13T18:30:21.919 INFO:tasks.workunit.client.1.smithi149.stdout:4/418: truncate df/f20 1047690 0 2024-09-13T18:30:21.929 INFO:tasks.workunit.client.1.smithi149.stdout:0/336: dwrite d1/f10 [0,4194304] 0 2024-09-13T18:30:21.929 INFO:tasks.workunit.client.1.smithi149.stdout:6/498: dwrite dc/d15/f55 [0,4194304] 0 2024-09-13T18:30:21.929 INFO:tasks.workunit.client.1.smithi149.stdout:4/419: dread df/f15 [0,4194304] 0 2024-09-13T18:30:21.931 INFO:tasks.workunit.client.1.smithi149.stdout:0/337: truncate d1/d29/d31/d3e/d54/f6b 3871830 0 2024-09-13T18:30:21.932 INFO:tasks.workunit.client.1.smithi149.stdout:6/499: link dc/f5a dc/d15/f9e 0 2024-09-13T18:30:21.933 INFO:tasks.workunit.client.1.smithi149.stdout:4/420: creat df/d79/d12/f85 x:0 0 0 2024-09-13T18:30:21.933 INFO:tasks.workunit.client.1.smithi149.stdout:7/455: write d7/d9/f72 [172286,71587] 0 2024-09-13T18:30:21.934 INFO:tasks.workunit.client.1.smithi149.stdout:4/421: truncate df/d79/d12/d21/d22/d30/d56/f5a 1704514 0 2024-09-13T18:30:21.936 INFO:tasks.workunit.client.1.smithi149.stdout:9/295: sync 2024-09-13T18:30:21.936 INFO:tasks.workunit.client.1.smithi149.stdout:2/388: sync 2024-09-13T18:30:21.936 INFO:tasks.workunit.client.1.smithi149.stdout:8/375: sync 2024-09-13T18:30:21.937 INFO:tasks.workunit.client.1.smithi149.stdout:1/428: sync 2024-09-13T18:30:21.938 INFO:tasks.workunit.client.1.smithi149.stdout:6/500: dread dc/f3f [0,4194304] 0 2024-09-13T18:30:21.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/365: sync 2024-09-13T18:30:21.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/366: chown d3/d8/c4b 1519 1 2024-09-13T18:30:21.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/367: readlink d3/d10/l24 0 2024-09-13T18:30:21.939 INFO:tasks.workunit.client.1.smithi149.stdout:7/456: creat d7/d9/d1c/d51/d52/fa0 x:0 0 0 2024-09-13T18:30:21.939 INFO:tasks.workunit.client.1.smithi149.stdout:7/457: write d7/d76/f8a [1372022,108222] 0 2024-09-13T18:30:21.945 INFO:tasks.workunit.client.1.smithi149.stdout:2/389: truncate db/d1b/d1c/d20/d3a/f53 2876262 0 2024-09-13T18:30:21.945 INFO:tasks.workunit.client.1.smithi149.stdout:0/338: dread d1/d29/d31/d44/d47/f59 [0,4194304] 0 2024-09-13T18:30:21.946 INFO:tasks.workunit.client.1.smithi149.stdout:5/368: mkdir d3/d8/d6d 0 2024-09-13T18:30:21.946 INFO:tasks.workunit.client.1.smithi149.stdout:5/369: write d3/f3d [1116126,50466] 0 2024-09-13T18:30:21.946 INFO:tasks.workunit.client.1.smithi149.stdout:5/370: readlink d3/d8/d13/l1b 0 2024-09-13T18:30:21.949 INFO:tasks.workunit.client.1.smithi149.stdout:0/339: mkdir d1/d48/d70 0 2024-09-13T18:30:21.949 INFO:tasks.workunit.client.1.smithi149.stdout:7/458: getdents d7/d9/d1b 0 2024-09-13T18:30:21.950 INFO:tasks.workunit.client.1.smithi149.stdout:7/459: readlink d7/d12/l9b 0 2024-09-13T18:30:21.951 INFO:tasks.workunit.client.1.smithi149.stdout:0/340: truncate d1/d1b/f56 2883400 0 2024-09-13T18:30:21.951 INFO:tasks.workunit.client.1.smithi149.stdout:0/341: write d1/d2/d5a/f63 [735934,31954] 0 2024-09-13T18:30:21.952 INFO:tasks.workunit.client.1.smithi149.stdout:7/460: mkdir d7/d9/d1c/d1f/da1 0 2024-09-13T18:30:21.953 INFO:tasks.workunit.client.1.smithi149.stdout:0/342: link d1/d1b/c2a d1/c71 0 2024-09-13T18:30:21.955 INFO:tasks.workunit.client.1.smithi149.stdout:7/461: creat d7/d9/d1c/d1f/d21/d7b/d96/d9e/fa2 x:0 0 0 2024-09-13T18:30:21.955 INFO:tasks.workunit.client.1.smithi149.stdout:1/429: read d9/d10/d3f/f7a [3384224,13998] 0 2024-09-13T18:30:21.956 INFO:tasks.workunit.client.1.smithi149.stdout:6/501: dread dc/d76/f7b [0,4194304] 0 2024-09-13T18:30:21.956 INFO:tasks.workunit.client.1.smithi149.stdout:0/343: unlink d1/l11 0 2024-09-13T18:30:21.957 INFO:tasks.workunit.client.1.smithi149.stdout:7/462: mkdir d7/d9/d1c/d51/d52/d86/da3 0 2024-09-13T18:30:21.959 INFO:tasks.workunit.client.1.smithi149.stdout:0/344: getdents d1/d29/d31/d44 0 2024-09-13T18:30:21.959 INFO:tasks.workunit.client.1.smithi149.stdout:0/345: creat d1/d1b/f72 x:0 0 0 2024-09-13T18:30:21.959 INFO:tasks.workunit.client.1.smithi149.stdout:0/346: write d1/d2/fb [5636715,121723] 0 2024-09-13T18:30:21.960 INFO:tasks.workunit.client.1.smithi149.stdout:5/371: dread d3/f34 [0,4194304] 0 2024-09-13T18:30:21.974 INFO:tasks.workunit.client.1.smithi149.stdout:2/390: dwrite db/d13/f4a [0,4194304] 0 2024-09-13T18:30:21.976 INFO:tasks.workunit.client.1.smithi149.stdout:2/391: truncate db/d1b/d1c/d20/f45 298715 0 2024-09-13T18:30:21.976 INFO:tasks.workunit.client.1.smithi149.stdout:2/392: rmdir db/d1b/d1c/d20/d49 39 2024-09-13T18:30:21.978 INFO:tasks.workunit.client.1.smithi149.stdout:4/422: dwrite df/d79/d12/d17/f3a [0,4194304] 0 2024-09-13T18:30:21.979 INFO:tasks.workunit.client.1.smithi149.stdout:4/423: mknod df/d79/d12/d21/d22/d30/d41/d57/d60/c86 0 2024-09-13T18:30:21.981 INFO:tasks.workunit.client.1.smithi149.stdout:6/502: read dc/d2f/f3a [2451232,13264] 0 2024-09-13T18:30:21.981 INFO:tasks.workunit.client.1.smithi149.stdout:6/503: creat dc/f9f x:0 0 0 2024-09-13T18:30:21.981 INFO:tasks.workunit.client.1.smithi149.stdout:6/504: chown dc/d2f/d75/c94 3 1 2024-09-13T18:30:21.997 INFO:tasks.workunit.client.1.smithi149.stdout:6/505: write dc/d15/f55 [6077377,48357] 0 2024-09-13T18:30:21.999 INFO:tasks.workunit.client.1.smithi149.stdout:6/506: creat dc/d15/d54/d5e/d79/fa0 x:0 0 0 2024-09-13T18:30:21.999 INFO:tasks.workunit.client.1.smithi149.stdout:6/507: readlink dc/d15/l33 0 2024-09-13T18:30:22.000 INFO:tasks.workunit.client.1.smithi149.stdout:6/508: mkdir dc/d2f/d75/da1 0 2024-09-13T18:30:22.000 INFO:tasks.workunit.client.1.smithi149.stdout:6/509: chown dc/d15/d54/d85/c90 3 1 2024-09-13T18:30:22.000 INFO:tasks.workunit.client.1.smithi149.stdout:6/510: dread - dc/d15/d23/d5b/f52 zero size 2024-09-13T18:30:22.000 INFO:tasks.workunit.client.1.smithi149.stdout:6/511: rename dc to dc/d70/da2 22 2024-09-13T18:30:22.004 INFO:tasks.workunit.client.1.smithi149.stdout:7/463: dwrite d7/d12/f17 [0,4194304] 0 2024-09-13T18:30:22.004 INFO:tasks.workunit.client.1.smithi149.stdout:7/464: chown d7/d9/d1c/d2c/f38 408 1 2024-09-13T18:30:22.004 INFO:tasks.workunit.client.1.smithi149.stdout:5/372: dwrite d3/d10/f1c [0,4194304] 0 2024-09-13T18:30:22.005 INFO:tasks.workunit.client.1.smithi149.stdout:4/424: write df/d79/f80 [513515,110236] 0 2024-09-13T18:30:22.005 INFO:tasks.workunit.client.1.smithi149.stdout:4/425: chown l7 12 1 2024-09-13T18:30:22.005 INFO:tasks.workunit.client.1.smithi149.stdout:8/376: dwrite d2/d12/f43 [0,4194304] 0 2024-09-13T18:30:22.010 INFO:tasks.workunit.client.1.smithi149.stdout:7/465: mkdir d7/d9/d1c/d2f/da4 0 2024-09-13T18:30:22.010 INFO:tasks.workunit.client.1.smithi149.stdout:6/512: dread dc/d15/f44 [0,4194304] 0 2024-09-13T18:30:22.011 INFO:tasks.workunit.client.1.smithi149.stdout:6/513: truncate dc/d15/d23/f3e 5188298 0 2024-09-13T18:30:22.011 INFO:tasks.workunit.client.1.smithi149.stdout:6/514: chown dc/d76/f7b 0 1 2024-09-13T18:30:22.011 INFO:tasks.workunit.client.1.smithi149.stdout:6/515: dread - dc/d15/d23/d5b/f8b zero size 2024-09-13T18:30:22.011 INFO:tasks.workunit.client.1.smithi149.stdout:5/373: symlink d3/d5e/l6e 0 2024-09-13T18:30:22.017 INFO:tasks.workunit.client.1.smithi149.stdout:6/516: link dc/l11 dc/d2f/d75/la3 0 2024-09-13T18:30:22.019 INFO:tasks.workunit.client.1.smithi149.stdout:8/377: rename d2/d12/d2a/f2c to d2/d13/f7b 0 2024-09-13T18:30:22.020 INFO:tasks.workunit.client.1.smithi149.stdout:6/517: truncate dc/d2f/d75/f8e 893233 0 2024-09-13T18:30:22.021 INFO:tasks.workunit.client.1.smithi149.stdout:5/374: getdents d3/d10/d4c/d4e/d61/d63 0 2024-09-13T18:30:22.023 INFO:tasks.workunit.client.1.smithi149.stdout:6/518: link dc/d15/d23/f4c dc/d15/d23/d5f/fa4 0 2024-09-13T18:30:22.025 INFO:tasks.workunit.client.1.smithi149.stdout:5/375: symlink d3/d10/d32/d67/l6f 0 2024-09-13T18:30:22.025 INFO:tasks.workunit.client.1.smithi149.stdout:6/519: mkdir dc/d15/d23/d57/da5 0 2024-09-13T18:30:22.025 INFO:tasks.workunit.client.1.smithi149.stdout:6/520: dread - dc/d70/f97 zero size 2024-09-13T18:30:22.026 INFO:tasks.workunit.client.1.smithi149.stdout:5/376: symlink d3/l70 0 2024-09-13T18:30:22.027 INFO:tasks.workunit.client.1.smithi149.stdout:6/521: unlink dc/d2f/d75/la3 0 2024-09-13T18:30:22.027 INFO:tasks.workunit.client.1.smithi149.stdout:6/522: fdatasync dc/d15/d23/d5b/f8b 0 2024-09-13T18:30:22.028 INFO:tasks.workunit.client.1.smithi149.stdout:6/523: read dc/f53 [1304324,15879] 0 2024-09-13T18:30:22.029 INFO:tasks.workunit.client.1.smithi149.stdout:5/377: rename d3/d10/f1c to d3/d10/d4c/f71 0 2024-09-13T18:30:22.030 INFO:tasks.workunit.client.1.smithi149.stdout:6/524: unlink dc/d15/l71 0 2024-09-13T18:30:22.030 INFO:tasks.workunit.client.1.smithi149.stdout:6/525: read dc/d15/d23/d5f/fa4 [7274801,91127] 0 2024-09-13T18:30:22.031 INFO:tasks.workunit.client.1.smithi149.stdout:5/378: rename d3/d5e/c60 to d3/d10/c72 0 2024-09-13T18:30:22.032 INFO:tasks.workunit.client.1.smithi149.stdout:6/526: mknod dc/d15/d54/ca6 0 2024-09-13T18:30:22.033 INFO:tasks.workunit.client.1.smithi149.stdout:5/379: link d3/d10/d4c/d4e/d61/l68 d3/d10/d4c/d4e/d61/l73 0 2024-09-13T18:30:22.035 INFO:tasks.workunit.client.1.smithi149.stdout:6/527: creat dc/d15/d23/d57/da5/fa7 x:0 0 0 2024-09-13T18:30:22.035 INFO:tasks.workunit.client.1.smithi149.stdout:6/528: readlink dc/d15/l33 0 2024-09-13T18:30:22.035 INFO:tasks.workunit.client.1.smithi149.stdout:6/529: write dc/f22 [4951836,41676] 0 2024-09-13T18:30:22.035 INFO:tasks.workunit.client.1.smithi149.stdout:5/380: mknod d3/d10/d32/d54/c74 0 2024-09-13T18:30:22.035 INFO:tasks.workunit.client.1.smithi149.stdout:5/381: chown d3/d8/d13/l1b 4855 1 2024-09-13T18:30:22.036 INFO:tasks.workunit.client.1.smithi149.stdout:5/382: chown d3/d10/f23 3593498 1 2024-09-13T18:30:22.039 INFO:tasks.workunit.client.1.smithi149.stdout:3/432: sync 2024-09-13T18:30:22.040 INFO:tasks.workunit.client.1.smithi149.stdout:3/433: rename d1/d47/d30/d46/c60 to d1/d48/c94 0 2024-09-13T18:30:22.041 INFO:tasks.workunit.client.1.smithi149.stdout:3/434: rmdir d1/d2c/d56 39 2024-09-13T18:30:22.041 INFO:tasks.workunit.client.1.smithi149.stdout:3/435: dread - d1/d2e/d1d/f89 zero size 2024-09-13T18:30:22.042 INFO:tasks.workunit.client.1.smithi149.stdout:5/383: read d3/d10/d32/f40 [214335,106275] 0 2024-09-13T18:30:22.045 INFO:tasks.workunit.client.1.smithi149.stdout:7/466: dwrite d7/fd [0,4194304] 0 2024-09-13T18:30:22.046 INFO:tasks.workunit.client.1.smithi149.stdout:4/426: dwrite df/f15 [0,4194304] 0 2024-09-13T18:30:22.046 INFO:tasks.workunit.client.1.smithi149.stdout:8/378: dwrite d2/d13/f50 [4194304,4194304] 0 2024-09-13T18:30:22.047 INFO:tasks.workunit.client.1.smithi149.stdout:7/467: truncate d7/d9/f46 965683 0 2024-09-13T18:30:22.049 INFO:tasks.workunit.client.1.smithi149.stdout:4/427: creat df/d79/d12/d21/d22/d30/d56/f87 x:0 0 0 2024-09-13T18:30:22.049 INFO:tasks.workunit.client.1.smithi149.stdout:7/468: write d7/d9/d1c/f29 [451372,67355] 0 2024-09-13T18:30:22.051 INFO:tasks.workunit.client.1.smithi149.stdout:8/379: creat d2/d12/f7c x:0 0 0 2024-09-13T18:30:22.053 INFO:tasks.workunit.client.1.smithi149.stdout:7/469: truncate d7/d9/d1b/f57 586055 0 2024-09-13T18:30:22.053 INFO:tasks.workunit.client.1.smithi149.stdout:7/470: chown d7/d9/d1c/d51 12 1 2024-09-13T18:30:22.061 INFO:tasks.workunit.client.1.smithi149.stdout:8/380: creat d2/d13/f7d x:0 0 0 2024-09-13T18:30:22.063 INFO:tasks.workunit.client.1.smithi149.stdout:7/471: creat d7/d9/d1b/fa5 x:0 0 0 2024-09-13T18:30:22.064 INFO:tasks.workunit.client.1.smithi149.stdout:6/530: dwrite dc/d15/d23/f40 [0,4194304] 0 2024-09-13T18:30:22.064 INFO:tasks.workunit.client.1.smithi149.stdout:3/436: dread d1/d47/d30/f71 [0,4194304] 0 2024-09-13T18:30:22.064 INFO:tasks.workunit.client.1.smithi149.stdout:7/472: unlink d7/f59 0 2024-09-13T18:30:22.068 INFO:tasks.workunit.client.1.smithi149.stdout:7/473: link d7/d9/d1c/d2f/d6f/l89 d7/d9/d1c/d51/d52/d86/da3/la6 0 2024-09-13T18:30:22.070 INFO:tasks.workunit.client.1.smithi149.stdout:7/474: rename d7/d9/d1c/d1f/d21/d49/f56 to d7/d9/d1c/d1f/d3d/fa7 0 2024-09-13T18:30:22.073 INFO:tasks.workunit.client.1.smithi149.stdout:4/428: dwrite df/d79/d12/d17/f5b [0,4194304] 0 2024-09-13T18:30:22.081 INFO:tasks.workunit.client.1.smithi149.stdout:8/381: dread d2/d13/f7b [0,4194304] 0 2024-09-13T18:30:22.087 INFO:tasks.workunit.client.1.smithi149.stdout:9/296: sync 2024-09-13T18:30:22.087 INFO:tasks.workunit.client.1.smithi149.stdout:2/393: sync 2024-09-13T18:30:22.089 INFO:tasks.workunit.client.1.smithi149.stdout:2/394: rename db/d13/d70/l86 to db/d1b/d2f/d30/l88 0 2024-09-13T18:30:22.089 INFO:tasks.workunit.client.1.smithi149.stdout:7/475: dread d7/f4c [4194304,4194304] 0 2024-09-13T18:30:22.090 INFO:tasks.workunit.client.1.smithi149.stdout:0/347: sync 2024-09-13T18:30:22.090 INFO:tasks.workunit.client.1.smithi149.stdout:1/430: sync 2024-09-13T18:30:22.090 INFO:tasks.workunit.client.1.smithi149.stdout:9/297: symlink d0/d18/d27/l60 0 2024-09-13T18:30:22.091 INFO:tasks.workunit.client.1.smithi149.stdout:2/395: mkdir db/d13/d70/d89 0 2024-09-13T18:30:22.091 INFO:tasks.workunit.client.1.smithi149.stdout:2/396: dread - db/d13/f79 zero size 2024-09-13T18:30:22.091 INFO:tasks.workunit.client.1.smithi149.stdout:2/397: write db/d1b/d1c/d20/d2b/d3e/f68 [22373,18167] 0 2024-09-13T18:30:22.091 INFO:tasks.workunit.client.1.smithi149.stdout:2/398: chown db/d1b/d2f/d30/f4f 1389 1 2024-09-13T18:30:22.092 INFO:tasks.workunit.client.1.smithi149.stdout:7/476: unlink d7/d9/d1c/d34/d4e/c7a 0 2024-09-13T18:30:22.093 INFO:tasks.workunit.client.1.smithi149.stdout:9/298: dread d0/d18/d27/f3e [0,4194304] 0 2024-09-13T18:30:22.093 INFO:tasks.workunit.client.1.smithi149.stdout:9/299: readlink d0/d18/d27/l5a 0 2024-09-13T18:30:22.093 INFO:tasks.workunit.client.1.smithi149.stdout:0/348: creat d1/d29/d31/d3e/f73 x:0 0 0 2024-09-13T18:30:22.095 INFO:tasks.workunit.client.1.smithi149.stdout:1/431: creat d9/d10/d34/d3c/f85 x:0 0 0 2024-09-13T18:30:22.095 INFO:tasks.workunit.client.1.smithi149.stdout:1/432: truncate d9/d15/d40/d4a/f69 121336 0 2024-09-13T18:30:22.095 INFO:tasks.workunit.client.1.smithi149.stdout:1/433: getdents d9/d10/d83 0 2024-09-13T18:30:22.096 INFO:tasks.workunit.client.1.smithi149.stdout:2/399: mknod db/d1b/d1c/d20/d3a/c8a 0 2024-09-13T18:30:22.098 INFO:tasks.workunit.client.1.smithi149.stdout:3/437: dwrite d1/d47/d30/d46/f52 [0,4194304] 0 2024-09-13T18:30:22.098 INFO:tasks.workunit.client.1.smithi149.stdout:9/300: mkdir d0/d47/d61 0 2024-09-13T18:30:22.099 INFO:tasks.workunit.client.1.smithi149.stdout:9/301: chown d0/d18/d27 11064 1 2024-09-13T18:30:22.099 INFO:tasks.workunit.client.1.smithi149.stdout:9/302: readlink d0/d47/l4a 0 2024-09-13T18:30:22.099 INFO:tasks.workunit.client.1.smithi149.stdout:1/434: symlink d9/d10/d3f/l86 0 2024-09-13T18:30:22.099 INFO:tasks.workunit.client.1.smithi149.stdout:2/400: symlink db/d1b/l8b 0 2024-09-13T18:30:22.099 INFO:tasks.workunit.client.1.smithi149.stdout:2/401: creat db/d1b/d1c/d20/d3a/d75/f8c x:0 0 0 2024-09-13T18:30:22.101 INFO:tasks.workunit.client.1.smithi149.stdout:7/477: creat d7/d9/d11/d50/fa8 x:0 0 0 2024-09-13T18:30:22.101 INFO:tasks.workunit.client.1.smithi149.stdout:7/478: stat d7/d76/c82 0 2024-09-13T18:30:22.105 INFO:tasks.workunit.client.1.smithi149.stdout:7/479: write d7/d9/d11/f94 [968748,29126] 0 2024-09-13T18:30:22.105 INFO:tasks.workunit.client.1.smithi149.stdout:7/480: fdatasync d7/d9/d1c/d1f/d21/f77 0 2024-09-13T18:30:22.105 INFO:tasks.workunit.client.1.smithi149.stdout:7/481: dread - d7/d9/d1c/d34/f97 zero size 2024-09-13T18:30:22.105 INFO:tasks.workunit.client.1.smithi149.stdout:7/482: readlink d7/d9/d1c/d51/d52/d86/da3/la6 0 2024-09-13T18:30:22.107 INFO:tasks.workunit.client.1.smithi149.stdout:6/531: dwrite dc/d15/d23/f31 [0,4194304] 0 2024-09-13T18:30:22.108 INFO:tasks.workunit.client.1.smithi149.stdout:3/438: rename d1/d4 to d1/d2e/d1d/d95 0 2024-09-13T18:30:22.108 INFO:tasks.workunit.client.1.smithi149.stdout:7/483: getdents d7/d9/d1c/d2c/d60 0 2024-09-13T18:30:22.108 INFO:tasks.workunit.client.1.smithi149.stdout:7/484: truncate d7/d9/d1c/d1f/d21/f83 672430 0 2024-09-13T18:30:22.110 INFO:tasks.workunit.client.1.smithi149.stdout:3/439: mkdir d1/d2c/d38/d88/d96 0 2024-09-13T18:30:22.111 INFO:tasks.workunit.client.1.smithi149.stdout:3/440: rmdir d1/d2c/d42 39 2024-09-13T18:30:22.111 INFO:tasks.workunit.client.1.smithi149.stdout:3/441: fdatasync d1/f85 0 2024-09-13T18:30:22.112 INFO:tasks.workunit.client.1.smithi149.stdout:3/442: mkdir d1/d47/d97 0 2024-09-13T18:30:22.113 INFO:tasks.workunit.client.1.smithi149.stdout:3/443: truncate d1/d12/f1a 497730 0 2024-09-13T18:30:22.113 INFO:tasks.workunit.client.1.smithi149.stdout:3/444: chown d1/f85 111231925 1 2024-09-13T18:30:22.115 INFO:tasks.workunit.client.1.smithi149.stdout:3/445: unlink d1/d2c/d38/f87 0 2024-09-13T18:30:22.115 INFO:tasks.workunit.client.1.smithi149.stdout:9/303: write d0/d18/d19/d3b/f4f [306053,95000] 0 2024-09-13T18:30:22.115 INFO:tasks.workunit.client.1.smithi149.stdout:8/382: dwrite d2/d12/f57 [0,4194304] 0 2024-09-13T18:30:22.115 INFO:tasks.workunit.client.1.smithi149.stdout:9/304: stat d0/d18/d27 0 2024-09-13T18:30:22.115 INFO:tasks.workunit.client.1.smithi149.stdout:9/305: creat d0/d2e/f62 x:0 0 0 2024-09-13T18:30:22.119 INFO:tasks.workunit.client.1.smithi149.stdout:4/429: dwrite df/f20 [0,4194304] 0 2024-09-13T18:30:22.122 INFO:tasks.workunit.client.1.smithi149.stdout:0/349: dwrite d1/d2/d5a/f63 [0,4194304] 0 2024-09-13T18:30:22.122 INFO:tasks.workunit.client.1.smithi149.stdout:0/350: chown d1/d1b/c2a 2575 1 2024-09-13T18:30:22.124 INFO:tasks.workunit.client.1.smithi149.stdout:9/306: link d0/d2e/f43 d0/d2e/d42/f63 0 2024-09-13T18:30:22.125 INFO:tasks.workunit.client.1.smithi149.stdout:0/351: dread d1/f6a [0,4194304] 0 2024-09-13T18:30:22.127 INFO:tasks.workunit.client.1.smithi149.stdout:9/307: mknod d0/d47/d54/c64 0 2024-09-13T18:30:22.127 INFO:tasks.workunit.client.1.smithi149.stdout:0/352: symlink d1/l74 0 2024-09-13T18:30:22.128 INFO:tasks.workunit.client.1.smithi149.stdout:9/308: link d0/d2e/f58 d0/d47/f65 0 2024-09-13T18:30:22.130 INFO:tasks.workunit.client.1.smithi149.stdout:9/309: unlink d0/d18/d19/l45 0 2024-09-13T18:30:22.133 INFO:tasks.workunit.client.1.smithi149.stdout:9/310: creat d0/d18/d27/f66 x:0 0 0 2024-09-13T18:30:22.135 INFO:tasks.workunit.client.1.smithi149.stdout:9/311: dread d0/f29 [0,4194304] 0 2024-09-13T18:30:22.135 INFO:tasks.workunit.client.1.smithi149.stdout:9/312: creat d0/f67 x:0 0 0 2024-09-13T18:30:22.137 INFO:tasks.workunit.client.1.smithi149.stdout:9/313: mkdir d0/d18/d68 0 2024-09-13T18:30:22.138 INFO:tasks.workunit.client.1.smithi149.stdout:8/383: dread d2/d12/f46 [0,4194304] 0 2024-09-13T18:30:22.138 INFO:tasks.workunit.client.1.smithi149.stdout:8/384: creat d2/d12/d1b/f7e x:0 0 0 2024-09-13T18:30:22.138 INFO:tasks.workunit.client.1.smithi149.stdout:4/430: dread df/d79/d12/d17/d3d/f6c [4194304,4194304] 0 2024-09-13T18:30:22.138 INFO:tasks.workunit.client.1.smithi149.stdout:2/402: dwrite db/fd [0,4194304] 0 2024-09-13T18:30:22.140 INFO:tasks.workunit.client.1.smithi149.stdout:8/385: mkdir d2/d13/d3a/d7f 0 2024-09-13T18:30:22.141 INFO:tasks.workunit.client.1.smithi149.stdout:8/386: creat d2/d12/d6e/f80 x:0 0 0 2024-09-13T18:30:22.142 INFO:tasks.workunit.client.1.smithi149.stdout:8/387: creat d2/d13/f81 x:0 0 0 2024-09-13T18:30:22.144 INFO:tasks.workunit.client.1.smithi149.stdout:8/388: creat d2/d13/d3a/d7f/f82 x:0 0 0 2024-09-13T18:30:22.150 INFO:tasks.workunit.client.1.smithi149.stdout:2/403: write db/d1b/d1c/d20/d2b/d3e/f46 [737322,101557] 0 2024-09-13T18:30:22.150 INFO:tasks.workunit.client.1.smithi149.stdout:0/353: dread d1/d2/d5a/d62/f6c [0,4194304] 0 2024-09-13T18:30:22.150 INFO:tasks.workunit.client.1.smithi149.stdout:0/354: fdatasync d1/d29/d31/d3e/d54/f6b 0 2024-09-13T18:30:22.150 INFO:tasks.workunit.client.1.smithi149.stdout:0/355: dread - d1/d1b/f72 zero size 2024-09-13T18:30:22.151 INFO:tasks.workunit.client.1.smithi149.stdout:0/356: creat d1/d2/d5a/f75 x:0 0 0 2024-09-13T18:30:22.152 INFO:tasks.workunit.client.1.smithi149.stdout:0/357: mknod d1/d1b/c76 0 2024-09-13T18:30:22.155 INFO:tasks.workunit.client.1.smithi149.stdout:8/389: write d2/d12/f57 [1972447,22613] 0 2024-09-13T18:30:22.164 INFO:tasks.workunit.client.1.smithi149.stdout:0/358: read d1/d29/d31/d3e/d54/f6b [1832232,38157] 0 2024-09-13T18:30:22.165 INFO:tasks.workunit.client.1.smithi149.stdout:6/532: dwrite dc/d15/d54/d5e/d79/fa0 [0,4194304] 0 2024-09-13T18:30:22.165 INFO:tasks.workunit.client.1.smithi149.stdout:6/533: fsync f5 0 2024-09-13T18:30:22.165 INFO:tasks.workunit.client.1.smithi149.stdout:3/446: dwrite d1/d2e/d1d/f2b [0,4194304] 0 2024-09-13T18:30:22.165 INFO:tasks.workunit.client.1.smithi149.stdout:4/431: dwrite df/d79/d12/d17/d3d/f73 [0,4194304] 0 2024-09-13T18:30:22.165 INFO:tasks.workunit.client.1.smithi149.stdout:4/432: stat df/d79/d12/d21/d22/d30/d41/d57 0 2024-09-13T18:30:22.166 INFO:tasks.workunit.client.1.smithi149.stdout:0/359: creat d1/d2/d5a/d62/f77 x:0 0 0 2024-09-13T18:30:22.167 INFO:tasks.workunit.client.1.smithi149.stdout:7/485: dwrite d7/d9/d1c/d2f/d31/f5b [4194304,4194304] 0 2024-09-13T18:30:22.170 INFO:tasks.workunit.client.1.smithi149.stdout:3/447: mknod d1/d21/c98 0 2024-09-13T18:30:22.173 INFO:tasks.workunit.client.1.smithi149.stdout:4/433: creat df/d79/d12/d21/d22/d30/f88 x:0 0 0 2024-09-13T18:30:22.177 INFO:tasks.workunit.client.1.smithi149.stdout:9/314: truncate d0/d47/d54/f55 2584595 0 2024-09-13T18:30:22.177 INFO:tasks.workunit.client.1.smithi149.stdout:4/434: rename df/d79/d1c/l4b to df/d79/d1c/d69/l89 0 2024-09-13T18:30:22.177 INFO:tasks.workunit.client.1.smithi149.stdout:4/435: fsync df/d79/d12/d21/d22/f62 0 2024-09-13T18:30:22.181 INFO:tasks.workunit.client.1.smithi149.stdout:5/384: sync 2024-09-13T18:30:22.182 INFO:tasks.workunit.client.1.smithi149.stdout:5/385: mkdir d3/d10/d4c/d4e/d61/d75 0 2024-09-13T18:30:22.183 INFO:tasks.workunit.client.1.smithi149.stdout:8/390: dwrite d2/d12/d40/f5e [0,4194304] 0 2024-09-13T18:30:22.190 INFO:tasks.workunit.client.1.smithi149.stdout:8/391: getdents d2/d12/d40 0 2024-09-13T18:30:22.190 INFO:tasks.workunit.client.1.smithi149.stdout:8/392: chown d2/d12/d1b/c55 12710581 1 2024-09-13T18:30:22.190 INFO:tasks.workunit.client.1.smithi149.stdout:8/393: creat d2/d12/d2a/d4d/f83 x:0 0 0 2024-09-13T18:30:22.190 INFO:tasks.workunit.client.1.smithi149.stdout:8/394: fdatasync d2/d12/d1b/f23 0 2024-09-13T18:30:22.190 INFO:tasks.workunit.client.1.smithi149.stdout:8/395: truncate d2/d12/d2a/d4d/f83 200736 0 2024-09-13T18:30:22.191 INFO:tasks.workunit.client.1.smithi149.stdout:8/396: write d2/d13/f7d [513237,117799] 0 2024-09-13T18:30:22.191 INFO:tasks.workunit.client.1.smithi149.stdout:8/397: fsync d2/d12/f7c 0 2024-09-13T18:30:22.191 INFO:tasks.workunit.client.1.smithi149.stdout:8/398: fdatasync d2/d52/f74 0 2024-09-13T18:30:22.191 INFO:tasks.workunit.client.1.smithi149.stdout:8/399: creat d2/d52/f84 x:0 0 0 2024-09-13T18:30:22.191 INFO:tasks.workunit.client.1.smithi149.stdout:8/400: chown d2/d52/l6c 23 1 2024-09-13T18:30:22.191 INFO:tasks.workunit.client.1.smithi149.stdout:8/401: fsync d2/d13/f7b 0 2024-09-13T18:30:22.191 INFO:tasks.workunit.client.1.smithi149.stdout:8/402: truncate d2/d12/d40/f75 611626 0 2024-09-13T18:30:22.191 INFO:tasks.workunit.client.1.smithi149.stdout:8/403: chown d2/d12/c3e 170 1 2024-09-13T18:30:22.191 INFO:tasks.workunit.client.1.smithi149.stdout:7/486: dread d7/d9/d1b/f36 [0,4194304] 0 2024-09-13T18:30:22.194 INFO:tasks.workunit.client.1.smithi149.stdout:2/404: dwrite db/d1b/d48/f6f [4194304,4194304] 0 2024-09-13T18:30:22.194 INFO:tasks.workunit.client.1.smithi149.stdout:2/405: fsync db/f7a 0 2024-09-13T18:30:22.195 INFO:tasks.workunit.client.1.smithi149.stdout:2/406: read db/d1b/d1c/d20/d2b/f57 [650949,59752] 0 2024-09-13T18:30:22.195 INFO:tasks.workunit.client.1.smithi149.stdout:2/407: write db/d13/f18 [3540291,23017] 0 2024-09-13T18:30:22.195 INFO:tasks.workunit.client.1.smithi149.stdout:8/404: rename d2/d12/f3d to d2/d13/f85 0 2024-09-13T18:30:22.196 INFO:tasks.workunit.client.1.smithi149.stdout:5/386: write d3/d10/d32/f3c [805846,8718] 0 2024-09-13T18:30:22.201 INFO:tasks.workunit.client.1.smithi149.stdout:2/408: mkdir db/d10/d8d 0 2024-09-13T18:30:22.203 INFO:tasks.workunit.client.1.smithi149.stdout:5/387: getdents d3/d5e 0 2024-09-13T18:30:22.203 INFO:tasks.workunit.client.1.smithi149.stdout:5/388: readlink d3/d10/d32/l4a 0 2024-09-13T18:30:22.204 INFO:tasks.workunit.client.1.smithi149.stdout:2/409: link db/d1b/d2f/d30/l64 db/d13/d70/l8e 0 2024-09-13T18:30:22.204 INFO:tasks.workunit.client.1.smithi149.stdout:2/410: write db/d1b/d1c/d20/d2b/f65 [2260309,85462] 0 2024-09-13T18:30:22.206 INFO:tasks.workunit.client.1.smithi149.stdout:8/405: unlink d2/d13/c20 0 2024-09-13T18:30:22.207 INFO:tasks.workunit.client.1.smithi149.stdout:4/436: dwrite df/d79/d12/d21/d22/d30/d56/f5a [0,4194304] 0 2024-09-13T18:30:22.207 INFO:tasks.workunit.client.1.smithi149.stdout:4/437: chown df/l47 66257923 1 2024-09-13T18:30:22.207 INFO:tasks.workunit.client.1.smithi149.stdout:4/438: read - df/d79/d1c/f67 zero size 2024-09-13T18:30:22.207 INFO:tasks.workunit.client.1.smithi149.stdout:3/448: dwrite d1/d2e/d1d/f89 [0,4194304] 0 2024-09-13T18:30:22.208 INFO:tasks.workunit.client.1.smithi149.stdout:3/449: fsync d1/d12/f77 0 2024-09-13T18:30:22.208 INFO:tasks.workunit.client.1.smithi149.stdout:9/315: dwrite d0/d2e/d42/f5e [0,4194304] 0 2024-09-13T18:30:22.208 INFO:tasks.workunit.client.1.smithi149.stdout:6/534: dwrite dc/d15/f9e [0,4194304] 0 2024-09-13T18:30:22.208 INFO:tasks.workunit.client.1.smithi149.stdout:9/316: write d0/d18/d27/f3e [623402,101800] 0 2024-09-13T18:30:22.208 INFO:tasks.workunit.client.1.smithi149.stdout:6/535: chown dc/d15/d23/f31 29494 1 2024-09-13T18:30:22.208 INFO:tasks.workunit.client.1.smithi149.stdout:5/389: mkdir d3/d10/d32/d54/d76 0 2024-09-13T18:30:22.208 INFO:tasks.workunit.client.1.smithi149.stdout:2/411: rename db/d1b/d2f/d30/l71 to db/d1b/d1c/d85/l8f 0 2024-09-13T18:30:22.209 INFO:tasks.workunit.client.1.smithi149.stdout:8/406: mkdir d2/d5b/d86 0 2024-09-13T18:30:22.214 INFO:tasks.workunit.client.1.smithi149.stdout:4/439: mkdir df/d79/d12/d21/d22/d30/d41/d57/d8a 0 2024-09-13T18:30:22.219 INFO:tasks.workunit.client.1.smithi149.stdout:9/317: creat d0/d2e/d42/d59/f69 x:0 0 0 2024-09-13T18:30:22.219 INFO:tasks.workunit.client.1.smithi149.stdout:9/318: write d0/f29 [104463,119139] 0 2024-09-13T18:30:22.219 INFO:tasks.workunit.client.1.smithi149.stdout:6/536: mknod dc/d76/ca8 0 2024-09-13T18:30:22.220 INFO:tasks.workunit.client.1.smithi149.stdout:1/435: sync 2024-09-13T18:30:22.221 INFO:tasks.workunit.client.1.smithi149.stdout:1/436: creat d9/d15/d40/d4a/f87 x:0 0 0 2024-09-13T18:30:22.221 INFO:tasks.workunit.client.1.smithi149.stdout:8/407: mkdir d2/d12/d87 0 2024-09-13T18:30:22.222 INFO:tasks.workunit.client.1.smithi149.stdout:1/437: dread d9/d15/d40/d4a/f69 [0,4194304] 0 2024-09-13T18:30:22.222 INFO:tasks.workunit.client.1.smithi149.stdout:5/390: write d3/d10/d32/f38 [924178,77809] 0 2024-09-13T18:30:22.223 INFO:tasks.workunit.client.1.smithi149.stdout:6/537: mkdir dc/d15/d54/da9 0 2024-09-13T18:30:22.227 INFO:tasks.workunit.client.1.smithi149.stdout:2/412: link db/d1b/d1c/d20/f50 db/d1b/d1c/d20/d49/f90 0 2024-09-13T18:30:22.227 INFO:tasks.workunit.client.1.smithi149.stdout:2/413: write db/d10/f25 [5085310,17818] 0 2024-09-13T18:30:22.229 INFO:tasks.workunit.client.1.smithi149.stdout:8/408: rmdir d2/d12/d1b/d58 39 2024-09-13T18:30:22.232 INFO:tasks.workunit.client.1.smithi149.stdout:5/391: rename d3/d10/d4c/d4e/d61/l65 to d3/d10/d32/l77 0 2024-09-13T18:30:22.232 INFO:tasks.workunit.client.1.smithi149.stdout:5/392: stat d3/d10/d32/d54/f2a 0 2024-09-13T18:30:22.232 INFO:tasks.workunit.client.1.smithi149.stdout:5/393: chown d3/l1d 3 1 2024-09-13T18:30:22.232 INFO:tasks.workunit.client.1.smithi149.stdout:8/409: dread d2/d12/f46 [0,4194304] 0 2024-09-13T18:30:22.233 INFO:tasks.workunit.client.1.smithi149.stdout:9/319: link d0/d47/d54/c64 d0/d18/c6a 0 2024-09-13T18:30:22.233 INFO:tasks.workunit.client.1.smithi149.stdout:9/320: write d0/d47/f65 [489351,93153] 0 2024-09-13T18:30:22.233 INFO:tasks.workunit.client.1.smithi149.stdout:6/538: mkdir dc/d15/daa 0 2024-09-13T18:30:22.234 INFO:tasks.workunit.client.1.smithi149.stdout:3/450: dwrite d1/d2e/f37 [0,4194304] 0 2024-09-13T18:30:22.235 INFO:tasks.workunit.client.1.smithi149.stdout:2/414: link db/d10/d12/l35 db/d13/l91 0 2024-09-13T18:30:22.235 INFO:tasks.workunit.client.1.smithi149.stdout:2/415: truncate db/d10/f61 253345 0 2024-09-13T18:30:22.235 INFO:tasks.workunit.client.1.smithi149.stdout:2/416: creat db/d1b/d1c/d20/d2b/f92 x:0 0 0 2024-09-13T18:30:22.235 INFO:tasks.workunit.client.1.smithi149.stdout:2/417: chown db/d1b/d1c/d20/d3a/d75/f83 2791291 1 2024-09-13T18:30:22.237 INFO:tasks.workunit.client.1.smithi149.stdout:5/394: symlink d3/d10/d4c/d4e/d61/l78 0 2024-09-13T18:30:22.237 INFO:tasks.workunit.client.1.smithi149.stdout:5/395: chown d3/d8/d6d 31 1 2024-09-13T18:30:22.237 INFO:tasks.workunit.client.1.smithi149.stdout:5/396: dread - d3/d8/d13/f52 zero size 2024-09-13T18:30:22.238 INFO:tasks.workunit.client.1.smithi149.stdout:8/410: mkdir d2/d5b/d88 0 2024-09-13T18:30:22.239 INFO:tasks.workunit.client.1.smithi149.stdout:9/321: creat d0/d47/d61/f6b x:0 0 0 2024-09-13T18:30:22.239 INFO:tasks.workunit.client.1.smithi149.stdout:9/322: chown d0/d47/d54 19347318 1 2024-09-13T18:30:22.241 INFO:tasks.workunit.client.1.smithi149.stdout:8/411: rename d2/d13/d3a/f61 to d2/d12/f89 0 2024-09-13T18:30:22.241 INFO:tasks.workunit.client.1.smithi149.stdout:8/412: truncate d2/f15 2302161 0 2024-09-13T18:30:22.242 INFO:tasks.workunit.client.1.smithi149.stdout:3/451: dread d1/d2e/d1d/f23 [0,4194304] 0 2024-09-13T18:30:22.247 INFO:tasks.workunit.client.1.smithi149.stdout:3/452: mknod d1/d47/d30/d5a/c99 0 2024-09-13T18:30:22.265 INFO:tasks.workunit.client.1.smithi149.stdout:3/453: write d1/d47/d30/d46/f52 [397480,55157] 0 2024-09-13T18:30:22.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:21 smithi149 ceph-mon[35845]: pgmap v13: 65 pgs: 65 active+clean; 407 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 25 MiB/s wr, 440 op/s 2024-09-13T18:30:22.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:21 smithi149 ceph-mon[35845]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:22.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:21 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/261882439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:30:22.282 INFO:tasks.workunit.client.1.smithi149.stdout:1/438: dwrite d9/d15/d40/d4a/f87 [0,4194304] 0 2024-09-13T18:30:22.282 INFO:tasks.workunit.client.1.smithi149.stdout:1/439: read - d9/d10/d34/d53/d57/d6c/f7f zero size 2024-09-13T18:30:22.282 INFO:tasks.workunit.client.1.smithi149.stdout:1/440: chown d9/d10/d37/d38/c63 3 1 2024-09-13T18:30:22.284 INFO:tasks.workunit.client.1.smithi149.stdout:1/441: rename d9/d58/f61 to d9/d10/d43/f88 0 2024-09-13T18:30:22.284 INFO:tasks.workunit.client.1.smithi149.stdout:1/442: write d9/f45 [193244,107933] 0 2024-09-13T18:30:22.285 INFO:tasks.workunit.client.1.smithi149.stdout:1/443: creat d9/d10/d34/d53/d7b/f89 x:0 0 0 2024-09-13T18:30:22.285 INFO:tasks.workunit.client.1.smithi149.stdout:1/444: chown d9/d10/d83 5656836 1 2024-09-13T18:30:22.285 INFO:tasks.workunit.client.1.smithi149.stdout:1/445: chown d9/d10/d3f/f67 68763134 1 2024-09-13T18:30:22.286 INFO:tasks.workunit.client.1.smithi149.stdout:8/413: dwrite d2/d12/d1b/f7e [0,4194304] 0 2024-09-13T18:30:22.286 INFO:tasks.workunit.client.1.smithi149.stdout:3/454: fsync d1/d47/d30/d46/f52 0 2024-09-13T18:30:22.286 INFO:tasks.workunit.client.1.smithi149.stdout:1/446: mknod d9/d10/c8a 0 2024-09-13T18:30:22.286 INFO:tasks.workunit.client.1.smithi149.stdout:2/418: dwrite db/d10/f61 [0,4194304] 0 2024-09-13T18:30:22.286 INFO:tasks.workunit.client.1.smithi149.stdout:2/419: truncate db/d1b/d1c/d20/d3a/f53 3317505 0 2024-09-13T18:30:22.287 INFO:tasks.workunit.client.1.smithi149.stdout:5/397: dwrite d3/f4 [0,4194304] 0 2024-09-13T18:30:22.288 INFO:tasks.workunit.client.1.smithi149.stdout:8/414: truncate d2/d12/d2a/d4d/f6f 855184 0 2024-09-13T18:30:22.291 INFO:tasks.workunit.client.1.smithi149.stdout:3/455: rename d1/d2e/d1d/d95 to d1/d2e/d1d/d9a 0 2024-09-13T18:30:22.291 INFO:tasks.workunit.client.1.smithi149.stdout:1/447: rename d9/d15/d40/d4a/d6b to d9/d15/d60/d80/d8b 0 2024-09-13T18:30:22.298 INFO:tasks.workunit.client.1.smithi149.stdout:1/448: mkdir d9/d10/d3f/d76/d8c 0 2024-09-13T18:30:22.306 INFO:tasks.workunit.client.1.smithi149.stdout:2/420: write db/d1b/d48/f6f [6037455,18843] 0 2024-09-13T18:30:22.309 INFO:tasks.workunit.client.1.smithi149.stdout:3/456: dread d1/d47/d30/f71 [0,4194304] 0 2024-09-13T18:30:22.309 INFO:tasks.workunit.client.1.smithi149.stdout:3/457: read d1/f11 [104512,30868] 0 2024-09-13T18:30:22.309 INFO:tasks.workunit.client.1.smithi149.stdout:3/458: read - d1/f83 zero size 2024-09-13T18:30:22.309 INFO:tasks.workunit.client.1.smithi149.stdout:2/421: creat db/d10/d8d/f93 x:0 0 0 2024-09-13T18:30:22.309 INFO:tasks.workunit.client.1.smithi149.stdout:2/422: chown db/d1b/d1c/d20/f45 8741 1 2024-09-13T18:30:22.309 INFO:tasks.workunit.client.1.smithi149.stdout:5/398: dread d3/d8/d13/f22 [0,4194304] 0 2024-09-13T18:30:22.309 INFO:tasks.workunit.client.1.smithi149.stdout:5/399: fsync d3/d8/fe 0 2024-09-13T18:30:22.310 INFO:tasks.workunit.client.1.smithi149.stdout:3/459: mkdir d1/d47/d97/d9b 0 2024-09-13T18:30:22.311 INFO:tasks.workunit.client.1.smithi149.stdout:3/460: symlink d1/d12/l9c 0 2024-09-13T18:30:22.312 INFO:tasks.workunit.client.1.smithi149.stdout:3/461: rename d1/d2e/d1d/f89 to d1/d47/d30/d46/f9d 0 2024-09-13T18:30:22.314 INFO:tasks.workunit.client.1.smithi149.stdout:1/449: rmdir d9/d15 39 2024-09-13T18:30:22.316 INFO:tasks.workunit.client.1.smithi149.stdout:1/450: creat d9/d10/d62/f8d x:0 0 0 2024-09-13T18:30:22.322 INFO:tasks.workunit.client.1.smithi149.stdout:5/400: dread d3/d8/d13/f22 [0,4194304] 0 2024-09-13T18:30:22.327 INFO:tasks.workunit.client.1.smithi149.stdout:3/462: write d1/d21/f63 [3072167,17077] 0 2024-09-13T18:30:22.327 INFO:tasks.workunit.client.1.smithi149.stdout:8/415: dread d2/fc [0,4194304] 0 2024-09-13T18:30:22.327 INFO:tasks.workunit.client.1.smithi149.stdout:8/416: stat d2/d12/f89 0 2024-09-13T18:30:22.327 INFO:tasks.workunit.client.1.smithi149.stdout:3/463: write d1/d2e/f17 [578089,80055] 0 2024-09-13T18:30:22.327 INFO:tasks.workunit.client.1.smithi149.stdout:3/464: chown d1/d12/l9c 77353724 1 2024-09-13T18:30:22.328 INFO:tasks.workunit.client.1.smithi149.stdout:9/323: dwrite d0/d47/f65 [0,4194304] 0 2024-09-13T18:30:22.329 INFO:tasks.workunit.client.1.smithi149.stdout:9/324: write d0/d18/d27/f66 [285591,86700] 0 2024-09-13T18:30:22.329 INFO:tasks.workunit.client.1.smithi149.stdout:3/465: mknod d1/d2e/d1d/d6c/c9e 0 2024-09-13T18:30:22.329 INFO:tasks.workunit.client.1.smithi149.stdout:2/423: dread db/d10/f14 [0,4194304] 0 2024-09-13T18:30:22.329 INFO:tasks.workunit.client.1.smithi149.stdout:2/424: write db/d1b/d48/f74 [5231428,120813] 0 2024-09-13T18:30:22.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:21 smithi038 ceph-mon[27689]: pgmap v13: 65 pgs: 65 active+clean; 407 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 25 MiB/s wr, 440 op/s 2024-09-13T18:30:22.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:21 smithi038 ceph-mon[27689]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:22.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:21 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/261882439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:30:22.332 INFO:tasks.workunit.client.1.smithi149.stdout:9/325: symlink d0/l6c 0 2024-09-13T18:30:22.332 INFO:tasks.workunit.client.1.smithi149.stdout:9/326: chown d0/d18/d19/c4c 81690 1 2024-09-13T18:30:22.333 INFO:tasks.workunit.client.1.smithi149.stdout:3/466: mkdir d1/d2c/d56/d9f 0 2024-09-13T18:30:22.335 INFO:tasks.workunit.client.1.smithi149.stdout:9/327: rmdir d0/d47/d54 39 2024-09-13T18:30:22.337 INFO:tasks.workunit.client.1.smithi149.stdout:9/328: dread d0/d18/d19/f24 [8388608,4194304] 0 2024-09-13T18:30:22.337 INFO:tasks.workunit.client.1.smithi149.stdout:9/329: write d0/d18/d19/f51 [591351,73685] 0 2024-09-13T18:30:22.345 INFO:tasks.workunit.client.1.smithi149.stdout:6/539: sync 2024-09-13T18:30:22.345 INFO:tasks.workunit.client.1.smithi149.stdout:4/440: sync 2024-09-13T18:30:22.345 INFO:tasks.workunit.client.1.smithi149.stdout:0/360: sync 2024-09-13T18:30:22.345 INFO:tasks.workunit.client.1.smithi149.stdout:0/361: fdatasync d1/f1a 0 2024-09-13T18:30:22.345 INFO:tasks.workunit.client.1.smithi149.stdout:7/487: sync 2024-09-13T18:30:22.346 INFO:tasks.workunit.client.1.smithi149.stdout:2/425: dread db/d10/f25 [0,4194304] 0 2024-09-13T18:30:22.346 INFO:tasks.workunit.client.1.smithi149.stdout:1/451: dwrite d9/d10/d34/d53/d57/f75 [0,4194304] 0 2024-09-13T18:30:22.347 INFO:tasks.workunit.client.1.smithi149.stdout:1/452: read d9/d10/d3f/f7a [2057213,7418] 0 2024-09-13T18:30:22.347 INFO:tasks.workunit.client.1.smithi149.stdout:1/453: fdatasync d9/d15/d60/d80/d8b/f31 0 2024-09-13T18:30:22.347 INFO:tasks.workunit.client.1.smithi149.stdout:2/426: dread db/d1b/d1c/d20/d3a/f47 [0,4194304] 0 2024-09-13T18:30:22.347 INFO:tasks.workunit.client.1.smithi149.stdout:4/441: rename df/d79/f34 to df/d79/d12/d21/d22/d30/d41/d57/d75/f8b 0 2024-09-13T18:30:22.348 INFO:tasks.workunit.client.1.smithi149.stdout:6/540: symlink dc/d8c/lab 0 2024-09-13T18:30:22.354 INFO:tasks.workunit.client.1.smithi149.stdout:7/488: unlink d7/d9/d1c/d1f/d21/d49/l75 0 2024-09-13T18:30:22.354 INFO:tasks.workunit.client.1.smithi149.stdout:7/489: write f3 [4562211,22972] 0 2024-09-13T18:30:22.354 INFO:tasks.workunit.client.1.smithi149.stdout:7/490: fsync d7/d9/d1c/d1f/d21/f4b 0 2024-09-13T18:30:22.354 INFO:tasks.workunit.client.1.smithi149.stdout:1/454: mknod d9/d15/d25/c8e 0 2024-09-13T18:30:22.354 INFO:tasks.workunit.client.1.smithi149.stdout:2/427: mknod db/d1b/d2f/d30/c94 0 2024-09-13T18:30:22.355 INFO:tasks.workunit.client.1.smithi149.stdout:4/442: link df/d79/d12/c51 df/d79/d12/d21/c8c 0 2024-09-13T18:30:22.356 INFO:tasks.workunit.client.1.smithi149.stdout:4/443: getdents df/d79/d12/d17/d3d 0 2024-09-13T18:30:22.356 INFO:tasks.workunit.client.1.smithi149.stdout:3/467: dwrite d1/d2e/d1d/d49/f8a [0,4194304] 0 2024-09-13T18:30:22.357 INFO:tasks.workunit.client.1.smithi149.stdout:0/362: link d1/d2/c3 d1/d2/d41/c78 0 2024-09-13T18:30:22.357 INFO:tasks.workunit.client.1.smithi149.stdout:0/363: creat d1/d2/d5a/f79 x:0 0 0 2024-09-13T18:30:22.357 INFO:tasks.workunit.client.1.smithi149.stdout:0/364: creat d1/d29/f7a x:0 0 0 2024-09-13T18:30:22.357 INFO:tasks.workunit.client.1.smithi149.stdout:0/365: stat d1/d29/d31/d3e/d54 0 2024-09-13T18:30:22.357 INFO:tasks.workunit.client.1.smithi149.stdout:0/366: dread - d1/d1b/f72 zero size 2024-09-13T18:30:22.357 INFO:tasks.workunit.client.1.smithi149.stdout:8/417: dwrite d2/f34 [4194304,4194304] 0 2024-09-13T18:30:22.358 INFO:tasks.workunit.client.1.smithi149.stdout:0/367: dread d1/d29/d31/f35 [0,4194304] 0 2024-09-13T18:30:22.359 INFO:tasks.workunit.client.1.smithi149.stdout:1/455: unlink d9/d10/d3f/l86 0 2024-09-13T18:30:22.359 INFO:tasks.workunit.client.1.smithi149.stdout:1/456: creat d9/d10/d34/d3c/d50/f8f x:0 0 0 2024-09-13T18:30:22.364 INFO:tasks.workunit.client.1.smithi149.stdout:0/368: mkdir d1/d2/d41/d46/d7b 0 2024-09-13T18:30:22.368 INFO:tasks.workunit.client.1.smithi149.stdout:1/457: rmdir d9/d10/d34/d3c/d79 0 2024-09-13T18:30:22.368 INFO:tasks.workunit.client.1.smithi149.stdout:0/369: symlink d1/d2/d5a/l7c 0 2024-09-13T18:30:22.371 INFO:tasks.workunit.client.1.smithi149.stdout:4/444: write df/d79/d12/d21/f24 [1031250,54158] 0 2024-09-13T18:30:22.371 INFO:tasks.workunit.client.1.smithi149.stdout:9/330: dwrite d0/d18/d19/f24 [0,4194304] 0 2024-09-13T18:30:22.371 INFO:tasks.workunit.client.1.smithi149.stdout:9/331: creat d0/d2e/d42/f6d x:0 0 0 2024-09-13T18:30:22.371 INFO:tasks.workunit.client.1.smithi149.stdout:0/370: creat d1/d2/d41/f7d x:0 0 0 2024-09-13T18:30:22.375 INFO:tasks.workunit.client.1.smithi149.stdout:9/332: creat d0/d18/d27/f6e x:0 0 0 2024-09-13T18:30:22.377 INFO:tasks.workunit.client.1.smithi149.stdout:0/371: link d1/f21 d1/d29/d31/d3e/d3f/f7e 0 2024-09-13T18:30:22.377 INFO:tasks.workunit.client.1.smithi149.stdout:0/372: write d1/f5f [220454,2045] 0 2024-09-13T18:30:22.377 INFO:tasks.workunit.client.1.smithi149.stdout:0/373: creat d1/d2/d5a/d62/f7f x:0 0 0 2024-09-13T18:30:22.377 INFO:tasks.workunit.client.1.smithi149.stdout:0/374: chown d1/d2/d41/l4a 6393 1 2024-09-13T18:30:22.377 INFO:tasks.workunit.client.1.smithi149.stdout:4/445: symlink df/d79/l8d 0 2024-09-13T18:30:22.379 INFO:tasks.workunit.client.1.smithi149.stdout:0/375: rename d1/d2/d41/f7d to d1/d48/f80 0 2024-09-13T18:30:22.380 INFO:tasks.workunit.client.1.smithi149.stdout:4/446: creat df/d79/d12/d21/f8e x:0 0 0 2024-09-13T18:30:22.380 INFO:tasks.workunit.client.1.smithi149.stdout:1/458: dread d9/d15/d60/d80/d8b/f31 [0,4194304] 0 2024-09-13T18:30:22.381 INFO:tasks.workunit.client.1.smithi149.stdout:1/459: mkdir d9/d15/d40/d90 0 2024-09-13T18:30:22.389 INFO:tasks.workunit.client.1.smithi149.stdout:7/491: dwrite d7/d9/d11/f42 [0,4194304] 0 2024-09-13T18:30:22.389 INFO:tasks.workunit.client.1.smithi149.stdout:0/376: read d1/d29/d31/d44/d47/f59 [11404,516] 0 2024-09-13T18:30:22.389 INFO:tasks.workunit.client.1.smithi149.stdout:8/418: dwrite d2/d13/f41 [0,4194304] 0 2024-09-13T18:30:22.391 INFO:tasks.workunit.client.1.smithi149.stdout:7/492: creat d7/d9/d1c/d51/fa9 x:0 0 0 2024-09-13T18:30:22.392 INFO:tasks.workunit.client.1.smithi149.stdout:0/377: unlink d1/c51 0 2024-09-13T18:30:22.392 INFO:tasks.workunit.client.1.smithi149.stdout:1/460: dread d9/f3d [0,4194304] 0 2024-09-13T18:30:22.394 INFO:tasks.workunit.client.1.smithi149.stdout:8/419: creat d2/d5b/f8a x:0 0 0 2024-09-13T18:30:22.394 INFO:tasks.workunit.client.1.smithi149.stdout:8/420: write d2/d52/f84 [788754,106357] 0 2024-09-13T18:30:22.395 INFO:tasks.workunit.client.1.smithi149.stdout:7/493: mkdir d7/d9/d1c/d1f/d47/d53/daa 0 2024-09-13T18:30:22.395 INFO:tasks.workunit.client.1.smithi149.stdout:7/494: fdatasync d7/d9/fa 0 2024-09-13T18:30:22.398 INFO:tasks.workunit.client.1.smithi149.stdout:1/461: truncate f3 1488993 0 2024-09-13T18:30:22.398 INFO:tasks.workunit.client.1.smithi149.stdout:1/462: chown d9/d15/c21 14752176 1 2024-09-13T18:30:22.398 INFO:tasks.workunit.client.1.smithi149.stdout:1/463: chown d9/d15/d40/d4a/l78 16129864 1 2024-09-13T18:30:22.399 INFO:tasks.workunit.client.1.smithi149.stdout:4/447: dwrite df/d79/f61 [0,4194304] 0 2024-09-13T18:30:22.400 INFO:tasks.workunit.client.1.smithi149.stdout:1/464: creat d9/d15/d40/d4a/f91 x:0 0 0 2024-09-13T18:30:22.404 INFO:tasks.workunit.client.1.smithi149.stdout:4/448: creat df/d79/d12/d21/d22/d30/d41/d57/d75/f8f x:0 0 0 2024-09-13T18:30:22.406 INFO:tasks.workunit.client.1.smithi149.stdout:4/449: link fc df/f90 0 2024-09-13T18:30:22.406 INFO:tasks.workunit.client.1.smithi149.stdout:4/450: chown df/d79/d12/d17/l33 11297 1 2024-09-13T18:30:22.407 INFO:tasks.workunit.client.1.smithi149.stdout:4/451: mkdir df/d79/d12/d21/d22/d30/d56/d91 0 2024-09-13T18:30:22.408 INFO:tasks.workunit.client.1.smithi149.stdout:4/452: dread - df/d79/d1c/f67 zero size 2024-09-13T18:30:22.409 INFO:tasks.workunit.client.1.smithi149.stdout:4/453: truncate df/d79/d12/d17/d3d/f5d 6365752 0 2024-09-13T18:30:22.411 INFO:tasks.workunit.client.1.smithi149.stdout:0/378: rename d1/d2/d5a to d1/d29/d31/d44/d81 0 2024-09-13T18:30:22.412 INFO:tasks.workunit.client.1.smithi149.stdout:0/379: creat d1/d29/d31/d3e/d3f/f82 x:0 0 0 2024-09-13T18:30:22.416 INFO:tasks.workunit.client.1.smithi149.stdout:7/495: rename c6 to d7/d9/d11/cab 0 2024-09-13T18:30:22.416 INFO:tasks.workunit.client.1.smithi149.stdout:7/496: write d7/f8 [1806265,112310] 0 2024-09-13T18:30:22.417 INFO:tasks.workunit.client.1.smithi149.stdout:0/380: getdents d1/d29/d31 0 2024-09-13T18:30:22.420 INFO:tasks.workunit.client.1.smithi149.stdout:1/465: rename d9/d15/l74 to d9/d10/d34/d53/d57/d6c/l92 0 2024-09-13T18:30:22.420 INFO:tasks.workunit.client.1.smithi149.stdout:1/466: creat d9/d58/f93 x:0 0 0 2024-09-13T18:30:22.421 INFO:tasks.workunit.client.1.smithi149.stdout:7/497: link l2 d7/d9/d1c/d51/d52/d86/da3/lac 0 2024-09-13T18:30:22.422 INFO:tasks.workunit.client.1.smithi149.stdout:8/421: rmdir d2/d5b 39 2024-09-13T18:30:22.424 INFO:tasks.workunit.client.1.smithi149.stdout:0/381: mkdir d1/d29/d31/d83 0 2024-09-13T18:30:22.427 INFO:tasks.workunit.client.1.smithi149.stdout:4/454: rename df/d79/d12/d21/d22/d30/f88 to df/d79/d1c/f92 0 2024-09-13T18:30:22.427 INFO:tasks.workunit.client.1.smithi149.stdout:4/455: read df/d79/d12/d21/d22/d30/d41/f50 [153533,31237] 0 2024-09-13T18:30:22.427 INFO:tasks.workunit.client.1.smithi149.stdout:4/456: fsync df/d79/d12/d21/d22/d30/d56/f87 0 2024-09-13T18:30:22.427 INFO:tasks.workunit.client.1.smithi149.stdout:4/457: chown df/d79/d12/d21/d22/d30/d41/d57/d8a 89 1 2024-09-13T18:30:22.427 INFO:tasks.workunit.client.1.smithi149.stdout:4/458: write df/d79/d12/d21/f4a [1781521,40916] 0 2024-09-13T18:30:22.431 INFO:tasks.workunit.client.1.smithi149.stdout:8/422: rmdir d2/d5b 39 2024-09-13T18:30:22.432 INFO:tasks.workunit.client.1.smithi149.stdout:0/382: creat d1/d29/d31/d44/d47/f84 x:0 0 0 2024-09-13T18:30:22.435 INFO:tasks.workunit.client.1.smithi149.stdout:4/459: creat df/d79/d12/d21/d22/d30/d56/d91/f93 x:0 0 0 2024-09-13T18:30:22.438 INFO:tasks.workunit.client.1.smithi149.stdout:1/467: rmdir d9/d10/d3f 39 2024-09-13T18:30:22.439 INFO:tasks.workunit.client.1.smithi149.stdout:1/468: chown d9/d15/d60 3 1 2024-09-13T18:30:22.439 INFO:tasks.workunit.client.1.smithi149.stdout:1/469: write d9/d10/d34/d3c/d50/f8f [718390,129446] 0 2024-09-13T18:30:22.442 INFO:tasks.workunit.client.1.smithi149.stdout:0/383: creat d1/d29/d31/d44/d81/f85 x:0 0 0 2024-09-13T18:30:22.442 INFO:tasks.workunit.client.1.smithi149.stdout:0/384: getdents d1/d2/d4e 0 2024-09-13T18:30:22.444 INFO:tasks.workunit.client.1.smithi149.stdout:4/460: symlink df/d79/d12/d21/l94 0 2024-09-13T18:30:22.444 INFO:tasks.workunit.client.1.smithi149.stdout:4/461: dread - df/d79/d1c/d69/f76 zero size 2024-09-13T18:30:22.445 INFO:tasks.workunit.client.1.smithi149.stdout:7/498: dwrite d7/d9/d1c/d1f/d21/f4b [0,4194304] 0 2024-09-13T18:30:22.446 INFO:tasks.workunit.client.1.smithi149.stdout:8/423: link d2/d12/f5c d2/d13/f8b 0 2024-09-13T18:30:22.450 INFO:tasks.workunit.client.1.smithi149.stdout:1/470: dread d9/d10/d34/d53/d57/f65 [0,4194304] 0 2024-09-13T18:30:22.454 INFO:tasks.workunit.client.1.smithi149.stdout:4/462: truncate df/f90 746657 0 2024-09-13T18:30:22.454 INFO:tasks.workunit.client.1.smithi149.stdout:4/463: read df/d79/f78 [1590246,80472] 0 2024-09-13T18:30:22.454 INFO:tasks.workunit.client.1.smithi149.stdout:4/464: dread - df/d79/d12/d17/f49 zero size 2024-09-13T18:30:22.455 INFO:tasks.workunit.client.1.smithi149.stdout:1/471: unlink d9/d15/d25/l3e 0 2024-09-13T18:30:22.456 INFO:tasks.workunit.client.1.smithi149.stdout:4/465: creat df/d79/f95 x:0 0 0 2024-09-13T18:30:22.469 INFO:tasks.workunit.client.1.smithi149.stdout:7/499: dwrite d7/d9/f46 [0,4194304] 0 2024-09-13T18:30:22.469 INFO:tasks.workunit.client.1.smithi149.stdout:7/500: fsync d7/fd 0 2024-09-13T18:30:22.470 INFO:tasks.workunit.client.1.smithi149.stdout:7/501: rmdir d7/d9/d1c/d1f/d3d 39 2024-09-13T18:30:22.471 INFO:tasks.workunit.client.1.smithi149.stdout:5/401: sync 2024-09-13T18:30:22.472 INFO:tasks.workunit.client.1.smithi149.stdout:7/502: creat d7/d9/d1c/d2f/fad x:0 0 0 2024-09-13T18:30:22.473 INFO:tasks.workunit.client.1.smithi149.stdout:5/402: mknod d3/d10/d4c/d4e/d61/d63/c79 0 2024-09-13T18:30:22.474 INFO:tasks.workunit.client.1.smithi149.stdout:7/503: dread d7/d9/d1c/d1f/d21/f83 [0,4194304] 0 2024-09-13T18:30:22.475 INFO:tasks.workunit.client.1.smithi149.stdout:7/504: mkdir d7/d9/d1c/d2f/da4/dae 0 2024-09-13T18:30:22.476 INFO:tasks.workunit.client.1.smithi149.stdout:8/424: dwrite d2/d12/d1b/f3c [0,4194304] 0 2024-09-13T18:30:22.480 INFO:tasks.workunit.client.1.smithi149.stdout:1/472: dwrite d9/d10/d3f/f67 [0,4194304] 0 2024-09-13T18:30:22.483 INFO:tasks.workunit.client.1.smithi149.stdout:4/466: dwrite df/d79/d12/f3c [0,4194304] 0 2024-09-13T18:30:22.483 INFO:tasks.workunit.client.1.smithi149.stdout:4/467: creat df/d79/d12/d21/d22/f96 x:0 0 0 2024-09-13T18:30:22.487 INFO:tasks.workunit.client.1.smithi149.stdout:4/468: creat df/d79/d12/d17/d3d/f97 x:0 0 0 2024-09-13T18:30:22.489 INFO:tasks.workunit.client.1.smithi149.stdout:4/469: symlink df/d79/d12/l98 0 2024-09-13T18:30:22.492 INFO:tasks.workunit.client.1.smithi149.stdout:8/425: dread d2/d13/f7b [0,4194304] 0 2024-09-13T18:30:22.492 INFO:tasks.workunit.client.1.smithi149.stdout:8/426: dread - d2/d12/d2a/d4d/f6b zero size 2024-09-13T18:30:22.494 INFO:tasks.workunit.client.1.smithi149.stdout:1/473: read d9/d10/d3f/f67 [2624867,127667] 0 2024-09-13T18:30:22.499 INFO:tasks.workunit.client.1.smithi149.stdout:4/470: dread df/d79/d12/d17/d3d/f5d [4194304,4194304] 0 2024-09-13T18:30:22.509 INFO:tasks.workunit.client.1.smithi149.stdout:5/403: dwrite d3/d10/d4c/f71 [0,4194304] 0 2024-09-13T18:30:22.509 INFO:tasks.workunit.client.1.smithi149.stdout:1/474: dread d9/d10/d37/f5a [0,4194304] 0 2024-09-13T18:30:22.511 INFO:tasks.workunit.client.1.smithi149.stdout:5/404: rename d3/d8/d13/d58 to d3/d10/d32/d54/d76/d7a 0 2024-09-13T18:30:22.511 INFO:tasks.workunit.client.1.smithi149.stdout:4/471: read df/d79/d12/d17/d3d/f73 [2949355,18544] 0 2024-09-13T18:30:22.511 INFO:tasks.workunit.client.1.smithi149.stdout:4/472: truncate df/d79/d12/d21/d22/f96 1009027 0 2024-09-13T18:30:22.511 INFO:tasks.workunit.client.1.smithi149.stdout:4/473: read df/d79/f78 [695797,53526] 0 2024-09-13T18:30:22.512 INFO:tasks.workunit.client.1.smithi149.stdout:4/474: chown df/d79/d12/d21/d22/d30/d41 319906959 1 2024-09-13T18:30:22.512 INFO:tasks.workunit.client.1.smithi149.stdout:1/475: symlink d9/d10/d37/d38/l94 0 2024-09-13T18:30:22.513 INFO:tasks.workunit.client.1.smithi149.stdout:5/405: unlink d3/d10/d32/d54/c2f 0 2024-09-13T18:30:22.515 INFO:tasks.workunit.client.1.smithi149.stdout:4/475: rename df/d79/d12/d17/d3d/f97 to df/d79/d12/d21/d22/d30/d41/f99 0 2024-09-13T18:30:22.517 INFO:tasks.workunit.client.1.smithi149.stdout:7/505: dwrite d7/d9/d1c/d2f/d31/f3f [0,4194304] 0 2024-09-13T18:30:22.518 INFO:tasks.workunit.client.1.smithi149.stdout:5/406: truncate d3/fd 2463048 0 2024-09-13T18:30:22.518 INFO:tasks.workunit.client.1.smithi149.stdout:8/427: dwrite d2/d13/f7b [0,4194304] 0 2024-09-13T18:30:22.520 INFO:tasks.workunit.client.1.smithi149.stdout:7/506: write d7/f4c [3053032,72937] 0 2024-09-13T18:30:22.521 INFO:tasks.workunit.client.1.smithi149.stdout:4/476: mkdir df/d79/d12/d7c/d9a 0 2024-09-13T18:30:22.522 INFO:tasks.workunit.client.1.smithi149.stdout:1/476: write d9/d10/d43/f88 [2021497,69823] 0 2024-09-13T18:30:22.523 INFO:tasks.workunit.client.1.smithi149.stdout:8/428: link d2/l10 d2/d5b/d88/l8c 0 2024-09-13T18:30:22.523 INFO:tasks.workunit.client.1.smithi149.stdout:8/429: read - d2/d52/f74 zero size 2024-09-13T18:30:22.525 INFO:tasks.workunit.client.1.smithi149.stdout:7/507: write d7/d9/d11/f1a [727848,52085] 0 2024-09-13T18:30:22.525 INFO:tasks.workunit.client.1.smithi149.stdout:7/508: fsync d7/d9/d1c/d2f/d6f/f45 0 2024-09-13T18:30:22.525 INFO:tasks.workunit.client.1.smithi149.stdout:7/509: dread - d7/f6b zero size 2024-09-13T18:30:22.525 INFO:tasks.workunit.client.1.smithi149.stdout:7/510: truncate f5 4360139 0 2024-09-13T18:30:22.525 INFO:tasks.workunit.client.1.smithi149.stdout:7/511: dread - d7/d9/d1c/d51/fa9 zero size 2024-09-13T18:30:22.525 INFO:tasks.workunit.client.1.smithi149.stdout:7/512: truncate d7/d9/d1c/d1f/d21/d7b/d96/d9e/fa2 869183 0 2024-09-13T18:30:22.527 INFO:tasks.workunit.client.1.smithi149.stdout:1/477: rename d9/d15/d60/d80/d8b/c2e to d9/d15/d73/c95 0 2024-09-13T18:30:22.530 INFO:tasks.workunit.client.1.smithi149.stdout:8/430: mkdir d2/d13/d3a/d7f/d8d 0 2024-09-13T18:30:22.532 INFO:tasks.workunit.client.1.smithi149.stdout:4/477: read df/d79/d12/f3c [2587579,30648] 0 2024-09-13T18:30:22.532 INFO:tasks.workunit.client.1.smithi149.stdout:4/478: truncate df/d79/d12/d21/d22/f5e 4199978 0 2024-09-13T18:30:22.532 INFO:tasks.workunit.client.1.smithi149.stdout:4/479: readlink df/d79/l66 0 2024-09-13T18:30:22.532 INFO:tasks.workunit.client.1.smithi149.stdout:7/513: mkdir d7/d9/d1c/d51/daf 0 2024-09-13T18:30:22.532 INFO:tasks.workunit.client.1.smithi149.stdout:7/514: fsync d7/d9/d1c/d1f/f25 0 2024-09-13T18:30:22.533 INFO:tasks.workunit.client.1.smithi149.stdout:5/407: dwrite d3/d10/d4c/f69 [0,4194304] 0 2024-09-13T18:30:22.533 INFO:tasks.workunit.client.1.smithi149.stdout:5/408: readlink d3/d10/l24 0 2024-09-13T18:30:22.533 INFO:tasks.workunit.client.1.smithi149.stdout:5/409: readlink d3/d8/lb 0 2024-09-13T18:30:22.533 INFO:tasks.workunit.client.1.smithi149.stdout:5/410: dread - d3/f5c zero size 2024-09-13T18:30:22.533 INFO:tasks.workunit.client.1.smithi149.stdout:5/411: write d3/f41 [647088,88583] 0 2024-09-13T18:30:22.535 INFO:tasks.workunit.client.1.smithi149.stdout:1/478: symlink d9/d15/l96 0 2024-09-13T18:30:22.535 INFO:tasks.workunit.client.1.smithi149.stdout:8/431: dread d2/d13/f7d [0,4194304] 0 2024-09-13T18:30:22.536 INFO:tasks.workunit.client.1.smithi149.stdout:4/480: mknod df/d79/d1c/d7e/c9b 0 2024-09-13T18:30:22.540 INFO:tasks.workunit.client.1.smithi149.stdout:7/515: dread d7/d12/f17 [0,4194304] 0 2024-09-13T18:30:22.540 INFO:tasks.workunit.client.1.smithi149.stdout:7/516: creat d7/d9/d11/d50/fb0 x:0 0 0 2024-09-13T18:30:22.559 INFO:tasks.workunit.client.1.smithi149.stdout:4/481: mknod df/d79/d12/d17/d3d/c9c 0 2024-09-13T18:30:22.563 INFO:tasks.workunit.client.1.smithi149.stdout:7/517: dwrite d7/d9/d1c/d1f/d21/f83 [0,4194304] 0 2024-09-13T18:30:22.563 INFO:tasks.workunit.client.1.smithi149.stdout:5/412: dwrite d3/d8/d13/f52 [0,4194304] 0 2024-09-13T18:30:22.565 INFO:tasks.workunit.client.1.smithi149.stdout:4/482: rmdir df/d79/d12/d21/d22/d72 39 2024-09-13T18:30:22.569 INFO:tasks.workunit.client.1.smithi149.stdout:7/518: link d7/d9/d1c/l4a d7/d9/d1c/d1f/d47/lb1 0 2024-09-13T18:30:22.574 INFO:tasks.workunit.client.1.smithi149.stdout:5/413: creat d3/d10/d4c/d4e/d61/d75/f7b x:0 0 0 2024-09-13T18:30:22.574 INFO:tasks.workunit.client.1.smithi149.stdout:5/414: write d3/f4f [2095393,51101] 0 2024-09-13T18:30:22.576 INFO:tasks.workunit.client.1.smithi149.stdout:1/479: rename d9/d15/d40/d4a to d9/d10/d83/d97 0 2024-09-13T18:30:22.576 INFO:tasks.workunit.client.1.smithi149.stdout:5/415: dread d3/d10/d32/f40 [0,4194304] 0 2024-09-13T18:30:22.576 INFO:tasks.workunit.client.1.smithi149.stdout:1/480: chown d9/d15/d25/c8e 3290 1 2024-09-13T18:30:22.577 INFO:tasks.workunit.client.1.smithi149.stdout:1/481: creat d9/d10/d34/d53/d57/f98 x:0 0 0 2024-09-13T18:30:22.577 INFO:tasks.workunit.client.1.smithi149.stdout:1/482: creat d9/d10/d62/f99 x:0 0 0 2024-09-13T18:30:22.581 INFO:tasks.workunit.client.1.smithi149.stdout:5/416: rename d3/d8/d13/f5b to d3/d10/d32/d54/f7c 0 2024-09-13T18:30:22.581 INFO:tasks.workunit.client.1.smithi149.stdout:5/417: chown d3/d10/f23 44 1 2024-09-13T18:30:22.583 INFO:tasks.workunit.client.1.smithi149.stdout:7/519: dwrite d7/d9/d11/d50/fb0 [0,4194304] 0 2024-09-13T18:30:22.585 INFO:tasks.workunit.client.1.smithi149.stdout:1/483: creat d9/d10/d83/d97/f9a x:0 0 0 2024-09-13T18:30:22.585 INFO:tasks.workunit.client.1.smithi149.stdout:1/484: write d9/d10/d34/d53/f82 [297112,29176] 0 2024-09-13T18:30:22.585 INFO:tasks.workunit.client.1.smithi149.stdout:1/485: fdatasync d9/d10/d34/d53/f72 0 2024-09-13T18:30:22.586 INFO:tasks.workunit.client.1.smithi149.stdout:4/483: getdents df/d79/d12/d21/d22/d30/d56/d91 0 2024-09-13T18:30:22.588 INFO:tasks.workunit.client.1.smithi149.stdout:5/418: link d3/fd d3/d10/f7d 0 2024-09-13T18:30:22.588 INFO:tasks.workunit.client.1.smithi149.stdout:5/419: write d3/d10/d4c/d4e/d61/d75/f7b [567244,909] 0 2024-09-13T18:30:22.593 INFO:tasks.workunit.client.1.smithi149.stdout:7/520: truncate d7/d9/fa 1458368 0 2024-09-13T18:30:22.595 INFO:tasks.workunit.client.1.smithi149.stdout:4/484: rename df/d79/d12/d21/d22/d30/c53 to df/d79/d12/d21/d22/d30/d41/d57/d8a/c9d 0 2024-09-13T18:30:22.595 INFO:tasks.workunit.client.1.smithi149.stdout:4/485: fsync df/f2b 0 2024-09-13T18:30:22.597 INFO:tasks.workunit.client.1.smithi149.stdout:5/420: creat d3/d10/d32/f7e x:0 0 0 2024-09-13T18:30:22.598 INFO:tasks.workunit.client.1.smithi149.stdout:7/521: mknod d7/d9/d1c/d2f/d6f/cb2 0 2024-09-13T18:30:22.601 INFO:tasks.workunit.client.1.smithi149.stdout:4/486: rename df/d79/d12/d21/d22/d30/d56/l63 to df/l9e 0 2024-09-13T18:30:22.601 INFO:tasks.workunit.client.1.smithi149.stdout:4/487: chown df/d79/d12/d21/d22/f5e 507200 1 2024-09-13T18:30:22.604 INFO:tasks.workunit.client.1.smithi149.stdout:7/522: getdents d7/d9/d1c/d51/d52/d86 0 2024-09-13T18:30:22.604 INFO:tasks.workunit.client.1.smithi149.stdout:7/523: truncate d7/d9/d1c/d51/d52/fa0 246591 0 2024-09-13T18:30:22.605 INFO:tasks.workunit.client.1.smithi149.stdout:1/486: dwrite d9/d10/d37/d38/f4e [0,4194304] 0 2024-09-13T18:30:22.605 INFO:tasks.workunit.client.1.smithi149.stdout:1/487: fdatasync d9/d10/d34/d53/f7d 0 2024-09-13T18:30:22.607 INFO:tasks.workunit.client.1.smithi149.stdout:4/488: mkdir df/d79/d1c/d7e/d9f 0 2024-09-13T18:30:22.611 INFO:tasks.workunit.client.1.smithi149.stdout:6/541: sync 2024-09-13T18:30:22.611 INFO:tasks.workunit.client.1.smithi149.stdout:3/468: sync 2024-09-13T18:30:22.611 INFO:tasks.workunit.client.1.smithi149.stdout:2/428: sync 2024-09-13T18:30:22.611 INFO:tasks.workunit.client.1.smithi149.stdout:0/385: sync 2024-09-13T18:30:22.611 INFO:tasks.workunit.client.1.smithi149.stdout:9/333: sync 2024-09-13T18:30:22.611 INFO:tasks.workunit.client.1.smithi149.stdout:3/469: stat d1/d2e/d1d/f23 0 2024-09-13T18:30:22.621 INFO:tasks.workunit.client.1.smithi149.stdout:9/334: stat d0/d47/d54/c64 0 2024-09-13T18:30:22.623 INFO:tasks.workunit.client.1.smithi149.stdout:0/386: fdatasync d1/d29/d31/f35 0 2024-09-13T18:30:22.625 INFO:tasks.workunit.client.1.smithi149.stdout:2/429: mkdir db/d1b/d1c/d20/d2b/d3e/d95 0 2024-09-13T18:30:22.627 INFO:tasks.workunit.client.1.smithi149.stdout:6/542: mkdir dc/d15/d23/d5f/dac 0 2024-09-13T18:30:22.628 INFO:tasks.workunit.client.1.smithi149.stdout:1/488: dwrite f2 [0,4194304] 0 2024-09-13T18:30:22.628 INFO:tasks.workunit.client.1.smithi149.stdout:7/524: dwrite d7/d9/d1c/d2c/f9a [0,4194304] 0 2024-09-13T18:30:22.629 INFO:tasks.workunit.client.1.smithi149.stdout:3/470: mknod d1/d47/d97/d9b/ca0 0 2024-09-13T18:30:22.631 INFO:tasks.workunit.client.1.smithi149.stdout:9/335: dread d0/f9 [0,4194304] 0 2024-09-13T18:30:22.631 INFO:tasks.workunit.client.1.smithi149.stdout:9/336: dread - d0/f4e zero size 2024-09-13T18:30:22.631 INFO:tasks.workunit.client.1.smithi149.stdout:9/337: chown d0/l6c 146 1 2024-09-13T18:30:22.631 INFO:tasks.workunit.client.1.smithi149.stdout:9/338: chown d0/d18/d19/l1c 1814 1 2024-09-13T18:30:22.631 INFO:tasks.workunit.client.1.smithi149.stdout:2/430: dread db/d1b/f42 [0,4194304] 0 2024-09-13T18:30:22.631 INFO:tasks.workunit.client.1.smithi149.stdout:2/431: write db/d1b/d1c/d20/f50 [3931894,84866] 0 2024-09-13T18:30:22.631 INFO:tasks.workunit.client.1.smithi149.stdout:2/432: dread - db/d10/f55 zero size 2024-09-13T18:30:22.631 INFO:tasks.workunit.client.1.smithi149.stdout:2/433: creat db/f96 x:0 0 0 2024-09-13T18:30:22.631 INFO:tasks.workunit.client.1.smithi149.stdout:2/434: write db/d10/f72 [631406,96436] 0 2024-09-13T18:30:22.631 INFO:tasks.workunit.client.1.smithi149.stdout:2/435: creat db/f97 x:0 0 0 2024-09-13T18:30:22.632 INFO:tasks.workunit.client.1.smithi149.stdout:2/436: readlink db/d1b/d1c/l44 0 2024-09-13T18:30:22.632 INFO:tasks.workunit.client.1.smithi149.stdout:6/543: dread dc/d2f/d75/f8e [0,4194304] 0 2024-09-13T18:30:22.634 INFO:tasks.workunit.client.1.smithi149.stdout:0/387: write d1/d2/d41/d46/f69 [2450220,36493] 0 2024-09-13T18:30:22.645 INFO:tasks.workunit.client.1.smithi149.stdout:1/489: rename d9/d10/d34/d53/d57/f68 to d9/d15/d60/d80/d8b/f9b 0 2024-09-13T18:30:22.645 INFO:tasks.workunit.client.1.smithi149.stdout:6/544: dwrite dc/d70/f97 [0,4194304] 0 2024-09-13T18:30:22.647 INFO:tasks.workunit.client.1.smithi149.stdout:5/421: getdents d3/d10 0 2024-09-13T18:30:22.647 INFO:tasks.workunit.client.1.smithi149.stdout:5/422: truncate d3/d10/f64 4314778 0 2024-09-13T18:30:22.647 INFO:tasks.workunit.client.1.smithi149.stdout:1/490: dread d9/d10/f1a [0,4194304] 0 2024-09-13T18:30:22.649 INFO:tasks.workunit.client.1.smithi149.stdout:3/471: unlink d1/d21/f63 0 2024-09-13T18:30:22.649 INFO:tasks.workunit.client.1.smithi149.stdout:3/472: chown d1/d2c/d38 56809126 1 2024-09-13T18:30:22.649 INFO:tasks.workunit.client.1.smithi149.stdout:3/473: write d1/d2e/f14 [2005406,42112] 0 2024-09-13T18:30:22.650 INFO:tasks.workunit.client.1.smithi149.stdout:9/339: mknod d0/d2e/d42/d59/c6f 0 2024-09-13T18:30:22.653 INFO:tasks.workunit.client.1.smithi149.stdout:9/340: dread d0/d47/d54/f55 [0,4194304] 0 2024-09-13T18:30:22.653 INFO:tasks.workunit.client.1.smithi149.stdout:9/341: stat d0/f3c 0 2024-09-13T18:30:22.658 INFO:tasks.workunit.client.1.smithi149.stdout:2/437: link db/fd db/d1b/f98 0 2024-09-13T18:30:22.666 INFO:tasks.workunit.client.1.smithi149.stdout:2/438: dread db/d1b/d1c/d20/d3a/f2e [0,4194304] 0 2024-09-13T18:30:22.668 INFO:tasks.workunit.client.1.smithi149.stdout:5/423: link d3/d8/l5a d3/d10/d4c/l7f 0 2024-09-13T18:30:22.668 INFO:tasks.workunit.client.1.smithi149.stdout:5/424: fdatasync d3/f5c 0 2024-09-13T18:30:22.668 INFO:tasks.workunit.client.1.smithi149.stdout:8/432: sync 2024-09-13T18:30:22.669 INFO:tasks.workunit.client.1.smithi149.stdout:3/474: symlink d1/d2e/d1d/d9a/la1 0 2024-09-13T18:30:22.670 INFO:tasks.workunit.client.1.smithi149.stdout:9/342: mkdir d0/d2e/d42/d70 0 2024-09-13T18:30:22.670 INFO:tasks.workunit.client.1.smithi149.stdout:9/343: write d0/d18/d19/d3b/f3d [2630890,127084] 0 2024-09-13T18:30:22.672 INFO:tasks.workunit.client.1.smithi149.stdout:0/388: symlink d1/d29/d31/l86 0 2024-09-13T18:30:22.674 INFO:tasks.workunit.client.1.smithi149.stdout:4/489: rename df/d79 to df/da0 0 2024-09-13T18:30:22.676 INFO:tasks.workunit.client.1.smithi149.stdout:8/433: write d2/fc [1630354,102866] 0 2024-09-13T18:30:22.678 INFO:tasks.workunit.client.1.smithi149.stdout:2/439: symlink db/d1b/d1c/l99 0 2024-09-13T18:30:22.678 INFO:tasks.workunit.client.1.smithi149.stdout:2/440: chown db/d1b/c41 5 1 2024-09-13T18:30:22.682 INFO:tasks.workunit.client.1.smithi149.stdout:6/545: getdents dc/d15/d54/d5e/d79 0 2024-09-13T18:30:22.683 INFO:tasks.workunit.client.1.smithi149.stdout:6/546: write dc/f53 [1788982,95503] 0 2024-09-13T18:30:22.684 INFO:tasks.workunit.client.1.smithi149.stdout:9/344: write d0/d47/f65 [1075670,8541] 0 2024-09-13T18:30:22.684 INFO:tasks.workunit.client.1.smithi149.stdout:9/345: creat d0/d2e/f71 x:0 0 0 2024-09-13T18:30:22.685 INFO:tasks.workunit.client.1.smithi149.stdout:3/475: write d1/d2e/d1d/f51 [1450873,81721] 0 2024-09-13T18:30:22.691 INFO:tasks.workunit.client.1.smithi149.stdout:4/490: mkdir df/da0/d12/d21/d22/d30/d41/d57/d75/da1 0 2024-09-13T18:30:22.691 INFO:tasks.workunit.client.1.smithi149.stdout:7/525: rename d7/d9/d1c/d2f to d7/d76/db3 0 2024-09-13T18:30:22.695 INFO:tasks.workunit.client.1.smithi149.stdout:5/425: getdents d3/d10/d32/d54 0 2024-09-13T18:30:22.695 INFO:tasks.workunit.client.1.smithi149.stdout:5/426: write d3/d10/d4c/d4e/f62 [300901,94641] 0 2024-09-13T18:30:22.703 INFO:tasks.workunit.client.1.smithi149.stdout:1/491: rename d9/d10/d43/f88 to d9/d10/d37/d38/f9c 0 2024-09-13T18:30:22.703 INFO:tasks.workunit.client.1.smithi149.stdout:7/526: dread d7/d9/d1c/d1f/d3d/fa7 [0,4194304] 0 2024-09-13T18:30:22.704 INFO:tasks.workunit.client.1.smithi149.stdout:5/427: creat d3/d10/f80 x:0 0 0 2024-09-13T18:30:22.704 INFO:tasks.workunit.client.1.smithi149.stdout:5/428: creat d3/d10/d4c/f81 x:0 0 0 2024-09-13T18:30:22.706 INFO:tasks.workunit.client.1.smithi149.stdout:3/476: dread d1/f19 [0,4194304] 0 2024-09-13T18:30:22.714 INFO:tasks.workunit.client.1.smithi149.stdout:4/491: rename df/da0/d12/d21/d22/d30/d41/d57/d75/f8b to df/da0/d12/d21/d22/d30/d41/d57/d8a/fa2 0 2024-09-13T18:30:22.714 INFO:tasks.workunit.client.1.smithi149.stdout:4/492: fdatasync df/da0/d12/d21/d22/d30/f37 0 2024-09-13T18:30:22.715 INFO:tasks.workunit.client.1.smithi149.stdout:7/527: symlink d7/d9/d1c/d51/d52/lb4 0 2024-09-13T18:30:22.718 INFO:tasks.workunit.client.1.smithi149.stdout:5/429: creat d3/d5e/f82 x:0 0 0 2024-09-13T18:30:22.719 INFO:tasks.workunit.client.1.smithi149.stdout:6/547: dwrite dc/d15/d23/d5b/f7f [0,4194304] 0 2024-09-13T18:30:22.719 INFO:tasks.workunit.client.1.smithi149.stdout:6/548: write dc/d15/f36 [913247,76727] 0 2024-09-13T18:30:22.719 INFO:tasks.workunit.client.1.smithi149.stdout:3/477: dread d1/d2e/d1d/d6c/f8c [0,4194304] 0 2024-09-13T18:30:22.719 INFO:tasks.workunit.client.1.smithi149.stdout:1/492: rename d9/f45 to d9/d15/d60/d80/f9d 0 2024-09-13T18:30:22.720 INFO:tasks.workunit.client.1.smithi149.stdout:4/493: mkdir df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3 0 2024-09-13T18:30:22.721 INFO:tasks.workunit.client.1.smithi149.stdout:7/528: truncate d7/d9/d1c/d34/f55 1322873 0 2024-09-13T18:30:22.722 INFO:tasks.workunit.client.1.smithi149.stdout:5/430: mkdir d3/d10/d32/d67/d83 0 2024-09-13T18:30:22.723 INFO:tasks.workunit.client.1.smithi149.stdout:0/389: dwrite d1/d29/d31/d44/d81/d62/f7f [0,4194304] 0 2024-09-13T18:30:22.727 INFO:tasks.workunit.client.1.smithi149.stdout:6/549: link dc/l17 dc/d15/d54/lad 0 2024-09-13T18:30:22.732 INFO:tasks.workunit.client.1.smithi149.stdout:6/550: mknod dc/d15/d23/d5b/d91/cae 0 2024-09-13T18:30:22.732 INFO:tasks.workunit.client.1.smithi149.stdout:6/551: chown dc/c38 1736154003 1 2024-09-13T18:30:22.734 INFO:tasks.workunit.client.1.smithi149.stdout:6/552: getdents dc/d15/d23 0 2024-09-13T18:30:22.739 INFO:tasks.workunit.client.1.smithi149.stdout:5/431: dread d3/d8/d13/f22 [0,4194304] 0 2024-09-13T18:30:22.741 INFO:tasks.workunit.client.1.smithi149.stdout:3/478: write d1/d12/d20/d54/f6a [20798,48210] 0 2024-09-13T18:30:22.741 INFO:tasks.workunit.client.1.smithi149.stdout:9/346: dwrite d0/d2e/d42/f63 [0,4194304] 0 2024-09-13T18:30:22.752 INFO:tasks.workunit.client.1.smithi149.stdout:8/434: truncate d2/fc 2898483 0 2024-09-13T18:30:22.755 INFO:tasks.workunit.client.1.smithi149.stdout:8/435: symlink d2/d52/l8e 0 2024-09-13T18:30:22.755 INFO:tasks.workunit.client.1.smithi149.stdout:8/436: chown d2/f15 492 1 2024-09-13T18:30:22.757 INFO:tasks.workunit.client.1.smithi149.stdout:9/347: write d0/d2e/d42/f5e [762219,88803] 0 2024-09-13T18:30:22.757 INFO:tasks.workunit.client.1.smithi149.stdout:9/348: fdatasync d0/d18/d27/f66 0 2024-09-13T18:30:22.757 INFO:tasks.workunit.client.1.smithi149.stdout:4/494: dwrite df/da0/d12/d21/d22/d30/d56/f87 [0,4194304] 0 2024-09-13T18:30:22.762 INFO:tasks.workunit.client.1.smithi149.stdout:8/437: chown d2/d13/d6d/l6a 263816 1 2024-09-13T18:30:22.762 INFO:tasks.workunit.client.1.smithi149.stdout:1/493: dwrite d9/d10/d34/d53/d57/f64 [0,4194304] 0 2024-09-13T18:30:22.762 INFO:tasks.workunit.client.1.smithi149.stdout:1/494: write d9/d15/d60/d80/d8b/f31 [3397964,94759] 0 2024-09-13T18:30:22.762 INFO:tasks.workunit.client.1.smithi149.stdout:1/495: chown d9/d15/d60/d80 48 1 2024-09-13T18:30:22.762 INFO:tasks.workunit.client.1.smithi149.stdout:1/496: fsync d9/d10/f27 0 2024-09-13T18:30:22.762 INFO:tasks.workunit.client.1.smithi149.stdout:1/497: fsync d9/d10/f27 0 2024-09-13T18:30:22.763 INFO:tasks.workunit.client.1.smithi149.stdout:1/498: write d9/d58/f93 [904722,59114] 0 2024-09-13T18:30:22.764 INFO:tasks.workunit.client.1.smithi149.stdout:9/349: rename d0/d18/d27/f3e to d0/f72 0 2024-09-13T18:30:22.765 INFO:tasks.workunit.client.1.smithi149.stdout:9/350: creat d0/d2e/d42/f73 x:0 0 0 2024-09-13T18:30:22.766 INFO:tasks.workunit.client.1.smithi149.stdout:5/432: dwrite d3/d10/d4c/d4e/d61/d75/f7b [0,4194304] 0 2024-09-13T18:30:22.770 INFO:tasks.workunit.client.1.smithi149.stdout:7/529: rmdir d7/d9/d1c/d51 39 2024-09-13T18:30:22.770 INFO:tasks.workunit.client.1.smithi149.stdout:9/351: fsync d0/d2e/d42/f5e 0 2024-09-13T18:30:22.772 INFO:tasks.workunit.client.1.smithi149.stdout:9/352: write d0/f72 [595929,48697] 0 2024-09-13T18:30:22.774 INFO:tasks.workunit.client.1.smithi149.stdout:4/495: rename df/da0/d70/c7d to df/da0/d1c/d69/ca4 0 2024-09-13T18:30:22.775 INFO:tasks.workunit.client.1.smithi149.stdout:1/499: dwrite d9/f3d [0,4194304] 0 2024-09-13T18:30:22.775 INFO:tasks.workunit.client.1.smithi149.stdout:1/500: write d9/d15/d60/d80/d8b/f9b [920019,82263] 0 2024-09-13T18:30:22.775 INFO:tasks.workunit.client.1.smithi149.stdout:1/501: write d9/d15/d60/d80/f9d [115485,126281] 0 2024-09-13T18:30:22.775 INFO:tasks.workunit.client.1.smithi149.stdout:1/502: creat d9/d10/d34/d53/f9e x:0 0 0 2024-09-13T18:30:22.777 INFO:tasks.workunit.client.1.smithi149.stdout:8/438: getdents d2/d13 0 2024-09-13T18:30:22.782 INFO:tasks.workunit.client.1.smithi149.stdout:5/433: truncate d3/f4f 3078847 0 2024-09-13T18:30:22.782 INFO:tasks.workunit.client.1.smithi149.stdout:5/434: chown d3/d8/f27 1023 1 2024-09-13T18:30:22.783 INFO:tasks.workunit.client.1.smithi149.stdout:7/530: creat d7/d9/d1c/d51/d52/d86/fb5 x:0 0 0 2024-09-13T18:30:22.785 INFO:tasks.workunit.client.1.smithi149.stdout:4/496: creat df/da0/d12/d21/d22/d30/d41/d57/d75/fa5 x:0 0 0 2024-09-13T18:30:22.785 INFO:tasks.workunit.client.1.smithi149.stdout:4/497: write df/da0/d12/f85 [889622,3698] 0 2024-09-13T18:30:22.785 INFO:tasks.workunit.client.1.smithi149.stdout:4/498: chown df/da0/d12/d21/d22/d30/f37 285617 1 2024-09-13T18:30:22.788 INFO:tasks.workunit.client.1.smithi149.stdout:9/353: dwrite d0/d47/d61/f6b [0,4194304] 0 2024-09-13T18:30:22.789 INFO:tasks.workunit.client.1.smithi149.stdout:1/503: creat d9/d15/d60/d80/d8b/f9f x:0 0 0 2024-09-13T18:30:22.791 INFO:tasks.workunit.client.1.smithi149.stdout:8/439: link d2/d12/d40/f7a d2/d12/d1b/f8f 0 2024-09-13T18:30:22.791 INFO:tasks.workunit.client.1.smithi149.stdout:8/440: truncate d2/d52/f84 1861416 0 2024-09-13T18:30:22.792 INFO:tasks.workunit.client.1.smithi149.stdout:7/531: write d7/d9/d1c/d1f/d3d/fa7 [375589,85714] 0 2024-09-13T18:30:22.793 INFO:tasks.workunit.client.1.smithi149.stdout:5/435: creat d3/d10/d32/d54/f84 x:0 0 0 2024-09-13T18:30:22.799 INFO:tasks.workunit.client.1.smithi149.stdout:7/532: dread d7/d9/fa [0,4194304] 0 2024-09-13T18:30:22.799 INFO:tasks.workunit.client.1.smithi149.stdout:1/504: mknod d9/d15/d25/ca0 0 2024-09-13T18:30:22.799 INFO:tasks.workunit.client.1.smithi149.stdout:1/505: creat d9/d10/d34/d53/d57/fa1 x:0 0 0 2024-09-13T18:30:22.800 INFO:tasks.workunit.client.1.smithi149.stdout:1/506: stat d9/d15/d60/d80/d8b/d42/l6d 0 2024-09-13T18:30:22.803 INFO:tasks.workunit.client.1.smithi149.stdout:8/441: mknod d2/d13/d3a/d7f/d8d/c90 0 2024-09-13T18:30:22.803 INFO:tasks.workunit.client.1.smithi149.stdout:8/442: creat d2/d12/d6e/f91 x:0 0 0 2024-09-13T18:30:22.805 INFO:tasks.workunit.client.1.smithi149.stdout:4/499: dwrite df/da0/d12/d17/f5b [0,4194304] 0 2024-09-13T18:30:22.812 INFO:tasks.workunit.client.1.smithi149.stdout:1/507: mkdir d9/d10/d34/d53/d57/d6c/da2 0 2024-09-13T18:30:22.812 INFO:tasks.workunit.client.1.smithi149.stdout:1/508: read d9/d15/d60/d80/d8b/d42/f5b [190110,24170] 0 2024-09-13T18:30:22.818 INFO:tasks.workunit.client.1.smithi149.stdout:4/500: dwrite df/da0/d12/d21/d22/f7b [0,4194304] 0 2024-09-13T18:30:22.824 INFO:tasks.workunit.client.1.smithi149.stdout:2/441: sync 2024-09-13T18:30:22.825 INFO:tasks.workunit.client.1.smithi149.stdout:9/354: rmdir d0/d18 39 2024-09-13T18:30:22.825 INFO:tasks.workunit.client.1.smithi149.stdout:1/509: truncate d9/d10/d3f/f7a 2394735 0 2024-09-13T18:30:22.825 INFO:tasks.workunit.client.1.smithi149.stdout:1/510: dread - d9/d10/d34/d53/d57/fa1 zero size 2024-09-13T18:30:22.828 INFO:tasks.workunit.client.1.smithi149.stdout:9/355: rmdir d0/d18/d19 39 2024-09-13T18:30:22.828 INFO:tasks.workunit.client.1.smithi149.stdout:4/501: dread df/da0/d12/d21/d22/d30/d56/f5a [0,4194304] 0 2024-09-13T18:30:22.829 INFO:tasks.workunit.client.1.smithi149.stdout:1/511: mknod d9/d15/d60/ca3 0 2024-09-13T18:30:22.829 INFO:tasks.workunit.client.1.smithi149.stdout:1/512: chown d9/d10/l1e 338 1 2024-09-13T18:30:22.834 INFO:tasks.workunit.client.1.smithi149.stdout:4/502: rename df/da0/d12/d21/d22/d30/d56/f87 to df/da0/d12/d21/d22/d30/d41/d57/fa6 0 2024-09-13T18:30:22.836 INFO:tasks.workunit.client.1.smithi149.stdout:1/513: unlink d9/c6e 0 2024-09-13T18:30:22.836 INFO:tasks.workunit.client.1.smithi149.stdout:1/514: chown d9/d10/d34/d53/d57/f64 9 1 2024-09-13T18:30:22.837 INFO:tasks.workunit.client.1.smithi149.stdout:9/356: mkdir d0/d18/d27/d74 0 2024-09-13T18:30:22.838 INFO:tasks.workunit.client.1.smithi149.stdout:9/357: write d0/d18/d27/f6e [553898,72497] 0 2024-09-13T18:30:22.838 INFO:tasks.workunit.client.1.smithi149.stdout:9/358: write d0/d2e/d42/f63 [5237710,24871] 0 2024-09-13T18:30:22.839 INFO:tasks.workunit.client.1.smithi149.stdout:4/503: creat df/da0/d12/d17/d3d/fa7 x:0 0 0 2024-09-13T18:30:22.839 INFO:tasks.workunit.client.1.smithi149.stdout:4/504: write df/da0/d12/d21/d22/d30/d41/f99 [611565,16804] 0 2024-09-13T18:30:22.841 INFO:tasks.workunit.client.1.smithi149.stdout:1/515: mkdir d9/d15/d60/d80/d8b/d42/da4 0 2024-09-13T18:30:22.841 INFO:tasks.workunit.client.1.smithi149.stdout:1/516: chown d9/d10/d83 27 1 2024-09-13T18:30:22.841 INFO:tasks.workunit.client.1.smithi149.stdout:1/517: getdents d9/d15/d40/d90 0 2024-09-13T18:30:22.843 INFO:tasks.workunit.client.1.smithi149.stdout:9/359: mkdir d0/d47/d54/d75 0 2024-09-13T18:30:22.846 INFO:tasks.workunit.client.1.smithi149.stdout:4/505: symlink df/da0/d12/d7c/d9a/la8 0 2024-09-13T18:30:22.846 INFO:tasks.workunit.client.1.smithi149.stdout:4/506: fsync df/da0/d12/d21/d22/d30/d41/d57/d8a/fa2 0 2024-09-13T18:30:22.848 INFO:tasks.workunit.client.1.smithi149.stdout:9/360: unlink d0/f4b 0 2024-09-13T18:30:22.849 INFO:tasks.workunit.client.1.smithi149.stdout:5/436: dread d3/d8/d13/f22 [0,4194304] 0 2024-09-13T18:30:22.850 INFO:tasks.workunit.client.1.smithi149.stdout:9/361: symlink d0/d2e/l76 0 2024-09-13T18:30:22.850 INFO:tasks.workunit.client.1.smithi149.stdout:9/362: creat d0/d47/d61/f77 x:0 0 0 2024-09-13T18:30:22.852 INFO:tasks.workunit.client.1.smithi149.stdout:4/507: mknod df/da0/ca9 0 2024-09-13T18:30:22.852 INFO:tasks.workunit.client.1.smithi149.stdout:4/508: fsync df/da0/d12/d21/f4a 0 2024-09-13T18:30:22.854 INFO:tasks.workunit.client.1.smithi149.stdout:5/437: mknod d3/d10/d32/c85 0 2024-09-13T18:30:22.854 INFO:tasks.workunit.client.1.smithi149.stdout:5/438: stat d3/fd 0 2024-09-13T18:30:22.860 INFO:tasks.workunit.client.1.smithi149.stdout:1/518: dwrite d9/d10/d83/d97/f91 [0,4194304] 0 2024-09-13T18:30:22.863 INFO:tasks.workunit.client.1.smithi149.stdout:2/442: dwrite db/d1b/d1c/f3c [0,4194304] 0 2024-09-13T18:30:22.863 INFO:tasks.workunit.client.1.smithi149.stdout:2/443: creat db/f9a x:0 0 0 2024-09-13T18:30:22.867 INFO:tasks.workunit.client.1.smithi149.stdout:1/519: mkdir d9/d15/d60/da5 0 2024-09-13T18:30:22.867 INFO:tasks.workunit.client.1.smithi149.stdout:1/520: chown d9/d10/d83/d97/f87 21 1 2024-09-13T18:30:22.867 INFO:tasks.workunit.client.1.smithi149.stdout:1/521: chown d9/d10/d34/d53/d7b 19747 1 2024-09-13T18:30:22.870 INFO:tasks.workunit.client.1.smithi149.stdout:9/363: dwrite d0/f67 [0,4194304] 0 2024-09-13T18:30:22.870 INFO:tasks.workunit.client.1.smithi149.stdout:9/364: write d0/f4e [935460,43924] 0 2024-09-13T18:30:22.872 INFO:tasks.workunit.client.1.smithi149.stdout:2/444: rename db/d1b/d1c/d20/d2b/d3e/f68 to db/d13/d70/f9b 0 2024-09-13T18:30:22.876 INFO:tasks.workunit.client.1.smithi149.stdout:2/445: mknod db/d10/c9c 0 2024-09-13T18:30:22.876 INFO:tasks.workunit.client.1.smithi149.stdout:2/446: creat db/d1b/d48/f9d x:0 0 0 2024-09-13T18:30:22.877 INFO:tasks.workunit.client.1.smithi149.stdout:1/522: dread d9/f1c [0,4194304] 0 2024-09-13T18:30:22.880 INFO:tasks.workunit.client.1.smithi149.stdout:2/447: rename db/d1b/d48/f56 to db/d1b/d1c/d20/d2b/f9e 0 2024-09-13T18:30:22.880 INFO:tasks.workunit.client.1.smithi149.stdout:0/390: sync 2024-09-13T18:30:22.884 INFO:tasks.workunit.client.1.smithi149.stdout:1/523: symlink d9/d15/d60/da5/la6 0 2024-09-13T18:30:22.884 INFO:tasks.workunit.client.1.smithi149.stdout:1/524: chown d9/d15/d60/d80/d8b/f9f 1 1 2024-09-13T18:30:22.884 INFO:tasks.workunit.client.1.smithi149.stdout:1/525: write d9/d10/d37/f5a [3712520,49583] 0 2024-09-13T18:30:22.884 INFO:tasks.workunit.client.1.smithi149.stdout:4/509: dwrite df/da0/d1c/f42 [8388608,4194304] 0 2024-09-13T18:30:22.888 INFO:tasks.workunit.client.1.smithi149.stdout:1/526: creat d9/d15/d60/d80/d8b/d42/fa7 x:0 0 0 2024-09-13T18:30:22.891 INFO:tasks.workunit.client.1.smithi149.stdout:2/448: write db/d10/f61 [1296192,38253] 0 2024-09-13T18:30:22.891 INFO:tasks.workunit.client.1.smithi149.stdout:2/449: write db/f97 [580699,115639] 0 2024-09-13T18:30:22.893 INFO:tasks.workunit.client.1.smithi149.stdout:9/365: dwrite d0/d2e/d42/f5e [0,4194304] 0 2024-09-13T18:30:22.895 INFO:tasks.workunit.client.1.smithi149.stdout:2/450: symlink db/d1b/d1c/d85/l9f 0 2024-09-13T18:30:22.906 INFO:tasks.workunit.client.1.smithi149.stdout:0/391: dwrite d1/d1b/f40 [0,4194304] 0 2024-09-13T18:30:22.910 INFO:tasks.workunit.client.1.smithi149.stdout:4/510: dwrite df/da0/d12/d21/f4a [4194304,4194304] 0 2024-09-13T18:30:22.910 INFO:tasks.workunit.client.1.smithi149.stdout:9/366: dread d0/d18/d19/f32 [0,4194304] 0 2024-09-13T18:30:22.910 INFO:tasks.workunit.client.1.smithi149.stdout:9/367: write d0/d2e/d42/f6d [594830,57839] 0 2024-09-13T18:30:22.911 INFO:tasks.workunit.client.1.smithi149.stdout:0/392: getdents d1/d29/d31/d44/d81/d62 0 2024-09-13T18:30:22.914 INFO:tasks.workunit.client.1.smithi149.stdout:9/368: mknod d0/d18/d19/c78 0 2024-09-13T18:30:22.916 INFO:tasks.workunit.client.1.smithi149.stdout:0/393: mkdir d1/d29/d31/d83/d87 0 2024-09-13T18:30:22.916 INFO:tasks.workunit.client.1.smithi149.stdout:0/394: chown d1/d48/f64 0 1 2024-09-13T18:30:22.920 INFO:tasks.workunit.client.1.smithi149.stdout:0/395: creat d1/d29/d31/f88 x:0 0 0 2024-09-13T18:30:22.920 INFO:tasks.workunit.client.1.smithi149.stdout:0/396: chown d1/d2/l5d 3 1 2024-09-13T18:30:22.928 INFO:tasks.workunit.client.1.smithi149.stdout:9/369: getdents d0 0 2024-09-13T18:30:22.928 INFO:tasks.workunit.client.1.smithi149.stdout:9/370: fdatasync d0/f9 0 2024-09-13T18:30:22.930 INFO:tasks.workunit.client.1.smithi149.stdout:0/397: dread d1/f1a [0,4194304] 0 2024-09-13T18:30:22.930 INFO:tasks.workunit.client.1.smithi149.stdout:0/398: chown d1/c71 92 1 2024-09-13T18:30:22.932 INFO:tasks.workunit.client.1.smithi149.stdout:0/399: creat d1/d2/f89 x:0 0 0 2024-09-13T18:30:22.932 INFO:tasks.workunit.client.1.smithi149.stdout:0/400: truncate d1/d29/d31/d44/d81/f75 334721 0 2024-09-13T18:30:22.939 INFO:tasks.workunit.client.1.smithi149.stdout:9/371: dread d0/d2e/d42/f63 [0,4194304] 0 2024-09-13T18:30:22.939 INFO:tasks.workunit.client.1.smithi149.stdout:9/372: chown d0/d47/d61 1853291328 1 2024-09-13T18:30:22.940 INFO:tasks.workunit.client.1.smithi149.stdout:9/373: mkdir d0/d18/d27/d5c/d79 0 2024-09-13T18:30:22.947 INFO:tasks.workunit.client.1.smithi149.stdout:9/374: rmdir d0/d2e 39 2024-09-13T18:30:22.947 INFO:tasks.workunit.client.1.smithi149.stdout:9/375: chown d0/d18/d19/c78 5694234 1 2024-09-13T18:30:22.947 INFO:tasks.workunit.client.1.smithi149.stdout:0/401: dwrite d1/d29/d31/d44/d81/d62/f7f [4194304,4194304] 0 2024-09-13T18:30:22.947 INFO:tasks.workunit.client.1.smithi149.stdout:0/402: chown d1/d29/f7a 26647 1 2024-09-13T18:30:22.950 INFO:tasks.workunit.client.1.smithi149.stdout:9/376: unlink d0/fe 0 2024-09-13T18:30:22.954 INFO:tasks.workunit.client.1.smithi149.stdout:0/403: rename d1/d48/d70 to d1/d2/d8a 0 2024-09-13T18:30:22.954 INFO:tasks.workunit.client.1.smithi149.stdout:0/404: fdatasync d1/d29/d31/d44/d81/d62/f7f 0 2024-09-13T18:30:22.958 INFO:tasks.workunit.client.1.smithi149.stdout:0/405: getdents d1/d2/d41 0 2024-09-13T18:30:22.960 INFO:tasks.workunit.client.1.smithi149.stdout:0/406: fsync d1/d29/d31/d3e/f45 0 2024-09-13T18:30:22.960 INFO:tasks.workunit.client.1.smithi149.stdout:0/407: write d1/d1b/f72 [338792,25334] 0 2024-09-13T18:30:22.972 INFO:tasks.workunit.client.1.smithi149.stdout:3/479: sync 2024-09-13T18:30:22.972 INFO:tasks.workunit.client.1.smithi149.stdout:6/553: sync 2024-09-13T18:30:22.974 INFO:tasks.workunit.client.1.smithi149.stdout:0/408: dwrite d1/f10 [0,4194304] 0 2024-09-13T18:30:22.986 INFO:tasks.workunit.client.1.smithi149.stdout:6/554: write dc/f2d [1044972,45299] 0 2024-09-13T18:30:22.989 INFO:tasks.workunit.client.1.smithi149.stdout:6/555: rename dc/l1b to dc/d15/d23/d57/d5c/laf 0 2024-09-13T18:30:22.991 INFO:tasks.workunit.client.1.smithi149.stdout:6/556: rmdir dc/d15/d23/d57/d5c/d64 39 2024-09-13T18:30:22.991 INFO:tasks.workunit.client.1.smithi149.stdout:6/557: truncate dc/d15/d23/d57/d5c/f9b 62004 0 2024-09-13T18:30:22.993 INFO:tasks.workunit.client.1.smithi149.stdout:6/558: getdents dc/d8c 0 2024-09-13T18:30:22.993 INFO:tasks.workunit.client.1.smithi149.stdout:6/559: truncate dc/d15/d23/d57/d5c/f9b 933484 0 2024-09-13T18:30:22.995 INFO:tasks.workunit.client.1.smithi149.stdout:6/560: mkdir dc/d15/d23/d5b/d91/db0 0 2024-09-13T18:30:22.996 INFO:tasks.workunit.client.1.smithi149.stdout:3/480: dwrite d1/d47/f26 [0,4194304] 0 2024-09-13T18:30:22.996 INFO:tasks.workunit.client.1.smithi149.stdout:3/481: chown d1/d48 203 1 2024-09-13T18:30:22.996 INFO:tasks.workunit.client.1.smithi149.stdout:3/482: fsync d1/f24 0 2024-09-13T18:30:22.996 INFO:tasks.workunit.client.1.smithi149.stdout:0/409: dwrite d1/d29/d31/d44/d81/f63 [4194304,4194304] 0 2024-09-13T18:30:22.996 INFO:tasks.workunit.client.1.smithi149.stdout:0/410: getdents d1/d2/d8a 0 2024-09-13T18:30:22.996 INFO:tasks.workunit.client.1.smithi149.stdout:0/411: chown d1/d2/fd 3 1 2024-09-13T18:30:22.998 INFO:tasks.workunit.client.1.smithi149.stdout:6/561: mknod dc/d15/d23/d57/d5c/d64/cb1 0 2024-09-13T18:30:22.998 INFO:tasks.workunit.client.1.smithi149.stdout:6/562: getdents dc/d15/d54/d5e/d79 0 2024-09-13T18:30:22.998 INFO:tasks.workunit.client.1.smithi149.stdout:6/563: dread - dc/d2f/d75/f7e zero size 2024-09-13T18:30:23.000 INFO:tasks.workunit.client.1.smithi149.stdout:3/483: symlink d1/d12/d20/d91/la2 0 2024-09-13T18:30:23.003 INFO:tasks.workunit.client.1.smithi149.stdout:6/564: rename dc/f8d to dc/d15/d23/d5b/d91/fb2 0 2024-09-13T18:30:23.005 INFO:tasks.workunit.client.1.smithi149.stdout:3/484: symlink d1/d48/d75/la3 0 2024-09-13T18:30:23.009 INFO:tasks.workunit.client.1.smithi149.stdout:3/485: symlink d1/d12/d20/d54/d6d/la4 0 2024-09-13T18:30:23.011 INFO:tasks.workunit.client.1.smithi149.stdout:3/486: mknod d1/d2e/d1d/d9a/d39/ca5 0 2024-09-13T18:30:23.013 INFO:tasks.workunit.client.1.smithi149.stdout:0/412: dwrite d1/d29/d31/d44/d47/f84 [0,4194304] 0 2024-09-13T18:30:23.017 INFO:tasks.workunit.client.1.smithi149.stdout:6/565: read dc/d15/d54/d5e/d79/fa0 [2635557,65640] 0 2024-09-13T18:30:23.020 INFO:tasks.workunit.client.1.smithi149.stdout:6/566: mkdir dc/d15/d54/da9/db3 0 2024-09-13T18:30:23.026 INFO:tasks.workunit.client.1.smithi149.stdout:6/567: link dc/l17 dc/d15/d54/d85/lb4 0 2024-09-13T18:30:23.032 INFO:tasks.workunit.client.1.smithi149.stdout:0/413: dwrite d1/d29/f7a [0,4194304] 0 2024-09-13T18:30:23.042 INFO:tasks.workunit.client.1.smithi149.stdout:0/414: write d1/d29/f7a [4053122,76104] 0 2024-09-13T18:30:23.043 INFO:tasks.workunit.client.1.smithi149.stdout:6/568: dwrite dc/d15/f20 [0,4194304] 0 2024-09-13T18:30:23.043 INFO:tasks.workunit.client.1.smithi149.stdout:6/569: readlink dc/d15/d54/lad 0 2024-09-13T18:30:23.043 INFO:tasks.workunit.client.1.smithi149.stdout:6/570: truncate dc/d15/d23/d5f/f67 697230 0 2024-09-13T18:30:23.045 INFO:tasks.workunit.client.1.smithi149.stdout:0/415: symlink d1/d1b/l8b 0 2024-09-13T18:30:23.047 INFO:tasks.workunit.client.1.smithi149.stdout:6/571: fdatasync dc/d2f/f6c 0 2024-09-13T18:30:23.047 INFO:tasks.workunit.client.1.smithi149.stdout:6/572: readlink dc/d2f/l86 0 2024-09-13T18:30:23.050 INFO:tasks.workunit.client.1.smithi149.stdout:6/573: symlink dc/d15/daa/lb5 0 2024-09-13T18:30:23.050 INFO:tasks.workunit.client.1.smithi149.stdout:6/574: fdatasync dc/d15/f3d 0 2024-09-13T18:30:23.057 INFO:tasks.workunit.client.1.smithi149.stdout:6/575: write dc/d15/d23/f3e [575004,88282] 0 2024-09-13T18:30:23.058 INFO:tasks.workunit.client.1.smithi149.stdout:0/416: dwrite d1/d2/d41/d46/f69 [0,4194304] 0 2024-09-13T18:30:23.059 INFO:tasks.workunit.client.1.smithi149.stdout:6/576: creat dc/d15/d23/fb6 x:0 0 0 2024-09-13T18:30:23.059 INFO:tasks.workunit.client.1.smithi149.stdout:6/577: chown dc/d76/ca8 469445835 1 2024-09-13T18:30:23.070 INFO:tasks.workunit.client.1.smithi149.stdout:7/533: sync 2024-09-13T18:30:23.074 INFO:tasks.workunit.client.1.smithi149.stdout:7/534: rename d7/d9/d1c/c2e to d7/d9/d1c/d1f/d21/d7b/d96/d9e/cb6 0 2024-09-13T18:30:23.074 INFO:tasks.workunit.client.1.smithi149.stdout:7/535: readlink d7/d9/d1c/d51/d52/lb4 0 2024-09-13T18:30:23.078 INFO:tasks.workunit.client.1.smithi149.stdout:7/536: rename d7/d9/d1c/f29 to d7/d76/fb7 0 2024-09-13T18:30:23.078 INFO:tasks.workunit.client.1.smithi149.stdout:7/537: creat d7/d9/d1c/d1f/d21/fb8 x:0 0 0 2024-09-13T18:30:23.080 INFO:tasks.workunit.client.1.smithi149.stdout:6/578: dwrite dc/d15/d23/f39 [8388608,4194304] 0 2024-09-13T18:30:23.082 INFO:tasks.workunit.client.1.smithi149.stdout:7/538: symlink d7/d9/d1c/d1f/lb9 0 2024-09-13T18:30:23.086 INFO:tasks.workunit.client.1.smithi149.stdout:6/579: link dc/d15/d23/f58 dc/d15/d23/d5f/dac/fb7 0 2024-09-13T18:30:23.087 INFO:tasks.workunit.client.1.smithi149.stdout:0/417: dwrite d1/d29/f7a [0,4194304] 0 2024-09-13T18:30:23.087 INFO:tasks.workunit.client.1.smithi149.stdout:0/418: read - d1/d29/d31/d44/d81/f85 zero size 2024-09-13T18:30:23.087 INFO:tasks.workunit.client.1.smithi149.stdout:0/419: getdents d1/d2/d8a 0 2024-09-13T18:30:23.087 INFO:tasks.workunit.client.1.smithi149.stdout:7/539: symlink d7/d9/d1c/d51/d52/d86/lba 0 2024-09-13T18:30:23.089 INFO:tasks.workunit.client.1.smithi149.stdout:6/580: mknod dc/d76/cb8 0 2024-09-13T18:30:23.090 INFO:tasks.workunit.client.1.smithi149.stdout:6/581: truncate dc/d15/d23/d5b/f52 735596 0 2024-09-13T18:30:23.094 INFO:tasks.workunit.client.1.smithi149.stdout:0/420: dread d1/d29/d31/d3e/d54/f6b [0,4194304] 0 2024-09-13T18:30:23.097 INFO:tasks.workunit.client.1.smithi149.stdout:0/421: symlink d1/d48/l8c 0 2024-09-13T18:30:23.098 INFO:tasks.workunit.client.1.smithi149.stdout:7/540: read d7/d9/d1c/d51/f61 [334869,9888] 0 2024-09-13T18:30:23.100 INFO:tasks.workunit.client.1.smithi149.stdout:6/582: dread dc/f1a [0,4194304] 0 2024-09-13T18:30:23.100 INFO:tasks.workunit.client.1.smithi149.stdout:6/583: chown f8 5597268 1 2024-09-13T18:30:23.101 INFO:tasks.workunit.client.1.smithi149.stdout:7/541: symlink d7/d9/d1c/d1f/da1/lbb 0 2024-09-13T18:30:23.103 INFO:tasks.workunit.client.1.smithi149.stdout:0/422: mknod d1/d2/c8d 0 2024-09-13T18:30:23.103 INFO:tasks.workunit.client.1.smithi149.stdout:0/423: creat d1/d29/d31/d44/d47/f8e x:0 0 0 2024-09-13T18:30:23.105 INFO:tasks.workunit.client.1.smithi149.stdout:6/584: mkdir dc/d15/d23/d5f/db9 0 2024-09-13T18:30:23.108 INFO:tasks.workunit.client.1.smithi149.stdout:7/542: rename d7/d9/d1c/d1f/lb9 to d7/d9/d1c/d34/d4e/lbc 0 2024-09-13T18:30:23.109 INFO:tasks.workunit.client.1.smithi149.stdout:8/443: sync 2024-09-13T18:30:23.109 INFO:tasks.workunit.client.1.smithi149.stdout:5/439: sync 2024-09-13T18:30:23.112 INFO:tasks.workunit.client.1.smithi149.stdout:0/424: mknod d1/d1b/c8f 0 2024-09-13T18:30:23.114 INFO:tasks.workunit.client.1.smithi149.stdout:6/585: creat dc/d15/d54/fba x:0 0 0 2024-09-13T18:30:23.115 INFO:tasks.workunit.client.1.smithi149.stdout:7/543: stat d7/d9/l79 0 2024-09-13T18:30:23.115 INFO:tasks.workunit.client.1.smithi149.stdout:7/544: creat d7/d9/d1c/d51/d52/d86/fbd x:0 0 0 2024-09-13T18:30:23.119 INFO:tasks.workunit.client.1.smithi149.stdout:8/444: mknod d2/d12/d1b/c92 0 2024-09-13T18:30:23.121 INFO:tasks.workunit.client.1.smithi149.stdout:5/440: truncate d3/d8/d13/f22 911723 0 2024-09-13T18:30:23.121 INFO:tasks.workunit.client.1.smithi149.stdout:5/441: fsync d3/d8/f1e 0 2024-09-13T18:30:23.124 INFO:tasks.workunit.client.1.smithi149.stdout:6/586: link dc/d15/c1c dc/d2f/d75/cbb 0 2024-09-13T18:30:23.124 INFO:tasks.workunit.client.1.smithi149.stdout:0/425: dread d1/d2/fd [0,4194304] 0 2024-09-13T18:30:23.127 INFO:tasks.workunit.client.1.smithi149.stdout:8/445: getdents d2/d13/d3a/d7f/d8d 0 2024-09-13T18:30:23.131 INFO:tasks.workunit.client.1.smithi149.stdout:6/587: rename dc/d15/d23/d57/d5c/d64 to dc/d70/dbc 0 2024-09-13T18:30:23.131 INFO:tasks.workunit.client.1.smithi149.stdout:7/545: dwrite d7/d9/d1c/d34/f55 [0,4194304] 0 2024-09-13T18:30:23.132 INFO:tasks.workunit.client.1.smithi149.stdout:7/546: truncate d7/d9/fa 2072376 0 2024-09-13T18:30:23.135 INFO:tasks.workunit.client.1.smithi149.stdout:6/588: mkdir dc/d15/d23/d5f/dac/dbd 0 2024-09-13T18:30:23.136 INFO:tasks.workunit.client.1.smithi149.stdout:6/589: write dc/d15/d23/d57/f59 [170168,115566] 0 2024-09-13T18:30:23.139 INFO:tasks.workunit.client.1.smithi149.stdout:5/442: dread d3/d10/d4c/d4e/d61/d75/f7b [0,4194304] 0 2024-09-13T18:30:23.140 INFO:tasks.workunit.client.1.smithi149.stdout:3/487: sync 2024-09-13T18:30:23.140 INFO:tasks.workunit.client.1.smithi149.stdout:4/511: sync 2024-09-13T18:30:23.140 INFO:tasks.workunit.client.1.smithi149.stdout:2/451: sync 2024-09-13T18:30:23.140 INFO:tasks.workunit.client.1.smithi149.stdout:1/527: sync 2024-09-13T18:30:23.140 INFO:tasks.workunit.client.1.smithi149.stdout:9/377: sync 2024-09-13T18:30:23.140 INFO:tasks.workunit.client.1.smithi149.stdout:2/452: write db/d13/f18 [1907837,100629] 0 2024-09-13T18:30:23.140 INFO:tasks.workunit.client.1.smithi149.stdout:1/528: write d9/d10/f27 [4460808,122669] 0 2024-09-13T18:30:23.140 INFO:tasks.workunit.client.1.smithi149.stdout:2/453: write db/f96 [27977,38505] 0 2024-09-13T18:30:23.141 INFO:tasks.workunit.client.1.smithi149.stdout:6/590: dread dc/d2f/f3a [0,4194304] 0 2024-09-13T18:30:23.143 INFO:tasks.workunit.client.1.smithi149.stdout:4/512: unlink df/da0/d12/d17/d3d/c9c 0 2024-09-13T18:30:23.144 INFO:tasks.workunit.client.1.smithi149.stdout:9/378: rmdir d0/d18/d27 39 2024-09-13T18:30:23.145 INFO:tasks.workunit.client.1.smithi149.stdout:2/454: dread db/d13/d70/f9b [0,4194304] 0 2024-09-13T18:30:23.145 INFO:tasks.workunit.client.1.smithi149.stdout:2/455: stat db/d1b/d1c/d20/d3a/d75/f8c 0 2024-09-13T18:30:23.149 INFO:tasks.workunit.client.1.smithi149.stdout:1/529: unlink d9/d10/d34/d3c/c44 0 2024-09-13T18:30:23.151 INFO:tasks.workunit.client.1.smithi149.stdout:6/591: creat dc/d2f/fbe x:0 0 0 2024-09-13T18:30:23.154 INFO:tasks.workunit.client.1.smithi149.stdout:9/379: chown d0/d18/d19/f3f 9705 1 2024-09-13T18:30:23.156 INFO:tasks.workunit.client.1.smithi149.stdout:2/456: unlink db/d1b/d1c/d85/l8f 0 2024-09-13T18:30:23.156 INFO:tasks.workunit.client.1.smithi149.stdout:3/488: dread d1/d2e/f37 [0,4194304] 0 2024-09-13T18:30:23.157 INFO:tasks.workunit.client.1.smithi149.stdout:9/380: symlink d0/d47/l7a 0 2024-09-13T18:30:23.158 INFO:tasks.workunit.client.1.smithi149.stdout:5/443: dread d3/d10/f7d [0,4194304] 0 2024-09-13T18:30:23.160 INFO:tasks.workunit.client.1.smithi149.stdout:2/457: rename db/d1b/d1c/l44 to db/d1b/d1c/d20/d3a/d75/la0 0 2024-09-13T18:30:23.162 INFO:tasks.workunit.client.1.smithi149.stdout:5/444: rmdir d3/d10/d4c/d4e/d61 39 2024-09-13T18:30:23.164 INFO:tasks.workunit.client.1.smithi149.stdout:3/489: dread d1/d2e/f37 [0,4194304] 0 2024-09-13T18:30:23.164 INFO:tasks.workunit.client.1.smithi149.stdout:2/458: mknod db/d1b/d1c/d85/ca1 0 2024-09-13T18:30:23.164 INFO:tasks.workunit.client.1.smithi149.stdout:2/459: read - db/d1b/d2f/d69/f5c zero size 2024-09-13T18:30:23.165 INFO:tasks.workunit.client.1.smithi149.stdout:6/592: dread dc/d15/d23/f27 [0,4194304] 0 2024-09-13T18:30:23.167 INFO:tasks.workunit.client.1.smithi149.stdout:8/446: dwrite d2/d12/d1b/f68 [0,4194304] 0 2024-09-13T18:30:23.167 INFO:tasks.workunit.client.1.smithi149.stdout:5/445: rename d3/f34 to d3/d10/d32/d67/f86 0 2024-09-13T18:30:23.167 INFO:tasks.workunit.client.1.smithi149.stdout:5/446: creat d3/d10/d4c/d4e/d61/d75/f87 x:0 0 0 2024-09-13T18:30:23.168 INFO:tasks.workunit.client.1.smithi149.stdout:6/593: dread dc/d15/d23/d5f/dac/fb7 [0,4194304] 0 2024-09-13T18:30:23.168 INFO:tasks.workunit.client.1.smithi149.stdout:6/594: dread - dc/d15/d54/d85/f89 zero size 2024-09-13T18:30:23.169 INFO:tasks.workunit.client.1.smithi149.stdout:6/595: read dc/f3f [4802689,63835] 0 2024-09-13T18:30:23.173 INFO:tasks.workunit.client.1.smithi149.stdout:3/490: creat d1/d2e/d93/fa6 x:0 0 0 2024-09-13T18:30:23.175 INFO:tasks.workunit.client.1.smithi149.stdout:8/447: link d2/d13/l35 d2/d13/d3a/l93 0 2024-09-13T18:30:23.177 INFO:tasks.workunit.client.1.smithi149.stdout:5/447: mkdir d3/d10/d4c/d4e/d61/d75/d88 0 2024-09-13T18:30:23.177 INFO:tasks.workunit.client.1.smithi149.stdout:5/448: fdatasync d3/f3d 0 2024-09-13T18:30:23.178 INFO:tasks.workunit.client.1.smithi149.stdout:6/596: symlink dc/d15/d23/lbf 0 2024-09-13T18:30:23.178 INFO:tasks.workunit.client.1.smithi149.stdout:6/597: getdents dc/d15/d23/d5b/d91/db0 0 2024-09-13T18:30:23.179 INFO:tasks.workunit.client.1.smithi149.stdout:7/547: dwrite d7/d76/fb7 [0,4194304] 0 2024-09-13T18:30:23.179 INFO:tasks.workunit.client.1.smithi149.stdout:7/548: chown d7/d9/d1c/d1f/d47/f8d 19201554 1 2024-09-13T18:30:23.180 INFO:tasks.workunit.client.1.smithi149.stdout:5/449: creat d3/d10/d32/d54/d76/f89 x:0 0 0 2024-09-13T18:30:23.180 INFO:tasks.workunit.client.1.smithi149.stdout:0/426: dwrite d1/d29/d31/d3e/d3f/f68 [0,4194304] 0 2024-09-13T18:30:23.180 INFO:tasks.workunit.client.1.smithi149.stdout:2/460: write db/d1b/d1c/d20/d3a/f3f [1078017,30837] 0 2024-09-13T18:30:23.180 INFO:tasks.workunit.client.1.smithi149.stdout:2/461: chown db/d10/f2c 0 1 2024-09-13T18:30:23.183 INFO:tasks.workunit.client.1.smithi149.stdout:4/513: dwrite df/f20 [0,4194304] 0 2024-09-13T18:30:23.184 INFO:tasks.workunit.client.1.smithi149.stdout:7/549: mkdir d7/d9/d1c/d1f/d47/d53/dbe 0 2024-09-13T18:30:23.185 INFO:tasks.workunit.client.1.smithi149.stdout:3/491: dread d1/d2e/d1d/d9a/f2f [0,4194304] 0 2024-09-13T18:30:23.186 INFO:tasks.workunit.client.1.smithi149.stdout:3/492: readlink d1/d2e/d1d/l3f 0 2024-09-13T18:30:23.189 INFO:tasks.workunit.client.1.smithi149.stdout:5/450: rename d3/d10/f64 to d3/d10/d32/d67/d83/f8a 0 2024-09-13T18:30:23.189 INFO:tasks.workunit.client.1.smithi149.stdout:5/451: dread - d3/d10/d32/d54/f7c zero size 2024-09-13T18:30:23.191 INFO:tasks.workunit.client.1.smithi149.stdout:0/427: dread d1/f6a [0,4194304] 0 2024-09-13T18:30:23.191 INFO:tasks.workunit.client.1.smithi149.stdout:2/462: unlink db/d10/d12/c27 0 2024-09-13T18:30:23.191 INFO:tasks.workunit.client.1.smithi149.stdout:9/381: dwrite d0/d18/d19/d3b/f3d [0,4194304] 0 2024-09-13T18:30:23.191 INFO:tasks.workunit.client.1.smithi149.stdout:9/382: creat d0/d47/d61/f7b x:0 0 0 2024-09-13T18:30:23.194 INFO:tasks.workunit.client.1.smithi149.stdout:8/448: dread d2/d12/f39 [0,4194304] 0 2024-09-13T18:30:23.194 INFO:tasks.workunit.client.1.smithi149.stdout:7/550: rename d7/fd to d7/d9/d11/d50/fbf 0 2024-09-13T18:30:23.196 INFO:tasks.workunit.client.1.smithi149.stdout:5/452: creat d3/f8b x:0 0 0 2024-09-13T18:30:23.196 INFO:tasks.workunit.client.1.smithi149.stdout:5/453: write d3/d10/d32/d54/d76/f89 [1044165,1682] 0 2024-09-13T18:30:23.200 INFO:tasks.workunit.client.1.smithi149.stdout:4/514: dread df/da0/d12/d17/d3d/f73 [0,4194304] 0 2024-09-13T18:30:23.203 INFO:tasks.workunit.client.1.smithi149.stdout:2/463: creat db/d13/d70/d89/fa2 x:0 0 0 2024-09-13T18:30:23.205 INFO:tasks.workunit.client.1.smithi149.stdout:8/449: mknod d2/d5b/d88/c94 0 2024-09-13T18:30:23.205 INFO:tasks.workunit.client.1.smithi149.stdout:8/450: fsync d2/d12/d1b/f8f 0 2024-09-13T18:30:23.206 INFO:tasks.workunit.client.1.smithi149.stdout:7/551: truncate d7/f4c 4475784 0 2024-09-13T18:30:23.207 INFO:tasks.workunit.client.1.smithi149.stdout:5/454: mknod d3/d10/d32/d54/d76/c8c 0 2024-09-13T18:30:23.209 INFO:tasks.workunit.client.1.smithi149.stdout:0/428: getdents d1/d29/d31/d3e/d3f 0 2024-09-13T18:30:23.212 INFO:tasks.workunit.client.1.smithi149.stdout:3/493: write d1/f24 [1315278,76049] 0 2024-09-13T18:30:23.212 INFO:tasks.workunit.client.1.smithi149.stdout:4/515: symlink df/da0/d12/laa 0 2024-09-13T18:30:23.212 INFO:tasks.workunit.client.1.smithi149.stdout:4/516: chown df/l47 21390 1 2024-09-13T18:30:23.213 INFO:tasks.workunit.client.1.smithi149.stdout:8/451: mknod d2/d13/d3a/c95 0 2024-09-13T18:30:23.213 INFO:tasks.workunit.client.1.smithi149.stdout:8/452: write d2/f15 [3023249,95197] 0 2024-09-13T18:30:23.213 INFO:tasks.workunit.client.1.smithi149.stdout:8/453: write d2/d12/f43 [4254413,122010] 0 2024-09-13T18:30:23.214 INFO:tasks.workunit.client.1.smithi149.stdout:9/383: write d0/f67 [713952,37072] 0 2024-09-13T18:30:23.214 INFO:tasks.workunit.client.1.smithi149.stdout:9/384: chown d0/d47/d61/f6b 487 1 2024-09-13T18:30:23.215 INFO:tasks.workunit.client.1.smithi149.stdout:7/552: creat d7/d76/db3/d6f/fc0 x:0 0 0 2024-09-13T18:30:23.217 INFO:tasks.workunit.client.1.smithi149.stdout:0/429: rename d1/d29/d31/d3e/d3f to d1/d2/d8a/d90 0 2024-09-13T18:30:23.219 INFO:tasks.workunit.client.1.smithi149.stdout:3/494: rmdir d1/d2c 39 2024-09-13T18:30:23.219 INFO:tasks.workunit.client.1.smithi149.stdout:6/598: dwrite dc/d15/d23/f31 [0,4194304] 0 2024-09-13T18:30:23.222 INFO:tasks.workunit.client.1.smithi149.stdout:4/517: unlink df/da0/d12/d21/d22/d30/d41/d57/d60/c86 0 2024-09-13T18:30:23.223 INFO:tasks.workunit.client.1.smithi149.stdout:1/530: dwrite d9/f1c [0,4194304] 0 2024-09-13T18:30:23.226 INFO:tasks.workunit.client.1.smithi149.stdout:8/454: creat d2/f96 x:0 0 0 2024-09-13T18:30:23.232 INFO:tasks.workunit.client.1.smithi149.stdout:0/430: rename d1/d1b/l55 to d1/d29/d31/d3e/l91 0 2024-09-13T18:30:23.233 INFO:tasks.workunit.client.1.smithi149.stdout:0/431: write d1/d29/d31/d3e/f45 [2029690,120121] 0 2024-09-13T18:30:23.233 INFO:tasks.workunit.client.1.smithi149.stdout:0/432: write d1/f2b [957194,6506] 0 2024-09-13T18:30:23.240 INFO:tasks.workunit.client.1.smithi149.stdout:6/599: truncate dc/d15/d23/d5b/f7f 2137285 0 2024-09-13T18:30:23.240 INFO:tasks.workunit.client.1.smithi149.stdout:3/495: dread d1/f19 [0,4194304] 0 2024-09-13T18:30:23.240 INFO:tasks.workunit.client.1.smithi149.stdout:4/518: mknod df/da0/d12/d21/d22/d30/d41/d57/cab 0 2024-09-13T18:30:23.243 INFO:tasks.workunit.client.1.smithi149.stdout:6/600: dread dc/d15/d23/f58 [0,4194304] 0 2024-09-13T18:30:23.243 INFO:tasks.workunit.client.1.smithi149.stdout:6/601: fsync dc/d15/f55 0 2024-09-13T18:30:23.243 INFO:tasks.workunit.client.1.smithi149.stdout:6/602: write dc/d15/d54/d5e/d79/fa0 [5104178,24988] 0 2024-09-13T18:30:23.248 INFO:tasks.workunit.client.1.smithi149.stdout:9/385: dwrite d0/d2e/d42/f73 [0,4194304] 0 2024-09-13T18:30:23.255 INFO:tasks.workunit.client.1.smithi149.stdout:0/433: rmdir d1/d2/d8a 39 2024-09-13T18:30:23.255 INFO:tasks.workunit.client.1.smithi149.stdout:0/434: fsync d1/d29/d31/d44/d47/f84 0 2024-09-13T18:30:23.256 INFO:tasks.workunit.client.1.smithi149.stdout:6/603: write dc/d70/dbc/f88 [3431341,19668] 0 2024-09-13T18:30:23.256 INFO:tasks.workunit.client.1.smithi149.stdout:6/604: chown dc/d15/d23/c61 0 1 2024-09-13T18:30:23.256 INFO:tasks.workunit.client.1.smithi149.stdout:3/496: mknod d1/d2e/d1d/d9a/ca7 0 2024-09-13T18:30:23.257 INFO:tasks.workunit.client.1.smithi149.stdout:3/497: read d1/d2e/f14 [1595463,11340] 0 2024-09-13T18:30:23.259 INFO:tasks.workunit.client.1.smithi149.stdout:9/386: dread d0/d18/d19/d3b/f4f [0,4194304] 0 2024-09-13T18:30:23.265 INFO:tasks.workunit.client.1.smithi149.stdout:6/605: creat dc/d15/d54/da9/fc0 x:0 0 0 2024-09-13T18:30:23.265 INFO:tasks.workunit.client.1.smithi149.stdout:6/606: write dc/d15/f55 [1677433,44531] 0 2024-09-13T18:30:23.266 INFO:tasks.workunit.client.1.smithi149.stdout:6/607: truncate dc/d15/d23/f39 12739632 0 2024-09-13T18:30:23.266 INFO:tasks.workunit.client.1.smithi149.stdout:3/498: creat d1/d2c/fa8 x:0 0 0 2024-09-13T18:30:23.267 INFO:tasks.workunit.client.1.smithi149.stdout:9/387: creat d0/d2e/d42/d59/f7c x:0 0 0 2024-09-13T18:30:23.268 INFO:tasks.workunit.client.1.smithi149.stdout:0/435: write d1/d29/d31/d44/d81/d62/f7f [3287024,83221] 0 2024-09-13T18:30:23.268 INFO:tasks.workunit.client.1.smithi149.stdout:0/436: stat d1/d1b/f56 0 2024-09-13T18:30:23.268 INFO:tasks.workunit.client.1.smithi149.stdout:0/437: dread - d1/d2/f5b zero size 2024-09-13T18:30:23.268 INFO:tasks.workunit.client.1.smithi149.stdout:0/438: fdatasync d1/d29/d31/d44/d47/f8e 0 2024-09-13T18:30:23.269 INFO:tasks.workunit.client.1.smithi149.stdout:6/608: link dc/d15/d54/c80 dc/d15/cc1 0 2024-09-13T18:30:23.270 INFO:tasks.workunit.client.1.smithi149.stdout:9/388: creat d0/d2e/d42/d70/f7d x:0 0 0 2024-09-13T18:30:23.271 INFO:tasks.workunit.client.1.smithi149.stdout:0/439: mkdir d1/d48/d92 0 2024-09-13T18:30:23.272 INFO:tasks.workunit.client.1.smithi149.stdout:6/609: creat dc/d8c/fc2 x:0 0 0 2024-09-13T18:30:23.272 INFO:tasks.workunit.client.1.smithi149.stdout:6/610: chown dc/d15/d23/c24 321330 1 2024-09-13T18:30:23.273 INFO:tasks.workunit.client.1.smithi149.stdout:7/553: dwrite d7/d12/f17 [0,4194304] 0 2024-09-13T18:30:23.275 INFO:tasks.workunit.client.1.smithi149.stdout:8/455: dwrite d2/d12/f5c [4194304,4194304] 0 2024-09-13T18:30:23.275 INFO:tasks.workunit.client.1.smithi149.stdout:1/531: dwrite d9/d15/d60/d80/d8b/d42/f6a [0,4194304] 0 2024-09-13T18:30:23.275 INFO:tasks.workunit.client.1.smithi149.stdout:1/532: chown d9/d10/d62/f8d 78 1 2024-09-13T18:30:23.275 INFO:tasks.workunit.client.1.smithi149.stdout:6/611: fdatasync dc/d70/dbc/f88 0 2024-09-13T18:30:23.275 INFO:tasks.workunit.client.1.smithi149.stdout:6/612: readlink dc/l6f 0 2024-09-13T18:30:23.275 INFO:tasks.workunit.client.1.smithi149.stdout:2/464: dwrite db/d1b/d2f/d30/f4f [0,4194304] 0 2024-09-13T18:30:23.276 INFO:tasks.workunit.client.1.smithi149.stdout:9/389: rmdir d0/d18/d27/d74 0 2024-09-13T18:30:23.276 INFO:tasks.workunit.client.1.smithi149.stdout:9/390: readlink d0/l6 0 2024-09-13T18:30:23.277 INFO:tasks.workunit.client.1.smithi149.stdout:6/613: write dc/d2f/d75/f8e [630274,120404] 0 2024-09-13T18:30:23.277 INFO:tasks.workunit.client.1.smithi149.stdout:6/614: creat dc/d15/d54/fc3 x:0 0 0 2024-09-13T18:30:23.278 INFO:tasks.workunit.client.1.smithi149.stdout:0/440: creat d1/d2/d8a/f93 x:0 0 0 2024-09-13T18:30:23.278 INFO:tasks.workunit.client.1.smithi149.stdout:0/441: read - d1/d29/d31/d3e/f73 zero size 2024-09-13T18:30:23.282 INFO:tasks.workunit.client.1.smithi149.stdout:8/456: mkdir d2/d12/d1b/d58/d97 0 2024-09-13T18:30:23.287 INFO:tasks.workunit.client.1.smithi149.stdout:8/457: dread d2/d12/f46 [0,4194304] 0 2024-09-13T18:30:23.287 INFO:tasks.workunit.client.1.smithi149.stdout:1/533: symlink d9/d10/d34/d53/d57/la8 0 2024-09-13T18:30:23.288 INFO:tasks.workunit.client.1.smithi149.stdout:1/534: dread d9/d10/d34/d53/f7d [0,4194304] 0 2024-09-13T18:30:23.288 INFO:tasks.workunit.client.1.smithi149.stdout:1/535: write d9/d10/d83/d97/f91 [4677045,118492] 0 2024-09-13T18:30:23.289 INFO:tasks.workunit.client.1.smithi149.stdout:4/519: getdents df/da0/d12 0 2024-09-13T18:30:23.295 INFO:tasks.workunit.client.1.smithi149.stdout:7/554: dwrite d7/d9/d1c/d51/d52/d86/fbd [0,4194304] 0 2024-09-13T18:30:23.302 INFO:tasks.workunit.client.1.smithi149.stdout:1/536: dwrite d9/d10/d34/f51 [0,4194304] 0 2024-09-13T18:30:23.302 INFO:tasks.workunit.client.1.smithi149.stdout:1/537: creat d9/d58/fa9 x:0 0 0 2024-09-13T18:30:23.302 INFO:tasks.workunit.client.1.smithi149.stdout:2/465: unlink db/d10/d8d/f93 0 2024-09-13T18:30:23.302 INFO:tasks.workunit.client.1.smithi149.stdout:2/466: truncate db/d1b/d2f/d69/f5c 337667 0 2024-09-13T18:30:23.303 INFO:tasks.workunit.client.1.smithi149.stdout:2/467: chown db/d13 151388 1 2024-09-13T18:30:23.303 INFO:tasks.workunit.client.1.smithi149.stdout:9/391: mkdir d0/d18/d27/d5c/d7e 0 2024-09-13T18:30:23.307 INFO:tasks.workunit.client.1.smithi149.stdout:6/615: unlink dc/d15/d23/d57/d5c/laf 0 2024-09-13T18:30:23.307 INFO:tasks.workunit.client.1.smithi149.stdout:6/616: creat dc/d76/fc4 x:0 0 0 2024-09-13T18:30:23.307 INFO:tasks.workunit.client.1.smithi149.stdout:6/617: fsync dc/d15/f4d 0 2024-09-13T18:30:23.307 INFO:tasks.workunit.client.1.smithi149.stdout:6/618: write dc/d15/d23/d5f/f67 [1025019,100801] 0 2024-09-13T18:30:23.308 INFO:tasks.workunit.client.1.smithi149.stdout:8/458: symlink d2/d12/d40/l98 0 2024-09-13T18:30:23.308 INFO:tasks.workunit.client.1.smithi149.stdout:8/459: write d2/f96 [185746,85372] 0 2024-09-13T18:30:23.308 INFO:tasks.workunit.client.1.smithi149.stdout:8/460: chown d2/d12/d1b/f3c 85 1 2024-09-13T18:30:23.312 INFO:tasks.workunit.client.1.smithi149.stdout:4/520: link df/da0/f61 df/da0/d12/d21/d22/d30/d41/d57/d60/fac 0 2024-09-13T18:30:23.315 INFO:tasks.workunit.client.1.smithi149.stdout:7/555: symlink d7/d9/d11/d50/lc1 0 2024-09-13T18:30:23.319 INFO:tasks.workunit.client.1.smithi149.stdout:1/538: symlink d9/d10/d34/d53/d7b/laa 0 2024-09-13T18:30:23.319 INFO:tasks.workunit.client.1.smithi149.stdout:1/539: fdatasync f3 0 2024-09-13T18:30:23.321 INFO:tasks.workunit.client.1.smithi149.stdout:2/468: rename db/d10/f55 to db/d10/d8d/fa3 0 2024-09-13T18:30:23.321 INFO:tasks.workunit.client.1.smithi149.stdout:2/469: readlink db/d10/l7e 0 2024-09-13T18:30:23.321 INFO:tasks.workunit.client.1.smithi149.stdout:3/499: rmdir d1/d2e/d1d 39 2024-09-13T18:30:23.322 INFO:tasks.workunit.client.1.smithi149.stdout:3/500: stat d1/d2e/d1d/d9a/d39/ca5 0 2024-09-13T18:30:23.322 INFO:tasks.workunit.client.1.smithi149.stdout:3/501: truncate d1/d2c/fa8 657727 0 2024-09-13T18:30:23.322 INFO:tasks.workunit.client.1.smithi149.stdout:3/502: readlink d1/d2e/d1d/d9a/la1 0 2024-09-13T18:30:23.322 INFO:tasks.workunit.client.1.smithi149.stdout:9/392: mknod d0/d2e/d42/d59/c7f 0 2024-09-13T18:30:23.322 INFO:tasks.workunit.client.1.smithi149.stdout:9/393: fsync d0/d18/d19/d3b/f53 0 2024-09-13T18:30:23.325 INFO:tasks.workunit.client.1.smithi149.stdout:6/619: truncate dc/d15/f3d 3064505 0 2024-09-13T18:30:23.328 INFO:tasks.workunit.client.1.smithi149.stdout:8/461: link d2/d5b/d88/l8c d2/d13/d6d/l99 0 2024-09-13T18:30:23.331 INFO:tasks.workunit.client.1.smithi149.stdout:9/394: write d0/d47/d61/f6b [3005646,62006] 0 2024-09-13T18:30:23.332 INFO:tasks.workunit.client.1.smithi149.stdout:1/540: mkdir d9/d10/d3f/d76/d8c/dab 0 2024-09-13T18:30:23.332 INFO:tasks.workunit.client.1.smithi149.stdout:1/541: stat d9/d10/d34/c4d 0 2024-09-13T18:30:23.335 INFO:tasks.workunit.client.1.smithi149.stdout:4/521: rename df/l47 to df/da0/d12/d21/d22/d30/d41/d57/lad 0 2024-09-13T18:30:23.337 INFO:tasks.workunit.client.1.smithi149.stdout:2/470: symlink db/d1b/la4 0 2024-09-13T18:30:23.339 INFO:tasks.workunit.client.1.smithi149.stdout:1/542: write d9/d10/d34/d53/d57/f64 [959831,82843] 0 2024-09-13T18:30:23.339 INFO:tasks.workunit.client.1.smithi149.stdout:1/543: stat d9/d10/d34/d53/d57 0 2024-09-13T18:30:23.340 INFO:tasks.workunit.client.1.smithi149.stdout:6/620: mknod dc/d15/d23/d5b/d91/db0/cc5 0 2024-09-13T18:30:23.342 INFO:tasks.workunit.client.1.smithi149.stdout:8/462: symlink d2/d5b/d86/l9a 0 2024-09-13T18:30:23.342 INFO:tasks.workunit.client.1.smithi149.stdout:8/463: fsync d2/d12/f43 0 2024-09-13T18:30:23.343 INFO:tasks.workunit.client.1.smithi149.stdout:7/556: getdents d7 0 2024-09-13T18:30:23.343 INFO:tasks.workunit.client.1.smithi149.stdout:7/557: truncate d7/d9/d1c/d2c/d60/f91 1048389 0 2024-09-13T18:30:23.346 INFO:tasks.workunit.client.1.smithi149.stdout:4/522: dread df/da0/d1c/f23 [0,4194304] 0 2024-09-13T18:30:23.346 INFO:tasks.workunit.client.1.smithi149.stdout:9/395: write d0/d18/d19/f23 [1464174,79155] 0 2024-09-13T18:30:23.349 INFO:tasks.workunit.client.1.smithi149.stdout:2/471: symlink db/d1b/d6c/la5 0 2024-09-13T18:30:23.349 INFO:tasks.workunit.client.1.smithi149.stdout:2/472: readlink db/d1b/d1c/l5e 0 2024-09-13T18:30:23.351 INFO:tasks.workunit.client.1.smithi149.stdout:6/621: dread dc/f5a [0,4194304] 0 2024-09-13T18:30:23.352 INFO:tasks.workunit.client.1.smithi149.stdout:6/622: fdatasync dc/d15/d23/d5f/fa4 0 2024-09-13T18:30:23.355 INFO:tasks.workunit.client.1.smithi149.stdout:1/544: rmdir d9/d10/d3f 39 2024-09-13T18:30:23.358 INFO:tasks.workunit.client.1.smithi149.stdout:7/558: link d7/d9/d11/d50/fbf d7/d76/db3/d6f/d9d/fc2 0 2024-09-13T18:30:23.358 INFO:tasks.workunit.client.1.smithi149.stdout:7/559: truncate d7/d9/d1b/f57 685541 0 2024-09-13T18:30:23.358 INFO:tasks.workunit.client.1.smithi149.stdout:7/560: chown d7/d9/d1b/fa5 793073331 1 2024-09-13T18:30:23.359 INFO:tasks.workunit.client.1.smithi149.stdout:2/473: dread db/d1b/d1c/d20/d49/f90 [0,4194304] 0 2024-09-13T18:30:23.362 INFO:tasks.workunit.client.1.smithi149.stdout:9/396: unlink d0/c3a 0 2024-09-13T18:30:23.362 INFO:tasks.workunit.client.1.smithi149.stdout:9/397: read - d0/f3c zero size 2024-09-13T18:30:23.362 INFO:tasks.workunit.client.1.smithi149.stdout:9/398: readlink d0/d2e/d42/l5f 0 2024-09-13T18:30:23.363 INFO:tasks.workunit.client.1.smithi149.stdout:6/623: creat dc/d2f/fc6 x:0 0 0 2024-09-13T18:30:23.365 INFO:tasks.workunit.client.1.smithi149.stdout:7/561: rmdir d7 39 2024-09-13T18:30:23.365 INFO:tasks.workunit.client.1.smithi149.stdout:7/562: write d7/d9/d1c/d51/d52/d86/fb5 [758296,28489] 0 2024-09-13T18:30:23.366 INFO:tasks.workunit.client.1.smithi149.stdout:2/474: symlink db/d13/d70/d89/la6 0 2024-09-13T18:30:23.368 INFO:tasks.workunit.client.1.smithi149.stdout:9/399: creat d0/d18/d19/f80 x:0 0 0 2024-09-13T18:30:23.369 INFO:tasks.workunit.client.1.smithi149.stdout:6/624: mkdir dc/d70/dc7 0 2024-09-13T18:30:23.376 INFO:tasks.workunit.client.1.smithi149.stdout:7/563: creat d7/d76/db3/fc3 x:0 0 0 2024-09-13T18:30:23.377 INFO:tasks.workunit.client.1.smithi149.stdout:2/475: rename db/d1b/d1c/d20/d2b/d3e/f46 to db/d13/d70/fa7 0 2024-09-13T18:30:23.378 INFO:tasks.workunit.client.1.smithi149.stdout:5/455: sync 2024-09-13T18:30:23.378 INFO:tasks.workunit.client.1.smithi149.stdout:5/456: chown d3/d8/d13/f46 521021846 1 2024-09-13T18:30:23.379 INFO:tasks.workunit.client.1.smithi149.stdout:8/464: dwrite d2/d12/f3f [0,4194304] 0 2024-09-13T18:30:23.379 INFO:tasks.workunit.client.1.smithi149.stdout:1/545: dwrite d9/d15/f29 [0,4194304] 0 2024-09-13T18:30:23.380 INFO:tasks.workunit.client.1.smithi149.stdout:4/523: dwrite df/da0/f61 [0,4194304] 0 2024-09-13T18:30:23.380 INFO:tasks.workunit.client.1.smithi149.stdout:6/625: creat dc/d2f/d75/da1/fc8 x:0 0 0 2024-09-13T18:30:23.381 INFO:tasks.workunit.client.1.smithi149.stdout:7/564: symlink d7/d9/d1c/d51/d52/lc4 0 2024-09-13T18:30:23.383 INFO:tasks.workunit.client.1.smithi149.stdout:2/476: symlink db/d1b/d1c/d20/d2b/la8 0 2024-09-13T18:30:23.386 INFO:tasks.workunit.client.1.smithi149.stdout:9/400: mkdir d0/d18/d81 0 2024-09-13T18:30:23.392 INFO:tasks.workunit.client.1.smithi149.stdout:8/465: mknod d2/d12/d1b/d66/c9b 0 2024-09-13T18:30:23.392 INFO:tasks.workunit.client.1.smithi149.stdout:4/524: truncate df/da0/d12/d21/d22/d30/d41/d57/f6a 2332016 0 2024-09-13T18:30:23.397 INFO:tasks.workunit.client.1.smithi149.stdout:7/565: symlink d7/d9/d1c/d1f/d21/d7b/d96/lc5 0 2024-09-13T18:30:23.399 INFO:tasks.workunit.client.1.smithi149.stdout:2/477: mkdir db/d10/da9 0 2024-09-13T18:30:23.399 INFO:tasks.workunit.client.1.smithi149.stdout:2/478: write db/d13/d70/d89/fa2 [135943,84119] 0 2024-09-13T18:30:23.399 INFO:tasks.workunit.client.1.smithi149.stdout:9/401: dread d0/d18/d19/f23 [0,4194304] 0 2024-09-13T18:30:23.400 INFO:tasks.workunit.client.1.smithi149.stdout:6/626: dwrite dc/d70/f97 [0,4194304] 0 2024-09-13T18:30:23.400 INFO:tasks.workunit.client.1.smithi149.stdout:5/457: rmdir d3/d8/d13 39 2024-09-13T18:30:23.405 INFO:tasks.workunit.client.1.smithi149.stdout:8/466: symlink d2/l9c 0 2024-09-13T18:30:23.409 INFO:tasks.workunit.client.1.smithi149.stdout:4/525: rename df/da0/d12/d21/d22/d30/d41/d57/d75/fa5 to df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fae 0 2024-09-13T18:30:23.409 INFO:tasks.workunit.client.1.smithi149.stdout:4/526: dread - df/da0/f95 zero size 2024-09-13T18:30:23.411 INFO:tasks.workunit.client.1.smithi149.stdout:7/566: truncate f3 1268297 0 2024-09-13T18:30:23.412 INFO:tasks.workunit.client.1.smithi149.stdout:2/479: truncate db/d1b/d1c/d20/d3a/f47 159072 0 2024-09-13T18:30:23.414 INFO:tasks.workunit.client.1.smithi149.stdout:9/402: mknod d0/d47/d61/c82 0 2024-09-13T18:30:23.414 INFO:tasks.workunit.client.1.smithi149.stdout:9/403: dread - d0/d2e/d42/d59/f7c zero size 2024-09-13T18:30:23.416 INFO:tasks.workunit.client.1.smithi149.stdout:6/627: dwrite dc/d15/d23/d57/d5c/f84 [0,4194304] 0 2024-09-13T18:30:23.416 INFO:tasks.workunit.client.1.smithi149.stdout:6/628: write dc/d15/d23/d57/da5/fa7 [139654,113905] 0 2024-09-13T18:30:23.416 INFO:tasks.workunit.client.1.smithi149.stdout:6/629: readlink dc/l6f 0 2024-09-13T18:30:23.418 INFO:tasks.workunit.client.1.smithi149.stdout:5/458: mknod d3/d10/d32/d67/d83/c8d 0 2024-09-13T18:30:23.418 INFO:tasks.workunit.client.1.smithi149.stdout:5/459: write d3/d10/d32/d54/f84 [124606,93470] 0 2024-09-13T18:30:23.420 INFO:tasks.workunit.client.1.smithi149.stdout:4/527: unlink df/da0/d12/d21/d22/d30/l3b 0 2024-09-13T18:30:23.423 INFO:tasks.workunit.client.1.smithi149.stdout:7/567: creat d7/d12/fc6 x:0 0 0 2024-09-13T18:30:23.423 INFO:tasks.workunit.client.1.smithi149.stdout:7/568: fdatasync d7/d9/f72 0 2024-09-13T18:30:23.423 INFO:tasks.workunit.client.1.smithi149.stdout:7/569: fsync d7/d12/f17 0 2024-09-13T18:30:23.423 INFO:tasks.workunit.client.1.smithi149.stdout:7/570: creat d7/d76/db3/d6f/fc7 x:0 0 0 2024-09-13T18:30:23.425 INFO:tasks.workunit.client.1.smithi149.stdout:2/480: mknod db/d1b/d1c/d20/d3a/caa 0 2024-09-13T18:30:23.425 INFO:tasks.workunit.client.1.smithi149.stdout:2/481: write db/f7a [411596,65631] 0 2024-09-13T18:30:23.427 INFO:tasks.workunit.client.1.smithi149.stdout:9/404: rmdir d0/d2e 39 2024-09-13T18:30:23.427 INFO:tasks.workunit.client.1.smithi149.stdout:9/405: readlink d0/d47/l4a 0 2024-09-13T18:30:23.434 INFO:tasks.workunit.client.1.smithi149.stdout:6/630: creat dc/d15/d23/d5f/fc9 x:0 0 0 2024-09-13T18:30:23.437 INFO:tasks.workunit.client.1.smithi149.stdout:5/460: dwrite d3/f20 [0,4194304] 0 2024-09-13T18:30:23.439 INFO:tasks.workunit.client.1.smithi149.stdout:4/528: creat df/da0/d12/d17/faf x:0 0 0 2024-09-13T18:30:23.443 INFO:tasks.workunit.client.1.smithi149.stdout:7/571: mknod d7/d76/db3/cc8 0 2024-09-13T18:30:23.443 INFO:tasks.workunit.client.1.smithi149.stdout:7/572: getdents d7 0 2024-09-13T18:30:23.447 INFO:tasks.workunit.client.1.smithi149.stdout:2/482: mkdir db/d1b/dab 0 2024-09-13T18:30:23.447 INFO:tasks.workunit.client.1.smithi149.stdout:2/483: chown db/f7a 2 1 2024-09-13T18:30:23.448 INFO:tasks.workunit.client.1.smithi149.stdout:9/406: creat d0/d47/f83 x:0 0 0 2024-09-13T18:30:23.451 INFO:tasks.workunit.client.1.smithi149.stdout:6/631: dwrite dc/d15/f9e [0,4194304] 0 2024-09-13T18:30:23.452 INFO:tasks.workunit.client.1.smithi149.stdout:6/632: truncate dc/d15/d23/d5f/dac/fb7 1538633 0 2024-09-13T18:30:23.455 INFO:tasks.workunit.client.1.smithi149.stdout:5/461: mknod d3/d10/d4c/d4e/d61/d75/c8e 0 2024-09-13T18:30:23.458 INFO:tasks.workunit.client.1.smithi149.stdout:7/573: mkdir d7/d9/d1c/d2c/d60/dc9 0 2024-09-13T18:30:23.458 INFO:tasks.workunit.client.1.smithi149.stdout:7/574: fsync d7/d76/db3/fad 0 2024-09-13T18:30:23.460 INFO:tasks.workunit.client.1.smithi149.stdout:2/484: truncate db/d10/d12/f80 5351370 0 2024-09-13T18:30:23.462 INFO:tasks.workunit.client.1.smithi149.stdout:5/462: symlink d3/d10/d4c/d4e/d61/l8f 0 2024-09-13T18:30:23.462 INFO:tasks.workunit.client.1.smithi149.stdout:5/463: truncate d3/d5e/f82 223521 0 2024-09-13T18:30:23.462 INFO:tasks.workunit.client.1.smithi149.stdout:9/407: dread d0/d18/d19/d3b/f3d [0,4194304] 0 2024-09-13T18:30:23.464 INFO:tasks.workunit.client.1.smithi149.stdout:7/575: symlink d7/d9/d1c/d1f/d21/d7b/lca 0 2024-09-13T18:30:23.464 INFO:tasks.workunit.client.1.smithi149.stdout:7/576: truncate d7/d9/d1c/d51/d52/d86/fb5 1316741 0 2024-09-13T18:30:23.466 INFO:tasks.workunit.client.1.smithi149.stdout:5/464: rename d3/d10/d4c/d4e/d61/l68 to d3/d10/d4c/l90 0 2024-09-13T18:30:23.470 INFO:tasks.workunit.client.1.smithi149.stdout:5/465: mkdir d3/d8/d6d/d91 0 2024-09-13T18:30:23.470 INFO:tasks.workunit.client.1.smithi149.stdout:4/529: dwrite df/da0/d12/d21/f8e [0,4194304] 0 2024-09-13T18:30:23.472 INFO:tasks.workunit.client.1.smithi149.stdout:9/408: dread d0/d47/d61/f6b [0,4194304] 0 2024-09-13T18:30:23.479 INFO:tasks.workunit.client.1.smithi149.stdout:5/466: truncate d3/d10/d32/f40 1979889 0 2024-09-13T18:30:23.479 INFO:tasks.workunit.client.1.smithi149.stdout:5/467: write d3/d10/d4c/d4e/f50 [1587496,80616] 0 2024-09-13T18:30:23.480 INFO:tasks.workunit.client.1.smithi149.stdout:4/530: creat df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3/fb0 x:0 0 0 2024-09-13T18:30:23.481 INFO:tasks.workunit.client.1.smithi149.stdout:9/409: mkdir d0/d2e/d42/d70/d84 0 2024-09-13T18:30:23.484 INFO:tasks.workunit.client.1.smithi149.stdout:7/577: dwrite d7/d9/f46 [4194304,4194304] 0 2024-09-13T18:30:23.487 INFO:tasks.workunit.client.1.smithi149.stdout:4/531: creat df/da0/d12/d21/d22/d30/d41/fb1 x:0 0 0 2024-09-13T18:30:23.489 INFO:tasks.workunit.client.1.smithi149.stdout:5/468: dread d3/d8/d13/f18 [0,4194304] 0 2024-09-13T18:30:23.489 INFO:tasks.workunit.client.1.smithi149.stdout:5/469: creat d3/d10/d32/f92 x:0 0 0 2024-09-13T18:30:23.491 INFO:tasks.workunit.client.1.smithi149.stdout:0/442: sync 2024-09-13T18:30:23.491 INFO:tasks.workunit.client.1.smithi149.stdout:0/443: chown d1/d29/d31/d3e/f73 530025790 1 2024-09-13T18:30:23.491 INFO:tasks.workunit.client.1.smithi149.stdout:0/444: read - d1/d29/d31/f88 zero size 2024-09-13T18:30:23.492 INFO:tasks.workunit.client.1.smithi149.stdout:4/532: creat df/da0/d12/d21/d22/d30/d56/d91/fb2 x:0 0 0 2024-09-13T18:30:23.492 INFO:tasks.workunit.client.1.smithi149.stdout:4/533: chown df/da0/d12/d21/d22/d30/d41/d57/d75 7645 1 2024-09-13T18:30:23.495 INFO:tasks.workunit.client.1.smithi149.stdout:7/578: rename d7/d9/d11/c4d to d7/d9/d1c/d1f/d21/d7b/d96/d9e/ccb 0 2024-09-13T18:30:23.497 INFO:tasks.workunit.client.1.smithi149.stdout:0/445: link d1/d1b/f67 d1/d2/d41/f94 0 2024-09-13T18:30:23.499 INFO:tasks.workunit.client.1.smithi149.stdout:4/534: creat df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fb3 x:0 0 0 2024-09-13T18:30:23.500 INFO:tasks.workunit.client.1.smithi149.stdout:7/579: mkdir d7/d9/d1c/d2c/dcc 0 2024-09-13T18:30:23.501 INFO:tasks.workunit.client.1.smithi149.stdout:0/446: mknod d1/d1b/c95 0 2024-09-13T18:30:23.502 INFO:tasks.workunit.client.1.smithi149.stdout:4/535: write df/da0/d12/d21/d22/f5e [2005496,39526] 0 2024-09-13T18:30:23.503 INFO:tasks.workunit.client.1.smithi149.stdout:7/580: truncate d7/f8 324688 0 2024-09-13T18:30:23.504 INFO:tasks.workunit.client.1.smithi149.stdout:0/447: dread d1/f42 [0,4194304] 0 2024-09-13T18:30:23.506 INFO:tasks.workunit.client.1.smithi149.stdout:4/536: symlink df/da0/d1c/d69/lb4 0 2024-09-13T18:30:23.507 INFO:tasks.workunit.client.1.smithi149.stdout:7/581: rmdir d7/d9 39 2024-09-13T18:30:23.507 INFO:tasks.workunit.client.1.smithi149.stdout:7/582: write d7/d9/d1c/d1f/d21/fb8 [773122,125903] 0 2024-09-13T18:30:23.509 INFO:tasks.workunit.client.1.smithi149.stdout:0/448: link d1/l2d d1/d29/d31/d44/d81/l96 0 2024-09-13T18:30:23.511 INFO:tasks.workunit.client.1.smithi149.stdout:4/537: rmdir df 39 2024-09-13T18:30:23.513 INFO:tasks.workunit.client.1.smithi149.stdout:7/583: mkdir d7/d9/d1c/d1f/dcd 0 2024-09-13T18:30:23.513 INFO:tasks.workunit.client.1.smithi149.stdout:7/584: write d7/f6b [666810,7561] 0 2024-09-13T18:30:23.516 INFO:tasks.workunit.client.1.smithi149.stdout:0/449: rename d1/d2/f12 to d1/d29/d31/d44/d81/f97 0 2024-09-13T18:30:23.517 INFO:tasks.workunit.client.1.smithi149.stdout:0/450: chown d1/f5 219040 1 2024-09-13T18:30:23.519 INFO:tasks.workunit.client.1.smithi149.stdout:4/538: mkdir df/da0/d70/db5 0 2024-09-13T18:30:23.519 INFO:tasks.workunit.client.1.smithi149.stdout:4/539: write df/da0/f80 [1594564,112290] 0 2024-09-13T18:30:23.519 INFO:tasks.workunit.client.1.smithi149.stdout:4/540: chown df/da0/d1c 15197 1 2024-09-13T18:30:23.521 INFO:tasks.workunit.client.1.smithi149.stdout:7/585: getdents d7/d9/d1c/d51 0 2024-09-13T18:30:23.521 INFO:tasks.workunit.client.1.smithi149.stdout:7/586: chown d7/d76/db3/d6f/l35 13296 1 2024-09-13T18:30:23.521 INFO:tasks.workunit.client.1.smithi149.stdout:7/587: chown d7/d76/c82 96349 1 2024-09-13T18:30:23.532 INFO:tasks.workunit.client.1.smithi149.stdout:0/451: dwrite d1/d2/d8a/d90/f82 [0,4194304] 0 2024-09-13T18:30:23.532 INFO:tasks.workunit.client.1.smithi149.stdout:4/541: creat df/da0/d12/d21/d22/d30/d41/d57/d60/fb6 x:0 0 0 2024-09-13T18:30:23.534 INFO:tasks.workunit.client.1.smithi149.stdout:4/542: dread df/da0/d1c/f32 [0,4194304] 0 2024-09-13T18:30:23.534 INFO:tasks.workunit.client.1.smithi149.stdout:7/588: link d7/d9/d1c/d34/d4e/l69 d7/d9/d1c/d34/d4e/lce 0 2024-09-13T18:30:23.539 INFO:tasks.workunit.client.1.smithi149.stdout:0/452: rmdir d1/d2/d8a/d90 39 2024-09-13T18:30:23.539 INFO:tasks.workunit.client.1.smithi149.stdout:0/453: chown d1/l74 128809629 1 2024-09-13T18:30:23.542 INFO:tasks.workunit.client.1.smithi149.stdout:0/454: mkdir d1/d2/d41/d46/d7b/d98 0 2024-09-13T18:30:23.544 INFO:tasks.workunit.client.1.smithi149.stdout:4/543: dread df/da0/f61 [0,4194304] 0 2024-09-13T18:30:23.544 INFO:tasks.workunit.client.1.smithi149.stdout:4/544: write df/f20 [4959500,116272] 0 2024-09-13T18:30:23.544 INFO:tasks.workunit.client.1.smithi149.stdout:4/545: chown df/da0/d1c/l1e 0 1 2024-09-13T18:30:23.545 INFO:tasks.workunit.client.1.smithi149.stdout:0/455: creat d1/d29/d31/d44/f99 x:0 0 0 2024-09-13T18:30:23.545 INFO:tasks.workunit.client.1.smithi149.stdout:0/456: stat d1/d48/f6d 0 2024-09-13T18:30:23.549 INFO:tasks.workunit.client.1.smithi149.stdout:4/546: creat df/da0/d12/d21/d22/d30/fb7 x:0 0 0 2024-09-13T18:30:23.551 INFO:tasks.workunit.client.1.smithi149.stdout:0/457: symlink d1/d29/d31/d3e/d54/l9a 0 2024-09-13T18:30:23.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/458: chown d1/d2/d41/f94 440415 1 2024-09-13T18:30:23.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/459: creat d1/d2/d8a/f9b x:0 0 0 2024-09-13T18:30:23.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/460: chown d1/d29/d31/d83/d87 16365421 1 2024-09-13T18:30:23.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/461: chown d1/d1b/f40 88369937 1 2024-09-13T18:30:23.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/462: dread d1/d29/d31/f35 [0,4194304] 0 2024-09-13T18:30:23.553 INFO:tasks.workunit.client.1.smithi149.stdout:4/547: symlink df/lb8 0 2024-09-13T18:30:23.553 INFO:tasks.workunit.client.1.smithi149.stdout:4/548: dread - df/da0/d12/d21/d22/d30/d41/fb1 zero size 2024-09-13T18:30:23.554 INFO:tasks.workunit.client.1.smithi149.stdout:3/503: sync 2024-09-13T18:30:23.554 INFO:tasks.workunit.client.1.smithi149.stdout:3/504: fdatasync d1/d12/d20/d54/d6d/f72 0 2024-09-13T18:30:23.555 INFO:tasks.workunit.client.1.smithi149.stdout:7/589: dwrite d7/d76/fb7 [4194304,4194304] 0 2024-09-13T18:30:23.564 INFO:tasks.workunit.client.1.smithi149.stdout:0/463: dread d1/d29/d31/d3e/d54/f6b [0,4194304] 0 2024-09-13T18:30:23.567 INFO:tasks.workunit.client.1.smithi149.stdout:0/464: getdents d1/d48 0 2024-09-13T18:30:23.568 INFO:tasks.workunit.client.1.smithi149.stdout:0/465: truncate d1/d29/d31/d44/d47/f8e 250903 0 2024-09-13T18:30:23.568 INFO:tasks.workunit.client.1.smithi149.stdout:0/466: chown d1/d29/d31/l86 468529002 1 2024-09-13T18:30:23.568 INFO:tasks.workunit.client.1.smithi149.stdout:4/549: dread df/f20 [0,4194304] 0 2024-09-13T18:30:23.570 INFO:tasks.workunit.client.1.smithi149.stdout:0/467: unlink d1/d2/f61 0 2024-09-13T18:30:23.570 INFO:tasks.workunit.client.1.smithi149.stdout:7/590: write d7/d12/f17 [4049826,64578] 0 2024-09-13T18:30:23.572 INFO:tasks.workunit.client.1.smithi149.stdout:4/550: mkdir df/da0/d70/db5/db9 0 2024-09-13T18:30:23.573 INFO:tasks.workunit.client.1.smithi149.stdout:0/468: symlink d1/d2/d41/d46/d7b/l9c 0 2024-09-13T18:30:23.573 INFO:tasks.workunit.client.1.smithi149.stdout:0/469: creat d1/d29/d31/d44/f9d x:0 0 0 2024-09-13T18:30:23.576 INFO:tasks.workunit.client.1.smithi149.stdout:7/591: symlink d7/d76/db3/lcf 0 2024-09-13T18:30:23.576 INFO:tasks.workunit.client.1.smithi149.stdout:7/592: fsync d7/d9/d1c/d51/f61 0 2024-09-13T18:30:23.576 INFO:tasks.workunit.client.1.smithi149.stdout:7/593: fdatasync d7/f6b 0 2024-09-13T18:30:23.577 INFO:tasks.workunit.client.1.smithi149.stdout:4/551: symlink df/da0/d12/d21/d22/d30/d41/d57/d75/da1/lba 0 2024-09-13T18:30:23.578 INFO:tasks.workunit.client.1.smithi149.stdout:3/505: dwrite d1/d2e/f14 [0,4194304] 0 2024-09-13T18:30:23.578 INFO:tasks.workunit.client.1.smithi149.stdout:3/506: creat d1/d2c/d38/fa9 x:0 0 0 2024-09-13T18:30:23.580 INFO:tasks.workunit.client.1.smithi149.stdout:0/470: creat d1/d2/f9e x:0 0 0 2024-09-13T18:30:23.584 INFO:tasks.workunit.client.1.smithi149.stdout:7/594: write d7/d9/d1c/d1f/d21/f83 [3377946,106837] 0 2024-09-13T18:30:23.589 INFO:tasks.workunit.client.1.smithi149.stdout:3/507: stat d1/d47/d30/c33 0 2024-09-13T18:30:23.590 INFO:tasks.workunit.client.1.smithi149.stdout:0/471: mkdir d1/d29/d31/d44/d81/d9f 0 2024-09-13T18:30:23.592 INFO:tasks.workunit.client.1.smithi149.stdout:1/546: sync 2024-09-13T18:30:23.592 INFO:tasks.workunit.client.1.smithi149.stdout:8/467: sync 2024-09-13T18:30:23.593 INFO:tasks.workunit.client.1.smithi149.stdout:8/468: stat d2/d5b/d86 0 2024-09-13T18:30:23.593 INFO:tasks.workunit.client.1.smithi149.stdout:8/469: creat d2/d12/f9d x:0 0 0 2024-09-13T18:30:23.593 INFO:tasks.workunit.client.1.smithi149.stdout:8/470: truncate d2/d13/f81 580364 0 2024-09-13T18:30:23.593 INFO:tasks.workunit.client.1.smithi149.stdout:4/552: rename df/da0/l6f to df/da0/d12/d21/d22/d30/d41/d57/d60/lbb 0 2024-09-13T18:30:23.593 INFO:tasks.workunit.client.1.smithi149.stdout:3/508: mkdir d1/d2e/d1d/d6c/daa 0 2024-09-13T18:30:23.595 INFO:tasks.workunit.client.1.smithi149.stdout:0/472: symlink d1/d29/d31/d44/d47/la0 0 2024-09-13T18:30:23.595 INFO:tasks.workunit.client.1.smithi149.stdout:0/473: write d1/d2/f66 [98597,6531] 0 2024-09-13T18:30:23.595 INFO:tasks.workunit.client.1.smithi149.stdout:0/474: truncate d1/d2/d8a/f93 10832 0 2024-09-13T18:30:23.596 INFO:tasks.workunit.client.1.smithi149.stdout:1/547: mknod d9/d15/d60/d80/cac 0 2024-09-13T18:30:23.599 INFO:tasks.workunit.client.1.smithi149.stdout:8/471: rename d2/d13/f17 to d2/d12/d87/f9e 0 2024-09-13T18:30:23.600 INFO:tasks.workunit.client.1.smithi149.stdout:4/553: mknod df/da0/d70/db5/cbc 0 2024-09-13T18:30:23.602 INFO:tasks.workunit.client.1.smithi149.stdout:3/509: mknod d1/d2e/d1d/cab 0 2024-09-13T18:30:23.603 INFO:tasks.workunit.client.1.smithi149.stdout:0/475: symlink d1/d29/d31/d44/la1 0 2024-09-13T18:30:23.604 INFO:tasks.workunit.client.1.smithi149.stdout:1/548: mkdir d9/d10/d3f/d76/dad 0 2024-09-13T18:30:23.607 INFO:tasks.workunit.client.1.smithi149.stdout:7/595: dwrite d7/d76/fb7 [4194304,4194304] 0 2024-09-13T18:30:23.607 INFO:tasks.workunit.client.1.smithi149.stdout:8/472: creat d2/d5b/d86/f9f x:0 0 0 2024-09-13T18:30:23.608 INFO:tasks.workunit.client.1.smithi149.stdout:1/549: dread d9/d10/d83/d97/f91 [4194304,4194304] 0 2024-09-13T18:30:23.610 INFO:tasks.workunit.client.1.smithi149.stdout:3/510: creat d1/d2c/d8b/fac x:0 0 0 2024-09-13T18:30:23.614 INFO:tasks.workunit.client.1.smithi149.stdout:0/476: rename d1/d29/d31/d3e/d54/f6b to d1/d48/fa2 0 2024-09-13T18:30:23.614 INFO:tasks.workunit.client.1.smithi149.stdout:0/477: write d1/d2/d8a/f93 [305870,99883] 0 2024-09-13T18:30:23.616 INFO:tasks.workunit.client.1.smithi149.stdout:8/473: creat d2/d12/d1b/d58/d97/fa0 x:0 0 0 2024-09-13T18:30:23.618 INFO:tasks.workunit.client.1.smithi149.stdout:4/554: dwrite df/da0/d1c/f67 [0,4194304] 0 2024-09-13T18:30:23.618 INFO:tasks.workunit.client.1.smithi149.stdout:3/511: mkdir d1/d2e/d1d/d6c/daa/dad 0 2024-09-13T18:30:23.618 INFO:tasks.workunit.client.1.smithi149.stdout:6/633: sync 2024-09-13T18:30:23.618 INFO:tasks.workunit.client.1.smithi149.stdout:6/634: write dc/d15/d23/f4c [5936459,91614] 0 2024-09-13T18:30:23.620 INFO:tasks.workunit.client.1.smithi149.stdout:0/478: creat d1/d2/d41/d46/d7b/d98/fa3 x:0 0 0 2024-09-13T18:30:23.620 INFO:tasks.workunit.client.1.smithi149.stdout:0/479: stat d1/d29/d31/d44/f9d 0 2024-09-13T18:30:23.622 INFO:tasks.workunit.client.1.smithi149.stdout:8/474: rename d2/d5b/d86/l9a to d2/d12/d87/la1 0 2024-09-13T18:30:23.626 INFO:tasks.workunit.client.1.smithi149.stdout:4/555: rmdir df/da0/d12/d21/d22/d30/d41/d57/d8a 39 2024-09-13T18:30:23.626 INFO:tasks.workunit.client.1.smithi149.stdout:4/556: chown df/da0/d12/d21/d22/f7b 22 1 2024-09-13T18:30:23.626 INFO:tasks.workunit.client.1.smithi149.stdout:4/557: fsync df/da0/d12/d21/d22/d30/d56/d91/fb2 0 2024-09-13T18:30:23.628 INFO:tasks.workunit.client.1.smithi149.stdout:3/512: dread d1/f19 [0,4194304] 0 2024-09-13T18:30:23.628 INFO:tasks.workunit.client.1.smithi149.stdout:6/635: truncate dc/d70/dbc/f6e 719687 0 2024-09-13T18:30:23.628 INFO:tasks.workunit.client.1.smithi149.stdout:3/513: stat d1/d12/f77 0 2024-09-13T18:30:23.629 INFO:tasks.workunit.client.1.smithi149.stdout:3/514: write d1/d12/f1a [1433703,1315] 0 2024-09-13T18:30:23.629 INFO:tasks.workunit.client.1.smithi149.stdout:3/515: write d1/d47/f92 [891158,110356] 0 2024-09-13T18:30:23.634 INFO:tasks.workunit.client.1.smithi149.stdout:1/550: dwrite d9/d10/d34/f51 [0,4194304] 0 2024-09-13T18:30:23.634 INFO:tasks.workunit.client.1.smithi149.stdout:1/551: chown l6 879510635 1 2024-09-13T18:30:23.635 INFO:tasks.workunit.client.1.smithi149.stdout:1/552: dread - d9/d15/d60/d80/d8b/d42/fa7 zero size 2024-09-13T18:30:23.638 INFO:tasks.workunit.client.1.smithi149.stdout:1/553: read d9/d58/f93 [431380,88411] 0 2024-09-13T18:30:23.640 INFO:tasks.workunit.client.1.smithi149.stdout:6/636: creat dc/d15/d23/d5b/d91/db0/fca x:0 0 0 2024-09-13T18:30:23.640 INFO:tasks.workunit.client.1.smithi149.stdout:6/637: write dc/d8c/fc2 [143940,27908] 0 2024-09-13T18:30:23.644 INFO:tasks.workunit.client.1.smithi149.stdout:6/638: mkdir dc/d2f/d75/da1/dcb 0 2024-09-13T18:30:23.649 INFO:tasks.workunit.client.1.smithi149.stdout:6/639: mkdir dc/d15/d54/d85/dcc 0 2024-09-13T18:30:23.652 INFO:tasks.workunit.client.1.smithi149.stdout:6/640: mkdir dc/d15/d23/dcd 0 2024-09-13T18:30:23.659 INFO:tasks.workunit.client.1.smithi149.stdout:9/410: sync 2024-09-13T18:30:23.659 INFO:tasks.workunit.client.1.smithi149.stdout:5/470: sync 2024-09-13T18:30:23.659 INFO:tasks.workunit.client.1.smithi149.stdout:2/485: sync 2024-09-13T18:30:23.659 INFO:tasks.workunit.client.1.smithi149.stdout:2/486: dread - db/f9a zero size 2024-09-13T18:30:23.660 INFO:tasks.workunit.client.1.smithi149.stdout:5/471: mknod d3/d10/d4c/c93 0 2024-09-13T18:30:23.660 INFO:tasks.workunit.client.1.smithi149.stdout:5/472: chown d3/d8/lb 0 1 2024-09-13T18:30:23.662 INFO:tasks.workunit.client.1.smithi149.stdout:2/487: dread db/d10/f72 [0,4194304] 0 2024-09-13T18:30:23.663 INFO:tasks.workunit.client.1.smithi149.stdout:7/596: dwrite d7/f84 [0,4194304] 0 2024-09-13T18:30:23.663 INFO:tasks.workunit.client.1.smithi149.stdout:7/597: fdatasync d7/d9/f46 0 2024-09-13T18:30:23.666 INFO:tasks.workunit.client.1.smithi149.stdout:7/598: write d7/d12/f17 [4307060,7032] 0 2024-09-13T18:30:23.666 INFO:tasks.workunit.client.1.smithi149.stdout:7/599: readlink d7/d9/d1c/d1f/d47/lb1 0 2024-09-13T18:30:23.666 INFO:tasks.workunit.client.1.smithi149.stdout:7/600: fsync d7/d76/fb7 0 2024-09-13T18:30:23.667 INFO:tasks.workunit.client.1.smithi149.stdout:2/488: symlink db/d10/lac 0 2024-09-13T18:30:23.668 INFO:tasks.workunit.client.1.smithi149.stdout:3/516: dwrite d1/d2e/d1d/f6b [0,4194304] 0 2024-09-13T18:30:23.668 INFO:tasks.workunit.client.1.smithi149.stdout:3/517: write d1/d2e/d1d/f23 [2632394,111640] 0 2024-09-13T18:30:23.668 INFO:tasks.workunit.client.1.smithi149.stdout:3/518: fsync d1/d2e/f17 0 2024-09-13T18:30:23.668 INFO:tasks.workunit.client.1.smithi149.stdout:3/519: readlink d1/d2c/d38/l3b 0 2024-09-13T18:30:23.670 INFO:tasks.workunit.client.1.smithi149.stdout:2/489: mkdir db/d13/d70/dad 0 2024-09-13T18:30:23.673 INFO:tasks.workunit.client.1.smithi149.stdout:8/475: dwrite d2/d13/d3a/d7f/f82 [0,4194304] 0 2024-09-13T18:30:23.675 INFO:tasks.workunit.client.1.smithi149.stdout:3/520: unlink d1/f19 0 2024-09-13T18:30:23.678 INFO:tasks.workunit.client.1.smithi149.stdout:2/490: creat db/d1b/d1c/d20/d2b/d3e/d95/fae x:0 0 0 2024-09-13T18:30:23.680 INFO:tasks.workunit.client.1.smithi149.stdout:2/491: dread db/d1b/d2f/d69/f5c [0,4194304] 0 2024-09-13T18:30:23.680 INFO:tasks.workunit.client.1.smithi149.stdout:2/492: dread - db/d13/f79 zero size 2024-09-13T18:30:23.680 INFO:tasks.workunit.client.1.smithi149.stdout:0/480: dwrite d1/d29/d31/d44/d81/f75 [0,4194304] 0 2024-09-13T18:30:23.688 INFO:tasks.workunit.client.1.smithi149.stdout:0/481: dread d1/f21 [0,4194304] 0 2024-09-13T18:30:23.688 INFO:tasks.workunit.client.1.smithi149.stdout:3/521: link d1/d2c/d42/l7e d1/d2c/d38/d88/lae 0 2024-09-13T18:30:23.692 INFO:tasks.workunit.client.1.smithi149.stdout:2/493: mkdir db/d10/d8d/daf 0 2024-09-13T18:30:23.693 INFO:tasks.workunit.client.1.smithi149.stdout:8/476: rmdir d2/d52 39 2024-09-13T18:30:23.696 INFO:tasks.workunit.client.1.smithi149.stdout:2/494: unlink db/d1b/d2f/d30/c66 0 2024-09-13T18:30:23.698 INFO:tasks.workunit.client.1.smithi149.stdout:8/477: creat d2/d5b/d88/fa2 x:0 0 0 2024-09-13T18:30:23.698 INFO:tasks.workunit.client.1.smithi149.stdout:8/478: chown d2/f34 3144 1 2024-09-13T18:30:23.699 INFO:tasks.workunit.client.1.smithi149.stdout:0/482: getdents d1/d29 0 2024-09-13T18:30:23.699 INFO:tasks.workunit.client.1.smithi149.stdout:0/483: fdatasync d1/d2/d8a/f9b 0 2024-09-13T18:30:23.701 INFO:tasks.workunit.client.1.smithi149.stdout:2/495: creat db/d10/da9/fb0 x:0 0 0 2024-09-13T18:30:23.701 INFO:tasks.workunit.client.1.smithi149.stdout:3/522: dread d1/f85 [0,4194304] 0 2024-09-13T18:30:23.703 INFO:tasks.workunit.client.1.smithi149.stdout:0/484: stat d1/d29/d31/f39 0 2024-09-13T18:30:23.705 INFO:tasks.workunit.client.1.smithi149.stdout:6/641: dwrite dc/d15/d23/f4c [4194304,4194304] 0 2024-09-13T18:30:23.705 INFO:tasks.workunit.client.1.smithi149.stdout:6/642: write dc/d15/d23/fb6 [229827,93100] 0 2024-09-13T18:30:23.705 INFO:tasks.workunit.client.1.smithi149.stdout:2/496: link db/d10/d12/c19 db/d13/cb1 0 2024-09-13T18:30:23.706 INFO:tasks.workunit.client.1.smithi149.stdout:2/497: truncate db/d1b/d1c/d20/d2b/f57 4996560 0 2024-09-13T18:30:23.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/601: dwrite d7/d9/d1c/d51/f61 [0,4194304] 0 2024-09-13T18:30:23.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/602: read d7/d9/d1b/f36 [830997,59980] 0 2024-09-13T18:30:23.706 INFO:tasks.workunit.client.1.smithi149.stdout:7/603: getdents d7/d9/d1c/d51 0 2024-09-13T18:30:23.706 INFO:tasks.workunit.client.1.smithi149.stdout:9/411: dwrite d0/d2e/d42/f63 [0,4194304] 0 2024-09-13T18:30:23.706 INFO:tasks.workunit.client.1.smithi149.stdout:3/523: mkdir d1/d2e/d6f/daf 0 2024-09-13T18:30:23.707 INFO:tasks.workunit.client.1.smithi149.stdout:7/604: dread d7/d9/d1b/f57 [0,4194304] 0 2024-09-13T18:30:23.707 INFO:tasks.workunit.client.1.smithi149.stdout:7/605: chown d7/d9/d1c/d1f/d3d/fa7 49775 1 2024-09-13T18:30:23.707 INFO:tasks.workunit.client.1.smithi149.stdout:7/606: fsync d7/d9/d1b/f57 0 2024-09-13T18:30:23.711 INFO:tasks.workunit.client.1.smithi149.stdout:0/485: unlink d1/d29/d31/f35 0 2024-09-13T18:30:23.713 INFO:tasks.workunit.client.1.smithi149.stdout:6/643: creat dc/d2f/fce x:0 0 0 2024-09-13T18:30:23.713 INFO:tasks.workunit.client.1.smithi149.stdout:6/644: write dc/d2f/fc6 [393956,108413] 0 2024-09-13T18:30:23.717 INFO:tasks.workunit.client.1.smithi149.stdout:3/524: dread d1/d2e/d1d/f23 [0,4194304] 0 2024-09-13T18:30:23.724 INFO:tasks.workunit.client.1.smithi149.stdout:9/412: creat d0/d18/d27/d5c/d7e/f85 x:0 0 0 2024-09-13T18:30:23.724 INFO:tasks.workunit.client.1.smithi149.stdout:9/413: readlink d0/d18/d27/l5a 0 2024-09-13T18:30:23.726 INFO:tasks.workunit.client.1.smithi149.stdout:6/645: creat dc/d2f/fcf x:0 0 0 2024-09-13T18:30:23.726 INFO:tasks.workunit.client.1.smithi149.stdout:6/646: write dc/d15/d54/da9/fc0 [125634,57464] 0 2024-09-13T18:30:23.731 INFO:tasks.workunit.client.1.smithi149.stdout:7/607: dwrite d7/d9/f72 [0,4194304] 0 2024-09-13T18:30:23.733 INFO:tasks.workunit.client.1.smithi149.stdout:0/486: dwrite d1/d29/d31/f88 [0,4194304] 0 2024-09-13T18:30:23.733 INFO:tasks.workunit.client.1.smithi149.stdout:5/473: rmdir d3/d10/d4c 39 2024-09-13T18:30:23.736 INFO:tasks.workunit.client.1.smithi149.stdout:9/414: dread d0/d2e/d42/f5e [0,4194304] 0 2024-09-13T18:30:23.736 INFO:tasks.workunit.client.1.smithi149.stdout:9/415: dread - d0/d2e/d42/d59/f69 zero size 2024-09-13T18:30:23.736 INFO:tasks.workunit.client.1.smithi149.stdout:9/416: write d0/d18/d19/d3b/f53 [260498,103567] 0 2024-09-13T18:30:23.737 INFO:tasks.workunit.client.1.smithi149.stdout:3/525: mknod d1/d2e/d1d/cb0 0 2024-09-13T18:30:23.740 INFO:tasks.workunit.client.1.smithi149.stdout:6/647: truncate dc/d2f/f6c 1752347 0 2024-09-13T18:30:23.740 INFO:tasks.workunit.client.1.smithi149.stdout:6/648: creat dc/d15/d23/d57/da5/fd0 x:0 0 0 2024-09-13T18:30:23.740 INFO:tasks.workunit.client.1.smithi149.stdout:6/649: dread - dc/d15/d23/d57/da5/fd0 zero size 2024-09-13T18:30:23.747 INFO:tasks.workunit.client.1.smithi149.stdout:0/487: symlink d1/d29/d31/d3e/la4 0 2024-09-13T18:30:23.749 INFO:tasks.workunit.client.1.smithi149.stdout:5/474: unlink d3/d8/l56 0 2024-09-13T18:30:23.751 INFO:tasks.workunit.client.1.smithi149.stdout:6/650: mkdir dc/d2f/d75/da1/dd1 0 2024-09-13T18:30:23.752 INFO:tasks.workunit.client.1.smithi149.stdout:6/651: chown dc/d70/dbc/c69 0 1 2024-09-13T18:30:23.757 INFO:tasks.workunit.client.1.smithi149.stdout:0/488: creat d1/d2/d8a/d90/fa5 x:0 0 0 2024-09-13T18:30:23.757 INFO:tasks.workunit.client.1.smithi149.stdout:0/489: truncate d1/d2/d41/f4d 53669 0 2024-09-13T18:30:23.759 INFO:tasks.workunit.client.1.smithi149.stdout:5/475: rename d3/d10/d4c/d4e/d61/l73 to d3/d10/d32/d54/d76/l94 0 2024-09-13T18:30:23.760 INFO:tasks.workunit.client.1.smithi149.stdout:0/490: symlink d1/d2/d41/d46/la6 0 2024-09-13T18:30:23.760 INFO:tasks.workunit.client.1.smithi149.stdout:0/491: getdents d1/d2/d4e 0 2024-09-13T18:30:23.762 INFO:tasks.workunit.client.1.smithi149.stdout:5/476: link d3/d10/d32/f45 d3/f95 0 2024-09-13T18:30:23.762 INFO:tasks.workunit.client.1.smithi149.stdout:5/477: stat d3/d10 0 2024-09-13T18:30:23.762 INFO:tasks.workunit.client.1.smithi149.stdout:7/608: dwrite d7/d9/f46 [4194304,4194304] 0 2024-09-13T18:30:23.763 INFO:tasks.workunit.client.1.smithi149.stdout:0/492: symlink d1/d48/d92/la7 0 2024-09-13T18:30:23.763 INFO:tasks.workunit.client.1.smithi149.stdout:0/493: chown d1/d2/l17 852273468 1 2024-09-13T18:30:23.764 INFO:tasks.workunit.client.1.smithi149.stdout:7/609: mknod d7/d9/d1c/d2c/cd0 0 2024-09-13T18:30:23.766 INFO:tasks.workunit.client.1.smithi149.stdout:7/610: mknod d7/d9/d1c/d2c/d60/cd1 0 2024-09-13T18:30:23.769 INFO:tasks.workunit.client.1.smithi149.stdout:9/417: dwrite d0/d2e/f43 [0,4194304] 0 2024-09-13T18:30:23.774 INFO:tasks.workunit.client.1.smithi149.stdout:6/652: dread dc/d76/f7b [0,4194304] 0 2024-09-13T18:30:23.779 INFO:tasks.workunit.client.1.smithi149.stdout:6/653: rmdir dc/d15/d23/d5b 39 2024-09-13T18:30:23.785 INFO:tasks.workunit.client.1.smithi149.stdout:8/479: rmdir d2/d5b/d88 39 2024-09-13T18:30:23.787 INFO:tasks.workunit.client.1.smithi149.stdout:7/611: read d7/d9/d11/d50/fbf [381808,100506] 0 2024-09-13T18:30:23.791 INFO:tasks.workunit.client.1.smithi149.stdout:7/612: mkdir d7/d9/d1c/d51/dd2 0 2024-09-13T18:30:23.792 INFO:tasks.workunit.client.1.smithi149.stdout:2/498: rmdir db/d10 39 2024-09-13T18:30:23.794 INFO:tasks.workunit.client.1.smithi149.stdout:6/654: dread dc/d15/d23/f31 [0,4194304] 0 2024-09-13T18:30:23.796 INFO:tasks.workunit.client.1.smithi149.stdout:7/613: truncate d7/d9/fa 1176991 0 2024-09-13T18:30:23.797 INFO:tasks.workunit.client.1.smithi149.stdout:2/499: unlink db/d10/d12/c19 0 2024-09-13T18:30:23.799 INFO:tasks.workunit.client.1.smithi149.stdout:6/655: unlink dc/d15/f55 0 2024-09-13T18:30:23.800 INFO:tasks.workunit.client.1.smithi149.stdout:5/478: dwrite d3/f3d [0,4194304] 0 2024-09-13T18:30:23.800 INFO:tasks.workunit.client.1.smithi149.stdout:5/479: chown d3/d10/d32 27451 1 2024-09-13T18:30:23.800 INFO:tasks.workunit.client.1.smithi149.stdout:5/480: write d3/d10/d32/f92 [832347,92894] 0 2024-09-13T18:30:23.800 INFO:tasks.workunit.client.1.smithi149.stdout:5/481: chown d3/d10/f5d 16782182 1 2024-09-13T18:30:23.801 INFO:tasks.workunit.client.1.smithi149.stdout:0/494: dwrite d1/d29/d31/d44/d81/f97 [4194304,4194304] 0 2024-09-13T18:30:23.803 INFO:tasks.workunit.client.1.smithi149.stdout:9/418: dwrite d0/f9 [0,4194304] 0 2024-09-13T18:30:23.803 INFO:tasks.workunit.client.1.smithi149.stdout:6/656: dread dc/d15/d23/d5b/f52 [0,4194304] 0 2024-09-13T18:30:23.811 INFO:tasks.workunit.client.1.smithi149.stdout:4/558: sync 2024-09-13T18:30:23.811 INFO:tasks.workunit.client.1.smithi149.stdout:1/554: sync 2024-09-13T18:30:23.814 INFO:tasks.workunit.client.1.smithi149.stdout:0/495: rename d1/c71 to d1/d2/d41/d46/ca8 0 2024-09-13T18:30:23.817 INFO:tasks.workunit.client.1.smithi149.stdout:6/657: creat dc/d70/dc7/fd2 x:0 0 0 2024-09-13T18:30:23.819 INFO:tasks.workunit.client.1.smithi149.stdout:1/555: symlink d9/d10/d34/d53/d57/d6c/da2/lae 0 2024-09-13T18:30:23.825 INFO:tasks.workunit.client.1.smithi149.stdout:8/480: dwrite d2/d12/d2a/d4d/f78 [0,4194304] 0 2024-09-13T18:30:23.825 INFO:tasks.workunit.client.1.smithi149.stdout:2/500: dread db/d1b/d1c/f3c [0,4194304] 0 2024-09-13T18:30:23.825 INFO:tasks.workunit.client.1.smithi149.stdout:7/614: dwrite d7/d9/d1c/d34/f5d [0,4194304] 0 2024-09-13T18:30:23.825 INFO:tasks.workunit.client.1.smithi149.stdout:7/615: chown d7/d9/d1c/d2c 138388110 1 2024-09-13T18:30:23.826 INFO:tasks.workunit.client.1.smithi149.stdout:0/496: rmdir d1/d48/d92 39 2024-09-13T18:30:23.826 INFO:tasks.workunit.client.1.smithi149.stdout:0/497: stat d1/d48/fa2 0 2024-09-13T18:30:23.826 INFO:tasks.workunit.client.1.smithi149.stdout:0/498: chown d1/f42 28490847 1 2024-09-13T18:30:23.826 INFO:tasks.workunit.client.1.smithi149.stdout:0/499: fdatasync d1/f27 0 2024-09-13T18:30:23.828 INFO:tasks.workunit.client.1.smithi149.stdout:6/658: rename dc/l6f to dc/d15/d23/d5f/dac/ld3 0 2024-09-13T18:30:23.830 INFO:tasks.workunit.client.1.smithi149.stdout:1/556: creat d9/d15/d60/da5/faf x:0 0 0 2024-09-13T18:30:23.830 INFO:tasks.workunit.client.1.smithi149.stdout:1/557: chown d9/d10/d34/d53/d57/d6c/da2/lae 21364 1 2024-09-13T18:30:23.830 INFO:tasks.workunit.client.1.smithi149.stdout:1/558: dread - d9/d10/d34/d3c/f85 zero size 2024-09-13T18:30:23.831 INFO:tasks.workunit.client.1.smithi149.stdout:4/559: write df/f20 [3379060,13869] 0 2024-09-13T18:30:23.835 INFO:tasks.workunit.client.1.smithi149.stdout:2/501: mkdir db/d1b/d2f/db2 0 2024-09-13T18:30:23.837 INFO:tasks.workunit.client.1.smithi149.stdout:7/616: mknod d7/d9/d1c/d1f/dcd/cd3 0 2024-09-13T18:30:23.837 INFO:tasks.workunit.client.1.smithi149.stdout:7/617: readlink d7/d9/d1c/d34/d4e/l63 0 2024-09-13T18:30:23.837 INFO:tasks.workunit.client.1.smithi149.stdout:7/618: chown d7/d76/c82 998 1 2024-09-13T18:30:23.838 INFO:tasks.workunit.client.1.smithi149.stdout:0/500: mkdir d1/d2/d8a/da9 0 2024-09-13T18:30:23.838 INFO:tasks.workunit.client.1.smithi149.stdout:0/501: write d1/d2/f66 [234100,105010] 0 2024-09-13T18:30:23.841 INFO:tasks.workunit.client.1.smithi149.stdout:6/659: mknod dc/d15/d23/d5f/dac/cd4 0 2024-09-13T18:30:23.842 INFO:tasks.workunit.client.1.smithi149.stdout:5/482: dwrite d3/d8/d13/f52 [0,4194304] 0 2024-09-13T18:30:23.843 INFO:tasks.workunit.client.1.smithi149.stdout:1/559: write f2 [1471348,52764] 0 2024-09-13T18:30:23.843 INFO:tasks.workunit.client.1.smithi149.stdout:1/560: fsync d9/d10/d34/d3c/f85 0 2024-09-13T18:30:23.845 INFO:tasks.workunit.client.1.smithi149.stdout:4/560: creat df/da0/d1c/d7e/fbd x:0 0 0 2024-09-13T18:30:23.845 INFO:tasks.workunit.client.1.smithi149.stdout:2/502: truncate db/d1b/d48/f6f 5556528 0 2024-09-13T18:30:23.845 INFO:tasks.workunit.client.1.smithi149.stdout:2/503: chown db/d10/f1a 197 1 2024-09-13T18:30:23.847 INFO:tasks.workunit.client.1.smithi149.stdout:2/504: write db/d1b/d2f/d69/f5c [151691,22855] 0 2024-09-13T18:30:23.848 INFO:tasks.workunit.client.1.smithi149.stdout:0/502: truncate d1/d2/d8a/f93 164279 0 2024-09-13T18:30:23.848 INFO:tasks.workunit.client.1.smithi149.stdout:0/503: write d1/d29/d31/d3e/f45 [6216456,12638] 0 2024-09-13T18:30:23.850 INFO:tasks.workunit.client.1.smithi149.stdout:6/660: truncate dc/d15/d23/f3e 4084475 0 2024-09-13T18:30:23.852 INFO:tasks.workunit.client.1.smithi149.stdout:5/483: creat d3/d10/d4c/d4e/d61/f96 x:0 0 0 2024-09-13T18:30:23.855 INFO:tasks.workunit.client.1.smithi149.stdout:8/481: dwrite d2/d12/d1b/d58/d97/fa0 [0,4194304] 0 2024-09-13T18:30:23.857 INFO:tasks.workunit.client.1.smithi149.stdout:0/504: creat d1/d2/d41/faa x:0 0 0 2024-09-13T18:30:23.857 INFO:tasks.workunit.client.1.smithi149.stdout:0/505: getdents d1/d29/d31/d83/d87 0 2024-09-13T18:30:23.859 INFO:tasks.workunit.client.1.smithi149.stdout:4/561: dread df/da0/d12/d17/d3d/f5d [0,4194304] 0 2024-09-13T18:30:23.859 INFO:tasks.workunit.client.1.smithi149.stdout:7/619: dwrite d7/d76/db3/d31/f5b [0,4194304] 0 2024-09-13T18:30:23.860 INFO:tasks.workunit.client.1.smithi149.stdout:6/661: mknod dc/d15/d54/da9/cd5 0 2024-09-13T18:30:23.869 INFO:tasks.workunit.client.1.smithi149.stdout:8/482: rename d2/f15 to d2/d5b/d88/fa3 0 2024-09-13T18:30:23.869 INFO:tasks.workunit.client.1.smithi149.stdout:8/483: chown d2/d12/f57 5 1 2024-09-13T18:30:23.869 INFO:tasks.workunit.client.1.smithi149.stdout:0/506: symlink d1/d48/d92/lab 0 2024-09-13T18:30:23.871 INFO:tasks.workunit.client.1.smithi149.stdout:7/620: creat d7/d9/d1c/d51/d52/d86/d9f/fd4 x:0 0 0 2024-09-13T18:30:23.871 INFO:tasks.workunit.client.1.smithi149.stdout:7/621: dread - d7/d9/d1c/d51/fa9 zero size 2024-09-13T18:30:23.876 INFO:tasks.workunit.client.1.smithi149.stdout:7/622: symlink d7/d76/db3/da4/dae/ld5 0 2024-09-13T18:30:23.878 INFO:tasks.workunit.client.1.smithi149.stdout:0/507: dread d1/f2b [0,4194304] 0 2024-09-13T18:30:23.881 INFO:tasks.workunit.client.1.smithi149.stdout:5/484: dread d3/f3d [0,4194304] 0 2024-09-13T18:30:23.889 INFO:tasks.workunit.client.1.smithi149.stdout:8/484: write d2/d12/f43 [6708,94626] 0 2024-09-13T18:30:23.889 INFO:tasks.workunit.client.1.smithi149.stdout:7/623: symlink d7/d9/d1c/d1f/d3d/ld6 0 2024-09-13T18:30:23.891 INFO:tasks.workunit.client.1.smithi149.stdout:5/485: mkdir d3/d10/d32/d54/d97 0 2024-09-13T18:30:23.892 INFO:tasks.workunit.client.1.smithi149.stdout:8/485: dread d2/f96 [0,4194304] 0 2024-09-13T18:30:23.895 INFO:tasks.workunit.client.1.smithi149.stdout:7/624: symlink d7/d9/d1c/d1f/d47/d53/daa/ld7 0 2024-09-13T18:30:23.897 INFO:tasks.workunit.client.1.smithi149.stdout:5/486: mkdir d3/d10/d98 0 2024-09-13T18:30:23.897 INFO:tasks.workunit.client.1.smithi149.stdout:5/487: fdatasync d3/d10/d32/d67/d83/f8a 0 2024-09-13T18:30:23.897 INFO:tasks.workunit.client.1.smithi149.stdout:5/488: write d3/d10/d32/d67/d83/f8a [5127099,117737] 0 2024-09-13T18:30:23.898 INFO:tasks.workunit.client.1.smithi149.stdout:8/486: creat d2/d12/d2a/fa4 x:0 0 0 2024-09-13T18:30:23.899 INFO:tasks.workunit.client.1.smithi149.stdout:8/487: creat d2/fa5 x:0 0 0 2024-09-13T18:30:23.900 INFO:tasks.workunit.client.1.smithi149.stdout:2/505: dwrite db/d10/f14 [0,4194304] 0 2024-09-13T18:30:23.900 INFO:tasks.workunit.client.1.smithi149.stdout:2/506: chown db/d1b/d6c 161955048 1 2024-09-13T18:30:23.903 INFO:tasks.workunit.client.1.smithi149.stdout:5/489: link d3/d10/c72 d3/d10/d4c/d4e/d61/d63/c99 0 2024-09-13T18:30:23.903 INFO:tasks.workunit.client.1.smithi149.stdout:5/490: chown d3/d8/d13/l49 2 1 2024-09-13T18:30:23.904 INFO:tasks.workunit.client.1.smithi149.stdout:7/625: write d7/d9/d1c/d51/d52/d86/fbd [326427,105106] 0 2024-09-13T18:30:23.905 INFO:tasks.workunit.client.1.smithi149.stdout:7/626: chown d7/d9/d1c/d1f/d21/f4b 230333 1 2024-09-13T18:30:23.906 INFO:tasks.workunit.client.1.smithi149.stdout:8/488: symlink d2/d12/d1b/d58/la6 0 2024-09-13T18:30:23.906 INFO:tasks.workunit.client.1.smithi149.stdout:8/489: chown d2/l7 1 1 2024-09-13T18:30:23.907 INFO:tasks.workunit.client.1.smithi149.stdout:5/491: read d3/d10/d4c/d4e/d61/d63/f6b [116579,4513] 0 2024-09-13T18:30:23.910 INFO:tasks.workunit.client.1.smithi149.stdout:5/492: dread d3/d10/d4c/f71 [8388608,4194304] 0 2024-09-13T18:30:23.910 INFO:tasks.workunit.client.1.smithi149.stdout:5/493: truncate d3/d10/d32/d54/f2a 5075939 0 2024-09-13T18:30:23.910 INFO:tasks.workunit.client.1.smithi149.stdout:7/627: mknod d7/d12/cd8 0 2024-09-13T18:30:23.910 INFO:tasks.workunit.client.1.smithi149.stdout:1/561: dwrite f2 [0,4194304] 0 2024-09-13T18:30:23.910 INFO:tasks.workunit.client.1.smithi149.stdout:1/562: stat d9/d10/d34/d3c 0 2024-09-13T18:30:23.910 INFO:tasks.workunit.client.1.smithi149.stdout:1/563: stat d9/d15/d25/c49 0 2024-09-13T18:30:23.911 INFO:tasks.workunit.client.1.smithi149.stdout:6/662: dwrite dc/d15/d23/d57/da5/fd0 [0,4194304] 0 2024-09-13T18:30:23.911 INFO:tasks.workunit.client.1.smithi149.stdout:8/490: truncate d2/d13/d3a/d7f/f82 3652215 0 2024-09-13T18:30:23.911 INFO:tasks.workunit.client.1.smithi149.stdout:8/491: chown d2/d12/f9d 94 1 2024-09-13T18:30:23.911 INFO:tasks.workunit.client.1.smithi149.stdout:8/492: chown d2/fe 11180170 1 2024-09-13T18:30:23.912 INFO:tasks.workunit.client.1.smithi149.stdout:2/507: dread db/d1b/d48/f74 [0,4194304] 0 2024-09-13T18:30:23.912 INFO:tasks.workunit.client.1.smithi149.stdout:4/562: dwrite df/da0/d12/d21/d22/d30/d56/f5a [0,4194304] 0 2024-09-13T18:30:23.912 INFO:tasks.workunit.client.1.smithi149.stdout:5/494: creat d3/d10/d32/d54/d97/f9a x:0 0 0 2024-09-13T18:30:23.912 INFO:tasks.workunit.client.1.smithi149.stdout:0/508: dwrite d1/d48/f6d [0,4194304] 0 2024-09-13T18:30:23.912 INFO:tasks.workunit.client.1.smithi149.stdout:0/509: fdatasync d1/d29/d31/d44/d47/f84 0 2024-09-13T18:30:23.927 INFO:tasks.workunit.client.1.smithi149.stdout:1/564: mknod d9/d15/d60/cb0 0 2024-09-13T18:30:23.931 INFO:tasks.workunit.client.1.smithi149.stdout:6/663: truncate dc/d15/f36 29929 0 2024-09-13T18:30:23.932 INFO:tasks.workunit.client.1.smithi149.stdout:6/664: write dc/d15/d23/d5b/f52 [169471,35785] 0 2024-09-13T18:30:23.932 INFO:tasks.workunit.client.1.smithi149.stdout:8/493: rmdir d2/d13/d3a 39 2024-09-13T18:30:23.938 INFO:tasks.workunit.client.1.smithi149.stdout:2/508: symlink db/d1b/d2f/db2/lb3 0 2024-09-13T18:30:23.938 INFO:tasks.workunit.client.1.smithi149.stdout:2/509: fdatasync db/d1b/d1c/d20/f50 0 2024-09-13T18:30:23.940 INFO:tasks.workunit.client.1.smithi149.stdout:4/563: symlink df/da0/d12/d21/d22/d30/d41/d57/d60/lbe 0 2024-09-13T18:30:23.942 INFO:tasks.workunit.client.1.smithi149.stdout:5/495: unlink d3/f3d 0 2024-09-13T18:30:23.942 INFO:tasks.workunit.client.1.smithi149.stdout:5/496: fsync d3/d10/d4c/d4e/d61/f96 0 2024-09-13T18:30:23.942 INFO:tasks.workunit.client.1.smithi149.stdout:5/497: getdents d3/d10/d4c/d4e/d61/d75/d88 0 2024-09-13T18:30:23.942 INFO:tasks.workunit.client.1.smithi149.stdout:5/498: chown d3/d10/d4c/f71 5425629 1 2024-09-13T18:30:23.945 INFO:tasks.workunit.client.1.smithi149.stdout:0/510: symlink d1/d2/d8a/d90/lac 0 2024-09-13T18:30:23.946 INFO:tasks.workunit.client.1.smithi149.stdout:7/628: rmdir d7/d9/d11/d50 39 2024-09-13T18:30:23.946 INFO:tasks.workunit.client.1.smithi149.stdout:7/629: chown d7/d12/c58 3856 1 2024-09-13T18:30:23.950 INFO:tasks.workunit.client.1.smithi149.stdout:8/494: truncate d2/d13/f85 222604 0 2024-09-13T18:30:23.950 INFO:tasks.workunit.client.1.smithi149.stdout:8/495: truncate d2/d5b/f8a 254310 0 2024-09-13T18:30:23.950 INFO:tasks.workunit.client.1.smithi149.stdout:8/496: creat d2/d5b/d86/fa7 x:0 0 0 2024-09-13T18:30:23.952 INFO:tasks.workunit.client.1.smithi149.stdout:2/510: mknod db/d1b/dab/cb4 0 2024-09-13T18:30:23.956 INFO:tasks.workunit.client.1.smithi149.stdout:5/499: rename d3/d8/f39 to d3/d8/f9b 0 2024-09-13T18:30:23.957 INFO:tasks.workunit.client.1.smithi149.stdout:1/565: rmdir d9/d10/d34/d53/d57/d6c 39 2024-09-13T18:30:23.960 INFO:tasks.workunit.client.1.smithi149.stdout:8/497: mkdir d2/d13/d3a/d7f/da8 0 2024-09-13T18:30:23.961 INFO:tasks.workunit.client.1.smithi149.stdout:0/511: dwrite d1/d2/d41/f94 [0,4194304] 0 2024-09-13T18:30:23.961 INFO:tasks.workunit.client.1.smithi149.stdout:2/511: truncate db/d10/d12/f80 4733101 0 2024-09-13T18:30:23.963 INFO:tasks.workunit.client.1.smithi149.stdout:5/500: creat d3/d8/d6d/d91/f9c x:0 0 0 2024-09-13T18:30:23.968 INFO:tasks.workunit.client.1.smithi149.stdout:1/566: rename d9/d15/d25/c8e to d9/d15/d40/d90/cb1 0 2024-09-13T18:30:23.969 INFO:tasks.workunit.client.1.smithi149.stdout:8/498: getdents d2/d12/d87 0 2024-09-13T18:30:23.969 INFO:tasks.workunit.client.1.smithi149.stdout:8/499: chown d2/d13/d3a/c72 61 1 2024-09-13T18:30:23.969 INFO:tasks.workunit.client.1.smithi149.stdout:8/500: truncate d2/d5b/f8a 1274500 0 2024-09-13T18:30:23.971 INFO:tasks.workunit.client.1.smithi149.stdout:0/512: mkdir d1/d29/dad 0 2024-09-13T18:30:23.972 INFO:tasks.workunit.client.1.smithi149.stdout:0/513: chown d1/d2/d41/d46/d7b/d98/fa3 137624 1 2024-09-13T18:30:23.972 INFO:tasks.workunit.client.1.smithi149.stdout:0/514: stat d1/l9 0 2024-09-13T18:30:23.972 INFO:tasks.workunit.client.1.smithi149.stdout:0/515: write d1/d48/fa2 [4158581,61432] 0 2024-09-13T18:30:23.972 INFO:tasks.workunit.client.1.smithi149.stdout:0/516: chown d1/d29/d31/d44/d81/f63 121560477 1 2024-09-13T18:30:23.972 INFO:tasks.workunit.client.1.smithi149.stdout:0/517: stat d1/d2/d41/d46/l4b 0 2024-09-13T18:30:23.972 INFO:tasks.workunit.client.1.smithi149.stdout:0/518: write d1/d48/fa2 [553200,15968] 0 2024-09-13T18:30:23.974 INFO:tasks.workunit.client.1.smithi149.stdout:8/501: truncate d2/d12/d2a/d4d/f6f 693622 0 2024-09-13T18:30:23.985 INFO:tasks.workunit.client.1.smithi149.stdout:5/501: dwrite d3/d10/d4c/d4e/d61/d75/f7b [4194304,4194304] 0 2024-09-13T18:30:23.989 INFO:tasks.workunit.client.1.smithi149.stdout:5/502: creat d3/d10/d4c/d4e/d61/d63/f9d x:0 0 0 2024-09-13T18:30:23.989 INFO:tasks.workunit.client.1.smithi149.stdout:5/503: chown d3/d10/d32/d54/c74 456150 1 2024-09-13T18:30:23.989 INFO:tasks.workunit.client.1.smithi149.stdout:5/504: dread - d3/f8b zero size 2024-09-13T18:30:23.989 INFO:tasks.workunit.client.1.smithi149.stdout:5/505: read - d3/d10/d4c/d4e/d61/f96 zero size 2024-09-13T18:30:23.997 INFO:tasks.workunit.client.1.smithi149.stdout:0/519: dwrite d1/d2/d41/faa [0,4194304] 0 2024-09-13T18:30:23.997 INFO:tasks.workunit.client.1.smithi149.stdout:0/520: creat d1/d2/d41/fae x:0 0 0 2024-09-13T18:30:23.997 INFO:tasks.workunit.client.1.smithi149.stdout:8/502: dwrite d2/d12/d40/f75 [0,4194304] 0 2024-09-13T18:30:23.999 INFO:tasks.workunit.client.1.smithi149.stdout:3/526: sync 2024-09-13T18:30:24.002 INFO:tasks.workunit.client.1.smithi149.stdout:5/506: read d3/d8/d13/f6c [1163740,99374] 0 2024-09-13T18:30:24.002 INFO:tasks.workunit.client.1.smithi149.stdout:5/507: chown d3/d10/d32/f2e 4023 1 2024-09-13T18:30:24.011 INFO:tasks.workunit.client.1.smithi149.stdout:9/419: sync 2024-09-13T18:30:24.016 INFO:tasks.workunit.client.1.smithi149.stdout:4/564: truncate df/da0/d12/d21/d22/d30/d41/d57/f6a 132907 0 2024-09-13T18:30:24.017 INFO:tasks.workunit.client.1.smithi149.stdout:3/527: dread d1/d2e/d1d/d9a/f2f [4194304,4194304] 0 2024-09-13T18:30:24.021 INFO:tasks.workunit.client.1.smithi149.stdout:9/420: chown d0/d18/d19/c4c 6 1 2024-09-13T18:30:24.028 INFO:tasks.workunit.client.1.smithi149.stdout:4/565: rmdir df/da0/d12/d21/d22 39 2024-09-13T18:30:24.028 INFO:tasks.workunit.client.1.smithi149.stdout:5/508: dread d3/d10/d4c/d4e/d61/d75/f7b [4194304,4194304] 0 2024-09-13T18:30:24.031 INFO:tasks.workunit.client.1.smithi149.stdout:8/503: dwrite d2/d12/d87/f9e [8388608,4194304] 0 2024-09-13T18:30:24.034 INFO:tasks.workunit.client.1.smithi149.stdout:5/509: unlink d3/d10/d4c/d4e/d61/d63/f6b 0 2024-09-13T18:30:24.036 INFO:tasks.workunit.client.1.smithi149.stdout:8/504: creat d2/d13/d3a/d7f/da8/fa9 x:0 0 0 2024-09-13T18:30:24.039 INFO:tasks.workunit.client.1.smithi149.stdout:8/505: truncate d2/f9 5054257 0 2024-09-13T18:30:24.039 INFO:tasks.workunit.client.1.smithi149.stdout:8/506: creat d2/faa x:0 0 0 2024-09-13T18:30:24.045 INFO:tasks.workunit.client.1.smithi149.stdout:8/507: mknod d2/d12/d87/cab 0 2024-09-13T18:30:24.045 INFO:tasks.workunit.client.1.smithi149.stdout:8/508: creat d2/d12/d6e/fac x:0 0 0 2024-09-13T18:30:24.047 INFO:tasks.workunit.client.1.smithi149.stdout:4/566: dread df/da0/d1c/f23 [0,4194304] 0 2024-09-13T18:30:24.068 INFO:tasks.workunit.client.1.smithi149.stdout:4/567: dread df/da0/d1c/f23 [0,4194304] 0 2024-09-13T18:30:24.069 INFO:tasks.workunit.client.1.smithi149.stdout:4/568: symlink df/da0/d12/d21/d22/d30/lbf 0 2024-09-13T18:30:24.069 INFO:tasks.workunit.client.1.smithi149.stdout:4/569: fdatasync df/da0/d1c/f67 0 2024-09-13T18:30:24.070 INFO:tasks.workunit.client.1.smithi149.stdout:4/570: link df/da0/d12/d21/d22/d30/d41/f99 df/fc0 0 2024-09-13T18:30:24.071 INFO:tasks.workunit.client.1.smithi149.stdout:4/571: mknod df/da0/d12/d21/d22/d30/d41/d57/d75/cc1 0 2024-09-13T18:30:24.077 INFO:tasks.workunit.client.1.smithi149.stdout:5/510: dwrite d3/d10/d32/f7e [0,4194304] 0 2024-09-13T18:30:24.082 INFO:tasks.workunit.client.1.smithi149.stdout:3/528: dwrite d1/d2e/f14 [0,4194304] 0 2024-09-13T18:30:24.082 INFO:tasks.workunit.client.1.smithi149.stdout:0/521: dwrite d1/f5 [4194304,4194304] 0 2024-09-13T18:30:24.085 INFO:tasks.workunit.client.1.smithi149.stdout:0/522: mkdir d1/d2/d41/d46/d7b/daf 0 2024-09-13T18:30:24.087 INFO:tasks.workunit.client.1.smithi149.stdout:0/523: creat d1/d29/d31/d44/d81/d9f/fb0 x:0 0 0 2024-09-13T18:30:24.087 INFO:tasks.workunit.client.1.smithi149.stdout:9/421: dwrite d0/d47/f65 [0,4194304] 0 2024-09-13T18:30:24.087 INFO:tasks.workunit.client.1.smithi149.stdout:0/524: creat d1/d2/d8a/fb1 x:0 0 0 2024-09-13T18:30:24.087 INFO:tasks.workunit.client.1.smithi149.stdout:5/511: dread d3/d10/d32/d54/f2a [0,4194304] 0 2024-09-13T18:30:24.088 INFO:tasks.workunit.client.1.smithi149.stdout:5/512: creat d3/d10/d32/d54/f9e x:0 0 0 2024-09-13T18:30:24.091 INFO:tasks.workunit.client.1.smithi149.stdout:0/525: creat d1/d29/d31/d83/fb2 x:0 0 0 2024-09-13T18:30:24.091 INFO:tasks.workunit.client.1.smithi149.stdout:0/526: write d1/d2/f89 [992803,23032] 0 2024-09-13T18:30:24.093 INFO:tasks.workunit.client.1.smithi149.stdout:5/513: link d3/d10/c15 d3/d10/d32/d67/c9f 0 2024-09-13T18:30:24.094 INFO:tasks.workunit.client.1.smithi149.stdout:5/514: creat d3/d10/d32/d54/d76/fa0 x:0 0 0 2024-09-13T18:30:24.094 INFO:tasks.workunit.client.1.smithi149.stdout:3/529: dread d1/d2e/d1d/f2b [0,4194304] 0 2024-09-13T18:30:24.095 INFO:tasks.workunit.client.1.smithi149.stdout:5/515: creat d3/d10/d4c/d4e/d61/d75/fa1 x:0 0 0 2024-09-13T18:30:24.095 INFO:tasks.workunit.client.1.smithi149.stdout:5/516: creat d3/d5e/fa2 x:0 0 0 2024-09-13T18:30:24.098 INFO:tasks.workunit.client.1.smithi149.stdout:4/572: dwrite df/da0/f95 [0,4194304] 0 2024-09-13T18:30:24.098 INFO:tasks.workunit.client.1.smithi149.stdout:3/530: getdents d1/d2c/d8b 0 2024-09-13T18:30:24.099 INFO:tasks.workunit.client.1.smithi149.stdout:8/509: dwrite d2/d13/f7b [4194304,4194304] 0 2024-09-13T18:30:24.099 INFO:tasks.workunit.client.1.smithi149.stdout:9/422: dread d0/d18/d19/f23 [0,4194304] 0 2024-09-13T18:30:24.101 INFO:tasks.workunit.client.1.smithi149.stdout:8/510: write d2/d13/f7d [74057,37995] 0 2024-09-13T18:30:24.102 INFO:tasks.workunit.client.1.smithi149.stdout:4/573: mkdir df/da0/d12/d17/dc2 0 2024-09-13T18:30:24.105 INFO:tasks.workunit.client.1.smithi149.stdout:0/527: write d1/d1b/f67 [3894160,52724] 0 2024-09-13T18:30:24.105 INFO:tasks.workunit.client.1.smithi149.stdout:0/528: dread - d1/d2/d41/d46/d7b/d98/fa3 zero size 2024-09-13T18:30:24.105 INFO:tasks.workunit.client.1.smithi149.stdout:0/529: write d1/d2/d8a/f93 [281185,71293] 0 2024-09-13T18:30:24.105 INFO:tasks.workunit.client.1.smithi149.stdout:0/530: truncate d1/d2/f66 1064343 0 2024-09-13T18:30:24.105 INFO:tasks.workunit.client.1.smithi149.stdout:0/531: chown d1/d1b/l8b 8 1 2024-09-13T18:30:24.106 INFO:tasks.workunit.client.1.smithi149.stdout:4/574: dread df/da0/d12/d17/d3d/f5d [0,4194304] 0 2024-09-13T18:30:24.108 INFO:tasks.workunit.client.1.smithi149.stdout:0/532: write d1/d2/fb [4403508,67958] 0 2024-09-13T18:30:24.108 INFO:tasks.workunit.client.1.smithi149.stdout:0/533: creat d1/d29/d31/d44/d81/fb3 x:0 0 0 2024-09-13T18:30:24.108 INFO:tasks.workunit.client.1.smithi149.stdout:0/534: write d1/d1b/f3d [707275,33035] 0 2024-09-13T18:30:24.108 INFO:tasks.workunit.client.1.smithi149.stdout:0/535: dread - d1/d2/f9e zero size 2024-09-13T18:30:24.108 INFO:tasks.workunit.client.1.smithi149.stdout:0/536: stat d1/d2/d8a/d90/l43 0 2024-09-13T18:30:24.110 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:23 smithi038 ceph-mon[27689]: pgmap v14: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 118 MiB/s rd, 149 MiB/s wr, 616 op/s 2024-09-13T18:30:24.111 INFO:tasks.workunit.client.1.smithi149.stdout:9/423: mkdir d0/d2e/d42/d59/d86 0 2024-09-13T18:30:24.112 INFO:tasks.workunit.client.1.smithi149.stdout:8/511: creat d2/d13/fad x:0 0 0 2024-09-13T18:30:24.115 INFO:tasks.workunit.client.1.smithi149.stdout:4/575: rename df/da0/d12/d21/d22/d30/d56/f5a to df/da0/d12/d7c/d9a/fc3 0 2024-09-13T18:30:24.117 INFO:tasks.workunit.client.1.smithi149.stdout:0/537: write d1/d29/d31/d44/d81/d62/f6c [1743757,60823] 0 2024-09-13T18:30:24.118 INFO:tasks.workunit.client.1.smithi149.stdout:4/576: mkdir df/da0/d12/d21/d22/d30/d41/d57/d60/dc4 0 2024-09-13T18:30:24.119 INFO:tasks.workunit.client.1.smithi149.stdout:9/424: mknod d0/d18/d19/c87 0 2024-09-13T18:30:24.121 INFO:tasks.workunit.client.1.smithi149.stdout:4/577: mknod df/da0/d12/d21/d22/d30/d41/d57/d60/cc5 0 2024-09-13T18:30:24.121 INFO:tasks.workunit.client.1.smithi149.stdout:4/578: write df/da0/d12/d7c/d9a/fc3 [294618,52858] 0 2024-09-13T18:30:24.122 INFO:tasks.workunit.client.1.smithi149.stdout:9/425: creat d0/f88 x:0 0 0 2024-09-13T18:30:24.122 INFO:tasks.workunit.client.1.smithi149.stdout:9/426: truncate d0/d2e/d42/d59/f69 816436 0 2024-09-13T18:30:24.122 INFO:tasks.workunit.client.1.smithi149.stdout:9/427: chown d0/d18/d27/d5c/d7e 2952 1 2024-09-13T18:30:24.122 INFO:tasks.workunit.client.1.smithi149.stdout:9/428: write d0/d2e/d42/d59/f7c [155737,14990] 0 2024-09-13T18:30:24.122 INFO:tasks.workunit.client.1.smithi149.stdout:9/429: creat d0/d47/f89 x:0 0 0 2024-09-13T18:30:24.122 INFO:tasks.workunit.client.1.smithi149.stdout:9/430: chown d0/d18/d27/d5c/d79 0 1 2024-09-13T18:30:24.125 INFO:tasks.workunit.client.1.smithi149.stdout:3/531: dwrite d1/d2c/fa8 [0,4194304] 0 2024-09-13T18:30:24.125 INFO:tasks.workunit.client.1.smithi149.stdout:6/665: sync 2024-09-13T18:30:24.125 INFO:tasks.workunit.client.0.smithi038.stdout:8/20: sync 2024-09-13T18:30:24.127 INFO:tasks.workunit.client.0.smithi038.stdout:9/32: sync 2024-09-13T18:30:24.127 INFO:tasks.workunit.client.0.smithi038.stdout:9/33: chown d0/d7/fa 5 1 2024-09-13T18:30:24.127 INFO:tasks.workunit.client.0.smithi038.stdout:4/130: sync 2024-09-13T18:30:24.127 INFO:tasks.workunit.client.0.smithi038.stdout:5/2: sync 2024-09-13T18:30:24.127 INFO:tasks.workunit.client.0.smithi038.stdout:5/3: creat f2 x:0 0 0 2024-09-13T18:30:24.127 INFO:tasks.workunit.client.0.smithi038.stdout:5/4: fdatasync f1 0 2024-09-13T18:30:24.127 INFO:tasks.workunit.client.0.smithi038.stdout:5/5: chown f2 3 1 2024-09-13T18:30:24.127 INFO:tasks.workunit.client.0.smithi038.stdout:5/6: readlink - no filename 2024-09-13T18:30:24.127 INFO:tasks.workunit.client.0.smithi038.stdout:5/7: creat f3 x:0 0 0 2024-09-13T18:30:24.127 INFO:tasks.workunit.client.0.smithi038.stdout:0/22: sync 2024-09-13T18:30:24.128 INFO:tasks.workunit.client.0.smithi038.stdout:2/6: sync 2024-09-13T18:30:24.128 INFO:tasks.workunit.client.0.smithi038.stdout:2/7: chown d2 441344091 1 2024-09-13T18:30:24.128 INFO:tasks.workunit.client.0.smithi038.stdout:7/2: sync 2024-09-13T18:30:24.128 INFO:tasks.workunit.client.0.smithi038.stdout:7/3: chown f0 79 1 2024-09-13T18:30:24.128 INFO:tasks.workunit.client.0.smithi038.stdout:3/6: sync 2024-09-13T18:30:24.128 INFO:tasks.workunit.client.0.smithi038.stdout:6/70: sync 2024-09-13T18:30:24.128 INFO:tasks.workunit.client.0.smithi038.stdout:1/44: sync 2024-09-13T18:30:24.131 INFO:tasks.workunit.client.1.smithi149.stdout:7/630: sync 2024-09-13T18:30:24.134 INFO:tasks.workunit.client.1.smithi149.stdout:3/532: getdents d1/d2e/d1d/d49 0 2024-09-13T18:30:24.134 INFO:tasks.workunit.client.1.smithi149.stdout:3/533: dread - d1/d48/f8f zero size 2024-09-13T18:30:24.134 INFO:tasks.workunit.client.1.smithi149.stdout:3/534: write d1/d2e/d93/fa6 [769605,130193] 0 2024-09-13T18:30:24.137 INFO:tasks.workunit.client.0.smithi038.stdout:8/21: mknod d1/d8/c9 0 2024-09-13T18:30:24.140 INFO:tasks.workunit.client.0.smithi038.stdout:9/34: truncate d0/d7/fa 3708994 0 2024-09-13T18:30:24.142 INFO:tasks.workunit.client.1.smithi149.stdout:7/631: symlink d7/d9/d1c/d1f/d21/d7b/d96/d9e/ld9 0 2024-09-13T18:30:24.143 INFO:tasks.workunit.client.1.smithi149.stdout:5/517: rmdir d3/d10/d4c/d4e/d61/d75 39 2024-09-13T18:30:24.143 INFO:tasks.workunit.client.1.smithi149.stdout:5/518: write d3/d10/d4c/d4e/d61/d75/fa1 [464776,78035] 0 2024-09-13T18:30:24.143 INFO:tasks.workunit.client.1.smithi149.stdout:5/519: creat d3/d5e/fa3 x:0 0 0 2024-09-13T18:30:24.144 INFO:tasks.workunit.client.0.smithi038.stdout:4/131: truncate d2/df/d22/dc/f1e 2311000 0 2024-09-13T18:30:24.148 INFO:tasks.workunit.client.0.smithi038.stdout:1/45: write f4 [3289363,2923] 0 2024-09-13T18:30:24.148 INFO:tasks.workunit.client.1.smithi149.stdout:2/512: sync 2024-09-13T18:30:24.148 INFO:tasks.workunit.client.1.smithi149.stdout:1/567: sync 2024-09-13T18:30:24.148 INFO:tasks.workunit.client.1.smithi149.stdout:1/568: dread - d9/d10/d62/f99 zero size 2024-09-13T18:30:24.151 INFO:tasks.workunit.client.0.smithi038.stdout:5/8: symlink l4 0 2024-09-13T18:30:24.151 INFO:tasks.workunit.client.0.smithi038.stdout:5/9: write f3 [205457,94084] 0 2024-09-13T18:30:24.151 INFO:tasks.workunit.client.0.smithi038.stdout:5/10: dread - f1 zero size 2024-09-13T18:30:24.151 INFO:tasks.workunit.client.0.smithi038.stdout:5/11: rmdir - no directory 2024-09-13T18:30:24.151 INFO:tasks.workunit.client.0.smithi038.stdout:5/12: truncate f3 669362 0 2024-09-13T18:30:24.152 INFO:tasks.workunit.client.1.smithi149.stdout:5/520: unlink d3/d10/f7d 0 2024-09-13T18:30:24.153 INFO:tasks.workunit.client.0.smithi038.stdout:2/8: symlink d2/l3 0 2024-09-13T18:30:24.153 INFO:tasks.workunit.client.0.smithi038.stdout:2/9: chown d2 100475943 1 2024-09-13T18:30:24.153 INFO:tasks.workunit.client.0.smithi038.stdout:2/10: chown l1 3 1 2024-09-13T18:30:24.153 INFO:tasks.workunit.client.0.smithi038.stdout:2/11: dwrite - no filename 2024-09-13T18:30:24.153 INFO:tasks.workunit.client.0.smithi038.stdout:2/12: write - no filename 2024-09-13T18:30:24.154 INFO:tasks.workunit.client.1.smithi149.stdout:2/513: mkdir db/d1b/d1c/d20/d2b/d3e/d95/db5 0 2024-09-13T18:30:24.155 INFO:tasks.workunit.client.1.smithi149.stdout:2/514: stat db/d1b/d1c/d85 0 2024-09-13T18:30:24.155 INFO:tasks.workunit.client.1.smithi149.stdout:2/515: chown db/d1b/d1c/d20/d2b/f92 482 1 2024-09-13T18:30:24.155 INFO:tasks.workunit.client.1.smithi149.stdout:7/632: dread d7/d12/f17 [0,4194304] 0 2024-09-13T18:30:24.155 INFO:tasks.workunit.client.1.smithi149.stdout:2/516: creat db/d1b/d1c/d20/d2b/d3e/d95/fb6 x:0 0 0 2024-09-13T18:30:24.155 INFO:tasks.workunit.client.1.smithi149.stdout:2/517: read db/d1b/f42 [359904,39514] 0 2024-09-13T18:30:24.157 INFO:tasks.workunit.client.1.smithi149.stdout:1/569: rename d9/d15/d25/f32 to d9/d10/d34/d53/d57/d6c/fb2 0 2024-09-13T18:30:24.157 INFO:tasks.workunit.client.1.smithi149.stdout:1/570: dread - d9/d10/d34/d53/f5f zero size 2024-09-13T18:30:24.158 INFO:tasks.workunit.client.0.smithi038.stdout:3/7: creat d0/f2 x:0 0 0 2024-09-13T18:30:24.158 INFO:tasks.workunit.client.0.smithi038.stdout:3/8: stat d0/l1 0 2024-09-13T18:30:24.161 INFO:tasks.workunit.client.0.smithi038.stdout:8/22: link d1/f7 d1/d4/fa 0 2024-09-13T18:30:24.163 INFO:tasks.workunit.client.1.smithi149.stdout:5/521: mkdir d3/d10/d4c/d4e/da4 0 2024-09-13T18:30:24.163 INFO:tasks.workunit.client.1.smithi149.stdout:5/522: getdents d3/d10/d32/d54/d76/d7a 0 2024-09-13T18:30:24.164 INFO:tasks.workunit.client.1.smithi149.stdout:8/512: dwrite d2/fa5 [0,4194304] 0 2024-09-13T18:30:24.166 INFO:tasks.workunit.client.1.smithi149.stdout:7/633: rmdir d7/d76/db3/d31 39 2024-09-13T18:30:24.166 INFO:tasks.workunit.client.0.smithi038.stdout:4/132: truncate d2/df/d22/dc/f16 6413778 0 2024-09-13T18:30:24.168 INFO:tasks.workunit.client.1.smithi149.stdout:2/518: rename db/d1b/d1c/d20/d49 to db/d1b/d1c/d20/d2b/db7 0 2024-09-13T18:30:24.170 INFO:tasks.workunit.client.1.smithi149.stdout:5/523: mkdir d3/d10/d32/d54/d76/d7a/da5 0 2024-09-13T18:30:24.171 INFO:tasks.workunit.client.0.smithi038.stdout:5/13: mknod c5 0 2024-09-13T18:30:24.173 INFO:tasks.workunit.client.0.smithi038.stdout:2/13: unlink l1 0 2024-09-13T18:30:24.173 INFO:tasks.workunit.client.0.smithi038.stdout:2/14: dwrite - no filename 2024-09-13T18:30:24.173 INFO:tasks.workunit.client.0.smithi038.stdout:2/15: read - no filename 2024-09-13T18:30:24.173 INFO:tasks.workunit.client.0.smithi038.stdout:2/16: chown d2 12017042 1 2024-09-13T18:30:24.174 INFO:tasks.workunit.client.1.smithi149.stdout:2/519: creat db/d1b/d1c/d20/d2b/db7/fb8 x:0 0 0 2024-09-13T18:30:24.174 INFO:tasks.workunit.client.0.smithi038.stdout:3/9: symlink d0/l3 0 2024-09-13T18:30:24.174 INFO:tasks.workunit.client.0.smithi038.stdout:3/10: truncate d0/f2 161846 0 2024-09-13T18:30:24.174 INFO:tasks.workunit.client.0.smithi038.stdout:3/11: creat d0/f4 x:0 0 0 2024-09-13T18:30:24.176 INFO:tasks.workunit.client.1.smithi149.stdout:2/520: symlink db/d1b/d1c/d20/lb9 0 2024-09-13T18:30:24.178 INFO:tasks.workunit.client.0.smithi038.stdout:8/23: link f0 d1/fb 0 2024-09-13T18:30:24.178 INFO:tasks.workunit.client.0.smithi038.stdout:8/24: chown d1/d4/fa 475132 1 2024-09-13T18:30:24.178 INFO:tasks.workunit.client.0.smithi038.stdout:8/25: creat d1/fc x:0 0 0 2024-09-13T18:30:24.178 INFO:tasks.workunit.client.0.smithi038.stdout:8/26: dread - d1/f3 zero size 2024-09-13T18:30:24.179 INFO:tasks.workunit.client.0.smithi038.stdout:8/27: write d1/d4/fa [491085,87204] 0 2024-09-13T18:30:24.180 INFO:tasks.workunit.client.0.smithi038.stdout:1/46: mknod cd 0 2024-09-13T18:30:24.182 INFO:tasks.workunit.client.0.smithi038.stdout:5/14: mknod c6 0 2024-09-13T18:30:24.182 INFO:tasks.workunit.client.0.smithi038.stdout:5/15: fdatasync f1 0 2024-09-13T18:30:24.182 INFO:tasks.workunit.client.0.smithi038.stdout:5/16: creat f7 x:0 0 0 2024-09-13T18:30:24.182 INFO:tasks.workunit.client.0.smithi038.stdout:5/17: chown c6 2681646 1 2024-09-13T18:30:24.182 INFO:tasks.workunit.client.0.smithi038.stdout:5/18: chown f2 5995 1 2024-09-13T18:30:24.182 INFO:tasks.workunit.client.0.smithi038.stdout:5/19: creat f8 x:0 0 0 2024-09-13T18:30:24.183 INFO:tasks.workunit.client.0.smithi038.stdout:2/17: symlink d2/l4 0 2024-09-13T18:30:24.183 INFO:tasks.workunit.client.1.smithi149.stdout:0/538: dwrite d1/d29/f7a [0,4194304] 0 2024-09-13T18:30:24.183 INFO:tasks.workunit.client.0.smithi038.stdout:1/47: write f3 [2093577,24553] 0 2024-09-13T18:30:24.185 INFO:tasks.workunit.client.1.smithi149.stdout:3/535: dwrite d1/d2e/d1d/f51 [0,4194304] 0 2024-09-13T18:30:24.185 INFO:tasks.workunit.client.1.smithi149.stdout:3/536: write d1/d2c/d38/fa9 [349556,1539] 0 2024-09-13T18:30:24.187 INFO:tasks.workunit.client.1.smithi149.stdout:6/666: dwrite dc/d15/d23/f58 [0,4194304] 0 2024-09-13T18:30:24.187 INFO:tasks.workunit.client.1.smithi149.stdout:6/667: write dc/d2f/d75/f7e [684512,65314] 0 2024-09-13T18:30:24.187 INFO:tasks.workunit.client.0.smithi038.stdout:5/20: link f1 f9 0 2024-09-13T18:30:24.193 INFO:tasks.workunit.client.0.smithi038.stdout:2/18: creat d2/f5 x:0 0 0 2024-09-13T18:30:24.193 INFO:tasks.workunit.client.0.smithi038.stdout:2/19: write d2/f5 [971695,32243] 0 2024-09-13T18:30:24.193 INFO:tasks.workunit.client.0.smithi038.stdout:2/20: readlink d2/l3 0 2024-09-13T18:30:24.193 INFO:tasks.workunit.client.0.smithi038.stdout:2/21: chown d2/f5 40407 1 2024-09-13T18:30:24.193 INFO:tasks.workunit.client.0.smithi038.stdout:2/22: write d2/f5 [1896323,6020] 0 2024-09-13T18:30:24.194 INFO:tasks.workunit.client.0.smithi038.stdout:5/21: mknod ca 0 2024-09-13T18:30:24.194 INFO:tasks.workunit.client.0.smithi038.stdout:5/22: read - f1 zero size 2024-09-13T18:30:24.194 INFO:tasks.workunit.client.0.smithi038.stdout:5/23: stat f8 0 2024-09-13T18:30:24.195 INFO:tasks.workunit.client.0.smithi038.stdout:5/24: chown ca 63258 1 2024-09-13T18:30:24.195 INFO:tasks.workunit.client.0.smithi038.stdout:5/25: chown c5 4884 1 2024-09-13T18:30:24.195 INFO:tasks.workunit.client.1.smithi149.stdout:1/571: dwrite d9/d15/d60/d80/d8b/d42/f5b [0,4194304] 0 2024-09-13T18:30:24.195 INFO:tasks.workunit.client.1.smithi149.stdout:3/537: rename d1/d12/l7a to d1/d2e/d1d/d9a/lb1 0 2024-09-13T18:30:24.196 INFO:tasks.workunit.client.1.smithi149.stdout:4/579: dwrite df/da0/d12/d17/d3d/f40 [8388608,4194304] 0 2024-09-13T18:30:24.196 INFO:tasks.workunit.client.0.smithi038.stdout:2/23: symlink d2/l6 0 2024-09-13T18:30:24.198 INFO:tasks.workunit.client.0.smithi038.stdout:2/24: mknod d2/c7 0 2024-09-13T18:30:24.198 INFO:tasks.workunit.client.0.smithi038.stdout:2/25: creat d2/f8 x:0 0 0 2024-09-13T18:30:24.200 INFO:tasks.workunit.client.1.smithi149.stdout:6/668: symlink dc/d15/d23/d57/d5c/ld6 0 2024-09-13T18:30:24.200 INFO:tasks.workunit.client.1.smithi149.stdout:6/669: chown dc/d15/d23/d57/c83 12159 1 2024-09-13T18:30:24.204 INFO:tasks.workunit.client.0.smithi038.stdout:2/26: symlink d2/l9 0 2024-09-13T18:30:24.206 INFO:tasks.workunit.client.1.smithi149.stdout:1/572: mknod d9/d10/d83/d97/cb3 0 2024-09-13T18:30:24.206 INFO:tasks.workunit.client.1.smithi149.stdout:1/573: truncate d9/d10/d62/f99 748783 0 2024-09-13T18:30:24.209 INFO:tasks.workunit.client.1.smithi149.stdout:6/670: rename dc/d15/d54/d5e/d79/fa0 to dc/d15/d23/dcd/fd7 0 2024-09-13T18:30:24.209 INFO:tasks.workunit.client.0.smithi038.stdout:2/27: mkdir d2/da 0 2024-09-13T18:30:24.212 INFO:tasks.workunit.client.1.smithi149.stdout:6/671: mkdir dc/d15/d23/d57/da5/dd8 0 2024-09-13T18:30:24.212 INFO:tasks.workunit.client.0.smithi038.stdout:2/28: symlink d2/lb 0 2024-09-13T18:30:24.214 INFO:tasks.workunit.client.1.smithi149.stdout:1/574: rename d9/d15/d60/da5/la6 to d9/d15/d25/lb4 0 2024-09-13T18:30:24.215 INFO:tasks.workunit.client.1.smithi149.stdout:1/575: truncate d9/d10/d34/f51 3257856 0 2024-09-13T18:30:24.217 INFO:tasks.workunit.client.1.smithi149.stdout:8/513: dwrite d2/d5b/d86/fa7 [0,4194304] 0 2024-09-13T18:30:24.217 INFO:tasks.workunit.client.1.smithi149.stdout:8/514: rename d2/d5b/d88 to d2/d5b/d88/dae 22 2024-09-13T18:30:24.219 INFO:tasks.workunit.client.0.smithi038.stdout:8/28: dread d1/d4/fa [0,4194304] 0 2024-09-13T18:30:24.220 INFO:tasks.workunit.client.0.smithi038.stdout:8/29: dread - d1/fc zero size 2024-09-13T18:30:24.220 INFO:tasks.workunit.client.0.smithi038.stdout:8/30: rename d1 to d1/d8/dd 22 2024-09-13T18:30:24.220 INFO:tasks.workunit.client.1.smithi149.stdout:4/580: dread df/da0/d12/d17/d3d/f40 [4194304,4194304] 0 2024-09-13T18:30:24.220 INFO:tasks.workunit.client.1.smithi149.stdout:4/581: write df/da0/d12/d17/d3d/fa7 [700906,17334] 0 2024-09-13T18:30:24.221 INFO:tasks.workunit.client.1.smithi149.stdout:8/515: getdents d2/d5b 0 2024-09-13T18:30:24.221 INFO:tasks.workunit.client.1.smithi149.stdout:5/524: dwrite d3/d10/d32/f2e [0,4194304] 0 2024-09-13T18:30:24.221 INFO:tasks.workunit.client.1.smithi149.stdout:8/516: chown d2/d5b/d88/fa2 2 1 2024-09-13T18:30:24.222 INFO:tasks.workunit.client.0.smithi038.stdout:4/133: dread d2/f19 [0,4194304] 0 2024-09-13T18:30:24.222 INFO:tasks.workunit.client.0.smithi038.stdout:4/134: chown d2/df/d22/f29 3833 1 2024-09-13T18:30:24.229 INFO:tasks.workunit.client.0.smithi038.stdout:4/135: creat d2/df/d22/dc/f2c x:0 0 0 2024-09-13T18:30:24.230 INFO:tasks.workunit.client.1.smithi149.stdout:5/525: creat d3/d10/d4c/d4e/da4/fa6 x:0 0 0 2024-09-13T18:30:24.231 INFO:tasks.workunit.client.1.smithi149.stdout:5/526: truncate d3/d8/d13/f6c 4927666 0 2024-09-13T18:30:24.231 INFO:tasks.workunit.client.1.smithi149.stdout:5/527: chown d3/d10/d32/f45 0 1 2024-09-13T18:30:24.231 INFO:tasks.workunit.client.1.smithi149.stdout:6/672: write dc/d15/d23/d57/d5c/f84 [164953,47691] 0 2024-09-13T18:30:24.245 INFO:tasks.workunit.client.1.smithi149.stdout:7/634: dwrite d7/d9/d1b/f57 [0,4194304] 0 2024-09-13T18:30:24.245 INFO:tasks.workunit.client.1.smithi149.stdout:1/576: write d9/d15/f5e [1887722,123356] 0 2024-09-13T18:30:24.245 INFO:tasks.workunit.client.1.smithi149.stdout:7/635: write d7/d76/db3/d31/f5b [9322678,106313] 0 2024-09-13T18:30:24.245 INFO:tasks.workunit.client.1.smithi149.stdout:7/636: chown d7/d9/d1c/d1f/d3d/fa7 3539605 1 2024-09-13T18:30:24.245 INFO:tasks.workunit.client.1.smithi149.stdout:7/637: creat d7/d9/d1c/d51/d52/d86/fda x:0 0 0 2024-09-13T18:30:24.245 INFO:tasks.workunit.client.1.smithi149.stdout:7/638: fdatasync d7/d9/d1c/d34/f5d 0 2024-09-13T18:30:24.247 INFO:tasks.workunit.client.0.smithi038.stdout:5/26: dwrite f8 [0,4194304] 0 2024-09-13T18:30:24.248 INFO:tasks.workunit.client.1.smithi149.stdout:3/538: dwrite d1/f24 [0,4194304] 0 2024-09-13T18:30:24.248 INFO:tasks.workunit.client.1.smithi149.stdout:8/517: dwrite d2/d5b/d88/fa2 [0,4194304] 0 2024-09-13T18:30:24.249 INFO:tasks.workunit.client.0.smithi038.stdout:1/48: dwrite fb [0,4194304] 0 2024-09-13T18:30:24.249 INFO:tasks.workunit.client.1.smithi149.stdout:2/521: dwrite db/d10/f72 [0,4194304] 0 2024-09-13T18:30:24.251 INFO:tasks.workunit.client.1.smithi149.stdout:7/639: mkdir d7/d76/db3/d31/ddb 0 2024-09-13T18:30:24.258 INFO:tasks.workunit.client.0.smithi038.stdout:3/12: fsync d0/f4 0 2024-09-13T18:30:24.261 INFO:tasks.workunit.client.0.smithi038.stdout:5/27: fsync f7 0 2024-09-13T18:30:24.261 INFO:tasks.workunit.client.0.smithi038.stdout:5/28: creat fb x:0 0 0 2024-09-13T18:30:24.265 INFO:tasks.workunit.client.0.smithi038.stdout:3/13: mknod d0/c5 0 2024-09-13T18:30:24.265 INFO:tasks.workunit.client.0.smithi038.stdout:3/14: creat d0/f6 x:0 0 0 2024-09-13T18:30:24.265 INFO:tasks.workunit.client.0.smithi038.stdout:3/15: write d0/f2 [1131494,122581] 0 2024-09-13T18:30:24.265 INFO:tasks.workunit.client.0.smithi038.stdout:2/29: fsync d2/f5 0 2024-09-13T18:30:24.265 INFO:tasks.workunit.client.0.smithi038.stdout:2/30: dread - d2/f8 zero size 2024-09-13T18:30:24.267 INFO:tasks.workunit.client.1.smithi149.stdout:8/518: rename d2/d52/f74 to d2/d13/d3a/d7f/d8d/faf 0 2024-09-13T18:30:24.267 INFO:tasks.workunit.client.0.smithi038.stdout:5/29: symlink lc 0 2024-09-13T18:30:24.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:23 smithi149 ceph-mon[35845]: pgmap v14: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 118 MiB/s rd, 149 MiB/s wr, 616 op/s 2024-09-13T18:30:24.271 INFO:tasks.workunit.client.1.smithi149.stdout:2/522: rename db/d1b/d48/f6f to db/d1b/fba 0 2024-09-13T18:30:24.273 INFO:tasks.workunit.client.0.smithi038.stdout:3/16: mknod d0/c7 0 2024-09-13T18:30:24.273 INFO:tasks.workunit.client.0.smithi038.stdout:7/4: dwrite f0 [0,4194304] 0 2024-09-13T18:30:24.273 INFO:tasks.workunit.client.1.smithi149.stdout:4/582: dwrite df/da0/d12/d21/d22/d30/fb7 [0,4194304] 0 2024-09-13T18:30:24.273 INFO:tasks.workunit.client.1.smithi149.stdout:6/673: dwrite dc/d2f/fc6 [0,4194304] 0 2024-09-13T18:30:24.274 INFO:tasks.workunit.client.1.smithi149.stdout:8/519: creat d2/d12/d1b/d66/fb0 x:0 0 0 2024-09-13T18:30:24.274 INFO:tasks.workunit.client.0.smithi038.stdout:2/31: symlink d2/lc 0 2024-09-13T18:30:24.276 INFO:tasks.workunit.client.1.smithi149.stdout:2/523: unlink db/d1b/d1c/l99 0 2024-09-13T18:30:24.277 INFO:tasks.workunit.client.0.smithi038.stdout:5/30: rename f7 to fd 0 2024-09-13T18:30:24.277 INFO:tasks.workunit.client.0.smithi038.stdout:5/31: write f2 [185671,59598] 0 2024-09-13T18:30:24.277 INFO:tasks.workunit.client.0.smithi038.stdout:5/32: fdatasync fb 0 2024-09-13T18:30:24.277 INFO:tasks.workunit.client.0.smithi038.stdout:5/33: chown ca 239 1 2024-09-13T18:30:24.278 INFO:tasks.workunit.client.0.smithi038.stdout:5/34: read - fb zero size 2024-09-13T18:30:24.283 INFO:tasks.workunit.client.1.smithi149.stdout:7/640: dwrite d7/d9/d1c/d34/f5d [4194304,4194304] 0 2024-09-13T18:30:24.285 INFO:tasks.workunit.client.1.smithi149.stdout:6/674: link dc/d70/dbc/cb1 dc/d15/d54/cd9 0 2024-09-13T18:30:24.286 INFO:tasks.workunit.client.1.smithi149.stdout:6/675: creat dc/d70/fda x:0 0 0 2024-09-13T18:30:24.286 INFO:tasks.workunit.client.1.smithi149.stdout:6/676: readlink dc/d15/d23/d57/d5c/l68 0 2024-09-13T18:30:24.286 INFO:tasks.workunit.client.1.smithi149.stdout:6/677: creat dc/d15/d23/d5f/fdb x:0 0 0 2024-09-13T18:30:24.287 INFO:tasks.workunit.client.1.smithi149.stdout:8/520: mkdir d2/db1 0 2024-09-13T18:30:24.287 INFO:tasks.workunit.client.1.smithi149.stdout:8/521: stat d2/d52/c64 0 2024-09-13T18:30:24.287 INFO:tasks.workunit.client.1.smithi149.stdout:8/522: dread - d2/d12/d6e/f91 zero size 2024-09-13T18:30:24.287 INFO:tasks.workunit.client.1.smithi149.stdout:2/524: mknod db/d1b/d1c/d20/d2b/d3e/d95/cbb 0 2024-09-13T18:30:24.288 INFO:tasks.workunit.client.1.smithi149.stdout:2/525: readlink db/d10/d12/l77 0 2024-09-13T18:30:24.289 INFO:tasks.workunit.client.0.smithi038.stdout:7/5: write f0 [1156541,76277] 0 2024-09-13T18:30:24.294 INFO:tasks.workunit.client.0.smithi038.stdout:7/6: rename f0 to f1 0 2024-09-13T18:30:24.294 INFO:tasks.workunit.client.0.smithi038.stdout:7/7: stat f1 0 2024-09-13T18:30:24.294 INFO:tasks.workunit.client.0.smithi038.stdout:7/8: write f1 [583612,93340] 0 2024-09-13T18:30:24.298 INFO:tasks.workunit.client.1.smithi149.stdout:6/678: symlink dc/d8c/ldc 0 2024-09-13T18:30:24.299 INFO:tasks.workunit.client.1.smithi149.stdout:2/526: rmdir db/d1b/d1c/d20/d2b/d3e/d95/db5 0 2024-09-13T18:30:24.299 INFO:tasks.workunit.client.1.smithi149.stdout:8/523: dread d2/f34 [0,4194304] 0 2024-09-13T18:30:24.302 INFO:tasks.workunit.client.1.smithi149.stdout:6/679: truncate dc/d15/d23/f3e 2681088 0 2024-09-13T18:30:24.305 INFO:tasks.workunit.client.1.smithi149.stdout:7/641: rename d7/d9/d1c/d1f/d47 to d7/d9/d1b/d71/ddc 0 2024-09-13T18:30:24.305 INFO:tasks.workunit.client.1.smithi149.stdout:6/680: mknod dc/d15/d54/da9/db3/cdd 0 2024-09-13T18:30:24.311 INFO:tasks.workunit.client.1.smithi149.stdout:4/583: truncate df/da0/d1c/f42 10938560 0 2024-09-13T18:30:24.311 INFO:tasks.workunit.client.1.smithi149.stdout:4/584: write df/da0/d1c/f92 [1002944,99719] 0 2024-09-13T18:30:24.311 INFO:tasks.workunit.client.0.smithi038.stdout:1/49: write fb [4397183,115560] 0 2024-09-13T18:30:24.311 INFO:tasks.workunit.client.0.smithi038.stdout:1/50: write f4 [1242091,31107] 0 2024-09-13T18:30:24.312 INFO:tasks.workunit.client.0.smithi038.stdout:8/31: write d1/fb [2563432,6059] 0 2024-09-13T18:30:24.312 INFO:tasks.workunit.client.0.smithi038.stdout:8/32: write d1/fb [4680960,79932] 0 2024-09-13T18:30:24.313 INFO:tasks.workunit.client.0.smithi038.stdout:8/33: chown d1/d4/fa 0 1 2024-09-13T18:30:24.313 INFO:tasks.workunit.client.0.smithi038.stdout:8/34: chown f0 407 1 2024-09-13T18:30:24.314 INFO:tasks.workunit.client.1.smithi149.stdout:7/642: creat d7/d9/d1b/d71/ddc/d53/dbe/fdd x:0 0 0 2024-09-13T18:30:24.315 INFO:tasks.workunit.client.0.smithi038.stdout:1/51: creat fe x:0 0 0 2024-09-13T18:30:24.315 INFO:tasks.workunit.client.0.smithi038.stdout:1/52: fdatasync f3 0 2024-09-13T18:30:24.315 INFO:tasks.workunit.client.0.smithi038.stdout:1/53: rmdir - no directory 2024-09-13T18:30:24.316 INFO:tasks.workunit.client.1.smithi149.stdout:6/681: rmdir dc/d15 39 2024-09-13T18:30:24.317 INFO:tasks.workunit.client.0.smithi038.stdout:8/35: mkdir d1/de 0 2024-09-13T18:30:24.317 INFO:tasks.workunit.client.0.smithi038.stdout:8/36: creat d1/ff x:0 0 0 2024-09-13T18:30:24.317 INFO:tasks.workunit.client.0.smithi038.stdout:8/37: write d1/f7 [886995,37698] 0 2024-09-13T18:30:24.317 INFO:tasks.workunit.client.1.smithi149.stdout:7/643: mkdir d7/d9/d11/d50/dde 0 2024-09-13T18:30:24.320 INFO:tasks.workunit.client.1.smithi149.stdout:7/644: mkdir d7/d76/db3/da4/ddf 0 2024-09-13T18:30:24.320 INFO:tasks.workunit.client.1.smithi149.stdout:7/645: chown d7/d9/d1c/d51/d52/d86/da3/lac 110303 1 2024-09-13T18:30:24.321 INFO:tasks.workunit.client.0.smithi038.stdout:5/35: dwrite f3 [0,4194304] 0 2024-09-13T18:30:24.321 INFO:tasks.workunit.client.0.smithi038.stdout:5/36: chown lc 38 1 2024-09-13T18:30:24.321 INFO:tasks.workunit.client.0.smithi038.stdout:5/37: creat fe x:0 0 0 2024-09-13T18:30:24.322 INFO:tasks.workunit.client.1.smithi149.stdout:1/577: dwrite d9/d10/d34/f51 [0,4194304] 0 2024-09-13T18:30:24.322 INFO:tasks.workunit.client.0.smithi038.stdout:8/38: creat d1/de/f10 x:0 0 0 2024-09-13T18:30:24.323 INFO:tasks.workunit.client.0.smithi038.stdout:3/17: dwrite d0/f2 [0,4194304] 0 2024-09-13T18:30:24.331 INFO:tasks.workunit.client.1.smithi149.stdout:9/431: sync 2024-09-13T18:30:24.331 INFO:tasks.workunit.client.1.smithi149.stdout:9/432: write d0/d2e/d42/d59/f69 [1394127,85308] 0 2024-09-13T18:30:24.331 INFO:tasks.workunit.client.1.smithi149.stdout:9/433: chown d0/d47/d61/c82 29 1 2024-09-13T18:30:24.334 INFO:tasks.workunit.client.1.smithi149.stdout:9/434: chown d0/d18/d19/c52 59 1 2024-09-13T18:30:24.334 INFO:tasks.workunit.client.1.smithi149.stdout:9/435: creat d0/f8a x:0 0 0 2024-09-13T18:30:24.334 INFO:tasks.workunit.client.1.smithi149.stdout:9/436: chown d0/d2e/f62 854 1 2024-09-13T18:30:24.341 INFO:tasks.workunit.client.0.smithi038.stdout:7/9: fsync f1 0 2024-09-13T18:30:24.342 INFO:tasks.workunit.client.0.smithi038.stdout:7/10: symlink l2 0 2024-09-13T18:30:24.344 INFO:tasks.workunit.client.0.smithi038.stdout:7/11: mknod c3 0 2024-09-13T18:30:24.345 INFO:tasks.workunit.client.1.smithi149.stdout:2/527: rmdir db/d1b/d1c 39 2024-09-13T18:30:24.346 INFO:tasks.workunit.client.0.smithi038.stdout:7/12: symlink l4 0 2024-09-13T18:30:24.346 INFO:tasks.workunit.client.0.smithi038.stdout:7/13: stat f1 0 2024-09-13T18:30:24.346 INFO:tasks.workunit.client.0.smithi038.stdout:7/14: fdatasync f1 0 2024-09-13T18:30:24.346 INFO:tasks.workunit.client.0.smithi038.stdout:7/15: write f1 [3805287,17615] 0 2024-09-13T18:30:24.347 INFO:tasks.workunit.client.0.smithi038.stdout:7/16: creat f5 x:0 0 0 2024-09-13T18:30:24.347 INFO:tasks.workunit.client.0.smithi038.stdout:7/17: rmdir - no directory 2024-09-13T18:30:24.347 INFO:tasks.workunit.client.0.smithi038.stdout:7/18: dread - f5 zero size 2024-09-13T18:30:24.347 INFO:tasks.workunit.client.1.smithi149.stdout:2/528: truncate db/d1b/d1c/f5b 1891044 0 2024-09-13T18:30:24.349 INFO:tasks.workunit.client.0.smithi038.stdout:7/19: symlink l6 0 2024-09-13T18:30:24.353 INFO:tasks.workunit.client.1.smithi149.stdout:2/529: link db/d10/f1a db/d13/d70/dad/fbc 0 2024-09-13T18:30:24.363 INFO:tasks.workunit.client.1.smithi149.stdout:0/539: sync 2024-09-13T18:30:24.363 INFO:tasks.workunit.client.1.smithi149.stdout:0/540: read - d1/d2/d8a/d90/fa5 zero size 2024-09-13T18:30:24.365 INFO:tasks.workunit.client.1.smithi149.stdout:0/541: mkdir d1/d48/d92/db4 0 2024-09-13T18:30:24.365 INFO:tasks.workunit.client.1.smithi149.stdout:0/542: write d1/d29/d31/d44/d81/d9f/fb0 [997229,8827] 0 2024-09-13T18:30:24.365 INFO:tasks.workunit.client.1.smithi149.stdout:0/543: truncate d1/d29/d31/d44/d81/fb3 336730 0 2024-09-13T18:30:24.365 INFO:tasks.workunit.client.1.smithi149.stdout:0/544: truncate d1/d29/d31/d44/d81/fb3 539106 0 2024-09-13T18:30:24.365 INFO:tasks.workunit.client.1.smithi149.stdout:0/545: fsync d1/d2/d8a/d90/f68 0 2024-09-13T18:30:24.366 INFO:tasks.workunit.client.0.smithi038.stdout:1/54: dwrite f8 [0,4194304] 0 2024-09-13T18:30:24.367 INFO:tasks.workunit.client.1.smithi149.stdout:0/546: unlink d1/d48/d92/la7 0 2024-09-13T18:30:24.367 INFO:tasks.workunit.client.1.smithi149.stdout:2/530: write db/d13/f4a [2785918,24882] 0 2024-09-13T18:30:24.367 INFO:tasks.workunit.client.1.smithi149.stdout:2/531: fdatasync db/f7a 0 2024-09-13T18:30:24.367 INFO:tasks.workunit.client.1.smithi149.stdout:1/578: dwrite d9/d15/d60/da5/faf [0,4194304] 0 2024-09-13T18:30:24.367 INFO:tasks.workunit.client.1.smithi149.stdout:7/646: dwrite d7/d76/db3/d31/f3f [0,4194304] 0 2024-09-13T18:30:24.368 INFO:tasks.workunit.client.1.smithi149.stdout:7/647: creat d7/d76/fe0 x:0 0 0 2024-09-13T18:30:24.368 INFO:tasks.workunit.client.0.smithi038.stdout:1/55: creat ff x:0 0 0 2024-09-13T18:30:24.368 INFO:tasks.workunit.client.0.smithi038.stdout:1/56: readlink - no filename 2024-09-13T18:30:24.368 INFO:tasks.workunit.client.0.smithi038.stdout:1/57: chown f4 0 1 2024-09-13T18:30:24.370 INFO:tasks.workunit.client.0.smithi038.stdout:7/20: dwrite f5 [0,4194304] 0 2024-09-13T18:30:24.376 INFO:tasks.workunit.client.0.smithi038.stdout:5/38: dwrite fb [0,4194304] 0 2024-09-13T18:30:24.377 INFO:tasks.workunit.client.1.smithi149.stdout:1/579: rmdir d9/d10/d34/d3c/d50 39 2024-09-13T18:30:24.379 INFO:tasks.workunit.client.1.smithi149.stdout:1/580: getdents d9/d10/d83 0 2024-09-13T18:30:24.379 INFO:tasks.workunit.client.1.smithi149.stdout:1/581: write d9/d10/d34/d53/f9e [894744,13172] 0 2024-09-13T18:30:24.379 INFO:tasks.workunit.client.1.smithi149.stdout:1/582: write d9/d15/d60/d80/d8b/f31 [5044734,895] 0 2024-09-13T18:30:24.380 INFO:tasks.workunit.client.1.smithi149.stdout:0/547: write d1/d29/d31/d44/d81/f97 [1146298,42884] 0 2024-09-13T18:30:24.382 INFO:tasks.workunit.client.1.smithi149.stdout:0/548: mkdir d1/d48/d92/db4/db5 0 2024-09-13T18:30:24.383 INFO:tasks.workunit.client.0.smithi038.stdout:3/18: truncate d0/f2 492888 0 2024-09-13T18:30:24.383 INFO:tasks.workunit.client.1.smithi149.stdout:7/648: write d7/d76/db3/d31/f3f [3635839,92250] 0 2024-09-13T18:30:24.383 INFO:tasks.workunit.client.1.smithi149.stdout:9/437: dwrite d0/f67 [0,4194304] 0 2024-09-13T18:30:24.383 INFO:tasks.workunit.client.1.smithi149.stdout:0/549: mknod d1/d2/d8a/cb6 0 2024-09-13T18:30:24.384 INFO:tasks.workunit.client.0.smithi038.stdout:8/39: truncate f0 3366526 0 2024-09-13T18:30:24.385 INFO:tasks.workunit.client.0.smithi038.stdout:3/19: mknod d0/c8 0 2024-09-13T18:30:24.389 INFO:tasks.workunit.client.1.smithi149.stdout:7/649: creat d7/d9/d1c/d1f/da1/fe1 x:0 0 0 2024-09-13T18:30:24.390 INFO:tasks.workunit.client.0.smithi038.stdout:8/40: read d1/f7 [772649,123971] 0 2024-09-13T18:30:24.391 INFO:tasks.workunit.client.1.smithi149.stdout:2/532: dwrite db/d1b/d1c/d20/d2b/f9e [0,4194304] 0 2024-09-13T18:30:24.391 INFO:tasks.workunit.client.1.smithi149.stdout:2/533: dread - db/d10/f4e zero size 2024-09-13T18:30:24.391 INFO:tasks.workunit.client.0.smithi038.stdout:3/20: rename d0/f6 to d0/f9 0 2024-09-13T18:30:24.392 INFO:tasks.workunit.client.1.smithi149.stdout:9/438: creat d0/d18/d27/f8b x:0 0 0 2024-09-13T18:30:24.393 INFO:tasks.workunit.client.0.smithi038.stdout:7/21: getdents . 0 2024-09-13T18:30:24.395 INFO:tasks.workunit.client.1.smithi149.stdout:0/550: rename d1/d2/l5e to d1/d2/d41/lb7 0 2024-09-13T18:30:24.395 INFO:tasks.workunit.client.1.smithi149.stdout:0/551: creat d1/fb8 x:0 0 0 2024-09-13T18:30:24.396 INFO:tasks.workunit.client.0.smithi038.stdout:8/41: mknod d1/de/c11 0 2024-09-13T18:30:24.396 INFO:tasks.workunit.client.0.smithi038.stdout:8/42: truncate d1/fc 117962 0 2024-09-13T18:30:24.396 INFO:tasks.workunit.client.0.smithi038.stdout:1/58: dwrite f8 [4194304,4194304] 0 2024-09-13T18:30:24.396 INFO:tasks.workunit.client.0.smithi038.stdout:1/59: stat fc 0 2024-09-13T18:30:24.398 INFO:tasks.workunit.client.0.smithi038.stdout:7/22: creat f7 x:0 0 0 2024-09-13T18:30:24.400 INFO:tasks.workunit.client.0.smithi038.stdout:8/43: creat d1/d4/f12 x:0 0 0 2024-09-13T18:30:24.400 INFO:tasks.workunit.client.0.smithi038.stdout:8/44: creat d1/d4/f13 x:0 0 0 2024-09-13T18:30:24.403 INFO:tasks.workunit.client.1.smithi149.stdout:5/528: sync 2024-09-13T18:30:24.403 INFO:tasks.workunit.client.1.smithi149.stdout:3/539: sync 2024-09-13T18:30:24.403 INFO:tasks.workunit.client.1.smithi149.stdout:5/529: creat d3/d10/fa7 x:0 0 0 2024-09-13T18:30:24.403 INFO:tasks.workunit.client.0.smithi038.stdout:1/60: write f8 [8375502,57635] 0 2024-09-13T18:30:24.404 INFO:tasks.workunit.client.1.smithi149.stdout:2/534: unlink db/d1b/d1c/d20/d3a/d75/f8c 0 2024-09-13T18:30:24.405 INFO:tasks.workunit.client.0.smithi038.stdout:8/45: mknod d1/de/c14 0 2024-09-13T18:30:24.407 INFO:tasks.workunit.client.1.smithi149.stdout:9/439: creat d0/d2e/d42/f8c x:0 0 0 2024-09-13T18:30:24.407 INFO:tasks.workunit.client.0.smithi038.stdout:7/23: mkdir d8 0 2024-09-13T18:30:24.409 INFO:tasks.workunit.client.0.smithi038.stdout:1/61: creat f10 x:0 0 0 2024-09-13T18:30:24.411 INFO:tasks.workunit.client.1.smithi149.stdout:0/552: rename d1/d29/d31/d3e/la4 to d1/d29/d31/d44/d81/lb9 0 2024-09-13T18:30:24.411 INFO:tasks.workunit.client.0.smithi038.stdout:3/21: truncate d0/f2 912956 0 2024-09-13T18:30:24.411 INFO:tasks.workunit.client.0.smithi038.stdout:3/22: chown d0/l1 2006656 1 2024-09-13T18:30:24.411 INFO:tasks.workunit.client.0.smithi038.stdout:3/23: creat d0/fa x:0 0 0 2024-09-13T18:30:24.411 INFO:tasks.workunit.client.0.smithi038.stdout:3/24: creat d0/fb x:0 0 0 2024-09-13T18:30:24.412 INFO:tasks.workunit.client.0.smithi038.stdout:3/25: creat d0/fc x:0 0 0 2024-09-13T18:30:24.412 INFO:tasks.workunit.client.0.smithi038.stdout:3/26: dread - d0/fa zero size 2024-09-13T18:30:24.412 INFO:tasks.workunit.client.1.smithi149.stdout:2/535: dread db/d1b/d1c/d20/d2b/db7/f90 [0,4194304] 0 2024-09-13T18:30:24.412 INFO:tasks.workunit.client.1.smithi149.stdout:2/536: chown db/d1b/d1c/d20/d2b/f57 13499 1 2024-09-13T18:30:24.412 INFO:tasks.workunit.client.1.smithi149.stdout:2/537: dread - db/d1b/d48/f9d zero size 2024-09-13T18:30:24.415 INFO:tasks.workunit.client.1.smithi149.stdout:7/650: mkdir d7/d9/d11/de2 0 2024-09-13T18:30:24.419 INFO:tasks.workunit.client.1.smithi149.stdout:5/530: mkdir d3/d10/d4c/d4e/d61/d75/da8 0 2024-09-13T18:30:24.423 INFO:tasks.workunit.client.1.smithi149.stdout:3/540: rename d1/d2e/l13 to d1/d2c/d8b/lb2 0 2024-09-13T18:30:24.424 INFO:tasks.workunit.client.1.smithi149.stdout:0/553: mkdir d1/d29/dad/dba 0 2024-09-13T18:30:24.429 INFO:tasks.workunit.client.1.smithi149.stdout:7/651: mknod d7/d76/db3/ce3 0 2024-09-13T18:30:24.429 INFO:tasks.workunit.client.1.smithi149.stdout:7/652: write d7/f22 [3281386,2200] 0 2024-09-13T18:30:24.429 INFO:tasks.workunit.client.1.smithi149.stdout:0/554: symlink d1/d2/d41/lbb 0 2024-09-13T18:30:24.429 INFO:tasks.workunit.client.1.smithi149.stdout:3/541: mknod d1/d2c/d42/cb3 0 2024-09-13T18:30:24.429 INFO:tasks.workunit.client.1.smithi149.stdout:0/555: truncate d1/d2/d8a/d90/fa5 657971 0 2024-09-13T18:30:24.429 INFO:tasks.workunit.client.1.smithi149.stdout:0/556: stat d1/d29/d31/d44/d81/f63 0 2024-09-13T18:30:24.431 INFO:tasks.workunit.client.1.smithi149.stdout:8/524: sync 2024-09-13T18:30:24.431 INFO:tasks.workunit.client.1.smithi149.stdout:3/542: mknod d1/d12/d20/d54/cb4 0 2024-09-13T18:30:24.435 INFO:tasks.workunit.client.1.smithi149.stdout:2/538: write db/d1b/d2f/d30/f4f [3657779,46480] 0 2024-09-13T18:30:24.435 INFO:tasks.workunit.client.1.smithi149.stdout:7/653: dread d7/f4c [0,4194304] 0 2024-09-13T18:30:24.435 INFO:tasks.workunit.client.1.smithi149.stdout:7/654: readlink d7/d9/d1c/d34/d4e/l63 0 2024-09-13T18:30:24.435 INFO:tasks.workunit.client.1.smithi149.stdout:0/557: creat d1/d2/d41/d46/d7b/fbc x:0 0 0 2024-09-13T18:30:24.437 INFO:tasks.workunit.client.1.smithi149.stdout:7/655: creat d7/d76/db3/da4/ddf/fe4 x:0 0 0 2024-09-13T18:30:24.437 INFO:tasks.workunit.client.1.smithi149.stdout:0/558: write d1/d1b/f3d [361284,106405] 0 2024-09-13T18:30:24.437 INFO:tasks.workunit.client.1.smithi149.stdout:0/559: chown d1/d29/d31/d44/d47 289538875 1 2024-09-13T18:30:24.438 INFO:tasks.workunit.client.1.smithi149.stdout:2/539: link db/d1b/d1c/d20/f45 db/d10/d8d/fbd 0 2024-09-13T18:30:24.440 INFO:tasks.workunit.client.1.smithi149.stdout:7/656: mknod d7/d9/d1c/d51/d52/d86/ce5 0 2024-09-13T18:30:24.442 INFO:tasks.workunit.client.1.smithi149.stdout:0/560: creat d1/d2/d41/d46/d7b/daf/fbd x:0 0 0 2024-09-13T18:30:24.442 INFO:tasks.workunit.client.1.smithi149.stdout:0/561: write d1/d29/d31/d83/fb2 [462169,124928] 0 2024-09-13T18:30:24.442 INFO:tasks.workunit.client.1.smithi149.stdout:2/540: unlink db/d10/l7e 0 2024-09-13T18:30:24.442 INFO:tasks.workunit.client.1.smithi149.stdout:2/541: stat db/d1b/d1c/d20/d2b/d3e/d95/cbb 0 2024-09-13T18:30:24.443 INFO:tasks.workunit.client.1.smithi149.stdout:7/657: rmdir d7/d9/d1c/d1f/d21/d7b 39 2024-09-13T18:30:24.443 INFO:tasks.workunit.client.1.smithi149.stdout:7/658: fdatasync d7/d9/d1c/d51/d52/d86/fb5 0 2024-09-13T18:30:24.443 INFO:tasks.workunit.client.1.smithi149.stdout:7/659: chown d7/d9/d1b/c3b 2598651 1 2024-09-13T18:30:24.444 INFO:tasks.workunit.client.1.smithi149.stdout:7/660: read - d7/d76/db3/fad zero size 2024-09-13T18:30:24.444 INFO:tasks.workunit.client.1.smithi149.stdout:7/661: read - d7/d9/d1c/d1f/da1/fe1 zero size 2024-09-13T18:30:24.444 INFO:tasks.workunit.client.1.smithi149.stdout:7/662: truncate d7/d9/d1c/d51/fa9 857728 0 2024-09-13T18:30:24.444 INFO:tasks.workunit.client.1.smithi149.stdout:0/562: mkdir d1/d48/d92/db4/dbe 0 2024-09-13T18:30:24.444 INFO:tasks.workunit.client.1.smithi149.stdout:0/563: write d1/d1b/f3d [1629422,31463] 0 2024-09-13T18:30:24.446 INFO:tasks.workunit.client.1.smithi149.stdout:7/663: mkdir d7/d9/d1c/d1f/d21/d7b/de6 0 2024-09-13T18:30:24.450 INFO:tasks.workunit.client.1.smithi149.stdout:7/664: link d7/d9/d1c/d34/d4e/l69 d7/d9/d1c/d51/d52/d86/d9f/le7 0 2024-09-13T18:30:24.450 INFO:tasks.workunit.client.1.smithi149.stdout:7/665: read d7/d9/d1c/d1f/d21/f83 [1377695,34405] 0 2024-09-13T18:30:24.451 INFO:tasks.workunit.client.1.smithi149.stdout:3/543: dread d1/d47/d30/d46/f52 [0,4194304] 0 2024-09-13T18:30:24.452 INFO:tasks.workunit.client.1.smithi149.stdout:9/440: dwrite d0/d2e/d42/d70/f7d [0,4194304] 0 2024-09-13T18:30:24.452 INFO:tasks.workunit.client.1.smithi149.stdout:7/666: creat d7/d9/d1b/d71/ddc/fe8 x:0 0 0 2024-09-13T18:30:24.452 INFO:tasks.workunit.client.1.smithi149.stdout:7/667: write d7/d12/f17 [691257,82935] 0 2024-09-13T18:30:24.452 INFO:tasks.workunit.client.1.smithi149.stdout:7/668: write d7/d9/d1c/d1f/d21/f4b [4286923,11176] 0 2024-09-13T18:30:24.453 INFO:tasks.workunit.client.1.smithi149.stdout:9/441: creat d0/d18/d19/d3b/f8d x:0 0 0 2024-09-13T18:30:24.454 INFO:tasks.workunit.client.0.smithi038.stdout:7/24: dwrite f7 [0,4194304] 0 2024-09-13T18:30:24.458 INFO:tasks.workunit.client.1.smithi149.stdout:7/669: symlink d7/d76/db3/da4/le9 0 2024-09-13T18:30:24.461 INFO:tasks.workunit.client.1.smithi149.stdout:9/442: rename d0/d47/d61/f7b to d0/d18/d68/f8e 0 2024-09-13T18:30:24.461 INFO:tasks.workunit.client.1.smithi149.stdout:9/443: chown d0/f9 24721 1 2024-09-13T18:30:24.464 INFO:tasks.workunit.client.0.smithi038.stdout:1/62: dwrite f3 [0,4194304] 0 2024-09-13T18:30:24.470 INFO:tasks.workunit.client.0.smithi038.stdout:3/27: dwrite d0/fa [0,4194304] 0 2024-09-13T18:30:24.470 INFO:tasks.workunit.client.0.smithi038.stdout:3/28: chown d0/l1 2498030 1 2024-09-13T18:30:24.470 INFO:tasks.workunit.client.0.smithi038.stdout:3/29: chown d0/l3 62898 1 2024-09-13T18:30:24.471 INFO:tasks.workunit.client.0.smithi038.stdout:8/46: dwrite d1/fc [0,4194304] 0 2024-09-13T18:30:24.472 INFO:tasks.workunit.client.0.smithi038.stdout:3/30: mkdir d0/dd 0 2024-09-13T18:30:24.474 INFO:tasks.workunit.client.0.smithi038.stdout:8/47: getdents d1/d4 0 2024-09-13T18:30:24.478 INFO:tasks.workunit.client.0.smithi038.stdout:7/25: write f7 [1185877,41360] 0 2024-09-13T18:30:24.478 INFO:tasks.workunit.client.0.smithi038.stdout:7/26: chown d8 0 1 2024-09-13T18:30:24.479 INFO:tasks.workunit.client.1.smithi149.stdout:8/525: dwrite d2/d13/f50 [4194304,4194304] 0 2024-09-13T18:30:24.484 INFO:tasks.workunit.client.1.smithi149.stdout:5/531: fsync d3/d10/fa7 0 2024-09-13T18:30:24.484 INFO:tasks.workunit.client.1.smithi149.stdout:5/532: rename d3 to d3/d10/d32/d54/d97/da9 22 2024-09-13T18:30:24.484 INFO:tasks.workunit.client.1.smithi149.stdout:5/533: readlink d3/d10/d32/d67/l6f 0 2024-09-13T18:30:24.484 INFO:tasks.workunit.client.1.smithi149.stdout:5/534: creat d3/d10/d4c/d4e/d61/d63/faa x:0 0 0 2024-09-13T18:30:24.484 INFO:tasks.workunit.client.1.smithi149.stdout:5/535: chown d3/d10/d32/d54/f9e 363 1 2024-09-13T18:30:24.484 INFO:tasks.workunit.client.1.smithi149.stdout:5/536: chown d3/d10/d4c/d4e 63485087 1 2024-09-13T18:30:24.484 INFO:tasks.workunit.client.1.smithi149.stdout:5/537: fsync d3/f4 0 2024-09-13T18:30:24.487 INFO:tasks.workunit.client.1.smithi149.stdout:5/538: mknod d3/d10/d4c/d4e/d61/cab 0 2024-09-13T18:30:24.489 INFO:tasks.workunit.client.0.smithi038.stdout:7/27: write f5 [1321734,15235] 0 2024-09-13T18:30:24.490 INFO:tasks.workunit.client.1.smithi149.stdout:5/539: symlink d3/d8/lac 0 2024-09-13T18:30:24.490 INFO:tasks.workunit.client.0.smithi038.stdout:7/28: write f1 [4308195,125245] 0 2024-09-13T18:30:24.491 INFO:tasks.workunit.client.0.smithi038.stdout:7/29: rmdir d8 0 2024-09-13T18:30:24.492 INFO:tasks.workunit.client.0.smithi038.stdout:7/30: symlink l9 0 2024-09-13T18:30:24.493 INFO:tasks.workunit.client.0.smithi038.stdout:7/31: write f7 [3487364,41341] 0 2024-09-13T18:30:24.493 INFO:tasks.workunit.client.0.smithi038.stdout:7/32: stat l4 0 2024-09-13T18:30:24.495 INFO:tasks.workunit.client.0.smithi038.stdout:7/33: rename f7 to fa 0 2024-09-13T18:30:24.496 INFO:tasks.workunit.client.1.smithi149.stdout:5/540: dread d3/f4f [0,4194304] 0 2024-09-13T18:30:24.497 INFO:tasks.workunit.client.0.smithi038.stdout:7/34: mkdir db 0 2024-09-13T18:30:24.501 INFO:tasks.workunit.client.1.smithi149.stdout:0/564: dwrite d1/f6a [0,4194304] 0 2024-09-13T18:30:24.501 INFO:tasks.workunit.client.1.smithi149.stdout:0/565: fdatasync d1/d29/f7a 0 2024-09-13T18:30:24.501 INFO:tasks.workunit.client.1.smithi149.stdout:0/566: creat d1/fbf x:0 0 0 2024-09-13T18:30:24.506 INFO:tasks.workunit.client.0.smithi038.stdout:8/48: dread f0 [0,4194304] 0 2024-09-13T18:30:24.506 INFO:tasks.workunit.client.1.smithi149.stdout:2/542: dwrite db/d1b/d1c/d20/d2b/db7/f6d [0,4194304] 0 2024-09-13T18:30:24.506 INFO:tasks.workunit.client.1.smithi149.stdout:2/543: fsync db/d1b/d1c/d20/d2b/db7/f90 0 2024-09-13T18:30:24.507 INFO:tasks.workunit.client.1.smithi149.stdout:2/544: write db/d10/d12/f43 [1034942,69864] 0 2024-09-13T18:30:24.507 INFO:tasks.workunit.client.1.smithi149.stdout:0/567: creat d1/d48/d92/db4/db5/fc0 x:0 0 0 2024-09-13T18:30:24.508 INFO:tasks.workunit.client.0.smithi038.stdout:8/49: mkdir d1/de/d15 0 2024-09-13T18:30:24.511 INFO:tasks.workunit.client.0.smithi038.stdout:1/63: dwrite f4 [0,4194304] 0 2024-09-13T18:30:24.513 INFO:tasks.workunit.client.0.smithi038.stdout:1/64: creat f11 x:0 0 0 2024-09-13T18:30:24.524 INFO:tasks.workunit.client.1.smithi149.stdout:5/541: dwrite d3/f4 [8388608,4194304] 0 2024-09-13T18:30:24.524 INFO:tasks.workunit.client.1.smithi149.stdout:5/542: dread - d3/f5c zero size 2024-09-13T18:30:24.525 INFO:tasks.workunit.client.0.smithi038.stdout:1/65: dread f3 [0,4194304] 0 2024-09-13T18:30:24.526 INFO:tasks.workunit.client.0.smithi038.stdout:1/66: write f10 [456201,53966] 0 2024-09-13T18:30:24.529 INFO:tasks.workunit.client.0.smithi038.stdout:1/67: write fc [462384,84017] 0 2024-09-13T18:30:24.532 INFO:tasks.workunit.client.1.smithi149.stdout:4/585: sync 2024-09-13T18:30:24.534 INFO:tasks.workunit.client.1.smithi149.stdout:4/586: mknod df/da0/d70/db5/db9/cc6 0 2024-09-13T18:30:24.534 INFO:tasks.workunit.client.1.smithi149.stdout:4/587: fdatasync df/da0/d1c/f42 0 2024-09-13T18:30:24.534 INFO:tasks.workunit.client.1.smithi149.stdout:8/526: dwrite d2/d13/fad [0,4194304] 0 2024-09-13T18:30:24.535 INFO:tasks.workunit.client.1.smithi149.stdout:4/588: mkdir df/da0/d70/db5/dc7 0 2024-09-13T18:30:24.535 INFO:tasks.workunit.client.1.smithi149.stdout:4/589: dread - df/da0/d12/d21/d22/d30/d41/fb1 zero size 2024-09-13T18:30:24.536 INFO:tasks.workunit.client.0.smithi038.stdout:1/68: write f3 [2984324,87304] 0 2024-09-13T18:30:24.536 INFO:tasks.workunit.client.1.smithi149.stdout:5/543: dread d3/fd [0,4194304] 0 2024-09-13T18:30:24.536 INFO:tasks.workunit.client.1.smithi149.stdout:5/544: write d3/f41 [1100425,11938] 0 2024-09-13T18:30:24.537 INFO:tasks.workunit.client.1.smithi149.stdout:6/682: sync 2024-09-13T18:30:24.538 INFO:tasks.workunit.client.1.smithi149.stdout:8/527: creat d2/d13/d3a/fb2 x:0 0 0 2024-09-13T18:30:24.538 INFO:tasks.workunit.client.1.smithi149.stdout:6/683: truncate dc/f53 2855792 0 2024-09-13T18:30:24.538 INFO:tasks.workunit.client.1.smithi149.stdout:8/528: truncate d2/d13/f85 938918 0 2024-09-13T18:30:24.538 INFO:tasks.workunit.client.1.smithi149.stdout:6/684: creat dc/d15/d23/fde x:0 0 0 2024-09-13T18:30:24.539 INFO:tasks.workunit.client.1.smithi149.stdout:3/544: dwrite d1/d2e/f55 [0,4194304] 0 2024-09-13T18:30:24.539 INFO:tasks.workunit.client.1.smithi149.stdout:3/545: chown d1/d2c/c8e 1 1 2024-09-13T18:30:24.539 INFO:tasks.workunit.client.1.smithi149.stdout:3/546: fdatasync d1/d2e/d1d/d9a/f5f 0 2024-09-13T18:30:24.539 INFO:tasks.workunit.client.0.smithi038.stdout:3/31: dwrite d0/f9 [0,4194304] 0 2024-09-13T18:30:24.540 INFO:tasks.workunit.client.1.smithi149.stdout:7/670: dwrite d7/d76/db3/d31/f3f [0,4194304] 0 2024-09-13T18:30:24.540 INFO:tasks.workunit.client.1.smithi149.stdout:0/568: dwrite d1/f2b [0,4194304] 0 2024-09-13T18:30:24.540 INFO:tasks.workunit.client.1.smithi149.stdout:9/444: dwrite d0/d2e/d42/d59/f69 [0,4194304] 0 2024-09-13T18:30:24.541 INFO:tasks.workunit.client.1.smithi149.stdout:4/590: mkdir df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3/dc8 0 2024-09-13T18:30:24.541 INFO:tasks.workunit.client.1.smithi149.stdout:4/591: fsync df/fc0 0 2024-09-13T18:30:24.541 INFO:tasks.workunit.client.0.smithi038.stdout:1/69: mkdir d12 0 2024-09-13T18:30:24.542 INFO:tasks.workunit.client.0.smithi038.stdout:7/35: dread f1 [0,4194304] 0 2024-09-13T18:30:24.542 INFO:tasks.workunit.client.0.smithi038.stdout:7/36: truncate f5 4196770 0 2024-09-13T18:30:24.542 INFO:tasks.workunit.client.0.smithi038.stdout:7/37: truncate f5 4886095 0 2024-09-13T18:30:24.542 INFO:tasks.workunit.client.0.smithi038.stdout:7/38: write f5 [639263,68005] 0 2024-09-13T18:30:24.545 INFO:tasks.workunit.client.1.smithi149.stdout:3/547: rename d1/d2e/lf to d1/d2e/d1d/d6c/daa/lb5 0 2024-09-13T18:30:24.545 INFO:tasks.workunit.client.1.smithi149.stdout:3/548: chown d1/d2e/d1d/f23 407997605 1 2024-09-13T18:30:24.547 INFO:tasks.workunit.client.0.smithi038.stdout:1/70: creat d12/f13 x:0 0 0 2024-09-13T18:30:24.548 INFO:tasks.workunit.client.0.smithi038.stdout:8/50: dwrite d1/ff [0,4194304] 0 2024-09-13T18:30:24.549 INFO:tasks.workunit.client.0.smithi038.stdout:7/39: creat db/fc x:0 0 0 2024-09-13T18:30:24.550 INFO:tasks.workunit.client.0.smithi038.stdout:3/32: getdents d0 0 2024-09-13T18:30:24.551 INFO:tasks.workunit.client.1.smithi149.stdout:8/529: dread d2/d12/f5c [0,4194304] 0 2024-09-13T18:30:24.551 INFO:tasks.workunit.client.1.smithi149.stdout:8/530: creat d2/d5b/d86/fb3 x:0 0 0 2024-09-13T18:30:24.551 INFO:tasks.workunit.client.1.smithi149.stdout:0/569: creat d1/d29/d31/d83/d87/fc1 x:0 0 0 2024-09-13T18:30:24.552 INFO:tasks.workunit.client.0.smithi038.stdout:1/71: fdatasync f9 0 2024-09-13T18:30:24.558 INFO:tasks.workunit.client.0.smithi038.stdout:8/51: unlink d1/d8/c9 0 2024-09-13T18:30:24.558 INFO:tasks.workunit.client.0.smithi038.stdout:8/52: fdatasync d1/d4/fa 0 2024-09-13T18:30:24.561 INFO:tasks.workunit.client.0.smithi038.stdout:7/40: rename l4 to db/ld 0 2024-09-13T18:30:24.561 INFO:tasks.workunit.client.0.smithi038.stdout:7/41: fsync f1 0 2024-09-13T18:30:24.563 INFO:tasks.workunit.client.0.smithi038.stdout:3/33: creat d0/dd/fe x:0 0 0 2024-09-13T18:30:24.564 INFO:tasks.workunit.client.0.smithi038.stdout:8/53: symlink d1/l16 0 2024-09-13T18:30:24.566 INFO:tasks.workunit.client.1.smithi149.stdout:8/531: dwrite d2/d5b/d86/f9f [0,4194304] 0 2024-09-13T18:30:24.569 INFO:tasks.workunit.client.1.smithi149.stdout:9/445: mknod d0/d2e/c8f 0 2024-09-13T18:30:24.570 INFO:tasks.workunit.client.1.smithi149.stdout:4/592: rmdir df/da0/d12/d21 39 2024-09-13T18:30:24.574 INFO:tasks.workunit.client.1.smithi149.stdout:6/685: getdents dc/d15/d23/d5b/d91/db0 0 2024-09-13T18:30:24.574 INFO:tasks.workunit.client.1.smithi149.stdout:6/686: chown dc/d70/fda 8422 1 2024-09-13T18:30:24.575 INFO:tasks.workunit.client.0.smithi038.stdout:7/42: link f1 db/fe 0 2024-09-13T18:30:24.579 INFO:tasks.workunit.client.1.smithi149.stdout:7/671: rename d7/d9/d1c/d1f/d21/d7b/d96/d9e/ccb to d7/d9/d1c/d51/d52/d86/d9f/cea 0 2024-09-13T18:30:24.580 INFO:tasks.workunit.client.1.smithi149.stdout:1/583: sync 2024-09-13T18:30:24.584 INFO:tasks.workunit.client.1.smithi149.stdout:4/593: dread df/da0/d12/d21/d22/f7b [0,4194304] 0 2024-09-13T18:30:24.585 INFO:tasks.workunit.client.0.smithi038.stdout:7/43: rename l2 to db/lf 0 2024-09-13T18:30:24.585 INFO:tasks.workunit.client.0.smithi038.stdout:7/44: read db/fe [3203393,11314] 0 2024-09-13T18:30:24.585 INFO:tasks.workunit.client.0.smithi038.stdout:7/45: creat db/f10 x:0 0 0 2024-09-13T18:30:24.586 INFO:tasks.workunit.client.1.smithi149.stdout:8/532: symlink d2/d13/lb4 0 2024-09-13T18:30:24.588 INFO:tasks.workunit.client.1.smithi149.stdout:6/687: symlink dc/d15/d54/d85/dcc/ldf 0 2024-09-13T18:30:24.589 INFO:tasks.workunit.client.1.smithi149.stdout:7/672: creat d7/d9/d1c/d1f/d21/d7b/feb x:0 0 0 2024-09-13T18:30:24.591 INFO:tasks.workunit.client.1.smithi149.stdout:3/549: rename d1/d2e/d1d/d6c/daa/lb5 to d1/d2e/d1d/d9a/lb6 0 2024-09-13T18:30:24.592 INFO:tasks.workunit.client.1.smithi149.stdout:1/584: mkdir d9/d15/d60/d80/d8b/d42/db5 0 2024-09-13T18:30:24.593 INFO:tasks.workunit.client.1.smithi149.stdout:4/594: symlink df/da0/d1c/lc9 0 2024-09-13T18:30:24.593 INFO:tasks.workunit.client.1.smithi149.stdout:4/595: creat df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fca x:0 0 0 2024-09-13T18:30:24.594 INFO:tasks.workunit.client.1.smithi149.stdout:6/688: symlink dc/le0 0 2024-09-13T18:30:24.594 INFO:tasks.workunit.client.1.smithi149.stdout:6/689: dread - dc/d76/fc4 zero size 2024-09-13T18:30:24.594 INFO:tasks.workunit.client.1.smithi149.stdout:6/690: dread - dc/d15/d54/fba zero size 2024-09-13T18:30:24.595 INFO:tasks.workunit.client.0.smithi038.stdout:7/46: dread f1 [0,4194304] 0 2024-09-13T18:30:24.596 INFO:tasks.workunit.client.1.smithi149.stdout:7/673: unlink d7/d9/d1c/d1f/d3d/ld6 0 2024-09-13T18:30:24.596 INFO:tasks.workunit.client.1.smithi149.stdout:0/570: write d1/d29/d31/f52 [2894730,55615] 0 2024-09-13T18:30:24.596 INFO:tasks.workunit.client.1.smithi149.stdout:0/571: write d1/d2/f9e [863316,82903] 0 2024-09-13T18:30:24.596 INFO:tasks.workunit.client.1.smithi149.stdout:3/550: creat d1/d2e/d1d/fb7 x:0 0 0 2024-09-13T18:30:24.597 INFO:tasks.workunit.client.1.smithi149.stdout:1/585: symlink d9/d10/lb6 0 2024-09-13T18:30:24.598 INFO:tasks.workunit.client.0.smithi038.stdout:7/47: rename f1 to db/f11 0 2024-09-13T18:30:24.604 INFO:tasks.workunit.client.1.smithi149.stdout:4/596: read df/da0/d1c/f42 [847464,5204] 0 2024-09-13T18:30:24.605 INFO:tasks.workunit.client.1.smithi149.stdout:6/691: mkdir dc/d15/d23/dcd/de1 0 2024-09-13T18:30:24.605 INFO:tasks.workunit.client.1.smithi149.stdout:3/551: symlink d1/d2e/lb8 0 2024-09-13T18:30:24.605 INFO:tasks.workunit.client.1.smithi149.stdout:6/692: chown dc/d15/cc1 355 1 2024-09-13T18:30:24.605 INFO:tasks.workunit.client.1.smithi149.stdout:3/552: stat d1/d2e/d1d/d9a/fd 0 2024-09-13T18:30:24.605 INFO:tasks.workunit.client.1.smithi149.stdout:1/586: truncate d9/d10/d83/d97/f91 3422968 0 2024-09-13T18:30:24.605 INFO:tasks.workunit.client.1.smithi149.stdout:4/597: mkdir df/da0/d12/d21/d22/d30/d56/d91/dcb 0 2024-09-13T18:30:24.606 INFO:tasks.workunit.client.1.smithi149.stdout:0/572: getdents d1/d29/d31/d83/d87 0 2024-09-13T18:30:24.608 INFO:tasks.workunit.client.1.smithi149.stdout:3/553: mkdir d1/d12/db9 0 2024-09-13T18:30:24.608 INFO:tasks.workunit.client.1.smithi149.stdout:3/554: getdents d1/d2e/d6f/daf 0 2024-09-13T18:30:24.608 INFO:tasks.workunit.client.1.smithi149.stdout:0/573: rmdir d1/d29 39 2024-09-13T18:30:24.608 INFO:tasks.workunit.client.1.smithi149.stdout:3/555: creat d1/d2e/d1d/d6c/fba x:0 0 0 2024-09-13T18:30:24.608 INFO:tasks.workunit.client.1.smithi149.stdout:4/598: mkdir df/da0/dcc 0 2024-09-13T18:30:24.609 INFO:tasks.workunit.client.1.smithi149.stdout:0/574: mkdir d1/d2/d8a/dc2 0 2024-09-13T18:30:24.609 INFO:tasks.workunit.client.1.smithi149.stdout:3/556: creat d1/d2c/d38/d8d/fbb x:0 0 0 2024-09-13T18:30:24.609 INFO:tasks.workunit.client.1.smithi149.stdout:3/557: fsync d1/f58 0 2024-09-13T18:30:24.610 INFO:tasks.workunit.client.1.smithi149.stdout:4/599: creat df/da0/d70/db5/dc7/fcd x:0 0 0 2024-09-13T18:30:24.611 INFO:tasks.workunit.client.1.smithi149.stdout:0/575: getdents d1/d48 0 2024-09-13T18:30:24.613 INFO:tasks.workunit.client.1.smithi149.stdout:0/576: getdents d1/d29/d31/d44/d47 0 2024-09-13T18:30:24.617 INFO:tasks.workunit.client.1.smithi149.stdout:0/577: creat d1/d2/d8a/da9/fc3 x:0 0 0 2024-09-13T18:30:24.618 INFO:tasks.workunit.client.1.smithi149.stdout:0/578: mknod d1/d2/d4e/cc4 0 2024-09-13T18:30:24.619 INFO:tasks.workunit.client.0.smithi038.stdout:7/48: dread f5 [0,4194304] 0 2024-09-13T18:30:24.620 INFO:tasks.workunit.client.1.smithi149.stdout:1/587: dread d9/d15/d60/d80/d8b/f31 [0,4194304] 0 2024-09-13T18:30:24.622 INFO:tasks.workunit.client.1.smithi149.stdout:0/579: mknod d1/d2/d8a/dc2/cc5 0 2024-09-13T18:30:24.624 INFO:tasks.workunit.client.0.smithi038.stdout:7/49: mkdir db/d12 0 2024-09-13T18:30:24.626 INFO:tasks.workunit.client.1.smithi149.stdout:1/588: mkdir d9/d10/d3f/d76/d8c/db7 0 2024-09-13T18:30:24.626 INFO:tasks.workunit.client.1.smithi149.stdout:1/589: write d9/d58/fa9 [1007811,11208] 0 2024-09-13T18:30:24.628 INFO:tasks.workunit.client.1.smithi149.stdout:0/580: symlink d1/d29/d31/d3e/lc6 0 2024-09-13T18:30:24.628 INFO:tasks.workunit.client.1.smithi149.stdout:0/581: readlink d1/d29/d31/d3e/d54/l9a 0 2024-09-13T18:30:24.629 INFO:tasks.workunit.client.0.smithi038.stdout:7/50: mkdir db/d12/d13 0 2024-09-13T18:30:24.629 INFO:tasks.workunit.client.0.smithi038.stdout:8/54: dwrite d1/fb [0,4194304] 0 2024-09-13T18:30:24.631 INFO:tasks.workunit.client.1.smithi149.stdout:1/590: unlink d9/d10/f22 0 2024-09-13T18:30:24.631 INFO:tasks.workunit.client.1.smithi149.stdout:1/591: fsync d9/d10/d34/d53/d57/f98 0 2024-09-13T18:30:24.631 INFO:tasks.workunit.client.1.smithi149.stdout:1/592: readlink d9/d10/d34/l3a 0 2024-09-13T18:30:24.631 INFO:tasks.workunit.client.1.smithi149.stdout:1/593: chown d9/d10/d37 1144 1 2024-09-13T18:30:24.634 INFO:tasks.workunit.client.0.smithi038.stdout:7/51: stat db/lf 0 2024-09-13T18:30:24.635 INFO:tasks.workunit.client.1.smithi149.stdout:9/446: dwrite d0/d2e/f58 [4194304,4194304] 0 2024-09-13T18:30:24.639 INFO:tasks.workunit.client.0.smithi038.stdout:8/55: symlink d1/d8/l17 0 2024-09-13T18:30:24.639 INFO:tasks.workunit.client.0.smithi038.stdout:8/56: chown d1/d4 26 1 2024-09-13T18:30:24.639 INFO:tasks.workunit.client.0.smithi038.stdout:8/57: write d1/f7 [1707778,125744] 0 2024-09-13T18:30:24.640 INFO:tasks.workunit.client.0.smithi038.stdout:7/52: stat c3 0 2024-09-13T18:30:24.642 INFO:tasks.workunit.client.0.smithi038.stdout:8/58: rename f0 to d1/d4/f18 0 2024-09-13T18:30:24.642 INFO:tasks.workunit.client.0.smithi038.stdout:8/59: fdatasync d1/d4/f13 0 2024-09-13T18:30:24.644 INFO:tasks.workunit.client.1.smithi149.stdout:3/558: dwrite d1/d2e/d1d/d49/f8a [0,4194304] 0 2024-09-13T18:30:24.644 INFO:tasks.workunit.client.1.smithi149.stdout:1/594: rmdir d9/d10/d37 39 2024-09-13T18:30:24.644 INFO:tasks.workunit.client.1.smithi149.stdout:6/693: dwrite dc/d8c/fc2 [0,4194304] 0 2024-09-13T18:30:24.645 INFO:tasks.workunit.client.1.smithi149.stdout:6/694: fsync dc/d15/d23/d57/da5/fa7 0 2024-09-13T18:30:24.645 INFO:tasks.workunit.client.1.smithi149.stdout:6/695: write dc/d15/d23/fde [699786,99811] 0 2024-09-13T18:30:24.645 INFO:tasks.workunit.client.1.smithi149.stdout:6/696: readlink dc/d15/d23/l8f 0 2024-09-13T18:30:24.645 INFO:tasks.workunit.client.1.smithi149.stdout:7/674: dwrite d7/f4c [0,4194304] 0 2024-09-13T18:30:24.645 INFO:tasks.workunit.client.1.smithi149.stdout:7/675: write d7/d9/d11/d50/fbf [1135907,71751] 0 2024-09-13T18:30:24.645 INFO:tasks.workunit.client.1.smithi149.stdout:4/600: dwrite df/da0/d12/d21/f8e [4194304,4194304] 0 2024-09-13T18:30:24.645 INFO:tasks.workunit.client.1.smithi149.stdout:9/447: rmdir d0/d18/d19/d3b 39 2024-09-13T18:30:24.645 INFO:tasks.workunit.client.1.smithi149.stdout:1/595: write d9/d10/d34/d53/f9e [743819,26199] 0 2024-09-13T18:30:24.646 INFO:tasks.workunit.client.0.smithi038.stdout:8/60: creat d1/d8/f19 x:0 0 0 2024-09-13T18:30:24.649 INFO:tasks.workunit.client.1.smithi149.stdout:3/559: rmdir d1/d2c/d56/d9f 0 2024-09-13T18:30:24.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/61: mknod d1/c1a 0 2024-09-13T18:30:24.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/62: chown d1/d4/f13 5080882 1 2024-09-13T18:30:24.653 INFO:tasks.workunit.client.0.smithi038.stdout:8/63: creat d1/de/d15/f1b x:0 0 0 2024-09-13T18:30:24.653 INFO:tasks.workunit.client.0.smithi038.stdout:8/64: creat d1/de/d15/f1c x:0 0 0 2024-09-13T18:30:24.655 INFO:tasks.workunit.client.1.smithi149.stdout:6/697: creat dc/d15/d54/d85/dcc/fe2 x:0 0 0 2024-09-13T18:30:24.656 INFO:tasks.workunit.client.1.smithi149.stdout:0/582: rmdir d1/d2/d8a/da9 39 2024-09-13T18:30:24.658 INFO:tasks.workunit.client.1.smithi149.stdout:7/676: rmdir d7/d9/d1c/d1f/d21/d7b/d96 39 2024-09-13T18:30:24.660 INFO:tasks.workunit.client.1.smithi149.stdout:1/596: dread d9/d10/d37/d38/f9c [0,4194304] 0 2024-09-13T18:30:24.660 INFO:tasks.workunit.client.1.smithi149.stdout:1/597: fsync d9/d10/d34/d53/d57/d6c/fb2 0 2024-09-13T18:30:24.663 INFO:tasks.workunit.client.1.smithi149.stdout:3/560: dread d1/d2e/d1d/f6b [0,4194304] 0 2024-09-13T18:30:24.663 INFO:tasks.workunit.client.1.smithi149.stdout:7/677: write d7/d9/d1c/d1f/d21/fb8 [648123,112872] 0 2024-09-13T18:30:24.669 INFO:tasks.workunit.client.1.smithi149.stdout:4/601: rmdir df/da0/d12/d21/d22/d30/d56 39 2024-09-13T18:30:24.669 INFO:tasks.workunit.client.1.smithi149.stdout:6/698: symlink dc/d15/daa/le3 0 2024-09-13T18:30:24.669 INFO:tasks.workunit.client.1.smithi149.stdout:6/699: fdatasync dc/d15/d23/d5b/f52 0 2024-09-13T18:30:24.669 INFO:tasks.workunit.client.1.smithi149.stdout:3/561: read d1/d47/f92 [28365,122425] 0 2024-09-13T18:30:24.669 INFO:tasks.workunit.client.1.smithi149.stdout:0/583: mknod d1/d29/dad/dba/cc7 0 2024-09-13T18:30:24.670 INFO:tasks.workunit.client.0.smithi038.stdout:8/65: dread d1/ff [0,4194304] 0 2024-09-13T18:30:24.670 INFO:tasks.workunit.client.0.smithi038.stdout:8/66: creat d1/de/d15/f1d x:0 0 0 2024-09-13T18:30:24.670 INFO:tasks.workunit.client.0.smithi038.stdout:8/67: creat d1/f1e x:0 0 0 2024-09-13T18:30:24.670 INFO:tasks.workunit.client.0.smithi038.stdout:8/68: write d1/f7 [1778105,53] 0 2024-09-13T18:30:24.670 INFO:tasks.workunit.client.1.smithi149.stdout:1/598: truncate d9/d10/d34/d53/d57/d6c/fb2 2419477 0 2024-09-13T18:30:24.671 INFO:tasks.workunit.client.1.smithi149.stdout:0/584: rmdir d1/d29 39 2024-09-13T18:30:24.672 INFO:tasks.workunit.client.1.smithi149.stdout:0/585: creat d1/d1b/fc8 x:0 0 0 2024-09-13T18:30:24.672 INFO:tasks.workunit.client.1.smithi149.stdout:0/586: write d1/f42 [1318643,39886] 0 2024-09-13T18:30:24.677 INFO:tasks.workunit.client.1.smithi149.stdout:1/599: rmdir d9/d10/d3f/d76/dad 0 2024-09-13T18:30:24.680 INFO:tasks.workunit.client.1.smithi149.stdout:4/602: dread df/da0/d1c/f67 [0,4194304] 0 2024-09-13T18:30:24.680 INFO:tasks.workunit.client.1.smithi149.stdout:4/603: write df/da0/d12/d21/f24 [667453,41471] 0 2024-09-13T18:30:24.680 INFO:tasks.workunit.client.1.smithi149.stdout:4/604: readlink df/da0/d12/d21/l94 0 2024-09-13T18:30:24.681 INFO:tasks.workunit.client.0.smithi038.stdout:8/69: unlink d1/fb 0 2024-09-13T18:30:24.681 INFO:tasks.workunit.client.0.smithi038.stdout:8/70: chown d1/l6 28628700 1 2024-09-13T18:30:24.681 INFO:tasks.workunit.client.1.smithi149.stdout:3/562: dread d1/d2e/f55 [0,4194304] 0 2024-09-13T18:30:24.681 INFO:tasks.workunit.client.0.smithi038.stdout:7/53: dwrite db/f11 [0,4194304] 0 2024-09-13T18:30:24.682 INFO:tasks.workunit.client.0.smithi038.stdout:7/54: creat db/f14 x:0 0 0 2024-09-13T18:30:24.682 INFO:tasks.workunit.client.0.smithi038.stdout:7/55: write db/f14 [178402,29124] 0 2024-09-13T18:30:24.682 INFO:tasks.workunit.client.0.smithi038.stdout:7/56: readlink l9 0 2024-09-13T18:30:24.683 INFO:tasks.workunit.client.1.smithi149.stdout:0/587: mknod d1/d48/d92/db4/dbe/cc9 0 2024-09-13T18:30:24.685 INFO:tasks.workunit.client.1.smithi149.stdout:1/600: link d9/d10/d34/d53/d57/f65 d9/d15/d40/d90/fb8 0 2024-09-13T18:30:24.687 INFO:tasks.workunit.client.0.smithi038.stdout:8/71: rename d1/d4/f18 to d1/d8/f1f 0 2024-09-13T18:30:24.687 INFO:tasks.workunit.client.0.smithi038.stdout:8/72: stat d1/de/d15/f1c 0 2024-09-13T18:30:24.687 INFO:tasks.workunit.client.0.smithi038.stdout:8/73: creat d1/de/d15/f20 x:0 0 0 2024-09-13T18:30:24.693 INFO:tasks.workunit.client.1.smithi149.stdout:5/545: sync 2024-09-13T18:30:24.693 INFO:tasks.workunit.client.1.smithi149.stdout:2/545: sync 2024-09-13T18:30:24.694 INFO:tasks.workunit.client.1.smithi149.stdout:8/533: sync 2024-09-13T18:30:24.694 INFO:tasks.workunit.client.1.smithi149.stdout:8/534: creat d2/d13/d3a/d7f/fb5 x:0 0 0 2024-09-13T18:30:24.694 INFO:tasks.workunit.client.1.smithi149.stdout:2/546: write db/d1b/d1c/d20/d3a/d75/f82 [102224,65251] 0 2024-09-13T18:30:24.694 INFO:tasks.workunit.client.1.smithi149.stdout:2/547: readlink db/d1b/d1c/d85/l9f 0 2024-09-13T18:30:24.697 INFO:tasks.workunit.client.0.smithi038.stdout:8/74: mkdir d1/de/d21 0 2024-09-13T18:30:24.697 INFO:tasks.workunit.client.0.smithi038.stdout:8/75: truncate d1/ff 4784505 0 2024-09-13T18:30:24.697 INFO:tasks.workunit.client.0.smithi038.stdout:8/76: dread - d1/de/f10 zero size 2024-09-13T18:30:24.700 INFO:tasks.workunit.client.1.smithi149.stdout:4/605: read df/da0/d12/d17/f3a [1584141,84615] 0 2024-09-13T18:30:24.700 INFO:tasks.workunit.client.1.smithi149.stdout:4/606: chown df/da0/d12/c51 939176 1 2024-09-13T18:30:24.700 INFO:tasks.workunit.client.1.smithi149.stdout:4/607: read df/da0/d12/d17/d3d/f73 [1812787,46958] 0 2024-09-13T18:30:24.700 INFO:tasks.workunit.client.1.smithi149.stdout:7/678: dwrite d7/d9/d11/f1a [0,4194304] 0 2024-09-13T18:30:24.703 INFO:tasks.workunit.client.1.smithi149.stdout:2/548: dread db/d1b/d1c/d20/f50 [0,4194304] 0 2024-09-13T18:30:24.703 INFO:tasks.workunit.client.1.smithi149.stdout:1/601: unlink d9/d15/d60/d80/cac 0 2024-09-13T18:30:24.704 INFO:tasks.workunit.client.1.smithi149.stdout:5/546: symlink d3/d10/lad 0 2024-09-13T18:30:24.706 INFO:tasks.workunit.client.1.smithi149.stdout:8/535: mkdir d2/d12/d1b/d58/d97/db6 0 2024-09-13T18:30:24.707 INFO:tasks.workunit.client.1.smithi149.stdout:7/679: creat d7/d9/d1c/d51/dd2/fec x:0 0 0 2024-09-13T18:30:24.709 INFO:tasks.workunit.client.1.smithi149.stdout:1/602: creat d9/d10/d34/d3c/d50/fb9 x:0 0 0 2024-09-13T18:30:24.711 INFO:tasks.workunit.client.1.smithi149.stdout:7/680: rename d7/d76/db3/d6f/d9d/fc2 to d7/d9/d1c/d1f/d21/d7b/fed 0 2024-09-13T18:30:24.712 INFO:tasks.workunit.client.1.smithi149.stdout:1/603: mknod d9/d10/d34/cba 0 2024-09-13T18:30:24.712 INFO:tasks.workunit.client.1.smithi149.stdout:1/604: readlink d9/d15/d25/lb4 0 2024-09-13T18:30:24.714 INFO:tasks.workunit.client.1.smithi149.stdout:7/681: mkdir d7/d9/d1c/d2c/d60/dee 0 2024-09-13T18:30:24.715 INFO:tasks.workunit.client.1.smithi149.stdout:1/605: rmdir d9/d10/d37 39 2024-09-13T18:30:24.715 INFO:tasks.workunit.client.0.smithi038.stdout:7/57: dwrite f5 [4194304,4194304] 0 2024-09-13T18:30:24.716 INFO:tasks.workunit.client.1.smithi149.stdout:1/606: symlink d9/d10/d62/lbb 0 2024-09-13T18:30:24.717 INFO:tasks.workunit.client.1.smithi149.stdout:1/607: chown d9/d15/d40/d90/fb8 5154755 1 2024-09-13T18:30:24.717 INFO:tasks.workunit.client.1.smithi149.stdout:1/608: write d9/d10/f1a [2255393,8557] 0 2024-09-13T18:30:24.717 INFO:tasks.workunit.client.1.smithi149.stdout:1/609: write d9/d10/d3f/f67 [3237904,13135] 0 2024-09-13T18:30:24.717 INFO:tasks.workunit.client.1.smithi149.stdout:3/563: dwrite d1/f58 [0,4194304] 0 2024-09-13T18:30:24.721 INFO:tasks.workunit.client.1.smithi149.stdout:4/608: write df/da0/d12/d21/d22/d30/d41/d57/d8a/fa2 [7333034,98926] 0 2024-09-13T18:30:24.721 INFO:tasks.workunit.client.1.smithi149.stdout:4/609: fdatasync df/da0/d12/d21/d22/d30/f37 0 2024-09-13T18:30:24.721 INFO:tasks.workunit.client.1.smithi149.stdout:9/448: dwrite d0/d18/d19/f32 [0,4194304] 0 2024-09-13T18:30:24.724 INFO:tasks.workunit.client.1.smithi149.stdout:3/564: creat d1/d12/db9/fbc x:0 0 0 2024-09-13T18:30:24.724 INFO:tasks.workunit.client.1.smithi149.stdout:9/449: unlink d0/d18/d27/c44 0 2024-09-13T18:30:24.726 INFO:tasks.workunit.client.0.smithi038.stdout:7/58: write f5 [4313413,117834] 0 2024-09-13T18:30:24.726 INFO:tasks.workunit.client.0.smithi038.stdout:7/59: chown db 8324 1 2024-09-13T18:30:24.726 INFO:tasks.workunit.client.1.smithi149.stdout:9/450: mknod d0/d2e/d42/d59/c90 0 2024-09-13T18:30:24.728 INFO:tasks.workunit.client.1.smithi149.stdout:8/536: write d2/d5b/d86/fa7 [1221380,129314] 0 2024-09-13T18:30:24.728 INFO:tasks.workunit.client.1.smithi149.stdout:9/451: creat d0/d18/d27/f91 x:0 0 0 2024-09-13T18:30:24.729 INFO:tasks.workunit.client.1.smithi149.stdout:4/610: dread df/da0/d12/d17/d3d/f5d [4194304,4194304] 0 2024-09-13T18:30:24.732 INFO:tasks.workunit.client.1.smithi149.stdout:5/547: read d3/d10/d32/f2e [2423190,106404] 0 2024-09-13T18:30:24.732 INFO:tasks.workunit.client.1.smithi149.stdout:8/537: mknod d2/d5b/d86/cb7 0 2024-09-13T18:30:24.732 INFO:tasks.workunit.client.1.smithi149.stdout:8/538: truncate d2/d12/f57 4841302 0 2024-09-13T18:30:24.732 INFO:tasks.workunit.client.1.smithi149.stdout:8/539: chown d2/d13/f8b 13 1 2024-09-13T18:30:24.735 INFO:tasks.workunit.client.0.smithi038.stdout:8/77: dwrite d1/d8/f19 [0,4194304] 0 2024-09-13T18:30:24.736 INFO:tasks.workunit.client.1.smithi149.stdout:9/452: mknod d0/c92 0 2024-09-13T18:30:24.737 INFO:tasks.workunit.client.1.smithi149.stdout:9/453: chown d0/d47/c5b 94326 1 2024-09-13T18:30:24.738 INFO:tasks.workunit.client.1.smithi149.stdout:1/610: write d9/d10/d83/d97/f91 [2956133,63604] 0 2024-09-13T18:30:24.738 INFO:tasks.workunit.client.1.smithi149.stdout:0/588: rmdir d1/d48/d92 39 2024-09-13T18:30:24.743 INFO:tasks.workunit.client.1.smithi149.stdout:5/548: rename d3/d10/d32/d67/c6a to d3/d10/d4c/d4e/d61/d75/d88/cae 0 2024-09-13T18:30:24.743 INFO:tasks.workunit.client.1.smithi149.stdout:5/549: dread - d3/d10/d32/d54/d97/f9a zero size 2024-09-13T18:30:24.746 INFO:tasks.workunit.client.1.smithi149.stdout:3/565: write d1/d12/f4c [393162,23881] 0 2024-09-13T18:30:24.746 INFO:tasks.workunit.client.1.smithi149.stdout:3/566: chown d1/d2c/l79 0 1 2024-09-13T18:30:24.746 INFO:tasks.workunit.client.1.smithi149.stdout:2/549: dwrite db/d10/f25 [0,4194304] 0 2024-09-13T18:30:24.746 INFO:tasks.workunit.client.1.smithi149.stdout:2/550: chown db/d1b/d48/f9d 0 1 2024-09-13T18:30:24.746 INFO:tasks.workunit.client.1.smithi149.stdout:2/551: rename db/d1b/d1c/d20/d2b/d3e to db/d1b/d1c/d20/d2b/d3e/d95/dbe 22 2024-09-13T18:30:24.747 INFO:tasks.workunit.client.1.smithi149.stdout:7/682: dwrite f3 [0,4194304] 0 2024-09-13T18:30:24.751 INFO:tasks.workunit.client.1.smithi149.stdout:1/611: creat d9/d10/fbc x:0 0 0 2024-09-13T18:30:24.754 INFO:tasks.workunit.client.1.smithi149.stdout:5/550: creat d3/d10/d4c/d4e/d61/d75/d88/faf x:0 0 0 2024-09-13T18:30:24.755 INFO:tasks.workunit.client.1.smithi149.stdout:2/552: mknod db/d1b/d1c/d20/cbf 0 2024-09-13T18:30:24.757 INFO:tasks.workunit.client.1.smithi149.stdout:7/683: mknod d7/d76/db3/da4/ddf/cef 0 2024-09-13T18:30:24.762 INFO:tasks.workunit.client.1.smithi149.stdout:5/551: creat d3/d10/d32/d67/d83/fb0 x:0 0 0 2024-09-13T18:30:24.762 INFO:tasks.workunit.client.1.smithi149.stdout:5/552: write d3/d10/d4c/d4e/da4/fa6 [876198,117057] 0 2024-09-13T18:30:24.763 INFO:tasks.workunit.client.1.smithi149.stdout:5/553: truncate d3/d10/d32/d54/d76/fa0 76068 0 2024-09-13T18:30:24.763 INFO:tasks.workunit.client.1.smithi149.stdout:1/612: rmdir d9/d10/d3f 39 2024-09-13T18:30:24.763 INFO:tasks.workunit.client.1.smithi149.stdout:1/613: write d9/d10/d3f/f67 [2977908,110481] 0 2024-09-13T18:30:24.765 INFO:tasks.workunit.client.1.smithi149.stdout:1/614: rename d9/d10/d43/l4b to d9/d15/d60/d80/d8b/lbd 0 2024-09-13T18:30:24.767 INFO:tasks.workunit.client.1.smithi149.stdout:1/615: rename d9/d10/d37 to d9/d10/d34/dbe 0 2024-09-13T18:30:24.767 INFO:tasks.workunit.client.0.smithi038.stdout:7/60: dwrite f5 [0,4194304] 0 2024-09-13T18:30:24.769 INFO:tasks.workunit.client.1.smithi149.stdout:1/616: link d9/d15/c46 d9/cbf 0 2024-09-13T18:30:24.769 INFO:tasks.workunit.client.1.smithi149.stdout:1/617: readlink d9/lb 0 2024-09-13T18:30:24.769 INFO:tasks.workunit.client.1.smithi149.stdout:0/589: read d1/f2b [756631,114264] 0 2024-09-13T18:30:24.771 INFO:tasks.workunit.client.0.smithi038.stdout:7/61: link l6 db/l15 0 2024-09-13T18:30:24.772 INFO:tasks.workunit.client.1.smithi149.stdout:5/554: dread d3/f4f [0,4194304] 0 2024-09-13T18:30:24.772 INFO:tasks.workunit.client.1.smithi149.stdout:5/555: write d3/d10/d32/d54/f2a [890296,9109] 0 2024-09-13T18:30:24.772 INFO:tasks.workunit.client.1.smithi149.stdout:5/556: fsync d3/d10/d32/d54/f7c 0 2024-09-13T18:30:24.772 INFO:tasks.workunit.client.0.smithi038.stdout:7/62: mknod db/c16 0 2024-09-13T18:30:24.773 INFO:tasks.workunit.client.1.smithi149.stdout:0/590: creat d1/d48/d92/db4/dbe/fca x:0 0 0 2024-09-13T18:30:24.773 INFO:tasks.workunit.client.0.smithi038.stdout:7/63: unlink fa 0 2024-09-13T18:30:24.776 INFO:tasks.workunit.client.1.smithi149.stdout:8/540: dwrite d2/d5b/d86/f9f [0,4194304] 0 2024-09-13T18:30:24.776 INFO:tasks.workunit.client.1.smithi149.stdout:7/684: dread d7/d9/d1c/d51/d52/d86/fb5 [0,4194304] 0 2024-09-13T18:30:24.776 INFO:tasks.workunit.client.1.smithi149.stdout:7/685: chown d7/d9/d1b/c3b 83363589 1 2024-09-13T18:30:24.776 INFO:tasks.workunit.client.1.smithi149.stdout:8/541: write d2/d12/f9d [1036941,121905] 0 2024-09-13T18:30:24.776 INFO:tasks.workunit.client.1.smithi149.stdout:8/542: fdatasync d2/f34 0 2024-09-13T18:30:24.777 INFO:tasks.workunit.client.1.smithi149.stdout:7/686: creat d7/d9/d1c/d51/d52/d86/d9f/ff0 x:0 0 0 2024-09-13T18:30:24.777 INFO:tasks.workunit.client.1.smithi149.stdout:7/687: truncate d7/d9/d1c/d51/d52/fa0 519519 0 2024-09-13T18:30:24.777 INFO:tasks.workunit.client.1.smithi149.stdout:5/557: truncate d3/d8/fe 3884666 0 2024-09-13T18:30:24.777 INFO:tasks.workunit.client.1.smithi149.stdout:0/591: rmdir d1/d29 39 2024-09-13T18:30:24.778 INFO:tasks.workunit.client.1.smithi149.stdout:0/592: chown d1/d29/d31/d3e/d54 14018952 1 2024-09-13T18:30:24.780 INFO:tasks.workunit.client.1.smithi149.stdout:7/688: mknod d7/d9/d1c/d2c/d60/dc9/cf1 0 2024-09-13T18:30:24.781 INFO:tasks.workunit.client.1.smithi149.stdout:5/558: symlink d3/d10/d4c/d4e/d61/lb1 0 2024-09-13T18:30:24.781 INFO:tasks.workunit.client.1.smithi149.stdout:8/543: getdents d2/d12/d6e 0 2024-09-13T18:30:24.784 INFO:tasks.workunit.client.1.smithi149.stdout:7/689: rename d7/d9/d1b/d71/ddc/d53/l8f to d7/d9/d1c/d51/d52/lf2 0 2024-09-13T18:30:24.784 INFO:tasks.workunit.client.1.smithi149.stdout:5/559: symlink d3/d10/d98/lb2 0 2024-09-13T18:30:24.785 INFO:tasks.workunit.client.1.smithi149.stdout:7/690: link d7/d9/d1b/c3b d7/d9/d1c/d51/cf3 0 2024-09-13T18:30:24.791 INFO:tasks.workunit.client.1.smithi149.stdout:5/560: rmdir d3/d10/d4c/d4e/d61/d75/da8 0 2024-09-13T18:30:24.799 INFO:tasks.workunit.client.1.smithi149.stdout:0/593: write d1/d29/d31/d44/d81/d62/f7f [6296749,116730] 0 2024-09-13T18:30:24.799 INFO:tasks.workunit.client.1.smithi149.stdout:0/594: dread - d1/fbf zero size 2024-09-13T18:30:24.799 INFO:tasks.workunit.client.1.smithi149.stdout:0/595: creat d1/d2/d41/d46/fcb x:0 0 0 2024-09-13T18:30:24.799 INFO:tasks.workunit.client.1.smithi149.stdout:0/596: chown d1/d2/d41/f94 194439 1 2024-09-13T18:30:24.800 INFO:tasks.workunit.client.1.smithi149.stdout:8/544: dread d2/d5b/d88/fa3 [0,4194304] 0 2024-09-13T18:30:24.801 INFO:tasks.workunit.client.1.smithi149.stdout:0/597: symlink d1/d48/d92/db4/lcc 0 2024-09-13T18:30:24.801 INFO:tasks.workunit.client.1.smithi149.stdout:0/598: getdents d1/d29/d31/d44/d81/d62 0 2024-09-13T18:30:24.802 INFO:tasks.workunit.client.1.smithi149.stdout:8/545: mkdir d2/d12/db8 0 2024-09-13T18:30:24.803 INFO:tasks.workunit.client.1.smithi149.stdout:8/546: write d2/d12/d1b/d66/fb0 [625478,93007] 0 2024-09-13T18:30:24.805 INFO:tasks.workunit.client.1.smithi149.stdout:4/611: dwrite df/da0/d12/d21/d22/f62 [0,4194304] 0 2024-09-13T18:30:24.810 INFO:tasks.workunit.client.1.smithi149.stdout:1/618: dwrite d9/d10/d34/d53/d57/fa1 [0,4194304] 0 2024-09-13T18:30:24.814 INFO:tasks.workunit.client.0.smithi038.stdout:8/78: dwrite d1/de/f10 [0,4194304] 0 2024-09-13T18:30:24.817 INFO:tasks.workunit.client.1.smithi149.stdout:3/567: dwrite d1/d2e/d1d/d9a/f5f [0,4194304] 0 2024-09-13T18:30:24.817 INFO:tasks.workunit.client.1.smithi149.stdout:3/568: chown d1/d48/d75 128542 1 2024-09-13T18:30:24.817 INFO:tasks.workunit.client.1.smithi149.stdout:9/454: dwrite d0/d18/d19/f51 [0,4194304] 0 2024-09-13T18:30:24.818 INFO:tasks.workunit.client.1.smithi149.stdout:9/455: fdatasync d0/d18/d27/f66 0 2024-09-13T18:30:24.819 INFO:tasks.workunit.client.1.smithi149.stdout:8/547: dread d2/d12/d40/f75 [0,4194304] 0 2024-09-13T18:30:24.819 INFO:tasks.workunit.client.1.smithi149.stdout:8/548: getdents d2/d5b 0 2024-09-13T18:30:24.820 INFO:tasks.workunit.client.1.smithi149.stdout:8/549: chown d2/d5b/d86/f9f 163097558 1 2024-09-13T18:30:24.820 INFO:tasks.workunit.client.1.smithi149.stdout:7/691: dwrite d7/d76/fe0 [0,4194304] 0 2024-09-13T18:30:24.820 INFO:tasks.workunit.client.0.smithi038.stdout:8/79: creat d1/de/d21/f22 x:0 0 0 2024-09-13T18:30:24.822 INFO:tasks.workunit.client.1.smithi149.stdout:3/569: link d1/d2e/f37 d1/d47/d30/fbd 0 2024-09-13T18:30:24.825 INFO:tasks.workunit.client.0.smithi038.stdout:8/80: getdents d1/de 0 2024-09-13T18:30:24.825 INFO:tasks.workunit.client.0.smithi038.stdout:8/81: chown d1/d4/f13 4022693 1 2024-09-13T18:30:24.825 INFO:tasks.workunit.client.0.smithi038.stdout:8/82: chown d1/ff 48419559 1 2024-09-13T18:30:24.825 INFO:tasks.workunit.client.1.smithi149.stdout:1/619: dread d9/d15/d60/d80/d8b/d42/f6a [0,4194304] 0 2024-09-13T18:30:24.825 INFO:tasks.workunit.client.1.smithi149.stdout:2/553: dwrite db/d13/d70/f7c [0,4194304] 0 2024-09-13T18:30:24.827 INFO:tasks.workunit.client.1.smithi149.stdout:8/550: creat d2/d12/d1b/d58/d97/db6/fb9 x:0 0 0 2024-09-13T18:30:24.830 INFO:tasks.workunit.client.1.smithi149.stdout:9/456: write d0/d47/f65 [7562205,9845] 0 2024-09-13T18:30:24.830 INFO:tasks.workunit.client.1.smithi149.stdout:8/551: link d2/d12/f16 d2/d12/d1b/fba 0 2024-09-13T18:30:24.833 INFO:tasks.workunit.client.1.smithi149.stdout:8/552: mkdir d2/d12/d2a/d4d/dbb 0 2024-09-13T18:30:24.835 INFO:tasks.workunit.client.1.smithi149.stdout:9/457: mkdir d0/d18/d93 0 2024-09-13T18:30:24.836 INFO:tasks.workunit.client.1.smithi149.stdout:3/570: write d1/d2e/d1d/f51 [2440342,81346] 0 2024-09-13T18:30:24.836 INFO:tasks.workunit.client.1.smithi149.stdout:3/571: write d1/d12/f77 [3594390,85353] 0 2024-09-13T18:30:24.839 INFO:tasks.workunit.client.1.smithi149.stdout:7/692: write d7/d9/d1c/d1f/f73 [917294,101037] 0 2024-09-13T18:30:24.839 INFO:tasks.workunit.client.1.smithi149.stdout:3/572: mkdir d1/d12/dbe 0 2024-09-13T18:30:24.841 INFO:tasks.workunit.client.1.smithi149.stdout:8/553: dread d2/fc [0,4194304] 0 2024-09-13T18:30:24.841 INFO:tasks.workunit.client.1.smithi149.stdout:8/554: dread - d2/d5b/d86/fb3 zero size 2024-09-13T18:30:24.841 INFO:tasks.workunit.client.1.smithi149.stdout:8/555: chown d2/d12/d2a/d4d/f79 6912654 1 2024-09-13T18:30:24.842 INFO:tasks.workunit.client.1.smithi149.stdout:6/700: sync 2024-09-13T18:30:24.842 INFO:tasks.workunit.client.1.smithi149.stdout:7/693: mknod d7/d9/d1b/d71/cf4 0 2024-09-13T18:30:24.845 INFO:tasks.workunit.client.1.smithi149.stdout:3/573: creat d1/d2e/d1d/d49/fbf x:0 0 0 2024-09-13T18:30:24.845 INFO:tasks.workunit.client.1.smithi149.stdout:7/694: getdents d7/d9/d1c/d51/d52/d86/da3 0 2024-09-13T18:30:24.845 INFO:tasks.workunit.client.1.smithi149.stdout:7/695: chown d7/d12/l78 108 1 2024-09-13T18:30:24.847 INFO:tasks.workunit.client.1.smithi149.stdout:6/701: rmdir dc/d70/dc7 39 2024-09-13T18:30:24.847 INFO:tasks.workunit.client.1.smithi149.stdout:1/620: write d9/d15/f29 [459052,70353] 0 2024-09-13T18:30:24.847 INFO:tasks.workunit.client.1.smithi149.stdout:1/621: rename d9/d10/d34 to d9/d10/d34/d53/dc0 22 2024-09-13T18:30:24.848 INFO:tasks.workunit.client.1.smithi149.stdout:0/599: dwrite d1/d2/d8a/da9/fc3 [0,4194304] 0 2024-09-13T18:30:24.848 INFO:tasks.workunit.client.1.smithi149.stdout:1/622: chown d9/d10/d83 193201454 1 2024-09-13T18:30:24.848 INFO:tasks.workunit.client.1.smithi149.stdout:1/623: write d9/d10/d83/d97/f91 [1392968,43761] 0 2024-09-13T18:30:24.848 INFO:tasks.workunit.client.1.smithi149.stdout:1/624: chown d9/d10/d34/c59 1094 1 2024-09-13T18:30:24.848 INFO:tasks.workunit.client.1.smithi149.stdout:7/696: unlink d7/d9/d1c/f6a 0 2024-09-13T18:30:24.848 INFO:tasks.workunit.client.1.smithi149.stdout:5/561: dwrite d3/d10/d32/f7e [0,4194304] 0 2024-09-13T18:30:24.848 INFO:tasks.workunit.client.1.smithi149.stdout:4/612: dwrite df/da0/d12/d21/d22/f7b [0,4194304] 0 2024-09-13T18:30:24.850 INFO:tasks.workunit.client.0.smithi038.stdout:8/83: write d1/d8/f19 [2861184,68027] 0 2024-09-13T18:30:24.851 INFO:tasks.workunit.client.1.smithi149.stdout:6/702: write dc/d15/d23/d5f/f67 [532883,25127] 0 2024-09-13T18:30:24.851 INFO:tasks.workunit.client.1.smithi149.stdout:0/600: unlink d1/d1b/l8b 0 2024-09-13T18:30:24.851 INFO:tasks.workunit.client.1.smithi149.stdout:0/601: fsync d1/d48/f80 0 2024-09-13T18:30:24.852 INFO:tasks.workunit.client.1.smithi149.stdout:3/574: dread d1/d47/d30/f71 [4194304,4194304] 0 2024-09-13T18:30:24.852 INFO:tasks.workunit.client.1.smithi149.stdout:3/575: fsync d1/d2e/f37 0 2024-09-13T18:30:24.853 INFO:tasks.workunit.client.1.smithi149.stdout:1/625: rename f3 to d9/d10/d83/d97/fc1 0 2024-09-13T18:30:24.855 INFO:tasks.workunit.client.1.smithi149.stdout:4/613: dread df/da0/d1c/f32 [0,4194304] 0 2024-09-13T18:30:24.856 INFO:tasks.workunit.client.0.smithi038.stdout:8/84: unlink d1/de/d15/f1d 0 2024-09-13T18:30:24.857 INFO:tasks.workunit.client.1.smithi149.stdout:5/562: truncate d3/d10/d4c/f69 3148044 0 2024-09-13T18:30:24.858 INFO:tasks.workunit.client.1.smithi149.stdout:5/563: chown d3/d8/lac 4 1 2024-09-13T18:30:24.861 INFO:tasks.workunit.client.1.smithi149.stdout:6/703: creat dc/d15/d23/d5f/dac/dbd/fe4 x:0 0 0 2024-09-13T18:30:24.861 INFO:tasks.workunit.client.1.smithi149.stdout:2/554: dwrite db/d1b/d1c/d20/d3a/f2e [0,4194304] 0 2024-09-13T18:30:24.861 INFO:tasks.workunit.client.1.smithi149.stdout:2/555: write db/d1b/d1c/d20/f50 [106658,120895] 0 2024-09-13T18:30:24.862 INFO:tasks.workunit.client.1.smithi149.stdout:3/576: creat d1/d2c/d42/fc0 x:0 0 0 2024-09-13T18:30:24.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/564: mknod d3/d10/d4c/d4e/da4/cb3 0 2024-09-13T18:30:24.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/565: chown d3/f4f 663 1 2024-09-13T18:30:24.867 INFO:tasks.workunit.client.1.smithi149.stdout:3/577: symlink d1/d2e/d6f/daf/lc1 0 2024-09-13T18:30:24.867 INFO:tasks.workunit.client.1.smithi149.stdout:2/556: link db/d1b/d1c/d20/f45 db/d1b/d2f/d30/fc0 0 2024-09-13T18:30:24.867 INFO:tasks.workunit.client.1.smithi149.stdout:3/578: chown d1/d12/c84 279861 1 2024-09-13T18:30:24.874 INFO:tasks.workunit.client.1.smithi149.stdout:7/697: dread d7/d9/d11/d50/fbf [0,4194304] 0 2024-09-13T18:30:24.876 INFO:tasks.workunit.client.1.smithi149.stdout:4/614: dread df/da0/f78 [0,4194304] 0 2024-09-13T18:30:24.877 INFO:tasks.workunit.client.1.smithi149.stdout:9/458: dwrite d0/d2e/d42/d59/f69 [0,4194304] 0 2024-09-13T18:30:24.878 INFO:tasks.workunit.client.1.smithi149.stdout:9/459: write d0/f88 [732933,70664] 0 2024-09-13T18:30:24.878 INFO:tasks.workunit.client.1.smithi149.stdout:9/460: truncate d0/f4e 1093438 0 2024-09-13T18:30:24.878 INFO:tasks.workunit.client.1.smithi149.stdout:9/461: rename d0/d47/d54 to d0/d47/d54/d94 22 2024-09-13T18:30:24.878 INFO:tasks.workunit.client.1.smithi149.stdout:9/462: chown d0/d2e/d42/d59/f7c 145 1 2024-09-13T18:30:24.879 INFO:tasks.workunit.client.1.smithi149.stdout:3/579: mkdir d1/d2c/d38/d88/dc2 0 2024-09-13T18:30:24.879 INFO:tasks.workunit.client.1.smithi149.stdout:4/615: creat df/da0/d1c/d69/fce x:0 0 0 2024-09-13T18:30:24.879 INFO:tasks.workunit.client.1.smithi149.stdout:4/616: stat df/l2d 0 2024-09-13T18:30:24.881 INFO:tasks.workunit.client.1.smithi149.stdout:6/704: dread dc/d15/f4d [0,4194304] 0 2024-09-13T18:30:24.881 INFO:tasks.workunit.client.1.smithi149.stdout:6/705: truncate dc/d15/d54/fc3 988403 0 2024-09-13T18:30:24.881 INFO:tasks.workunit.client.1.smithi149.stdout:9/463: rename d0/f72 to d0/d47/d54/d75/f95 0 2024-09-13T18:30:24.882 INFO:tasks.workunit.client.1.smithi149.stdout:9/464: readlink d0/l1f 0 2024-09-13T18:30:24.887 INFO:tasks.workunit.client.1.smithi149.stdout:3/580: link d1/d47/l3a d1/d21/lc3 0 2024-09-13T18:30:24.888 INFO:tasks.workunit.client.1.smithi149.stdout:4/617: mknod df/da0/d1c/d69/ccf 0 2024-09-13T18:30:24.890 INFO:tasks.workunit.client.1.smithi149.stdout:3/581: mknod d1/d47/d30/d5a/cc4 0 2024-09-13T18:30:24.890 INFO:tasks.workunit.client.1.smithi149.stdout:3/582: creat d1/d48/fc5 x:0 0 0 2024-09-13T18:30:24.891 INFO:tasks.workunit.client.1.smithi149.stdout:4/618: link df/f15 df/da0/d12/d21/d22/d30/d41/d57/d60/dc4/fd0 0 2024-09-13T18:30:24.891 INFO:tasks.workunit.client.1.smithi149.stdout:4/619: read fc [164468,80959] 0 2024-09-13T18:30:24.893 INFO:tasks.workunit.client.1.smithi149.stdout:3/583: creat d1/d47/d30/d5a/fc6 x:0 0 0 2024-09-13T18:30:24.900 INFO:tasks.workunit.client.1.smithi149.stdout:8/556: dwrite d2/d13/f81 [0,4194304] 0 2024-09-13T18:30:24.900 INFO:tasks.workunit.client.1.smithi149.stdout:8/557: chown d2/faa 80 1 2024-09-13T18:30:24.902 INFO:tasks.workunit.client.1.smithi149.stdout:7/698: write d7/d76/fe0 [381472,95624] 0 2024-09-13T18:30:24.902 INFO:tasks.workunit.client.1.smithi149.stdout:1/626: dwrite d9/d10/d34/d53/f9e [0,4194304] 0 2024-09-13T18:30:24.903 INFO:tasks.workunit.client.1.smithi149.stdout:8/558: symlink d2/d12/d1b/lbc 0 2024-09-13T18:30:24.907 INFO:tasks.workunit.client.1.smithi149.stdout:7/699: getdents d7/d9/d1c/d1f 0 2024-09-13T18:30:24.910 INFO:tasks.workunit.client.1.smithi149.stdout:7/700: creat d7/d9/d11/ff5 x:0 0 0 2024-09-13T18:30:24.910 INFO:tasks.workunit.client.1.smithi149.stdout:8/559: fdatasync d2/d5b/d86/fa7 0 2024-09-13T18:30:24.912 INFO:tasks.workunit.client.0.smithi038.stdout:8/85: dwrite d1/de/d21/f22 [0,4194304] 0 2024-09-13T18:30:24.912 INFO:tasks.workunit.client.0.smithi038.stdout:8/86: write d1/de/d15/f1b [662196,9076] 0 2024-09-13T18:30:24.914 INFO:tasks.workunit.client.1.smithi149.stdout:7/701: symlink d7/d9/d1c/d2c/d60/dee/lf6 0 2024-09-13T18:30:24.916 INFO:tasks.workunit.client.1.smithi149.stdout:1/627: dread d9/d10/d83/d97/f87 [0,4194304] 0 2024-09-13T18:30:24.919 INFO:tasks.workunit.client.1.smithi149.stdout:8/560: mknod d2/d12/d2a/d4d/dbb/cbd 0 2024-09-13T18:30:24.919 INFO:tasks.workunit.client.1.smithi149.stdout:0/602: dwrite d1/d2/f89 [0,4194304] 0 2024-09-13T18:30:24.920 INFO:tasks.workunit.client.0.smithi038.stdout:8/87: creat d1/de/f23 x:0 0 0 2024-09-13T18:30:24.920 INFO:tasks.workunit.client.0.smithi038.stdout:8/88: read - d1/f1e zero size 2024-09-13T18:30:24.921 INFO:tasks.workunit.client.1.smithi149.stdout:6/706: write dc/d15/d23/d5f/dac/fb7 [1679520,53187] 0 2024-09-13T18:30:24.921 INFO:tasks.workunit.client.1.smithi149.stdout:6/707: write dc/d15/d23/d5b/f81 [2744656,54688] 0 2024-09-13T18:30:24.921 INFO:tasks.workunit.client.1.smithi149.stdout:6/708: dread - dc/d2f/d75/da1/fc8 zero size 2024-09-13T18:30:24.922 INFO:tasks.workunit.client.1.smithi149.stdout:7/702: rename d7/d76/db3/da4 to d7/d9/d11/d50/dde/df7 0 2024-09-13T18:30:24.923 INFO:tasks.workunit.client.0.smithi038.stdout:8/89: mkdir d1/de/d21/d24 0 2024-09-13T18:30:24.931 INFO:tasks.workunit.client.1.smithi149.stdout:1/628: dread d9/d10/d34/f51 [0,4194304] 0 2024-09-13T18:30:24.938 INFO:tasks.workunit.client.0.smithi038.stdout:8/90: dread d1/d8/f1f [0,4194304] 0 2024-09-13T18:30:24.950 INFO:tasks.workunit.client.1.smithi149.stdout:4/620: dwrite df/da0/d12/d21/d22/d30/d41/d57/f6a [0,4194304] 0 2024-09-13T18:30:24.950 INFO:tasks.workunit.client.1.smithi149.stdout:4/621: creat df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fd1 x:0 0 0 2024-09-13T18:30:24.950 INFO:tasks.workunit.client.1.smithi149.stdout:8/561: dwrite d2/d12/d1b/f4c [0,4194304] 0 2024-09-13T18:30:24.950 INFO:tasks.workunit.client.1.smithi149.stdout:3/584: dwrite d1/d47/d30/d5a/fc6 [0,4194304] 0 2024-09-13T18:30:24.950 INFO:tasks.workunit.client.1.smithi149.stdout:3/585: chown d1/d2c/l79 70416100 1 2024-09-13T18:30:24.950 INFO:tasks.workunit.client.1.smithi149.stdout:8/562: creat d2/d13/fbe x:0 0 0 2024-09-13T18:30:24.950 INFO:tasks.workunit.client.1.smithi149.stdout:8/563: write d2/d12/d1b/f7e [5141639,71433] 0 2024-09-13T18:30:24.958 INFO:tasks.workunit.client.1.smithi149.stdout:4/622: dread df/da0/d12/d21/f4a [4194304,4194304] 0 2024-09-13T18:30:24.964 INFO:tasks.workunit.client.1.smithi149.stdout:9/465: dwrite d0/f4e [0,4194304] 0 2024-09-13T18:30:24.965 INFO:tasks.workunit.client.1.smithi149.stdout:5/566: dwrite d3/d10/d4c/d4e/d61/d63/faa [0,4194304] 0 2024-09-13T18:30:24.966 INFO:tasks.workunit.client.0.smithi038.stdout:8/91: mkdir d1/de/d21/d24/d25 0 2024-09-13T18:30:24.969 INFO:tasks.workunit.client.0.smithi038.stdout:8/92: symlink d1/de/d21/d24/d25/l26 0 2024-09-13T18:30:24.971 INFO:tasks.workunit.client.0.smithi038.stdout:8/93: unlink d1/de/d15/f1b 0 2024-09-13T18:30:24.971 INFO:tasks.workunit.client.0.smithi038.stdout:8/94: truncate d1/d4/f12 966612 0 2024-09-13T18:30:24.974 INFO:tasks.workunit.client.0.smithi038.stdout:8/95: symlink d1/de/d21/l27 0 2024-09-13T18:30:24.974 INFO:tasks.workunit.client.0.smithi038.stdout:8/96: dread - d1/f3 zero size 2024-09-13T18:30:24.974 INFO:tasks.workunit.client.0.smithi038.stdout:8/97: creat d1/de/d21/f28 x:0 0 0 2024-09-13T18:30:24.974 INFO:tasks.workunit.client.0.smithi038.stdout:8/98: dread - d1/de/d21/f28 zero size 2024-09-13T18:30:24.974 INFO:tasks.workunit.client.0.smithi038.stdout:8/99: truncate d1/de/d21/f28 800886 0 2024-09-13T18:30:24.977 INFO:tasks.workunit.client.1.smithi149.stdout:6/709: mkdir dc/d15/daa/de5 0 2024-09-13T18:30:24.977 INFO:tasks.workunit.client.0.smithi038.stdout:8/100: symlink d1/de/d21/d24/l29 0 2024-09-13T18:30:24.978 INFO:tasks.workunit.client.1.smithi149.stdout:0/603: rename d1/d48/f80 to d1/d29/d31/d3e/d54/fcd 0 2024-09-13T18:30:24.980 INFO:tasks.workunit.client.1.smithi149.stdout:7/703: creat d7/d9/d11/d50/dde/df7/dae/ff8 x:0 0 0 2024-09-13T18:30:24.981 INFO:tasks.workunit.client.1.smithi149.stdout:7/704: fdatasync d7/f84 0 2024-09-13T18:30:24.981 INFO:tasks.workunit.client.1.smithi149.stdout:7/705: truncate d7/d9/d1b/d71/ddc/f8d 129104 0 2024-09-13T18:30:24.981 INFO:tasks.workunit.client.1.smithi149.stdout:1/629: mknod d9/d15/d60/d80/d8b/d42/da4/cc2 0 2024-09-13T18:30:24.983 INFO:tasks.workunit.client.1.smithi149.stdout:1/630: dread d9/d10/d83/d97/f69 [0,4194304] 0 2024-09-13T18:30:24.983 INFO:tasks.workunit.client.1.smithi149.stdout:1/631: dread - d9/d10/d62/f8d zero size 2024-09-13T18:30:24.985 INFO:tasks.workunit.client.1.smithi149.stdout:8/564: creat d2/d5b/fbf x:0 0 0 2024-09-13T18:30:24.987 INFO:tasks.workunit.client.1.smithi149.stdout:4/623: creat df/da0/d1c/fd2 x:0 0 0 2024-09-13T18:30:24.987 INFO:tasks.workunit.client.1.smithi149.stdout:4/624: chown df/da0/l36 404797724 1 2024-09-13T18:30:24.987 INFO:tasks.workunit.client.1.smithi149.stdout:4/625: stat df/da0/d12/d21/f8e 0 2024-09-13T18:30:24.999 INFO:tasks.workunit.client.1.smithi149.stdout:3/586: rename d1/f83 to d1/d2e/d1d/fc7 0 2024-09-13T18:30:25.001 INFO:tasks.workunit.client.1.smithi149.stdout:1/632: unlink d9/lb 0 2024-09-13T18:30:25.002 INFO:tasks.workunit.client.1.smithi149.stdout:8/565: link d2/d13/fad d2/d13/d6d/fc0 0 2024-09-13T18:30:25.003 INFO:tasks.workunit.client.1.smithi149.stdout:9/466: mknod d0/d18/d27/c96 0 2024-09-13T18:30:25.005 INFO:tasks.workunit.client.1.smithi149.stdout:5/567: rename d3/d10/d32/d54/f7c to d3/d10/d4c/d4e/da4/fb4 0 2024-09-13T18:30:25.005 INFO:tasks.workunit.client.1.smithi149.stdout:5/568: stat d3/d10/d4c/c93 0 2024-09-13T18:30:25.006 INFO:tasks.workunit.client.1.smithi149.stdout:1/633: symlink d9/d10/d34/dbe/d38/lc3 0 2024-09-13T18:30:25.007 INFO:tasks.workunit.client.1.smithi149.stdout:7/706: dwrite d7/f8 [0,4194304] 0 2024-09-13T18:30:25.007 INFO:tasks.workunit.client.1.smithi149.stdout:8/566: link d2/d52/l6c d2/d5b/lc1 0 2024-09-13T18:30:25.007 INFO:tasks.workunit.client.0.smithi038.stdout:8/101: dwrite d1/d8/f19 [0,4194304] 0 2024-09-13T18:30:25.009 INFO:tasks.workunit.client.1.smithi149.stdout:5/569: mknod d3/d10/d32/d54/d97/cb5 0 2024-09-13T18:30:25.009 INFO:tasks.workunit.client.1.smithi149.stdout:5/570: fsync d3/d10/f23 0 2024-09-13T18:30:25.011 INFO:tasks.workunit.client.1.smithi149.stdout:3/587: write d1/f85 [323289,30239] 0 2024-09-13T18:30:25.012 INFO:tasks.workunit.client.1.smithi149.stdout:1/634: mknod d9/cc4 0 2024-09-13T18:30:25.012 INFO:tasks.workunit.client.1.smithi149.stdout:4/626: dwrite df/da0/d12/f3c [0,4194304] 0 2024-09-13T18:30:25.012 INFO:tasks.workunit.client.1.smithi149.stdout:4/627: read df/da0/d12/d21/d22/f5e [3598689,53273] 0 2024-09-13T18:30:25.013 INFO:tasks.workunit.client.0.smithi038.stdout:8/102: getdents d1/de/d21 0 2024-09-13T18:30:25.014 INFO:tasks.workunit.client.1.smithi149.stdout:2/557: sync 2024-09-13T18:30:25.015 INFO:tasks.workunit.client.1.smithi149.stdout:2/558: creat db/fc1 x:0 0 0 2024-09-13T18:30:25.015 INFO:tasks.workunit.client.1.smithi149.stdout:2/559: stat db/d1b/f42 0 2024-09-13T18:30:25.015 INFO:tasks.workunit.client.1.smithi149.stdout:2/560: creat db/d1b/d2f/fc2 x:0 0 0 2024-09-13T18:30:25.015 INFO:tasks.workunit.client.0.smithi038.stdout:8/103: mkdir d1/d2a 0 2024-09-13T18:30:25.016 INFO:tasks.workunit.client.1.smithi149.stdout:8/567: mkdir d2/d12/dc2 0 2024-09-13T18:30:25.016 INFO:tasks.workunit.client.1.smithi149.stdout:8/568: chown d2/d12/f3f 129136693 1 2024-09-13T18:30:25.018 INFO:tasks.workunit.client.0.smithi038.stdout:8/104: link d1/d4/fa d1/d8/f2b 0 2024-09-13T18:30:25.018 INFO:tasks.workunit.client.0.smithi038.stdout:8/105: write d1/f7 [998994,97389] 0 2024-09-13T18:30:25.023 INFO:tasks.workunit.client.1.smithi149.stdout:1/635: mknod d9/d15/d40/cc5 0 2024-09-13T18:30:25.023 INFO:tasks.workunit.client.1.smithi149.stdout:1/636: stat d9/d58/fa9 0 2024-09-13T18:30:25.024 INFO:tasks.workunit.client.1.smithi149.stdout:4/628: creat df/da0/d12/d21/d22/d30/d56/d91/dcb/fd3 x:0 0 0 2024-09-13T18:30:25.025 INFO:tasks.workunit.client.1.smithi149.stdout:4/629: chown df/da0/d12/d21/d22/d30/d56/l38 166228701 1 2024-09-13T18:30:25.025 INFO:tasks.workunit.client.1.smithi149.stdout:4/630: chown df/da0/d12/d17/d3d/f40 1493 1 2024-09-13T18:30:25.025 INFO:tasks.workunit.client.1.smithi149.stdout:4/631: creat df/da0/d12/d17/d3d/fd4 x:0 0 0 2024-09-13T18:30:25.025 INFO:tasks.workunit.client.1.smithi149.stdout:9/467: dwrite d0/f38 [0,4194304] 0 2024-09-13T18:30:25.029 INFO:tasks.workunit.client.1.smithi149.stdout:7/707: link d7/d9/d1b/d71/ddc/f8d d7/d9/d11/ff9 0 2024-09-13T18:30:25.029 INFO:tasks.workunit.client.1.smithi149.stdout:7/708: fsync d7/f4c 0 2024-09-13T18:30:25.029 INFO:tasks.workunit.client.1.smithi149.stdout:8/569: stat d2/d13/d6d/l99 0 2024-09-13T18:30:25.029 INFO:tasks.workunit.client.1.smithi149.stdout:8/570: readlink d2/l7 0 2024-09-13T18:30:25.031 INFO:tasks.workunit.client.1.smithi149.stdout:6/710: rename dc/d15/d23/d5f/dac/dbd to dc/d15/daa/de5/de6 0 2024-09-13T18:30:25.031 INFO:tasks.workunit.client.1.smithi149.stdout:6/711: chown dc/d15/d23/c93 53669 1 2024-09-13T18:30:25.031 INFO:tasks.workunit.client.1.smithi149.stdout:6/712: write f5 [5658648,62695] 0 2024-09-13T18:30:25.033 INFO:tasks.workunit.client.1.smithi149.stdout:3/588: getdents d1/d12 0 2024-09-13T18:30:25.033 INFO:tasks.workunit.client.1.smithi149.stdout:1/637: truncate d9/d10/d34/d53/f82 121614 0 2024-09-13T18:30:25.034 INFO:tasks.workunit.client.1.smithi149.stdout:1/638: write d9/d15/d60/d80/f84 [434574,81187] 0 2024-09-13T18:30:25.034 INFO:tasks.workunit.client.1.smithi149.stdout:1/639: creat d9/d15/d60/da5/fc6 x:0 0 0 2024-09-13T18:30:25.034 INFO:tasks.workunit.client.1.smithi149.stdout:1/640: write d9/d10/f27 [5508183,20895] 0 2024-09-13T18:30:25.034 INFO:tasks.workunit.client.1.smithi149.stdout:1/641: stat d9/d10/d62/f99 0 2024-09-13T18:30:25.034 INFO:tasks.workunit.client.1.smithi149.stdout:1/642: stat d9/d10/d34/d53/f5f 0 2024-09-13T18:30:25.034 INFO:tasks.workunit.client.1.smithi149.stdout:1/643: fdatasync d9/d15/f29 0 2024-09-13T18:30:25.035 INFO:tasks.workunit.client.1.smithi149.stdout:4/632: creat df/da0/d12/d7c/d9a/fd5 x:0 0 0 2024-09-13T18:30:25.036 INFO:tasks.workunit.client.1.smithi149.stdout:2/561: getdents db/d1b/d2f/d30 0 2024-09-13T18:30:25.038 INFO:tasks.workunit.client.1.smithi149.stdout:7/709: getdents d7/d9/d1b/d71/ddc/d53/daa 0 2024-09-13T18:30:25.038 INFO:tasks.workunit.client.1.smithi149.stdout:7/710: read - d7/d9/d1c/d51/d52/d86/fda zero size 2024-09-13T18:30:25.040 INFO:tasks.workunit.client.1.smithi149.stdout:0/604: rename d1/d2/d41/d46/la6 to d1/d2/d41/d46/d7b/daf/lce 0 2024-09-13T18:30:25.040 INFO:tasks.workunit.client.1.smithi149.stdout:5/571: rename d3/d8 to d3/d8/d13/db6 22 2024-09-13T18:30:25.040 INFO:tasks.workunit.client.1.smithi149.stdout:5/572: dread - d3/d10/d4c/d4e/d61/f96 zero size 2024-09-13T18:30:25.042 INFO:tasks.workunit.client.1.smithi149.stdout:3/589: truncate d1/d2c/fa8 1866079 0 2024-09-13T18:30:25.043 INFO:tasks.workunit.client.1.smithi149.stdout:3/590: creat d1/d47/d30/fc8 x:0 0 0 2024-09-13T18:30:25.043 INFO:tasks.workunit.client.1.smithi149.stdout:6/713: read dc/d70/dbc/f6e [52973,20748] 0 2024-09-13T18:30:25.043 INFO:tasks.workunit.client.0.smithi038.stdout:8/106: dwrite d1/d8/f19 [0,4194304] 0 2024-09-13T18:30:25.045 INFO:tasks.workunit.client.1.smithi149.stdout:1/644: mknod d9/d58/cc7 0 2024-09-13T18:30:25.045 INFO:tasks.workunit.client.1.smithi149.stdout:1/645: dread - d9/d10/d34/d3c/d50/fb9 zero size 2024-09-13T18:30:25.045 INFO:tasks.workunit.client.1.smithi149.stdout:1/646: creat d9/d10/d34/d53/d57/fc8 x:0 0 0 2024-09-13T18:30:25.047 INFO:tasks.workunit.client.1.smithi149.stdout:2/562: symlink db/d1b/d2f/d30/lc3 0 2024-09-13T18:30:25.047 INFO:tasks.workunit.client.1.smithi149.stdout:2/563: truncate db/d1b/d1c/d20/d2b/f92 438616 0 2024-09-13T18:30:25.049 INFO:tasks.workunit.client.1.smithi149.stdout:7/711: symlink d7/d76/db3/d31/ddb/lfa 0 2024-09-13T18:30:25.051 INFO:tasks.workunit.client.1.smithi149.stdout:0/605: symlink d1/d29/d31/d83/d87/lcf 0 2024-09-13T18:30:25.051 INFO:tasks.workunit.client.1.smithi149.stdout:5/573: truncate d3/d10/d32/d67/d83/f8a 4716427 0 2024-09-13T18:30:25.053 INFO:tasks.workunit.client.1.smithi149.stdout:3/591: mknod d1/d2c/d38/d88/d96/cc9 0 2024-09-13T18:30:25.053 INFO:tasks.workunit.client.1.smithi149.stdout:3/592: write d1/d2c/d8b/fac [247609,10847] 0 2024-09-13T18:30:25.054 INFO:tasks.workunit.client.1.smithi149.stdout:9/468: dwrite d0/d2e/d42/d59/f69 [4194304,4194304] 0 2024-09-13T18:30:25.054 INFO:tasks.workunit.client.1.smithi149.stdout:9/469: creat d0/d18/d27/d5c/d7e/f97 x:0 0 0 2024-09-13T18:30:25.054 INFO:tasks.workunit.client.1.smithi149.stdout:9/470: fsync d0/d18/d27/f6e 0 2024-09-13T18:30:25.054 INFO:tasks.workunit.client.1.smithi149.stdout:6/714: mknod dc/d2f/d75/da1/dcb/ce7 0 2024-09-13T18:30:25.058 INFO:tasks.workunit.client.1.smithi149.stdout:4/633: getdents df/da0/d12/d21/d22/d30/d56/d91 0 2024-09-13T18:30:25.058 INFO:tasks.workunit.client.1.smithi149.stdout:4/634: stat df/da0/d12/d21/d22/d30/d41/d57/d60/cc5 0 2024-09-13T18:30:25.058 INFO:tasks.workunit.client.1.smithi149.stdout:4/635: write df/da0/d12/d17/d3d/f73 [3018913,105305] 0 2024-09-13T18:30:25.060 INFO:tasks.workunit.client.1.smithi149.stdout:7/712: mknod d7/d76/db3/d31/ddb/cfb 0 2024-09-13T18:30:25.061 INFO:tasks.workunit.client.1.smithi149.stdout:8/571: dwrite d2/d5b/d86/fb3 [0,4194304] 0 2024-09-13T18:30:25.062 INFO:tasks.workunit.client.1.smithi149.stdout:8/572: dread - d2/d12/d6e/fac zero size 2024-09-13T18:30:25.062 INFO:tasks.workunit.client.1.smithi149.stdout:0/606: unlink d1/d2/d8a/d90/fa5 0 2024-09-13T18:30:25.062 INFO:tasks.workunit.client.1.smithi149.stdout:0/607: creat d1/d2/d8a/fd0 x:0 0 0 2024-09-13T18:30:25.062 INFO:tasks.workunit.client.1.smithi149.stdout:0/608: write d1/d1b/f72 [767696,17872] 0 2024-09-13T18:30:25.062 INFO:tasks.workunit.client.1.smithi149.stdout:5/574: mknod d3/d10/cb7 0 2024-09-13T18:30:25.063 INFO:tasks.workunit.client.1.smithi149.stdout:7/713: dread d7/d9/d11/d50/f90 [0,4194304] 0 2024-09-13T18:30:25.063 INFO:tasks.workunit.client.1.smithi149.stdout:7/714: fdatasync d7/d9/d1c/d51/d52/d86/fda 0 2024-09-13T18:30:25.063 INFO:tasks.workunit.client.1.smithi149.stdout:3/593: mknod d1/d2e/d1d/d6c/cca 0 2024-09-13T18:30:25.067 INFO:tasks.workunit.client.1.smithi149.stdout:6/715: dread dc/f5a [0,4194304] 0 2024-09-13T18:30:25.067 INFO:tasks.workunit.client.1.smithi149.stdout:6/716: dread - dc/f9f zero size 2024-09-13T18:30:25.068 INFO:tasks.workunit.client.1.smithi149.stdout:6/717: chown dc/d15/d23/d5b/d91/db0/fca 5446 1 2024-09-13T18:30:25.068 INFO:tasks.workunit.client.1.smithi149.stdout:1/647: rmdir d9/d10/d34/d53/d7b 39 2024-09-13T18:30:25.069 INFO:tasks.workunit.client.1.smithi149.stdout:4/636: creat df/da0/d12/fd6 x:0 0 0 2024-09-13T18:30:25.071 INFO:tasks.workunit.client.0.smithi038.stdout:8/107: dwrite d1/f1e [0,4194304] 0 2024-09-13T18:30:25.076 INFO:tasks.workunit.client.1.smithi149.stdout:8/573: symlink d2/d52/lc3 0 2024-09-13T18:30:25.076 INFO:tasks.workunit.client.1.smithi149.stdout:8/574: fdatasync d2/d13/f85 0 2024-09-13T18:30:25.078 INFO:tasks.workunit.client.1.smithi149.stdout:0/609: creat d1/d29/fd1 x:0 0 0 2024-09-13T18:30:25.081 INFO:tasks.workunit.client.1.smithi149.stdout:7/715: creat d7/d9/d1c/d51/ffc x:0 0 0 2024-09-13T18:30:25.081 INFO:tasks.workunit.client.1.smithi149.stdout:3/594: write d1/d2e/d1d/f2b [3569433,102009] 0 2024-09-13T18:30:25.082 INFO:tasks.workunit.client.1.smithi149.stdout:6/718: creat dc/d15/d23/d5f/dac/fe8 x:0 0 0 2024-09-13T18:30:25.084 INFO:tasks.workunit.client.1.smithi149.stdout:8/575: dread d2/d12/f46 [0,4194304] 0 2024-09-13T18:30:25.092 INFO:tasks.workunit.client.1.smithi149.stdout:8/576: read d2/d13/f85 [288981,74443] 0 2024-09-13T18:30:25.092 INFO:tasks.workunit.client.1.smithi149.stdout:8/577: fsync d2/d12/d1b/f23 0 2024-09-13T18:30:25.096 INFO:tasks.workunit.client.1.smithi149.stdout:4/637: dwrite df/da0/d12/d21/d22/d30/d56/d91/dcb/fd3 [0,4194304] 0 2024-09-13T18:30:25.097 INFO:tasks.workunit.client.1.smithi149.stdout:4/638: chown df/da0/d70/db5/dc7 24144637 1 2024-09-13T18:30:25.097 INFO:tasks.workunit.client.1.smithi149.stdout:0/610: dread d1/d29/f7a [0,4194304] 0 2024-09-13T18:30:25.097 INFO:tasks.workunit.client.1.smithi149.stdout:0/611: dread - d1/d48/f64 zero size 2024-09-13T18:30:25.097 INFO:tasks.workunit.client.1.smithi149.stdout:0/612: readlink d1/d2/d41/lb7 0 2024-09-13T18:30:25.106 INFO:tasks.workunit.client.1.smithi149.stdout:8/578: dread d2/f42 [0,4194304] 0 2024-09-13T18:30:25.106 INFO:tasks.workunit.client.1.smithi149.stdout:8/579: chown d2/d12/f89 30 1 2024-09-13T18:30:25.127 INFO:tasks.workunit.client.1.smithi149.stdout:7/716: dwrite d7/d9/d1c/d51/f61 [4194304,4194304] 0 2024-09-13T18:30:25.127 INFO:tasks.workunit.client.1.smithi149.stdout:6/719: dwrite dc/f5a [0,4194304] 0 2024-09-13T18:30:25.128 INFO:tasks.workunit.client.0.smithi038.stdout:8/108: dwrite d1/de/f10 [0,4194304] 0 2024-09-13T18:30:25.128 INFO:tasks.workunit.client.0.smithi038.stdout:8/109: truncate d1/d8/f19 4710674 0 2024-09-13T18:30:25.128 INFO:tasks.workunit.client.1.smithi149.stdout:8/580: dwrite d2/d12/d1b/d58/d97/fa0 [0,4194304] 0 2024-09-13T18:30:25.128 INFO:tasks.workunit.client.1.smithi149.stdout:8/581: fdatasync d2/d12/d87/f9e 0 2024-09-13T18:30:25.130 INFO:tasks.workunit.client.1.smithi149.stdout:5/575: getdents d3/d10/d4c/d4e/da4 0 2024-09-13T18:30:25.136 INFO:tasks.workunit.client.1.smithi149.stdout:3/595: unlink d1/d2e/d1d/cab 0 2024-09-13T18:30:25.136 INFO:tasks.workunit.client.1.smithi149.stdout:3/596: truncate d1/d2c/d42/fc0 148293 0 2024-09-13T18:30:25.136 INFO:tasks.workunit.client.1.smithi149.stdout:3/597: read - d1/d2e/d1d/fb7 zero size 2024-09-13T18:30:25.140 INFO:tasks.workunit.client.1.smithi149.stdout:8/582: read d2/d13/fad [2448891,15493] 0 2024-09-13T18:30:25.147 INFO:tasks.workunit.client.1.smithi149.stdout:1/648: rmdir d9/d15/d60/d80 39 2024-09-13T18:30:25.152 INFO:tasks.workunit.client.0.smithi038.stdout:8/110: dwrite d1/d8/f1f [0,4194304] 0 2024-09-13T18:30:25.154 INFO:tasks.workunit.client.1.smithi149.stdout:0/613: creat d1/d29/d31/fd2 x:0 0 0 2024-09-13T18:30:25.160 INFO:tasks.workunit.client.0.smithi038.stdout:8/111: read d1/f1e [3751638,18501] 0 2024-09-13T18:30:25.167 INFO:tasks.workunit.client.0.smithi038.stdout:8/112: dread d1/d8/f2b [0,4194304] 0 2024-09-13T18:30:25.169 INFO:tasks.workunit.client.0.smithi038.stdout:8/113: rmdir d1/de/d21/d24/d25 39 2024-09-13T18:30:25.172 INFO:tasks.workunit.client.0.smithi038.stdout:8/114: rename d1/d4/c5 to d1/d4/c2c 0 2024-09-13T18:30:25.172 INFO:tasks.workunit.client.0.smithi038.stdout:8/115: chown d1/d4 14593 1 2024-09-13T18:30:25.175 INFO:tasks.workunit.client.0.smithi038.stdout:8/116: link d1/ff d1/d4/f2d 0 2024-09-13T18:30:25.176 INFO:tasks.workunit.client.0.smithi038.stdout:8/117: chown d1/c1a 72 1 2024-09-13T18:30:25.179 INFO:tasks.workunit.client.0.smithi038.stdout:8/118: rename d1/de/d15/f20 to d1/d2a/f2e 0 2024-09-13T18:30:25.184 INFO:tasks.workunit.client.0.smithi038.stdout:8/119: unlink d1/d8/l17 0 2024-09-13T18:30:25.202 INFO:tasks.workunit.client.0.smithi038.stdout:8/120: dwrite d1/d8/f2b [0,4194304] 0 2024-09-13T18:30:25.208 INFO:tasks.workunit.client.0.smithi038.stdout:8/121: creat d1/de/d21/d24/f2f x:0 0 0 2024-09-13T18:30:25.217 INFO:tasks.workunit.client.0.smithi038.stdout:8/122: dread d1/d8/f19 [0,4194304] 0 2024-09-13T18:30:25.222 INFO:tasks.workunit.client.0.smithi038.stdout:8/123: mkdir d1/de/d15/d30 0 2024-09-13T18:30:25.222 INFO:tasks.workunit.client.0.smithi038.stdout:8/124: fsync d1/d4/fa 0 2024-09-13T18:30:25.229 INFO:tasks.workunit.client.0.smithi038.stdout:8/125: creat d1/de/d21/d24/d25/f31 x:0 0 0 2024-09-13T18:30:25.229 INFO:tasks.workunit.client.0.smithi038.stdout:8/126: fdatasync d1/de/d21/d24/d25/f31 0 2024-09-13T18:30:25.229 INFO:tasks.workunit.client.0.smithi038.stdout:8/127: fsync d1/d4/fa 0 2024-09-13T18:30:25.229 INFO:tasks.workunit.client.0.smithi038.stdout:8/128: readlink d1/de/d21/l27 0 2024-09-13T18:30:25.266 INFO:tasks.workunit.client.1.smithi149.stdout:3/598: stat d1/d2c/d38/d88/lae 0 2024-09-13T18:30:25.266 INFO:tasks.workunit.client.1.smithi149.stdout:3/599: stat d1/d2e/c15 0 2024-09-13T18:30:25.267 INFO:tasks.workunit.client.1.smithi149.stdout:1/649: mkdir d9/d10/d3f/dc9 0 2024-09-13T18:30:25.269 INFO:tasks.workunit.client.1.smithi149.stdout:0/614: rename d1/d29/d31/d44/f9d to d1/d29/d31/d44/d81/d62/fd3 0 2024-09-13T18:30:25.272 INFO:tasks.workunit.client.1.smithi149.stdout:3/600: rmdir d1/d2c/d38/d88/dc2 0 2024-09-13T18:30:25.282 INFO:tasks.workunit.client.1.smithi149.stdout:3/601: read d1/d47/d30/d46/f9d [2712385,129758] 0 2024-09-13T18:30:25.335 INFO:tasks.workunit.client.0.smithi038.stdout:8/129: dwrite d1/de/d21/f22 [0,4194304] 0 2024-09-13T18:30:25.336 INFO:tasks.workunit.client.0.smithi038.stdout:8/130: symlink d1/d8/l32 0 2024-09-13T18:30:25.343 INFO:tasks.workunit.client.1.smithi149.stdout:3/602: dread d1/d47/d30/f71 [0,4194304] 0 2024-09-13T18:30:25.343 INFO:tasks.workunit.client.1.smithi149.stdout:3/603: write d1/d47/f92 [36470,69595] 0 2024-09-13T18:30:25.343 INFO:tasks.workunit.client.1.smithi149.stdout:3/604: creat d1/d2e/d93/fcb x:0 0 0 2024-09-13T18:30:25.355 INFO:tasks.workunit.client.1.smithi149.stdout:0/615: dwrite d1/d29/f7a [0,4194304] 0 2024-09-13T18:30:25.359 INFO:tasks.workunit.client.1.smithi149.stdout:0/616: dread d1/d29/d31/d44/d47/f8e [0,4194304] 0 2024-09-13T18:30:25.360 INFO:tasks.workunit.client.1.smithi149.stdout:0/617: mknod d1/d2/d4e/cd4 0 2024-09-13T18:30:25.360 INFO:tasks.workunit.client.1.smithi149.stdout:0/618: creat d1/d2/d8a/d90/fd5 x:0 0 0 2024-09-13T18:30:25.363 INFO:tasks.workunit.client.0.smithi038.stdout:8/131: dwrite d1/f1e [0,4194304] 0 2024-09-13T18:30:25.364 INFO:tasks.workunit.client.1.smithi149.stdout:0/619: creat d1/d29/d31/d44/d47/fd6 x:0 0 0 2024-09-13T18:30:25.370 INFO:tasks.workunit.client.1.smithi149.stdout:8/583: mkdir d2/dc4 0 2024-09-13T18:30:25.372 INFO:tasks.workunit.client.1.smithi149.stdout:8/584: symlink d2/d12/d6e/lc5 0 2024-09-13T18:30:25.378 INFO:tasks.workunit.client.1.smithi149.stdout:1/650: mkdir d9/d10/dca 0 2024-09-13T18:30:25.379 INFO:tasks.workunit.client.1.smithi149.stdout:7/717: unlink d7/d9/d1c/d1f/d21/f4b 0 2024-09-13T18:30:25.379 INFO:tasks.workunit.client.1.smithi149.stdout:7/718: chown d7/d76/db3/d6f/d9d 3357804 1 2024-09-13T18:30:25.382 INFO:tasks.workunit.client.1.smithi149.stdout:3/605: rmdir d1 39 2024-09-13T18:30:25.383 INFO:tasks.workunit.client.1.smithi149.stdout:1/651: dread d9/d15/d60/d80/f9d [0,4194304] 0 2024-09-13T18:30:25.383 INFO:tasks.workunit.client.1.smithi149.stdout:1/652: write d9/d10/d83/d97/f91 [3114020,93027] 0 2024-09-13T18:30:25.383 INFO:tasks.workunit.client.1.smithi149.stdout:1/653: fdatasync d9/d10/d34/d3c/d50/f8f 0 2024-09-13T18:30:25.385 INFO:tasks.workunit.client.1.smithi149.stdout:1/654: mkdir d9/d10/d43/dcb 0 2024-09-13T18:30:25.387 INFO:tasks.workunit.client.1.smithi149.stdout:1/655: rename d9/d10/lb6 to d9/d15/d60/lcc 0 2024-09-13T18:30:25.387 INFO:tasks.workunit.client.1.smithi149.stdout:1/656: write d9/d15/d60/d80/d8b/f9f [60371,10823] 0 2024-09-13T18:30:25.397 INFO:tasks.workunit.client.1.smithi149.stdout:7/719: dread d7/d9/d1c/d34/f55 [0,4194304] 0 2024-09-13T18:30:25.398 INFO:tasks.workunit.client.1.smithi149.stdout:7/720: symlink d7/d9/d11/lfd 0 2024-09-13T18:30:25.400 INFO:tasks.workunit.client.1.smithi149.stdout:0/620: dwrite d1/d48/d92/db4/db5/fc0 [0,4194304] 0 2024-09-13T18:30:25.400 INFO:tasks.workunit.client.1.smithi149.stdout:8/585: dwrite d2/d12/d1b/fba [0,4194304] 0 2024-09-13T18:30:25.400 INFO:tasks.workunit.client.1.smithi149.stdout:8/586: fsync d2/d12/f16 0 2024-09-13T18:30:25.402 INFO:tasks.workunit.client.1.smithi149.stdout:0/621: truncate d1/d29/d31/d44/d81/f97 1801356 0 2024-09-13T18:30:25.403 INFO:tasks.workunit.client.1.smithi149.stdout:0/622: truncate d1/d29/d31/d44/d81/f79 587711 0 2024-09-13T18:30:25.403 INFO:tasks.workunit.client.1.smithi149.stdout:0/623: fdatasync d1/d29/d31/f39 0 2024-09-13T18:30:25.403 INFO:tasks.workunit.client.1.smithi149.stdout:0/624: truncate d1/d1b/f40 4497874 0 2024-09-13T18:30:25.403 INFO:tasks.workunit.client.0.smithi038.stdout:8/132: dwrite d1/fc [0,4194304] 0 2024-09-13T18:30:25.404 INFO:tasks.workunit.client.1.smithi149.stdout:0/625: mkdir d1/d2/d8a/da9/dd7 0 2024-09-13T18:30:25.404 INFO:tasks.workunit.client.1.smithi149.stdout:0/626: readlink d1/l9 0 2024-09-13T18:30:25.405 INFO:tasks.workunit.client.1.smithi149.stdout:3/606: dwrite d1/d12/d20/d54/d6d/f72 [0,4194304] 0 2024-09-13T18:30:25.406 INFO:tasks.workunit.client.1.smithi149.stdout:3/607: stat d1/d2e/d6f/daf/lc1 0 2024-09-13T18:30:25.407 INFO:tasks.workunit.client.1.smithi149.stdout:0/627: symlink d1/d29/d31/d3e/ld8 0 2024-09-13T18:30:25.410 INFO:tasks.workunit.client.1.smithi149.stdout:0/628: creat d1/d29/d31/d3e/fd9 x:0 0 0 2024-09-13T18:30:25.410 INFO:tasks.workunit.client.1.smithi149.stdout:7/721: dread d7/d9/d1c/d1f/d3d/f6e [0,4194304] 0 2024-09-13T18:30:25.411 INFO:tasks.workunit.client.1.smithi149.stdout:0/629: stat d1/d29/d31/d44/d81/l96 0 2024-09-13T18:30:25.415 INFO:tasks.workunit.client.1.smithi149.stdout:4/639: sync 2024-09-13T18:30:25.415 INFO:tasks.workunit.client.1.smithi149.stdout:6/720: sync 2024-09-13T18:30:25.415 INFO:tasks.workunit.client.1.smithi149.stdout:2/564: sync 2024-09-13T18:30:25.415 INFO:tasks.workunit.client.1.smithi149.stdout:5/576: sync 2024-09-13T18:30:25.415 INFO:tasks.workunit.client.1.smithi149.stdout:5/577: chown d3/d10/d32/f3c 333394661 1 2024-09-13T18:30:25.415 INFO:tasks.workunit.client.1.smithi149.stdout:9/471: sync 2024-09-13T18:30:25.416 INFO:tasks.workunit.client.1.smithi149.stdout:9/472: stat d0/d18/d19/f3f 0 2024-09-13T18:30:25.416 INFO:tasks.workunit.client.1.smithi149.stdout:0/630: rename d1/d29/d31/fd2 to d1/d2/d8a/dc2/fda 0 2024-09-13T18:30:25.420 INFO:tasks.workunit.client.1.smithi149.stdout:5/578: mkdir d3/d10/d4c/db8 0 2024-09-13T18:30:25.420 INFO:tasks.workunit.client.1.smithi149.stdout:5/579: chown d3/d10/d4c/c57 326550 1 2024-09-13T18:30:25.424 INFO:tasks.workunit.client.1.smithi149.stdout:0/631: creat d1/d2/fdb x:0 0 0 2024-09-13T18:30:25.424 INFO:tasks.workunit.client.1.smithi149.stdout:0/632: fsync d1/d1b/f56 0 2024-09-13T18:30:25.427 INFO:tasks.workunit.client.1.smithi149.stdout:2/565: dread db/d1b/d1c/f3c [0,4194304] 0 2024-09-13T18:30:25.430 INFO:tasks.workunit.client.1.smithi149.stdout:2/566: dread db/d1b/d1c/d20/d3a/f47 [0,4194304] 0 2024-09-13T18:30:25.430 INFO:tasks.workunit.client.1.smithi149.stdout:2/567: stat db/d1b/f42 0 2024-09-13T18:30:25.430 INFO:tasks.workunit.client.1.smithi149.stdout:2/568: readlink db/d13/d70/l8e 0 2024-09-13T18:30:25.432 INFO:tasks.workunit.client.1.smithi149.stdout:2/569: rename db/d1b/d1c/d20/d3a/l60 to db/d13/d70/lc4 0 2024-09-13T18:30:25.435 INFO:tasks.workunit.client.1.smithi149.stdout:2/570: creat db/d1b/d2f/fc5 x:0 0 0 2024-09-13T18:30:25.435 INFO:tasks.workunit.client.1.smithi149.stdout:2/571: chown db/d1b/d1c/l5e 1610141 1 2024-09-13T18:30:25.435 INFO:tasks.workunit.client.1.smithi149.stdout:2/572: chown db/d1b/d1c/l5e 13726 1 2024-09-13T18:30:25.435 INFO:tasks.workunit.client.1.smithi149.stdout:2/573: chown db/d1b/d1c/d20/d2b/la8 4119375 1 2024-09-13T18:30:25.435 INFO:tasks.workunit.client.1.smithi149.stdout:2/574: fdatasync db/f97 0 2024-09-13T18:30:25.435 INFO:tasks.workunit.client.1.smithi149.stdout:9/473: dread d0/f38 [4194304,4194304] 0 2024-09-13T18:30:25.436 INFO:tasks.workunit.client.1.smithi149.stdout:2/575: rmdir db/d10 39 2024-09-13T18:30:25.436 INFO:tasks.workunit.client.1.smithi149.stdout:2/576: readlink db/d1b/d48/l84 0 2024-09-13T18:30:25.436 INFO:tasks.workunit.client.1.smithi149.stdout:2/577: fdatasync db/d1b/d2f/fc2 0 2024-09-13T18:30:25.439 INFO:tasks.workunit.client.1.smithi149.stdout:2/578: creat db/d10/d8d/fc6 x:0 0 0 2024-09-13T18:30:25.439 INFO:tasks.workunit.client.1.smithi149.stdout:9/474: rename d0/d47/d61/c82 to d0/d18/c98 0 2024-09-13T18:30:25.439 INFO:tasks.workunit.client.1.smithi149.stdout:0/633: write d1/d29/d31/f39 [5882095,97551] 0 2024-09-13T18:30:25.439 INFO:tasks.workunit.client.1.smithi149.stdout:0/634: stat d1/d48/d92/db4/db5 0 2024-09-13T18:30:25.440 INFO:tasks.workunit.client.0.smithi038.stdout:8/133: dread d1/fc [0,4194304] 0 2024-09-13T18:30:25.444 INFO:tasks.workunit.client.1.smithi149.stdout:9/475: unlink d0/d18/c6a 0 2024-09-13T18:30:25.447 INFO:tasks.workunit.client.1.smithi149.stdout:3/608: write d1/d2c/d56/f76 [2674109,68511] 0 2024-09-13T18:30:25.447 INFO:tasks.workunit.client.1.smithi149.stdout:0/635: dread d1/d1b/f3d [0,4194304] 0 2024-09-13T18:30:25.447 INFO:tasks.workunit.client.1.smithi149.stdout:0/636: fsync d1/d2/f5b 0 2024-09-13T18:30:25.451 INFO:tasks.workunit.client.1.smithi149.stdout:0/637: rename d1/d29/d31/d3e/l91 to d1/d2/d41/ldc 0 2024-09-13T18:30:25.452 INFO:tasks.workunit.client.1.smithi149.stdout:3/609: symlink d1/d2e/d1d/d49/lcc 0 2024-09-13T18:30:25.456 INFO:tasks.workunit.client.1.smithi149.stdout:0/638: creat d1/fdd x:0 0 0 2024-09-13T18:30:25.456 INFO:tasks.workunit.client.1.smithi149.stdout:0/639: creat d1/d29/d31/d44/fde x:0 0 0 2024-09-13T18:30:25.457 INFO:tasks.workunit.client.1.smithi149.stdout:7/722: dwrite d7/f6b [0,4194304] 0 2024-09-13T18:30:25.458 INFO:tasks.workunit.client.1.smithi149.stdout:0/640: creat d1/d29/d31/d83/d87/fdf x:0 0 0 2024-09-13T18:30:25.458 INFO:tasks.workunit.client.1.smithi149.stdout:0/641: dread - d1/d29/d31/d3e/d54/fcd zero size 2024-09-13T18:30:25.464 INFO:tasks.workunit.client.1.smithi149.stdout:7/723: creat d7/d9/d1c/d2c/ffe x:0 0 0 2024-09-13T18:30:25.467 INFO:tasks.workunit.client.1.smithi149.stdout:7/724: chown d7/d9/d1c/d51/d52/d86/da3/la6 7447915 1 2024-09-13T18:30:25.467 INFO:tasks.workunit.client.0.smithi038.stdout:8/134: write d1/de/d21/f22 [3865992,93219] 0 2024-09-13T18:30:25.467 INFO:tasks.workunit.client.0.smithi038.stdout:8/135: chown d1/d4/f13 1 1 2024-09-13T18:30:25.467 INFO:tasks.workunit.client.0.smithi038.stdout:8/136: creat d1/de/f33 x:0 0 0 2024-09-13T18:30:25.468 INFO:tasks.workunit.client.1.smithi149.stdout:7/725: mknod d7/d76/db3/d6f/d9d/cff 0 2024-09-13T18:30:25.469 INFO:tasks.workunit.client.0.smithi038.stdout:8/137: getdents d1 0 2024-09-13T18:30:25.471 INFO:tasks.workunit.client.1.smithi149.stdout:8/587: dwrite d2/d5b/f8a [0,4194304] 0 2024-09-13T18:30:25.471 INFO:tasks.workunit.client.1.smithi149.stdout:8/588: write d2/d12/f43 [2045029,114953] 0 2024-09-13T18:30:25.471 INFO:tasks.workunit.client.0.smithi038.stdout:8/138: creat d1/de/d15/d30/f34 x:0 0 0 2024-09-13T18:30:25.479 INFO:tasks.workunit.client.1.smithi149.stdout:9/476: dwrite d0/d18/d27/f8b [0,4194304] 0 2024-09-13T18:30:25.480 INFO:tasks.workunit.client.1.smithi149.stdout:7/726: dread d7/d9/d1c/d1f/d3d/fa7 [0,4194304] 0 2024-09-13T18:30:25.480 INFO:tasks.workunit.client.1.smithi149.stdout:7/727: chown d7/d9/d1c/d1f/dcd/cd3 24068 1 2024-09-13T18:30:25.482 INFO:tasks.workunit.client.1.smithi149.stdout:5/580: dwrite d3/d8/d13/f6c [0,4194304] 0 2024-09-13T18:30:25.482 INFO:tasks.workunit.client.1.smithi149.stdout:3/610: dwrite d1/d47/d30/fc8 [0,4194304] 0 2024-09-13T18:30:25.483 INFO:tasks.workunit.client.1.smithi149.stdout:6/721: dwrite dc/d15/d54/fba [0,4194304] 0 2024-09-13T18:30:25.483 INFO:tasks.workunit.client.0.smithi038.stdout:8/139: read d1/d4/fa [434461,131025] 0 2024-09-13T18:30:25.483 INFO:tasks.workunit.client.1.smithi149.stdout:7/728: creat d7/d9/d1c/d51/f100 x:0 0 0 2024-09-13T18:30:25.486 INFO:tasks.workunit.client.0.smithi038.stdout:8/140: mknod d1/d4/c35 0 2024-09-13T18:30:25.487 INFO:tasks.workunit.client.1.smithi149.stdout:3/611: mkdir d1/d2e/d1d/d6c/dcd 0 2024-09-13T18:30:25.490 INFO:tasks.workunit.client.0.smithi038.stdout:8/141: mknod d1/d8/c36 0 2024-09-13T18:30:25.490 INFO:tasks.workunit.client.0.smithi038.stdout:8/142: write d1/d4/f12 [1072873,76052] 0 2024-09-13T18:30:25.490 INFO:tasks.workunit.client.0.smithi038.stdout:8/143: write d1/de/d15/f1c [809151,9896] 0 2024-09-13T18:30:25.492 INFO:tasks.workunit.client.1.smithi149.stdout:6/722: symlink dc/d15/d23/d5b/d91/db0/le9 0 2024-09-13T18:30:25.493 INFO:tasks.workunit.client.0.smithi038.stdout:8/144: rename d1/de/d21/d24/l29 to d1/d8/l37 0 2024-09-13T18:30:25.494 INFO:tasks.workunit.client.1.smithi149.stdout:7/729: mkdir d7/d9/d11/de2/d101 0 2024-09-13T18:30:25.495 INFO:tasks.workunit.client.1.smithi149.stdout:3/612: unlink d1/d12/d20/d91/la2 0 2024-09-13T18:30:25.497 INFO:tasks.workunit.client.1.smithi149.stdout:6/723: creat dc/d15/fea x:0 0 0 2024-09-13T18:30:25.497 INFO:tasks.workunit.client.1.smithi149.stdout:6/724: dread - dc/d15/d23/d5f/fc9 zero size 2024-09-13T18:30:25.498 INFO:tasks.workunit.client.1.smithi149.stdout:5/581: write d3/d10/d32/d67/d83/f8a [1996791,63215] 0 2024-09-13T18:30:25.498 INFO:tasks.workunit.client.1.smithi149.stdout:8/589: dwrite d2/f9 [0,4194304] 0 2024-09-13T18:30:25.498 INFO:tasks.workunit.client.1.smithi149.stdout:0/642: dwrite d1/d2/d41/faa [0,4194304] 0 2024-09-13T18:30:25.498 INFO:tasks.workunit.client.1.smithi149.stdout:0/643: dread - d1/d29/d31/d3e/f73 zero size 2024-09-13T18:30:25.499 INFO:tasks.workunit.client.1.smithi149.stdout:7/730: mkdir d7/d9/d1c/d1f/d21/d49/d102 0 2024-09-13T18:30:25.499 INFO:tasks.workunit.client.1.smithi149.stdout:3/613: rmdir d1/d2c/d38/d8d 39 2024-09-13T18:30:25.500 INFO:tasks.workunit.client.1.smithi149.stdout:6/725: mknod dc/d76/ceb 0 2024-09-13T18:30:25.500 INFO:tasks.workunit.client.0.smithi038.stdout:8/145: dread d1/d4/fa [0,4194304] 0 2024-09-13T18:30:25.501 INFO:tasks.workunit.client.1.smithi149.stdout:5/582: mkdir d3/d10/d32/d54/db9 0 2024-09-13T18:30:25.502 INFO:tasks.workunit.client.1.smithi149.stdout:5/583: stat d3/d8/f1e 0 2024-09-13T18:30:25.502 INFO:tasks.workunit.client.0.smithi038.stdout:8/146: creat d1/d2a/f38 x:0 0 0 2024-09-13T18:30:25.503 INFO:tasks.workunit.client.1.smithi149.stdout:8/590: mknod d2/d5b/d88/cc6 0 2024-09-13T18:30:25.504 INFO:tasks.workunit.client.0.smithi038.stdout:8/147: getdents d1/d4 0 2024-09-13T18:30:25.504 INFO:tasks.workunit.client.0.smithi038.stdout:8/148: readlink d1/l16 0 2024-09-13T18:30:25.504 INFO:tasks.workunit.client.1.smithi149.stdout:9/477: dwrite d0/d18/d19/f32 [0,4194304] 0 2024-09-13T18:30:25.505 INFO:tasks.workunit.client.1.smithi149.stdout:7/731: symlink d7/d76/db3/d6f/d9d/l103 0 2024-09-13T18:30:25.505 INFO:tasks.workunit.client.1.smithi149.stdout:7/732: creat d7/d9/d1c/d2c/f104 x:0 0 0 2024-09-13T18:30:25.507 INFO:tasks.workunit.client.1.smithi149.stdout:3/614: creat d1/d2e/d1d/d9a/fce x:0 0 0 2024-09-13T18:30:25.511 INFO:tasks.workunit.client.1.smithi149.stdout:5/584: mkdir d3/d10/d32/d54/d97/dba 0 2024-09-13T18:30:25.511 INFO:tasks.workunit.client.1.smithi149.stdout:5/585: dread - d3/d10/d32/d54/f9e zero size 2024-09-13T18:30:25.511 INFO:tasks.workunit.client.1.smithi149.stdout:8/591: symlink d2/d5b/d88/lc7 0 2024-09-13T18:30:25.513 INFO:tasks.workunit.client.1.smithi149.stdout:9/478: mkdir d0/d18/d27/d5c/d99 0 2024-09-13T18:30:25.513 INFO:tasks.workunit.client.1.smithi149.stdout:9/479: dread - d0/f8a zero size 2024-09-13T18:30:25.513 INFO:tasks.workunit.client.1.smithi149.stdout:9/480: write d0/f8a [993191,128635] 0 2024-09-13T18:30:25.513 INFO:tasks.workunit.client.1.smithi149.stdout:0/644: getdents d1/d29/d31/d44 0 2024-09-13T18:30:25.515 INFO:tasks.workunit.client.1.smithi149.stdout:7/733: dread - d7/d9/d1c/d51/dd2/fec zero size 2024-09-13T18:30:25.516 INFO:tasks.workunit.client.1.smithi149.stdout:3/615: creat d1/d2c/d38/d88/d96/fcf x:0 0 0 2024-09-13T18:30:25.516 INFO:tasks.workunit.client.1.smithi149.stdout:3/616: chown d1/d2c 3095 1 2024-09-13T18:30:25.517 INFO:tasks.workunit.client.1.smithi149.stdout:3/617: readlink d1/d2e/d1d/l32 0 2024-09-13T18:30:25.518 INFO:tasks.workunit.client.1.smithi149.stdout:9/481: symlink d0/d47/d54/l9a 0 2024-09-13T18:30:25.518 INFO:tasks.workunit.client.1.smithi149.stdout:6/726: dwrite dc/d15/d23/d5f/fc9 [0,4194304] 0 2024-09-13T18:30:25.518 INFO:tasks.workunit.client.1.smithi149.stdout:6/727: write dc/d15/f36 [177893,100657] 0 2024-09-13T18:30:25.521 INFO:tasks.workunit.client.1.smithi149.stdout:9/482: creat d0/d2e/d42/d59/d86/f9b x:0 0 0 2024-09-13T18:30:25.521 INFO:tasks.workunit.client.1.smithi149.stdout:9/483: readlink d0/l16 0 2024-09-13T18:30:25.524 INFO:tasks.workunit.client.0.smithi038.stdout:8/149: truncate d1/ff 3689582 0 2024-09-13T18:30:25.524 INFO:tasks.workunit.client.0.smithi038.stdout:8/150: dread - d1/d2a/f2e zero size 2024-09-13T18:30:25.525 INFO:tasks.workunit.client.0.smithi038.stdout:8/151: rmdir d1/d4 39 2024-09-13T18:30:25.526 INFO:tasks.workunit.client.1.smithi149.stdout:5/586: dread d3/f4 [0,4194304] 0 2024-09-13T18:30:25.526 INFO:tasks.workunit.client.1.smithi149.stdout:8/592: getdents d2/d5b/d88 0 2024-09-13T18:30:25.526 INFO:tasks.workunit.client.1.smithi149.stdout:7/734: dread d7/d9/f46 [4194304,4194304] 0 2024-09-13T18:30:25.527 INFO:tasks.workunit.client.1.smithi149.stdout:9/484: mkdir d0/d47/d61/d9c 0 2024-09-13T18:30:25.529 INFO:tasks.workunit.client.0.smithi038.stdout:8/152: creat d1/d4/f39 x:0 0 0 2024-09-13T18:30:25.529 INFO:tasks.workunit.client.1.smithi149.stdout:5/587: stat d3/d8/d13/l5f 0 2024-09-13T18:30:25.532 INFO:tasks.workunit.client.1.smithi149.stdout:8/593: rename d2/d12/d40/c47 to d2/cc8 0 2024-09-13T18:30:25.532 INFO:tasks.workunit.client.1.smithi149.stdout:8/594: readlink d2/d12/d1b/lbc 0 2024-09-13T18:30:25.533 INFO:tasks.workunit.client.0.smithi038.stdout:8/153: mkdir d1/de/d3a 0 2024-09-13T18:30:25.533 INFO:tasks.workunit.client.0.smithi038.stdout:8/154: dread - d1/d2a/f38 zero size 2024-09-13T18:30:25.534 INFO:tasks.workunit.client.1.smithi149.stdout:7/735: mknod d7/d9/d11/d50/c105 0 2024-09-13T18:30:25.534 INFO:tasks.workunit.client.1.smithi149.stdout:7/736: read d7/d9/d1c/d1f/d3d/fa7 [179236,99296] 0 2024-09-13T18:30:25.534 INFO:tasks.workunit.client.1.smithi149.stdout:3/618: dwrite d1/d2e/d1d/d6c/fba [0,4194304] 0 2024-09-13T18:30:25.535 INFO:tasks.workunit.client.1.smithi149.stdout:9/485: mknod d0/d2e/d42/d59/d86/c9d 0 2024-09-13T18:30:25.535 INFO:tasks.workunit.client.1.smithi149.stdout:9/486: fsync d0/d47/d61/f6b 0 2024-09-13T18:30:25.536 INFO:tasks.workunit.client.0.smithi038.stdout:8/155: symlink d1/d8/l3b 0 2024-09-13T18:30:25.536 INFO:tasks.workunit.client.0.smithi038.stdout:8/156: creat d1/de/d15/d30/f3c x:0 0 0 2024-09-13T18:30:25.538 INFO:tasks.workunit.client.1.smithi149.stdout:5/588: creat d3/fbb x:0 0 0 2024-09-13T18:30:25.539 INFO:tasks.workunit.client.1.smithi149.stdout:8/595: mknod d2/d12/d1b/d58/d97/cc9 0 2024-09-13T18:30:25.539 INFO:tasks.workunit.client.1.smithi149.stdout:8/596: stat d2/d12/d2a/d4d/c5f 0 2024-09-13T18:30:25.539 INFO:tasks.workunit.client.1.smithi149.stdout:8/597: readlink d2/d12/d87/la1 0 2024-09-13T18:30:25.540 INFO:tasks.workunit.client.1.smithi149.stdout:1/657: sync 2024-09-13T18:30:25.542 INFO:tasks.workunit.client.1.smithi149.stdout:7/737: symlink d7/d9/d1c/d1f/d21/d7b/d96/d9e/l106 0 2024-09-13T18:30:25.542 INFO:tasks.workunit.client.1.smithi149.stdout:7/738: chown d7/d9/d1b 381300150 1 2024-09-13T18:30:25.543 INFO:tasks.workunit.client.0.smithi038.stdout:8/157: link d1/fc d1/d4/f3d 0 2024-09-13T18:30:25.547 INFO:tasks.workunit.client.1.smithi149.stdout:3/619: unlink d1/d12/f77 0 2024-09-13T18:30:25.547 INFO:tasks.workunit.client.1.smithi149.stdout:3/620: dread - d1/d2e/d1d/d9a/f82 zero size 2024-09-13T18:30:25.547 INFO:tasks.workunit.client.0.smithi038.stdout:8/158: creat d1/de/d3a/f3e x:0 0 0 2024-09-13T18:30:25.549 INFO:tasks.workunit.client.1.smithi149.stdout:8/598: mkdir d2/d12/db8/dca 0 2024-09-13T18:30:25.549 INFO:tasks.workunit.client.1.smithi149.stdout:8/599: stat d2/d5b/d86 0 2024-09-13T18:30:25.549 INFO:tasks.workunit.client.1.smithi149.stdout:8/600: fdatasync d2/fc 0 2024-09-13T18:30:25.550 INFO:tasks.workunit.client.1.smithi149.stdout:1/658: rmdir d9/d10/d3f/d76/d8c 39 2024-09-13T18:30:25.551 INFO:tasks.workunit.client.1.smithi149.stdout:8/601: mknod d2/d5b/d86/ccb 0 2024-09-13T18:30:25.551 INFO:tasks.workunit.client.1.smithi149.stdout:8/602: dread - d2/d13/d3a/d7f/d8d/faf zero size 2024-09-13T18:30:25.551 INFO:tasks.workunit.client.1.smithi149.stdout:1/659: getdents d9/d15/d40 0 2024-09-13T18:30:25.554 INFO:tasks.workunit.client.1.smithi149.stdout:8/603: rename d2/d13/d3a/fb2 to d2/d12/d1b/fcc 0 2024-09-13T18:30:25.563 INFO:tasks.workunit.client.1.smithi149.stdout:7/739: dread f5 [0,4194304] 0 2024-09-13T18:30:25.563 INFO:tasks.workunit.client.1.smithi149.stdout:7/740: dread - d7/d9/d11/d50/dde/df7/dae/ff8 zero size 2024-09-13T18:30:25.572 INFO:tasks.workunit.client.1.smithi149.stdout:8/604: dread d2/d5b/f8a [0,4194304] 0 2024-09-13T18:30:25.573 INFO:tasks.workunit.client.0.smithi038.stdout:8/159: dread d1/f1e [0,4194304] 0 2024-09-13T18:30:25.573 INFO:tasks.workunit.client.0.smithi038.stdout:8/160: readlink d1/l16 0 2024-09-13T18:30:25.574 INFO:tasks.workunit.client.0.smithi038.stdout:8/161: mkdir d1/d2a/d3f 0 2024-09-13T18:30:25.574 INFO:tasks.workunit.client.0.smithi038.stdout:8/162: chown d1/de/d15/d30/f34 661476630 1 2024-09-13T18:30:25.582 INFO:tasks.workunit.client.1.smithi149.stdout:8/605: read d2/d5b/f8a [3329130,117146] 0 2024-09-13T18:30:25.584 INFO:tasks.workunit.client.1.smithi149.stdout:9/487: dwrite d0/d18/d19/f23 [0,4194304] 0 2024-09-13T18:30:25.584 INFO:tasks.workunit.client.1.smithi149.stdout:8/606: getdents d2/d12 0 2024-09-13T18:30:25.584 INFO:tasks.workunit.client.1.smithi149.stdout:8/607: creat d2/d12/d2a/d4d/fcd x:0 0 0 2024-09-13T18:30:25.585 INFO:tasks.workunit.client.1.smithi149.stdout:8/608: creat d2/d13/d3a/d7f/da8/fce x:0 0 0 2024-09-13T18:30:25.585 INFO:tasks.workunit.client.1.smithi149.stdout:8/609: chown d2/d12/d1b/d58/d97/cc9 386862 1 2024-09-13T18:30:25.585 INFO:tasks.workunit.client.1.smithi149.stdout:5/589: dwrite d3/d10/d32/d54/f2a [0,4194304] 0 2024-09-13T18:30:25.586 INFO:tasks.workunit.client.1.smithi149.stdout:9/488: rename d0/d18/d19 to d0/d9e 0 2024-09-13T18:30:25.588 INFO:tasks.workunit.client.1.smithi149.stdout:5/590: mknod d3/d8/cbc 0 2024-09-13T18:30:25.600 INFO:tasks.workunit.client.1.smithi149.stdout:9/489: dread d0/d2e/d42/d70/f7d [0,4194304] 0 2024-09-13T18:30:25.601 INFO:tasks.workunit.client.1.smithi149.stdout:9/490: mkdir d0/d18/d27/d5c/d99/d9f 0 2024-09-13T18:30:25.605 INFO:tasks.workunit.client.0.smithi038.stdout:8/163: dwrite d1/d4/fa [0,4194304] 0 2024-09-13T18:30:25.613 INFO:tasks.workunit.client.1.smithi149.stdout:5/591: dwrite d3/d10/d4c/d4e/d61/f96 [0,4194304] 0 2024-09-13T18:30:25.613 INFO:tasks.workunit.client.1.smithi149.stdout:8/610: dwrite d2/d13/f50 [0,4194304] 0 2024-09-13T18:30:25.613 INFO:tasks.workunit.client.1.smithi149.stdout:5/592: chown d3/d10/lad 25 1 2024-09-13T18:30:25.616 INFO:tasks.workunit.client.0.smithi038.stdout:8/164: truncate d1/de/d21/f22 3984747 0 2024-09-13T18:30:25.620 INFO:tasks.workunit.client.1.smithi149.stdout:8/611: mknod d2/ccf 0 2024-09-13T18:30:25.620 INFO:tasks.workunit.client.1.smithi149.stdout:8/612: write d2/d13/d3a/d7f/fb5 [995057,55089] 0 2024-09-13T18:30:25.624 INFO:tasks.workunit.client.0.smithi038.stdout:8/165: write d1/f7 [2846859,92082] 0 2024-09-13T18:30:25.624 INFO:tasks.workunit.client.0.smithi038.stdout:8/166: readlink d1/d8/l32 0 2024-09-13T18:30:25.625 INFO:tasks.workunit.client.1.smithi149.stdout:5/593: write d3/d8/d13/f52 [1249367,120106] 0 2024-09-13T18:30:25.625 INFO:tasks.workunit.client.0.smithi038.stdout:8/167: mkdir d1/d2a/d40 0 2024-09-13T18:30:25.625 INFO:tasks.workunit.client.0.smithi038.stdout:8/168: truncate d1/de/d15/d30/f34 684628 0 2024-09-13T18:30:25.629 INFO:tasks.workunit.client.0.smithi038.stdout:8/169: truncate d1/de/d21/f28 476352 0 2024-09-13T18:30:25.637 INFO:tasks.workunit.client.1.smithi149.stdout:3/621: dwrite d1/d2e/d1d/d9a/f5f [0,4194304] 0 2024-09-13T18:30:25.638 INFO:tasks.workunit.client.1.smithi149.stdout:5/594: read d3/d8/d13/f6c [735468,106552] 0 2024-09-13T18:30:25.638 INFO:tasks.workunit.client.1.smithi149.stdout:1/660: dwrite d9/d15/d60/d80/d8b/d42/f6a [4194304,4194304] 0 2024-09-13T18:30:25.638 INFO:tasks.workunit.client.1.smithi149.stdout:1/661: fsync d9/d10/d83/d97/f9a 0 2024-09-13T18:30:25.639 INFO:tasks.workunit.client.1.smithi149.stdout:1/662: stat d9/d10/d83/d97/f87 0 2024-09-13T18:30:25.639 INFO:tasks.workunit.client.1.smithi149.stdout:7/741: dwrite d7/d9/d11/d50/dde/df7/dae/ff8 [0,4194304] 0 2024-09-13T18:30:25.639 INFO:tasks.workunit.client.1.smithi149.stdout:9/491: dwrite d0/d47/d54/f55 [0,4194304] 0 2024-09-13T18:30:25.639 INFO:tasks.workunit.client.1.smithi149.stdout:9/492: fsync d0/d47/d54/f55 0 2024-09-13T18:30:25.639 INFO:tasks.workunit.client.1.smithi149.stdout:3/622: rename d1/d2e/d1d/fb7 to d1/d47/fd0 0 2024-09-13T18:30:25.643 INFO:tasks.workunit.client.1.smithi149.stdout:1/663: dread d9/d15/d60/d80/d8b/f31 [0,4194304] 0 2024-09-13T18:30:25.647 INFO:tasks.workunit.client.1.smithi149.stdout:7/742: truncate d7/d9/d1c/d34/f5d 7673404 0 2024-09-13T18:30:25.649 INFO:tasks.workunit.client.1.smithi149.stdout:3/623: mkdir d1/d12/d20/d54/dd1 0 2024-09-13T18:30:25.650 INFO:tasks.workunit.client.1.smithi149.stdout:3/624: fdatasync d1/d2e/f55 0 2024-09-13T18:30:25.656 INFO:tasks.workunit.client.1.smithi149.stdout:4/640: sync 2024-09-13T18:30:25.656 INFO:tasks.workunit.client.1.smithi149.stdout:4/641: creat df/da0/d1c/d69/fd7 x:0 0 0 2024-09-13T18:30:25.661 INFO:tasks.workunit.client.1.smithi149.stdout:4/642: mkdir df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3/dc8/dd8 0 2024-09-13T18:30:25.662 INFO:tasks.workunit.client.1.smithi149.stdout:1/664: dread f2 [0,4194304] 0 2024-09-13T18:30:25.662 INFO:tasks.workunit.client.1.smithi149.stdout:5/595: write d3/d10/d4c/d4e/d61/d63/faa [2664037,30904] 0 2024-09-13T18:30:25.664 INFO:tasks.workunit.client.1.smithi149.stdout:1/665: rename d9/d10/d3f/d76/d8c to d9/d15/d60/d80/dcd 0 2024-09-13T18:30:25.664 INFO:tasks.workunit.client.1.smithi149.stdout:1/666: write d9/d10/f1a [323695,78537] 0 2024-09-13T18:30:25.664 INFO:tasks.workunit.client.0.smithi038.stdout:8/170: dwrite d1/d4/f12 [0,4194304] 0 2024-09-13T18:30:25.665 INFO:tasks.workunit.client.0.smithi038.stdout:8/171: write d1/d8/f19 [5255777,14496] 0 2024-09-13T18:30:25.666 INFO:tasks.workunit.client.1.smithi149.stdout:5/596: mkdir d3/d10/d32/d54/dbd 0 2024-09-13T18:30:25.679 INFO:tasks.workunit.client.1.smithi149.stdout:9/493: dwrite d0/d9e/f3f [0,4194304] 0 2024-09-13T18:30:25.679 INFO:tasks.workunit.client.1.smithi149.stdout:9/494: fsync d0/d18/d27/d5c/d7e/f97 0 2024-09-13T18:30:25.679 INFO:tasks.workunit.client.1.smithi149.stdout:9/495: fdatasync d0/d47/d54/d75/f95 0 2024-09-13T18:30:25.682 INFO:tasks.workunit.client.1.smithi149.stdout:9/496: rename d0/d9e/c4c to d0/d2e/d42/ca0 0 2024-09-13T18:30:25.697 INFO:tasks.workunit.client.1.smithi149.stdout:4/643: dwrite df/da0/d1c/f3f [0,4194304] 0 2024-09-13T18:30:25.697 INFO:tasks.workunit.client.1.smithi149.stdout:4/644: readlink df/da0/d12/d21/l6b 0 2024-09-13T18:30:25.697 INFO:tasks.workunit.client.1.smithi149.stdout:7/743: dwrite d7/d9/d1c/d1f/d21/d7b/fed [0,4194304] 0 2024-09-13T18:30:25.697 INFO:tasks.workunit.client.1.smithi149.stdout:3/625: dwrite d1/d2e/d93/fcb [0,4194304] 0 2024-09-13T18:30:25.699 INFO:tasks.workunit.client.1.smithi149.stdout:4/645: getdents df/da0/d12 0 2024-09-13T18:30:25.699 INFO:tasks.workunit.client.1.smithi149.stdout:4/646: write df/da0/d12/d17/d3d/f6c [6624852,130792] 0 2024-09-13T18:30:25.702 INFO:tasks.workunit.client.1.smithi149.stdout:3/626: symlink d1/d12/ld2 0 2024-09-13T18:30:25.702 INFO:tasks.workunit.client.1.smithi149.stdout:3/627: fdatasync d1/d2e/d1d/d49/f8a 0 2024-09-13T18:30:25.702 INFO:tasks.workunit.client.1.smithi149.stdout:3/628: write d1/d47/d30/d46/f9d [265910,7476] 0 2024-09-13T18:30:25.704 INFO:tasks.workunit.client.1.smithi149.stdout:3/629: creat d1/d2c/d38/d88/fd3 x:0 0 0 2024-09-13T18:30:25.705 INFO:tasks.workunit.client.1.smithi149.stdout:3/630: mknod d1/d12/cd4 0 2024-09-13T18:30:25.706 INFO:tasks.workunit.client.1.smithi149.stdout:3/631: chown d1/d12/l36 1136156 1 2024-09-13T18:30:25.707 INFO:tasks.workunit.client.1.smithi149.stdout:3/632: creat d1/d2c/d56/fd5 x:0 0 0 2024-09-13T18:30:25.707 INFO:tasks.workunit.client.1.smithi149.stdout:3/633: mknod d1/d2c/d38/d88/cd6 0 2024-09-13T18:30:25.710 INFO:tasks.workunit.client.1.smithi149.stdout:4/647: dread df/da0/f16 [0,4194304] 0 2024-09-13T18:30:25.710 INFO:tasks.workunit.client.1.smithi149.stdout:4/648: write df/da0/d12/d21/f24 [4403851,44006] 0 2024-09-13T18:30:25.710 INFO:tasks.workunit.client.1.smithi149.stdout:4/649: truncate df/da0/d1c/f67 439825 0 2024-09-13T18:30:25.712 INFO:tasks.workunit.client.1.smithi149.stdout:7/744: dwrite d7/d9/d1b/d71/ddc/d53/dbe/fdd [0,4194304] 0 2024-09-13T18:30:25.715 INFO:tasks.workunit.client.1.smithi149.stdout:7/745: symlink d7/d9/d1b/d71/ddc/d53/daa/l107 0 2024-09-13T18:30:25.720 INFO:tasks.workunit.client.1.smithi149.stdout:3/634: dread d1/d2e/d1d/f6b [0,4194304] 0 2024-09-13T18:30:25.720 INFO:tasks.workunit.client.1.smithi149.stdout:3/635: truncate d1/d2c/fa8 107 0 2024-09-13T18:30:25.720 INFO:tasks.workunit.client.1.smithi149.stdout:3/636: creat d1/d2c/d38/d88/d96/fd7 x:0 0 0 2024-09-13T18:30:25.721 INFO:tasks.workunit.client.1.smithi149.stdout:3/637: creat d1/d2c/d38/d88/d96/fd8 x:0 0 0 2024-09-13T18:30:25.724 INFO:tasks.workunit.client.1.smithi149.stdout:7/746: dread d7/d76/db3/d31/f3f [0,4194304] 0 2024-09-13T18:30:25.728 INFO:tasks.workunit.client.1.smithi149.stdout:3/638: creat d1/d2e/d1d/d6c/dcd/fd9 x:0 0 0 2024-09-13T18:30:25.730 INFO:tasks.workunit.client.1.smithi149.stdout:7/747: truncate f5 3561407 0 2024-09-13T18:30:25.730 INFO:tasks.workunit.client.1.smithi149.stdout:7/748: readlink d7/d9/d11/d50/dde/df7/le9 0 2024-09-13T18:30:25.731 INFO:tasks.workunit.client.1.smithi149.stdout:3/639: creat d1/d2c/d38/d8d/fda x:0 0 0 2024-09-13T18:30:25.732 INFO:tasks.workunit.client.1.smithi149.stdout:0/645: sync 2024-09-13T18:30:25.732 INFO:tasks.workunit.client.1.smithi149.stdout:2/579: sync 2024-09-13T18:30:25.733 INFO:tasks.workunit.client.1.smithi149.stdout:7/749: truncate d7/d9/d11/d50/dde/df7/dae/ff8 2238580 0 2024-09-13T18:30:25.733 INFO:tasks.workunit.client.1.smithi149.stdout:0/646: getdents d1/d48/d92 0 2024-09-13T18:30:25.735 INFO:tasks.workunit.client.1.smithi149.stdout:2/580: mknod db/d1b/d1c/d85/cc7 0 2024-09-13T18:30:25.735 INFO:tasks.workunit.client.1.smithi149.stdout:4/650: dwrite df/da0/d12/d21/f24 [0,4194304] 0 2024-09-13T18:30:25.736 INFO:tasks.workunit.client.1.smithi149.stdout:0/647: dread d1/d29/d31/d44/d81/fb3 [0,4194304] 0 2024-09-13T18:30:25.739 INFO:tasks.workunit.client.1.smithi149.stdout:4/651: mknod df/da0/d12/d21/d22/d30/d56/d91/cd9 0 2024-09-13T18:30:25.740 INFO:tasks.workunit.client.1.smithi149.stdout:7/750: dread d7/d9/d11/f94 [0,4194304] 0 2024-09-13T18:30:25.742 INFO:tasks.workunit.client.1.smithi149.stdout:4/652: symlink df/da0/dcc/lda 0 2024-09-13T18:30:25.742 INFO:tasks.workunit.client.1.smithi149.stdout:4/653: write df/da0/d12/f85 [1713809,92950] 0 2024-09-13T18:30:25.742 INFO:tasks.workunit.client.1.smithi149.stdout:4/654: write df/da0/d12/d21/d22/d30/d56/d91/fb2 [490883,28250] 0 2024-09-13T18:30:25.750 INFO:tasks.workunit.client.1.smithi149.stdout:7/751: dread d7/d9/d1c/d1f/f73 [0,4194304] 0 2024-09-13T18:30:25.752 INFO:tasks.workunit.client.1.smithi149.stdout:3/640: dwrite d1/d47/d30/fbd [4194304,4194304] 0 2024-09-13T18:30:25.752 INFO:tasks.workunit.client.1.smithi149.stdout:3/641: chown d1/d2c/d38/d88/d96/cc9 55 1 2024-09-13T18:30:25.753 INFO:tasks.workunit.client.1.smithi149.stdout:7/752: creat d7/d9/f108 x:0 0 0 2024-09-13T18:30:25.753 INFO:tasks.workunit.client.1.smithi149.stdout:7/753: chown d7/d9/d11/de2 1761644835 1 2024-09-13T18:30:25.762 INFO:tasks.workunit.client.1.smithi149.stdout:0/648: dwrite d1/f5 [8388608,4194304] 0 2024-09-13T18:30:25.765 INFO:tasks.workunit.client.1.smithi149.stdout:0/649: unlink d1/d2/f89 0 2024-09-13T18:30:25.765 INFO:tasks.workunit.client.1.smithi149.stdout:3/642: dread d1/d2e/f37 [0,4194304] 0 2024-09-13T18:30:25.767 INFO:tasks.workunit.client.1.smithi149.stdout:4/655: dwrite df/da0/d12/d17/f49 [0,4194304] 0 2024-09-13T18:30:25.771 INFO:tasks.workunit.client.1.smithi149.stdout:4/656: unlink l6 0 2024-09-13T18:30:25.774 INFO:tasks.workunit.client.1.smithi149.stdout:4/657: mkdir df/da0/d12/d21/d22/d30/d56/ddb 0 2024-09-13T18:30:25.776 INFO:tasks.workunit.client.1.smithi149.stdout:4/658: link df/da0/d12/c84 df/da0/d1c/cdc 0 2024-09-13T18:30:25.789 INFO:tasks.workunit.client.1.smithi149.stdout:3/643: write d1/d2e/d93/fcb [907342,2535] 0 2024-09-13T18:30:25.789 INFO:tasks.workunit.client.1.smithi149.stdout:0/650: dwrite d1/d29/d31/d44/d47/f84 [0,4194304] 0 2024-09-13T18:30:25.789 INFO:tasks.workunit.client.1.smithi149.stdout:0/651: creat d1/d48/d92/db4/dbe/fe0 x:0 0 0 2024-09-13T18:30:25.789 INFO:tasks.workunit.client.1.smithi149.stdout:0/652: dread - d1/d2/d8a/fd0 zero size 2024-09-13T18:30:25.790 INFO:tasks.workunit.client.1.smithi149.stdout:3/644: mkdir d1/d48/ddb 0 2024-09-13T18:30:25.792 INFO:tasks.workunit.client.1.smithi149.stdout:4/659: dwrite df/da0/d12/d17/faf [0,4194304] 0 2024-09-13T18:30:25.794 INFO:tasks.workunit.client.1.smithi149.stdout:0/653: getdents d1/d1b 0 2024-09-13T18:30:25.795 INFO:tasks.workunit.client.1.smithi149.stdout:3/645: dread d1/d12/f1a [0,4194304] 0 2024-09-13T18:30:25.797 INFO:tasks.workunit.client.1.smithi149.stdout:0/654: mknod d1/d29/d31/d3e/ce1 0 2024-09-13T18:30:25.797 INFO:tasks.workunit.client.1.smithi149.stdout:0/655: chown d1/d2/d41/d46 785099 1 2024-09-13T18:30:25.798 INFO:tasks.workunit.client.1.smithi149.stdout:3/646: link d1/d2c/l86 d1/d12/d20/d91/ldc 0 2024-09-13T18:30:25.799 INFO:tasks.workunit.client.1.smithi149.stdout:0/656: symlink d1/d2/d8a/da9/dd7/le2 0 2024-09-13T18:30:25.802 INFO:tasks.workunit.client.1.smithi149.stdout:0/657: unlink d1/d2/d41/lb7 0 2024-09-13T18:30:25.802 INFO:tasks.workunit.client.1.smithi149.stdout:0/658: read - d1/d2/d41/d46/d7b/daf/fbd zero size 2024-09-13T18:30:25.802 INFO:tasks.workunit.client.1.smithi149.stdout:0/659: chown d1/d29/d31/d44/d81/d9f 192790 1 2024-09-13T18:30:25.804 INFO:tasks.workunit.client.1.smithi149.stdout:0/660: mknod d1/d2/d8a/dc2/ce3 0 2024-09-13T18:30:25.805 INFO:tasks.workunit.client.1.smithi149.stdout:0/661: creat d1/d2/fe4 x:0 0 0 2024-09-13T18:30:25.807 INFO:tasks.workunit.client.1.smithi149.stdout:0/662: creat d1/d2/d8a/da9/fe5 x:0 0 0 2024-09-13T18:30:25.811 INFO:tasks.workunit.client.1.smithi149.stdout:0/663: dread d1/d1b/f3d [0,4194304] 0 2024-09-13T18:30:25.812 INFO:tasks.workunit.client.1.smithi149.stdout:0/664: mknod d1/d48/d92/db4/ce6 0 2024-09-13T18:30:25.812 INFO:tasks.workunit.client.1.smithi149.stdout:0/665: chown d1/d1b/f67 193 1 2024-09-13T18:30:25.812 INFO:tasks.workunit.client.1.smithi149.stdout:0/666: creat d1/d2/d4e/fe7 x:0 0 0 2024-09-13T18:30:25.812 INFO:tasks.workunit.client.1.smithi149.stdout:0/667: truncate d1/d29/d31/d44/d81/fb3 885059 0 2024-09-13T18:30:25.813 INFO:tasks.workunit.client.1.smithi149.stdout:0/668: link d1/f42 d1/d29/d31/fe8 0 2024-09-13T18:30:25.815 INFO:tasks.workunit.client.1.smithi149.stdout:0/669: getdents d1/d2/d41/d46/d7b/d98 0 2024-09-13T18:30:25.815 INFO:tasks.workunit.client.1.smithi149.stdout:0/670: chown d1/d29/d31/f88 0 1 2024-09-13T18:30:25.815 INFO:tasks.workunit.client.1.smithi149.stdout:0/671: dread - d1/d29/d31/d83/d87/fdf zero size 2024-09-13T18:30:25.816 INFO:tasks.workunit.client.1.smithi149.stdout:4/660: dwrite fc [0,4194304] 0 2024-09-13T18:30:25.816 INFO:tasks.workunit.client.1.smithi149.stdout:6/728: sync 2024-09-13T18:30:25.816 INFO:tasks.workunit.client.1.smithi149.stdout:8/613: sync 2024-09-13T18:30:25.816 INFO:tasks.workunit.client.1.smithi149.stdout:1/667: sync 2024-09-13T18:30:25.816 INFO:tasks.workunit.client.1.smithi149.stdout:4/661: readlink df/da0/d12/laa 0 2024-09-13T18:30:25.817 INFO:tasks.workunit.client.1.smithi149.stdout:0/672: unlink d1/d29/fd1 0 2024-09-13T18:30:25.817 INFO:tasks.workunit.client.1.smithi149.stdout:0/673: dread - d1/d29/d31/d44/fde zero size 2024-09-13T18:30:25.818 INFO:tasks.workunit.client.1.smithi149.stdout:4/662: mkdir df/da0/d1c/d7e/ddd 0 2024-09-13T18:30:25.819 INFO:tasks.workunit.client.1.smithi149.stdout:3/647: dwrite d1/d47/d30/f3c [0,4194304] 0 2024-09-13T18:30:25.819 INFO:tasks.workunit.client.1.smithi149.stdout:3/648: readlink d1/d2e/d1d/d9a/d39/l80 0 2024-09-13T18:30:25.819 INFO:tasks.workunit.client.1.smithi149.stdout:3/649: chown d1/f11 7056580 1 2024-09-13T18:30:25.821 INFO:tasks.workunit.client.1.smithi149.stdout:6/729: rename dc/d70/dbc/cb1 to dc/d15/d23/d57/cec 0 2024-09-13T18:30:25.824 INFO:tasks.workunit.client.1.smithi149.stdout:0/674: mknod d1/d29/d31/d83/d87/ce9 0 2024-09-13T18:30:25.824 INFO:tasks.workunit.client.1.smithi149.stdout:4/663: creat df/da0/d1c/d7e/d9f/fde x:0 0 0 2024-09-13T18:30:25.828 INFO:tasks.workunit.client.1.smithi149.stdout:8/614: dread d2/f34 [0,4194304] 0 2024-09-13T18:30:25.834 INFO:tasks.workunit.client.1.smithi149.stdout:4/664: mknod df/da0/d12/cdf 0 2024-09-13T18:30:25.834 INFO:tasks.workunit.client.1.smithi149.stdout:4/665: chown df/da0/d12/d21/d22/d30 9025820 1 2024-09-13T18:30:25.834 INFO:tasks.workunit.client.1.smithi149.stdout:4/666: write df/da0/d12/d21/d22/d30/d41/f99 [1604308,115112] 0 2024-09-13T18:30:25.835 INFO:tasks.workunit.client.1.smithi149.stdout:8/615: creat d2/db1/fd0 x:0 0 0 2024-09-13T18:30:25.835 INFO:tasks.workunit.client.1.smithi149.stdout:8/616: write d2/fa5 [4289632,100878] 0 2024-09-13T18:30:25.836 INFO:tasks.workunit.client.1.smithi149.stdout:6/730: dread dc/d15/d23/f40 [0,4194304] 0 2024-09-13T18:30:25.838 INFO:tasks.workunit.client.1.smithi149.stdout:0/675: rmdir d1/d2/d41/d46/d7b/daf 39 2024-09-13T18:30:25.838 INFO:tasks.workunit.client.1.smithi149.stdout:0/676: write d1/d2/d41/d46/d7b/fbc [968328,62995] 0 2024-09-13T18:30:25.840 INFO:tasks.workunit.client.1.smithi149.stdout:4/667: rename df/da0/d12/d21/d22/d30/d56/d91/dcb/fd3 to df/da0/d12/d17/fe0 0 2024-09-13T18:30:25.847 INFO:tasks.workunit.client.1.smithi149.stdout:0/677: dread d1/f13 [0,4194304] 0 2024-09-13T18:30:25.848 INFO:tasks.workunit.client.1.smithi149.stdout:0/678: dread - d1/d29/d31/d44/fde zero size 2024-09-13T18:30:25.848 INFO:tasks.workunit.client.1.smithi149.stdout:3/650: dwrite d1/d2c/d38/d88/d96/fd8 [0,4194304] 0 2024-09-13T18:30:25.849 INFO:tasks.workunit.client.1.smithi149.stdout:1/668: dwrite d9/d10/d34/d53/f9e [0,4194304] 0 2024-09-13T18:30:25.850 INFO:tasks.workunit.client.1.smithi149.stdout:0/679: link d1/d2/d4e/fe7 d1/d29/d31/d44/d81/d62/fea 0 2024-09-13T18:30:25.850 INFO:tasks.workunit.client.1.smithi149.stdout:0/680: write d1/d29/d31/d44/d81/d62/fea [633153,103144] 0 2024-09-13T18:30:25.853 INFO:tasks.workunit.client.1.smithi149.stdout:3/651: getdents d1/d2e/d1d/d9a/d39 0 2024-09-13T18:30:25.863 INFO:tasks.workunit.client.1.smithi149.stdout:1/669: write d9/d10/d34/dbe/d38/f4e [1782274,96965] 0 2024-09-13T18:30:25.864 INFO:tasks.workunit.client.1.smithi149.stdout:4/668: read df/da0/d12/d21/d22/f62 [2372794,32323] 0 2024-09-13T18:30:25.864 INFO:tasks.workunit.client.1.smithi149.stdout:0/681: truncate d1/d29/d31/f52 982698 0 2024-09-13T18:30:25.866 INFO:tasks.workunit.client.1.smithi149.stdout:1/670: creat d9/fce x:0 0 0 2024-09-13T18:30:25.866 INFO:tasks.workunit.client.1.smithi149.stdout:1/671: write d9/d10/d34/f51 [4216359,88207] 0 2024-09-13T18:30:25.866 INFO:tasks.workunit.client.1.smithi149.stdout:1/672: readlink d9/d10/d62/lbb 0 2024-09-13T18:30:25.866 INFO:tasks.workunit.client.1.smithi149.stdout:1/673: readlink d9/d10/l1e 0 2024-09-13T18:30:25.866 INFO:tasks.workunit.client.1.smithi149.stdout:1/674: write d9/d58/fa9 [1364654,12486] 0 2024-09-13T18:30:25.866 INFO:tasks.workunit.client.1.smithi149.stdout:4/669: rename df/f15 to df/da0/d1c/fe1 0 2024-09-13T18:30:25.866 INFO:tasks.workunit.client.1.smithi149.stdout:4/670: read - df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fd1 zero size 2024-09-13T18:30:25.868 INFO:tasks.workunit.client.1.smithi149.stdout:0/682: unlink d1/d2/d41/d46/d7b/daf/lce 0 2024-09-13T18:30:25.869 INFO:tasks.workunit.client.1.smithi149.stdout:6/731: dwrite dc/d15/d54/d85/f89 [0,4194304] 0 2024-09-13T18:30:25.869 INFO:tasks.workunit.client.1.smithi149.stdout:6/732: truncate dc/d70/dbc/f6e 1685257 0 2024-09-13T18:30:25.871 INFO:tasks.workunit.client.1.smithi149.stdout:1/675: mknod d9/d15/d40/d90/ccf 0 2024-09-13T18:30:25.875 INFO:tasks.workunit.client.1.smithi149.stdout:6/733: link dc/d15/d23/d57/da5/fd0 dc/d15/d23/d57/da5/fed 0 2024-09-13T18:30:25.876 INFO:tasks.workunit.client.1.smithi149.stdout:4/671: dread df/da0/d12/f3c [0,4194304] 0 2024-09-13T18:30:25.877 INFO:tasks.workunit.client.1.smithi149.stdout:1/676: rename d9/f1c to d9/d10/d43/dcb/fd0 0 2024-09-13T18:30:25.877 INFO:tasks.workunit.client.1.smithi149.stdout:3/652: dwrite d1/d2e/d1d/d49/fbf [0,4194304] 0 2024-09-13T18:30:25.878 INFO:tasks.workunit.client.1.smithi149.stdout:4/672: link df/da0/d12/d21/c4d df/da0/d70/db5/dc7/ce2 0 2024-09-13T18:30:25.881 INFO:tasks.workunit.client.1.smithi149.stdout:0/683: dread d1/d48/fa2 [0,4194304] 0 2024-09-13T18:30:25.881 INFO:tasks.workunit.client.1.smithi149.stdout:0/684: chown d1/d2/d8a/f9b 10660 1 2024-09-13T18:30:25.882 INFO:tasks.workunit.client.1.smithi149.stdout:3/653: creat d1/d48/d75/fdd x:0 0 0 2024-09-13T18:30:25.883 INFO:tasks.workunit.client.1.smithi149.stdout:4/673: mkdir df/da0/d12/d21/d22/d30/d41/d57/d75/da1/de3 0 2024-09-13T18:30:25.885 INFO:tasks.workunit.client.1.smithi149.stdout:0/685: link d1/d2/d8a/cb6 d1/ceb 0 2024-09-13T18:30:25.885 INFO:tasks.workunit.client.1.smithi149.stdout:6/734: write dc/d15/d23/d5f/fa4 [3973616,50336] 0 2024-09-13T18:30:25.887 INFO:tasks.workunit.client.1.smithi149.stdout:4/674: getdents df/da0/d12/d21/d22/d30/d41/d57 0 2024-09-13T18:30:25.887 INFO:tasks.workunit.client.1.smithi149.stdout:3/654: truncate d1/d2e/d1d/f2b 2627815 0 2024-09-13T18:30:25.887 INFO:tasks.workunit.client.1.smithi149.stdout:4/675: stat df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3 0 2024-09-13T18:30:25.889 INFO:tasks.workunit.client.1.smithi149.stdout:3/655: unlink d1/d2e/d1d/d49/lcc 0 2024-09-13T18:30:25.890 INFO:tasks.workunit.client.1.smithi149.stdout:9/497: sync 2024-09-13T18:30:25.890 INFO:tasks.workunit.client.1.smithi149.stdout:3/656: fdatasync d1/d12/db9/fbc 0 2024-09-13T18:30:25.890 INFO:tasks.workunit.client.1.smithi149.stdout:1/677: write d9/d10/d34/d53/d57/f65 [3233184,58162] 0 2024-09-13T18:30:25.890 INFO:tasks.workunit.client.1.smithi149.stdout:4/676: mknod df/da0/dcc/ce4 0 2024-09-13T18:30:25.893 INFO:tasks.workunit.client.1.smithi149.stdout:3/657: symlink d1/d48/ddb/lde 0 2024-09-13T18:30:25.893 INFO:tasks.workunit.client.1.smithi149.stdout:3/658: fdatasync d1/d2c/d8b/fac 0 2024-09-13T18:30:25.896 INFO:tasks.workunit.client.1.smithi149.stdout:4/677: creat df/da0/d1c/d7e/ddd/fe5 x:0 0 0 2024-09-13T18:30:25.896 INFO:tasks.workunit.client.1.smithi149.stdout:6/735: dread dc/d15/d23/d57/d5c/f84 [0,4194304] 0 2024-09-13T18:30:25.897 INFO:tasks.workunit.client.1.smithi149.stdout:9/498: rmdir d0/d2e/d42/d59/d86 39 2024-09-13T18:30:25.900 INFO:tasks.workunit.client.1.smithi149.stdout:4/678: unlink df/da0/d12/d21/d22/d30/d56/d91/f93 0 2024-09-13T18:30:25.900 INFO:tasks.workunit.client.1.smithi149.stdout:1/678: write d9/d10/d34/d53/d57/fa1 [1671488,96988] 0 2024-09-13T18:30:25.900 INFO:tasks.workunit.client.1.smithi149.stdout:4/679: fdatasync df/da0/d12/d21/d22/d30/d41/d57/d8a/fa2 0 2024-09-13T18:30:25.900 INFO:tasks.workunit.client.1.smithi149.stdout:6/736: creat dc/d15/d54/d5e/d79/fee x:0 0 0 2024-09-13T18:30:25.901 INFO:tasks.workunit.client.1.smithi149.stdout:9/499: creat d0/d18/d27/d5c/d79/fa1 x:0 0 0 2024-09-13T18:30:25.902 INFO:tasks.workunit.client.1.smithi149.stdout:1/679: truncate d9/d15/d60/d80/f9d 236794 0 2024-09-13T18:30:25.903 INFO:tasks.workunit.client.1.smithi149.stdout:1/680: creat d9/d10/d62/fd1 x:0 0 0 2024-09-13T18:30:25.904 INFO:tasks.workunit.client.1.smithi149.stdout:4/680: link df/da0/d12/d21/d22/d30/d41/fb1 df/da0/d12/d21/d22/d30/d56/d91/dcb/fe6 0 2024-09-13T18:30:25.905 INFO:tasks.workunit.client.1.smithi149.stdout:0/686: dwrite d1/d2/d8a/f9b [0,4194304] 0 2024-09-13T18:30:25.906 INFO:tasks.workunit.client.1.smithi149.stdout:9/500: dread d0/d2e/d42/d59/f7c [0,4194304] 0 2024-09-13T18:30:25.906 INFO:tasks.workunit.client.1.smithi149.stdout:5/597: sync 2024-09-13T18:30:25.910 INFO:tasks.workunit.client.1.smithi149.stdout:4/681: creat df/da0/d70/db5/db9/fe7 x:0 0 0 2024-09-13T18:30:25.914 INFO:tasks.workunit.client.1.smithi149.stdout:0/687: symlink d1/d29/lec 0 2024-09-13T18:30:25.914 INFO:tasks.workunit.client.1.smithi149.stdout:0/688: fdatasync d1/d2/d8a/d90/f68 0 2024-09-13T18:30:25.914 INFO:tasks.workunit.client.1.smithi149.stdout:5/598: mknod d3/d10/d32/d54/d76/cbe 0 2024-09-13T18:30:25.915 INFO:tasks.workunit.client.1.smithi149.stdout:4/682: truncate df/da0/d12/d21/d22/f5e 2572079 0 2024-09-13T18:30:25.917 INFO:tasks.workunit.client.1.smithi149.stdout:0/689: mknod d1/d2/d8a/da9/dd7/ced 0 2024-09-13T18:30:25.917 INFO:tasks.workunit.client.1.smithi149.stdout:3/659: read d1/d2e/d1d/d49/fbf [1804213,89153] 0 2024-09-13T18:30:25.918 INFO:tasks.workunit.client.1.smithi149.stdout:5/599: creat d3/d10/d4c/db8/fbf x:0 0 0 2024-09-13T18:30:25.921 INFO:tasks.workunit.client.1.smithi149.stdout:0/690: rename d1/d1b/f67 to d1/d29/fee 0 2024-09-13T18:30:25.921 INFO:tasks.workunit.client.1.smithi149.stdout:0/691: stat d1/f2b 0 2024-09-13T18:30:25.921 INFO:tasks.workunit.client.1.smithi149.stdout:0/692: chown d1/d2/d41/d46/fcb 6411648 1 2024-09-13T18:30:25.921 INFO:tasks.workunit.client.1.smithi149.stdout:0/693: chown d1/d48/d92/lab 22031 1 2024-09-13T18:30:25.922 INFO:tasks.workunit.client.1.smithi149.stdout:3/660: rmdir d1/d12/dbe 0 2024-09-13T18:30:25.923 INFO:tasks.workunit.client.1.smithi149.stdout:5/600: unlink d3/d8/d13/f22 0 2024-09-13T18:30:25.923 INFO:tasks.workunit.client.1.smithi149.stdout:5/601: chown d3/d10/d4c/d4e/d61/d63/c79 727470972 1 2024-09-13T18:30:25.923 INFO:tasks.workunit.client.1.smithi149.stdout:9/501: dread d0/d2e/f58 [4194304,4194304] 0 2024-09-13T18:30:25.926 INFO:tasks.workunit.client.1.smithi149.stdout:9/502: symlink d0/d18/d27/d5c/d99/la2 0 2024-09-13T18:30:25.929 INFO:tasks.workunit.client.1.smithi149.stdout:4/683: dread df/da0/d1c/fe1 [4194304,4194304] 0 2024-09-13T18:30:25.930 INFO:tasks.workunit.client.1.smithi149.stdout:9/503: symlink d0/d18/d27/d5c/d99/la3 0 2024-09-13T18:30:25.930 INFO:tasks.workunit.client.1.smithi149.stdout:5/602: rmdir d3/d10/d32/d54 39 2024-09-13T18:30:25.930 INFO:tasks.workunit.client.1.smithi149.stdout:4/684: rmdir df/da0/d12/d21/d22/d30/d41/d57/d60/dc4 39 2024-09-13T18:30:25.931 INFO:tasks.workunit.client.1.smithi149.stdout:4/685: chown df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3/dc8 114196 1 2024-09-13T18:30:25.933 INFO:tasks.workunit.client.1.smithi149.stdout:5/603: mknod d3/d10/d32/d67/d83/cc0 0 2024-09-13T18:30:25.935 INFO:tasks.workunit.client.1.smithi149.stdout:6/737: dwrite dc/d15/d23/fde [0,4194304] 0 2024-09-13T18:30:25.935 INFO:tasks.workunit.client.1.smithi149.stdout:5/604: unlink l2 0 2024-09-13T18:30:25.936 INFO:tasks.workunit.client.1.smithi149.stdout:5/605: truncate d3/f5c 314118 0 2024-09-13T18:30:25.942 INFO:tasks.workunit.client.1.smithi149.stdout:0/694: dread d1/d48/d92/db4/db5/fc0 [0,4194304] 0 2024-09-13T18:30:25.942 INFO:tasks.workunit.client.1.smithi149.stdout:0/695: chown d1/d48/f64 324798 1 2024-09-13T18:30:25.942 INFO:tasks.workunit.client.1.smithi149.stdout:0/696: fsync d1/d29/d31/d44/d47/f59 0 2024-09-13T18:30:25.942 INFO:tasks.workunit.client.1.smithi149.stdout:0/697: chown d1/d29/d31/f88 541382 1 2024-09-13T18:30:25.943 INFO:tasks.workunit.client.1.smithi149.stdout:1/681: dwrite d9/d10/d34/dbe/f5a [0,4194304] 0 2024-09-13T18:30:25.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/738: getdents dc/d15/daa/de5/de6 0 2024-09-13T18:30:25.943 INFO:tasks.workunit.client.1.smithi149.stdout:5/606: creat d3/d10/d32/fc1 x:0 0 0 2024-09-13T18:30:25.944 INFO:tasks.workunit.client.1.smithi149.stdout:4/686: dread df/da0/d12/d21/d22/d30/f37 [4194304,4194304] 0 2024-09-13T18:30:25.945 INFO:tasks.workunit.client.1.smithi149.stdout:4/687: stat df/da0/d12/d21/f4a 0 2024-09-13T18:30:25.948 INFO:tasks.workunit.client.1.smithi149.stdout:1/682: creat d9/d15/d73/fd2 x:0 0 0 2024-09-13T18:30:25.951 INFO:tasks.workunit.client.1.smithi149.stdout:6/739: truncate dc/d15/d23/d5f/f67 654292 0 2024-09-13T18:30:25.951 INFO:tasks.workunit.client.1.smithi149.stdout:6/740: write dc/d15/d23/d5f/fdb [372586,110052] 0 2024-09-13T18:30:25.951 INFO:tasks.workunit.client.1.smithi149.stdout:5/607: write d3/d5e/fa2 [117532,53819] 0 2024-09-13T18:30:25.952 INFO:tasks.workunit.client.1.smithi149.stdout:4/688: symlink df/da0/d12/d21/d22/d30/d41/d57/d75/le8 0 2024-09-13T18:30:25.953 INFO:tasks.workunit.client.1.smithi149.stdout:1/683: symlink d9/d15/d60/d80/dcd/dab/ld3 0 2024-09-13T18:30:25.955 INFO:tasks.workunit.client.1.smithi149.stdout:5/608: truncate d3/d8/f27 2256888 0 2024-09-13T18:30:25.957 INFO:tasks.workunit.client.1.smithi149.stdout:5/609: read - d3/d10/f80 zero size 2024-09-13T18:30:25.957 INFO:tasks.workunit.client.1.smithi149.stdout:5/610: creat d3/d10/d4c/db8/fc2 x:0 0 0 2024-09-13T18:30:25.959 INFO:tasks.workunit.client.1.smithi149.stdout:0/698: dread d1/d29/d31/d44/d47/f84 [0,4194304] 0 2024-09-13T18:30:25.960 INFO:tasks.workunit.client.1.smithi149.stdout:0/699: dread - d1/d29/d31/d3e/f73 zero size 2024-09-13T18:30:25.961 INFO:tasks.workunit.client.1.smithi149.stdout:2/581: sync 2024-09-13T18:30:25.961 INFO:tasks.workunit.client.1.smithi149.stdout:7/754: sync 2024-09-13T18:30:25.964 INFO:tasks.workunit.client.1.smithi149.stdout:2/582: mkdir db/d1b/d6c/dc8 0 2024-09-13T18:30:25.965 INFO:tasks.workunit.client.1.smithi149.stdout:9/504: dwrite d0/d18/d27/f6e [0,4194304] 0 2024-09-13T18:30:25.965 INFO:tasks.workunit.client.1.smithi149.stdout:9/505: stat d0/f67 0 2024-09-13T18:30:25.966 INFO:tasks.workunit.client.1.smithi149.stdout:2/583: mknod db/d1b/dab/cc9 0 2024-09-13T18:30:25.966 INFO:tasks.workunit.client.1.smithi149.stdout:2/584: dread - db/d10/f4e zero size 2024-09-13T18:30:25.968 INFO:tasks.workunit.client.1.smithi149.stdout:9/506: rename d0/d9e/d3b/f8d to d0/d2e/d42/d59/d86/fa4 0 2024-09-13T18:30:25.969 INFO:tasks.workunit.client.1.smithi149.stdout:3/661: dwrite d1/d47/d30/d5a/fc6 [0,4194304] 0 2024-09-13T18:30:25.969 INFO:tasks.workunit.client.1.smithi149.stdout:3/662: read - d1/d2c/d38/d8d/fbb zero size 2024-09-13T18:30:25.970 INFO:tasks.workunit.client.1.smithi149.stdout:3/663: chown d1/d2e/c1c 1 1 2024-09-13T18:30:25.970 INFO:tasks.workunit.client.1.smithi149.stdout:3/664: chown d1/d47/d30/d46 1 1 2024-09-13T18:30:25.970 INFO:tasks.workunit.client.1.smithi149.stdout:2/585: symlink db/d10/d12/lca 0 2024-09-13T18:30:25.970 INFO:tasks.workunit.client.1.smithi149.stdout:4/689: write df/da0/d12/d21/f8e [3352079,124936] 0 2024-09-13T18:30:25.970 INFO:tasks.workunit.client.1.smithi149.stdout:4/690: write df/da0/f78 [3645491,76970] 0 2024-09-13T18:30:25.970 INFO:tasks.workunit.client.1.smithi149.stdout:4/691: creat df/da0/d12/d21/d22/d30/d41/d57/d60/fe9 x:0 0 0 2024-09-13T18:30:25.973 INFO:tasks.workunit.client.1.smithi149.stdout:3/665: rename d1/d21/lc3 to d1/d21/ldf 0 2024-09-13T18:30:25.973 INFO:tasks.workunit.client.1.smithi149.stdout:2/586: truncate db/d1b/d1c/d20/d2b/db7/f90 1787134 0 2024-09-13T18:30:25.973 INFO:tasks.workunit.client.1.smithi149.stdout:9/507: getdents d0/d18/d27/d5c/d7e 0 2024-09-13T18:30:25.973 INFO:tasks.workunit.client.1.smithi149.stdout:9/508: chown d0/d2e/d42/d59/c90 494 1 2024-09-13T18:30:25.973 INFO:tasks.workunit.client.1.smithi149.stdout:9/509: write d0/d9e/f23 [4607688,2679] 0 2024-09-13T18:30:25.975 INFO:tasks.workunit.client.1.smithi149.stdout:4/692: link df/da0/d12/d21/d22/c6d df/da0/d12/d21/d22/d30/d41/d57/d8a/cea 0 2024-09-13T18:30:25.975 INFO:tasks.workunit.client.1.smithi149.stdout:4/693: dread - df/da0/d1c/d69/f76 zero size 2024-09-13T18:30:25.976 INFO:tasks.workunit.client.1.smithi149.stdout:4/694: fdatasync df/da0/d12/d21/d22/d30/d41/d57/d60/fac 0 2024-09-13T18:30:25.976 INFO:tasks.workunit.client.1.smithi149.stdout:3/666: creat d1/d48/ddb/fe0 x:0 0 0 2024-09-13T18:30:25.977 INFO:tasks.workunit.client.1.smithi149.stdout:2/587: symlink db/d13/d70/d89/lcb 0 2024-09-13T18:30:25.978 INFO:tasks.workunit.client.1.smithi149.stdout:0/700: dread d1/d29/f7a [0,4194304] 0 2024-09-13T18:30:25.978 INFO:tasks.workunit.client.1.smithi149.stdout:0/701: chown d1/f27 59013783 1 2024-09-13T18:30:25.980 INFO:tasks.workunit.client.1.smithi149.stdout:3/667: unlink d1/d47/d30/fc8 0 2024-09-13T18:30:25.981 INFO:tasks.workunit.client.1.smithi149.stdout:2/588: mknod db/d1b/ccc 0 2024-09-13T18:30:25.981 INFO:tasks.workunit.client.1.smithi149.stdout:2/589: dread - db/d1b/d48/f9d zero size 2024-09-13T18:30:25.982 INFO:tasks.workunit.client.1.smithi149.stdout:2/590: fsync db/f97 0 2024-09-13T18:30:25.983 INFO:tasks.workunit.client.1.smithi149.stdout:9/510: mknod d0/d18/ca5 0 2024-09-13T18:30:25.985 INFO:tasks.workunit.client.1.smithi149.stdout:0/702: truncate d1/d2/d8a/d90/f7e 937382 0 2024-09-13T18:30:25.985 INFO:tasks.workunit.client.1.smithi149.stdout:4/695: mkdir df/da0/deb 0 2024-09-13T18:30:25.989 INFO:tasks.workunit.client.1.smithi149.stdout:3/668: mkdir d1/d2c/d38/d8d/de1 0 2024-09-13T18:30:25.992 INFO:tasks.workunit.client.1.smithi149.stdout:2/591: rmdir db/d1b/d2f 39 2024-09-13T18:30:25.992 INFO:tasks.workunit.client.1.smithi149.stdout:0/703: truncate d1/d29/d31/d44/d81/d62/f6c 1817367 0 2024-09-13T18:30:25.994 INFO:tasks.workunit.client.1.smithi149.stdout:2/592: mknod db/d1b/d48/ccd 0 2024-09-13T18:30:25.994 INFO:tasks.workunit.client.1.smithi149.stdout:0/704: mknod d1/d2/d8a/d90/cef 0 2024-09-13T18:30:25.994 INFO:tasks.workunit.client.1.smithi149.stdout:2/593: fdatasync db/d10/f4e 0 2024-09-13T18:30:25.995 INFO:tasks.workunit.client.1.smithi149.stdout:0/705: creat d1/ff0 x:0 0 0 2024-09-13T18:30:25.996 INFO:tasks.workunit.client.1.smithi149.stdout:2/594: creat db/d1b/dab/fce x:0 0 0 2024-09-13T18:30:25.998 INFO:tasks.workunit.client.1.smithi149.stdout:8/617: sync 2024-09-13T18:30:25.998 INFO:tasks.workunit.client.1.smithi149.stdout:0/706: link d1/d29/d31/l65 d1/d48/d92/lf1 0 2024-09-13T18:30:25.999 INFO:tasks.workunit.client.1.smithi149.stdout:2/595: creat db/d13/fcf x:0 0 0 2024-09-13T18:30:25.999 INFO:tasks.workunit.client.1.smithi149.stdout:2/596: truncate db/d1b/d48/f9d 933481 0 2024-09-13T18:30:25.999 INFO:tasks.workunit.client.1.smithi149.stdout:2/597: readlink db/d1b/d2f/d30/l64 0 2024-09-13T18:30:26.001 INFO:tasks.workunit.client.1.smithi149.stdout:2/598: creat db/d10/fd0 x:0 0 0 2024-09-13T18:30:26.002 INFO:tasks.workunit.client.1.smithi149.stdout:2/599: rmdir db/d13/d70/dad 39 2024-09-13T18:30:26.011 INFO:tasks.workunit.client.1.smithi149.stdout:6/741: dwrite dc/d15/d23/d5b/f52 [0,4194304] 0 2024-09-13T18:30:26.013 INFO:tasks.workunit.client.1.smithi149.stdout:6/742: unlink dc/d15/d54/c80 0 2024-09-13T18:30:26.013 INFO:tasks.workunit.client.1.smithi149.stdout:6/743: chown dc/d15/d23/f40 202 1 2024-09-13T18:30:26.051 INFO:tasks.workunit.client.1.smithi149.stdout:5/611: dwrite d3/d10/fa7 [0,4194304] 0 2024-09-13T18:30:26.051 INFO:tasks.workunit.client.1.smithi149.stdout:5/612: readlink d3/d8/d13/l1b 0 2024-09-13T18:30:26.053 INFO:tasks.workunit.client.1.smithi149.stdout:1/684: dwrite d9/d10/d34/d53/f9e [4194304,4194304] 0 2024-09-13T18:30:26.059 INFO:tasks.workunit.client.1.smithi149.stdout:9/511: dwrite d0/d2e/f71 [0,4194304] 0 2024-09-13T18:30:26.061 INFO:tasks.workunit.client.1.smithi149.stdout:4/696: dwrite df/da0/d1c/f32 [0,4194304] 0 2024-09-13T18:30:26.064 INFO:tasks.workunit.client.1.smithi149.stdout:7/755: dwrite d7/d76/db3/fad [0,4194304] 0 2024-09-13T18:30:26.066 INFO:tasks.workunit.client.1.smithi149.stdout:2/600: write db/d1b/d1c/f3c [8151,13952] 0 2024-09-13T18:30:26.066 INFO:tasks.workunit.client.1.smithi149.stdout:2/601: chown db/d1b/d1c/d20/d2b/db7/fb8 485 1 2024-09-13T18:30:26.066 INFO:tasks.workunit.client.1.smithi149.stdout:2/602: fdatasync f6 0 2024-09-13T18:30:26.067 INFO:tasks.workunit.client.1.smithi149.stdout:1/685: dread d9/d15/f5e [0,4194304] 0 2024-09-13T18:30:26.067 INFO:tasks.workunit.client.1.smithi149.stdout:1/686: creat d9/d15/d60/da5/fd4 x:0 0 0 2024-09-13T18:30:26.068 INFO:tasks.workunit.client.1.smithi149.stdout:9/512: mknod d0/d47/ca6 0 2024-09-13T18:30:26.068 INFO:tasks.workunit.client.1.smithi149.stdout:9/513: stat d0/d47/ca6 0 2024-09-13T18:30:26.068 INFO:tasks.workunit.client.1.smithi149.stdout:9/514: chown d0/d18/d27/d5c 3861 1 2024-09-13T18:30:26.068 INFO:tasks.workunit.client.1.smithi149.stdout:9/515: creat d0/d2e/d42/d59/fa7 x:0 0 0 2024-09-13T18:30:26.068 INFO:tasks.workunit.client.1.smithi149.stdout:8/618: write d2/d13/f81 [1301256,26089] 0 2024-09-13T18:30:26.069 INFO:tasks.workunit.client.1.smithi149.stdout:4/697: truncate df/da0/f80 1244656 0 2024-09-13T18:30:26.075 INFO:tasks.workunit.client.1.smithi149.stdout:7/756: creat d7/d9/d1c/f109 x:0 0 0 2024-09-13T18:30:26.076 INFO:tasks.workunit.client.1.smithi149.stdout:7/757: write d7/d9/d1c/d51/d52/d86/d9f/fd4 [372829,109615] 0 2024-09-13T18:30:26.076 INFO:tasks.workunit.client.1.smithi149.stdout:0/707: dwrite d1/d2/d41/f4d [0,4194304] 0 2024-09-13T18:30:26.076 INFO:tasks.workunit.client.1.smithi149.stdout:3/669: dwrite d1/d2c/d38/d88/fd3 [0,4194304] 0 2024-09-13T18:30:26.079 INFO:tasks.workunit.client.1.smithi149.stdout:1/687: rmdir d9/d10/d83 39 2024-09-13T18:30:26.079 INFO:tasks.workunit.client.1.smithi149.stdout:1/688: chown d9/d10/d34/d3c 17 1 2024-09-13T18:30:26.079 INFO:tasks.workunit.client.1.smithi149.stdout:1/689: dread - d9/d10/d34/d53/d57/d6c/f7f zero size 2024-09-13T18:30:26.081 INFO:tasks.workunit.client.1.smithi149.stdout:9/516: write d0/d9e/f56 [961714,32971] 0 2024-09-13T18:30:26.083 INFO:tasks.workunit.client.1.smithi149.stdout:8/619: mkdir d2/db1/dd1 0 2024-09-13T18:30:26.083 INFO:tasks.workunit.client.1.smithi149.stdout:8/620: creat d2/d5b/fd2 x:0 0 0 2024-09-13T18:30:26.083 INFO:tasks.workunit.client.1.smithi149.stdout:8/621: stat d2/d12/d1b/l77 0 2024-09-13T18:30:26.083 INFO:tasks.workunit.client.1.smithi149.stdout:8/622: chown d2/d12/d1b/f51 1 1 2024-09-13T18:30:26.085 INFO:tasks.workunit.client.1.smithi149.stdout:4/698: mknod df/da0/d12/d7c/d9a/cec 0 2024-09-13T18:30:26.085 INFO:tasks.workunit.client.1.smithi149.stdout:6/744: truncate dc/d15/d23/d5b/f52 869531 0 2024-09-13T18:30:26.086 INFO:tasks.workunit.client.1.smithi149.stdout:7/758: symlink d7/d9/d1c/d2c/d60/dee/l10a 0 2024-09-13T18:30:26.087 INFO:tasks.workunit.client.1.smithi149.stdout:7/759: write d7/d9/d1c/d2c/d60/f91 [1440991,33062] 0 2024-09-13T18:30:26.094 INFO:tasks.workunit.client.1.smithi149.stdout:3/670: dwrite d1/d2c/d56/f76 [0,4194304] 0 2024-09-13T18:30:26.095 INFO:tasks.workunit.client.1.smithi149.stdout:2/603: dwrite db/d10/d12/f43 [0,4194304] 0 2024-09-13T18:30:26.095 INFO:tasks.workunit.client.1.smithi149.stdout:0/708: dread d1/d29/d31/d44/d81/d62/f7f [0,4194304] 0 2024-09-13T18:30:26.097 INFO:tasks.workunit.client.1.smithi149.stdout:1/690: link d9/d10/c8a d9/d10/d34/d3c/d50/cd5 0 2024-09-13T18:30:26.097 INFO:tasks.workunit.client.1.smithi149.stdout:1/691: chown d9/d10/fbc 286 1 2024-09-13T18:30:26.098 INFO:tasks.workunit.client.1.smithi149.stdout:9/517: creat d0/d18/d27/fa8 x:0 0 0 2024-09-13T18:30:26.101 INFO:tasks.workunit.client.1.smithi149.stdout:8/623: creat d2/d13/d6d/fd3 x:0 0 0 2024-09-13T18:30:26.102 INFO:tasks.workunit.client.1.smithi149.stdout:4/699: link df/da0/d12/d21/d22/c6d df/da0/d70/ced 0 2024-09-13T18:30:26.105 INFO:tasks.workunit.client.1.smithi149.stdout:6/745: rmdir dc/d15/d23/d5f/db9 0 2024-09-13T18:30:26.106 INFO:tasks.workunit.client.1.smithi149.stdout:7/760: mkdir d7/d9/d1c/d1f/da1/d10b 0 2024-09-13T18:30:26.106 INFO:tasks.workunit.client.1.smithi149.stdout:7/761: stat d7/d9/d1c/d51/f100 0 2024-09-13T18:30:26.113 INFO:tasks.workunit.client.1.smithi149.stdout:0/709: mknod d1/d2/d8a/da9/cf2 0 2024-09-13T18:30:26.115 INFO:tasks.workunit.client.1.smithi149.stdout:2/604: creat db/d1b/d1c/d20/d3a/d75/fd1 x:0 0 0 2024-09-13T18:30:26.115 INFO:tasks.workunit.client.1.smithi149.stdout:2/605: write db/d1b/d2f/fc5 [577077,104036] 0 2024-09-13T18:30:26.115 INFO:tasks.workunit.client.1.smithi149.stdout:0/710: dread d1/d29/d31/d44/d47/f8e [0,4194304] 0 2024-09-13T18:30:26.117 INFO:tasks.workunit.client.1.smithi149.stdout:8/624: creat d2/fd4 x:0 0 0 2024-09-13T18:30:26.117 INFO:tasks.workunit.client.1.smithi149.stdout:8/625: creat d2/d5b/d86/fd5 x:0 0 0 2024-09-13T18:30:26.119 INFO:tasks.workunit.client.1.smithi149.stdout:7/762: symlink d7/d76/db3/d6f/d9d/l10c 0 2024-09-13T18:30:26.119 INFO:tasks.workunit.client.1.smithi149.stdout:7/763: write d7/d9/d1c/d1f/d21/d7b/d96/d9e/fa2 [1700378,97089] 0 2024-09-13T18:30:26.120 INFO:tasks.workunit.client.1.smithi149.stdout:7/764: fdatasync d7/d9/d11/d50/dde/df7/dae/ff8 0 2024-09-13T18:30:26.121 INFO:tasks.workunit.client.1.smithi149.stdout:2/606: creat db/d1b/d1c/d20/fd2 x:0 0 0 2024-09-13T18:30:26.121 INFO:tasks.workunit.client.1.smithi149.stdout:2/607: dread - db/d10/da9/fb0 zero size 2024-09-13T18:30:26.124 INFO:tasks.workunit.client.1.smithi149.stdout:8/626: unlink d2/d13/f7b 0 2024-09-13T18:30:26.124 INFO:tasks.workunit.client.1.smithi149.stdout:8/627: dread - d2/d12/d6e/f91 zero size 2024-09-13T18:30:26.125 INFO:tasks.workunit.client.1.smithi149.stdout:9/518: dwrite d0/f38 [4194304,4194304] 0 2024-09-13T18:30:26.125 INFO:tasks.workunit.client.1.smithi149.stdout:6/746: symlink dc/d15/d23/d57/da5/lef 0 2024-09-13T18:30:26.126 INFO:tasks.workunit.client.1.smithi149.stdout:1/692: dwrite d9/d10/d34/d53/d57/f65 [0,4194304] 0 2024-09-13T18:30:26.126 INFO:tasks.workunit.client.1.smithi149.stdout:1/693: dread - d9/d10/d83/d97/f9a zero size 2024-09-13T18:30:26.128 INFO:tasks.workunit.client.1.smithi149.stdout:7/765: mknod d7/d9/d1c/d2c/d60/c10d 0 2024-09-13T18:30:26.129 INFO:tasks.workunit.client.1.smithi149.stdout:8/628: symlink d2/d12/d1b/d66/ld6 0 2024-09-13T18:30:26.130 INFO:tasks.workunit.client.1.smithi149.stdout:8/629: chown d2/d12/d87/f9e 7444144 1 2024-09-13T18:30:26.130 INFO:tasks.workunit.client.1.smithi149.stdout:6/747: dread dc/f53 [0,4194304] 0 2024-09-13T18:30:26.131 INFO:tasks.workunit.client.1.smithi149.stdout:9/519: creat d0/d18/d27/d5c/d99/d9f/fa9 x:0 0 0 2024-09-13T18:30:26.131 INFO:tasks.workunit.client.1.smithi149.stdout:9/520: readlink d0/d18/d27/d5c/d99/la2 0 2024-09-13T18:30:26.133 INFO:tasks.workunit.client.1.smithi149.stdout:7/766: mknod d7/d9/d1c/d51/d52/c10e 0 2024-09-13T18:30:26.138 INFO:tasks.workunit.client.1.smithi149.stdout:8/630: symlink d2/d12/ld7 0 2024-09-13T18:30:26.138 INFO:tasks.workunit.client.1.smithi149.stdout:4/700: dwrite df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fca [0,4194304] 0 2024-09-13T18:30:26.138 INFO:tasks.workunit.client.1.smithi149.stdout:4/701: dread - df/da0/d12/d21/d22/d30/d41/d57/d75/f8f zero size 2024-09-13T18:30:26.138 INFO:tasks.workunit.client.1.smithi149.stdout:0/711: dwrite d1/d29/d31/d44/d81/fb3 [0,4194304] 0 2024-09-13T18:30:26.138 INFO:tasks.workunit.client.1.smithi149.stdout:9/521: getdents d0/d9e 0 2024-09-13T18:30:26.143 INFO:tasks.workunit.client.1.smithi149.stdout:0/712: mkdir d1/d2/d41/df3 0 2024-09-13T18:30:26.144 INFO:tasks.workunit.client.1.smithi149.stdout:0/713: mknod d1/d2/d8a/da9/dd7/cf4 0 2024-09-13T18:30:26.150 INFO:tasks.workunit.client.1.smithi149.stdout:0/714: mknod d1/d2/cf5 0 2024-09-13T18:30:26.151 INFO:tasks.workunit.client.1.smithi149.stdout:0/715: creat d1/d2/d41/d46/d7b/d98/ff6 x:0 0 0 2024-09-13T18:30:26.151 INFO:tasks.workunit.client.1.smithi149.stdout:9/522: write d0/d9e/f51 [836466,93224] 0 2024-09-13T18:30:26.153 INFO:tasks.workunit.client.1.smithi149.stdout:9/523: mkdir d0/d18/d27/d5c/d99/d9f/daa 0 2024-09-13T18:30:26.155 INFO:tasks.workunit.client.1.smithi149.stdout:9/524: write d0/f8a [566058,54728] 0 2024-09-13T18:30:26.155 INFO:tasks.workunit.client.1.smithi149.stdout:9/525: chown d0/d18/c25 1 1 2024-09-13T18:30:26.158 INFO:tasks.workunit.client.1.smithi149.stdout:8/631: dread d2/f34 [0,4194304] 0 2024-09-13T18:30:26.159 INFO:tasks.workunit.client.1.smithi149.stdout:6/748: dwrite dc/d15/d23/d5f/fc9 [0,4194304] 0 2024-09-13T18:30:26.162 INFO:tasks.workunit.client.1.smithi149.stdout:7/767: dwrite d7/d9/d11/f94 [0,4194304] 0 2024-09-13T18:30:26.168 INFO:tasks.workunit.client.1.smithi149.stdout:8/632: rename d2/d12/d1b to d2/d12/dd8 0 2024-09-13T18:30:26.172 INFO:tasks.workunit.client.1.smithi149.stdout:1/694: dwrite d9/d10/d62/fd1 [0,4194304] 0 2024-09-13T18:30:26.172 INFO:tasks.workunit.client.1.smithi149.stdout:4/702: dread df/da0/d12/d21/f4a [4194304,4194304] 0 2024-09-13T18:30:26.175 INFO:tasks.workunit.client.1.smithi149.stdout:6/749: write dc/d15/d23/d57/da5/fd0 [490991,81914] 0 2024-09-13T18:30:26.177 INFO:tasks.workunit.client.1.smithi149.stdout:9/526: dwrite d0/d18/f41 [0,4194304] 0 2024-09-13T18:30:26.178 INFO:tasks.workunit.client.1.smithi149.stdout:9/527: write d0/d9e/f56 [4492117,106163] 0 2024-09-13T18:30:26.178 INFO:tasks.workunit.client.1.smithi149.stdout:9/528: write d0/d2e/d42/f8c [572158,103850] 0 2024-09-13T18:30:26.178 INFO:tasks.workunit.client.1.smithi149.stdout:9/529: chown d0/d9e/f56 0 1 2024-09-13T18:30:26.179 INFO:tasks.workunit.client.1.smithi149.stdout:6/750: creat dc/d15/d23/d57/da5/dd8/ff0 x:0 0 0 2024-09-13T18:30:26.182 INFO:tasks.workunit.client.1.smithi149.stdout:5/613: sync 2024-09-13T18:30:26.182 INFO:tasks.workunit.client.1.smithi149.stdout:5/614: readlink d3/d10/d4c/d4e/d61/l8f 0 2024-09-13T18:30:26.184 INFO:tasks.workunit.client.1.smithi149.stdout:6/751: rename dc/d15/d54/c62 to dc/d15/d23/dcd/cf1 0 2024-09-13T18:30:26.186 INFO:tasks.workunit.client.1.smithi149.stdout:8/633: dread d2/fe [0,4194304] 0 2024-09-13T18:30:26.186 INFO:tasks.workunit.client.1.smithi149.stdout:6/752: mkdir dc/d2f/df2 0 2024-09-13T18:30:26.187 INFO:tasks.workunit.client.1.smithi149.stdout:8/634: mkdir d2/d12/db8/dca/dd9 0 2024-09-13T18:30:26.188 INFO:tasks.workunit.client.1.smithi149.stdout:8/635: write d2/f63 [875325,108352] 0 2024-09-13T18:30:26.188 INFO:tasks.workunit.client.1.smithi149.stdout:0/716: dwrite d1/d2/d41/faa [0,4194304] 0 2024-09-13T18:30:26.190 INFO:tasks.workunit.client.1.smithi149.stdout:0/717: creat d1/d29/d31/d44/d81/d62/ff7 x:0 0 0 2024-09-13T18:30:26.192 INFO:tasks.workunit.client.1.smithi149.stdout:0/718: getdents d1/d2/d4e 0 2024-09-13T18:30:26.196 INFO:tasks.workunit.client.1.smithi149.stdout:7/768: dwrite f5 [0,4194304] 0 2024-09-13T18:30:26.197 INFO:tasks.workunit.client.1.smithi149.stdout:0/719: creat d1/d29/d31/ff8 x:0 0 0 2024-09-13T18:30:26.200 INFO:tasks.workunit.client.1.smithi149.stdout:7/769: unlink d7/d9/d1c/d51/d52/d86/d9f/le7 0 2024-09-13T18:30:26.201 INFO:tasks.workunit.client.1.smithi149.stdout:7/770: stat d7/d9/d1c/d2c 0 2024-09-13T18:30:26.201 INFO:tasks.workunit.client.1.smithi149.stdout:7/771: dread - d7/d12/fc6 zero size 2024-09-13T18:30:26.202 INFO:tasks.workunit.client.1.smithi149.stdout:0/720: link d1/d2/l5d d1/d29/d31/d44/d81/d62/lf9 0 2024-09-13T18:30:26.202 INFO:tasks.workunit.client.1.smithi149.stdout:0/721: read - d1/d48/d92/db4/dbe/fe0 zero size 2024-09-13T18:30:26.202 INFO:tasks.workunit.client.1.smithi149.stdout:0/722: stat d1/d2/d8a/da9/dd7/le2 0 2024-09-13T18:30:26.205 INFO:tasks.workunit.client.1.smithi149.stdout:9/530: dread d0/d9e/f3f [0,4194304] 0 2024-09-13T18:30:26.205 INFO:tasks.workunit.client.1.smithi149.stdout:4/703: dwrite df/da0/d12/d21/f24 [0,4194304] 0 2024-09-13T18:30:26.208 INFO:tasks.workunit.client.1.smithi149.stdout:9/531: unlink d0/d2e/d42/f73 0 2024-09-13T18:30:26.208 INFO:tasks.workunit.client.1.smithi149.stdout:9/532: write d0/d47/d61/f6b [2994835,53674] 0 2024-09-13T18:30:26.209 INFO:tasks.workunit.client.1.smithi149.stdout:4/704: symlink df/da0/d70/db5/dc7/lee 0 2024-09-13T18:30:26.209 INFO:tasks.workunit.client.1.smithi149.stdout:4/705: dread - df/da0/d12/d21/d22/d30/d41/d57/d60/fe9 zero size 2024-09-13T18:30:26.209 INFO:tasks.workunit.client.1.smithi149.stdout:7/772: rename d7/d9/d1c/d1f/da1 to d7/d9/d1c/d1f/d21/d49/d102/d10f 0 2024-09-13T18:30:26.211 INFO:tasks.workunit.client.1.smithi149.stdout:7/773: mkdir d7/d9/d1c/d1f/d21/d49/d102/d10f/d110 0 2024-09-13T18:30:26.211 INFO:tasks.workunit.client.1.smithi149.stdout:7/774: dread - d7/d9/d1c/d51/d52/d86/fda zero size 2024-09-13T18:30:26.218 INFO:tasks.workunit.client.1.smithi149.stdout:8/636: dwrite d2/d12/dd8/d58/d97/db6/fb9 [0,4194304] 0 2024-09-13T18:30:26.222 INFO:tasks.workunit.client.1.smithi149.stdout:8/637: creat d2/d12/d40/fda x:0 0 0 2024-09-13T18:30:26.222 INFO:tasks.workunit.client.1.smithi149.stdout:4/706: dread df/da0/d1c/f42 [0,4194304] 0 2024-09-13T18:30:26.222 INFO:tasks.workunit.client.1.smithi149.stdout:5/615: dwrite d3/d10/d32/d54/f9e [0,4194304] 0 2024-09-13T18:30:26.222 INFO:tasks.workunit.client.1.smithi149.stdout:8/638: fsync d2/d12/d2a/d4d/f78 0 2024-09-13T18:30:26.222 INFO:tasks.workunit.client.1.smithi149.stdout:4/707: write df/da0/d12/fd6 [788197,52124] 0 2024-09-13T18:30:26.223 INFO:tasks.workunit.client.1.smithi149.stdout:6/753: dwrite dc/d15/d23/fde [0,4194304] 0 2024-09-13T18:30:26.225 INFO:tasks.workunit.client.1.smithi149.stdout:8/639: mkdir d2/dc4/ddb 0 2024-09-13T18:30:26.225 INFO:tasks.workunit.client.1.smithi149.stdout:8/640: creat d2/d13/d3a/d7f/fdc x:0 0 0 2024-09-13T18:30:26.226 INFO:tasks.workunit.client.1.smithi149.stdout:5/616: symlink d3/d10/d32/d54/dbd/lc3 0 2024-09-13T18:30:26.227 INFO:tasks.workunit.client.1.smithi149.stdout:4/708: creat df/da0/d12/d21/d22/d30/d56/fef x:0 0 0 2024-09-13T18:30:26.228 INFO:tasks.workunit.client.1.smithi149.stdout:6/754: unlink dc/d15/d23/d5f/f67 0 2024-09-13T18:30:26.230 INFO:tasks.workunit.client.1.smithi149.stdout:4/709: symlink df/da0/d12/d17/lf0 0 2024-09-13T18:30:26.230 INFO:tasks.workunit.client.1.smithi149.stdout:4/710: creat df/da0/d12/d17/d3d/ff1 x:0 0 0 2024-09-13T18:30:26.231 INFO:tasks.workunit.client.1.smithi149.stdout:6/755: rename dc/d15/d23/d5f/dac/ld3 to dc/d15/d54/da9/lf3 0 2024-09-13T18:30:26.231 INFO:tasks.workunit.client.1.smithi149.stdout:6/756: readlink dc/d15/d23/l96 0 2024-09-13T18:30:26.234 INFO:tasks.workunit.client.1.smithi149.stdout:4/711: rename df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3/fb0 to df/da0/dcc/ff2 0 2024-09-13T18:30:26.235 INFO:tasks.workunit.client.1.smithi149.stdout:9/533: dwrite d0/d2e/d42/f8c [0,4194304] 0 2024-09-13T18:30:26.236 INFO:tasks.workunit.client.1.smithi149.stdout:4/712: dread df/da0/d12/d21/d22/d30/d56/d91/fb2 [0,4194304] 0 2024-09-13T18:30:26.237 INFO:tasks.workunit.client.1.smithi149.stdout:4/713: mkdir df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3/dc8/df3 0 2024-09-13T18:30:26.238 INFO:tasks.workunit.client.1.smithi149.stdout:5/617: read d3/d10/d4c/d4e/da4/fa6 [525107,56063] 0 2024-09-13T18:30:26.239 INFO:tasks.workunit.client.1.smithi149.stdout:5/618: rmdir d3/d10 39 2024-09-13T18:30:26.240 INFO:tasks.workunit.client.1.smithi149.stdout:4/714: mknod df/da0/cf4 0 2024-09-13T18:30:26.240 INFO:tasks.workunit.client.1.smithi149.stdout:4/715: fsync df/da0/d12/d21/d22/d30/d41/fb1 0 2024-09-13T18:30:26.242 INFO:tasks.workunit.client.1.smithi149.stdout:6/757: write dc/d15/d23/f4c [10877540,33690] 0 2024-09-13T18:30:26.242 INFO:tasks.workunit.client.1.smithi149.stdout:6/758: fsync dc/d15/d23/f40 0 2024-09-13T18:30:26.242 INFO:tasks.workunit.client.1.smithi149.stdout:5/619: link d3/d10/f80 d3/d10/d4c/d4e/fc4 0 2024-09-13T18:30:26.243 INFO:tasks.workunit.client.1.smithi149.stdout:6/759: rmdir dc/d15/d23/dcd 39 2024-09-13T18:30:26.243 INFO:tasks.workunit.client.1.smithi149.stdout:6/760: readlink dc/d2f/l86 0 2024-09-13T18:30:26.247 INFO:tasks.workunit.client.1.smithi149.stdout:8/641: dwrite d2/d5b/fbf [0,4194304] 0 2024-09-13T18:30:26.247 INFO:tasks.workunit.client.1.smithi149.stdout:8/642: read - d2/d13/d3a/d7f/d8d/faf zero size 2024-09-13T18:30:26.252 INFO:tasks.workunit.client.1.smithi149.stdout:8/643: truncate d2/fc 1427142 0 2024-09-13T18:30:26.255 INFO:tasks.workunit.client.1.smithi149.stdout:8/644: mkdir d2/db1/dd1/ddd 0 2024-09-13T18:30:26.255 INFO:tasks.workunit.client.1.smithi149.stdout:8/645: read - d2/faa zero size 2024-09-13T18:30:26.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:25 smithi149 ceph-mon[35845]: pgmap v15: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 116 MiB/s rd, 147 MiB/s wr, 508 op/s 2024-09-13T18:30:26.280 INFO:tasks.workunit.client.1.smithi149.stdout:6/761: dwrite dc/d2f/d75/f7e [0,4194304] 0 2024-09-13T18:30:26.280 INFO:tasks.workunit.client.1.smithi149.stdout:5/620: dwrite d3/d10/d4c/f69 [0,4194304] 0 2024-09-13T18:30:26.280 INFO:tasks.workunit.client.1.smithi149.stdout:5/621: chown d3/d10/f80 0 1 2024-09-13T18:30:26.280 INFO:tasks.workunit.client.1.smithi149.stdout:8/646: dwrite d2/fe [0,4194304] 0 2024-09-13T18:30:26.282 INFO:tasks.workunit.client.1.smithi149.stdout:6/762: dread dc/d2f/d75/f8e [0,4194304] 0 2024-09-13T18:30:26.284 INFO:tasks.workunit.client.1.smithi149.stdout:5/622: rename d3/d10/d32/f92 to d3/d10/d4c/d4e/d61/d63/fc5 0 2024-09-13T18:30:26.288 INFO:tasks.workunit.client.1.smithi149.stdout:6/763: symlink dc/d15/d23/d57/lf4 0 2024-09-13T18:30:26.289 INFO:tasks.workunit.client.1.smithi149.stdout:5/623: creat d3/d10/d32/d54/db9/fc6 x:0 0 0 2024-09-13T18:30:26.289 INFO:tasks.workunit.client.1.smithi149.stdout:5/624: chown d3/d10/d32/d54/d76/f89 50 1 2024-09-13T18:30:26.289 INFO:tasks.workunit.client.1.smithi149.stdout:5/625: creat d3/d10/d4c/db8/fc7 x:0 0 0 2024-09-13T18:30:26.290 INFO:tasks.workunit.client.1.smithi149.stdout:5/626: creat d3/d10/d32/d54/d76/d7a/fc8 x:0 0 0 2024-09-13T18:30:26.294 INFO:tasks.workunit.client.1.smithi149.stdout:8/647: dwrite d2/d12/f9d [0,4194304] 0 2024-09-13T18:30:26.296 INFO:tasks.workunit.client.1.smithi149.stdout:8/648: creat d2/d12/d6e/fde x:0 0 0 2024-09-13T18:30:26.298 INFO:tasks.workunit.client.1.smithi149.stdout:8/649: mkdir d2/d12/d87/ddf 0 2024-09-13T18:30:26.298 INFO:tasks.workunit.client.1.smithi149.stdout:8/650: write d2/d12/f7c [241119,35797] 0 2024-09-13T18:30:26.298 INFO:tasks.workunit.client.1.smithi149.stdout:8/651: creat d2/d12/d2a/d4d/fe0 x:0 0 0 2024-09-13T18:30:26.298 INFO:tasks.workunit.client.1.smithi149.stdout:8/652: creat d2/d13/d3a/fe1 x:0 0 0 2024-09-13T18:30:26.298 INFO:tasks.workunit.client.1.smithi149.stdout:8/653: chown d2/d52/lc3 1 1 2024-09-13T18:30:26.304 INFO:tasks.workunit.client.1.smithi149.stdout:3/671: sync 2024-09-13T18:30:26.305 INFO:tasks.workunit.client.1.smithi149.stdout:3/672: rename d1/d2e/d1d/d9a/fce to d1/d2e/d1d/d9a/fe2 0 2024-09-13T18:30:26.306 INFO:tasks.workunit.client.1.smithi149.stdout:3/673: unlink d1/d2c/d38/d88/lae 0 2024-09-13T18:30:26.307 INFO:tasks.workunit.client.1.smithi149.stdout:3/674: creat d1/d2c/d38/d8d/fe3 x:0 0 0 2024-09-13T18:30:26.308 INFO:tasks.workunit.client.1.smithi149.stdout:3/675: symlink d1/d2c/d38/d88/le4 0 2024-09-13T18:30:26.308 INFO:tasks.workunit.client.1.smithi149.stdout:3/676: creat d1/d2e/d1d/d6c/dcd/fe5 x:0 0 0 2024-09-13T18:30:26.317 INFO:tasks.workunit.client.1.smithi149.stdout:6/764: dwrite dc/d2f/fce [0,4194304] 0 2024-09-13T18:30:26.318 INFO:tasks.workunit.client.1.smithi149.stdout:8/654: dwrite d2/d12/dd8/d58/d97/fa0 [0,4194304] 0 2024-09-13T18:30:26.321 INFO:tasks.workunit.client.1.smithi149.stdout:8/655: mknod d2/ce2 0 2024-09-13T18:30:26.324 INFO:tasks.workunit.client.1.smithi149.stdout:3/677: dwrite d1/f85 [0,4194304] 0 2024-09-13T18:30:26.324 INFO:tasks.workunit.client.1.smithi149.stdout:3/678: dread - d1/d2c/d38/d88/d96/fd7 zero size 2024-09-13T18:30:26.324 INFO:tasks.workunit.client.1.smithi149.stdout:3/679: write d1/d47/fd0 [157949,86803] 0 2024-09-13T18:30:26.326 INFO:tasks.workunit.client.1.smithi149.stdout:3/680: rename d1/d2e/d1d/f23 to d1/d12/d20/d54/dd1/fe6 0 2024-09-13T18:30:26.328 INFO:tasks.workunit.client.1.smithi149.stdout:3/681: creat d1/d21/fe7 x:0 0 0 2024-09-13T18:30:26.330 INFO:tasks.workunit.client.1.smithi149.stdout:6/765: dread dc/d15/f44 [0,4194304] 0 2024-09-13T18:30:26.330 INFO:tasks.workunit.client.1.smithi149.stdout:6/766: creat dc/d70/ff5 x:0 0 0 2024-09-13T18:30:26.330 INFO:tasks.workunit.client.1.smithi149.stdout:3/682: mkdir d1/d2e/d6f/daf/de8 0 2024-09-13T18:30:26.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:25 smithi038 ceph-mon[27689]: pgmap v15: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 116 MiB/s rd, 147 MiB/s wr, 508 op/s 2024-09-13T18:30:26.331 INFO:tasks.workunit.client.1.smithi149.stdout:6/767: write dc/d15/f36 [90385,120563] 0 2024-09-13T18:30:26.331 INFO:tasks.workunit.client.1.smithi149.stdout:6/768: truncate dc/d70/ff5 3817 0 2024-09-13T18:30:26.332 INFO:tasks.workunit.client.1.smithi149.stdout:3/683: mknod d1/d12/ce9 0 2024-09-13T18:30:26.337 INFO:tasks.workunit.client.1.smithi149.stdout:8/656: dwrite d2/d13/fad [4194304,4194304] 0 2024-09-13T18:30:26.340 INFO:tasks.workunit.client.1.smithi149.stdout:8/657: symlink d2/db1/dd1/le3 0 2024-09-13T18:30:26.342 INFO:tasks.workunit.client.1.smithi149.stdout:8/658: mknod d2/ce4 0 2024-09-13T18:30:26.342 INFO:tasks.workunit.client.1.smithi149.stdout:8/659: creat d2/d5b/fe5 x:0 0 0 2024-09-13T18:30:26.346 INFO:tasks.workunit.client.1.smithi149.stdout:8/660: link d2/d12/d6e/fac d2/d12/d6e/fe6 0 2024-09-13T18:30:26.360 INFO:tasks.workunit.client.1.smithi149.stdout:6/769: dwrite dc/d15/d23/d5f/fdb [0,4194304] 0 2024-09-13T18:30:26.362 INFO:tasks.workunit.client.1.smithi149.stdout:3/684: dwrite d1/d2e/d1d/fc7 [0,4194304] 0 2024-09-13T18:30:26.362 INFO:tasks.workunit.client.1.smithi149.stdout:3/685: chown d1/d2e/d1d/d6c/daa/dad 780563393 1 2024-09-13T18:30:26.362 INFO:tasks.workunit.client.1.smithi149.stdout:3/686: fdatasync d1/d2e/d1d/f2b 0 2024-09-13T18:30:26.362 INFO:tasks.workunit.client.1.smithi149.stdout:3/687: creat d1/d2c/d56/fea x:0 0 0 2024-09-13T18:30:26.363 INFO:tasks.workunit.client.1.smithi149.stdout:6/770: dread - dc/d15/daa/de5/de6/fe4 zero size 2024-09-13T18:30:26.363 INFO:tasks.workunit.client.1.smithi149.stdout:8/661: dwrite d2/f42 [0,4194304] 0 2024-09-13T18:30:26.363 INFO:tasks.workunit.client.1.smithi149.stdout:8/662: dread - d2/d12/d2a/d4d/f79 zero size 2024-09-13T18:30:26.364 INFO:tasks.workunit.client.1.smithi149.stdout:3/688: mknod d1/d2c/d56/ceb 0 2024-09-13T18:30:26.365 INFO:tasks.workunit.client.1.smithi149.stdout:6/771: mknod dc/d15/d54/d85/dcc/cf6 0 2024-09-13T18:30:26.372 INFO:tasks.workunit.client.1.smithi149.stdout:3/689: creat d1/fec x:0 0 0 2024-09-13T18:30:26.373 INFO:tasks.workunit.client.1.smithi149.stdout:3/690: mkdir d1/d12/d20/ded 0 2024-09-13T18:30:26.373 INFO:tasks.workunit.client.1.smithi149.stdout:3/691: fsync d1/d47/d30/fbd 0 2024-09-13T18:30:26.377 INFO:tasks.workunit.client.1.smithi149.stdout:2/608: sync 2024-09-13T18:30:26.377 INFO:tasks.workunit.client.1.smithi149.stdout:1/695: sync 2024-09-13T18:30:26.377 INFO:tasks.workunit.client.1.smithi149.stdout:1/696: write d9/d15/d60/da5/fd4 [607678,72661] 0 2024-09-13T18:30:26.378 INFO:tasks.workunit.client.1.smithi149.stdout:1/697: chown d9/d10/d83/d97/l78 1819 1 2024-09-13T18:30:26.378 INFO:tasks.workunit.client.1.smithi149.stdout:6/772: write dc/d76/f7b [1657525,120219] 0 2024-09-13T18:30:26.378 INFO:tasks.workunit.client.1.smithi149.stdout:2/609: write db/d1b/d1c/d20/d2b/f92 [95758,28572] 0 2024-09-13T18:30:26.378 INFO:tasks.workunit.client.1.smithi149.stdout:8/663: dwrite d2/d12/f9d [0,4194304] 0 2024-09-13T18:30:26.378 INFO:tasks.workunit.client.1.smithi149.stdout:1/698: rmdir d9/d15/d60 39 2024-09-13T18:30:26.383 INFO:tasks.workunit.client.1.smithi149.stdout:8/664: getdents d2/d12/dd8 0 2024-09-13T18:30:26.383 INFO:tasks.workunit.client.1.smithi149.stdout:1/699: mknod d9/d15/d73/cd6 0 2024-09-13T18:30:26.386 INFO:tasks.workunit.client.1.smithi149.stdout:8/665: unlink d2/d13/d3a/c72 0 2024-09-13T18:30:26.386 INFO:tasks.workunit.client.1.smithi149.stdout:8/666: readlink d2/d5b/d88/lc7 0 2024-09-13T18:30:26.386 INFO:tasks.workunit.client.1.smithi149.stdout:8/667: write d2/d12/d6e/fac [648306,115645] 0 2024-09-13T18:30:26.386 INFO:tasks.workunit.client.1.smithi149.stdout:8/668: creat d2/d13/d3a/d7f/da8/fe7 x:0 0 0 2024-09-13T18:30:26.386 INFO:tasks.workunit.client.1.smithi149.stdout:1/700: mkdir d9/d10/d34/dbe/dd7 0 2024-09-13T18:30:26.388 INFO:tasks.workunit.client.1.smithi149.stdout:8/669: unlink d2/d12/dd8/fba 0 2024-09-13T18:30:26.388 INFO:tasks.workunit.client.1.smithi149.stdout:8/670: write d2/d12/d6e/f91 [847965,107732] 0 2024-09-13T18:30:26.389 INFO:tasks.workunit.client.1.smithi149.stdout:7/775: sync 2024-09-13T18:30:26.389 INFO:tasks.workunit.client.1.smithi149.stdout:9/534: sync 2024-09-13T18:30:26.389 INFO:tasks.workunit.client.1.smithi149.stdout:4/716: sync 2024-09-13T18:30:26.389 INFO:tasks.workunit.client.1.smithi149.stdout:0/723: sync 2024-09-13T18:30:26.389 INFO:tasks.workunit.client.1.smithi149.stdout:7/776: chown d7/d12/c58 417 1 2024-09-13T18:30:26.389 INFO:tasks.workunit.client.1.smithi149.stdout:4/717: write df/da0/d12/d17/f3a [6965539,112502] 0 2024-09-13T18:30:26.389 INFO:tasks.workunit.client.1.smithi149.stdout:5/627: sync 2024-09-13T18:30:26.390 INFO:tasks.workunit.client.1.smithi149.stdout:8/671: rename d2/c4 to d2/d13/d3a/ce8 0 2024-09-13T18:30:26.390 INFO:tasks.workunit.client.1.smithi149.stdout:6/773: dread dc/d76/f7b [0,4194304] 0 2024-09-13T18:30:26.391 INFO:tasks.workunit.client.1.smithi149.stdout:0/724: link d1/d48/d92/lf1 d1/d29/d31/d83/lfa 0 2024-09-13T18:30:26.391 INFO:tasks.workunit.client.1.smithi149.stdout:0/725: write d1/d2/d41/fae [40957,91263] 0 2024-09-13T18:30:26.391 INFO:tasks.workunit.client.1.smithi149.stdout:7/777: mknod d7/d9/d1c/d51/d52/d86/c111 0 2024-09-13T18:30:26.391 INFO:tasks.workunit.client.1.smithi149.stdout:7/778: stat d7/d9/d1c/d2c/dcc 0 2024-09-13T18:30:26.392 INFO:tasks.workunit.client.1.smithi149.stdout:7/779: dread - d7/d76/db3/fc3 zero size 2024-09-13T18:30:26.392 INFO:tasks.workunit.client.1.smithi149.stdout:7/780: write d7/d9/d11/ff5 [331306,11205] 0 2024-09-13T18:30:26.394 INFO:tasks.workunit.client.1.smithi149.stdout:4/718: unlink df/da0/d12/d21/d22/d30/d41/d57/c64 0 2024-09-13T18:30:26.394 INFO:tasks.workunit.client.1.smithi149.stdout:4/719: getdents df/da0/d12/d17/dc2 0 2024-09-13T18:30:26.394 INFO:tasks.workunit.client.1.smithi149.stdout:4/720: creat df/da0/d1c/d7e/ddd/ff5 x:0 0 0 2024-09-13T18:30:26.394 INFO:tasks.workunit.client.1.smithi149.stdout:4/721: dread - df/da0/d12/d21/d22/d30/d41/d57/d60/fe9 zero size 2024-09-13T18:30:26.394 INFO:tasks.workunit.client.1.smithi149.stdout:4/722: stat df/l45 0 2024-09-13T18:30:26.394 INFO:tasks.workunit.client.1.smithi149.stdout:5/628: readlink d3/lf 0 2024-09-13T18:30:26.394 INFO:tasks.workunit.client.1.smithi149.stdout:8/672: mknod d2/db1/ce9 0 2024-09-13T18:30:26.396 INFO:tasks.workunit.client.1.smithi149.stdout:6/774: mkdir dc/d15/d54/d5e/df7 0 2024-09-13T18:30:26.396 INFO:tasks.workunit.client.1.smithi149.stdout:0/726: mkdir d1/d29/d31/d44/d47/dfb 0 2024-09-13T18:30:26.399 INFO:tasks.workunit.client.1.smithi149.stdout:7/781: creat d7/d9/d1c/d1f/d21/d49/d102/d10f/d10b/f112 x:0 0 0 2024-09-13T18:30:26.399 INFO:tasks.workunit.client.1.smithi149.stdout:7/782: stat d7/d76/db3/d6f/l35 0 2024-09-13T18:30:26.399 INFO:tasks.workunit.client.1.smithi149.stdout:1/701: dread d9/d10/f27 [0,4194304] 0 2024-09-13T18:30:26.399 INFO:tasks.workunit.client.1.smithi149.stdout:4/723: symlink df/da0/d1c/d69/lf6 0 2024-09-13T18:30:26.399 INFO:tasks.workunit.client.1.smithi149.stdout:4/724: stat df/da0/cf4 0 2024-09-13T18:30:26.400 INFO:tasks.workunit.client.1.smithi149.stdout:8/673: mknod d2/d12/dd8/d66/cea 0 2024-09-13T18:30:26.400 INFO:tasks.workunit.client.1.smithi149.stdout:1/702: truncate d9/d10/d34/d53/d57/f75 3088474 0 2024-09-13T18:30:26.402 INFO:tasks.workunit.client.1.smithi149.stdout:3/692: dwrite d1/d2e/d1d/d9a/d39/f5d [0,4194304] 0 2024-09-13T18:30:26.402 INFO:tasks.workunit.client.1.smithi149.stdout:4/725: symlink df/da0/d12/d21/lf7 0 2024-09-13T18:30:26.402 INFO:tasks.workunit.client.1.smithi149.stdout:2/610: dwrite db/d1b/f42 [0,4194304] 0 2024-09-13T18:30:26.402 INFO:tasks.workunit.client.1.smithi149.stdout:2/611: stat db/d1b/d2f/d69/l7f 0 2024-09-13T18:30:26.402 INFO:tasks.workunit.client.1.smithi149.stdout:8/674: creat d2/d12/dd8/d58/feb x:0 0 0 2024-09-13T18:30:26.402 INFO:tasks.workunit.client.1.smithi149.stdout:8/675: write d2/d13/fbe [481307,112342] 0 2024-09-13T18:30:26.403 INFO:tasks.workunit.client.1.smithi149.stdout:1/703: mknod d9/d15/d73/cd8 0 2024-09-13T18:30:26.403 INFO:tasks.workunit.client.1.smithi149.stdout:1/704: fdatasync d9/d15/f5e 0 2024-09-13T18:30:26.404 INFO:tasks.workunit.client.1.smithi149.stdout:5/629: write d3/d10/d4c/f71 [1475449,56969] 0 2024-09-13T18:30:26.407 INFO:tasks.workunit.client.1.smithi149.stdout:3/693: mknod d1/d2c/d38/cee 0 2024-09-13T18:30:26.411 INFO:tasks.workunit.client.1.smithi149.stdout:2/612: creat db/d1b/fd3 x:0 0 0 2024-09-13T18:30:26.413 INFO:tasks.workunit.client.1.smithi149.stdout:0/727: dread d1/f5 [0,4194304] 0 2024-09-13T18:30:26.414 INFO:tasks.workunit.client.1.smithi149.stdout:0/728: dread - d1/d2/d8a/fb1 zero size 2024-09-13T18:30:26.414 INFO:tasks.workunit.client.1.smithi149.stdout:0/729: readlink d1/d2/d8a/da9/dd7/le2 0 2024-09-13T18:30:26.414 INFO:tasks.workunit.client.1.smithi149.stdout:9/535: dwrite d0/d2e/f71 [0,4194304] 0 2024-09-13T18:30:26.414 INFO:tasks.workunit.client.1.smithi149.stdout:8/676: symlink d2/d12/d2a/lec 0 2024-09-13T18:30:26.416 INFO:tasks.workunit.client.1.smithi149.stdout:4/726: write fe [9390380,78343] 0 2024-09-13T18:30:26.416 INFO:tasks.workunit.client.1.smithi149.stdout:8/677: mkdir d2/d12/dd8/d66/ded 0 2024-09-13T18:30:26.421 INFO:tasks.workunit.client.1.smithi149.stdout:4/727: creat df/da0/d12/ff8 x:0 0 0 2024-09-13T18:30:26.421 INFO:tasks.workunit.client.1.smithi149.stdout:4/728: dread - df/da0/d70/db5/dc7/fcd zero size 2024-09-13T18:30:26.422 INFO:tasks.workunit.client.1.smithi149.stdout:4/729: mkdir df/da0/d70/db5/dc7/df9 0 2024-09-13T18:30:26.426 INFO:tasks.workunit.client.1.smithi149.stdout:7/783: dread f5 [0,4194304] 0 2024-09-13T18:30:26.426 INFO:tasks.workunit.client.1.smithi149.stdout:7/784: read - d7/d9/d1c/d1f/d21/d49/d102/d10f/d10b/f112 zero size 2024-09-13T18:30:26.429 INFO:tasks.workunit.client.1.smithi149.stdout:7/785: rename d7/d9/d1c/d34/f55 to d7/d9/d1c/d1f/d21/d7b/d96/d9e/f113 0 2024-09-13T18:30:26.430 INFO:tasks.workunit.client.1.smithi149.stdout:7/786: creat d7/d9/d11/d50/dde/df7/ddf/f114 x:0 0 0 2024-09-13T18:30:26.432 INFO:tasks.workunit.client.1.smithi149.stdout:7/787: symlink d7/d9/d1c/d51/dd2/l115 0 2024-09-13T18:30:26.435 INFO:tasks.workunit.client.1.smithi149.stdout:0/730: dread d1/d2/d41/f4d [0,4194304] 0 2024-09-13T18:30:26.436 INFO:tasks.workunit.client.1.smithi149.stdout:0/731: fdatasync d1/d29/d31/d44/d47/f84 0 2024-09-13T18:30:26.436 INFO:tasks.workunit.client.1.smithi149.stdout:7/788: creat d7/d9/d1c/d34/f116 x:0 0 0 2024-09-13T18:30:26.436 INFO:tasks.workunit.client.1.smithi149.stdout:0/732: creat d1/d48/d92/db4/dbe/ffc x:0 0 0 2024-09-13T18:30:26.436 INFO:tasks.workunit.client.1.smithi149.stdout:9/536: write d0/d2e/f43 [2544730,34548] 0 2024-09-13T18:30:26.440 INFO:tasks.workunit.client.1.smithi149.stdout:9/537: rename d0/l6c to d0/d47/lab 0 2024-09-13T18:30:26.446 INFO:tasks.workunit.client.1.smithi149.stdout:9/538: creat d0/d2e/d42/d70/d84/fac x:0 0 0 2024-09-13T18:30:26.460 INFO:tasks.workunit.client.1.smithi149.stdout:6/775: dwrite dc/d15/f36 [0,4194304] 0 2024-09-13T18:30:26.461 INFO:tasks.workunit.client.1.smithi149.stdout:6/776: truncate dc/d15/d23/d5b/d91/db0/fca 770863 0 2024-09-13T18:30:26.461 INFO:tasks.workunit.client.1.smithi149.stdout:6/777: chown dc/d15/d54/fba 12 1 2024-09-13T18:30:26.461 INFO:tasks.workunit.client.1.smithi149.stdout:6/778: stat dc/d15/d23/d5f/dac/fb7 0 2024-09-13T18:30:26.471 INFO:tasks.workunit.client.1.smithi149.stdout:6/779: dread dc/d2f/fce [0,4194304] 0 2024-09-13T18:30:26.471 INFO:tasks.workunit.client.1.smithi149.stdout:6/780: creat dc/d2f/d75/da1/ff8 x:0 0 0 2024-09-13T18:30:26.487 INFO:tasks.workunit.client.1.smithi149.stdout:1/705: dwrite d9/d10/d83/d97/f9a [0,4194304] 0 2024-09-13T18:30:26.487 INFO:tasks.workunit.client.1.smithi149.stdout:1/706: chown d9/d10/d34/d3c/d50/fb9 226239120 1 2024-09-13T18:30:26.487 INFO:tasks.workunit.client.1.smithi149.stdout:1/707: write d9/d15/d60/da5/fc6 [348207,126426] 0 2024-09-13T18:30:26.487 INFO:tasks.workunit.client.1.smithi149.stdout:1/708: fdatasync d9/d15/d60/da5/faf 0 2024-09-13T18:30:26.487 INFO:tasks.workunit.client.1.smithi149.stdout:1/709: write d9/d15/d60/d80/d8b/f31 [3365349,109157] 0 2024-09-13T18:30:26.487 INFO:tasks.workunit.client.1.smithi149.stdout:8/678: dwrite d2/d12/f46 [0,4194304] 0 2024-09-13T18:30:26.487 INFO:tasks.workunit.client.1.smithi149.stdout:8/679: fsync d2/d12/d2a/d4d/f79 0 2024-09-13T18:30:26.487 INFO:tasks.workunit.client.1.smithi149.stdout:0/733: dwrite d1/d48/d92/db4/db5/fc0 [0,4194304] 0 2024-09-13T18:30:26.488 INFO:tasks.workunit.client.1.smithi149.stdout:0/734: chown d1/d48/d92/db4/db5 14586394 1 2024-09-13T18:30:26.488 INFO:tasks.workunit.client.1.smithi149.stdout:0/735: creat d1/d29/d31/d44/d81/d9f/ffd x:0 0 0 2024-09-13T18:30:26.488 INFO:tasks.workunit.client.1.smithi149.stdout:7/789: dwrite d7/d9/d1b/f36 [0,4194304] 0 2024-09-13T18:30:26.489 INFO:tasks.workunit.client.1.smithi149.stdout:9/539: dwrite d0/d47/d61/f77 [0,4194304] 0 2024-09-13T18:30:26.489 INFO:tasks.workunit.client.1.smithi149.stdout:4/730: dwrite df/da0/d70/db5/dc7/fcd [0,4194304] 0 2024-09-13T18:30:26.492 INFO:tasks.workunit.client.1.smithi149.stdout:0/736: write d1/d2/d41/f4d [564646,115237] 0 2024-09-13T18:30:26.495 INFO:tasks.workunit.client.1.smithi149.stdout:9/540: getdents d0/d47/d54/d75 0 2024-09-13T18:30:26.496 INFO:tasks.workunit.client.1.smithi149.stdout:9/541: write d0/d18/d27/d5c/d7e/f97 [339718,105607] 0 2024-09-13T18:30:26.496 INFO:tasks.workunit.client.1.smithi149.stdout:9/542: readlink d0/d18/d27/l46 0 2024-09-13T18:30:26.499 INFO:tasks.workunit.client.1.smithi149.stdout:1/710: rmdir d9/d10/d62 39 2024-09-13T18:30:26.502 INFO:tasks.workunit.client.1.smithi149.stdout:0/737: mkdir d1/d2/d8a/da9/dd7/dfe 0 2024-09-13T18:30:26.502 INFO:tasks.workunit.client.1.smithi149.stdout:0/738: write d1/d29/d31/f52 [736153,13759] 0 2024-09-13T18:30:26.504 INFO:tasks.workunit.client.1.smithi149.stdout:9/543: mkdir d0/d2e/d42/d70/d84/dad 0 2024-09-13T18:30:26.504 INFO:tasks.workunit.client.1.smithi149.stdout:9/544: write d0/d47/d61/f77 [5037100,68085] 0 2024-09-13T18:30:26.507 INFO:tasks.workunit.client.1.smithi149.stdout:1/711: truncate d9/d15/d60/d80/d8b/d42/f6a 2770791 0 2024-09-13T18:30:26.507 INFO:tasks.workunit.client.1.smithi149.stdout:1/712: fsync d9/d10/d34/d53/d57/f65 0 2024-09-13T18:30:26.511 INFO:tasks.workunit.client.1.smithi149.stdout:9/545: mkdir d0/d2e/d42/d70/d84/dae 0 2024-09-13T18:30:26.511 INFO:tasks.workunit.client.1.smithi149.stdout:1/713: getdents d9/d15 0 2024-09-13T18:30:26.513 INFO:tasks.workunit.client.1.smithi149.stdout:9/546: mknod d0/d2e/d42/d70/d84/dad/caf 0 2024-09-13T18:30:26.514 INFO:tasks.workunit.client.1.smithi149.stdout:1/714: symlink d9/d10/d34/d53/d7b/ld9 0 2024-09-13T18:30:26.514 INFO:tasks.workunit.client.1.smithi149.stdout:1/715: write d9/d10/d83/d97/f87 [4342779,126551] 0 2024-09-13T18:30:26.514 INFO:tasks.workunit.client.1.smithi149.stdout:9/547: chown d0/d18/d27/c30 1172 1 2024-09-13T18:30:26.515 INFO:tasks.workunit.client.1.smithi149.stdout:9/548: symlink d0/d9e/d3b/lb0 0 2024-09-13T18:30:26.515 INFO:tasks.workunit.client.1.smithi149.stdout:9/549: write d0/d18/d27/d5c/d99/d9f/fa9 [17917,92662] 0 2024-09-13T18:30:26.526 INFO:tasks.workunit.client.1.smithi149.stdout:7/790: dwrite d7/d9/d1b/f57 [0,4194304] 0 2024-09-13T18:30:26.526 INFO:tasks.workunit.client.1.smithi149.stdout:4/731: dwrite df/da0/d12/d17/f3a [0,4194304] 0 2024-09-13T18:30:26.526 INFO:tasks.workunit.client.1.smithi149.stdout:0/739: dwrite d1/d29/d31/d44/d81/f79 [0,4194304] 0 2024-09-13T18:30:26.526 INFO:tasks.workunit.client.1.smithi149.stdout:0/740: write d1/fbf [181799,56192] 0 2024-09-13T18:30:26.527 INFO:tasks.workunit.client.1.smithi149.stdout:9/550: dread d0/d47/d54/f55 [0,4194304] 0 2024-09-13T18:30:26.527 INFO:tasks.workunit.client.1.smithi149.stdout:8/680: dwrite d2/d12/f89 [0,4194304] 0 2024-09-13T18:30:26.527 INFO:tasks.workunit.client.1.smithi149.stdout:8/681: chown d2/d12/dd8/d58/la6 181 1 2024-09-13T18:30:26.528 INFO:tasks.workunit.client.1.smithi149.stdout:7/791: rmdir d7 39 2024-09-13T18:30:26.528 INFO:tasks.workunit.client.1.smithi149.stdout:7/792: fdatasync d7/d9/d1c/f109 0 2024-09-13T18:30:26.528 INFO:tasks.workunit.client.1.smithi149.stdout:4/732: dread df/da0/d12/d17/d3d/fa7 [0,4194304] 0 2024-09-13T18:30:26.533 INFO:tasks.workunit.client.1.smithi149.stdout:0/741: rename d1/d2/d8a/da9/fe5 to d1/d2/d8a/d90/fff 0 2024-09-13T18:30:26.534 INFO:tasks.workunit.client.1.smithi149.stdout:9/551: creat d0/d2e/fb1 x:0 0 0 2024-09-13T18:30:26.538 INFO:tasks.workunit.client.1.smithi149.stdout:8/682: link d2/d13/d6d/l6a d2/dc4/lee 0 2024-09-13T18:30:26.538 INFO:tasks.workunit.client.1.smithi149.stdout:8/683: readlink d2/d12/d87/la1 0 2024-09-13T18:30:26.539 INFO:tasks.workunit.client.1.smithi149.stdout:7/793: unlink d7/d9/d1c/d1f/d3d/l41 0 2024-09-13T18:30:26.543 INFO:tasks.workunit.client.1.smithi149.stdout:8/684: truncate d2/d5b/f8a 2556909 0 2024-09-13T18:30:26.543 INFO:tasks.workunit.client.1.smithi149.stdout:8/685: creat d2/d13/d6d/fef x:0 0 0 2024-09-13T18:30:26.543 INFO:tasks.workunit.client.1.smithi149.stdout:8/686: fdatasync d2/d12/f3f 0 2024-09-13T18:30:26.543 INFO:tasks.workunit.client.1.smithi149.stdout:8/687: dread - d2/d13/d6d/fd3 zero size 2024-09-13T18:30:26.543 INFO:tasks.workunit.client.1.smithi149.stdout:8/688: readlink d2/l7 0 2024-09-13T18:30:26.544 INFO:tasks.workunit.client.1.smithi149.stdout:1/716: write d9/d15/d60/d80/d8b/d42/f6a [851496,38146] 0 2024-09-13T18:30:26.544 INFO:tasks.workunit.client.1.smithi149.stdout:1/717: write d9/d15/d60/d80/f9d [6397,101938] 0 2024-09-13T18:30:26.544 INFO:tasks.workunit.client.1.smithi149.stdout:7/794: rename d7/d76/fe0 to d7/d9/d11/d50/dde/df7/ddf/f117 0 2024-09-13T18:30:26.547 INFO:tasks.workunit.client.1.smithi149.stdout:0/742: rmdir d1/d2/d41/d46 39 2024-09-13T18:30:26.548 INFO:tasks.workunit.client.1.smithi149.stdout:9/552: dread d0/d9e/d3b/f3d [0,4194304] 0 2024-09-13T18:30:26.549 INFO:tasks.workunit.client.1.smithi149.stdout:4/733: dwrite df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fae [0,4194304] 0 2024-09-13T18:30:26.551 INFO:tasks.workunit.client.1.smithi149.stdout:7/795: dread d7/d9/d11/d50/f90 [0,4194304] 0 2024-09-13T18:30:26.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/743: mknod d1/d2/d8a/da9/dd7/c100 0 2024-09-13T18:30:26.554 INFO:tasks.workunit.client.1.smithi149.stdout:9/553: mkdir d0/d18/d68/db2 0 2024-09-13T18:30:26.557 INFO:tasks.workunit.client.1.smithi149.stdout:1/718: dread d9/d15/d60/da5/faf [0,4194304] 0 2024-09-13T18:30:26.562 INFO:tasks.workunit.client.0.smithi038.stdout:0/23: sync 2024-09-13T18:30:26.564 INFO:tasks.workunit.client.1.smithi149.stdout:8/689: dwrite d2/db1/fd0 [0,4194304] 0 2024-09-13T18:30:26.564 INFO:tasks.workunit.client.1.smithi149.stdout:8/690: readlink d2/d12/dd8/d66/ld6 0 2024-09-13T18:30:26.565 INFO:tasks.workunit.client.1.smithi149.stdout:4/734: rename df/da0/d12/d21/d22/d30/d41/d57/f6a to df/da0/d12/d7c/d9a/ffa 0 2024-09-13T18:30:26.565 INFO:tasks.workunit.client.1.smithi149.stdout:4/735: write df/da0/d12/d21/d22/d30/d41/d57/d60/dc4/fd0 [9414185,38115] 0 2024-09-13T18:30:26.566 INFO:tasks.workunit.client.0.smithi038.stdout:0/24: creat d2/fa x:0 0 0 2024-09-13T18:30:26.567 INFO:tasks.workunit.client.1.smithi149.stdout:1/719: mknod d9/d15/d60/d80/dcd/dab/cda 0 2024-09-13T18:30:26.569 INFO:tasks.workunit.client.1.smithi149.stdout:9/554: write d0/d18/f41 [1872878,98428] 0 2024-09-13T18:30:26.570 INFO:tasks.workunit.client.1.smithi149.stdout:8/691: rename d2/d5b/d88/fa2 to d2/d12/d40/ff0 0 2024-09-13T18:30:26.571 INFO:tasks.workunit.client.1.smithi149.stdout:1/720: creat d9/d10/d3f/dc9/fdb x:0 0 0 2024-09-13T18:30:26.574 INFO:tasks.workunit.client.1.smithi149.stdout:8/692: rmdir d2/d12/dd8/d66 39 2024-09-13T18:30:26.576 INFO:tasks.workunit.client.1.smithi149.stdout:9/555: getdents d0/d47/d61 0 2024-09-13T18:30:26.577 INFO:tasks.workunit.client.1.smithi149.stdout:9/556: stat d0/d9e/f32 0 2024-09-13T18:30:26.578 INFO:tasks.workunit.client.1.smithi149.stdout:8/693: mkdir d2/d12/d87/df1 0 2024-09-13T18:30:26.578 INFO:tasks.workunit.client.1.smithi149.stdout:2/613: sync 2024-09-13T18:30:26.578 INFO:tasks.workunit.client.1.smithi149.stdout:3/694: sync 2024-09-13T18:30:26.578 INFO:tasks.workunit.client.1.smithi149.stdout:5/630: sync 2024-09-13T18:30:26.579 INFO:tasks.workunit.client.1.smithi149.stdout:7/796: dwrite d7/f84 [0,4194304] 0 2024-09-13T18:30:26.580 INFO:tasks.workunit.client.1.smithi149.stdout:9/557: mknod d0/d18/d27/d5c/d7e/cb3 0 2024-09-13T18:30:26.580 INFO:tasks.workunit.client.1.smithi149.stdout:9/558: stat d0/f29 0 2024-09-13T18:30:26.581 INFO:tasks.workunit.client.1.smithi149.stdout:3/695: symlink d1/lef 0 2024-09-13T18:30:26.583 INFO:tasks.workunit.client.1.smithi149.stdout:2/614: rename db/d1b/d1c/d20/fd2 to db/d10/d8d/fd4 0 2024-09-13T18:30:26.583 INFO:tasks.workunit.client.1.smithi149.stdout:2/615: chown db/d13/d70/f7c 50457914 1 2024-09-13T18:30:26.585 INFO:tasks.workunit.client.1.smithi149.stdout:7/797: creat d7/d9/d1b/d71/ddc/f118 x:0 0 0 2024-09-13T18:30:26.585 INFO:tasks.workunit.client.1.smithi149.stdout:9/559: mknod d0/d47/d54/d75/cb4 0 2024-09-13T18:30:26.588 INFO:tasks.workunit.client.1.smithi149.stdout:5/631: creat d3/d10/d32/d54/d97/dba/fc9 x:0 0 0 2024-09-13T18:30:26.588 INFO:tasks.workunit.client.1.smithi149.stdout:2/616: creat db/d1b/d1c/d20/d2b/d3e/d95/fd5 x:0 0 0 2024-09-13T18:30:26.588 INFO:tasks.workunit.client.1.smithi149.stdout:2/617: chown db/d1b/d1c/d20/d2b/d3e/d95/cbb 31 1 2024-09-13T18:30:26.588 INFO:tasks.workunit.client.1.smithi149.stdout:1/721: write d9/d10/d83/d97/f87 [2527583,37772] 0 2024-09-13T18:30:26.589 INFO:tasks.workunit.client.1.smithi149.stdout:7/798: symlink d7/d9/d11/d9c/l119 0 2024-09-13T18:30:26.592 INFO:tasks.workunit.client.1.smithi149.stdout:5/632: symlink d3/d10/d4c/d4e/da4/lca 0 2024-09-13T18:30:26.593 INFO:tasks.workunit.client.1.smithi149.stdout:1/722: rmdir d9/d15 39 2024-09-13T18:30:26.593 INFO:tasks.workunit.client.1.smithi149.stdout:1/723: stat d9/d10/d34/d53/d57/d6c/da2 0 2024-09-13T18:30:26.593 INFO:tasks.workunit.client.1.smithi149.stdout:9/560: symlink d0/d2e/d42/d59/d86/lb5 0 2024-09-13T18:30:26.594 INFO:tasks.workunit.client.1.smithi149.stdout:7/799: rmdir d7/d9/d1b/d71 39 2024-09-13T18:30:26.599 INFO:tasks.workunit.client.1.smithi149.stdout:5/633: mknod d3/d10/d4c/d4e/d61/d75/ccb 0 2024-09-13T18:30:26.600 INFO:tasks.workunit.client.1.smithi149.stdout:6/781: sync 2024-09-13T18:30:26.600 INFO:tasks.workunit.client.1.smithi149.stdout:8/694: read d2/fe [3286349,9956] 0 2024-09-13T18:30:26.600 INFO:tasks.workunit.client.1.smithi149.stdout:6/782: dread - dc/d15/d23/d5b/f8b zero size 2024-09-13T18:30:26.602 INFO:tasks.workunit.client.1.smithi149.stdout:1/724: creat d9/d15/d40/d90/fdc x:0 0 0 2024-09-13T18:30:26.602 INFO:tasks.workunit.client.1.smithi149.stdout:7/800: rmdir d7/d9/d1c/d51/d52/d86/da3 39 2024-09-13T18:30:26.606 INFO:tasks.workunit.client.1.smithi149.stdout:8/695: getdents d2/d12 0 2024-09-13T18:30:26.606 INFO:tasks.workunit.client.1.smithi149.stdout:6/783: getdents dc/d15/d23/d5b/d91/db0 0 2024-09-13T18:30:26.606 INFO:tasks.workunit.client.0.smithi038.stdout:0/25: dwrite d2/d7/f9 [0,4194304] 0 2024-09-13T18:30:26.607 INFO:tasks.workunit.client.0.smithi038.stdout:0/26: creat d2/d7/fb x:0 0 0 2024-09-13T18:30:26.607 INFO:tasks.workunit.client.0.smithi038.stdout:0/27: chown l0 1 1 2024-09-13T18:30:26.607 INFO:tasks.workunit.client.0.smithi038.stdout:0/28: chown d2/l3 489 1 2024-09-13T18:30:26.607 INFO:tasks.workunit.client.0.smithi038.stdout:0/29: chown d2 1058 1 2024-09-13T18:30:26.608 INFO:tasks.workunit.client.1.smithi149.stdout:1/725: rename d9/d15/d60/d80/d8b/f9f to d9/d10/d3f/fdd 0 2024-09-13T18:30:26.610 INFO:tasks.workunit.client.1.smithi149.stdout:7/801: mkdir d7/d9/d1b/d71/d11a 0 2024-09-13T18:30:26.612 INFO:tasks.workunit.client.0.smithi038.stdout:6/71: sync 2024-09-13T18:30:26.614 INFO:tasks.workunit.client.1.smithi149.stdout:8/696: link d2/ld d2/dc4/lf2 0 2024-09-13T18:30:26.617 INFO:tasks.workunit.client.1.smithi149.stdout:7/802: creat d7/d9/d1c/d1f/d3d/f11b x:0 0 0 2024-09-13T18:30:26.617 INFO:tasks.workunit.client.1.smithi149.stdout:7/803: readlink d7/d9/d1c/d34/d4e/l63 0 2024-09-13T18:30:26.617 INFO:tasks.workunit.client.1.smithi149.stdout:7/804: write d7/d9/d1c/d34/f97 [23247,60577] 0 2024-09-13T18:30:26.619 INFO:tasks.workunit.client.1.smithi149.stdout:7/805: symlink d7/d9/d1c/d1f/d21/d7b/de6/l11c 0 2024-09-13T18:30:26.619 INFO:tasks.workunit.client.1.smithi149.stdout:7/806: write d7/d76/f8a [856426,68308] 0 2024-09-13T18:30:26.626 INFO:tasks.workunit.client.1.smithi149.stdout:6/784: write dc/d15/d54/fba [3992615,21815] 0 2024-09-13T18:30:26.627 INFO:tasks.workunit.client.1.smithi149.stdout:3/696: dwrite d1/d48/ddb/fe0 [0,4194304] 0 2024-09-13T18:30:26.628 INFO:tasks.workunit.client.1.smithi149.stdout:6/785: mknod dc/d15/d23/d5b/d91/cf9 0 2024-09-13T18:30:26.628 INFO:tasks.workunit.client.1.smithi149.stdout:8/697: dread d2/d12/d6e/fe6 [0,4194304] 0 2024-09-13T18:30:26.628 INFO:tasks.workunit.client.1.smithi149.stdout:2/618: dwrite db/d1b/d1c/d20/d3a/d75/f83 [0,4194304] 0 2024-09-13T18:30:26.629 INFO:tasks.workunit.client.1.smithi149.stdout:2/619: creat db/d1b/d1c/d20/fd6 x:0 0 0 2024-09-13T18:30:26.632 INFO:tasks.workunit.client.1.smithi149.stdout:4/736: dwrite df/da0/d12/d21/f8e [0,4194304] 0 2024-09-13T18:30:26.632 INFO:tasks.workunit.client.1.smithi149.stdout:1/726: write d9/d15/d40/d90/fb8 [441998,78737] 0 2024-09-13T18:30:26.633 INFO:tasks.workunit.client.1.smithi149.stdout:3/697: mkdir d1/d48/df0 0 2024-09-13T18:30:26.635 INFO:tasks.workunit.client.1.smithi149.stdout:2/620: unlink db/d1b/d6c/la5 0 2024-09-13T18:30:26.635 INFO:tasks.workunit.client.0.smithi038.stdout:6/72: write fa [2388142,72520] 0 2024-09-13T18:30:26.638 INFO:tasks.workunit.client.0.smithi038.stdout:6/73: mkdir dd/d1c 0 2024-09-13T18:30:26.638 INFO:tasks.workunit.client.0.smithi038.stdout:6/74: readlink dd/l19 0 2024-09-13T18:30:26.638 INFO:tasks.workunit.client.0.smithi038.stdout:0/30: dwrite d2/f4 [4194304,4194304] 0 2024-09-13T18:30:26.638 INFO:tasks.workunit.client.1.smithi149.stdout:4/737: rmdir df/da0/d12/d21/d22/d30/d41 39 2024-09-13T18:30:26.638 INFO:tasks.workunit.client.1.smithi149.stdout:3/698: truncate d1/d2c/d56/f76 3062851 0 2024-09-13T18:30:26.638 INFO:tasks.workunit.client.1.smithi149.stdout:3/699: chown d1/d2c/d42/fc0 39859292 1 2024-09-13T18:30:26.640 INFO:tasks.workunit.client.0.smithi038.stdout:6/75: unlink dd/c17 0 2024-09-13T18:30:26.643 INFO:tasks.workunit.client.0.smithi038.stdout:0/31: mkdir d2/dc 0 2024-09-13T18:30:26.643 INFO:tasks.workunit.client.0.smithi038.stdout:0/32: rename d2/d7 to d2/d7/dd 22 2024-09-13T18:30:26.644 INFO:tasks.workunit.client.0.smithi038.stdout:6/76: mknod dd/c1d 0 2024-09-13T18:30:26.645 INFO:tasks.workunit.client.0.smithi038.stdout:0/33: symlink d2/dc/le 0 2024-09-13T18:30:26.647 INFO:tasks.workunit.client.0.smithi038.stdout:6/77: creat dd/de/f1e x:0 0 0 2024-09-13T18:30:26.649 INFO:tasks.workunit.client.0.smithi038.stdout:0/34: symlink d2/lf 0 2024-09-13T18:30:26.649 INFO:tasks.workunit.client.1.smithi149.stdout:7/807: dread d7/d76/db3/fad [0,4194304] 0 2024-09-13T18:30:26.649 INFO:tasks.workunit.client.1.smithi149.stdout:3/700: symlink d1/d2e/d6f/daf/de8/lf1 0 2024-09-13T18:30:26.649 INFO:tasks.workunit.client.1.smithi149.stdout:9/561: dwrite d0/d9e/f23 [0,4194304] 0 2024-09-13T18:30:26.649 INFO:tasks.workunit.client.1.smithi149.stdout:9/562: write d0/d9e/f56 [3731842,108000] 0 2024-09-13T18:30:26.649 INFO:tasks.workunit.client.1.smithi149.stdout:9/563: fsync d0/d9e/d3b/f4f 0 2024-09-13T18:30:26.649 INFO:tasks.workunit.client.1.smithi149.stdout:9/564: chown d0/d18/d27/d5c/d7e/f97 850358 1 2024-09-13T18:30:26.649 INFO:tasks.workunit.client.1.smithi149.stdout:9/565: write d0/d18/d27/d5c/d7e/f97 [888037,28482] 0 2024-09-13T18:30:26.651 INFO:tasks.workunit.client.0.smithi038.stdout:6/78: unlink dd/de/f1e 0 2024-09-13T18:30:26.657 INFO:tasks.workunit.client.0.smithi038.stdout:0/35: mknod d2/c10 0 2024-09-13T18:30:26.662 INFO:tasks.workunit.client.1.smithi149.stdout:2/621: dread f6 [0,4194304] 0 2024-09-13T18:30:26.671 INFO:tasks.workunit.client.0.smithi038.stdout:4/136: sync 2024-09-13T18:30:26.671 INFO:tasks.workunit.client.0.smithi038.stdout:2/32: sync 2024-09-13T18:30:26.671 INFO:tasks.workunit.client.0.smithi038.stdout:7/64: sync 2024-09-13T18:30:26.671 INFO:tasks.workunit.client.0.smithi038.stdout:9/35: sync 2024-09-13T18:30:26.671 INFO:tasks.workunit.client.0.smithi038.stdout:9/36: fsync d0/fb 0 2024-09-13T18:30:26.671 INFO:tasks.workunit.client.0.smithi038.stdout:7/65: dread - db/f10 zero size 2024-09-13T18:30:26.672 INFO:tasks.workunit.client.0.smithi038.stdout:4/137: rmdir d2/df/d22/dc/d8 39 2024-09-13T18:30:26.672 INFO:tasks.workunit.client.0.smithi038.stdout:4/138: fsync d2/df/d22/dc/d8/f23 0 2024-09-13T18:30:26.672 INFO:tasks.workunit.client.0.smithi038.stdout:4/139: chown d2/df/d22/l1f 1346913461 1 2024-09-13T18:30:26.672 INFO:tasks.workunit.client.0.smithi038.stdout:5/39: sync 2024-09-13T18:30:26.672 INFO:tasks.workunit.client.0.smithi038.stdout:1/72: sync 2024-09-13T18:30:26.672 INFO:tasks.workunit.client.0.smithi038.stdout:3/34: sync 2024-09-13T18:30:26.673 INFO:tasks.workunit.client.0.smithi038.stdout:5/40: truncate f2 386312 0 2024-09-13T18:30:26.673 INFO:tasks.workunit.client.0.smithi038.stdout:8/172: sync 2024-09-13T18:30:26.673 INFO:tasks.workunit.client.0.smithi038.stdout:1/73: creat d12/f14 x:0 0 0 2024-09-13T18:30:26.673 INFO:tasks.workunit.client.0.smithi038.stdout:1/74: fsync fe 0 2024-09-13T18:30:26.673 INFO:tasks.workunit.client.0.smithi038.stdout:1/75: write d12/f13 [88080,102697] 0 2024-09-13T18:30:26.673 INFO:tasks.workunit.client.1.smithi149.stdout:5/634: dwrite d3/d8/f9b [0,4194304] 0 2024-09-13T18:30:26.674 INFO:tasks.workunit.client.0.smithi038.stdout:7/66: unlink db/lf 0 2024-09-13T18:30:26.675 INFO:tasks.workunit.client.0.smithi038.stdout:4/140: symlink d2/df/l2d 0 2024-09-13T18:30:26.675 INFO:tasks.workunit.client.0.smithi038.stdout:4/141: chown d2/df/d22/l2a 406535432 1 2024-09-13T18:30:26.675 INFO:tasks.workunit.client.0.smithi038.stdout:4/142: chown d2/df/d1b/d10/f25 226140175 1 2024-09-13T18:30:26.676 INFO:tasks.workunit.client.0.smithi038.stdout:4/143: write d2/df/d22/dc/f2c [575347,121768] 0 2024-09-13T18:30:26.678 INFO:tasks.workunit.client.0.smithi038.stdout:3/35: unlink d0/l1 0 2024-09-13T18:30:26.678 INFO:tasks.workunit.client.0.smithi038.stdout:2/33: write d2/f5 [1274543,75019] 0 2024-09-13T18:30:26.683 INFO:tasks.workunit.client.0.smithi038.stdout:8/173: dread d1/f7 [0,4194304] 0 2024-09-13T18:30:26.683 INFO:tasks.workunit.client.0.smithi038.stdout:8/174: readlink d1/d8/l37 0 2024-09-13T18:30:26.684 INFO:tasks.workunit.client.1.smithi149.stdout:5/635: rename d3/d10/c4d to d3/d10/d4c/d4e/d61/ccc 0 2024-09-13T18:30:26.686 INFO:tasks.workunit.client.0.smithi038.stdout:7/67: creat db/d12/d13/f17 x:0 0 0 2024-09-13T18:30:26.688 INFO:tasks.workunit.client.0.smithi038.stdout:4/144: creat d2/df/d22/dc/d8/f2e x:0 0 0 2024-09-13T18:30:26.689 INFO:tasks.workunit.client.0.smithi038.stdout:5/41: getdents . 0 2024-09-13T18:30:26.690 INFO:tasks.workunit.client.0.smithi038.stdout:7/68: creat db/d12/f18 x:0 0 0 2024-09-13T18:30:26.691 INFO:tasks.workunit.client.0.smithi038.stdout:6/79: dread fa [0,4194304] 0 2024-09-13T18:30:26.693 INFO:tasks.workunit.client.0.smithi038.stdout:5/42: unlink fe 0 2024-09-13T18:30:26.694 INFO:tasks.workunit.client.0.smithi038.stdout:5/43: chown fb 2624 1 2024-09-13T18:30:26.695 INFO:tasks.workunit.client.0.smithi038.stdout:9/37: dread d0/f8 [0,4194304] 0 2024-09-13T18:30:26.697 INFO:tasks.workunit.client.0.smithi038.stdout:5/44: mkdir df 0 2024-09-13T18:30:26.702 INFO:tasks.workunit.client.0.smithi038.stdout:1/76: getdents d12 0 2024-09-13T18:30:26.705 INFO:tasks.workunit.client.0.smithi038.stdout:1/77: mkdir d12/d15 0 2024-09-13T18:30:26.706 INFO:tasks.workunit.client.0.smithi038.stdout:9/38: write d0/f1 [3307481,100909] 0 2024-09-13T18:30:26.707 INFO:tasks.workunit.client.1.smithi149.stdout:5/636: read d3/d8/d13/f18 [2846541,100814] 0 2024-09-13T18:30:26.708 INFO:tasks.workunit.client.1.smithi149.stdout:4/738: dwrite df/f90 [0,4194304] 0 2024-09-13T18:30:26.708 INFO:tasks.workunit.client.1.smithi149.stdout:5/637: dread - d3/d10/d4c/db8/fbf zero size 2024-09-13T18:30:26.708 INFO:tasks.workunit.client.1.smithi149.stdout:5/638: write d3/d5e/fa2 [38196,59486] 0 2024-09-13T18:30:26.709 INFO:tasks.workunit.client.1.smithi149.stdout:5/639: dread - d3/d10/d32/d54/d97/dba/fc9 zero size 2024-09-13T18:30:26.711 INFO:tasks.workunit.client.0.smithi038.stdout:1/78: link f9 d12/f16 0 2024-09-13T18:30:26.711 INFO:tasks.workunit.client.0.smithi038.stdout:4/145: write d2/df/d1b/d10/f25 [1492868,84202] 0 2024-09-13T18:30:26.712 INFO:tasks.workunit.client.0.smithi038.stdout:8/175: write d1/fc [764704,49550] 0 2024-09-13T18:30:26.714 INFO:tasks.workunit.client.1.smithi149.stdout:4/739: link df/da0/d1c/d69/ca4 df/da0/d1c/cfb 0 2024-09-13T18:30:26.715 INFO:tasks.workunit.client.0.smithi038.stdout:1/79: truncate f3 1357317 0 2024-09-13T18:30:26.716 INFO:tasks.workunit.client.0.smithi038.stdout:9/39: write d0/f8 [637987,54148] 0 2024-09-13T18:30:26.716 INFO:tasks.workunit.client.0.smithi038.stdout:9/40: write d0/f1 [2505043,116226] 0 2024-09-13T18:30:26.716 INFO:tasks.workunit.client.0.smithi038.stdout:9/41: chown d0/fb 5 1 2024-09-13T18:30:26.717 INFO:tasks.workunit.client.1.smithi149.stdout:5/640: link d3/d10/d4c/c93 d3/d10/d32/ccd 0 2024-09-13T18:30:26.719 INFO:tasks.workunit.client.1.smithi149.stdout:5/641: mknod d3/d10/d4c/d4e/d61/d75/cce 0 2024-09-13T18:30:26.721 INFO:tasks.workunit.client.0.smithi038.stdout:1/80: creat d12/f17 x:0 0 0 2024-09-13T18:30:26.724 INFO:tasks.workunit.client.1.smithi149.stdout:5/642: dread d3/f5c [0,4194304] 0 2024-09-13T18:30:26.728 INFO:tasks.workunit.client.0.smithi038.stdout:1/81: mknod d12/c18 0 2024-09-13T18:30:26.729 INFO:tasks.workunit.client.1.smithi149.stdout:7/808: dwrite d7/d9/d1c/d1f/d21/f77 [0,4194304] 0 2024-09-13T18:30:26.729 INFO:tasks.workunit.client.1.smithi149.stdout:1/727: dwrite d9/d10/d34/d53/d57/f98 [0,4194304] 0 2024-09-13T18:30:26.729 INFO:tasks.workunit.client.1.smithi149.stdout:1/728: read d9/d15/d60/d80/f84 [436476,35670] 0 2024-09-13T18:30:26.732 INFO:tasks.workunit.client.0.smithi038.stdout:3/36: dwrite d0/dd/fe [0,4194304] 0 2024-09-13T18:30:26.733 INFO:tasks.workunit.client.1.smithi149.stdout:7/809: unlink d7/d9/d1c/d51/d52/d86/lba 0 2024-09-13T18:30:26.733 INFO:tasks.workunit.client.1.smithi149.stdout:7/810: dread - d7/d9/d1c/d51/dd2/fec zero size 2024-09-13T18:30:26.734 INFO:tasks.workunit.client.1.smithi149.stdout:2/622: dwrite db/d1b/f98 [0,4194304] 0 2024-09-13T18:30:26.735 INFO:tasks.workunit.client.1.smithi149.stdout:9/566: dwrite d0/d18/d27/d5c/d99/d9f/fa9 [0,4194304] 0 2024-09-13T18:30:26.735 INFO:tasks.workunit.client.1.smithi149.stdout:9/567: write d0/d47/d61/f77 [5464439,22128] 0 2024-09-13T18:30:26.736 INFO:tasks.workunit.client.0.smithi038.stdout:9/42: dread d0/d7/fa [0,4194304] 0 2024-09-13T18:30:26.736 INFO:tasks.workunit.client.0.smithi038.stdout:5/45: dwrite fb [4194304,4194304] 0 2024-09-13T18:30:26.736 INFO:tasks.workunit.client.1.smithi149.stdout:3/701: dwrite d1/d12/d20/d54/f6a [0,4194304] 0 2024-09-13T18:30:26.736 INFO:tasks.workunit.client.1.smithi149.stdout:1/729: unlink d9/d10/d34/d53/d57/d6c/f7f 0 2024-09-13T18:30:26.739 INFO:tasks.workunit.client.0.smithi038.stdout:0/36: dwrite d2/d7/fb [0,4194304] 0 2024-09-13T18:30:26.739 INFO:tasks.workunit.client.0.smithi038.stdout:7/69: dwrite db/f10 [0,4194304] 0 2024-09-13T18:30:26.740 INFO:tasks.workunit.client.1.smithi149.stdout:5/643: dread d3/d10/d4c/d4e/d61/f96 [0,4194304] 0 2024-09-13T18:30:26.741 INFO:tasks.workunit.client.0.smithi038.stdout:8/176: dwrite d1/d2a/f38 [0,4194304] 0 2024-09-13T18:30:26.742 INFO:tasks.workunit.client.0.smithi038.stdout:3/37: mknod d0/cf 0 2024-09-13T18:30:26.745 INFO:tasks.workunit.client.0.smithi038.stdout:9/43: link d0/d7/fe d0/ff 0 2024-09-13T18:30:26.745 INFO:tasks.workunit.client.0.smithi038.stdout:9/44: rename d0 to d0/d7/d10 22 2024-09-13T18:30:26.748 INFO:tasks.workunit.client.0.smithi038.stdout:5/46: creat df/f10 x:0 0 0 2024-09-13T18:30:26.748 INFO:tasks.workunit.client.0.smithi038.stdout:5/47: creat df/f11 x:0 0 0 2024-09-13T18:30:26.749 INFO:tasks.workunit.client.1.smithi149.stdout:9/568: creat d0/d18/d93/fb6 x:0 0 0 2024-09-13T18:30:26.753 INFO:tasks.workunit.client.1.smithi149.stdout:1/730: symlink d9/d10/d34/lde 0 2024-09-13T18:30:26.754 INFO:tasks.workunit.client.1.smithi149.stdout:7/811: rmdir d7/d9/d11/d50/dde/df7/dae 39 2024-09-13T18:30:26.754 INFO:tasks.workunit.client.1.smithi149.stdout:7/812: getdents d7/d9/d11/de2/d101 0 2024-09-13T18:30:26.754 INFO:tasks.workunit.client.1.smithi149.stdout:7/813: stat d7/d76/db3/d6f/d9d/l10c 0 2024-09-13T18:30:26.755 INFO:tasks.workunit.client.0.smithi038.stdout:7/70: mknod db/d12/c19 0 2024-09-13T18:30:26.758 INFO:tasks.workunit.client.1.smithi149.stdout:2/623: rename db/d10/d12/l35 to db/d13/ld7 0 2024-09-13T18:30:26.758 INFO:tasks.workunit.client.1.smithi149.stdout:2/624: write db/d1b/d1c/d20/d2b/db7/f90 [484154,17316] 0 2024-09-13T18:30:26.759 INFO:tasks.workunit.client.1.smithi149.stdout:9/569: mknod d0/d2e/cb7 0 2024-09-13T18:30:26.760 INFO:tasks.workunit.client.0.smithi038.stdout:8/177: mkdir d1/de/d21/d24/d41 0 2024-09-13T18:30:26.761 INFO:tasks.workunit.client.1.smithi149.stdout:1/731: mkdir d9/d10/d3f/dc9/ddf 0 2024-09-13T18:30:26.763 INFO:tasks.workunit.client.1.smithi149.stdout:5/644: rmdir d3/d10/d4c/db8 39 2024-09-13T18:30:26.763 INFO:tasks.workunit.client.1.smithi149.stdout:5/645: readlink d3/d8/l5a 0 2024-09-13T18:30:26.763 INFO:tasks.workunit.client.0.smithi038.stdout:4/146: dwrite d2/df/d22/dc/f16 [4194304,4194304] 0 2024-09-13T18:30:26.763 INFO:tasks.workunit.client.1.smithi149.stdout:7/814: read d7/d9/d1c/d1f/d21/d7b/fed [1621996,53491] 0 2024-09-13T18:30:26.764 INFO:tasks.workunit.client.0.smithi038.stdout:3/38: link d0/c8 d0/dd/c10 0 2024-09-13T18:30:26.765 INFO:tasks.workunit.client.0.smithi038.stdout:6/80: dwrite f9 [0,4194304] 0 2024-09-13T18:30:26.765 INFO:tasks.workunit.client.1.smithi149.stdout:3/702: dwrite d1/d2c/d38/fa9 [0,4194304] 0 2024-09-13T18:30:26.766 INFO:tasks.workunit.client.0.smithi038.stdout:0/37: dwrite d2/f4 [4194304,4194304] 0 2024-09-13T18:30:26.767 INFO:tasks.workunit.client.1.smithi149.stdout:2/625: fsync db/d1b/d2f/d30/f4f 0 2024-09-13T18:30:26.770 INFO:tasks.workunit.client.1.smithi149.stdout:9/570: creat d0/d18/d27/d5c/d7e/fb8 x:0 0 0 2024-09-13T18:30:26.770 INFO:tasks.workunit.client.1.smithi149.stdout:9/571: write d0/d47/f83 [592831,128558] 0 2024-09-13T18:30:26.770 INFO:tasks.workunit.client.1.smithi149.stdout:9/572: write d0/d2e/d42/d59/d86/fa4 [210079,27003] 0 2024-09-13T18:30:26.770 INFO:tasks.workunit.client.1.smithi149.stdout:9/573: chown d0/d9e/f51 2 1 2024-09-13T18:30:26.772 INFO:tasks.workunit.client.0.smithi038.stdout:9/45: creat d0/f11 x:0 0 0 2024-09-13T18:30:26.774 INFO:tasks.workunit.client.1.smithi149.stdout:1/732: mknod d9/d10/d34/d53/d57/ce0 0 2024-09-13T18:30:26.778 INFO:tasks.workunit.client.1.smithi149.stdout:5/646: write d3/f41 [323884,24284] 0 2024-09-13T18:30:26.778 INFO:tasks.workunit.client.1.smithi149.stdout:5/647: chown d3/f41 4787852 1 2024-09-13T18:30:26.778 INFO:tasks.workunit.client.1.smithi149.stdout:5/648: fsync d3/d10/d32/d54/d76/f89 0 2024-09-13T18:30:26.781 INFO:tasks.workunit.client.0.smithi038.stdout:7/71: mkdir db/d12/d1a 0 2024-09-13T18:30:26.781 INFO:tasks.workunit.client.0.smithi038.stdout:7/72: truncate db/f14 241708 0 2024-09-13T18:30:26.781 INFO:tasks.workunit.client.0.smithi038.stdout:7/73: creat db/d12/d13/f1b x:0 0 0 2024-09-13T18:30:26.783 INFO:tasks.workunit.client.0.smithi038.stdout:8/178: creat d1/de/d21/d24/d41/f42 x:0 0 0 2024-09-13T18:30:26.783 INFO:tasks.workunit.client.0.smithi038.stdout:8/179: creat d1/de/d3a/f43 x:0 0 0 2024-09-13T18:30:26.783 INFO:tasks.workunit.client.0.smithi038.stdout:8/180: write d1/d4/f3d [3000350,86497] 0 2024-09-13T18:30:26.785 INFO:tasks.workunit.client.1.smithi149.stdout:2/626: creat db/d1b/d1c/d20/d2b/fd8 x:0 0 0 2024-09-13T18:30:26.785 INFO:tasks.workunit.client.1.smithi149.stdout:6/786: sync 2024-09-13T18:30:26.785 INFO:tasks.workunit.client.1.smithi149.stdout:8/698: sync 2024-09-13T18:30:26.785 INFO:tasks.workunit.client.1.smithi149.stdout:8/699: dread - d2/fd4 zero size 2024-09-13T18:30:26.785 INFO:tasks.workunit.client.1.smithi149.stdout:0/744: sync 2024-09-13T18:30:26.786 INFO:tasks.workunit.client.1.smithi149.stdout:0/745: stat d1/d2/fdb 0 2024-09-13T18:30:26.786 INFO:tasks.workunit.client.1.smithi149.stdout:9/574: getdents d0/d18/d27/d5c/d99 0 2024-09-13T18:30:26.787 INFO:tasks.workunit.client.1.smithi149.stdout:9/575: fdatasync d0/d47/d54/d75/f95 0 2024-09-13T18:30:26.787 INFO:tasks.workunit.client.0.smithi038.stdout:4/147: dread d2/df/d22/dc/f1a [8388608,4194304] 0 2024-09-13T18:30:26.787 INFO:tasks.workunit.client.0.smithi038.stdout:4/148: dread - d2/df/d22/dc/d8/f2e zero size 2024-09-13T18:30:26.788 INFO:tasks.workunit.client.0.smithi038.stdout:6/81: link dd/de/l12 dd/l1f 0 2024-09-13T18:30:26.788 INFO:tasks.workunit.client.0.smithi038.stdout:6/82: truncate f1 314428 0 2024-09-13T18:30:26.790 INFO:tasks.workunit.client.0.smithi038.stdout:9/46: unlink d0/l5 0 2024-09-13T18:30:26.791 INFO:tasks.workunit.client.0.smithi038.stdout:9/47: write d0/fb [642757,5591] 0 2024-09-13T18:30:26.791 INFO:tasks.workunit.client.0.smithi038.stdout:9/48: rename d0 to d0/d7/d12 22 2024-09-13T18:30:26.791 INFO:tasks.workunit.client.0.smithi038.stdout:9/49: read d0/f4 [3774116,59601] 0 2024-09-13T18:30:26.791 INFO:tasks.workunit.client.1.smithi149.stdout:7/815: dwrite d7/d9/d1c/d2c/d60/f91 [0,4194304] 0 2024-09-13T18:30:26.792 INFO:tasks.workunit.client.0.smithi038.stdout:5/48: unlink c5 0 2024-09-13T18:30:26.795 INFO:tasks.workunit.client.1.smithi149.stdout:5/649: creat d3/d8/d6d/fcf x:0 0 0 2024-09-13T18:30:26.795 INFO:tasks.workunit.client.0.smithi038.stdout:7/74: mkdir db/d12/d1c 0 2024-09-13T18:30:26.798 INFO:tasks.workunit.client.1.smithi149.stdout:6/787: truncate dc/d8c/fc2 2078125 0 2024-09-13T18:30:26.800 INFO:tasks.workunit.client.1.smithi149.stdout:8/700: dread d2/f42 [0,4194304] 0 2024-09-13T18:30:26.801 INFO:tasks.workunit.client.0.smithi038.stdout:4/149: creat d2/f2f x:0 0 0 2024-09-13T18:30:26.803 INFO:tasks.workunit.client.1.smithi149.stdout:9/576: write d0/d47/d61/f77 [1013112,1303] 0 2024-09-13T18:30:26.805 INFO:tasks.workunit.client.0.smithi038.stdout:9/50: truncate d0/d7/fa 1056029 0 2024-09-13T18:30:26.806 INFO:tasks.workunit.client.0.smithi038.stdout:3/39: dwrite d0/f4 [0,4194304] 0 2024-09-13T18:30:26.806 INFO:tasks.workunit.client.1.smithi149.stdout:1/733: dwrite d9/d15/d60/d80/d8b/d42/f6a [0,4194304] 0 2024-09-13T18:30:26.806 INFO:tasks.workunit.client.0.smithi038.stdout:0/38: dwrite d2/f4 [4194304,4194304] 0 2024-09-13T18:30:26.808 INFO:tasks.workunit.client.0.smithi038.stdout:5/49: symlink df/l12 0 2024-09-13T18:30:26.808 INFO:tasks.workunit.client.0.smithi038.stdout:5/50: stat df 0 2024-09-13T18:30:26.808 INFO:tasks.workunit.client.0.smithi038.stdout:5/51: chown df 15498175 1 2024-09-13T18:30:26.811 INFO:tasks.workunit.client.0.smithi038.stdout:4/150: dread d2/df/d22/dc/f18 [0,4194304] 0 2024-09-13T18:30:26.811 INFO:tasks.workunit.client.1.smithi149.stdout:6/788: dread dc/d70/dbc/f88 [0,4194304] 0 2024-09-13T18:30:26.811 INFO:tasks.workunit.client.1.smithi149.stdout:6/789: getdents dc/d15/d54/d5e/df7 0 2024-09-13T18:30:26.813 INFO:tasks.workunit.client.1.smithi149.stdout:1/734: dread d9/d10/d34/d3c/d50/f8f [0,4194304] 0 2024-09-13T18:30:26.813 INFO:tasks.workunit.client.1.smithi149.stdout:7/816: mkdir d7/d11d 0 2024-09-13T18:30:26.814 INFO:tasks.workunit.client.1.smithi149.stdout:1/735: dread d9/d10/d62/f99 [0,4194304] 0 2024-09-13T18:30:26.814 INFO:tasks.workunit.client.1.smithi149.stdout:5/650: mkdir d3/d10/d4c/d4e/d61/dd0 0 2024-09-13T18:30:26.815 INFO:tasks.workunit.client.1.smithi149.stdout:5/651: creat d3/d10/d32/d67/d83/fd1 x:0 0 0 2024-09-13T18:30:26.817 INFO:tasks.workunit.client.1.smithi149.stdout:2/627: rmdir db/d10/d8d 39 2024-09-13T18:30:26.817 INFO:tasks.workunit.client.1.smithi149.stdout:2/628: creat db/d1b/d48/fd9 x:0 0 0 2024-09-13T18:30:26.817 INFO:tasks.workunit.client.1.smithi149.stdout:2/629: chown db/d1b/d1c/d20/d3a/f53 661875 1 2024-09-13T18:30:26.819 INFO:tasks.workunit.client.0.smithi038.stdout:8/181: rmdir d1/de/d15 39 2024-09-13T18:30:26.820 INFO:tasks.workunit.client.1.smithi149.stdout:6/790: read dc/d15/f36 [3565895,69330] 0 2024-09-13T18:30:26.820 INFO:tasks.workunit.client.1.smithi149.stdout:6/791: dread - dc/d15/d54/d85/dcc/fe2 zero size 2024-09-13T18:30:26.820 INFO:tasks.workunit.client.1.smithi149.stdout:0/746: getdents d1/d2/d8a/d90 0 2024-09-13T18:30:26.823 INFO:tasks.workunit.client.1.smithi149.stdout:8/701: rename d2/d12/dd8/d66/c9b to d2/d12/d87/ddf/cf3 0 2024-09-13T18:30:26.827 INFO:tasks.workunit.client.1.smithi149.stdout:9/577: creat d0/d18/d27/d5c/d99/fb9 x:0 0 0 2024-09-13T18:30:26.827 INFO:tasks.workunit.client.1.smithi149.stdout:9/578: fdatasync d0/d2e/d42/f5e 0 2024-09-13T18:30:26.830 INFO:tasks.workunit.client.1.smithi149.stdout:2/630: dread db/d1b/d1c/d20/d2b/f9e [0,4194304] 0 2024-09-13T18:30:26.832 INFO:tasks.workunit.client.0.smithi038.stdout:5/52: mkdir df/d13 0 2024-09-13T18:30:26.834 INFO:tasks.workunit.client.1.smithi149.stdout:4/740: sync 2024-09-13T18:30:26.835 INFO:tasks.workunit.client.0.smithi038.stdout:7/75: getdents db/d12/d13 0 2024-09-13T18:30:26.840 INFO:tasks.workunit.client.1.smithi149.stdout:7/817: symlink d7/d9/d1c/d2c/dcc/l11e 0 2024-09-13T18:30:26.843 INFO:tasks.workunit.client.0.smithi038.stdout:4/151: dwrite d2/df/d22/dc/d8/f2e [0,4194304] 0 2024-09-13T18:30:26.843 INFO:tasks.workunit.client.0.smithi038.stdout:4/152: chown d2/df/d22/l2a 601367645 1 2024-09-13T18:30:26.843 INFO:tasks.workunit.client.0.smithi038.stdout:0/39: dwrite d2/d7/fb [0,4194304] 0 2024-09-13T18:30:26.843 INFO:tasks.workunit.client.0.smithi038.stdout:0/40: fdatasync d2/d7/fb 0 2024-09-13T18:30:26.843 INFO:tasks.workunit.client.0.smithi038.stdout:0/41: stat d2/c10 0 2024-09-13T18:30:26.844 INFO:tasks.workunit.client.1.smithi149.stdout:1/736: mkdir d9/d10/d83/de1 0 2024-09-13T18:30:26.848 INFO:tasks.workunit.client.1.smithi149.stdout:4/741: dread df/da0/d12/d21/d22/d30/d41/d57/fa6 [0,4194304] 0 2024-09-13T18:30:26.848 INFO:tasks.workunit.client.1.smithi149.stdout:4/742: fsync fc 0 2024-09-13T18:30:26.849 INFO:tasks.workunit.client.0.smithi038.stdout:8/182: rename d1/f1e to d1/d8/f44 0 2024-09-13T18:30:26.849 INFO:tasks.workunit.client.0.smithi038.stdout:8/183: readlink d1/l2 0 2024-09-13T18:30:26.849 INFO:tasks.workunit.client.0.smithi038.stdout:8/184: read - d1/de/d3a/f43 zero size 2024-09-13T18:30:26.849 INFO:tasks.workunit.client.1.smithi149.stdout:5/652: symlink d3/d10/d32/d67/ld2 0 2024-09-13T18:30:26.851 INFO:tasks.workunit.client.0.smithi038.stdout:9/51: getdents d0 0 2024-09-13T18:30:26.854 INFO:tasks.workunit.client.1.smithi149.stdout:4/743: dread df/fc0 [0,4194304] 0 2024-09-13T18:30:26.854 INFO:tasks.workunit.client.1.smithi149.stdout:4/744: chown df/lb8 127135170 1 2024-09-13T18:30:26.854 INFO:tasks.workunit.client.1.smithi149.stdout:4/745: dread - df/da0/d1c/d7e/d9f/fde zero size 2024-09-13T18:30:26.855 INFO:tasks.workunit.client.0.smithi038.stdout:5/53: creat df/d13/f14 x:0 0 0 2024-09-13T18:30:26.855 INFO:tasks.workunit.client.1.smithi149.stdout:6/792: dwrite dc/d15/d54/fba [0,4194304] 0 2024-09-13T18:30:26.856 INFO:tasks.workunit.client.0.smithi038.stdout:6/83: write f5 [2092298,12172] 0 2024-09-13T18:30:26.856 INFO:tasks.workunit.client.1.smithi149.stdout:0/747: creat d1/d48/f101 x:0 0 0 2024-09-13T18:30:26.858 INFO:tasks.workunit.client.1.smithi149.stdout:3/703: sync 2024-09-13T18:30:26.858 INFO:tasks.workunit.client.1.smithi149.stdout:3/704: creat d1/d48/ddb/ff2 x:0 0 0 2024-09-13T18:30:26.858 INFO:tasks.workunit.client.1.smithi149.stdout:3/705: write d1/d2c/d56/fea [723922,104942] 0 2024-09-13T18:30:26.858 INFO:tasks.workunit.client.1.smithi149.stdout:9/579: mknod d0/d18/d27/d5c/d99/d9f/cba 0 2024-09-13T18:30:26.859 INFO:tasks.workunit.client.0.smithi038.stdout:4/153: symlink d2/df/d1b/d10/l30 0 2024-09-13T18:30:26.860 INFO:tasks.workunit.client.1.smithi149.stdout:8/702: dwrite d2/d13/fbe [0,4194304] 0 2024-09-13T18:30:26.860 INFO:tasks.workunit.client.1.smithi149.stdout:8/703: stat d2/d12/d2a/d4d/f83 0 2024-09-13T18:30:26.861 INFO:tasks.workunit.client.1.smithi149.stdout:7/818: mknod d7/d9/d1c/d2c/d60/dc9/c11f 0 2024-09-13T18:30:26.863 INFO:tasks.workunit.client.1.smithi149.stdout:2/631: dwrite db/d1b/d1c/d20/d3a/f2e [0,4194304] 0 2024-09-13T18:30:26.863 INFO:tasks.workunit.client.0.smithi038.stdout:0/42: creat d2/dc/f11 x:0 0 0 2024-09-13T18:30:26.864 INFO:tasks.workunit.client.1.smithi149.stdout:1/737: unlink d9/lf 0 2024-09-13T18:30:26.864 INFO:tasks.workunit.client.0.smithi038.stdout:7/76: dwrite db/d12/f18 [0,4194304] 0 2024-09-13T18:30:26.865 INFO:tasks.workunit.client.0.smithi038.stdout:8/185: mkdir d1/de/d21/d45 0 2024-09-13T18:30:26.866 INFO:tasks.workunit.client.1.smithi149.stdout:5/653: truncate d3/d10/d32/d54/f9e 2001537 0 2024-09-13T18:30:26.868 INFO:tasks.workunit.client.0.smithi038.stdout:9/52: mkdir d0/d7/d13 0 2024-09-13T18:30:26.868 INFO:tasks.workunit.client.0.smithi038.stdout:9/53: truncate d0/d7/fe 136849 0 2024-09-13T18:30:26.871 INFO:tasks.workunit.client.0.smithi038.stdout:5/54: chown f8 71694061 1 2024-09-13T18:30:26.874 INFO:tasks.workunit.client.0.smithi038.stdout:8/186: dread d1/d8/f2b [0,4194304] 0 2024-09-13T18:30:26.874 INFO:tasks.workunit.client.1.smithi149.stdout:8/704: dread d2/d13/fbe [0,4194304] 0 2024-09-13T18:30:26.874 INFO:tasks.workunit.client.1.smithi149.stdout:8/705: chown d2/d13/d3a/d7f/da8 9 1 2024-09-13T18:30:26.874 INFO:tasks.workunit.client.1.smithi149.stdout:8/706: chown d2/d52/c64 0 1 2024-09-13T18:30:26.875 INFO:tasks.workunit.client.1.smithi149.stdout:0/748: mkdir d1/d29/d31/d44/d81/d62/d102 0 2024-09-13T18:30:26.875 INFO:tasks.workunit.client.1.smithi149.stdout:0/749: dread - d1/d29/d31/d44/d81/d62/f77 zero size 2024-09-13T18:30:26.876 INFO:tasks.workunit.client.0.smithi038.stdout:4/154: symlink d2/df/d1b/d10/l31 0 2024-09-13T18:30:26.876 INFO:tasks.workunit.client.1.smithi149.stdout:9/580: dread d0/d18/d27/f8b [0,4194304] 0 2024-09-13T18:30:26.879 INFO:tasks.workunit.client.1.smithi149.stdout:3/706: creat d1/d2c/d42/ff3 x:0 0 0 2024-09-13T18:30:26.882 INFO:tasks.workunit.client.0.smithi038.stdout:7/77: creat db/d12/d1a/f1d x:0 0 0 2024-09-13T18:30:26.882 INFO:tasks.workunit.client.0.smithi038.stdout:7/78: dread - db/d12/d13/f17 zero size 2024-09-13T18:30:26.885 INFO:tasks.workunit.client.0.smithi038.stdout:0/43: read d2/f4 [3667002,109241] 0 2024-09-13T18:30:26.885 INFO:tasks.workunit.client.1.smithi149.stdout:4/746: dwrite df/da0/d12/d21/f8e [4194304,4194304] 0 2024-09-13T18:30:26.885 INFO:tasks.workunit.client.1.smithi149.stdout:4/747: fsync df/da0/d12/d21/d22/d30/d41/d57/fa6 0 2024-09-13T18:30:26.886 INFO:tasks.workunit.client.0.smithi038.stdout:9/54: symlink d0/d7/d13/l14 0 2024-09-13T18:30:26.886 INFO:tasks.workunit.client.0.smithi038.stdout:9/55: fdatasync d0/f4 0 2024-09-13T18:30:26.886 INFO:tasks.workunit.client.0.smithi038.stdout:5/55: dread - fd zero size 2024-09-13T18:30:26.886 INFO:tasks.workunit.client.0.smithi038.stdout:9/56: readlink d0/d7/d13/l14 0 2024-09-13T18:30:26.888 INFO:tasks.workunit.client.1.smithi149.stdout:1/738: creat d9/d10/d34/dbe/d38/fe2 x:0 0 0 2024-09-13T18:30:26.889 INFO:tasks.workunit.client.1.smithi149.stdout:5/654: read d3/d10/d32/f45 [329619,101033] 0 2024-09-13T18:30:26.889 INFO:tasks.workunit.client.1.smithi149.stdout:5/655: truncate d3/d10/d32/d54/f2a 5455759 0 2024-09-13T18:30:26.889 INFO:tasks.workunit.client.1.smithi149.stdout:5/656: stat d3/d10/cb7 0 2024-09-13T18:30:26.892 INFO:tasks.workunit.client.0.smithi038.stdout:4/155: dread d2/df/d22/f1d [0,4194304] 0 2024-09-13T18:30:26.892 INFO:tasks.workunit.client.0.smithi038.stdout:6/84: getdents dd 0 2024-09-13T18:30:26.899 INFO:tasks.workunit.client.1.smithi149.stdout:3/707: write d1/d2c/d38/d88/d96/fd8 [809523,48745] 0 2024-09-13T18:30:26.899 INFO:tasks.workunit.client.1.smithi149.stdout:0/750: creat d1/d29/d31/d44/f103 x:0 0 0 2024-09-13T18:30:26.899 INFO:tasks.workunit.client.1.smithi149.stdout:3/708: read d1/d21/f27 [1751285,114561] 0 2024-09-13T18:30:26.900 INFO:tasks.workunit.client.1.smithi149.stdout:3/709: fdatasync d1/d2e/f55 0 2024-09-13T18:30:26.900 INFO:tasks.workunit.client.1.smithi149.stdout:9/581: truncate d0/d2e/f71 2812347 0 2024-09-13T18:30:26.900 INFO:tasks.workunit.client.1.smithi149.stdout:8/707: dread d2/d12/f89 [0,4194304] 0 2024-09-13T18:30:26.902 INFO:tasks.workunit.client.0.smithi038.stdout:9/57: mknod d0/d7/c15 0 2024-09-13T18:30:26.903 INFO:tasks.workunit.client.0.smithi038.stdout:6/85: symlink dd/l20 0 2024-09-13T18:30:26.905 INFO:tasks.workunit.client.0.smithi038.stdout:4/156: dread d2/df/d22/dc/f1a [0,4194304] 0 2024-09-13T18:30:26.905 INFO:tasks.workunit.client.0.smithi038.stdout:4/157: rename d2/df to d2/df/d1b/d10/d32 22 2024-09-13T18:30:26.906 INFO:tasks.workunit.client.0.smithi038.stdout:5/56: getdents df/d13 0 2024-09-13T18:30:26.906 INFO:tasks.workunit.client.1.smithi149.stdout:6/793: dwrite dc/d15/f9e [0,4194304] 0 2024-09-13T18:30:26.909 INFO:tasks.workunit.client.1.smithi149.stdout:2/632: getdents db/d1b/d48 0 2024-09-13T18:30:26.910 INFO:tasks.workunit.client.0.smithi038.stdout:9/58: unlink d0/d7/fe 0 2024-09-13T18:30:26.911 INFO:tasks.workunit.client.0.smithi038.stdout:9/59: write d0/fb [1548083,122576] 0 2024-09-13T18:30:26.913 INFO:tasks.workunit.client.0.smithi038.stdout:6/86: mknod dd/de/c21 0 2024-09-13T18:30:26.913 INFO:tasks.workunit.client.0.smithi038.stdout:6/87: write dd/f16 [4655658,65545] 0 2024-09-13T18:30:26.913 INFO:tasks.workunit.client.0.smithi038.stdout:6/88: fdatasync f6 0 2024-09-13T18:30:26.913 INFO:tasks.workunit.client.0.smithi038.stdout:6/89: fsync dd/f11 0 2024-09-13T18:30:26.915 INFO:tasks.workunit.client.0.smithi038.stdout:5/57: mkdir df/d15 0 2024-09-13T18:30:26.916 INFO:tasks.workunit.client.1.smithi149.stdout:0/751: creat d1/d48/d92/db4/db5/f104 x:0 0 0 2024-09-13T18:30:26.916 INFO:tasks.workunit.client.1.smithi149.stdout:0/752: write d1/d2/d41/f94 [200388,96633] 0 2024-09-13T18:30:26.916 INFO:tasks.workunit.client.1.smithi149.stdout:0/753: read - d1/d2/fe4 zero size 2024-09-13T18:30:26.917 INFO:tasks.workunit.client.1.smithi149.stdout:3/710: rename d1/d2c/d38/cee to d1/d21/cf4 0 2024-09-13T18:30:26.918 INFO:tasks.workunit.client.0.smithi038.stdout:9/60: mknod d0/c16 0 2024-09-13T18:30:26.918 INFO:tasks.workunit.client.0.smithi038.stdout:8/187: dwrite d1/d4/f39 [0,4194304] 0 2024-09-13T18:30:26.919 INFO:tasks.workunit.client.1.smithi149.stdout:9/582: link d0/d2e/d42/l4d d0/d2e/d42/d70/lbb 0 2024-09-13T18:30:26.923 INFO:tasks.workunit.client.1.smithi149.stdout:8/708: truncate d2/d12/d40/f5e 1596001 0 2024-09-13T18:30:26.923 INFO:tasks.workunit.client.1.smithi149.stdout:4/748: getdents df/da0/d12/d21/d22/d30/d41/d57 0 2024-09-13T18:30:26.925 INFO:tasks.workunit.client.0.smithi038.stdout:4/158: write d2/df/d22/dc/d8/f27 [3282133,88387] 0 2024-09-13T18:30:26.925 INFO:tasks.workunit.client.0.smithi038.stdout:4/159: chown d2 30908487 1 2024-09-13T18:30:26.929 INFO:tasks.workunit.client.0.smithi038.stdout:9/61: creat d0/d7/d13/f17 x:0 0 0 2024-09-13T18:30:26.930 INFO:tasks.workunit.client.1.smithi149.stdout:2/633: mknod db/d10/d8d/cda 0 2024-09-13T18:30:26.931 INFO:tasks.workunit.client.1.smithi149.stdout:1/739: dwrite d9/d10/f1a [0,4194304] 0 2024-09-13T18:30:26.934 INFO:tasks.workunit.client.1.smithi149.stdout:0/754: creat d1/d2/d41/d46/f105 x:0 0 0 2024-09-13T18:30:26.936 INFO:tasks.workunit.client.0.smithi038.stdout:4/160: dread d2/df/d22/dc/f16 [4194304,4194304] 0 2024-09-13T18:30:26.936 INFO:tasks.workunit.client.0.smithi038.stdout:7/79: dwrite db/f10 [4194304,4194304] 0 2024-09-13T18:30:26.937 INFO:tasks.workunit.client.1.smithi149.stdout:3/711: rename d1/d48/c4a to d1/d2c/d38/d8d/cf5 0 2024-09-13T18:30:26.940 INFO:tasks.workunit.client.1.smithi149.stdout:9/583: mkdir d0/d18/d27/d5c/d7e/dbc 0 2024-09-13T18:30:26.941 INFO:tasks.workunit.client.1.smithi149.stdout:5/657: dwrite d3/d10/d32/d54/f2a [0,4194304] 0 2024-09-13T18:30:26.943 INFO:tasks.workunit.client.1.smithi149.stdout:8/709: truncate d2/d13/fad 652581 0 2024-09-13T18:30:26.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/794: dwrite dc/d15/f36 [0,4194304] 0 2024-09-13T18:30:26.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/795: chown dc/l4e 5 1 2024-09-13T18:30:26.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/796: chown dc/d15/d23/d57/da5/dd8 21868 1 2024-09-13T18:30:26.943 INFO:tasks.workunit.client.0.smithi038.stdout:9/62: dread d0/f8 [0,4194304] 0 2024-09-13T18:30:26.944 INFO:tasks.workunit.client.0.smithi038.stdout:8/188: dwrite d1/d4/fa [0,4194304] 0 2024-09-13T18:30:26.945 INFO:tasks.workunit.client.1.smithi149.stdout:2/634: rmdir db/d10/da9 39 2024-09-13T18:30:26.945 INFO:tasks.workunit.client.1.smithi149.stdout:2/635: dread - db/d1b/d1c/d20/d2b/fd8 zero size 2024-09-13T18:30:26.948 INFO:tasks.workunit.client.1.smithi149.stdout:0/755: link d1/d29/d31/d44/d81/d62/fea d1/d29/d31/d3e/f106 0 2024-09-13T18:30:26.948 INFO:tasks.workunit.client.0.smithi038.stdout:7/80: write db/f10 [5497397,126683] 0 2024-09-13T18:30:26.950 INFO:tasks.workunit.client.1.smithi149.stdout:4/749: rename df/da0/d70/db5/dc7/fcd to df/da0/d12/ffc 0 2024-09-13T18:30:26.953 INFO:tasks.workunit.client.1.smithi149.stdout:3/712: mkdir d1/d12/d20/ded/df6 0 2024-09-13T18:30:26.953 INFO:tasks.workunit.client.1.smithi149.stdout:9/584: write d0/f38 [5047185,29299] 0 2024-09-13T18:30:26.953 INFO:tasks.workunit.client.1.smithi149.stdout:9/585: stat d0/d18/f41 0 2024-09-13T18:30:26.954 INFO:tasks.workunit.client.1.smithi149.stdout:5/658: rmdir d3/d10/d32/d54/d76/d7a/da5 0 2024-09-13T18:30:26.956 INFO:tasks.workunit.client.1.smithi149.stdout:8/710: mkdir d2/dc4/df4 0 2024-09-13T18:30:26.957 INFO:tasks.workunit.client.1.smithi149.stdout:5/659: dread d3/f5c [0,4194304] 0 2024-09-13T18:30:26.960 INFO:tasks.workunit.client.0.smithi038.stdout:6/90: getdents dd/de 0 2024-09-13T18:30:26.967 INFO:tasks.workunit.client.0.smithi038.stdout:9/63: creat d0/d7/d13/f18 x:0 0 0 2024-09-13T18:30:26.967 INFO:tasks.workunit.client.0.smithi038.stdout:9/64: chown d0/d7/d13/f18 2 1 2024-09-13T18:30:26.967 INFO:tasks.workunit.client.0.smithi038.stdout:9/65: creat d0/d7/d13/f19 x:0 0 0 2024-09-13T18:30:26.968 INFO:tasks.workunit.client.0.smithi038.stdout:8/189: write d1/d4/f39 [1893514,38062] 0 2024-09-13T18:30:26.968 INFO:tasks.workunit.client.0.smithi038.stdout:8/190: dread - d1/de/f23 zero size 2024-09-13T18:30:26.968 INFO:tasks.workunit.client.0.smithi038.stdout:8/191: stat d1/fc 0 2024-09-13T18:30:26.969 INFO:tasks.workunit.client.1.smithi149.stdout:6/797: mknod dc/d2f/d75/da1/dcb/cfa 0 2024-09-13T18:30:26.970 INFO:tasks.workunit.client.0.smithi038.stdout:7/81: symlink db/d12/d1c/l1e 0 2024-09-13T18:30:26.970 INFO:tasks.workunit.client.0.smithi038.stdout:7/82: chown c3 62699515 1 2024-09-13T18:30:26.970 INFO:tasks.workunit.client.0.smithi038.stdout:7/83: creat db/d12/d1a/f1f x:0 0 0 2024-09-13T18:30:26.971 INFO:tasks.workunit.client.1.smithi149.stdout:0/756: creat d1/d1b/f107 x:0 0 0 2024-09-13T18:30:26.973 INFO:tasks.workunit.client.0.smithi038.stdout:6/91: creat dd/d1c/f22 x:0 0 0 2024-09-13T18:30:26.973 INFO:tasks.workunit.client.0.smithi038.stdout:6/92: fdatasync f6 0 2024-09-13T18:30:26.975 INFO:tasks.workunit.client.1.smithi149.stdout:1/740: rename d9/d15/d73/cd6 to d9/d15/d25/ce3 0 2024-09-13T18:30:26.977 INFO:tasks.workunit.client.1.smithi149.stdout:4/750: symlink df/da0/d12/d7c/d9a/lfd 0 2024-09-13T18:30:26.977 INFO:tasks.workunit.client.1.smithi149.stdout:4/751: write df/da0/f80 [422092,62000] 0 2024-09-13T18:30:26.979 INFO:tasks.workunit.client.1.smithi149.stdout:3/713: rmdir d1/d2e/d1d 39 2024-09-13T18:30:26.982 INFO:tasks.workunit.client.1.smithi149.stdout:8/711: symlink d2/d5b/d88/lf5 0 2024-09-13T18:30:26.983 INFO:tasks.workunit.client.0.smithi038.stdout:4/161: dwrite d2/df/d22/dc/d8/f12 [4194304,4194304] 0 2024-09-13T18:30:26.983 INFO:tasks.workunit.client.1.smithi149.stdout:0/757: mkdir d1/d29/d31/d3e/d108 0 2024-09-13T18:30:26.984 INFO:tasks.workunit.client.0.smithi038.stdout:7/84: truncate db/d12/f18 2197648 0 2024-09-13T18:30:26.986 INFO:tasks.workunit.client.1.smithi149.stdout:2/636: rename db/d1b/d2f/db2 to db/d10/da9/ddb 0 2024-09-13T18:30:26.986 INFO:tasks.workunit.client.1.smithi149.stdout:2/637: truncate db/d10/f1a 4815647 0 2024-09-13T18:30:26.986 INFO:tasks.workunit.client.1.smithi149.stdout:2/638: readlink db/d1b/d1c/d20/d2b/la8 0 2024-09-13T18:30:26.986 INFO:tasks.workunit.client.1.smithi149.stdout:2/639: chown db/d1b/fd3 1119 1 2024-09-13T18:30:26.987 INFO:tasks.workunit.client.0.smithi038.stdout:8/192: write d1/d8/f19 [796985,4382] 0 2024-09-13T18:30:26.987 INFO:tasks.workunit.client.0.smithi038.stdout:8/193: chown d1/d8/f1f 14288 1 2024-09-13T18:30:26.988 INFO:tasks.workunit.client.1.smithi149.stdout:6/798: dread dc/f22 [0,4194304] 0 2024-09-13T18:30:26.988 INFO:tasks.workunit.client.1.smithi149.stdout:1/741: dread d9/d10/d34/d53/d57/f64 [0,4194304] 0 2024-09-13T18:30:26.988 INFO:tasks.workunit.client.0.smithi038.stdout:6/93: link dd/l20 dd/l23 0 2024-09-13T18:30:26.990 INFO:tasks.workunit.client.1.smithi149.stdout:3/714: link d1/d2e/f14 d1/d2c/d42/ff7 0 2024-09-13T18:30:26.991 INFO:tasks.workunit.client.1.smithi149.stdout:4/752: dread df/da0/d12/d17/faf [0,4194304] 0 2024-09-13T18:30:26.992 INFO:tasks.workunit.client.1.smithi149.stdout:7/819: sync 2024-09-13T18:30:26.993 INFO:tasks.workunit.client.0.smithi038.stdout:4/162: truncate d2/df/d22/dc/f1e 793107 0 2024-09-13T18:30:26.994 INFO:tasks.workunit.client.1.smithi149.stdout:4/753: read df/da0/d12/d17/d3d/f6c [8766920,85308] 0 2024-09-13T18:30:26.995 INFO:tasks.workunit.client.1.smithi149.stdout:8/712: rename d2/d12/db8 to d2/d12/dd8/d66/ded/df6 0 2024-09-13T18:30:26.995 INFO:tasks.workunit.client.1.smithi149.stdout:9/586: dwrite d0/d2e/d42/d59/d86/f9b [0,4194304] 0 2024-09-13T18:30:26.997 INFO:tasks.workunit.client.0.smithi038.stdout:7/85: creat db/d12/d1c/f20 x:0 0 0 2024-09-13T18:30:26.997 INFO:tasks.workunit.client.0.smithi038.stdout:7/86: dread - db/d12/d1a/f1f zero size 2024-09-13T18:30:26.997 INFO:tasks.workunit.client.0.smithi038.stdout:7/87: chown f5 11 1 2024-09-13T18:30:26.997 INFO:tasks.workunit.client.0.smithi038.stdout:7/88: write db/d12/d13/f1b [595404,86197] 0 2024-09-13T18:30:26.998 INFO:tasks.workunit.client.1.smithi149.stdout:5/660: dwrite d3/d10/d4c/f81 [0,4194304] 0 2024-09-13T18:30:26.998 INFO:tasks.workunit.client.1.smithi149.stdout:5/661: chown d3/d10/d32/d54/c74 5 1 2024-09-13T18:30:26.998 INFO:tasks.workunit.client.1.smithi149.stdout:5/662: dread - d3/d10/d4c/db8/fc2 zero size 2024-09-13T18:30:26.999 INFO:tasks.workunit.client.0.smithi038.stdout:6/94: symlink dd/l24 0 2024-09-13T18:30:27.000 INFO:tasks.workunit.client.0.smithi038.stdout:6/95: dread - dd/de/f1a zero size 2024-09-13T18:30:27.002 INFO:tasks.workunit.client.1.smithi149.stdout:1/742: mkdir d9/d10/de4 0 2024-09-13T18:30:27.002 INFO:tasks.workunit.client.0.smithi038.stdout:9/66: dwrite d0/f1 [0,4194304] 0 2024-09-13T18:30:27.002 INFO:tasks.workunit.client.0.smithi038.stdout:8/194: dread d1/d8/f1f [0,4194304] 0 2024-09-13T18:30:27.002 INFO:tasks.workunit.client.0.smithi038.stdout:7/89: mkdir db/d21 0 2024-09-13T18:30:27.004 INFO:tasks.workunit.client.1.smithi149.stdout:6/799: symlink dc/d70/dc7/lfb 0 2024-09-13T18:30:27.004 INFO:tasks.workunit.client.1.smithi149.stdout:6/800: creat dc/d15/d23/d57/da5/dd8/ffc x:0 0 0 2024-09-13T18:30:27.005 INFO:tasks.workunit.client.0.smithi038.stdout:6/96: symlink dd/de/l25 0 2024-09-13T18:30:27.006 INFO:tasks.workunit.client.1.smithi149.stdout:3/715: creat d1/d48/ff8 x:0 0 0 2024-09-13T18:30:27.006 INFO:tasks.workunit.client.1.smithi149.stdout:3/716: chown d1/d47 415995 1 2024-09-13T18:30:27.008 INFO:tasks.workunit.client.0.smithi038.stdout:9/67: rename d0/d7/lc to d0/d7/d13/l1a 0 2024-09-13T18:30:27.009 INFO:tasks.workunit.client.1.smithi149.stdout:0/758: rmdir d1/d29/d31/d83/d87 39 2024-09-13T18:30:27.013 INFO:tasks.workunit.client.1.smithi149.stdout:7/820: symlink d7/d9/d11/de2/l120 0 2024-09-13T18:30:27.015 INFO:tasks.workunit.client.0.smithi038.stdout:8/195: getdents d1/d2a 0 2024-09-13T18:30:27.017 INFO:tasks.workunit.client.1.smithi149.stdout:4/754: rmdir df/da0/d12/d17 39 2024-09-13T18:30:27.019 INFO:tasks.workunit.client.0.smithi038.stdout:8/196: link d1/d4/c35 d1/de/d21/c46 0 2024-09-13T18:30:27.021 INFO:tasks.workunit.client.0.smithi038.stdout:4/163: read d2/f19 [556648,83086] 0 2024-09-13T18:30:27.021 INFO:tasks.workunit.client.0.smithi038.stdout:4/164: creat d2/f33 x:0 0 0 2024-09-13T18:30:27.021 INFO:tasks.workunit.client.0.smithi038.stdout:4/165: chown d2/df/d22/dc/f1e 1893564074 1 2024-09-13T18:30:27.021 INFO:tasks.workunit.client.0.smithi038.stdout:4/166: write d2/f19 [765654,30773] 0 2024-09-13T18:30:27.022 INFO:tasks.workunit.client.0.smithi038.stdout:8/197: getdents d1/de/d15 0 2024-09-13T18:30:27.023 INFO:tasks.workunit.client.1.smithi149.stdout:8/713: mknod d2/d13/d6d/cf7 0 2024-09-13T18:30:27.025 INFO:tasks.workunit.client.0.smithi038.stdout:6/97: dread dd/f11 [0,4194304] 0 2024-09-13T18:30:27.025 INFO:tasks.workunit.client.1.smithi149.stdout:2/640: mkdir db/d13/ddc 0 2024-09-13T18:30:27.026 INFO:tasks.workunit.client.1.smithi149.stdout:2/641: fsync db/d1b/d1c/d20/fd6 0 2024-09-13T18:30:27.026 INFO:tasks.workunit.client.1.smithi149.stdout:5/663: dwrite d3/d10/d32/d67/f86 [0,4194304] 0 2024-09-13T18:30:27.026 INFO:tasks.workunit.client.1.smithi149.stdout:5/664: write d3/d8/fe [247289,93913] 0 2024-09-13T18:30:27.026 INFO:tasks.workunit.client.0.smithi038.stdout:4/167: truncate d2/df/d22/f1d 3725052 0 2024-09-13T18:30:27.026 INFO:tasks.workunit.client.0.smithi038.stdout:4/168: write d2/df/d22/dc/d8/f23 [1039263,113705] 0 2024-09-13T18:30:27.028 INFO:tasks.workunit.client.0.smithi038.stdout:8/198: rename d1/de/d3a/f43 to d1/d4/f47 0 2024-09-13T18:30:27.028 INFO:tasks.workunit.client.0.smithi038.stdout:8/199: dread - d1/f3 zero size 2024-09-13T18:30:27.029 INFO:tasks.workunit.client.0.smithi038.stdout:6/98: link dd/f13 dd/f26 0 2024-09-13T18:30:27.031 INFO:tasks.workunit.client.0.smithi038.stdout:6/99: write dd/f26 [4886643,108960] 0 2024-09-13T18:30:27.031 INFO:tasks.workunit.client.0.smithi038.stdout:6/100: chown dd/l24 24676 1 2024-09-13T18:30:27.032 INFO:tasks.workunit.client.1.smithi149.stdout:1/743: rmdir d9/d10/d62 39 2024-09-13T18:30:27.032 INFO:tasks.workunit.client.1.smithi149.stdout:1/744: getdents d9/d10/d34/dbe/dd7 0 2024-09-13T18:30:27.034 INFO:tasks.workunit.client.0.smithi038.stdout:8/200: link d1/ff d1/de/d21/d24/d41/f48 0 2024-09-13T18:30:27.034 INFO:tasks.workunit.client.0.smithi038.stdout:8/201: dread - d1/de/d15/d30/f3c zero size 2024-09-13T18:30:27.039 INFO:tasks.workunit.client.0.smithi038.stdout:6/101: mkdir dd/d1c/d27 0 2024-09-13T18:30:27.041 INFO:tasks.workunit.client.0.smithi038.stdout:8/202: mknod d1/d2a/c49 0 2024-09-13T18:30:27.048 INFO:tasks.workunit.client.1.smithi149.stdout:5/665: dread d3/d10/d32/d67/d83/f8a [0,4194304] 0 2024-09-13T18:30:27.050 INFO:tasks.workunit.client.0.smithi038.stdout:6/102: mknod dd/d1c/d27/c28 0 2024-09-13T18:30:27.050 INFO:tasks.workunit.client.0.smithi038.stdout:6/103: creat dd/d1c/f29 x:0 0 0 2024-09-13T18:30:27.050 INFO:tasks.workunit.client.1.smithi149.stdout:6/801: symlink dc/d15/d23/d57/d5c/lfd 0 2024-09-13T18:30:27.051 INFO:tasks.workunit.client.1.smithi149.stdout:3/717: mkdir d1/d47/df9 0 2024-09-13T18:30:27.054 INFO:tasks.workunit.client.1.smithi149.stdout:4/755: rename df/da0/d1c/d69/ccf to df/da0/d12/d21/d22/d30/d41/d57/d60/cfe 0 2024-09-13T18:30:27.055 INFO:tasks.workunit.client.1.smithi149.stdout:8/714: truncate d2/d12/f7c 190257 0 2024-09-13T18:30:27.058 INFO:tasks.workunit.client.0.smithi038.stdout:9/68: dwrite d0/d7/d13/f18 [0,4194304] 0 2024-09-13T18:30:27.063 INFO:tasks.workunit.client.1.smithi149.stdout:5/666: creat d3/d10/d4c/fd3 x:0 0 0 2024-09-13T18:30:27.063 INFO:tasks.workunit.client.1.smithi149.stdout:5/667: write d3/d10/d32/f40 [1753890,90923] 0 2024-09-13T18:30:27.063 INFO:tasks.workunit.client.1.smithi149.stdout:5/668: dread - d3/d10/d4c/d4e/fc4 zero size 2024-09-13T18:30:27.063 INFO:tasks.workunit.client.1.smithi149.stdout:5/669: chown d3/d10/d32/d67/d83 2 1 2024-09-13T18:30:27.063 INFO:tasks.workunit.client.1.smithi149.stdout:0/759: dwrite d1/d2/fd [0,4194304] 0 2024-09-13T18:30:27.063 INFO:tasks.workunit.client.1.smithi149.stdout:0/760: fdatasync d1/d29/d31/d83/d87/fc1 0 2024-09-13T18:30:27.065 INFO:tasks.workunit.client.0.smithi038.stdout:7/90: dwrite db/d12/d1a/f1f [0,4194304] 0 2024-09-13T18:30:27.065 INFO:tasks.workunit.client.1.smithi149.stdout:3/718: mkdir d1/d2e/d1d/d9a/dfa 0 2024-09-13T18:30:27.065 INFO:tasks.workunit.client.1.smithi149.stdout:3/719: truncate d1/d21/fe7 849124 0 2024-09-13T18:30:27.067 INFO:tasks.workunit.client.1.smithi149.stdout:6/802: read dc/f5a [2867094,121742] 0 2024-09-13T18:30:27.067 INFO:tasks.workunit.client.1.smithi149.stdout:6/803: dread - dc/d2f/d75/da1/fc8 zero size 2024-09-13T18:30:27.067 INFO:tasks.workunit.client.1.smithi149.stdout:6/804: truncate dc/d15/d23/d5f/fc9 5008280 0 2024-09-13T18:30:27.067 INFO:tasks.workunit.client.1.smithi149.stdout:7/821: dwrite d7/f6b [0,4194304] 0 2024-09-13T18:30:27.067 INFO:tasks.workunit.client.1.smithi149.stdout:7/822: chown d7/d9/d11/d50/fb0 1039518 1 2024-09-13T18:30:27.068 INFO:tasks.workunit.client.0.smithi038.stdout:8/203: dwrite d1/d8/f2b [0,4194304] 0 2024-09-13T18:30:27.069 INFO:tasks.workunit.client.1.smithi149.stdout:2/642: rename db/d1b/d1c/d20/d3a/f2e to db/d1b/d2f/fdd 0 2024-09-13T18:30:27.069 INFO:tasks.workunit.client.1.smithi149.stdout:2/643: chown f6 90846 1 2024-09-13T18:30:27.072 INFO:tasks.workunit.client.1.smithi149.stdout:4/756: creat df/da0/d12/d17/fff x:0 0 0 2024-09-13T18:30:27.072 INFO:tasks.workunit.client.1.smithi149.stdout:4/757: chown df/l28 6382 1 2024-09-13T18:30:27.072 INFO:tasks.workunit.client.1.smithi149.stdout:4/758: fsync df/da0/d12/ff8 0 2024-09-13T18:30:27.072 INFO:tasks.workunit.client.1.smithi149.stdout:4/759: creat df/da0/d70/db5/db9/f100 x:0 0 0 2024-09-13T18:30:27.072 INFO:tasks.workunit.client.0.smithi038.stdout:9/69: mknod d0/d7/c1b 0 2024-09-13T18:30:27.075 INFO:tasks.workunit.client.1.smithi149.stdout:8/715: creat d2/d12/dd8/d58/d97/db6/ff8 x:0 0 0 2024-09-13T18:30:27.078 INFO:tasks.workunit.client.0.smithi038.stdout:6/104: getdents dd/d1c/d27 0 2024-09-13T18:30:27.079 INFO:tasks.workunit.client.1.smithi149.stdout:0/761: symlink d1/d2/d4e/l109 0 2024-09-13T18:30:27.081 INFO:tasks.workunit.client.0.smithi038.stdout:4/169: dwrite d2/df/d22/dc/d8/f23 [0,4194304] 0 2024-09-13T18:30:27.082 INFO:tasks.workunit.client.1.smithi149.stdout:3/720: mkdir d1/d2e/d1d/d6c/daa/dfb 0 2024-09-13T18:30:27.085 INFO:tasks.workunit.client.1.smithi149.stdout:2/644: read db/d10/f1a [3268183,53438] 0 2024-09-13T18:30:27.085 INFO:tasks.workunit.client.1.smithi149.stdout:2/645: chown db/d1b/d1c/d20/d3a/d75/f83 273235 1 2024-09-13T18:30:27.085 INFO:tasks.workunit.client.1.smithi149.stdout:2/646: write db/d1b/d2f/f52 [2944229,114831] 0 2024-09-13T18:30:27.088 INFO:tasks.workunit.client.1.smithi149.stdout:8/716: link d2/d12/c3e d2/d13/d6d/cf9 0 2024-09-13T18:30:27.089 INFO:tasks.workunit.client.1.smithi149.stdout:8/717: write d2/d13/f85 [241191,78004] 0 2024-09-13T18:30:27.089 INFO:tasks.workunit.client.1.smithi149.stdout:8/718: chown d2/d12/dd8/f8f 788 1 2024-09-13T18:30:27.090 INFO:tasks.workunit.client.1.smithi149.stdout:0/762: link d1/d29/d31/d44/d81/d62/fd3 d1/d29/dad/f10a 0 2024-09-13T18:30:27.091 INFO:tasks.workunit.client.0.smithi038.stdout:7/91: mkdir db/d12/d1a/d22 0 2024-09-13T18:30:27.091 INFO:tasks.workunit.client.0.smithi038.stdout:7/92: write db/d12/d13/f1b [1376391,120698] 0 2024-09-13T18:30:27.097 INFO:tasks.workunit.client.1.smithi149.stdout:5/670: dwrite d3/d10/d32/d54/d97/dba/fc9 [0,4194304] 0 2024-09-13T18:30:27.097 INFO:tasks.workunit.client.1.smithi149.stdout:5/671: write d3/f5c [956915,99524] 0 2024-09-13T18:30:27.097 INFO:tasks.workunit.client.1.smithi149.stdout:5/672: chown d3/d10/d4c/d4e/d61/d63/c99 28 1 2024-09-13T18:30:27.099 INFO:tasks.workunit.client.1.smithi149.stdout:3/721: mknod d1/d2e/d6f/daf/cfc 0 2024-09-13T18:30:27.099 INFO:tasks.workunit.client.1.smithi149.stdout:2/647: read db/d13/d70/f7c [62199,121905] 0 2024-09-13T18:30:27.099 INFO:tasks.workunit.client.1.smithi149.stdout:6/805: dwrite dc/d15/d23/d5b/d91/fb2 [0,4194304] 0 2024-09-13T18:30:27.100 INFO:tasks.workunit.client.1.smithi149.stdout:6/806: creat dc/d15/d54/da9/ffe x:0 0 0 2024-09-13T18:30:27.100 INFO:tasks.workunit.client.0.smithi038.stdout:8/204: mknod d1/c4a 0 2024-09-13T18:30:27.101 INFO:tasks.workunit.client.0.smithi038.stdout:6/105: dwrite f9 [0,4194304] 0 2024-09-13T18:30:27.105 INFO:tasks.workunit.client.1.smithi149.stdout:7/823: mknod d7/d9/d1c/d51/c121 0 2024-09-13T18:30:27.105 INFO:tasks.workunit.client.0.smithi038.stdout:4/170: symlink d2/df/d1b/d10/l34 0 2024-09-13T18:30:27.106 INFO:tasks.workunit.client.1.smithi149.stdout:8/719: symlink d2/d13/d6d/lfa 0 2024-09-13T18:30:27.107 INFO:tasks.workunit.client.0.smithi038.stdout:9/70: dread d0/fb [0,4194304] 0 2024-09-13T18:30:27.110 INFO:tasks.workunit.client.1.smithi149.stdout:5/673: dread d3/d10/d32/f40 [0,4194304] 0 2024-09-13T18:30:27.110 INFO:tasks.workunit.client.1.smithi149.stdout:5/674: stat d3/d10/d4c/d4e/da4/fa6 0 2024-09-13T18:30:27.110 INFO:tasks.workunit.client.1.smithi149.stdout:5/675: write d3/d10/d32/f2e [165129,40069] 0 2024-09-13T18:30:27.110 INFO:tasks.workunit.client.1.smithi149.stdout:5/676: chown d3/d10/d32/d54 60 1 2024-09-13T18:30:27.111 INFO:tasks.workunit.client.0.smithi038.stdout:8/205: mknod d1/de/d15/d30/c4b 0 2024-09-13T18:30:27.111 INFO:tasks.workunit.client.0.smithi038.stdout:8/206: chown d1/d4 26 1 2024-09-13T18:30:27.114 INFO:tasks.workunit.client.0.smithi038.stdout:6/106: creat dd/f2a x:0 0 0 2024-09-13T18:30:27.114 INFO:tasks.workunit.client.0.smithi038.stdout:6/107: fsync f1 0 2024-09-13T18:30:27.114 INFO:tasks.workunit.client.0.smithi038.stdout:6/108: truncate dd/d1c/f22 253760 0 2024-09-13T18:30:27.115 INFO:tasks.workunit.client.0.smithi038.stdout:9/71: dread - d0/f11 zero size 2024-09-13T18:30:27.118 INFO:tasks.workunit.client.0.smithi038.stdout:7/93: getdents db/d12 0 2024-09-13T18:30:27.121 INFO:tasks.workunit.client.1.smithi149.stdout:7/824: dread f5 [0,4194304] 0 2024-09-13T18:30:27.121 INFO:tasks.workunit.client.1.smithi149.stdout:7/825: readlink l2 0 2024-09-13T18:30:27.125 INFO:tasks.workunit.client.0.smithi038.stdout:6/109: symlink dd/d1c/l2b 0 2024-09-13T18:30:27.127 INFO:tasks.workunit.client.1.smithi149.stdout:2/648: dwrite db/d1b/d48/f74 [0,4194304] 0 2024-09-13T18:30:27.129 INFO:tasks.workunit.client.1.smithi149.stdout:0/763: getdents d1/d2/d8a 0 2024-09-13T18:30:27.129 INFO:tasks.workunit.client.1.smithi149.stdout:0/764: readlink d1/l9 0 2024-09-13T18:30:27.129 INFO:tasks.workunit.client.1.smithi149.stdout:0/765: write d1/f42 [1673798,18918] 0 2024-09-13T18:30:27.131 INFO:tasks.workunit.client.0.smithi038.stdout:7/94: creat db/d12/d1a/d22/f23 x:0 0 0 2024-09-13T18:30:27.131 INFO:tasks.workunit.client.1.smithi149.stdout:6/807: dwrite dc/d8c/fc2 [0,4194304] 0 2024-09-13T18:30:27.134 INFO:tasks.workunit.client.0.smithi038.stdout:8/207: getdents d1/de/d21/d24/d41 0 2024-09-13T18:30:27.136 INFO:tasks.workunit.client.1.smithi149.stdout:5/677: rmdir d3/d10/d32/d54/dbd 39 2024-09-13T18:30:27.138 INFO:tasks.workunit.client.1.smithi149.stdout:8/720: dwrite d2/d13/d3a/d7f/fdc [0,4194304] 0 2024-09-13T18:30:27.138 INFO:tasks.workunit.client.1.smithi149.stdout:8/721: write d2/d13/f81 [422242,106453] 0 2024-09-13T18:30:27.138 INFO:tasks.workunit.client.0.smithi038.stdout:6/110: creat dd/de/f2c x:0 0 0 2024-09-13T18:30:27.138 INFO:tasks.workunit.client.0.smithi038.stdout:4/171: dwrite d2/df/d22/dc/d8/f27 [0,4194304] 0 2024-09-13T18:30:27.138 INFO:tasks.workunit.client.0.smithi038.stdout:4/172: truncate d2/df/d22/f29 1214048 0 2024-09-13T18:30:27.140 INFO:tasks.workunit.client.0.smithi038.stdout:4/173: dread d2/f19 [0,4194304] 0 2024-09-13T18:30:27.141 INFO:tasks.workunit.client.1.smithi149.stdout:7/826: mkdir d7/d9/d1c/d1f/d21/d49/d122 0 2024-09-13T18:30:27.141 INFO:tasks.workunit.client.0.smithi038.stdout:9/72: symlink d0/l1c 0 2024-09-13T18:30:27.143 INFO:tasks.workunit.client.0.smithi038.stdout:7/95: symlink db/d12/l24 0 2024-09-13T18:30:27.145 INFO:tasks.workunit.client.1.smithi149.stdout:2/649: rename db/d1b/fba to db/d1b/d1c/d85/fde 0 2024-09-13T18:30:27.147 INFO:tasks.workunit.client.1.smithi149.stdout:7/827: dread d7/d9/d1c/d1f/d21/d7b/d96/d9e/f113 [0,4194304] 0 2024-09-13T18:30:27.148 INFO:tasks.workunit.client.1.smithi149.stdout:0/766: mkdir d1/d2/d41/d46/d7b/d10b 0 2024-09-13T18:30:27.148 INFO:tasks.workunit.client.0.smithi038.stdout:4/174: write d2/df/d22/dc/d8/f2e [1464291,27659] 0 2024-09-13T18:30:27.149 INFO:tasks.workunit.client.0.smithi038.stdout:6/111: creat dd/d1c/d27/f2d x:0 0 0 2024-09-13T18:30:27.149 INFO:tasks.workunit.client.0.smithi038.stdout:6/112: readlink dd/d1c/l2b 0 2024-09-13T18:30:27.149 INFO:tasks.workunit.client.0.smithi038.stdout:6/113: chown c8 11317 1 2024-09-13T18:30:27.150 INFO:tasks.workunit.client.0.smithi038.stdout:9/73: mknod d0/d7/c1d 0 2024-09-13T18:30:27.152 INFO:tasks.workunit.client.1.smithi149.stdout:6/808: mkdir dc/d15/d54/d5e/df7/dff 0 2024-09-13T18:30:27.153 INFO:tasks.workunit.client.0.smithi038.stdout:7/96: mknod db/d12/d1a/d22/c25 0 2024-09-13T18:30:27.153 INFO:tasks.workunit.client.0.smithi038.stdout:7/97: dread - db/d12/d1a/f1d zero size 2024-09-13T18:30:27.153 INFO:tasks.workunit.client.0.smithi038.stdout:7/98: truncate db/d12/d13/f17 90417 0 2024-09-13T18:30:27.153 INFO:tasks.workunit.client.0.smithi038.stdout:7/99: dread - db/fc zero size 2024-09-13T18:30:27.153 INFO:tasks.workunit.client.0.smithi038.stdout:7/100: read db/d12/d13/f17 [68634,13073] 0 2024-09-13T18:30:27.154 INFO:tasks.workunit.client.1.smithi149.stdout:6/809: dread dc/d15/d23/fb6 [0,4194304] 0 2024-09-13T18:30:27.155 INFO:tasks.workunit.client.0.smithi038.stdout:4/175: write d2/df/d22/dc/f1a [2176337,33444] 0 2024-09-13T18:30:27.155 INFO:tasks.workunit.client.0.smithi038.stdout:4/176: chown d2/f19 101476480 1 2024-09-13T18:30:27.156 INFO:tasks.workunit.client.1.smithi149.stdout:5/678: link d3/d10/fa7 d3/d10/d4c/db8/fd4 0 2024-09-13T18:30:27.161 INFO:tasks.workunit.client.0.smithi038.stdout:6/114: mkdir dd/de/d2e 0 2024-09-13T18:30:27.165 INFO:tasks.workunit.client.1.smithi149.stdout:8/722: link d2/d13/f50 d2/d12/dd8/d58/d97/db6/ffb 0 2024-09-13T18:30:27.169 INFO:tasks.workunit.client.1.smithi149.stdout:2/650: fdatasync db/d1b/d2f/d30/fc0 0 2024-09-13T18:30:27.169 INFO:tasks.workunit.client.1.smithi149.stdout:2/651: write db/d10/f4e [273971,94051] 0 2024-09-13T18:30:27.170 INFO:tasks.workunit.client.1.smithi149.stdout:7/828: fdatasync d7/d9/f1d 0 2024-09-13T18:30:27.170 INFO:tasks.workunit.client.1.smithi149.stdout:7/829: write d7/d9/d1b/d71/ddc/f118 [231815,115912] 0 2024-09-13T18:30:27.175 INFO:tasks.workunit.client.1.smithi149.stdout:6/810: mknod dc/d15/d54/d85/c100 0 2024-09-13T18:30:27.176 INFO:tasks.workunit.client.0.smithi038.stdout:7/101: mkdir db/d12/d1a/d26 0 2024-09-13T18:30:27.176 INFO:tasks.workunit.client.0.smithi038.stdout:7/102: write db/d12/d1c/f20 [839614,2860] 0 2024-09-13T18:30:27.176 INFO:tasks.workunit.client.1.smithi149.stdout:9/587: sync 2024-09-13T18:30:27.176 INFO:tasks.workunit.client.1.smithi149.stdout:9/588: stat d0/d9e/c2f 0 2024-09-13T18:30:27.176 INFO:tasks.workunit.client.1.smithi149.stdout:1/745: sync 2024-09-13T18:30:27.177 INFO:tasks.workunit.client.0.smithi038.stdout:8/208: rename d1/de/d21/d24/d25 to d1/de/d4c 0 2024-09-13T18:30:27.179 INFO:tasks.workunit.client.0.smithi038.stdout:6/115: dwrite f6 [0,4194304] 0 2024-09-13T18:30:27.180 INFO:tasks.workunit.client.0.smithi038.stdout:4/177: symlink d2/df/l35 0 2024-09-13T18:30:27.180 INFO:tasks.workunit.client.0.smithi038.stdout:4/178: chown d2/df/d22/l1f 0 1 2024-09-13T18:30:27.181 INFO:tasks.workunit.client.1.smithi149.stdout:7/830: mknod d7/d9/d1b/d71/ddc/d53/daa/c123 0 2024-09-13T18:30:27.182 INFO:tasks.workunit.client.0.smithi038.stdout:9/74: rename d0/d7/fa to d0/d7/d13/f1e 0 2024-09-13T18:30:27.182 INFO:tasks.workunit.client.0.smithi038.stdout:9/75: dread - d0/d7/d13/f19 zero size 2024-09-13T18:30:27.201 INFO:tasks.workunit.client.0.smithi038.stdout:4/179: write d2/df/d22/dc/d8/f23 [218712,21820] 0 2024-09-13T18:30:27.207 INFO:tasks.workunit.client.1.smithi149.stdout:7/831: dwrite d7/d9/d11/d50/dde/df7/dae/ff8 [0,4194304] 0 2024-09-13T18:30:27.207 INFO:tasks.workunit.client.0.smithi038.stdout:8/209: dwrite d1/d4/f39 [0,4194304] 0 2024-09-13T18:30:27.214 INFO:tasks.workunit.client.0.smithi038.stdout:8/210: write d1/d4/fa [3068608,89065] 0 2024-09-13T18:30:27.235 INFO:tasks.workunit.client.0.smithi038.stdout:6/116: mkdir dd/de/d2e/d2f 0 2024-09-13T18:30:27.236 INFO:tasks.workunit.client.1.smithi149.stdout:6/811: mknod dc/c101 0 2024-09-13T18:30:27.237 INFO:tasks.workunit.client.1.smithi149.stdout:9/589: link d0/l1f d0/d18/d27/d5c/d7e/lbd 0 2024-09-13T18:30:27.238 INFO:tasks.workunit.client.1.smithi149.stdout:1/746: creat d9/d15/d40/fe5 x:0 0 0 2024-09-13T18:30:27.239 INFO:tasks.workunit.client.0.smithi038.stdout:4/180: symlink d2/df/d22/dc/l36 0 2024-09-13T18:30:27.242 INFO:tasks.workunit.client.1.smithi149.stdout:0/767: rename d1/d29/d31/d3e/d54 to d1/d48/d92/d10c 0 2024-09-13T18:30:27.243 INFO:tasks.workunit.client.1.smithi149.stdout:6/812: truncate dc/d15/d23/d57/da5/fd0 1814898 0 2024-09-13T18:30:27.244 INFO:tasks.workunit.client.1.smithi149.stdout:9/590: dread d0/d2e/d42/d59/f69 [0,4194304] 0 2024-09-13T18:30:27.244 INFO:tasks.workunit.client.1.smithi149.stdout:9/591: creat d0/d18/d27/d5c/d79/fbe x:0 0 0 2024-09-13T18:30:27.244 INFO:tasks.workunit.client.1.smithi149.stdout:9/592: stat d0/f67 0 2024-09-13T18:30:27.247 INFO:tasks.workunit.client.1.smithi149.stdout:0/768: creat d1/d29/d31/d44/d47/dfb/f10d x:0 0 0 2024-09-13T18:30:27.247 INFO:tasks.workunit.client.0.smithi038.stdout:8/211: mkdir d1/de/d21/d24/d4d 0 2024-09-13T18:30:27.251 INFO:tasks.workunit.client.0.smithi038.stdout:9/76: symlink d0/l1f 0 2024-09-13T18:30:27.251 INFO:tasks.workunit.client.0.smithi038.stdout:9/77: chown d0/d7/d13/f1e 1021 1 2024-09-13T18:30:27.253 INFO:tasks.workunit.client.1.smithi149.stdout:5/679: rename d3/d10/fa7 to d3/fd5 0 2024-09-13T18:30:27.254 INFO:tasks.workunit.client.0.smithi038.stdout:8/212: mknod d1/d2a/d40/c4e 0 2024-09-13T18:30:27.254 INFO:tasks.workunit.client.0.smithi038.stdout:8/213: fdatasync d1/fc 0 2024-09-13T18:30:27.254 INFO:tasks.workunit.client.0.smithi038.stdout:8/214: creat d1/d4/f4f x:0 0 0 2024-09-13T18:30:27.255 INFO:tasks.workunit.client.0.smithi038.stdout:8/215: write d1/f3 [632981,87093] 0 2024-09-13T18:30:27.256 INFO:tasks.workunit.client.1.smithi149.stdout:6/813: symlink dc/d15/l102 0 2024-09-13T18:30:27.258 INFO:tasks.workunit.client.1.smithi149.stdout:4/760: sync 2024-09-13T18:30:27.258 INFO:tasks.workunit.client.1.smithi149.stdout:3/722: sync 2024-09-13T18:30:27.258 INFO:tasks.workunit.client.1.smithi149.stdout:3/723: write d1/d2e/d1d/d6c/dcd/fe5 [491629,20400] 0 2024-09-13T18:30:27.258 INFO:tasks.workunit.client.1.smithi149.stdout:3/724: write d1/d48/ddb/ff2 [194199,115836] 0 2024-09-13T18:30:27.259 INFO:tasks.workunit.client.1.smithi149.stdout:8/723: rename d2/d12/dd8/d58/d97/cc9 to d2/d12/d2a/d4d/dbb/cfc 0 2024-09-13T18:30:27.259 INFO:tasks.workunit.client.1.smithi149.stdout:3/725: dread d1/d21/fe7 [0,4194304] 0 2024-09-13T18:30:27.260 INFO:tasks.workunit.client.0.smithi038.stdout:9/78: symlink d0/d7/d13/l20 0 2024-09-13T18:30:27.260 INFO:tasks.workunit.client.0.smithi038.stdout:9/79: chown d0/d7/d13/f18 691924 1 2024-09-13T18:30:27.261 INFO:tasks.workunit.client.1.smithi149.stdout:5/680: mkdir d3/d10/d4c/db8/dd6 0 2024-09-13T18:30:27.263 INFO:tasks.workunit.client.1.smithi149.stdout:0/769: getdents d1/d29/d31/d44/d81 0 2024-09-13T18:30:27.263 INFO:tasks.workunit.client.1.smithi149.stdout:0/770: fsync d1/d29/fee 0 2024-09-13T18:30:27.263 INFO:tasks.workunit.client.0.smithi038.stdout:8/216: mkdir d1/de/d21/d24/d4d/d50 0 2024-09-13T18:30:27.263 INFO:tasks.workunit.client.0.smithi038.stdout:8/217: creat d1/d8/f51 x:0 0 0 2024-09-13T18:30:27.263 INFO:tasks.workunit.client.0.smithi038.stdout:8/218: chown d1/d4/f13 12068013 1 2024-09-13T18:30:27.265 INFO:tasks.workunit.client.1.smithi149.stdout:4/761: link df/l9e df/da0/d12/d21/d22/d30/d41/d57/d60/dc4/l101 0 2024-09-13T18:30:27.265 INFO:tasks.workunit.client.1.smithi149.stdout:4/762: chown df/da0/d12/d21/l6b 159907518 1 2024-09-13T18:30:27.266 INFO:tasks.workunit.client.0.smithi038.stdout:6/117: rename dd/d1c to dd/de/d2e/d30 0 2024-09-13T18:30:27.266 INFO:tasks.workunit.client.0.smithi038.stdout:4/181: rename d2 to d2/df/d22/dc/d8/d37 22 2024-09-13T18:30:27.268 INFO:tasks.workunit.client.1.smithi149.stdout:4/763: dread df/da0/d12/d21/d22/d30/d41/f50 [0,4194304] 0 2024-09-13T18:30:27.268 INFO:tasks.workunit.client.1.smithi149.stdout:2/652: rename db/d10/f25 to db/d1b/d1c/d20/d3a/d75/fdf 0 2024-09-13T18:30:27.269 INFO:tasks.workunit.client.0.smithi038.stdout:9/80: mkdir d0/d7/d21 0 2024-09-13T18:30:27.269 INFO:tasks.workunit.client.0.smithi038.stdout:9/81: truncate d0/d7/d13/f19 518230 0 2024-09-13T18:30:27.269 INFO:tasks.workunit.client.0.smithi038.stdout:9/82: truncate d0/f11 142183 0 2024-09-13T18:30:27.270 INFO:tasks.workunit.client.1.smithi149.stdout:8/724: unlink d2/d12/d6e/f80 0 2024-09-13T18:30:27.271 INFO:tasks.workunit.client.1.smithi149.stdout:5/681: symlink d3/d10/d4c/d4e/ld7 0 2024-09-13T18:30:27.272 INFO:tasks.workunit.client.0.smithi038.stdout:8/219: unlink d1/c4a 0 2024-09-13T18:30:27.273 INFO:tasks.workunit.client.0.smithi038.stdout:4/182: symlink d2/df/d1b/l38 0 2024-09-13T18:30:27.273 INFO:tasks.workunit.client.0.smithi038.stdout:4/183: read d2/f19 [708554,97668] 0 2024-09-13T18:30:27.277 INFO:tasks.workunit.client.1.smithi149.stdout:2/653: link db/d1b/d1c/d20/d3a/c8a db/d10/da9/ddb/ce0 0 2024-09-13T18:30:27.277 INFO:tasks.workunit.client.1.smithi149.stdout:2/654: fsync db/d1b/dab/fce 0 2024-09-13T18:30:27.278 INFO:tasks.workunit.client.1.smithi149.stdout:3/726: dread d1/f24 [0,4194304] 0 2024-09-13T18:30:27.279 INFO:tasks.workunit.client.0.smithi038.stdout:8/220: dread d1/f3 [0,4194304] 0 2024-09-13T18:30:27.279 INFO:tasks.workunit.client.0.smithi038.stdout:8/221: readlink d1/d8/l3b 0 2024-09-13T18:30:27.279 INFO:tasks.workunit.client.0.smithi038.stdout:4/184: unlink d2/df/d22/dc/f2c 0 2024-09-13T18:30:27.281 INFO:tasks.workunit.client.1.smithi149.stdout:8/725: mknod d2/db1/dd1/cfd 0 2024-09-13T18:30:27.284 INFO:tasks.workunit.client.0.smithi038.stdout:9/83: rename d0/c16 to d0/d7/c22 0 2024-09-13T18:30:27.286 INFO:tasks.workunit.client.1.smithi149.stdout:4/764: getdents df/da0/d12/d21/d22/d30/d56/d91 0 2024-09-13T18:30:27.289 INFO:tasks.workunit.client.0.smithi038.stdout:8/222: write d1/d4/f12 [486663,81254] 0 2024-09-13T18:30:27.290 INFO:tasks.workunit.client.0.smithi038.stdout:9/84: link d0/d7/d13/f18 d0/d7/f23 0 2024-09-13T18:30:27.290 INFO:tasks.workunit.client.0.smithi038.stdout:9/85: chown d0/f11 1572 1 2024-09-13T18:30:27.291 INFO:tasks.workunit.client.1.smithi149.stdout:3/727: dread d1/d2c/d56/f76 [0,4194304] 0 2024-09-13T18:30:27.291 INFO:tasks.workunit.client.1.smithi149.stdout:3/728: chown d1/d2c/d38/d88/d96/fcf 1981587574 1 2024-09-13T18:30:27.291 INFO:tasks.workunit.client.1.smithi149.stdout:6/814: dwrite dc/f5a [0,4194304] 0 2024-09-13T18:30:27.291 INFO:tasks.workunit.client.1.smithi149.stdout:6/815: write dc/d70/ff5 [164951,75118] 0 2024-09-13T18:30:27.291 INFO:tasks.workunit.client.1.smithi149.stdout:6/816: fsync dc/f2d 0 2024-09-13T18:30:27.292 INFO:tasks.workunit.client.1.smithi149.stdout:0/771: dwrite d1/d48/d92/db4/dbe/fe0 [0,4194304] 0 2024-09-13T18:30:27.292 INFO:tasks.workunit.client.0.smithi038.stdout:4/185: dread d2/df/d22/dc/d8/f2e [0,4194304] 0 2024-09-13T18:30:27.296 INFO:tasks.workunit.client.0.smithi038.stdout:4/186: dread d2/df/d1b/d10/f25 [0,4194304] 0 2024-09-13T18:30:27.296 INFO:tasks.workunit.client.0.smithi038.stdout:4/187: truncate d2/df/d22/dc/d8/f23 5206287 0 2024-09-13T18:30:27.296 INFO:tasks.workunit.client.0.smithi038.stdout:4/188: chown d2/df/d22/f29 1150735 1 2024-09-13T18:30:27.296 INFO:tasks.workunit.client.0.smithi038.stdout:8/223: creat d1/de/d21/f52 x:0 0 0 2024-09-13T18:30:27.296 INFO:tasks.workunit.client.1.smithi149.stdout:2/655: creat db/d1b/d1c/d20/d2b/d3e/fe1 x:0 0 0 2024-09-13T18:30:27.297 INFO:tasks.workunit.client.0.smithi038.stdout:2/34: sync 2024-09-13T18:30:27.300 INFO:tasks.workunit.client.1.smithi149.stdout:4/765: creat df/da0/d70/f102 x:0 0 0 2024-09-13T18:30:27.300 INFO:tasks.workunit.client.1.smithi149.stdout:4/766: fsync df/da0/d12/d21/f24 0 2024-09-13T18:30:27.300 INFO:tasks.workunit.client.1.smithi149.stdout:4/767: creat df/da0/d70/db5/dc7/f103 x:0 0 0 2024-09-13T18:30:27.300 INFO:tasks.workunit.client.1.smithi149.stdout:4/768: chown fe 6011469 1 2024-09-13T18:30:27.301 INFO:tasks.workunit.client.1.smithi149.stdout:1/747: rename d9/d10/d34/d53/d57/d6c to d9/d15/d60/d80/dcd/de6 0 2024-09-13T18:30:27.305 INFO:tasks.workunit.client.0.smithi038.stdout:2/35: creat d2/da/fd x:0 0 0 2024-09-13T18:30:27.307 INFO:tasks.workunit.client.1.smithi149.stdout:6/817: mknod dc/d8c/c103 0 2024-09-13T18:30:27.309 INFO:tasks.workunit.client.1.smithi149.stdout:5/682: dwrite d3/d5e/fa2 [0,4194304] 0 2024-09-13T18:30:27.309 INFO:tasks.workunit.client.1.smithi149.stdout:5/683: chown d3/d10/d4c/d4e/d61/d75/fa1 25 1 2024-09-13T18:30:27.316 INFO:tasks.workunit.client.1.smithi149.stdout:4/769: mkdir df/da0/d12/d21/d22/d30/d41/d57/d75/d104 0 2024-09-13T18:30:27.318 INFO:tasks.workunit.client.1.smithi149.stdout:6/818: dread dc/d15/d23/d5b/f52 [0,4194304] 0 2024-09-13T18:30:27.318 INFO:tasks.workunit.client.1.smithi149.stdout:6/819: dread - dc/d15/d54/da9/ffe zero size 2024-09-13T18:30:27.318 INFO:tasks.workunit.client.1.smithi149.stdout:6/820: chown dc/d15/d23/dcd 17 1 2024-09-13T18:30:27.319 INFO:tasks.workunit.client.1.smithi149.stdout:1/748: rmdir d9/d10/d3f/d6f 0 2024-09-13T18:30:27.319 INFO:tasks.workunit.client.0.smithi038.stdout:4/189: write d2/df/d22/f29 [1231872,116605] 0 2024-09-13T18:30:27.320 INFO:tasks.workunit.client.0.smithi038.stdout:4/190: fdatasync d2/df/d1b/f2b 0 2024-09-13T18:30:27.321 INFO:tasks.workunit.client.1.smithi149.stdout:9/593: rename d0/d9e/d3b/f3d to d0/d2e/d42/d70/d84/dae/fbf 0 2024-09-13T18:30:27.322 INFO:tasks.workunit.client.1.smithi149.stdout:3/729: dwrite d1/d2c/d38/d88/d96/fd7 [0,4194304] 0 2024-09-13T18:30:27.325 INFO:tasks.workunit.client.1.smithi149.stdout:4/770: mknod df/da0/d70/db5/dc7/df9/c105 0 2024-09-13T18:30:27.325 INFO:tasks.workunit.client.1.smithi149.stdout:4/771: write fe [6569973,108205] 0 2024-09-13T18:30:27.325 INFO:tasks.workunit.client.1.smithi149.stdout:4/772: readlink lb 0 2024-09-13T18:30:27.325 INFO:tasks.workunit.client.1.smithi149.stdout:4/773: dread - df/da0/d1c/d7e/fbd zero size 2024-09-13T18:30:27.326 INFO:tasks.workunit.client.0.smithi038.stdout:4/191: rmdir d2/df/d22/dc/d8 39 2024-09-13T18:30:27.327 INFO:tasks.workunit.client.1.smithi149.stdout:1/749: symlink d9/d10/d83/le7 0 2024-09-13T18:30:27.327 INFO:tasks.workunit.client.1.smithi149.stdout:1/750: chown d9/d15/d60/d80/dcd/de6/da2 198 1 2024-09-13T18:30:27.327 INFO:tasks.workunit.client.1.smithi149.stdout:1/751: read d9/d10/d3f/f7a [2022281,100838] 0 2024-09-13T18:30:27.328 INFO:tasks.workunit.client.0.smithi038.stdout:4/192: rename d2/df/l2d to d2/df/d22/l39 0 2024-09-13T18:30:27.331 INFO:tasks.workunit.client.1.smithi149.stdout:5/684: rename d3/d10/d4c/db8/fc7 to d3/d10/d98/fd8 0 2024-09-13T18:30:27.335 INFO:tasks.workunit.client.1.smithi149.stdout:7/832: sync 2024-09-13T18:30:27.335 INFO:tasks.workunit.client.1.smithi149.stdout:7/833: chown d7/d12/fc6 1299423 1 2024-09-13T18:30:27.335 INFO:tasks.workunit.client.1.smithi149.stdout:7/834: chown d7/d9/d1b/f57 536931 1 2024-09-13T18:30:27.335 INFO:tasks.workunit.client.1.smithi149.stdout:3/730: mknod d1/d2e/d6f/daf/cfd 0 2024-09-13T18:30:27.335 INFO:tasks.workunit.client.1.smithi149.stdout:3/731: fsync d1/d2e/d1d/f51 0 2024-09-13T18:30:27.339 INFO:tasks.workunit.client.0.smithi038.stdout:9/86: dwrite d0/d7/d13/f19 [0,4194304] 0 2024-09-13T18:30:27.340 INFO:tasks.workunit.client.1.smithi149.stdout:4/774: rename df/da0/d12/d21/d22/d72/l82 to df/da0/d12/d21/d22/d72/l106 0 2024-09-13T18:30:27.340 INFO:tasks.workunit.client.1.smithi149.stdout:8/726: dwrite d2/d12/d2a/d4d/fcd [0,4194304] 0 2024-09-13T18:30:27.340 INFO:tasks.workunit.client.1.smithi149.stdout:8/727: stat d2/d12/dd8/d58/d97/db6/fb9 0 2024-09-13T18:30:27.340 INFO:tasks.workunit.client.1.smithi149.stdout:3/732: read d1/d12/f1a [948291,98390] 0 2024-09-13T18:30:27.340 INFO:tasks.workunit.client.1.smithi149.stdout:1/752: creat d9/d15/d60/d80/fe8 x:0 0 0 2024-09-13T18:30:27.340 INFO:tasks.workunit.client.1.smithi149.stdout:1/753: fdatasync f2 0 2024-09-13T18:30:27.340 INFO:tasks.workunit.client.1.smithi149.stdout:1/754: fdatasync d9/d10/d34/d53/d57/fa1 0 2024-09-13T18:30:27.341 INFO:tasks.workunit.client.1.smithi149.stdout:1/755: write d9/d10/d62/f8d [547112,26063] 0 2024-09-13T18:30:27.341 INFO:tasks.workunit.client.1.smithi149.stdout:1/756: stat d9/d10/l5c 0 2024-09-13T18:30:27.341 INFO:tasks.workunit.client.1.smithi149.stdout:0/772: dwrite d1/d29/d31/d44/d81/d62/f77 [0,4194304] 0 2024-09-13T18:30:27.341 INFO:tasks.workunit.client.0.smithi038.stdout:2/36: dwrite d2/f5 [0,4194304] 0 2024-09-13T18:30:27.341 INFO:tasks.workunit.client.0.smithi038.stdout:2/37: dread - d2/da/fd zero size 2024-09-13T18:30:27.342 INFO:tasks.workunit.client.0.smithi038.stdout:2/38: dread - d2/f8 zero size 2024-09-13T18:30:27.342 INFO:tasks.workunit.client.1.smithi149.stdout:9/594: dwrite d0/d9e/f3f [0,4194304] 0 2024-09-13T18:30:27.345 INFO:tasks.workunit.client.1.smithi149.stdout:4/775: mknod df/da0/d12/d21/d22/d30/d56/d91/c107 0 2024-09-13T18:30:27.345 INFO:tasks.workunit.client.1.smithi149.stdout:3/733: symlink d1/d2e/d1d/d9a/d39/lfe 0 2024-09-13T18:30:27.346 INFO:tasks.workunit.client.1.smithi149.stdout:1/757: truncate d9/d10/f27 3145585 0 2024-09-13T18:30:27.347 INFO:tasks.workunit.client.1.smithi149.stdout:8/728: mknod d2/d12/dd8/d66/ded/df6/dca/cfe 0 2024-09-13T18:30:27.348 INFO:tasks.workunit.client.1.smithi149.stdout:6/821: rename dc/d2f/d75 to dc/d15/d23/d104 0 2024-09-13T18:30:27.348 INFO:tasks.workunit.client.1.smithi149.stdout:6/822: fdatasync dc/d15/d23/d5f/dac/fb7 0 2024-09-13T18:30:27.348 INFO:tasks.workunit.client.1.smithi149.stdout:6/823: creat dc/d8c/f105 x:0 0 0 2024-09-13T18:30:27.364 INFO:tasks.workunit.client.1.smithi149.stdout:0/773: mkdir d1/d48/d92/d10c/d10e 0 2024-09-13T18:30:27.364 INFO:tasks.workunit.client.0.smithi038.stdout:9/87: write d0/f1 [2665018,61302] 0 2024-09-13T18:30:27.366 INFO:tasks.workunit.client.0.smithi038.stdout:2/39: link d2/l9 d2/le 0 2024-09-13T18:30:27.368 INFO:tasks.workunit.client.1.smithi149.stdout:5/685: dwrite d3/d10/d32/d67/d83/f8a [0,4194304] 0 2024-09-13T18:30:27.368 INFO:tasks.workunit.client.1.smithi149.stdout:5/686: readlink d3/d10/d4c/l7f 0 2024-09-13T18:30:27.368 INFO:tasks.workunit.client.0.smithi038.stdout:9/88: symlink d0/d7/l24 0 2024-09-13T18:30:27.369 INFO:tasks.workunit.client.0.smithi038.stdout:4/193: dwrite d2/f2f [0,4194304] 0 2024-09-13T18:30:27.369 INFO:tasks.workunit.client.0.smithi038.stdout:4/194: read d2/f19 [344345,50163] 0 2024-09-13T18:30:27.369 INFO:tasks.workunit.client.1.smithi149.stdout:9/595: dwrite d0/d47/d61/f6b [0,4194304] 0 2024-09-13T18:30:27.371 INFO:tasks.workunit.client.1.smithi149.stdout:3/734: rmdir d1/d12/d20/d54/dd1 39 2024-09-13T18:30:27.372 INFO:tasks.workunit.client.0.smithi038.stdout:2/40: symlink d2/lf 0 2024-09-13T18:30:27.375 INFO:tasks.workunit.client.1.smithi149.stdout:7/835: rename d7/d9/d1c/d51/d52/d86/fb5 to d7/d9/d11/de2/f124 0 2024-09-13T18:30:27.376 INFO:tasks.workunit.client.0.smithi038.stdout:9/89: read - d0/f6 zero size 2024-09-13T18:30:27.381 INFO:tasks.workunit.client.1.smithi149.stdout:0/774: unlink d1/d2/d8a/fb1 0 2024-09-13T18:30:27.382 INFO:tasks.workunit.client.1.smithi149.stdout:0/775: read d1/d2/d8a/f93 [224658,66233] 0 2024-09-13T18:30:27.384 INFO:tasks.workunit.client.0.smithi038.stdout:4/195: truncate d2/f19 73269 0 2024-09-13T18:30:27.385 INFO:tasks.workunit.client.1.smithi149.stdout:4/776: dwrite df/f29 [0,4194304] 0 2024-09-13T18:30:27.385 INFO:tasks.workunit.client.1.smithi149.stdout:4/777: readlink df/da0/l8d 0 2024-09-13T18:30:27.388 INFO:tasks.workunit.client.0.smithi038.stdout:9/90: creat d0/d7/d21/f25 x:0 0 0 2024-09-13T18:30:27.390 INFO:tasks.workunit.client.1.smithi149.stdout:7/836: unlink d7/d9/d1c/d34/f97 0 2024-09-13T18:30:27.390 INFO:tasks.workunit.client.1.smithi149.stdout:7/837: readlink d7/d76/db3/d31/l8c 0 2024-09-13T18:30:27.390 INFO:tasks.workunit.client.1.smithi149.stdout:7/838: creat d7/d12/f125 x:0 0 0 2024-09-13T18:30:27.391 INFO:tasks.workunit.client.1.smithi149.stdout:0/776: symlink d1/d29/d31/d44/d81/d62/d102/l10f 0 2024-09-13T18:30:27.391 INFO:tasks.workunit.client.1.smithi149.stdout:0/777: fsync d1/d1b/f56 0 2024-09-13T18:30:27.391 INFO:tasks.workunit.client.0.smithi038.stdout:4/196: symlink d2/df/d1b/l3a 0 2024-09-13T18:30:27.391 INFO:tasks.workunit.client.0.smithi038.stdout:4/197: chown d2/df/d22/f1d 0 1 2024-09-13T18:30:27.391 INFO:tasks.workunit.client.0.smithi038.stdout:2/41: rmdir d2/da 39 2024-09-13T18:30:27.392 INFO:tasks.workunit.client.0.smithi038.stdout:2/42: stat d2/f5 0 2024-09-13T18:30:27.392 INFO:tasks.workunit.client.0.smithi038.stdout:9/91: mknod d0/d7/d13/c26 0 2024-09-13T18:30:27.392 INFO:tasks.workunit.client.1.smithi149.stdout:4/778: unlink df/da0/dcc/ce4 0 2024-09-13T18:30:27.393 INFO:tasks.workunit.client.0.smithi038.stdout:4/198: mkdir d2/df/d22/dc/d8/d3b 0 2024-09-13T18:30:27.394 INFO:tasks.workunit.client.0.smithi038.stdout:2/43: link d2/lc d2/l10 0 2024-09-13T18:30:27.394 INFO:tasks.workunit.client.0.smithi038.stdout:2/44: fdatasync d2/f5 0 2024-09-13T18:30:27.396 INFO:tasks.workunit.client.1.smithi149.stdout:5/687: rmdir d3/d10/d4c 39 2024-09-13T18:30:27.396 INFO:tasks.workunit.client.1.smithi149.stdout:5/688: read d3/d10/d4c/d4e/d61/d63/faa [3173803,66777] 0 2024-09-13T18:30:27.396 INFO:tasks.workunit.client.1.smithi149.stdout:5/689: fsync d3/d10/d4c/d4e/d61/d63/fc5 0 2024-09-13T18:30:27.397 INFO:tasks.workunit.client.1.smithi149.stdout:9/596: dwrite d0/d18/d27/d5c/d99/d9f/fa9 [4194304,4194304] 0 2024-09-13T18:30:27.397 INFO:tasks.workunit.client.1.smithi149.stdout:8/729: dwrite d2/d12/dd8/f3c [0,4194304] 0 2024-09-13T18:30:27.398 INFO:tasks.workunit.client.1.smithi149.stdout:6/824: dwrite dc/d15/d23/fde [0,4194304] 0 2024-09-13T18:30:27.400 INFO:tasks.workunit.client.1.smithi149.stdout:7/839: symlink d7/d9/d1c/l126 0 2024-09-13T18:30:27.402 INFO:tasks.workunit.client.1.smithi149.stdout:5/690: truncate d3/d10/f5d 1314344 0 2024-09-13T18:30:27.402 INFO:tasks.workunit.client.1.smithi149.stdout:5/691: stat d3/d10/d4c/d4e/d61/d75/c8e 0 2024-09-13T18:30:27.405 INFO:tasks.workunit.client.1.smithi149.stdout:8/730: getdents d2/dc4 0 2024-09-13T18:30:27.407 INFO:tasks.workunit.client.1.smithi149.stdout:0/778: rmdir d1/d48 39 2024-09-13T18:30:27.412 INFO:tasks.workunit.client.1.smithi149.stdout:5/692: truncate d3/d10/d4c/d4e/f50 664191 0 2024-09-13T18:30:27.413 INFO:tasks.workunit.client.1.smithi149.stdout:4/779: dread df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fca [0,4194304] 0 2024-09-13T18:30:27.413 INFO:tasks.workunit.client.1.smithi149.stdout:4/780: write df/da0/d70/f102 [595511,82962] 0 2024-09-13T18:30:27.414 INFO:tasks.workunit.client.1.smithi149.stdout:4/781: creat df/da0/d1c/d7e/ddd/f108 x:0 0 0 2024-09-13T18:30:27.419 INFO:tasks.workunit.client.0.smithi038.stdout:9/92: rmdir d0/d7/d21 39 2024-09-13T18:30:27.419 INFO:tasks.workunit.client.0.smithi038.stdout:9/93: write d0/f6 [194897,110311] 0 2024-09-13T18:30:27.420 INFO:tasks.workunit.client.1.smithi149.stdout:7/840: getdents d7/d9/d1c/d1f/d21 0 2024-09-13T18:30:27.422 INFO:tasks.workunit.client.0.smithi038.stdout:0/44: sync 2024-09-13T18:30:27.422 INFO:tasks.workunit.client.0.smithi038.stdout:3/40: sync 2024-09-13T18:30:27.423 INFO:tasks.workunit.client.0.smithi038.stdout:5/58: sync 2024-09-13T18:30:27.423 INFO:tasks.workunit.client.0.smithi038.stdout:1/82: sync 2024-09-13T18:30:27.423 INFO:tasks.workunit.client.1.smithi149.stdout:9/597: dwrite d0/d47/f65 [4194304,4194304] 0 2024-09-13T18:30:27.423 INFO:tasks.workunit.client.1.smithi149.stdout:9/598: readlink d0/d2e/d42/l4d 0 2024-09-13T18:30:27.423 INFO:tasks.workunit.client.1.smithi149.stdout:9/599: read d0/d47/d61/f77 [3259198,80717] 0 2024-09-13T18:30:27.426 INFO:tasks.workunit.client.0.smithi038.stdout:0/45: mknod d2/d7/c12 0 2024-09-13T18:30:27.427 INFO:tasks.workunit.client.0.smithi038.stdout:0/46: chown d2/dc 4663 1 2024-09-13T18:30:27.427 INFO:tasks.workunit.client.0.smithi038.stdout:0/47: creat d2/d7/f13 x:0 0 0 2024-09-13T18:30:27.427 INFO:tasks.workunit.client.0.smithi038.stdout:0/48: write d2/d7/f13 [562217,57906] 0 2024-09-13T18:30:27.427 INFO:tasks.workunit.client.0.smithi038.stdout:0/49: write d2/f4 [967322,111312] 0 2024-09-13T18:30:27.429 INFO:tasks.workunit.client.0.smithi038.stdout:4/199: dread d2/df/d1b/fd [0,4194304] 0 2024-09-13T18:30:27.429 INFO:tasks.workunit.client.0.smithi038.stdout:3/41: symlink d0/l11 0 2024-09-13T18:30:27.430 INFO:tasks.workunit.client.0.smithi038.stdout:2/45: dwrite d2/f5 [4194304,4194304] 0 2024-09-13T18:30:27.430 INFO:tasks.workunit.client.0.smithi038.stdout:2/46: creat d2/f11 x:0 0 0 2024-09-13T18:30:27.431 INFO:tasks.workunit.client.1.smithi149.stdout:9/600: stat d0/d2e/d42/ca0 0 2024-09-13T18:30:27.431 INFO:tasks.workunit.client.1.smithi149.stdout:9/601: write d0/d18/d27/fa8 [695477,77780] 0 2024-09-13T18:30:27.432 INFO:tasks.workunit.client.0.smithi038.stdout:4/200: dread d2/f19 [0,4194304] 0 2024-09-13T18:30:27.432 INFO:tasks.workunit.client.0.smithi038.stdout:4/201: readlink d2/df/d22/l9 0 2024-09-13T18:30:27.433 INFO:tasks.workunit.client.0.smithi038.stdout:5/59: symlink df/d15/l16 0 2024-09-13T18:30:27.433 INFO:tasks.workunit.client.1.smithi149.stdout:6/825: dwrite dc/d2f/fcf [0,4194304] 0 2024-09-13T18:30:27.433 INFO:tasks.workunit.client.0.smithi038.stdout:1/83: chown d12/f14 599 1 2024-09-13T18:30:27.437 INFO:tasks.workunit.client.1.smithi149.stdout:9/602: mknod d0/d18/d81/cc0 0 2024-09-13T18:30:27.438 INFO:tasks.workunit.client.1.smithi149.stdout:8/731: dwrite d2/d12/d2a/d4d/f6b [0,4194304] 0 2024-09-13T18:30:27.438 INFO:tasks.workunit.client.1.smithi149.stdout:8/732: fdatasync d2/d12/dd8/f4c 0 2024-09-13T18:30:27.439 INFO:tasks.workunit.client.0.smithi038.stdout:0/50: link d2/fa d2/dc/f14 0 2024-09-13T18:30:27.442 INFO:tasks.workunit.client.0.smithi038.stdout:3/42: mkdir d0/dd/d12 0 2024-09-13T18:30:27.452 INFO:tasks.workunit.client.0.smithi038.stdout:5/60: rename l4 to df/d15/l17 0 2024-09-13T18:30:27.454 INFO:tasks.workunit.client.1.smithi149.stdout:8/733: mkdir d2/dc4/ddb/dff 0 2024-09-13T18:30:27.454 INFO:tasks.workunit.client.1.smithi149.stdout:8/734: write d2/d12/d40/fda [172165,79965] 0 2024-09-13T18:30:27.457 INFO:tasks.workunit.client.0.smithi038.stdout:5/61: fsync f9 0 2024-09-13T18:30:27.457 INFO:tasks.workunit.client.0.smithi038.stdout:5/62: write df/f11 [546201,64657] 0 2024-09-13T18:30:27.458 INFO:tasks.workunit.client.0.smithi038.stdout:1/84: rename f4 to d12/f19 0 2024-09-13T18:30:27.459 INFO:tasks.workunit.client.0.smithi038.stdout:5/63: rename df/d13/f14 to df/d13/f18 0 2024-09-13T18:30:27.459 INFO:tasks.workunit.client.0.smithi038.stdout:5/64: creat df/f19 x:0 0 0 2024-09-13T18:30:27.460 INFO:tasks.workunit.client.0.smithi038.stdout:5/65: mknod df/c1a 0 2024-09-13T18:30:27.460 INFO:tasks.workunit.client.0.smithi038.stdout:5/66: write df/f10 [980247,4173] 0 2024-09-13T18:30:27.463 INFO:tasks.workunit.client.1.smithi149.stdout:0/779: dwrite d1/d29/d31/d44/d47/fd6 [0,4194304] 0 2024-09-13T18:30:27.464 INFO:tasks.workunit.client.1.smithi149.stdout:7/841: dwrite d7/d76/fb7 [4194304,4194304] 0 2024-09-13T18:30:27.467 INFO:tasks.workunit.client.1.smithi149.stdout:7/842: rename d7/c99 to d7/d9/d1b/c127 0 2024-09-13T18:30:27.467 INFO:tasks.workunit.client.1.smithi149.stdout:7/843: chown d7/d9/d1c/d1f/d21/d49/d102/d10f/fe1 18299950 1 2024-09-13T18:30:27.467 INFO:tasks.workunit.client.1.smithi149.stdout:0/780: getdents d1/d29 0 2024-09-13T18:30:27.467 INFO:tasks.workunit.client.1.smithi149.stdout:0/781: stat d1/d29/d31/d44/d81/d62/d102/l10f 0 2024-09-13T18:30:27.468 INFO:tasks.workunit.client.1.smithi149.stdout:8/735: write d2/d12/d87/f9e [8007436,67690] 0 2024-09-13T18:30:27.468 INFO:tasks.workunit.client.1.smithi149.stdout:8/736: chown d2/dc4 0 1 2024-09-13T18:30:27.468 INFO:tasks.workunit.client.1.smithi149.stdout:8/737: stat d2/d5b/d86/f9f 0 2024-09-13T18:30:27.468 INFO:tasks.workunit.client.1.smithi149.stdout:8/738: stat d2/dc4/ddb/dff 0 2024-09-13T18:30:27.469 INFO:tasks.workunit.client.1.smithi149.stdout:7/844: rename d7/d9/d1c/d34/l98 to d7/d9/d1c/d1f/d21/d7b/d96/l128 0 2024-09-13T18:30:27.469 INFO:tasks.workunit.client.1.smithi149.stdout:7/845: write d7/d9/d11/d50/dde/df7/ddf/fe4 [295914,75714] 0 2024-09-13T18:30:27.469 INFO:tasks.workunit.client.1.smithi149.stdout:7/846: fsync d7/d76/db3/fc3 0 2024-09-13T18:30:27.469 INFO:tasks.workunit.client.1.smithi149.stdout:9/603: dread d0/d2e/d42/f8c [0,4194304] 0 2024-09-13T18:30:27.470 INFO:tasks.workunit.client.1.smithi149.stdout:8/739: truncate d2/d12/dd8/f68 3807815 0 2024-09-13T18:30:27.470 INFO:tasks.workunit.client.1.smithi149.stdout:8/740: creat d2/f100 x:0 0 0 2024-09-13T18:30:27.473 INFO:tasks.workunit.client.1.smithi149.stdout:0/782: rmdir d1/d2 39 2024-09-13T18:30:27.473 INFO:tasks.workunit.client.1.smithi149.stdout:0/783: chown d1/d29/f7a 228 1 2024-09-13T18:30:27.474 INFO:tasks.workunit.client.1.smithi149.stdout:8/741: symlink d2/d12/dd8/d66/ded/l101 0 2024-09-13T18:30:27.475 INFO:tasks.workunit.client.1.smithi149.stdout:9/604: mknod d0/d18/d27/cc1 0 2024-09-13T18:30:27.476 INFO:tasks.workunit.client.1.smithi149.stdout:0/784: rename d1/d2/c8d to d1/d2/d41/d46/c110 0 2024-09-13T18:30:27.477 INFO:tasks.workunit.client.1.smithi149.stdout:8/742: creat d2/d12/dd8/d58/d97/f102 x:0 0 0 2024-09-13T18:30:27.477 INFO:tasks.workunit.client.1.smithi149.stdout:8/743: chown d2/d13/d3a/d7f/fb5 465281 1 2024-09-13T18:30:27.477 INFO:tasks.workunit.client.1.smithi149.stdout:8/744: chown d2/d13/d6d/cf9 623 1 2024-09-13T18:30:27.477 INFO:tasks.workunit.client.1.smithi149.stdout:9/605: mknod d0/d2e/d42/d59/cc2 0 2024-09-13T18:30:27.478 INFO:tasks.workunit.client.1.smithi149.stdout:8/745: truncate d2/f42 2268302 0 2024-09-13T18:30:27.478 INFO:tasks.workunit.client.1.smithi149.stdout:8/746: fdatasync d2/d12/f3f 0 2024-09-13T18:30:27.478 INFO:tasks.workunit.client.1.smithi149.stdout:8/747: dread - d2/d13/d3a/fe1 zero size 2024-09-13T18:30:27.479 INFO:tasks.workunit.client.1.smithi149.stdout:9/606: mknod d0/d18/d68/cc3 0 2024-09-13T18:30:27.479 INFO:tasks.workunit.client.1.smithi149.stdout:8/748: getdents d2/d13/d3a/d7f/d8d 0 2024-09-13T18:30:27.480 INFO:tasks.workunit.client.1.smithi149.stdout:0/785: dread d1/d1b/f72 [0,4194304] 0 2024-09-13T18:30:27.481 INFO:tasks.workunit.client.1.smithi149.stdout:9/607: getdents d0/d47 0 2024-09-13T18:30:27.482 INFO:tasks.workunit.client.1.smithi149.stdout:0/786: creat d1/d2/d41/d46/d7b/d98/f111 x:0 0 0 2024-09-13T18:30:27.484 INFO:tasks.workunit.client.0.smithi038.stdout:2/47: dwrite d2/f8 [0,4194304] 0 2024-09-13T18:30:27.485 INFO:tasks.workunit.client.0.smithi038.stdout:2/48: creat d2/f12 x:0 0 0 2024-09-13T18:30:27.485 INFO:tasks.workunit.client.0.smithi038.stdout:2/49: fdatasync d2/f11 0 2024-09-13T18:30:27.489 INFO:tasks.workunit.client.1.smithi149.stdout:6/826: dwrite dc/f5a [0,4194304] 0 2024-09-13T18:30:27.491 INFO:tasks.workunit.client.0.smithi038.stdout:0/51: dwrite d2/fa [0,4194304] 0 2024-09-13T18:30:27.491 INFO:tasks.workunit.client.0.smithi038.stdout:4/202: dwrite d2/df/d22/f1d [4194304,4194304] 0 2024-09-13T18:30:27.491 INFO:tasks.workunit.client.0.smithi038.stdout:0/52: creat d2/f15 x:0 0 0 2024-09-13T18:30:27.491 INFO:tasks.workunit.client.0.smithi038.stdout:0/53: dread - d2/dc/f11 zero size 2024-09-13T18:30:27.491 INFO:tasks.workunit.client.1.smithi149.stdout:4/782: dwrite df/da0/d1c/f3f [0,4194304] 0 2024-09-13T18:30:27.495 INFO:tasks.workunit.client.0.smithi038.stdout:2/50: write d2/f5 [6862610,1062] 0 2024-09-13T18:30:27.495 INFO:tasks.workunit.client.0.smithi038.stdout:9/94: dwrite d0/d7/d13/f19 [0,4194304] 0 2024-09-13T18:30:27.498 INFO:tasks.workunit.client.1.smithi149.stdout:8/749: dread d2/d13/d3a/d7f/fdc [0,4194304] 0 2024-09-13T18:30:27.501 INFO:tasks.workunit.client.1.smithi149.stdout:6/827: rename dc/d15/d23/fde to dc/d15/f106 0 2024-09-13T18:30:27.506 INFO:tasks.workunit.client.1.smithi149.stdout:6/828: unlink dc/d15/d23/d5b/f7f 0 2024-09-13T18:30:27.506 INFO:tasks.workunit.client.1.smithi149.stdout:7/847: dwrite d7/d9/d1c/d1f/d3d/fa7 [0,4194304] 0 2024-09-13T18:30:27.507 INFO:tasks.workunit.client.0.smithi038.stdout:4/203: link d2/df/d1b/d10/l34 d2/df/d22/dc/l3c 0 2024-09-13T18:30:27.507 INFO:tasks.workunit.client.1.smithi149.stdout:0/787: dwrite d1/d29/d31/d44/d47/dfb/f10d [0,4194304] 0 2024-09-13T18:30:27.510 INFO:tasks.workunit.client.1.smithi149.stdout:6/829: rmdir dc/d15/d23/d104/da1/dcb 39 2024-09-13T18:30:27.510 INFO:tasks.workunit.client.0.smithi038.stdout:0/54: dread d2/d7/f9 [0,4194304] 0 2024-09-13T18:30:27.514 INFO:tasks.workunit.client.0.smithi038.stdout:2/51: symlink d2/l13 0 2024-09-13T18:30:27.515 INFO:tasks.workunit.client.1.smithi149.stdout:2/656: sync 2024-09-13T18:30:27.520 INFO:tasks.workunit.client.0.smithi038.stdout:0/55: mknod d2/c16 0 2024-09-13T18:30:27.520 INFO:tasks.workunit.client.0.smithi038.stdout:0/56: creat d2/dc/f17 x:0 0 0 2024-09-13T18:30:27.522 INFO:tasks.workunit.client.0.smithi038.stdout:2/52: link d2/lf d2/l14 0 2024-09-13T18:30:27.522 INFO:tasks.workunit.client.0.smithi038.stdout:2/53: stat d2/l13 0 2024-09-13T18:30:27.523 INFO:tasks.workunit.client.1.smithi149.stdout:7/848: symlink d7/d9/d1c/d1f/d21/d49/d102/l129 0 2024-09-13T18:30:27.527 INFO:tasks.workunit.client.0.smithi038.stdout:2/54: creat d2/da/f15 x:0 0 0 2024-09-13T18:30:27.527 INFO:tasks.workunit.client.0.smithi038.stdout:2/55: write d2/f12 [181320,22024] 0 2024-09-13T18:30:27.530 INFO:tasks.workunit.client.1.smithi149.stdout:7/849: creat d7/d9/d1c/d1f/d21/d49/d102/f12a x:0 0 0 2024-09-13T18:30:27.530 INFO:tasks.workunit.client.1.smithi149.stdout:0/788: write d1/d29/d31/d44/d81/f63 [846657,46080] 0 2024-09-13T18:30:27.530 INFO:tasks.workunit.client.1.smithi149.stdout:4/783: dwrite df/da0/d1c/f92 [0,4194304] 0 2024-09-13T18:30:27.533 INFO:tasks.workunit.client.0.smithi038.stdout:0/57: dread d2/f5 [0,4194304] 0 2024-09-13T18:30:27.534 INFO:tasks.workunit.client.0.smithi038.stdout:9/95: dwrite d0/f11 [0,4194304] 0 2024-09-13T18:30:27.534 INFO:tasks.workunit.client.1.smithi149.stdout:6/830: unlink dc/d15/f3d 0 2024-09-13T18:30:27.534 INFO:tasks.workunit.client.1.smithi149.stdout:6/831: chown dc/d15/d23/d5f/dac/cd4 18556454 1 2024-09-13T18:30:27.534 INFO:tasks.workunit.client.1.smithi149.stdout:6/832: dread - dc/d15/d23/d5b/f8b zero size 2024-09-13T18:30:27.534 INFO:tasks.workunit.client.1.smithi149.stdout:6/833: write dc/d15/d23/d57/d5c/f9b [1439905,69061] 0 2024-09-13T18:30:27.534 INFO:tasks.workunit.client.1.smithi149.stdout:6/834: chown dc/d15/d54/cd9 7380469 1 2024-09-13T18:30:27.535 INFO:tasks.workunit.client.0.smithi038.stdout:5/67: getdents df/d13 0 2024-09-13T18:30:27.537 INFO:tasks.workunit.client.1.smithi149.stdout:2/657: write db/d1b/d1c/d20/d3a/f53 [744430,109687] 0 2024-09-13T18:30:27.537 INFO:tasks.workunit.client.1.smithi149.stdout:2/658: chown db/d1b/d1c/d20/d2b/d3e/l4d 213 1 2024-09-13T18:30:27.541 INFO:tasks.workunit.client.1.smithi149.stdout:4/784: mkdir df/da0/d12/d7c/d109 0 2024-09-13T18:30:27.541 INFO:tasks.workunit.client.1.smithi149.stdout:4/785: fsync df/da0/d1c/f32 0 2024-09-13T18:30:27.541 INFO:tasks.workunit.client.1.smithi149.stdout:4/786: creat df/da0/d70/db5/db9/f10a x:0 0 0 2024-09-13T18:30:27.544 INFO:tasks.workunit.client.1.smithi149.stdout:6/835: creat dc/d15/d23/f107 x:0 0 0 2024-09-13T18:30:27.545 INFO:tasks.workunit.client.1.smithi149.stdout:7/850: dread d7/d9/d1b/d71/ddc/d53/dbe/fdd [0,4194304] 0 2024-09-13T18:30:27.545 INFO:tasks.workunit.client.1.smithi149.stdout:7/851: truncate d7/d9/d1c/d1f/d21/d49/d102/d10f/d10b/f112 52891 0 2024-09-13T18:30:27.546 INFO:tasks.workunit.client.1.smithi149.stdout:4/787: truncate df/da0/d12/d17/d3d/f40 8314559 0 2024-09-13T18:30:27.548 INFO:tasks.workunit.client.1.smithi149.stdout:7/852: creat d7/d11d/f12b x:0 0 0 2024-09-13T18:30:27.551 INFO:tasks.workunit.client.1.smithi149.stdout:4/788: rmdir df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3/dc8/df3 0 2024-09-13T18:30:27.551 INFO:tasks.workunit.client.1.smithi149.stdout:4/789: write df/da0/d12/d21/d22/d30/d41/d57/d75/f8f [214850,33825] 0 2024-09-13T18:30:27.552 INFO:tasks.workunit.client.0.smithi038.stdout:0/58: write d2/dc/f14 [1782981,94875] 0 2024-09-13T18:30:27.555 INFO:tasks.workunit.client.1.smithi149.stdout:8/750: dwrite d2/f96 [0,4194304] 0 2024-09-13T18:30:27.555 INFO:tasks.workunit.client.1.smithi149.stdout:8/751: creat d2/d12/d2a/d4d/f103 x:0 0 0 2024-09-13T18:30:27.556 INFO:tasks.workunit.client.0.smithi038.stdout:4/204: dwrite d2/df/d22/dc/f1e [0,4194304] 0 2024-09-13T18:30:27.556 INFO:tasks.workunit.client.1.smithi149.stdout:4/790: symlink df/da0/d12/d21/d22/d30/d41/d57/d8a/l10b 0 2024-09-13T18:30:27.559 INFO:tasks.workunit.client.0.smithi038.stdout:0/59: link d2/c6 d2/dc/c18 0 2024-09-13T18:30:27.559 INFO:tasks.workunit.client.1.smithi149.stdout:7/853: unlink d7/d9/d1c/d51/cf3 0 2024-09-13T18:30:27.562 INFO:tasks.workunit.client.0.smithi038.stdout:4/205: rename d2/df/d22/f1d to d2/df/d1b/d10/f3d 0 2024-09-13T18:30:27.566 INFO:tasks.workunit.client.1.smithi149.stdout:0/789: dwrite d1/d29/d31/d44/d81/d62/fd3 [0,4194304] 0 2024-09-13T18:30:27.566 INFO:tasks.workunit.client.0.smithi038.stdout:0/60: symlink d2/l19 0 2024-09-13T18:30:27.570 INFO:tasks.workunit.client.1.smithi149.stdout:7/854: link d7/d9/d1c/d1f/d21/d7b/d96/lc5 d7/d9/d1c/d2c/d60/dc9/l12c 0 2024-09-13T18:30:27.570 INFO:tasks.workunit.client.1.smithi149.stdout:7/855: stat d7/d76/db3 0 2024-09-13T18:30:27.572 INFO:tasks.workunit.client.0.smithi038.stdout:4/206: rename d2/df/d22/l39 to d2/df/d22/dc/d8/l3e 0 2024-09-13T18:30:27.575 INFO:tasks.workunit.client.1.smithi149.stdout:0/790: truncate d1/d2/d8a/f93 160192 0 2024-09-13T18:30:27.575 INFO:tasks.workunit.client.0.smithi038.stdout:9/96: dwrite d0/fb [0,4194304] 0 2024-09-13T18:30:27.577 INFO:tasks.workunit.client.1.smithi149.stdout:7/856: link d7/d9/d1c/d1f/d21/d49/d102/f12a d7/d9/d11/d50/f12d 0 2024-09-13T18:30:27.577 INFO:tasks.workunit.client.1.smithi149.stdout:7/857: truncate d7/d9/d1c/d2c/f9a 4420620 0 2024-09-13T18:30:27.577 INFO:tasks.workunit.client.1.smithi149.stdout:7/858: chown d7/d9/d1c/d51/d52/d86/da3 56 1 2024-09-13T18:30:27.578 INFO:tasks.workunit.client.0.smithi038.stdout:4/207: write d2/df/d1b/d10/f3d [9051574,3496] 0 2024-09-13T18:30:27.578 INFO:tasks.workunit.client.0.smithi038.stdout:4/208: truncate d2/df/d1b/f2b 839623 0 2024-09-13T18:30:27.579 INFO:tasks.workunit.client.1.smithi149.stdout:7/859: symlink d7/d9/d1b/d71/ddc/d53/daa/l12e 0 2024-09-13T18:30:27.580 INFO:tasks.workunit.client.0.smithi038.stdout:9/97: creat d0/d7/d21/f27 x:0 0 0 2024-09-13T18:30:27.583 INFO:tasks.workunit.client.1.smithi149.stdout:3/735: sync 2024-09-13T18:30:27.583 INFO:tasks.workunit.client.1.smithi149.stdout:1/758: sync 2024-09-13T18:30:27.583 INFO:tasks.workunit.client.1.smithi149.stdout:3/736: creat d1/fff x:0 0 0 2024-09-13T18:30:27.586 INFO:tasks.workunit.client.1.smithi149.stdout:6/836: dwrite dc/d15/d23/f27 [0,4194304] 0 2024-09-13T18:30:27.586 INFO:tasks.workunit.client.1.smithi149.stdout:6/837: fsync dc/d15/f106 0 2024-09-13T18:30:27.586 INFO:tasks.workunit.client.1.smithi149.stdout:1/759: mknod d9/d15/d60/da5/ce9 0 2024-09-13T18:30:27.586 INFO:tasks.workunit.client.0.smithi038.stdout:0/61: fsync d2/dc/f14 0 2024-09-13T18:30:27.587 INFO:tasks.workunit.client.0.smithi038.stdout:7/103: sync 2024-09-13T18:30:27.588 INFO:tasks.workunit.client.1.smithi149.stdout:2/659: dwrite db/d1b/d1c/f3c [0,4194304] 0 2024-09-13T18:30:27.590 INFO:tasks.workunit.client.1.smithi149.stdout:5/693: sync 2024-09-13T18:30:27.590 INFO:tasks.workunit.client.1.smithi149.stdout:5/694: write d3/d10/d4c/d4e/d61/d63/fc5 [1137334,22746] 0 2024-09-13T18:30:27.590 INFO:tasks.workunit.client.1.smithi149.stdout:5/695: write d3/d10/d4c/d4e/fc4 [372035,114597] 0 2024-09-13T18:30:27.590 INFO:tasks.workunit.client.1.smithi149.stdout:5/696: chown d3/d10/d32/d54/dbd/lc3 28229 1 2024-09-13T18:30:27.590 INFO:tasks.workunit.client.1.smithi149.stdout:5/697: chown d3/d10/d4c/d4e/d61/d75/f7b 1590215 1 2024-09-13T18:30:27.592 INFO:tasks.workunit.client.1.smithi149.stdout:4/791: dwrite df/da0/f61 [4194304,4194304] 0 2024-09-13T18:30:27.596 INFO:tasks.workunit.client.0.smithi038.stdout:9/98: dread d0/d7/d13/f19 [0,4194304] 0 2024-09-13T18:30:27.596 INFO:tasks.workunit.client.0.smithi038.stdout:9/99: chown d0/d7/d13/f17 270685 1 2024-09-13T18:30:27.601 INFO:tasks.workunit.client.1.smithi149.stdout:6/838: rename dc/d15/d54/d5e/df7/dff to dc/d15/d54/d85/dcc/d108 0 2024-09-13T18:30:27.602 INFO:tasks.workunit.client.1.smithi149.stdout:5/698: dread d3/d10/d4c/f81 [0,4194304] 0 2024-09-13T18:30:27.603 INFO:tasks.workunit.client.1.smithi149.stdout:7/860: dread d7/d9/f46 [4194304,4194304] 0 2024-09-13T18:30:27.603 INFO:tasks.workunit.client.1.smithi149.stdout:8/752: dwrite d2/d13/d3a/f4f [0,4194304] 0 2024-09-13T18:30:27.603 INFO:tasks.workunit.client.1.smithi149.stdout:7/861: getdents d7/d9/d1c/d1f/d21/d49/d122 0 2024-09-13T18:30:27.603 INFO:tasks.workunit.client.1.smithi149.stdout:8/753: creat d2/d5b/f104 x:0 0 0 2024-09-13T18:30:27.605 INFO:tasks.workunit.client.1.smithi149.stdout:1/760: mknod d9/d15/d60/d80/dcd/db7/cea 0 2024-09-13T18:30:27.605 INFO:tasks.workunit.client.1.smithi149.stdout:1/761: chown d9/d10/d34/dbe/d38/l94 0 1 2024-09-13T18:30:27.608 INFO:tasks.workunit.client.0.smithi038.stdout:0/62: symlink d2/d7/l1a 0 2024-09-13T18:30:27.608 INFO:tasks.workunit.client.0.smithi038.stdout:0/63: fdatasync d2/fa 0 2024-09-13T18:30:27.608 INFO:tasks.workunit.client.0.smithi038.stdout:0/64: chown d2/l3 13707 1 2024-09-13T18:30:27.610 INFO:tasks.workunit.client.1.smithi149.stdout:0/791: dwrite d1/d2/d8a/fd0 [0,4194304] 0 2024-09-13T18:30:27.610 INFO:tasks.workunit.client.1.smithi149.stdout:0/792: write d1/f1a [9140131,29695] 0 2024-09-13T18:30:27.610 INFO:tasks.workunit.client.1.smithi149.stdout:0/793: readlink d1/d29/d31/d44/d81/d62/d102/l10f 0 2024-09-13T18:30:27.610 INFO:tasks.workunit.client.1.smithi149.stdout:0/794: chown d1/d29/d31/d44/d81/f97 77 1 2024-09-13T18:30:27.610 INFO:tasks.workunit.client.1.smithi149.stdout:0/795: write d1/fbf [902344,8718] 0 2024-09-13T18:30:27.610 INFO:tasks.workunit.client.0.smithi038.stdout:2/56: rmdir d2 39 2024-09-13T18:30:27.610 INFO:tasks.workunit.client.0.smithi038.stdout:2/57: write d2/da/f15 [139555,33258] 0 2024-09-13T18:30:27.612 INFO:tasks.workunit.client.0.smithi038.stdout:9/100: dread d0/ff [0,4194304] 0 2024-09-13T18:30:27.614 INFO:tasks.workunit.client.0.smithi038.stdout:0/65: rename d2/c16 to d2/c1b 0 2024-09-13T18:30:27.615 INFO:tasks.workunit.client.0.smithi038.stdout:7/104: dwrite db/fc [0,4194304] 0 2024-09-13T18:30:27.616 INFO:tasks.workunit.client.0.smithi038.stdout:2/58: mkdir d2/da/d16 0 2024-09-13T18:30:27.616 INFO:tasks.workunit.client.0.smithi038.stdout:2/59: getdents d2/da/d16 0 2024-09-13T18:30:27.619 INFO:tasks.workunit.client.0.smithi038.stdout:4/209: dwrite d2/df/d22/dc/d8/f23 [4194304,4194304] 0 2024-09-13T18:30:27.619 INFO:tasks.workunit.client.0.smithi038.stdout:4/210: truncate d2/df/d22/dc/d8/f23 8510607 0 2024-09-13T18:30:27.622 INFO:tasks.workunit.client.0.smithi038.stdout:0/66: write d2/f5 [2681373,94680] 0 2024-09-13T18:30:27.622 INFO:tasks.workunit.client.1.smithi149.stdout:3/737: dwrite d1/f58 [0,4194304] 0 2024-09-13T18:30:27.622 INFO:tasks.workunit.client.1.smithi149.stdout:3/738: fsync d1/d2e/d1d/d6c/dcd/fe5 0 2024-09-13T18:30:27.623 INFO:tasks.workunit.client.0.smithi038.stdout:7/105: symlink db/d12/l27 0 2024-09-13T18:30:27.624 INFO:tasks.workunit.client.0.smithi038.stdout:7/106: dread db/d12/d13/f17 [0,4194304] 0 2024-09-13T18:30:27.624 INFO:tasks.workunit.client.0.smithi038.stdout:7/107: chown db/d12/d1a/d22/c25 8 1 2024-09-13T18:30:27.628 INFO:tasks.workunit.client.0.smithi038.stdout:2/60: symlink d2/l17 0 2024-09-13T18:30:27.628 INFO:tasks.workunit.client.0.smithi038.stdout:2/61: dread - d2/da/fd zero size 2024-09-13T18:30:27.630 INFO:tasks.workunit.client.0.smithi038.stdout:0/67: read d2/d7/f9 [1008331,37134] 0 2024-09-13T18:30:27.630 INFO:tasks.workunit.client.0.smithi038.stdout:0/68: creat d2/f1c x:0 0 0 2024-09-13T18:30:27.630 INFO:tasks.workunit.client.0.smithi038.stdout:0/69: write d2/dc/f14 [2405561,71049] 0 2024-09-13T18:30:27.630 INFO:tasks.workunit.client.0.smithi038.stdout:0/70: chown d2/l8 21 1 2024-09-13T18:30:27.631 INFO:tasks.workunit.client.0.smithi038.stdout:4/211: symlink d2/df/d1b/d10/l3f 0 2024-09-13T18:30:27.633 INFO:tasks.workunit.client.1.smithi149.stdout:0/796: write d1/d29/d31/d44/d81/f75 [3342362,94428] 0 2024-09-13T18:30:27.633 INFO:tasks.workunit.client.1.smithi149.stdout:0/797: write d1/d2/d41/f4d [1899044,125030] 0 2024-09-13T18:30:27.633 INFO:tasks.workunit.client.1.smithi149.stdout:0/798: dread - d1/d2/d41/d46/d7b/d98/f111 zero size 2024-09-13T18:30:27.633 INFO:tasks.workunit.client.1.smithi149.stdout:0/799: creat d1/d29/d31/d44/d47/f112 x:0 0 0 2024-09-13T18:30:27.634 INFO:tasks.workunit.client.1.smithi149.stdout:4/792: mknod df/da0/d1c/d7e/d9f/c10c 0 2024-09-13T18:30:27.637 INFO:tasks.workunit.client.0.smithi038.stdout:7/108: mkdir db/d12/d1a/d22/d28 0 2024-09-13T18:30:27.639 INFO:tasks.workunit.client.0.smithi038.stdout:2/62: truncate d2/f5 2197636 0 2024-09-13T18:30:27.644 INFO:tasks.workunit.client.0.smithi038.stdout:7/109: mknod db/d12/d1a/d26/c29 0 2024-09-13T18:30:27.644 INFO:tasks.workunit.client.1.smithi149.stdout:6/839: dwrite dc/d76/fc4 [0,4194304] 0 2024-09-13T18:30:27.645 INFO:tasks.workunit.client.1.smithi149.stdout:6/840: write dc/d15/f106 [5136282,9522] 0 2024-09-13T18:30:27.645 INFO:tasks.workunit.client.0.smithi038.stdout:7/110: read db/f14 [2531,35562] 0 2024-09-13T18:30:27.645 INFO:tasks.workunit.client.1.smithi149.stdout:8/754: symlink d2/d12/dd8/d66/ded/l105 0 2024-09-13T18:30:27.645 INFO:tasks.workunit.client.0.smithi038.stdout:2/63: rmdir d2 39 2024-09-13T18:30:27.647 INFO:tasks.workunit.client.1.smithi149.stdout:1/762: mknod d9/d15/d60/d80/ceb 0 2024-09-13T18:30:27.651 INFO:tasks.workunit.client.1.smithi149.stdout:3/739: link d1/d2c/l79 d1/d12/d20/d54/d6d/l100 0 2024-09-13T18:30:27.658 INFO:tasks.workunit.client.1.smithi149.stdout:0/800: mknod d1/d2/d8a/dc2/c113 0 2024-09-13T18:30:27.658 INFO:tasks.workunit.client.1.smithi149.stdout:0/801: chown d1/d29/d31/d3e/d108 342214752 1 2024-09-13T18:30:27.658 INFO:tasks.workunit.client.1.smithi149.stdout:0/802: readlink d1/d2/l49 0 2024-09-13T18:30:27.658 INFO:tasks.workunit.client.1.smithi149.stdout:0/803: dread - d1/d1b/fc8 zero size 2024-09-13T18:30:27.658 INFO:tasks.workunit.client.1.smithi149.stdout:4/793: mkdir df/da0/deb/d10d 0 2024-09-13T18:30:27.661 INFO:tasks.workunit.client.1.smithi149.stdout:6/841: link dc/d15/d23/lbf dc/d76/l109 0 2024-09-13T18:30:27.662 INFO:tasks.workunit.client.1.smithi149.stdout:2/660: dwrite db/d1b/d1c/d20/d2b/f57 [0,4194304] 0 2024-09-13T18:30:27.663 INFO:tasks.workunit.client.1.smithi149.stdout:5/699: dwrite d3/d10/d4c/db8/fbf [0,4194304] 0 2024-09-13T18:30:27.663 INFO:tasks.workunit.client.0.smithi038.stdout:9/101: dwrite d0/d7/d13/f18 [4194304,4194304] 0 2024-09-13T18:30:27.663 INFO:tasks.workunit.client.0.smithi038.stdout:9/102: truncate d0/d7/d21/f25 1009737 0 2024-09-13T18:30:27.663 INFO:tasks.workunit.client.0.smithi038.stdout:9/103: readlink d0/d7/d13/l1a 0 2024-09-13T18:30:27.664 INFO:tasks.workunit.client.0.smithi038.stdout:9/104: write d0/fb [4433799,93106] 0 2024-09-13T18:30:27.664 INFO:tasks.workunit.client.0.smithi038.stdout:0/71: dwrite d2/f15 [0,4194304] 0 2024-09-13T18:30:27.664 INFO:tasks.workunit.client.1.smithi149.stdout:8/755: creat d2/d12/dc2/f106 x:0 0 0 2024-09-13T18:30:27.665 INFO:tasks.workunit.client.1.smithi149.stdout:3/740: write d1/d2e/d1d/d6c/fba [528338,108418] 0 2024-09-13T18:30:27.665 INFO:tasks.workunit.client.1.smithi149.stdout:3/741: write d1/d48/fc5 [102361,17648] 0 2024-09-13T18:30:27.665 INFO:tasks.workunit.client.1.smithi149.stdout:3/742: creat d1/f101 x:0 0 0 2024-09-13T18:30:27.665 INFO:tasks.workunit.client.1.smithi149.stdout:3/743: creat d1/d48/f102 x:0 0 0 2024-09-13T18:30:27.665 INFO:tasks.workunit.client.1.smithi149.stdout:8/756: write d2/d52/f84 [1106617,125923] 0 2024-09-13T18:30:27.665 INFO:tasks.workunit.client.1.smithi149.stdout:8/757: write d2/d13/d3a/d7f/fdc [5026680,57925] 0 2024-09-13T18:30:27.666 INFO:tasks.workunit.client.1.smithi149.stdout:0/804: unlink d1/d48/d92/db4/dbe/cc9 0 2024-09-13T18:30:27.667 INFO:tasks.workunit.client.0.smithi038.stdout:2/64: getdents d2/da 0 2024-09-13T18:30:27.671 INFO:tasks.workunit.client.1.smithi149.stdout:4/794: creat df/da0/d70/db5/dc7/df9/f10e x:0 0 0 2024-09-13T18:30:27.672 INFO:tasks.workunit.client.0.smithi038.stdout:2/65: dread d2/da/f15 [0,4194304] 0 2024-09-13T18:30:27.672 INFO:tasks.workunit.client.0.smithi038.stdout:2/66: write d2/da/f15 [454221,107198] 0 2024-09-13T18:30:27.672 INFO:tasks.workunit.client.1.smithi149.stdout:6/842: mkdir dc/d15/d23/d5b/d10a 0 2024-09-13T18:30:27.673 INFO:tasks.workunit.client.1.smithi149.stdout:9/608: sync 2024-09-13T18:30:27.680 INFO:tasks.workunit.client.1.smithi149.stdout:4/795: write df/da0/d12/d17/fe0 [123370,20516] 0 2024-09-13T18:30:27.682 INFO:tasks.workunit.client.1.smithi149.stdout:1/763: rmdir d9/d58 39 2024-09-13T18:30:27.691 INFO:tasks.workunit.client.1.smithi149.stdout:3/744: dwrite d1/d47/d30/d5a/fc6 [0,4194304] 0 2024-09-13T18:30:27.691 INFO:tasks.workunit.client.1.smithi149.stdout:8/758: unlink d2/f63 0 2024-09-13T18:30:27.692 INFO:tasks.workunit.client.1.smithi149.stdout:2/661: dwrite db/d1b/d1c/f5b [0,4194304] 0 2024-09-13T18:30:27.692 INFO:tasks.workunit.client.1.smithi149.stdout:2/662: write db/d1b/d2f/d69/f5c [445143,67428] 0 2024-09-13T18:30:27.693 INFO:tasks.workunit.client.0.smithi038.stdout:0/72: link d2/f15 d2/d7/f1d 0 2024-09-13T18:30:27.693 INFO:tasks.workunit.client.0.smithi038.stdout:0/73: creat d2/f1e x:0 0 0 2024-09-13T18:30:27.694 INFO:tasks.workunit.client.1.smithi149.stdout:0/805: mkdir d1/d2/d8a/d90/d114 0 2024-09-13T18:30:27.694 INFO:tasks.workunit.client.1.smithi149.stdout:0/806: creat d1/d29/d31/d3e/f115 x:0 0 0 2024-09-13T18:30:27.694 INFO:tasks.workunit.client.1.smithi149.stdout:0/807: dread - d1/d2/d41/d46/d7b/d98/fa3 zero size 2024-09-13T18:30:27.694 INFO:tasks.workunit.client.0.smithi038.stdout:2/67: symlink d2/da/l18 0 2024-09-13T18:30:27.696 INFO:tasks.workunit.client.1.smithi149.stdout:4/796: dwrite df/da0/d12/d21/d22/d30/d56/fef [0,4194304] 0 2024-09-13T18:30:27.699 INFO:tasks.workunit.client.1.smithi149.stdout:6/843: rename dc/d15/d23/f31 to dc/d15/d23/dcd/f10b 0 2024-09-13T18:30:27.701 INFO:tasks.workunit.client.1.smithi149.stdout:9/609: rmdir d0/d18 39 2024-09-13T18:30:27.704 INFO:tasks.workunit.client.0.smithi038.stdout:0/74: symlink d2/dc/l1f 0 2024-09-13T18:30:27.710 INFO:tasks.workunit.client.1.smithi149.stdout:1/764: link d9/d10/d43/dcb/fd0 d9/d10/d3f/d76/fec 0 2024-09-13T18:30:27.715 INFO:tasks.workunit.client.1.smithi149.stdout:0/808: symlink d1/d29/d31/d44/l116 0 2024-09-13T18:30:27.716 INFO:tasks.workunit.client.1.smithi149.stdout:2/663: dwrite db/d1b/d1c/f5b [0,4194304] 0 2024-09-13T18:30:27.717 INFO:tasks.workunit.client.1.smithi149.stdout:6/844: dwrite dc/f1a [4194304,4194304] 0 2024-09-13T18:30:27.718 INFO:tasks.workunit.client.1.smithi149.stdout:0/809: dread d1/d2/d41/fae [0,4194304] 0 2024-09-13T18:30:27.719 INFO:tasks.workunit.client.1.smithi149.stdout:3/745: rename d1/d2c/c50 to d1/d2c/d38/c103 0 2024-09-13T18:30:27.720 INFO:tasks.workunit.client.1.smithi149.stdout:9/610: truncate d0/d2e/f71 373252 0 2024-09-13T18:30:27.721 INFO:tasks.workunit.client.1.smithi149.stdout:1/765: symlink d9/d15/d60/d80/dcd/db7/led 0 2024-09-13T18:30:27.723 INFO:tasks.workunit.client.1.smithi149.stdout:8/759: rmdir d2/d5b/d86 39 2024-09-13T18:30:27.723 INFO:tasks.workunit.client.1.smithi149.stdout:8/760: chown d2/l26 94450888 1 2024-09-13T18:30:27.728 INFO:tasks.workunit.client.1.smithi149.stdout:6/845: dread - dc/d15/fea zero size 2024-09-13T18:30:27.728 INFO:tasks.workunit.client.1.smithi149.stdout:7/862: sync 2024-09-13T18:30:27.729 INFO:tasks.workunit.client.1.smithi149.stdout:0/810: mkdir d1/d2/d8a/da9/d117 0 2024-09-13T18:30:27.729 INFO:tasks.workunit.client.1.smithi149.stdout:4/797: rename df/da0/d12/d21/d22/d30/d41/d57/d75/da1/lba to df/da0/d70/db5/dc7/l10f 0 2024-09-13T18:30:27.729 INFO:tasks.workunit.client.1.smithi149.stdout:4/798: readlink df/da0/d12/d17/d3d/l3e 0 2024-09-13T18:30:27.729 INFO:tasks.workunit.client.1.smithi149.stdout:4/799: chown df/da0/d1c/cdc 390055 1 2024-09-13T18:30:27.730 INFO:tasks.workunit.client.0.smithi038.stdout:9/105: truncate d0/d7/d13/f18 1464694 0 2024-09-13T18:30:27.731 INFO:tasks.workunit.client.1.smithi149.stdout:1/766: getdents d9/d10/d83/d97 0 2024-09-13T18:30:27.732 INFO:tasks.workunit.client.1.smithi149.stdout:2/664: dread db/d13/d70/fa7 [0,4194304] 0 2024-09-13T18:30:27.733 INFO:tasks.workunit.client.1.smithi149.stdout:2/665: chown db/d13/d70/d89 224491167 1 2024-09-13T18:30:27.733 INFO:tasks.workunit.client.1.smithi149.stdout:2/666: write db/d1b/d1c/d20/d3a/f47 [176951,78122] 0 2024-09-13T18:30:27.733 INFO:tasks.workunit.client.1.smithi149.stdout:2/667: chown db/d13/f4a 11 1 2024-09-13T18:30:27.733 INFO:tasks.workunit.client.1.smithi149.stdout:4/800: mkdir df/da0/d12/d21/d22/d30/d41/d110 0 2024-09-13T18:30:27.734 INFO:tasks.workunit.client.1.smithi149.stdout:1/767: mkdir d9/d10/d43/dcb/dee 0 2024-09-13T18:30:27.735 INFO:tasks.workunit.client.1.smithi149.stdout:6/846: dread dc/d15/d23/d57/da5/fd0 [0,4194304] 0 2024-09-13T18:30:27.735 INFO:tasks.workunit.client.1.smithi149.stdout:6/847: read dc/d15/d23/f3e [2144924,4507] 0 2024-09-13T18:30:27.739 INFO:tasks.workunit.client.1.smithi149.stdout:1/768: mkdir d9/d10/d34/d3c/d50/def 0 2024-09-13T18:30:27.740 INFO:tasks.workunit.client.1.smithi149.stdout:6/848: symlink dc/d15/d23/d5b/d91/db0/l10c 0 2024-09-13T18:30:27.741 INFO:tasks.workunit.client.0.smithi038.stdout:0/75: rmdir d2 39 2024-09-13T18:30:27.742 INFO:tasks.workunit.client.0.smithi038.stdout:0/76: mknod d2/c20 0 2024-09-13T18:30:27.743 INFO:tasks.workunit.client.0.smithi038.stdout:0/77: creat d2/d7/f21 x:0 0 0 2024-09-13T18:30:27.745 INFO:tasks.workunit.client.0.smithi038.stdout:0/78: symlink d2/dc/l22 0 2024-09-13T18:30:27.746 INFO:tasks.workunit.client.1.smithi149.stdout:2/668: mkdir db/d1b/d1c/d20/d2b/db7/de2 0 2024-09-13T18:30:27.753 INFO:tasks.workunit.client.1.smithi149.stdout:8/761: dread d2/d12/dd8/f4c [0,4194304] 0 2024-09-13T18:30:27.753 INFO:tasks.workunit.client.1.smithi149.stdout:7/863: dread d7/d9/f72 [0,4194304] 0 2024-09-13T18:30:27.753 INFO:tasks.workunit.client.1.smithi149.stdout:3/746: dwrite d1/d2c/d56/fd5 [0,4194304] 0 2024-09-13T18:30:27.758 INFO:tasks.workunit.client.1.smithi149.stdout:5/700: sync 2024-09-13T18:30:27.758 INFO:tasks.workunit.client.1.smithi149.stdout:7/864: mknod d7/d9/d11/d50/dde/df7/dae/c12f 0 2024-09-13T18:30:27.758 INFO:tasks.workunit.client.1.smithi149.stdout:7/865: read - d7/d9/d1c/d1f/d21/d49/d102/f12a zero size 2024-09-13T18:30:27.758 INFO:tasks.workunit.client.1.smithi149.stdout:7/866: chown d7/d9/d1c/d2c 8143281 1 2024-09-13T18:30:27.759 INFO:tasks.workunit.client.0.smithi038.stdout:9/106: write d0/d7/f23 [2356143,62939] 0 2024-09-13T18:30:27.760 INFO:tasks.workunit.client.0.smithi038.stdout:6/118: sync 2024-09-13T18:30:27.762 INFO:tasks.workunit.client.0.smithi038.stdout:9/107: mknod d0/d7/c28 0 2024-09-13T18:30:27.763 INFO:tasks.workunit.client.1.smithi149.stdout:8/762: dread d2/d52/f84 [0,4194304] 0 2024-09-13T18:30:27.764 INFO:tasks.workunit.client.0.smithi038.stdout:6/119: mkdir dd/de/d31 0 2024-09-13T18:30:27.764 INFO:tasks.workunit.client.0.smithi038.stdout:6/120: chown dd/de/l25 1990291 1 2024-09-13T18:30:27.765 INFO:tasks.workunit.client.1.smithi149.stdout:8/763: truncate d2/f9 1129639 0 2024-09-13T18:30:27.765 INFO:tasks.workunit.client.1.smithi149.stdout:8/764: chown d2/d12/dd8/lbc 24 1 2024-09-13T18:30:27.765 INFO:tasks.workunit.client.1.smithi149.stdout:8/765: chown d2 9909 1 2024-09-13T18:30:27.765 INFO:tasks.workunit.client.0.smithi038.stdout:9/108: stat d0/d7/d13/l1a 0 2024-09-13T18:30:27.765 INFO:tasks.workunit.client.0.smithi038.stdout:9/109: creat d0/d7/d21/f29 x:0 0 0 2024-09-13T18:30:27.765 INFO:tasks.workunit.client.0.smithi038.stdout:9/110: readlink d0/l1f 0 2024-09-13T18:30:27.772 INFO:tasks.workunit.client.1.smithi149.stdout:2/669: dwrite db/d1b/d1c/d20/d3a/f53 [4194304,4194304] 0 2024-09-13T18:30:27.775 INFO:tasks.workunit.client.1.smithi149.stdout:2/670: symlink db/d10/le3 0 2024-09-13T18:30:27.775 INFO:tasks.workunit.client.1.smithi149.stdout:2/671: chown db/d1b/d2f/fc5 28 1 2024-09-13T18:30:27.777 INFO:tasks.workunit.client.0.smithi038.stdout:9/111: write d0/d7/d13/f19 [2721493,128740] 0 2024-09-13T18:30:27.778 INFO:tasks.workunit.client.1.smithi149.stdout:2/672: mkdir db/d1b/d1c/d20/d2b/d3e/de4 0 2024-09-13T18:30:27.781 INFO:tasks.workunit.client.1.smithi149.stdout:8/766: dread d2/d12/dd8/d58/d97/db6/fb9 [0,4194304] 0 2024-09-13T18:30:27.781 INFO:tasks.workunit.client.1.smithi149.stdout:8/767: write d2/d12/f39 [1601070,130799] 0 2024-09-13T18:30:27.781 INFO:tasks.workunit.client.1.smithi149.stdout:2/673: link db/d1b/d1c/d20/d3a/d75/fd1 db/d1b/d1c/d20/d2b/d3e/de4/fe5 0 2024-09-13T18:30:27.782 INFO:tasks.workunit.client.0.smithi038.stdout:9/112: rmdir d0/d7/d13 39 2024-09-13T18:30:27.784 INFO:tasks.workunit.client.0.smithi038.stdout:0/79: getdents d2 0 2024-09-13T18:30:27.784 INFO:tasks.workunit.client.0.smithi038.stdout:0/80: truncate d2/d7/f9 5229062 0 2024-09-13T18:30:27.784 INFO:tasks.workunit.client.0.smithi038.stdout:0/81: readlink d2/l8 0 2024-09-13T18:30:27.785 INFO:tasks.workunit.client.1.smithi149.stdout:4/801: dwrite df/da0/d12/d17/d3d/f5d [0,4194304] 0 2024-09-13T18:30:27.787 INFO:tasks.workunit.client.1.smithi149.stdout:8/768: mkdir d2/d12/dd8/d58/d97/d107 0 2024-09-13T18:30:27.787 INFO:tasks.workunit.client.1.smithi149.stdout:8/769: write d2/d12/f5a [1401724,48754] 0 2024-09-13T18:30:27.787 INFO:tasks.workunit.client.1.smithi149.stdout:8/770: dread - d2/d13/d3a/d7f/d8d/faf zero size 2024-09-13T18:30:27.788 INFO:tasks.workunit.client.0.smithi038.stdout:0/82: symlink d2/d7/l23 0 2024-09-13T18:30:27.788 INFO:tasks.workunit.client.0.smithi038.stdout:0/83: truncate d2/d7/f21 230703 0 2024-09-13T18:30:27.791 INFO:tasks.workunit.client.1.smithi149.stdout:5/701: dwrite d3/d10/d32/fc1 [0,4194304] 0 2024-09-13T18:30:27.792 INFO:tasks.workunit.client.1.smithi149.stdout:2/674: symlink db/d1b/d2f/d30/le6 0 2024-09-13T18:30:27.793 INFO:tasks.workunit.client.1.smithi149.stdout:8/771: truncate d2/d13/f85 144467 0 2024-09-13T18:30:27.793 INFO:tasks.workunit.client.1.smithi149.stdout:8/772: chown d2/d12/f9d 10615414 1 2024-09-13T18:30:27.795 INFO:tasks.workunit.client.1.smithi149.stdout:5/702: creat d3/d10/d32/d54/d97/fd9 x:0 0 0 2024-09-13T18:30:27.798 INFO:tasks.workunit.client.1.smithi149.stdout:8/773: rename d2/d12/d87/ddf/cf3 to d2/dc4/ddb/c108 0 2024-09-13T18:30:27.799 INFO:tasks.workunit.client.1.smithi149.stdout:5/703: creat d3/d10/d4c/db8/fda x:0 0 0 2024-09-13T18:30:27.799 INFO:tasks.workunit.client.1.smithi149.stdout:5/704: dread - d3/d10/d32/d54/db9/fc6 zero size 2024-09-13T18:30:27.800 INFO:tasks.workunit.client.1.smithi149.stdout:5/705: creat d3/d10/d32/d54/db9/fdb x:0 0 0 2024-09-13T18:30:27.800 INFO:tasks.workunit.client.1.smithi149.stdout:5/706: chown d3/d10/d98/lb2 1140 1 2024-09-13T18:30:27.800 INFO:tasks.workunit.client.1.smithi149.stdout:5/707: creat d3/d10/d32/d54/d97/dba/fdc x:0 0 0 2024-09-13T18:30:27.800 INFO:tasks.workunit.client.1.smithi149.stdout:5/708: read d3/d10/d4c/d4e/da4/fa6 [106333,17389] 0 2024-09-13T18:30:27.801 INFO:tasks.workunit.client.1.smithi149.stdout:4/802: dread df/da0/d12/d21/d22/d30/d56/fef [0,4194304] 0 2024-09-13T18:30:27.801 INFO:tasks.workunit.client.1.smithi149.stdout:4/803: stat df/da0/d12/d17/dc2 0 2024-09-13T18:30:27.801 INFO:tasks.workunit.client.1.smithi149.stdout:2/675: getdents db/d1b/d6c 0 2024-09-13T18:30:27.801 INFO:tasks.workunit.client.1.smithi149.stdout:2/676: dread - db/d1b/d1c/d20/d2b/d3e/de4/fe5 zero size 2024-09-13T18:30:27.801 INFO:tasks.workunit.client.1.smithi149.stdout:2/677: stat db/d10/d12/f80 0 2024-09-13T18:30:27.803 INFO:tasks.workunit.client.1.smithi149.stdout:4/804: truncate df/f90 1251288 0 2024-09-13T18:30:27.805 INFO:tasks.workunit.client.1.smithi149.stdout:8/774: getdents d2/d5b 0 2024-09-13T18:30:27.805 INFO:tasks.workunit.client.1.smithi149.stdout:8/775: fdatasync d2/d12/f16 0 2024-09-13T18:30:27.805 INFO:tasks.workunit.client.1.smithi149.stdout:8/776: chown d2/db1/dd1/ddd 104201735 1 2024-09-13T18:30:27.805 INFO:tasks.workunit.client.1.smithi149.stdout:8/777: chown d2/d13/d3a/d7f 91472459 1 2024-09-13T18:30:27.805 INFO:tasks.workunit.client.1.smithi149.stdout:8/778: creat d2/d12/dd8/d58/f109 x:0 0 0 2024-09-13T18:30:27.806 INFO:tasks.workunit.client.1.smithi149.stdout:6/849: dwrite dc/d70/fda [0,4194304] 0 2024-09-13T18:30:27.806 INFO:tasks.workunit.client.1.smithi149.stdout:6/850: fdatasync dc/d15/d23/d57/f59 0 2024-09-13T18:30:27.806 INFO:tasks.workunit.client.1.smithi149.stdout:6/851: chown dc/d15/d54/d85/dcc/cf6 458302073 1 2024-09-13T18:30:27.806 INFO:tasks.workunit.client.1.smithi149.stdout:2/678: unlink db/d1b/d2f/d30/c94 0 2024-09-13T18:30:27.807 INFO:tasks.workunit.client.1.smithi149.stdout:8/779: link d2/d12/dd8/f51 d2/dc4/f10a 0 2024-09-13T18:30:27.808 INFO:tasks.workunit.client.1.smithi149.stdout:6/852: creat dc/d2f/df2/f10d x:0 0 0 2024-09-13T18:30:27.809 INFO:tasks.workunit.client.1.smithi149.stdout:2/679: symlink db/d10/le7 0 2024-09-13T18:30:27.810 INFO:tasks.workunit.client.1.smithi149.stdout:6/853: rename dc/l46 to dc/d70/dbc/l10e 0 2024-09-13T18:30:27.811 INFO:tasks.workunit.client.1.smithi149.stdout:2/680: creat db/d1b/d1c/d20/d3a/fe8 x:0 0 0 2024-09-13T18:30:27.811 INFO:tasks.workunit.client.1.smithi149.stdout:8/780: getdents d2/d13/d3a/d7f/da8 0 2024-09-13T18:30:27.813 INFO:tasks.workunit.client.1.smithi149.stdout:6/854: unlink f5 0 2024-09-13T18:30:27.813 INFO:tasks.workunit.client.1.smithi149.stdout:6/855: mkdir dc/d15/d23/d5f/d10f 0 2024-09-13T18:30:27.814 INFO:tasks.workunit.client.1.smithi149.stdout:6/856: symlink dc/d8c/l110 0 2024-09-13T18:30:27.814 INFO:tasks.workunit.client.1.smithi149.stdout:6/857: fdatasync dc/d15/d23/f39 0 2024-09-13T18:30:27.822 INFO:tasks.workunit.client.1.smithi149.stdout:8/781: dread d2/d13/d3a/f4f [0,4194304] 0 2024-09-13T18:30:27.822 INFO:tasks.workunit.client.1.smithi149.stdout:8/782: fsync d2/d12/dd8/d58/d97/db6/ff8 0 2024-09-13T18:30:27.822 INFO:tasks.workunit.client.1.smithi149.stdout:8/783: fsync d2/d12/d6e/fe6 0 2024-09-13T18:30:27.824 INFO:tasks.workunit.client.1.smithi149.stdout:4/805: dread df/da0/d12/d7c/d9a/ffa [0,4194304] 0 2024-09-13T18:30:27.826 INFO:tasks.workunit.client.1.smithi149.stdout:9/611: dwrite d0/d2e/d42/d59/d86/fa4 [0,4194304] 0 2024-09-13T18:30:27.827 INFO:tasks.workunit.client.1.smithi149.stdout:3/747: dwrite d1/fff [0,4194304] 0 2024-09-13T18:30:27.828 INFO:tasks.workunit.client.1.smithi149.stdout:9/612: truncate d0/d9e/f51 4134001 0 2024-09-13T18:30:27.828 INFO:tasks.workunit.client.1.smithi149.stdout:9/613: dread - d0/d2e/d42/d70/d84/fac zero size 2024-09-13T18:30:27.828 INFO:tasks.workunit.client.1.smithi149.stdout:9/614: read - d0/d18/d93/fb6 zero size 2024-09-13T18:30:27.830 INFO:tasks.workunit.client.1.smithi149.stdout:6/858: dread dc/d76/fc4 [0,4194304] 0 2024-09-13T18:30:27.831 INFO:tasks.workunit.client.1.smithi149.stdout:1/769: dwrite d9/d10/d34/d3c/f85 [0,4194304] 0 2024-09-13T18:30:27.831 INFO:tasks.workunit.client.1.smithi149.stdout:9/615: truncate d0/d2e/d42/d59/d86/f9b 2694328 0 2024-09-13T18:30:27.833 INFO:tasks.workunit.client.1.smithi149.stdout:1/770: mknod d9/d10/d43/cf0 0 2024-09-13T18:30:27.833 INFO:tasks.workunit.client.1.smithi149.stdout:1/771: creat d9/d10/d34/dbe/d38/ff1 x:0 0 0 2024-09-13T18:30:27.834 INFO:tasks.workunit.client.1.smithi149.stdout:6/859: symlink dc/l111 0 2024-09-13T18:30:27.835 INFO:tasks.workunit.client.1.smithi149.stdout:9/616: link d0/d2e/d42/d70/lbb d0/d2e/d42/d59/lc4 0 2024-09-13T18:30:27.837 INFO:tasks.workunit.client.1.smithi149.stdout:1/772: mkdir d9/d10/d34/dbe/d38/df2 0 2024-09-13T18:30:27.838 INFO:tasks.workunit.client.1.smithi149.stdout:6/860: mkdir dc/d15/d54/da9/d112 0 2024-09-13T18:30:27.838 INFO:tasks.workunit.client.1.smithi149.stdout:6/861: fsync dc/d2f/fbe 0 2024-09-13T18:30:27.840 INFO:tasks.workunit.client.1.smithi149.stdout:7/867: dwrite d7/d76/db3/fad [0,4194304] 0 2024-09-13T18:30:27.843 INFO:tasks.workunit.client.1.smithi149.stdout:3/748: dread d1/d2e/d93/fcb [0,4194304] 0 2024-09-13T18:30:27.845 INFO:tasks.workunit.client.0.smithi038.stdout:6/121: dwrite dd/f14 [0,4194304] 0 2024-09-13T18:30:27.845 INFO:tasks.workunit.client.0.smithi038.stdout:6/122: chown c8 641 1 2024-09-13T18:30:27.846 INFO:tasks.workunit.client.0.smithi038.stdout:6/123: stat dd/de/d2e/d30/d27/c28 0 2024-09-13T18:30:27.847 INFO:tasks.workunit.client.1.smithi149.stdout:3/749: dread d1/d2e/d93/fa6 [0,4194304] 0 2024-09-13T18:30:27.848 INFO:tasks.workunit.client.1.smithi149.stdout:7/868: rename d7/d76/db3/d6f/d9d/l103 to d7/d9/d1c/d2c/dcc/l130 0 2024-09-13T18:30:27.848 INFO:tasks.workunit.client.1.smithi149.stdout:7/869: chown d7/d9/d11/f94 960740131 1 2024-09-13T18:30:27.850 INFO:tasks.workunit.client.1.smithi149.stdout:5/709: dwrite d3/d10/d4c/d4e/d61/d63/fc5 [0,4194304] 0 2024-09-13T18:30:27.851 INFO:tasks.workunit.client.0.smithi038.stdout:0/84: getdents d2/d7 0 2024-09-13T18:30:27.851 INFO:tasks.workunit.client.0.smithi038.stdout:0/85: fsync d2/f4 0 2024-09-13T18:30:27.853 INFO:tasks.workunit.client.1.smithi149.stdout:1/773: write d9/d10/d34/f51 [2949879,111164] 0 2024-09-13T18:30:27.853 INFO:tasks.workunit.client.1.smithi149.stdout:2/681: dwrite db/d1b/d2f/fc5 [0,4194304] 0 2024-09-13T18:30:27.854 INFO:tasks.workunit.client.1.smithi149.stdout:3/750: link d1/d2e/d1d/d6c/f8c d1/d2e/d1d/d6c/daa/dad/f104 0 2024-09-13T18:30:27.854 INFO:tasks.workunit.client.1.smithi149.stdout:8/784: dwrite d2/d12/d40/f75 [0,4194304] 0 2024-09-13T18:30:27.856 INFO:tasks.workunit.client.1.smithi149.stdout:7/870: truncate d7/d9/f72 3826709 0 2024-09-13T18:30:27.859 INFO:tasks.workunit.client.1.smithi149.stdout:4/806: dwrite df/da0/d12/d21/f8e [4194304,4194304] 0 2024-09-13T18:30:27.859 INFO:tasks.workunit.client.1.smithi149.stdout:4/807: chown df/da0/d70/db5/cbc 4009 1 2024-09-13T18:30:27.860 INFO:tasks.workunit.client.1.smithi149.stdout:4/808: chown df/da0/d12/d17/l33 3600071 1 2024-09-13T18:30:27.862 INFO:tasks.workunit.client.1.smithi149.stdout:9/617: dwrite d0/d2e/d42/d59/f7c [0,4194304] 0 2024-09-13T18:30:27.862 INFO:tasks.workunit.client.1.smithi149.stdout:9/618: write d0/d18/d27/d5c/d79/fbe [362884,66583] 0 2024-09-13T18:30:27.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/710: rename d3/d8/l3e to d3/d10/d32/d54/d76/d7a/ldd 0 2024-09-13T18:30:27.872 INFO:tasks.workunit.client.1.smithi149.stdout:7/871: creat d7/d9/d1c/d2c/d60/f131 x:0 0 0 2024-09-13T18:30:27.878 INFO:tasks.workunit.client.1.smithi149.stdout:9/619: unlink d0/d9e/c87 0 2024-09-13T18:30:27.881 INFO:tasks.workunit.client.1.smithi149.stdout:1/774: rename d9/d15/d60/d80/dcd/de6 to d9/d15/d60/d80/dcd/dab/df3 0 2024-09-13T18:30:27.882 INFO:tasks.workunit.client.1.smithi149.stdout:5/711: creat d3/d8/d13/fde x:0 0 0 2024-09-13T18:30:27.882 INFO:tasks.workunit.client.1.smithi149.stdout:5/712: readlink d3/d10/d4c/l90 0 2024-09-13T18:30:27.884 INFO:tasks.workunit.client.1.smithi149.stdout:7/872: symlink d7/d9/d1c/d1f/d21/d7b/l132 0 2024-09-13T18:30:27.884 INFO:tasks.workunit.client.1.smithi149.stdout:7/873: dread - d7/d9/d1c/d2c/f104 zero size 2024-09-13T18:30:27.884 INFO:tasks.workunit.client.1.smithi149.stdout:7/874: write d7/d76/db3/d31/f3f [4773763,16052] 0 2024-09-13T18:30:27.884 INFO:tasks.workunit.client.1.smithi149.stdout:7/875: write d7/d9/d1b/fa5 [568232,52979] 0 2024-09-13T18:30:27.892 INFO:tasks.workunit.client.1.smithi149.stdout:9/620: mkdir d0/d9e/dc5 0 2024-09-13T18:30:27.892 INFO:tasks.workunit.client.1.smithi149.stdout:8/785: rename d2/d5b/fbf to d2/d12/d87/ddf/f10b 0 2024-09-13T18:30:27.892 INFO:tasks.workunit.client.1.smithi149.stdout:1/775: truncate d9/d10/d34/d53/d57/f98 1235066 0 2024-09-13T18:30:27.896 INFO:tasks.workunit.client.1.smithi149.stdout:0/811: sync 2024-09-13T18:30:27.898 INFO:tasks.workunit.client.1.smithi149.stdout:0/812: creat d1/d29/dad/f118 x:0 0 0 2024-09-13T18:30:27.905 INFO:tasks.workunit.client.1.smithi149.stdout:0/813: creat d1/d2/f119 x:0 0 0 2024-09-13T18:30:27.906 INFO:tasks.workunit.client.0.smithi038.stdout:1/85: sync 2024-09-13T18:30:27.906 INFO:tasks.workunit.client.0.smithi038.stdout:8/224: sync 2024-09-13T18:30:27.906 INFO:tasks.workunit.client.0.smithi038.stdout:3/43: sync 2024-09-13T18:30:27.908 INFO:tasks.workunit.client.0.smithi038.stdout:1/86: creat d12/f1a x:0 0 0 2024-09-13T18:30:27.909 INFO:tasks.workunit.client.0.smithi038.stdout:3/44: mknod d0/c13 0 2024-09-13T18:30:27.909 INFO:tasks.workunit.client.0.smithi038.stdout:3/45: write d0/f2 [1045201,36894] 0 2024-09-13T18:30:27.909 INFO:tasks.workunit.client.0.smithi038.stdout:8/225: rmdir d1/de/d21 39 2024-09-13T18:30:27.910 INFO:tasks.workunit.client.0.smithi038.stdout:8/226: creat d1/de/d3a/f53 x:0 0 0 2024-09-13T18:30:27.910 INFO:tasks.workunit.client.0.smithi038.stdout:8/227: chown d1/de/d21/d24/d4d 32314577 1 2024-09-13T18:30:27.911 INFO:tasks.workunit.client.0.smithi038.stdout:1/87: symlink d12/d15/l1b 0 2024-09-13T18:30:27.912 INFO:tasks.workunit.client.0.smithi038.stdout:9/113: dwrite d0/ff [0,4194304] 0 2024-09-13T18:30:27.913 INFO:tasks.workunit.client.0.smithi038.stdout:6/124: dwrite f5 [4194304,4194304] 0 2024-09-13T18:30:27.913 INFO:tasks.workunit.client.0.smithi038.stdout:3/46: mknod d0/c14 0 2024-09-13T18:30:27.913 INFO:tasks.workunit.client.1.smithi149.stdout:4/809: dwrite df/f90 [0,4194304] 0 2024-09-13T18:30:27.920 INFO:tasks.workunit.client.1.smithi149.stdout:2/682: dwrite db/d13/f4a [4194304,4194304] 0 2024-09-13T18:30:27.920 INFO:tasks.workunit.client.0.smithi038.stdout:0/86: dwrite d2/d7/f13 [0,4194304] 0 2024-09-13T18:30:27.922 INFO:tasks.workunit.client.0.smithi038.stdout:3/47: unlink d0/c7 0 2024-09-13T18:30:27.925 INFO:tasks.workunit.client.1.smithi149.stdout:4/810: creat df/da0/d12/d21/d22/f111 x:0 0 0 2024-09-13T18:30:27.925 INFO:tasks.workunit.client.1.smithi149.stdout:4/811: read - df/da0/d1c/d7e/fbd zero size 2024-09-13T18:30:27.926 INFO:tasks.workunit.client.0.smithi038.stdout:9/114: rename d0/d7/d13/f18 to d0/f2a 0 2024-09-13T18:30:27.927 INFO:tasks.workunit.client.1.smithi149.stdout:5/713: dwrite d3/d5e/fa3 [0,4194304] 0 2024-09-13T18:30:27.929 INFO:tasks.workunit.client.1.smithi149.stdout:4/812: getdents df/da0/d12/d21/d22/d30/d56/d91/dcb 0 2024-09-13T18:30:27.929 INFO:tasks.workunit.client.0.smithi038.stdout:0/87: truncate d2/f5 2679811 0 2024-09-13T18:30:27.929 INFO:tasks.workunit.client.0.smithi038.stdout:0/88: chown d2/d7/f21 559937 1 2024-09-13T18:30:27.930 INFO:tasks.workunit.client.0.smithi038.stdout:3/48: rmdir d0/dd/d12 0 2024-09-13T18:30:27.931 INFO:tasks.workunit.client.0.smithi038.stdout:9/115: read d0/f8 [1957980,97861] 0 2024-09-13T18:30:27.933 INFO:tasks.workunit.client.0.smithi038.stdout:0/89: mkdir d2/d7/d24 0 2024-09-13T18:30:27.935 INFO:tasks.workunit.client.0.smithi038.stdout:3/49: rename d0/c13 to d0/dd/c15 0 2024-09-13T18:30:27.937 INFO:tasks.workunit.client.0.smithi038.stdout:3/50: symlink d0/dd/l16 0 2024-09-13T18:30:27.937 INFO:tasks.workunit.client.0.smithi038.stdout:3/51: truncate d0/dd/fe 4407987 0 2024-09-13T18:30:27.938 INFO:tasks.workunit.client.0.smithi038.stdout:9/116: unlink d0/f4 0 2024-09-13T18:30:27.938 INFO:tasks.workunit.client.0.smithi038.stdout:9/117: chown d0/d7/c1b 231999701 1 2024-09-13T18:30:27.939 INFO:tasks.workunit.client.0.smithi038.stdout:3/52: mkdir d0/dd/d17 0 2024-09-13T18:30:27.940 INFO:tasks.workunit.client.0.smithi038.stdout:1/88: write d12/f16 [1465162,17953] 0 2024-09-13T18:30:27.941 INFO:tasks.workunit.client.0.smithi038.stdout:3/53: creat d0/dd/d17/f18 x:0 0 0 2024-09-13T18:30:27.944 INFO:tasks.workunit.client.0.smithi038.stdout:1/89: creat d12/f1c x:0 0 0 2024-09-13T18:30:27.945 INFO:tasks.workunit.client.0.smithi038.stdout:3/54: unlink d0/c8 0 2024-09-13T18:30:27.946 INFO:tasks.workunit.client.1.smithi149.stdout:5/714: dread d3/d8/f9b [0,4194304] 0 2024-09-13T18:30:27.947 INFO:tasks.workunit.client.0.smithi038.stdout:6/125: read dd/f14 [2312032,19579] 0 2024-09-13T18:30:27.947 INFO:tasks.workunit.client.0.smithi038.stdout:6/126: stat dd/de/d2e/d2f 0 2024-09-13T18:30:27.947 INFO:tasks.workunit.client.0.smithi038.stdout:6/127: creat dd/f32 x:0 0 0 2024-09-13T18:30:27.947 INFO:tasks.workunit.client.0.smithi038.stdout:6/128: chown dd/l23 136 1 2024-09-13T18:30:27.948 INFO:tasks.workunit.client.0.smithi038.stdout:3/55: unlink d0/c5 0 2024-09-13T18:30:27.948 INFO:tasks.workunit.client.0.smithi038.stdout:3/56: write d0/dd/d17/f18 [825547,6588] 0 2024-09-13T18:30:27.948 INFO:tasks.workunit.client.0.smithi038.stdout:3/57: chown d0/f4 113 1 2024-09-13T18:30:27.948 INFO:tasks.workunit.client.0.smithi038.stdout:1/90: mknod d12/c1d 0 2024-09-13T18:30:27.948 INFO:tasks.workunit.client.0.smithi038.stdout:1/91: chown fe 402 1 2024-09-13T18:30:27.948 INFO:tasks.workunit.client.0.smithi038.stdout:1/92: chown d12/f1c 326998 1 2024-09-13T18:30:27.951 INFO:tasks.workunit.client.0.smithi038.stdout:6/129: creat dd/de/d2e/d30/d27/f33 x:0 0 0 2024-09-13T18:30:27.951 INFO:tasks.workunit.client.1.smithi149.stdout:4/813: dread df/da0/f61 [0,4194304] 0 2024-09-13T18:30:27.952 INFO:tasks.workunit.client.1.smithi149.stdout:4/814: fsync df/da0/d1c/d7e/ddd/f108 0 2024-09-13T18:30:27.952 INFO:tasks.workunit.client.1.smithi149.stdout:5/715: mknod d3/d8/d13/cdf 0 2024-09-13T18:30:27.952 INFO:tasks.workunit.client.0.smithi038.stdout:3/58: mkdir d0/dd/d19 0 2024-09-13T18:30:27.952 INFO:tasks.workunit.client.0.smithi038.stdout:3/59: creat d0/dd/f1a x:0 0 0 2024-09-13T18:30:27.953 INFO:tasks.workunit.client.0.smithi038.stdout:3/60: truncate d0/f9 4776408 0 2024-09-13T18:30:27.953 INFO:tasks.workunit.client.0.smithi038.stdout:3/61: write d0/fb [703541,121884] 0 2024-09-13T18:30:27.953 INFO:tasks.workunit.client.1.smithi149.stdout:4/815: rmdir df/da0/d12/d21/d22/d30/d41 39 2024-09-13T18:30:27.954 INFO:tasks.workunit.client.0.smithi038.stdout:6/130: symlink dd/de/d31/l34 0 2024-09-13T18:30:27.956 INFO:tasks.workunit.client.1.smithi149.stdout:5/716: symlink d3/d10/d4c/d4e/d61/d75/le0 0 2024-09-13T18:30:27.957 INFO:tasks.workunit.client.0.smithi038.stdout:3/62: symlink d0/dd/l1b 0 2024-09-13T18:30:27.958 INFO:tasks.workunit.client.1.smithi149.stdout:5/717: rmdir d3/d8 39 2024-09-13T18:30:27.960 INFO:tasks.workunit.client.1.smithi149.stdout:5/718: creat d3/d10/d4c/d4e/d61/d75/d88/fe1 x:0 0 0 2024-09-13T18:30:27.960 INFO:tasks.workunit.client.1.smithi149.stdout:5/719: dread - d3/d10/d4c/d4e/d61/d75/d88/fe1 zero size 2024-09-13T18:30:27.966 INFO:tasks.workunit.client.0.smithi038.stdout:3/63: read d0/fa [3629652,28290] 0 2024-09-13T18:30:27.967 INFO:tasks.workunit.client.0.smithi038.stdout:8/228: dwrite d1/de/d15/d30/f3c [0,4194304] 0 2024-09-13T18:30:27.969 INFO:tasks.workunit.client.0.smithi038.stdout:8/229: rename d1/de/d15/d30/f34 to d1/f54 0 2024-09-13T18:30:27.970 INFO:tasks.workunit.client.0.smithi038.stdout:8/230: getdents d1/d2a 0 2024-09-13T18:30:27.972 INFO:tasks.workunit.client.1.smithi149.stdout:5/720: dread d3/d5e/fa2 [0,4194304] 0 2024-09-13T18:30:27.980 INFO:tasks.workunit.client.0.smithi038.stdout:8/231: dread d1/de/d15/d30/f3c [0,4194304] 0 2024-09-13T18:30:27.980 INFO:tasks.workunit.client.0.smithi038.stdout:8/232: fsync d1/d2a/f2e 0 2024-09-13T18:30:27.981 INFO:tasks.workunit.client.0.smithi038.stdout:8/233: rename d1/de/d21/f22 to d1/de/d15/d30/f55 0 2024-09-13T18:30:27.982 INFO:tasks.workunit.client.0.smithi038.stdout:6/131: dread fa [0,4194304] 0 2024-09-13T18:30:27.983 INFO:tasks.workunit.client.1.smithi149.stdout:7/876: dwrite d7/d9/d1c/d1f/d21/d7b/d96/d9e/fa2 [0,4194304] 0 2024-09-13T18:30:27.983 INFO:tasks.workunit.client.1.smithi149.stdout:7/877: readlink d7/d9/d1c/d1f/d21/d7b/d96/lc5 0 2024-09-13T18:30:27.983 INFO:tasks.workunit.client.0.smithi038.stdout:8/234: mkdir d1/de/d21/d24/d56 0 2024-09-13T18:30:27.983 INFO:tasks.workunit.client.0.smithi038.stdout:8/235: write d1/de/d15/d30/f55 [2776676,70418] 0 2024-09-13T18:30:27.983 INFO:tasks.workunit.client.0.smithi038.stdout:8/236: chown d1/de/d3a/f53 1 1 2024-09-13T18:30:27.983 INFO:tasks.workunit.client.1.smithi149.stdout:8/786: dwrite d2/d12/d2a/d4d/f78 [0,4194304] 0 2024-09-13T18:30:27.985 INFO:tasks.workunit.client.1.smithi149.stdout:9/621: dwrite d0/d47/d54/f55 [0,4194304] 0 2024-09-13T18:30:27.989 INFO:tasks.workunit.client.1.smithi149.stdout:7/878: unlink d7/d9/d1c/d1f/d21/d49/d102/l129 0 2024-09-13T18:30:27.989 INFO:tasks.workunit.client.1.smithi149.stdout:8/787: symlink d2/d12/d87/df1/l10c 0 2024-09-13T18:30:27.991 INFO:tasks.workunit.client.1.smithi149.stdout:7/879: mkdir d7/d9/d11/d50/d133 0 2024-09-13T18:30:27.994 INFO:tasks.workunit.client.1.smithi149.stdout:8/788: truncate d2/fa5 3923731 0 2024-09-13T18:30:27.994 INFO:tasks.workunit.client.1.smithi149.stdout:8/789: read - d2/fd4 zero size 2024-09-13T18:30:27.994 INFO:tasks.workunit.client.1.smithi149.stdout:1/776: dwrite d9/d15/d60/da5/fc6 [0,4194304] 0 2024-09-13T18:30:27.994 INFO:tasks.workunit.client.1.smithi149.stdout:2/683: dwrite db/fc1 [0,4194304] 0 2024-09-13T18:30:27.994 INFO:tasks.workunit.client.0.smithi038.stdout:0/90: dwrite d2/d7/f21 [0,4194304] 0 2024-09-13T18:30:27.996 INFO:tasks.workunit.client.1.smithi149.stdout:0/814: dwrite d1/d1b/f56 [0,4194304] 0 2024-09-13T18:30:27.996 INFO:tasks.workunit.client.0.smithi038.stdout:0/91: write d2/d7/f1d [5227409,75007] 0 2024-09-13T18:30:27.996 INFO:tasks.workunit.client.1.smithi149.stdout:4/816: dwrite df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fca [4194304,4194304] 0 2024-09-13T18:30:27.998 INFO:tasks.workunit.client.1.smithi149.stdout:5/721: dwrite d3/d10/d32/d54/d76/f89 [0,4194304] 0 2024-09-13T18:30:28.000 INFO:tasks.workunit.client.0.smithi038.stdout:3/64: dread d0/dd/d17/f18 [0,4194304] 0 2024-09-13T18:30:28.001 INFO:tasks.workunit.client.0.smithi038.stdout:3/65: write d0/fc [40341,40637] 0 2024-09-13T18:30:28.004 INFO:tasks.workunit.client.0.smithi038.stdout:8/237: dwrite d1/d8/f51 [0,4194304] 0 2024-09-13T18:30:28.005 INFO:tasks.workunit.client.0.smithi038.stdout:8/238: dread - d1/d4/f47 zero size 2024-09-13T18:30:28.005 INFO:tasks.workunit.client.1.smithi149.stdout:9/622: dread d0/d9e/f3f [0,4194304] 0 2024-09-13T18:30:28.005 INFO:tasks.workunit.client.1.smithi149.stdout:1/777: creat d9/d15/d60/d80/d8b/ff4 x:0 0 0 2024-09-13T18:30:28.005 INFO:tasks.workunit.client.1.smithi149.stdout:9/623: chown d0/l16 36659 1 2024-09-13T18:30:28.005 INFO:tasks.workunit.client.1.smithi149.stdout:9/624: write d0/d2e/f43 [1857443,17642] 0 2024-09-13T18:30:28.006 INFO:tasks.workunit.client.0.smithi038.stdout:9/118: rmdir d0/d7 39 2024-09-13T18:30:28.006 INFO:tasks.workunit.client.0.smithi038.stdout:5/68: sync 2024-09-13T18:30:28.006 INFO:tasks.workunit.client.0.smithi038.stdout:4/212: sync 2024-09-13T18:30:28.006 INFO:tasks.workunit.client.0.smithi038.stdout:4/213: stat d2/df/d22/f29 0 2024-09-13T18:30:28.007 INFO:tasks.workunit.client.1.smithi149.stdout:1/778: dread d9/d10/d34/d53/f82 [0,4194304] 0 2024-09-13T18:30:28.007 INFO:tasks.workunit.client.1.smithi149.stdout:8/790: dread d2/d12/d6e/fe6 [0,4194304] 0 2024-09-13T18:30:28.010 INFO:tasks.workunit.client.0.smithi038.stdout:3/66: dread d0/fa [0,4194304] 0 2024-09-13T18:30:28.014 INFO:tasks.workunit.client.0.smithi038.stdout:3/67: read d0/f2 [769619,122156] 0 2024-09-13T18:30:28.015 INFO:tasks.workunit.client.0.smithi038.stdout:3/68: creat d0/dd/d17/f1c x:0 0 0 2024-09-13T18:30:28.016 INFO:tasks.workunit.client.1.smithi149.stdout:2/684: dwrite db/d1b/d1c/d20/d2b/d3e/de4/fe5 [0,4194304] 0 2024-09-13T18:30:28.017 INFO:tasks.workunit.client.0.smithi038.stdout:3/69: dread d0/dd/d17/f18 [0,4194304] 0 2024-09-13T18:30:28.027 INFO:tasks.workunit.client.1.smithi149.stdout:7/880: dwrite d7/d9/d1c/d1f/d21/d49/d102/d10f/d10b/f112 [0,4194304] 0 2024-09-13T18:30:28.027 INFO:tasks.workunit.client.1.smithi149.stdout:7/881: fsync d7/d12/f125 0 2024-09-13T18:30:28.028 INFO:tasks.workunit.client.0.smithi038.stdout:1/93: getdents d12 0 2024-09-13T18:30:28.028 INFO:tasks.workunit.client.0.smithi038.stdout:0/92: dwrite d2/dc/f14 [0,4194304] 0 2024-09-13T18:30:28.031 INFO:tasks.workunit.client.1.smithi149.stdout:7/882: dread d7/d9/d1c/d51/d52/d86/d9f/fd4 [0,4194304] 0 2024-09-13T18:30:28.032 INFO:tasks.workunit.client.0.smithi038.stdout:6/132: rmdir dd/de/d2e/d30/d27 39 2024-09-13T18:30:28.034 INFO:tasks.workunit.client.0.smithi038.stdout:8/239: symlink d1/de/d15/d30/l57 0 2024-09-13T18:30:28.034 INFO:tasks.workunit.client.0.smithi038.stdout:8/240: chown d1/de/d21 6024 1 2024-09-13T18:30:28.034 INFO:tasks.workunit.client.0.smithi038.stdout:8/241: readlink d1/l6 0 2024-09-13T18:30:28.037 INFO:tasks.workunit.client.1.smithi149.stdout:2/685: dwrite f6 [4194304,4194304] 0 2024-09-13T18:30:28.040 INFO:tasks.workunit.client.1.smithi149.stdout:1/779: mknod d9/d10/d62/cf5 0 2024-09-13T18:30:28.040 INFO:tasks.workunit.client.0.smithi038.stdout:4/214: getdents d2/df/d22 0 2024-09-13T18:30:28.050 INFO:tasks.workunit.client.0.smithi038.stdout:1/94: rename d12/f19 to d12/d15/f1e 0 2024-09-13T18:30:28.050 INFO:tasks.workunit.client.0.smithi038.stdout:1/95: stat d12 0 2024-09-13T18:30:28.055 INFO:tasks.workunit.client.0.smithi038.stdout:0/93: unlink d2/fa 0 2024-09-13T18:30:28.062 INFO:tasks.workunit.client.1.smithi149.stdout:2/686: dwrite db/d1b/d2f/d69/f5c [0,4194304] 0 2024-09-13T18:30:28.062 INFO:tasks.workunit.client.0.smithi038.stdout:5/69: dwrite f3 [4194304,4194304] 0 2024-09-13T18:30:28.063 INFO:tasks.workunit.client.0.smithi038.stdout:5/70: write df/f11 [684198,111410] 0 2024-09-13T18:30:28.063 INFO:tasks.workunit.client.0.smithi038.stdout:9/119: mknod d0/d7/d13/c2b 0 2024-09-13T18:30:28.065 INFO:tasks.workunit.client.1.smithi149.stdout:2/687: dread db/d10/f4e [0,4194304] 0 2024-09-13T18:30:28.065 INFO:tasks.workunit.client.1.smithi149.stdout:2/688: chown db/d1b/d48/fd9 1 1 2024-09-13T18:30:28.067 INFO:tasks.workunit.client.0.smithi038.stdout:9/120: dread d0/f6 [0,4194304] 0 2024-09-13T18:30:28.067 INFO:tasks.workunit.client.0.smithi038.stdout:4/215: creat d2/df/d22/f40 x:0 0 0 2024-09-13T18:30:28.069 INFO:tasks.workunit.client.0.smithi038.stdout:1/96: chown d12/f16 0 1 2024-09-13T18:30:28.072 INFO:tasks.workunit.client.1.smithi149.stdout:7/883: mknod d7/d76/db3/d31/ddb/c134 0 2024-09-13T18:30:28.076 INFO:tasks.workunit.client.1.smithi149.stdout:9/625: unlink d0/d18/c26 0 2024-09-13T18:30:28.077 INFO:tasks.workunit.client.0.smithi038.stdout:2/68: sync 2024-09-13T18:30:28.079 INFO:tasks.workunit.client.1.smithi149.stdout:1/780: symlink d9/lf6 0 2024-09-13T18:30:28.079 INFO:tasks.workunit.client.1.smithi149.stdout:1/781: write d9/d10/d34/dbe/d38/f4e [3022346,117019] 0 2024-09-13T18:30:28.080 INFO:tasks.workunit.client.1.smithi149.stdout:8/791: truncate d2/d12/f16 808302 0 2024-09-13T18:30:28.082 INFO:tasks.workunit.client.0.smithi038.stdout:1/97: rename cd to d12/c1f 0 2024-09-13T18:30:28.082 INFO:tasks.workunit.client.0.smithi038.stdout:1/98: read d12/f16 [82390,34557] 0 2024-09-13T18:30:28.083 INFO:tasks.workunit.client.0.smithi038.stdout:2/69: symlink d2/da/l19 0 2024-09-13T18:30:28.084 INFO:tasks.workunit.client.0.smithi038.stdout:7/111: sync 2024-09-13T18:30:28.086 INFO:tasks.workunit.client.0.smithi038.stdout:0/94: dwrite d2/dc/f11 [0,4194304] 0 2024-09-13T18:30:28.087 INFO:tasks.workunit.client.0.smithi038.stdout:2/70: mkdir d2/da/d1a 0 2024-09-13T18:30:28.087 INFO:tasks.workunit.client.1.smithi149.stdout:3/751: sync 2024-09-13T18:30:28.087 INFO:tasks.workunit.client.1.smithi149.stdout:6/862: sync 2024-09-13T18:30:28.088 INFO:tasks.workunit.client.1.smithi149.stdout:6/863: fdatasync dc/d15/d23/f3e 0 2024-09-13T18:30:28.096 INFO:tasks.workunit.client.0.smithi038.stdout:0/95: rename d2/lf to d2/d7/d24/l25 0 2024-09-13T18:30:28.099 INFO:tasks.workunit.client.0.smithi038.stdout:2/71: link d2/f8 d2/da/f1b 0 2024-09-13T18:30:28.101 INFO:tasks.workunit.client.0.smithi038.stdout:5/71: dwrite f9 [0,4194304] 0 2024-09-13T18:30:28.101 INFO:tasks.workunit.client.0.smithi038.stdout:5/72: chown df/l12 334639 1 2024-09-13T18:30:28.102 INFO:tasks.workunit.client.1.smithi149.stdout:3/752: mknod d1/d2c/d38/d8d/c105 0 2024-09-13T18:30:28.105 INFO:tasks.workunit.client.1.smithi149.stdout:4/817: rename df/da0/d12/d17 to df/da0/d112 0 2024-09-13T18:30:28.105 INFO:tasks.workunit.client.1.smithi149.stdout:4/818: creat df/da0/d12/d7c/d9a/f113 x:0 0 0 2024-09-13T18:30:28.106 INFO:tasks.workunit.client.1.smithi149.stdout:1/782: write d9/d10/d34/dbe/f5a [882912,89275] 0 2024-09-13T18:30:28.106 INFO:tasks.workunit.client.1.smithi149.stdout:1/783: read - d9/d10/d34/d53/f5f zero size 2024-09-13T18:30:28.107 INFO:tasks.workunit.client.0.smithi038.stdout:0/96: rename d2/f4 to d2/f26 0 2024-09-13T18:30:28.107 INFO:tasks.workunit.client.0.smithi038.stdout:0/97: truncate d2/f15 5451987 0 2024-09-13T18:30:28.110 INFO:tasks.workunit.client.0.smithi038.stdout:7/112: write db/d12/d1a/f1f [1837603,125905] 0 2024-09-13T18:30:28.111 INFO:tasks.workunit.client.1.smithi149.stdout:9/626: rename d0/d18/d27/d5c/d99/la3 to d0/d18/d27/d5c/d79/lc6 0 2024-09-13T18:30:28.111 INFO:tasks.workunit.client.0.smithi038.stdout:9/121: dwrite d0/f11 [0,4194304] 0 2024-09-13T18:30:28.113 INFO:tasks.workunit.client.1.smithi149.stdout:6/864: write dc/d2f/fc6 [3563919,25966] 0 2024-09-13T18:30:28.113 INFO:tasks.workunit.client.1.smithi149.stdout:6/865: write dc/d15/d23/d57/da5/fed [2169340,52902] 0 2024-09-13T18:30:28.116 INFO:tasks.workunit.client.0.smithi038.stdout:5/73: unlink df/f19 0 2024-09-13T18:30:28.117 INFO:tasks.workunit.client.1.smithi149.stdout:1/784: getdents d9/d10/d34/d3c 0 2024-09-13T18:30:28.124 INFO:tasks.workunit.client.0.smithi038.stdout:7/113: symlink db/d12/d1a/d22/d28/l2a 0 2024-09-13T18:30:28.126 INFO:tasks.workunit.client.1.smithi149.stdout:3/753: dread d1/d2e/f37 [4194304,4194304] 0 2024-09-13T18:30:28.126 INFO:tasks.workunit.client.1.smithi149.stdout:6/866: mkdir dc/d15/daa/de5/de6/d113 0 2024-09-13T18:30:28.126 INFO:tasks.workunit.client.1.smithi149.stdout:3/754: dread - d1/d12/db9/fbc zero size 2024-09-13T18:30:28.126 INFO:tasks.workunit.client.1.smithi149.stdout:4/819: dwrite df/da0/d70/f102 [0,4194304] 0 2024-09-13T18:30:28.127 INFO:tasks.workunit.client.0.smithi038.stdout:9/122: truncate d0/d7/f23 778686 0 2024-09-13T18:30:28.128 INFO:tasks.workunit.client.0.smithi038.stdout:4/216: dwrite d2/df/d22/f29 [0,4194304] 0 2024-09-13T18:30:28.128 INFO:tasks.workunit.client.0.smithi038.stdout:4/217: chown d2/df 18627 1 2024-09-13T18:30:28.132 INFO:tasks.workunit.client.0.smithi038.stdout:9/123: mkdir d0/d7/d2c 0 2024-09-13T18:30:28.132 INFO:tasks.workunit.client.0.smithi038.stdout:1/99: dwrite d12/f1c [0,4194304] 0 2024-09-13T18:30:28.133 INFO:tasks.workunit.client.1.smithi149.stdout:8/792: dwrite d2/d12/dd8/d58/feb [0,4194304] 0 2024-09-13T18:30:28.133 INFO:tasks.workunit.client.1.smithi149.stdout:6/867: rename dc/d15/d23/dcd/fd7 to dc/d15/d54/da9/f114 0 2024-09-13T18:30:28.134 INFO:tasks.workunit.client.0.smithi038.stdout:7/114: dread db/d12/d13/f1b [0,4194304] 0 2024-09-13T18:30:28.136 INFO:tasks.workunit.client.1.smithi149.stdout:8/793: write d2/d12/dd8/f4c [2758315,72891] 0 2024-09-13T18:30:28.136 INFO:tasks.workunit.client.1.smithi149.stdout:8/794: write d2/d12/d6e/f91 [1522022,87099] 0 2024-09-13T18:30:28.137 INFO:tasks.workunit.client.1.smithi149.stdout:4/820: getdents df/da0/d112 0 2024-09-13T18:30:28.137 INFO:tasks.workunit.client.1.smithi149.stdout:4/821: truncate df/da0/d12/ff8 837572 0 2024-09-13T18:30:28.137 INFO:tasks.workunit.client.1.smithi149.stdout:4/822: fdatasync df/da0/f80 0 2024-09-13T18:30:28.137 INFO:tasks.workunit.client.1.smithi149.stdout:4/823: creat df/da0/d70/db5/dc7/f114 x:0 0 0 2024-09-13T18:30:28.138 INFO:tasks.workunit.client.0.smithi038.stdout:1/100: dread f3 [0,4194304] 0 2024-09-13T18:30:28.140 INFO:tasks.workunit.client.0.smithi038.stdout:4/218: write d2/f2f [4028945,93792] 0 2024-09-13T18:30:28.141 INFO:tasks.workunit.client.0.smithi038.stdout:0/98: rename d2/f26 to d2/d7/f27 0 2024-09-13T18:30:28.141 INFO:tasks.workunit.client.1.smithi149.stdout:0/815: sync 2024-09-13T18:30:28.142 INFO:tasks.workunit.client.1.smithi149.stdout:5/722: sync 2024-09-13T18:30:28.143 INFO:tasks.workunit.client.0.smithi038.stdout:9/124: truncate d0/d7/d21/f25 742724 0 2024-09-13T18:30:28.143 INFO:tasks.workunit.client.0.smithi038.stdout:9/125: dread - d0/d7/d13/f17 zero size 2024-09-13T18:30:28.143 INFO:tasks.workunit.client.0.smithi038.stdout:9/126: chown d0/l1f 364 1 2024-09-13T18:30:28.143 INFO:tasks.workunit.client.0.smithi038.stdout:2/72: dwrite d2/f12 [0,4194304] 0 2024-09-13T18:30:28.143 INFO:tasks.workunit.client.0.smithi038.stdout:2/73: fdatasync d2/da/f1b 0 2024-09-13T18:30:28.144 INFO:tasks.workunit.client.1.smithi149.stdout:9/627: dwrite d0/f67 [0,4194304] 0 2024-09-13T18:30:28.144 INFO:tasks.workunit.client.1.smithi149.stdout:3/755: rename d1/d2c/d42/l7e to d1/d2e/d1d/d6c/dcd/l106 0 2024-09-13T18:30:28.146 INFO:tasks.workunit.client.1.smithi149.stdout:1/785: dwrite d9/d10/d83/d97/f69 [0,4194304] 0 2024-09-13T18:30:28.148 INFO:tasks.workunit.client.0.smithi038.stdout:9/127: dread d0/d7/d13/f1e [0,4194304] 0 2024-09-13T18:30:28.148 INFO:tasks.workunit.client.1.smithi149.stdout:6/868: unlink dc/l11 0 2024-09-13T18:30:28.150 INFO:tasks.workunit.client.0.smithi038.stdout:1/101: write d12/f17 [277444,48222] 0 2024-09-13T18:30:28.151 INFO:tasks.workunit.client.1.smithi149.stdout:0/816: dread d1/d29/d31/f52 [0,4194304] 0 2024-09-13T18:30:28.151 INFO:tasks.workunit.client.1.smithi149.stdout:0/817: write d1/fbf [1442060,51200] 0 2024-09-13T18:30:28.151 INFO:tasks.workunit.client.1.smithi149.stdout:0/818: fsync d1/d2/d8a/fd0 0 2024-09-13T18:30:28.153 INFO:tasks.workunit.client.1.smithi149.stdout:4/824: mkdir df/da0/d12/d21/d22/d30/d56/d115 0 2024-09-13T18:30:28.161 INFO:tasks.workunit.client.1.smithi149.stdout:8/795: dwrite d2/d12/dd8/d58/d97/fa0 [0,4194304] 0 2024-09-13T18:30:28.177 INFO:tasks.workunit.client.1.smithi149.stdout:9/628: dwrite d0/d2e/d42/d70/d84/fac [0,4194304] 0 2024-09-13T18:30:28.179 INFO:tasks.workunit.client.1.smithi149.stdout:3/756: dwrite d1/d2e/d1d/d49/fbf [0,4194304] 0 2024-09-13T18:30:28.179 INFO:tasks.workunit.client.1.smithi149.stdout:3/757: readlink d1/d2c/d38/l3b 0 2024-09-13T18:30:28.179 INFO:tasks.workunit.client.1.smithi149.stdout:3/758: fdatasync d1/d2e/d1d/d9a/fd 0 2024-09-13T18:30:28.180 INFO:tasks.workunit.client.0.smithi038.stdout:5/74: dwrite f1 [4194304,4194304] 0 2024-09-13T18:30:28.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:27 smithi149 ceph-mon[35845]: pgmap v16: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 116 MiB/s rd, 147 MiB/s wr, 508 op/s 2024-09-13T18:30:28.297 INFO:tasks.workunit.client.1.smithi149.stdout:5/723: mkdir d3/d10/d32/d67/d83/de2 0 2024-09-13T18:30:28.302 INFO:tasks.workunit.client.0.smithi038.stdout:2/74: creat d2/da/d16/f1c x:0 0 0 2024-09-13T18:30:28.307 INFO:tasks.workunit.client.0.smithi038.stdout:9/128: mkdir d0/d7/d13/d2d 0 2024-09-13T18:30:28.308 INFO:tasks.workunit.client.0.smithi038.stdout:9/129: readlink d0/d7/d13/l14 0 2024-09-13T18:30:28.309 INFO:tasks.workunit.client.0.smithi038.stdout:1/102: truncate fb 3522492 0 2024-09-13T18:30:28.313 INFO:tasks.workunit.client.0.smithi038.stdout:4/219: rename d2/df/d22/dc/d8/f12 to d2/f41 0 2024-09-13T18:30:28.313 INFO:tasks.workunit.client.0.smithi038.stdout:4/220: truncate d2/df/d22/f40 830819 0 2024-09-13T18:30:28.314 INFO:tasks.workunit.client.0.smithi038.stdout:0/99: dwrite d2/dc/f11 [0,4194304] 0 2024-09-13T18:30:28.315 INFO:tasks.workunit.client.1.smithi149.stdout:1/786: symlink d9/d15/d60/d80/d8b/d42/lf7 0 2024-09-13T18:30:28.316 INFO:tasks.workunit.client.0.smithi038.stdout:5/75: truncate f8 1968531 0 2024-09-13T18:30:28.317 INFO:tasks.workunit.client.0.smithi038.stdout:5/76: creat df/f1b x:0 0 0 2024-09-13T18:30:28.317 INFO:tasks.workunit.client.0.smithi038.stdout:5/77: fdatasync df/f10 0 2024-09-13T18:30:28.318 INFO:tasks.workunit.client.1.smithi149.stdout:6/869: link dc/d15/d54/d85/dcc/ldf dc/d15/d23/d5f/dac/l115 0 2024-09-13T18:30:28.318 INFO:tasks.workunit.client.1.smithi149.stdout:6/870: dread - dc/d15/d54/d85/dcc/fe2 zero size 2024-09-13T18:30:28.321 INFO:tasks.workunit.client.0.smithi038.stdout:1/103: dread f8 [4194304,4194304] 0 2024-09-13T18:30:28.324 INFO:tasks.workunit.client.1.smithi149.stdout:0/819: link d1/l74 d1/d29/d31/d83/d87/l11a 0 2024-09-13T18:30:28.324 INFO:tasks.workunit.client.0.smithi038.stdout:5/78: dread df/f10 [0,4194304] 0 2024-09-13T18:30:28.326 INFO:tasks.workunit.client.1.smithi149.stdout:4/825: symlink df/da0/d112/l116 0 2024-09-13T18:30:28.326 INFO:tasks.workunit.client.1.smithi149.stdout:4/826: dread - df/da0/d70/db5/db9/f10a zero size 2024-09-13T18:30:28.326 INFO:tasks.workunit.client.0.smithi038.stdout:4/221: read d2/df/d22/f29 [2045183,48143] 0 2024-09-13T18:30:28.329 INFO:tasks.workunit.client.1.smithi149.stdout:8/796: symlink d2/d13/l10d 0 2024-09-13T18:30:28.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:27 smithi038 ceph-mon[27689]: pgmap v16: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 116 MiB/s rd, 147 MiB/s wr, 508 op/s 2024-09-13T18:30:28.332 INFO:tasks.workunit.client.0.smithi038.stdout:2/75: creat d2/da/f1d x:0 0 0 2024-09-13T18:30:28.332 INFO:tasks.workunit.client.0.smithi038.stdout:2/76: dread - d2/da/f1d zero size 2024-09-13T18:30:28.332 INFO:tasks.workunit.client.0.smithi038.stdout:2/77: write d2/da/fd [720460,64592] 0 2024-09-13T18:30:28.336 INFO:tasks.workunit.client.1.smithi149.stdout:9/629: mknod d0/d2e/d42/d70/d84/cc7 0 2024-09-13T18:30:28.337 INFO:tasks.workunit.client.1.smithi149.stdout:2/689: sync 2024-09-13T18:30:28.337 INFO:tasks.workunit.client.1.smithi149.stdout:2/690: creat db/d1b/fe9 x:0 0 0 2024-09-13T18:30:28.337 INFO:tasks.workunit.client.1.smithi149.stdout:2/691: readlink db/d13/d70/d89/lcb 0 2024-09-13T18:30:28.337 INFO:tasks.workunit.client.1.smithi149.stdout:2/692: write db/d1b/d1c/d20/d3a/f3f [1667988,98544] 0 2024-09-13T18:30:28.338 INFO:tasks.workunit.client.0.smithi038.stdout:0/100: creat d2/dc/f28 x:0 0 0 2024-09-13T18:30:28.340 INFO:tasks.workunit.client.1.smithi149.stdout:3/759: symlink d1/d12/d20/d54/l107 0 2024-09-13T18:30:28.340 INFO:tasks.workunit.client.1.smithi149.stdout:3/760: chown d1/d2e/d1d/d49 1038454 1 2024-09-13T18:30:28.342 INFO:tasks.workunit.client.0.smithi038.stdout:1/104: readlink d12/d15/l1b 0 2024-09-13T18:30:28.342 INFO:tasks.workunit.client.1.smithi149.stdout:5/724: mknod d3/d10/d32/d54/db9/ce3 0 2024-09-13T18:30:28.343 INFO:tasks.workunit.client.1.smithi149.stdout:4/827: dread df/da0/d1c/f23 [0,4194304] 0 2024-09-13T18:30:28.344 INFO:tasks.workunit.client.1.smithi149.stdout:1/787: unlink d9/d15/d60/da5/fc6 0 2024-09-13T18:30:28.344 INFO:tasks.workunit.client.1.smithi149.stdout:3/761: dread d1/d47/fd0 [0,4194304] 0 2024-09-13T18:30:28.347 INFO:tasks.workunit.client.1.smithi149.stdout:6/871: symlink dc/d15/d54/d85/l116 0 2024-09-13T18:30:28.348 INFO:tasks.workunit.client.1.smithi149.stdout:0/820: mknod d1/d2/d41/c11b 0 2024-09-13T18:30:28.348 INFO:tasks.workunit.client.1.smithi149.stdout:0/821: fdatasync d1/d29/d31/d44/d47/dfb/f10d 0 2024-09-13T18:30:28.348 INFO:tasks.workunit.client.1.smithi149.stdout:0/822: truncate d1/d48/d92/db4/dbe/fca 708929 0 2024-09-13T18:30:28.350 INFO:tasks.workunit.client.1.smithi149.stdout:9/630: rename d0/d18/d27/d5c/d7e/f85 to d0/d18/d68/db2/fc8 0 2024-09-13T18:30:28.351 INFO:tasks.workunit.client.1.smithi149.stdout:9/631: dread - d0/d9e/f80 zero size 2024-09-13T18:30:28.352 INFO:tasks.workunit.client.0.smithi038.stdout:4/222: creat d2/df/d22/dc/f42 x:0 0 0 2024-09-13T18:30:28.353 INFO:tasks.workunit.client.1.smithi149.stdout:7/884: sync 2024-09-13T18:30:28.355 INFO:tasks.workunit.client.0.smithi038.stdout:2/78: mkdir d2/d1e 0 2024-09-13T18:30:28.355 INFO:tasks.workunit.client.0.smithi038.stdout:2/79: readlink d2/l17 0 2024-09-13T18:30:28.357 INFO:tasks.workunit.client.1.smithi149.stdout:3/762: dread d1/d12/d20/d54/d6d/f72 [0,4194304] 0 2024-09-13T18:30:28.357 INFO:tasks.workunit.client.1.smithi149.stdout:3/763: read d1/d21/f27 [1266694,41466] 0 2024-09-13T18:30:28.358 INFO:tasks.workunit.client.0.smithi038.stdout:1/105: dread d12/f1c [0,4194304] 0 2024-09-13T18:30:28.358 INFO:tasks.workunit.client.0.smithi038.stdout:9/130: rename d0/d7/d21 to d0/d2e 0 2024-09-13T18:30:28.360 INFO:tasks.workunit.client.1.smithi149.stdout:4/828: creat df/da0/d12/d7c/f117 x:0 0 0 2024-09-13T18:30:28.360 INFO:tasks.workunit.client.1.smithi149.stdout:4/829: write df/da0/d1c/f23 [4864161,103647] 0 2024-09-13T18:30:28.361 INFO:tasks.workunit.client.0.smithi038.stdout:0/101: chown d2/dc/le 1 1 2024-09-13T18:30:28.363 INFO:tasks.workunit.client.1.smithi149.stdout:6/872: dread dc/d15/d54/d85/f89 [0,4194304] 0 2024-09-13T18:30:28.363 INFO:tasks.workunit.client.1.smithi149.stdout:6/873: stat dc/d15/d23/dcd/de1 0 2024-09-13T18:30:28.364 INFO:tasks.workunit.client.1.smithi149.stdout:6/874: stat dc/d15/d23/c61 0 2024-09-13T18:30:28.364 INFO:tasks.workunit.client.1.smithi149.stdout:1/788: mkdir d9/d10/d34/df8 0 2024-09-13T18:30:28.366 INFO:tasks.workunit.client.0.smithi038.stdout:2/80: mknod d2/da/d16/c1f 0 2024-09-13T18:30:28.368 INFO:tasks.workunit.client.0.smithi038.stdout:0/102: unlink d2/d7/l23 0 2024-09-13T18:30:28.368 INFO:tasks.workunit.client.1.smithi149.stdout:5/725: rename d3/d10/d4c/d4e/d61/d75/cce to d3/d10/d4c/d4e/d61/d63/ce4 0 2024-09-13T18:30:28.368 INFO:tasks.workunit.client.1.smithi149.stdout:5/726: dread - d3/d10/d4c/d4e/d61/d63/f9d zero size 2024-09-13T18:30:28.369 INFO:tasks.workunit.client.1.smithi149.stdout:9/632: truncate d0/d47/f65 2978989 0 2024-09-13T18:30:28.369 INFO:tasks.workunit.client.1.smithi149.stdout:9/633: fdatasync d0/d2e/d42/d59/d86/f9b 0 2024-09-13T18:30:28.369 INFO:tasks.workunit.client.0.smithi038.stdout:0/103: mknod d2/d7/d24/c29 0 2024-09-13T18:30:28.369 INFO:tasks.workunit.client.0.smithi038.stdout:0/104: write d2/d7/fb [4954988,95897] 0 2024-09-13T18:30:28.371 INFO:tasks.workunit.client.0.smithi038.stdout:1/106: write d12/f1c [3302036,2075] 0 2024-09-13T18:30:28.371 INFO:tasks.workunit.client.1.smithi149.stdout:4/830: mknod df/da0/d12/d21/d22/d30/d56/d91/c118 0 2024-09-13T18:30:28.372 INFO:tasks.workunit.client.0.smithi038.stdout:0/105: mknod d2/d7/c2a 0 2024-09-13T18:30:28.373 INFO:tasks.workunit.client.1.smithi149.stdout:6/875: getdents dc/d15/d23/d104 0 2024-09-13T18:30:28.373 INFO:tasks.workunit.client.1.smithi149.stdout:8/797: dwrite d2/d12/d2a/d4d/f103 [0,4194304] 0 2024-09-13T18:30:28.374 INFO:tasks.workunit.client.1.smithi149.stdout:8/798: chown d2/d12/f46 114433890 1 2024-09-13T18:30:28.376 INFO:tasks.workunit.client.1.smithi149.stdout:7/885: dread d7/d76/fb7 [4194304,4194304] 0 2024-09-13T18:30:28.376 INFO:tasks.workunit.client.1.smithi149.stdout:2/693: dwrite db/d1b/fd3 [0,4194304] 0 2024-09-13T18:30:28.376 INFO:tasks.workunit.client.1.smithi149.stdout:2/694: chown db/d1b/d1c/d85/ca1 98798720 1 2024-09-13T18:30:28.377 INFO:tasks.workunit.client.0.smithi038.stdout:4/223: dread d2/df/d1b/d10/f25 [0,4194304] 0 2024-09-13T18:30:28.378 INFO:tasks.workunit.client.1.smithi149.stdout:0/823: rename d1/d29/d31/d44/d81/d62/f6c to d1/d29/d31/d44/d47/f11c 0 2024-09-13T18:30:28.379 INFO:tasks.workunit.client.1.smithi149.stdout:0/824: chown d1/d2/d8a/d90/f68 7 1 2024-09-13T18:30:28.379 INFO:tasks.workunit.client.1.smithi149.stdout:0/825: chown d1/d2/d8a/d90/fff 34968 1 2024-09-13T18:30:28.379 INFO:tasks.workunit.client.1.smithi149.stdout:0/826: fdatasync d1/d29/d31/d44/d81/f85 0 2024-09-13T18:30:28.380 INFO:tasks.workunit.client.1.smithi149.stdout:5/727: creat d3/d10/d4c/d4e/fe5 x:0 0 0 2024-09-13T18:30:28.380 INFO:tasks.workunit.client.1.smithi149.stdout:5/728: fsync d3/d10/d4c/d4e/d61/d75/d88/faf 0 2024-09-13T18:30:28.380 INFO:tasks.workunit.client.0.smithi038.stdout:1/107: creat d12/d15/f20 x:0 0 0 2024-09-13T18:30:28.380 INFO:tasks.workunit.client.0.smithi038.stdout:1/108: creat d12/d15/f21 x:0 0 0 2024-09-13T18:30:28.381 INFO:tasks.workunit.client.1.smithi149.stdout:4/831: symlink df/da0/d70/l119 0 2024-09-13T18:30:28.383 INFO:tasks.workunit.client.0.smithi038.stdout:0/106: mkdir d2/d7/d24/d2b 0 2024-09-13T18:30:28.386 INFO:tasks.workunit.client.0.smithi038.stdout:5/79: getdents df 0 2024-09-13T18:30:28.390 INFO:tasks.workunit.client.1.smithi149.stdout:3/764: dwrite d1/d2e/d1d/d49/fbf [0,4194304] 0 2024-09-13T18:30:28.392 INFO:tasks.workunit.client.1.smithi149.stdout:6/876: creat dc/d15/f117 x:0 0 0 2024-09-13T18:30:28.393 INFO:tasks.workunit.client.0.smithi038.stdout:9/131: dread d0/ff [0,4194304] 0 2024-09-13T18:30:28.393 INFO:tasks.workunit.client.0.smithi038.stdout:9/132: readlink d0/l1c 0 2024-09-13T18:30:28.393 INFO:tasks.workunit.client.0.smithi038.stdout:9/133: truncate d0/d2e/f27 911045 0 2024-09-13T18:30:28.393 INFO:tasks.workunit.client.0.smithi038.stdout:0/107: link d2/dc/l22 d2/d7/l2c 0 2024-09-13T18:30:28.395 INFO:tasks.workunit.client.0.smithi038.stdout:9/134: getdents d0/d2e 0 2024-09-13T18:30:28.398 INFO:tasks.workunit.client.0.smithi038.stdout:9/135: creat d0/f2f x:0 0 0 2024-09-13T18:30:28.398 INFO:tasks.workunit.client.0.smithi038.stdout:9/136: fsync d0/ff 0 2024-09-13T18:30:28.399 INFO:tasks.workunit.client.0.smithi038.stdout:5/80: read f8 [1147345,112989] 0 2024-09-13T18:30:28.400 INFO:tasks.workunit.client.1.smithi149.stdout:4/832: mkdir df/da0/d12/d21/d22/d30/d41/d110/d11a 0 2024-09-13T18:30:28.402 INFO:tasks.workunit.client.0.smithi038.stdout:9/137: mkdir d0/d7/d13/d30 0 2024-09-13T18:30:28.406 INFO:tasks.workunit.client.0.smithi038.stdout:5/81: mknod df/d13/c1c 0 2024-09-13T18:30:28.407 INFO:tasks.workunit.client.0.smithi038.stdout:9/138: rmdir d0/d7 39 2024-09-13T18:30:28.408 INFO:tasks.workunit.client.0.smithi038.stdout:2/81: dwrite d2/f12 [0,4194304] 0 2024-09-13T18:30:28.408 INFO:tasks.workunit.client.0.smithi038.stdout:2/82: chown d2/f12 2652 1 2024-09-13T18:30:28.409 INFO:tasks.workunit.client.1.smithi149.stdout:6/877: read dc/d70/f97 [4188293,29901] 0 2024-09-13T18:30:28.409 INFO:tasks.workunit.client.1.smithi149.stdout:6/878: truncate dc/d70/dbc/f88 4455110 0 2024-09-13T18:30:28.411 INFO:tasks.workunit.client.1.smithi149.stdout:5/729: link d3/d8/f1e d3/d10/d32/d54/d76/d7a/fe6 0 2024-09-13T18:30:28.412 INFO:tasks.workunit.client.1.smithi149.stdout:2/695: write db/d13/d70/fa7 [771087,43750] 0 2024-09-13T18:30:28.413 INFO:tasks.workunit.client.1.smithi149.stdout:4/833: mkdir df/da0/d12/d7c/d109/d11b 0 2024-09-13T18:30:28.415 INFO:tasks.workunit.client.1.smithi149.stdout:6/879: mkdir dc/d15/d23/d104/da1/dcb/d118 0 2024-09-13T18:30:28.416 INFO:tasks.workunit.client.1.smithi149.stdout:6/880: chown dc/d15/d23/d5b/d91/db0 5529451 1 2024-09-13T18:30:28.418 INFO:tasks.workunit.client.1.smithi149.stdout:5/730: mkdir d3/d10/d32/d54/d97/de7 0 2024-09-13T18:30:28.418 INFO:tasks.workunit.client.1.smithi149.stdout:5/731: fdatasync d3/d8/f27 0 2024-09-13T18:30:28.420 INFO:tasks.workunit.client.0.smithi038.stdout:5/82: dread f1 [4194304,4194304] 0 2024-09-13T18:30:28.423 INFO:tasks.workunit.client.1.smithi149.stdout:2/696: unlink db/d10/da9/ddb/ce0 0 2024-09-13T18:30:28.423 INFO:tasks.workunit.client.1.smithi149.stdout:2/697: fsync db/d1b/d6c/f73 0 2024-09-13T18:30:28.424 INFO:tasks.workunit.client.1.smithi149.stdout:4/834: rename fe to df/da0/d12/d21/d22/d30/d41/d57/d60/f11c 0 2024-09-13T18:30:28.427 INFO:tasks.workunit.client.1.smithi149.stdout:6/881: symlink dc/d15/d23/l119 0 2024-09-13T18:30:28.428 INFO:tasks.workunit.client.0.smithi038.stdout:2/83: mknod d2/d1e/c20 0 2024-09-13T18:30:28.429 INFO:tasks.workunit.client.0.smithi038.stdout:2/84: creat d2/da/d16/f21 x:0 0 0 2024-09-13T18:30:28.429 INFO:tasks.workunit.client.1.smithi149.stdout:2/698: rmdir db/d1b/d2f 39 2024-09-13T18:30:28.431 INFO:tasks.workunit.client.0.smithi038.stdout:9/139: truncate d0/f8 1120783 0 2024-09-13T18:30:28.432 INFO:tasks.workunit.client.1.smithi149.stdout:4/835: unlink df/da0/d12/d21/d22/f96 0 2024-09-13T18:30:28.433 INFO:tasks.workunit.client.1.smithi149.stdout:3/765: dwrite d1/d2e/d93/fcb [0,4194304] 0 2024-09-13T18:30:28.434 INFO:tasks.workunit.client.0.smithi038.stdout:5/83: truncate f8 809579 0 2024-09-13T18:30:28.434 INFO:tasks.workunit.client.0.smithi038.stdout:5/84: truncate fd 111275 0 2024-09-13T18:30:28.435 INFO:tasks.workunit.client.1.smithi149.stdout:4/836: symlink df/da0/d1c/d7e/l11d 0 2024-09-13T18:30:28.435 INFO:tasks.workunit.client.1.smithi149.stdout:4/837: write df/da0/d70/db5/dc7/f114 [924005,65792] 0 2024-09-13T18:30:28.435 INFO:tasks.workunit.client.1.smithi149.stdout:4/838: creat df/da0/d12/d7c/f11e x:0 0 0 2024-09-13T18:30:28.436 INFO:tasks.workunit.client.1.smithi149.stdout:1/789: dwrite d9/d10/f1a [0,4194304] 0 2024-09-13T18:30:28.437 INFO:tasks.workunit.client.1.smithi149.stdout:0/827: dwrite d1/d29/d31/d44/d81/f97 [0,4194304] 0 2024-09-13T18:30:28.437 INFO:tasks.workunit.client.1.smithi149.stdout:6/882: rename dc/d15/d23/f27 to dc/d2f/f11a 0 2024-09-13T18:30:28.438 INFO:tasks.workunit.client.0.smithi038.stdout:5/85: dread f2 [0,4194304] 0 2024-09-13T18:30:28.438 INFO:tasks.workunit.client.0.smithi038.stdout:4/224: dwrite d2/df/d22/dc/f16 [4194304,4194304] 0 2024-09-13T18:30:28.439 INFO:tasks.workunit.client.1.smithi149.stdout:1/790: dread d9/d15/d60/da5/fd4 [0,4194304] 0 2024-09-13T18:30:28.439 INFO:tasks.workunit.client.1.smithi149.stdout:1/791: fdatasync d9/d15/d40/d90/fdc 0 2024-09-13T18:30:28.439 INFO:tasks.workunit.client.1.smithi149.stdout:1/792: stat d9/d10/d34/dbe/dd7 0 2024-09-13T18:30:28.440 INFO:tasks.workunit.client.0.smithi038.stdout:9/140: dread d0/d7/f23 [0,4194304] 0 2024-09-13T18:30:28.440 INFO:tasks.workunit.client.0.smithi038.stdout:4/225: dread d2/df/d22/f40 [0,4194304] 0 2024-09-13T18:30:28.441 INFO:tasks.workunit.client.1.smithi149.stdout:4/839: mkdir df/da0/d12/d21/d22/d30/d41/d57/d60/d11f 0 2024-09-13T18:30:28.442 INFO:tasks.workunit.client.1.smithi149.stdout:4/840: chown df/da0/l66 26 1 2024-09-13T18:30:28.443 INFO:tasks.workunit.client.0.smithi038.stdout:0/108: dwrite d2/d7/f27 [4194304,4194304] 0 2024-09-13T18:30:28.443 INFO:tasks.workunit.client.0.smithi038.stdout:2/85: read d2/f12 [3838350,109903] 0 2024-09-13T18:30:28.443 INFO:tasks.workunit.client.1.smithi149.stdout:3/766: rename d1/d2c/d38/d8d/fda to d1/d2e/d6f/daf/de8/f108 0 2024-09-13T18:30:28.443 INFO:tasks.workunit.client.1.smithi149.stdout:3/767: truncate d1/d48/f8f 924966 0 2024-09-13T18:30:28.444 INFO:tasks.workunit.client.1.smithi149.stdout:2/699: write db/d1b/d1c/d20/d2b/db7/f6d [3756685,120180] 0 2024-09-13T18:30:28.445 INFO:tasks.workunit.client.1.smithi149.stdout:8/799: dwrite d2/d12/d6e/f91 [0,4194304] 0 2024-09-13T18:30:28.445 INFO:tasks.workunit.client.1.smithi149.stdout:8/800: creat d2/d12/dd8/d58/f10e x:0 0 0 2024-09-13T18:30:28.445 INFO:tasks.workunit.client.1.smithi149.stdout:6/883: symlink dc/d15/d54/l11b 0 2024-09-13T18:30:28.446 INFO:tasks.workunit.client.1.smithi149.stdout:6/884: truncate dc/d15/d23/d5f/fdb 5014225 0 2024-09-13T18:30:28.446 INFO:tasks.workunit.client.1.smithi149.stdout:6/885: fsync dc/f1a 0 2024-09-13T18:30:28.446 INFO:tasks.workunit.client.1.smithi149.stdout:6/886: stat dc/d76 0 2024-09-13T18:30:28.446 INFO:tasks.workunit.client.1.smithi149.stdout:6/887: fsync dc/d15/d23/d5b/f81 0 2024-09-13T18:30:28.446 INFO:tasks.workunit.client.1.smithi149.stdout:6/888: truncate dc/d15/d54/da9/fc0 1066151 0 2024-09-13T18:30:28.446 INFO:tasks.workunit.client.1.smithi149.stdout:6/889: creat dc/d15/d23/d57/da5/dd8/f11c x:0 0 0 2024-09-13T18:30:28.447 INFO:tasks.workunit.client.0.smithi038.stdout:5/86: dread f9 [4194304,4194304] 0 2024-09-13T18:30:28.447 INFO:tasks.workunit.client.0.smithi038.stdout:0/109: truncate d2/d7/f1d 1488393 0 2024-09-13T18:30:28.447 INFO:tasks.workunit.client.0.smithi038.stdout:0/110: readlink l1 0 2024-09-13T18:30:28.447 INFO:tasks.workunit.client.0.smithi038.stdout:5/87: chown f9 13 1 2024-09-13T18:30:28.447 INFO:tasks.workunit.client.1.smithi149.stdout:5/732: dwrite d3/d8/d13/f18 [0,4194304] 0 2024-09-13T18:30:28.447 INFO:tasks.workunit.client.1.smithi149.stdout:1/793: mknod d9/d10/d3f/dc9/ddf/cf9 0 2024-09-13T18:30:28.447 INFO:tasks.workunit.client.1.smithi149.stdout:1/794: getdents d9/d10/d34/dbe/d38/df2 0 2024-09-13T18:30:28.448 INFO:tasks.workunit.client.0.smithi038.stdout:2/86: mknod d2/d1e/c22 0 2024-09-13T18:30:28.448 INFO:tasks.workunit.client.0.smithi038.stdout:2/87: readlink d2/l13 0 2024-09-13T18:30:28.448 INFO:tasks.workunit.client.0.smithi038.stdout:2/88: fdatasync d2/da/f1d 0 2024-09-13T18:30:28.448 INFO:tasks.workunit.client.1.smithi149.stdout:0/828: read d1/d29/d31/d44/d81/f63 [5692801,44574] 0 2024-09-13T18:30:28.449 INFO:tasks.workunit.client.1.smithi149.stdout:4/841: mknod df/da0/d112/d3d/c120 0 2024-09-13T18:30:28.450 INFO:tasks.workunit.client.0.smithi038.stdout:4/226: mknod d2/df/d22/c43 0 2024-09-13T18:30:28.451 INFO:tasks.workunit.client.1.smithi149.stdout:3/768: unlink d1/d2c/d42/ff7 0 2024-09-13T18:30:28.451 INFO:tasks.workunit.client.1.smithi149.stdout:3/769: chown d1/d2e/d1d/d9a/d39/c3d 3267 1 2024-09-13T18:30:28.451 INFO:tasks.workunit.client.1.smithi149.stdout:3/770: fdatasync d1/f85 0 2024-09-13T18:30:28.452 INFO:tasks.workunit.client.0.smithi038.stdout:0/111: creat d2/d7/d24/d2b/f2d x:0 0 0 2024-09-13T18:30:28.452 INFO:tasks.workunit.client.0.smithi038.stdout:0/112: write d2/d7/f27 [1333904,80631] 0 2024-09-13T18:30:28.453 INFO:tasks.workunit.client.0.smithi038.stdout:5/88: creat df/d15/f1d x:0 0 0 2024-09-13T18:30:28.454 INFO:tasks.workunit.client.1.smithi149.stdout:2/700: dread db/d10/d12/f43 [0,4194304] 0 2024-09-13T18:30:28.456 INFO:tasks.workunit.client.0.smithi038.stdout:2/89: link d2/l10 d2/da/d16/l23 0 2024-09-13T18:30:28.457 INFO:tasks.workunit.client.0.smithi038.stdout:2/90: creat d2/da/d16/f24 x:0 0 0 2024-09-13T18:30:28.460 INFO:tasks.workunit.client.1.smithi149.stdout:1/795: dread d9/d10/d34/d53/d57/f64 [0,4194304] 0 2024-09-13T18:30:28.460 INFO:tasks.workunit.client.1.smithi149.stdout:1/796: dread - d9/d10/d34/d53/d57/fc8 zero size 2024-09-13T18:30:28.460 INFO:tasks.workunit.client.0.smithi038.stdout:3/70: sync 2024-09-13T18:30:28.462 INFO:tasks.workunit.client.1.smithi149.stdout:8/801: mkdir d2/d10f 0 2024-09-13T18:30:28.463 INFO:tasks.workunit.client.0.smithi038.stdout:5/89: creat df/f1e x:0 0 0 2024-09-13T18:30:28.463 INFO:tasks.workunit.client.0.smithi038.stdout:5/90: chown df 1638 1 2024-09-13T18:30:28.468 INFO:tasks.workunit.client.0.smithi038.stdout:2/91: unlink d2/l10 0 2024-09-13T18:30:28.468 INFO:tasks.workunit.client.0.smithi038.stdout:2/92: write d2/da/f1b [4676247,130618] 0 2024-09-13T18:30:28.469 INFO:tasks.workunit.client.0.smithi038.stdout:0/113: rmdir d2/dc 39 2024-09-13T18:30:28.470 INFO:tasks.workunit.client.1.smithi149.stdout:2/701: dwrite db/d13/d70/f7c [4194304,4194304] 0 2024-09-13T18:30:28.471 INFO:tasks.workunit.client.0.smithi038.stdout:3/71: dread - d0/dd/d17/f1c zero size 2024-09-13T18:30:28.472 INFO:tasks.workunit.client.1.smithi149.stdout:8/802: write d2/d12/dd8/d58/d97/fa0 [3243823,54062] 0 2024-09-13T18:30:28.477 INFO:tasks.workunit.client.1.smithi149.stdout:8/803: dread d2/d13/f41 [0,4194304] 0 2024-09-13T18:30:28.479 INFO:tasks.workunit.client.0.smithi038.stdout:2/93: unlink d2/da/d16/f1c 0 2024-09-13T18:30:28.479 INFO:tasks.workunit.client.0.smithi038.stdout:2/94: creat d2/da/f25 x:0 0 0 2024-09-13T18:30:28.481 INFO:tasks.workunit.client.0.smithi038.stdout:0/114: dread - d2/dc/f17 zero size 2024-09-13T18:30:28.484 INFO:tasks.workunit.client.0.smithi038.stdout:2/95: fdatasync d2/f8 0 2024-09-13T18:30:28.484 INFO:tasks.workunit.client.0.smithi038.stdout:5/91: rename ca to df/d13/c1f 0 2024-09-13T18:30:28.485 INFO:tasks.workunit.client.0.smithi038.stdout:3/72: dwrite d0/fb [0,4194304] 0 2024-09-13T18:30:28.485 INFO:tasks.workunit.client.1.smithi149.stdout:8/804: dread d2/d12/f39 [0,4194304] 0 2024-09-13T18:30:28.489 INFO:tasks.workunit.client.0.smithi038.stdout:5/92: mknod df/c20 0 2024-09-13T18:30:28.489 INFO:tasks.workunit.client.0.smithi038.stdout:5/93: stat f2 0 2024-09-13T18:30:28.489 INFO:tasks.workunit.client.0.smithi038.stdout:5/94: stat df/c20 0 2024-09-13T18:30:28.492 INFO:tasks.workunit.client.0.smithi038.stdout:2/96: creat d2/f26 x:0 0 0 2024-09-13T18:30:28.492 INFO:tasks.workunit.client.0.smithi038.stdout:2/97: truncate d2/da/d16/f24 939298 0 2024-09-13T18:30:28.496 INFO:tasks.workunit.client.1.smithi149.stdout:8/805: write d2/d12/dd8/f23 [3108050,61607] 0 2024-09-13T18:30:28.497 INFO:tasks.workunit.client.1.smithi149.stdout:5/733: mkdir d3/d10/d4c/d4e/de8 0 2024-09-13T18:30:28.497 INFO:tasks.workunit.client.1.smithi149.stdout:5/734: truncate d3/d10/d32/d54/db9/fc6 798728 0 2024-09-13T18:30:28.498 INFO:tasks.workunit.client.1.smithi149.stdout:0/829: creat d1/d2/f11d x:0 0 0 2024-09-13T18:30:28.500 INFO:tasks.workunit.client.0.smithi038.stdout:0/115: dwrite d2/dc/f28 [0,4194304] 0 2024-09-13T18:30:28.500 INFO:tasks.workunit.client.0.smithi038.stdout:5/95: rename df/d13/f18 to df/d13/f21 0 2024-09-13T18:30:28.500 INFO:tasks.workunit.client.0.smithi038.stdout:5/96: write df/f10 [1974079,110155] 0 2024-09-13T18:30:28.501 INFO:tasks.workunit.client.1.smithi149.stdout:4/842: creat df/da0/d1c/f121 x:0 0 0 2024-09-13T18:30:28.501 INFO:tasks.workunit.client.1.smithi149.stdout:4/843: stat df/da0/d12/d7c/d9a/ffa 0 2024-09-13T18:30:28.501 INFO:tasks.workunit.client.0.smithi038.stdout:2/98: stat d2/da/d16/l23 0 2024-09-13T18:30:28.501 INFO:tasks.workunit.client.0.smithi038.stdout:2/99: truncate d2/da/d16/f24 1876341 0 2024-09-13T18:30:28.501 INFO:tasks.workunit.client.0.smithi038.stdout:2/100: stat d2/l4 0 2024-09-13T18:30:28.501 INFO:tasks.workunit.client.0.smithi038.stdout:2/101: truncate d2/da/d16/f21 794255 0 2024-09-13T18:30:28.503 INFO:tasks.workunit.client.0.smithi038.stdout:3/73: mkdir d0/dd/d19/d1d 0 2024-09-13T18:30:28.504 INFO:tasks.workunit.client.1.smithi149.stdout:1/797: link d9/d10/d34/c59 d9/d10/dca/cfa 0 2024-09-13T18:30:28.504 INFO:tasks.workunit.client.1.smithi149.stdout:1/798: chown d9/d10/d34/d3c/d50/fb9 128802789 1 2024-09-13T18:30:28.506 INFO:tasks.workunit.client.1.smithi149.stdout:6/890: mkdir dc/d15/d11d 0 2024-09-13T18:30:28.510 INFO:tasks.workunit.client.0.smithi038.stdout:0/116: mknod d2/d7/d24/c2e 0 2024-09-13T18:30:28.510 INFO:tasks.workunit.client.0.smithi038.stdout:0/117: fdatasync d2/d7/f21 0 2024-09-13T18:30:28.514 INFO:tasks.workunit.client.0.smithi038.stdout:5/97: chown c6 26 1 2024-09-13T18:30:28.517 INFO:tasks.workunit.client.0.smithi038.stdout:2/102: rename d2/da/d16/l23 to d2/d1e/l27 0 2024-09-13T18:30:28.518 INFO:tasks.workunit.client.1.smithi149.stdout:0/830: dwrite d1/d29/d31/d44/d81/d62/fd3 [0,4194304] 0 2024-09-13T18:30:28.519 INFO:tasks.workunit.client.1.smithi149.stdout:6/891: dread dc/d8c/fc2 [0,4194304] 0 2024-09-13T18:30:28.519 INFO:tasks.workunit.client.0.smithi038.stdout:3/74: rename d0/cf to d0/c1e 0 2024-09-13T18:30:28.521 INFO:tasks.workunit.client.1.smithi149.stdout:8/806: link d2/fa5 d2/d12/d6e/f110 0 2024-09-13T18:30:28.523 INFO:tasks.workunit.client.1.smithi149.stdout:5/735: symlink d3/d10/d4c/d4e/d61/d75/le9 0 2024-09-13T18:30:28.523 INFO:tasks.workunit.client.1.smithi149.stdout:7/886: sync 2024-09-13T18:30:28.523 INFO:tasks.workunit.client.1.smithi149.stdout:9/634: sync 2024-09-13T18:30:28.525 INFO:tasks.workunit.client.1.smithi149.stdout:4/844: mkdir df/da0/d12/d7c/d122 0 2024-09-13T18:30:28.526 INFO:tasks.workunit.client.1.smithi149.stdout:8/807: dread d2/d12/d40/f5e [0,4194304] 0 2024-09-13T18:30:28.526 INFO:tasks.workunit.client.1.smithi149.stdout:3/771: rmdir d1/d2e/d1d/d9a 39 2024-09-13T18:30:28.535 INFO:tasks.workunit.client.0.smithi038.stdout:0/118: mkdir d2/d2f 0 2024-09-13T18:30:28.535 INFO:tasks.workunit.client.0.smithi038.stdout:0/119: chown d2/dc/le 3995949 1 2024-09-13T18:30:28.535 INFO:tasks.workunit.client.0.smithi038.stdout:5/98: read f3 [5177024,115455] 0 2024-09-13T18:30:28.537 INFO:tasks.workunit.client.1.smithi149.stdout:2/702: mknod db/d13/cea 0 2024-09-13T18:30:28.537 INFO:tasks.workunit.client.1.smithi149.stdout:2/703: fsync db/d1b/d2f/fc5 0 2024-09-13T18:30:28.538 INFO:tasks.workunit.client.0.smithi038.stdout:2/103: write d2/f5 [586257,15752] 0 2024-09-13T18:30:28.538 INFO:tasks.workunit.client.0.smithi038.stdout:2/104: write d2/f26 [907113,56855] 0 2024-09-13T18:30:28.539 INFO:tasks.workunit.client.0.smithi038.stdout:3/75: readlink d0/dd/l16 0 2024-09-13T18:30:28.539 INFO:tasks.workunit.client.0.smithi038.stdout:3/76: chown d0/dd 37 1 2024-09-13T18:30:28.545 INFO:tasks.workunit.client.1.smithi149.stdout:0/831: dwrite d1/d29/d31/d44/d81/f97 [0,4194304] 0 2024-09-13T18:30:28.552 INFO:tasks.workunit.client.0.smithi038.stdout:2/105: dwrite d2/f8 [0,4194304] 0 2024-09-13T18:30:28.558 INFO:tasks.workunit.client.0.smithi038.stdout:2/106: write d2/da/f1b [820004,98782] 0 2024-09-13T18:30:28.561 INFO:tasks.workunit.client.0.smithi038.stdout:2/107: dread d2/da/fd [0,4194304] 0 2024-09-13T18:30:28.561 INFO:tasks.workunit.client.0.smithi038.stdout:2/108: creat d2/da/f28 x:0 0 0 2024-09-13T18:30:28.567 INFO:tasks.workunit.client.0.smithi038.stdout:2/109: dread d2/f12 [0,4194304] 0 2024-09-13T18:30:28.617 INFO:tasks.workunit.client.0.smithi038.stdout:0/120: link d2/d7/f13 d2/d2f/f30 0 2024-09-13T18:30:28.618 INFO:tasks.workunit.client.1.smithi149.stdout:6/892: truncate dc/d15/d54/da9/fc0 440717 0 2024-09-13T18:30:28.619 INFO:tasks.workunit.client.0.smithi038.stdout:5/99: rmdir df/d13 39 2024-09-13T18:30:28.619 INFO:tasks.workunit.client.0.smithi038.stdout:5/100: chown f3 4914 1 2024-09-13T18:30:28.619 INFO:tasks.workunit.client.0.smithi038.stdout:5/101: creat df/d15/f22 x:0 0 0 2024-09-13T18:30:28.619 INFO:tasks.workunit.client.0.smithi038.stdout:5/102: chown df/d13/c1c 12628 1 2024-09-13T18:30:28.619 INFO:tasks.workunit.client.0.smithi038.stdout:5/103: readlink df/d15/l16 0 2024-09-13T18:30:28.620 INFO:tasks.workunit.client.1.smithi149.stdout:5/736: mkdir d3/d10/d4c/d4e/d61/dea 0 2024-09-13T18:30:28.622 INFO:tasks.workunit.client.1.smithi149.stdout:9/635: mkdir d0/d18/d68/db2/dc9 0 2024-09-13T18:30:28.624 INFO:tasks.workunit.client.1.smithi149.stdout:7/887: creat d7/f135 x:0 0 0 2024-09-13T18:30:28.625 INFO:tasks.workunit.client.1.smithi149.stdout:9/636: dread d0/d9e/d3b/f53 [0,4194304] 0 2024-09-13T18:30:28.625 INFO:tasks.workunit.client.1.smithi149.stdout:4/845: symlink df/da0/deb/l123 0 2024-09-13T18:30:28.626 INFO:tasks.workunit.client.0.smithi038.stdout:6/133: sync 2024-09-13T18:30:28.626 INFO:tasks.workunit.client.0.smithi038.stdout:7/115: sync 2024-09-13T18:30:28.626 INFO:tasks.workunit.client.0.smithi038.stdout:6/134: write dd/f13 [1325343,116414] 0 2024-09-13T18:30:28.626 INFO:tasks.workunit.client.0.smithi038.stdout:8/242: sync 2024-09-13T18:30:28.627 INFO:tasks.workunit.client.1.smithi149.stdout:6/893: dread dc/d15/d23/d5f/fa4 [4194304,4194304] 0 2024-09-13T18:30:28.629 INFO:tasks.workunit.client.1.smithi149.stdout:8/808: link d2/d13/d3a/ce8 d2/d12/c111 0 2024-09-13T18:30:28.629 INFO:tasks.workunit.client.1.smithi149.stdout:8/809: creat d2/d12/dd8/d58/f112 x:0 0 0 2024-09-13T18:30:28.630 INFO:tasks.workunit.client.0.smithi038.stdout:2/110: rename d2/f12 to d2/da/d1a/f29 0 2024-09-13T18:30:28.630 INFO:tasks.workunit.client.0.smithi038.stdout:2/111: chown d2/da/d16 2 1 2024-09-13T18:30:28.630 INFO:tasks.workunit.client.1.smithi149.stdout:8/810: write d2/d12/f43 [4870754,104644] 0 2024-09-13T18:30:28.631 INFO:tasks.workunit.client.1.smithi149.stdout:8/811: fdatasync d2/d13/d3a/d7f/da8/fa9 0 2024-09-13T18:30:28.631 INFO:tasks.workunit.client.1.smithi149.stdout:8/812: readlink d2/d12/dd8/d66/ded/l105 0 2024-09-13T18:30:28.632 INFO:tasks.workunit.client.1.smithi149.stdout:3/772: creat d1/d47/d30/d5a/f109 x:0 0 0 2024-09-13T18:30:28.632 INFO:tasks.workunit.client.1.smithi149.stdout:3/773: truncate d1/d48/ff8 765159 0 2024-09-13T18:30:28.632 INFO:tasks.workunit.client.0.smithi038.stdout:0/121: creat d2/d7/f31 x:0 0 0 2024-09-13T18:30:28.634 INFO:tasks.workunit.client.1.smithi149.stdout:2/704: mkdir db/d1b/d2f/d69/deb 0 2024-09-13T18:30:28.638 INFO:tasks.workunit.client.0.smithi038.stdout:5/104: symlink df/d13/l23 0 2024-09-13T18:30:28.640 INFO:tasks.workunit.client.1.smithi149.stdout:0/832: unlink d1/d2/d8a/f93 0 2024-09-13T18:30:28.641 INFO:tasks.workunit.client.0.smithi038.stdout:3/77: symlink d0/dd/l1f 0 2024-09-13T18:30:28.645 INFO:tasks.workunit.client.0.smithi038.stdout:7/116: creat db/d12/d1a/d26/f2b x:0 0 0 2024-09-13T18:30:28.645 INFO:tasks.workunit.client.0.smithi038.stdout:7/117: creat db/d12/d1a/d22/f2c x:0 0 0 2024-09-13T18:30:28.645 INFO:tasks.workunit.client.0.smithi038.stdout:7/118: fdatasync db/fe 0 2024-09-13T18:30:28.646 INFO:tasks.workunit.client.1.smithi149.stdout:9/637: link d0/d2e/d42/f6d d0/d47/fca 0 2024-09-13T18:30:28.646 INFO:tasks.workunit.client.1.smithi149.stdout:9/638: write d0/d18/d27/d5c/d79/fa1 [572301,121684] 0 2024-09-13T18:30:28.647 INFO:tasks.workunit.client.0.smithi038.stdout:6/135: link dd/de/f1a dd/de/f35 0 2024-09-13T18:30:28.648 INFO:tasks.workunit.client.0.smithi038.stdout:8/243: mknod d1/de/d21/d24/d41/c58 0 2024-09-13T18:30:28.650 INFO:tasks.workunit.client.1.smithi149.stdout:8/813: truncate d2/fc 1160315 0 2024-09-13T18:30:28.651 INFO:tasks.workunit.client.1.smithi149.stdout:3/774: mknod d1/d2c/d38/d88/d96/c10a 0 2024-09-13T18:30:28.654 INFO:tasks.workunit.client.1.smithi149.stdout:2/705: mknod db/d1b/d1c/d20/d3a/cec 0 2024-09-13T18:30:28.654 INFO:tasks.workunit.client.0.smithi038.stdout:5/105: symlink df/d13/l24 0 2024-09-13T18:30:28.656 INFO:tasks.workunit.client.1.smithi149.stdout:0/833: link d1/d29/d31/d44/d47/f8e d1/f11e 0 2024-09-13T18:30:28.659 INFO:tasks.workunit.client.1.smithi149.stdout:2/706: symlink db/d13/d70/dad/led 0 2024-09-13T18:30:28.659 INFO:tasks.workunit.client.1.smithi149.stdout:2/707: truncate db/d1b/d2f/fc2 649887 0 2024-09-13T18:30:28.661 INFO:tasks.workunit.client.1.smithi149.stdout:0/834: symlink d1/d2/d8a/da9/d117/l11f 0 2024-09-13T18:30:28.661 INFO:tasks.workunit.client.0.smithi038.stdout:6/136: symlink dd/de/d2e/d30/l36 0 2024-09-13T18:30:28.661 INFO:tasks.workunit.client.0.smithi038.stdout:3/78: truncate d0/dd/fe 3243069 0 2024-09-13T18:30:28.664 INFO:tasks.workunit.client.0.smithi038.stdout:6/137: unlink fa 0 2024-09-13T18:30:28.666 INFO:tasks.workunit.client.1.smithi149.stdout:9/639: write d0/f67 [3040362,40561] 0 2024-09-13T18:30:28.666 INFO:tasks.workunit.client.1.smithi149.stdout:9/640: chown d0/d18/d68/db2/fc8 3729052 1 2024-09-13T18:30:28.666 INFO:tasks.workunit.client.1.smithi149.stdout:0/835: link d1/d29/d31/d3e/fd9 d1/d2/d8a/f120 0 2024-09-13T18:30:28.666 INFO:tasks.workunit.client.0.smithi038.stdout:3/79: rename d0/c14 to d0/c20 0 2024-09-13T18:30:28.667 INFO:tasks.workunit.client.0.smithi038.stdout:6/138: getdents dd/de/d31 0 2024-09-13T18:30:28.668 INFO:tasks.workunit.client.1.smithi149.stdout:9/641: symlink d0/d2e/d42/d70/lcb 0 2024-09-13T18:30:28.668 INFO:tasks.workunit.client.1.smithi149.stdout:9/642: creat d0/d18/d27/d5c/d7e/fcc x:0 0 0 2024-09-13T18:30:28.669 INFO:tasks.workunit.client.0.smithi038.stdout:3/80: write d0/dd/d17/f18 [760541,53191] 0 2024-09-13T18:30:28.670 INFO:tasks.workunit.client.1.smithi149.stdout:0/836: readlink d1/d2/l15 0 2024-09-13T18:30:28.670 INFO:tasks.workunit.client.1.smithi149.stdout:4/846: dwrite df/da0/d70/db5/dc7/f114 [0,4194304] 0 2024-09-13T18:30:28.670 INFO:tasks.workunit.client.1.smithi149.stdout:4/847: fsync df/da0/d12/fd6 0 2024-09-13T18:30:28.671 INFO:tasks.workunit.client.0.smithi038.stdout:2/112: dwrite d2/da/d16/f21 [0,4194304] 0 2024-09-13T18:30:28.671 INFO:tasks.workunit.client.0.smithi038.stdout:2/113: readlink d2/l3 0 2024-09-13T18:30:28.673 INFO:tasks.workunit.client.1.smithi149.stdout:5/737: dwrite d3/d8/d6d/d91/f9c [0,4194304] 0 2024-09-13T18:30:28.673 INFO:tasks.workunit.client.1.smithi149.stdout:0/837: mknod d1/d2/d8a/c121 0 2024-09-13T18:30:28.673 INFO:tasks.workunit.client.1.smithi149.stdout:1/799: sync 2024-09-13T18:30:28.674 INFO:tasks.workunit.client.0.smithi038.stdout:7/119: write db/f11 [659703,73446] 0 2024-09-13T18:30:28.678 INFO:tasks.workunit.client.0.smithi038.stdout:3/81: dread d0/fa [0,4194304] 0 2024-09-13T18:30:28.678 INFO:tasks.workunit.client.0.smithi038.stdout:3/82: read d0/f2 [474662,70593] 0 2024-09-13T18:30:28.678 INFO:tasks.workunit.client.0.smithi038.stdout:3/83: chown d0/dd 130713 1 2024-09-13T18:30:28.678 INFO:tasks.workunit.client.0.smithi038.stdout:3/84: read d0/dd/d17/f18 [512789,88587] 0 2024-09-13T18:30:28.678 INFO:tasks.workunit.client.0.smithi038.stdout:2/114: rename d2/da/d1a to d2/d2a 0 2024-09-13T18:30:28.680 INFO:tasks.workunit.client.1.smithi149.stdout:9/643: dread d0/d2e/d42/d59/f69 [0,4194304] 0 2024-09-13T18:30:28.680 INFO:tasks.workunit.client.1.smithi149.stdout:6/894: dwrite dc/d8c/f105 [0,4194304] 0 2024-09-13T18:30:28.680 INFO:tasks.workunit.client.1.smithi149.stdout:9/644: stat d0/d9e/f24 0 2024-09-13T18:30:28.680 INFO:tasks.workunit.client.1.smithi149.stdout:4/848: mknod df/da0/d12/d21/d22/d30/d41/c124 0 2024-09-13T18:30:28.682 INFO:tasks.workunit.client.0.smithi038.stdout:7/120: rename db/d12/l24 to db/d12/d1a/d26/l2d 0 2024-09-13T18:30:28.685 INFO:tasks.workunit.client.0.smithi038.stdout:2/115: mkdir d2/d2a/d2b 0 2024-09-13T18:30:28.685 INFO:tasks.workunit.client.0.smithi038.stdout:2/116: write d2/da/f25 [271936,43840] 0 2024-09-13T18:30:28.687 INFO:tasks.workunit.client.1.smithi149.stdout:2/708: dwrite db/d1b/d1c/d85/fde [0,4194304] 0 2024-09-13T18:30:28.687 INFO:tasks.workunit.client.1.smithi149.stdout:8/814: dwrite d2/d12/d2a/f59 [0,4194304] 0 2024-09-13T18:30:28.687 INFO:tasks.workunit.client.1.smithi149.stdout:8/815: readlink d2/d13/l44 0 2024-09-13T18:30:28.688 INFO:tasks.workunit.client.0.smithi038.stdout:7/121: link db/f10 db/d12/d1a/d26/f2e 0 2024-09-13T18:30:28.690 INFO:tasks.workunit.client.0.smithi038.stdout:2/117: mknod d2/d2a/c2c 0 2024-09-13T18:30:28.691 INFO:tasks.workunit.client.0.smithi038.stdout:6/139: truncate dd/f13 3689305 0 2024-09-13T18:30:28.692 INFO:tasks.workunit.client.1.smithi149.stdout:5/738: symlink d3/d10/d4c/d4e/d61/leb 0 2024-09-13T18:30:28.692 INFO:tasks.workunit.client.1.smithi149.stdout:5/739: write d3/d10/d4c/d4e/d61/d75/d88/faf [697159,120605] 0 2024-09-13T18:30:28.693 INFO:tasks.workunit.client.0.smithi038.stdout:7/122: symlink db/d12/l2f 0 2024-09-13T18:30:28.693 INFO:tasks.workunit.client.0.smithi038.stdout:7/123: creat db/d12/d1a/d22/f30 x:0 0 0 2024-09-13T18:30:28.695 INFO:tasks.workunit.client.1.smithi149.stdout:1/800: creat d9/d10/d34/dbe/d38/df2/ffb x:0 0 0 2024-09-13T18:30:28.696 INFO:tasks.workunit.client.0.smithi038.stdout:2/118: creat d2/d2a/d2b/f2d x:0 0 0 2024-09-13T18:30:28.697 INFO:tasks.workunit.client.1.smithi149.stdout:8/816: write d2/d12/f46 [4158938,8920] 0 2024-09-13T18:30:28.698 INFO:tasks.workunit.client.0.smithi038.stdout:2/119: read d2/da/fd [234790,19830] 0 2024-09-13T18:30:28.698 INFO:tasks.workunit.client.0.smithi038.stdout:6/140: mknod dd/de/d2e/d30/c37 0 2024-09-13T18:30:28.701 INFO:tasks.workunit.client.1.smithi149.stdout:9/645: dwrite d0/d9e/f51 [0,4194304] 0 2024-09-13T18:30:28.701 INFO:tasks.workunit.client.0.smithi038.stdout:3/85: dwrite d0/f9 [0,4194304] 0 2024-09-13T18:30:28.704 INFO:tasks.workunit.client.0.smithi038.stdout:2/120: link d2/da/f15 d2/d2a/d2b/f2e 0 2024-09-13T18:30:28.705 INFO:tasks.workunit.client.1.smithi149.stdout:6/895: symlink dc/d15/d54/da9/d112/l11e 0 2024-09-13T18:30:28.705 INFO:tasks.workunit.client.1.smithi149.stdout:6/896: fdatasync dc/f3f 0 2024-09-13T18:30:28.705 INFO:tasks.workunit.client.1.smithi149.stdout:6/897: write dc/d15/d23/fb6 [487261,81179] 0 2024-09-13T18:30:28.706 INFO:tasks.workunit.client.0.smithi038.stdout:6/141: rmdir dd/de/d2e 39 2024-09-13T18:30:28.707 INFO:tasks.workunit.client.1.smithi149.stdout:4/849: mknod df/da0/d12/d21/d22/c125 0 2024-09-13T18:30:28.710 INFO:tasks.workunit.client.0.smithi038.stdout:3/86: creat d0/dd/d19/f21 x:0 0 0 2024-09-13T18:30:28.712 INFO:tasks.workunit.client.0.smithi038.stdout:2/121: link d2/f11 d2/d1e/f2f 0 2024-09-13T18:30:28.715 INFO:tasks.workunit.client.1.smithi149.stdout:2/709: chown db/d13/f18 19635 1 2024-09-13T18:30:28.715 INFO:tasks.workunit.client.1.smithi149.stdout:2/710: write db/f9a [691822,41467] 0 2024-09-13T18:30:28.718 INFO:tasks.workunit.client.0.smithi038.stdout:2/122: creat d2/d2a/f30 x:0 0 0 2024-09-13T18:30:28.720 INFO:tasks.workunit.client.0.smithi038.stdout:7/124: dwrite db/f14 [0,4194304] 0 2024-09-13T18:30:28.722 INFO:tasks.workunit.client.1.smithi149.stdout:1/801: unlink d9/d15/d40/cc5 0 2024-09-13T18:30:28.722 INFO:tasks.workunit.client.1.smithi149.stdout:1/802: fdatasync d9/d15/d40/d90/fb8 0 2024-09-13T18:30:28.723 INFO:tasks.workunit.client.1.smithi149.stdout:5/740: dwrite d3/d10/d4c/d4e/d61/d63/faa [0,4194304] 0 2024-09-13T18:30:28.727 INFO:tasks.workunit.client.1.smithi149.stdout:8/817: creat d2/d5b/f113 x:0 0 0 2024-09-13T18:30:28.731 INFO:tasks.workunit.client.0.smithi038.stdout:3/87: dwrite d0/dd/fe [0,4194304] 0 2024-09-13T18:30:28.731 INFO:tasks.workunit.client.0.smithi038.stdout:3/88: fsync d0/dd/d17/f18 0 2024-09-13T18:30:28.732 INFO:tasks.workunit.client.1.smithi149.stdout:9/646: creat d0/d47/d54/d75/fcd x:0 0 0 2024-09-13T18:30:28.732 INFO:tasks.workunit.client.1.smithi149.stdout:9/647: getdents d0/d18/d68/db2/dc9 0 2024-09-13T18:30:28.736 INFO:tasks.workunit.client.1.smithi149.stdout:6/898: mknod dc/d15/d23/d57/da5/dd8/c11f 0 2024-09-13T18:30:28.736 INFO:tasks.workunit.client.1.smithi149.stdout:6/899: chown dc/d15/d54/ca6 0 1 2024-09-13T18:30:28.737 INFO:tasks.workunit.client.1.smithi149.stdout:1/803: write d9/d10/f1a [3800765,12003] 0 2024-09-13T18:30:28.739 INFO:tasks.workunit.client.1.smithi149.stdout:4/850: creat df/da0/d12/d21/d22/d30/d41/d57/d8a/f126 x:0 0 0 2024-09-13T18:30:28.739 INFO:tasks.workunit.client.1.smithi149.stdout:4/851: stat df/da0/d12/f3c 0 2024-09-13T18:30:28.740 INFO:tasks.workunit.client.0.smithi038.stdout:7/125: getdents db 0 2024-09-13T18:30:28.743 INFO:tasks.workunit.client.1.smithi149.stdout:2/711: mknod db/d1b/d1c/d20/d2b/cee 0 2024-09-13T18:30:28.744 INFO:tasks.workunit.client.0.smithi038.stdout:3/89: mkdir d0/dd/d22 0 2024-09-13T18:30:28.744 INFO:tasks.workunit.client.1.smithi149.stdout:8/818: dwrite d2/f100 [0,4194304] 0 2024-09-13T18:30:28.747 INFO:tasks.workunit.client.0.smithi038.stdout:7/126: rename db/c16 to db/d12/d1c/c31 0 2024-09-13T18:30:28.748 INFO:tasks.workunit.client.1.smithi149.stdout:5/741: symlink d3/d10/d4c/d4e/d61/dea/lec 0 2024-09-13T18:30:28.750 INFO:tasks.workunit.client.0.smithi038.stdout:3/90: rmdir d0/dd/d22 0 2024-09-13T18:30:28.753 INFO:tasks.workunit.client.0.smithi038.stdout:2/123: getdents d2/d1e 0 2024-09-13T18:30:28.753 INFO:tasks.workunit.client.0.smithi038.stdout:2/124: write d2/d2a/f30 [868457,116329] 0 2024-09-13T18:30:28.754 INFO:tasks.workunit.client.0.smithi038.stdout:3/91: mkdir d0/dd/d19/d23 0 2024-09-13T18:30:28.755 INFO:tasks.workunit.client.1.smithi149.stdout:4/852: read df/f90 [320029,93170] 0 2024-09-13T18:30:28.758 INFO:tasks.workunit.client.1.smithi149.stdout:6/900: symlink dc/d15/d23/d5f/dac/l120 0 2024-09-13T18:30:28.758 INFO:tasks.workunit.client.1.smithi149.stdout:6/901: fdatasync dc/d15/d54/fc3 0 2024-09-13T18:30:28.760 INFO:tasks.workunit.client.0.smithi038.stdout:3/92: creat d0/f24 x:0 0 0 2024-09-13T18:30:28.763 INFO:tasks.workunit.client.1.smithi149.stdout:1/804: truncate d9/d10/d34/d53/d57/fa1 2641843 0 2024-09-13T18:30:28.765 INFO:tasks.workunit.client.1.smithi149.stdout:2/712: fsync db/d13/f79 0 2024-09-13T18:30:28.766 INFO:tasks.workunit.client.1.smithi149.stdout:6/902: dread dc/d2f/f6c [0,4194304] 0 2024-09-13T18:30:28.767 INFO:tasks.workunit.client.0.smithi038.stdout:7/127: dread db/d12/d1a/f1f [0,4194304] 0 2024-09-13T18:30:28.769 INFO:tasks.workunit.client.0.smithi038.stdout:3/93: mknod d0/dd/c25 0 2024-09-13T18:30:28.772 INFO:tasks.workunit.client.0.smithi038.stdout:7/128: creat db/d12/d13/f32 x:0 0 0 2024-09-13T18:30:28.772 INFO:tasks.workunit.client.0.smithi038.stdout:7/129: dread - db/d12/d1a/f1d zero size 2024-09-13T18:30:28.772 INFO:tasks.workunit.client.1.smithi149.stdout:8/819: dwrite d2/d12/d40/f5e [0,4194304] 0 2024-09-13T18:30:28.773 INFO:tasks.workunit.client.1.smithi149.stdout:4/853: creat df/da0/d12/d21/d22/d30/d41/d57/f127 x:0 0 0 2024-09-13T18:30:28.775 INFO:tasks.workunit.client.1.smithi149.stdout:1/805: rename d9/d15/d60/d80/fe8 to d9/d15/d60/d80/dcd/dab/ffc 0 2024-09-13T18:30:28.777 INFO:tasks.workunit.client.1.smithi149.stdout:6/903: dread dc/f5a [0,4194304] 0 2024-09-13T18:30:28.778 INFO:tasks.workunit.client.1.smithi149.stdout:9/648: dwrite d0/d9e/f56 [4194304,4194304] 0 2024-09-13T18:30:28.779 INFO:tasks.workunit.client.1.smithi149.stdout:9/649: creat d0/d18/d93/fce x:0 0 0 2024-09-13T18:30:28.779 INFO:tasks.workunit.client.0.smithi038.stdout:7/130: mkdir db/d21/d33 0 2024-09-13T18:30:28.781 INFO:tasks.workunit.client.1.smithi149.stdout:8/820: link d2/f34 d2/d5b/f114 0 2024-09-13T18:30:28.783 INFO:tasks.workunit.client.1.smithi149.stdout:4/854: rename df/da0/d12/d21/d22/d30/d41/d57/d60/f11c to df/da0/d12/d21/d22/d30/d56/f128 0 2024-09-13T18:30:28.783 INFO:tasks.workunit.client.1.smithi149.stdout:4/855: write df/da0/d70/f102 [4812811,47112] 0 2024-09-13T18:30:28.784 INFO:tasks.workunit.client.1.smithi149.stdout:6/904: symlink dc/d15/d54/d5e/df7/l121 0 2024-09-13T18:30:28.785 INFO:tasks.workunit.client.0.smithi038.stdout:3/94: write d0/fb [1382790,125684] 0 2024-09-13T18:30:28.785 INFO:tasks.workunit.client.0.smithi038.stdout:2/125: dwrite d2/f8 [0,4194304] 0 2024-09-13T18:30:28.785 INFO:tasks.workunit.client.0.smithi038.stdout:3/95: stat d0/dd/d19/d23 0 2024-09-13T18:30:28.785 INFO:tasks.workunit.client.0.smithi038.stdout:2/126: chown d2/d1e/f2f 15155 1 2024-09-13T18:30:28.785 INFO:tasks.workunit.client.0.smithi038.stdout:2/127: chown d2/d2a 18 1 2024-09-13T18:30:28.786 INFO:tasks.workunit.client.1.smithi149.stdout:5/742: rmdir d3/d10/d4c/d4e 39 2024-09-13T18:30:28.786 INFO:tasks.workunit.client.1.smithi149.stdout:5/743: fdatasync d3/d10/d32/d54/d97/dba/fc9 0 2024-09-13T18:30:28.787 INFO:tasks.workunit.client.0.smithi038.stdout:2/128: dread d2/f8 [4194304,4194304] 0 2024-09-13T18:30:28.789 INFO:tasks.workunit.client.0.smithi038.stdout:3/96: dread - d0/dd/f1a zero size 2024-09-13T18:30:28.790 INFO:tasks.workunit.client.0.smithi038.stdout:3/97: stat d0/dd/d17/f18 0 2024-09-13T18:30:28.793 INFO:tasks.workunit.client.1.smithi149.stdout:9/650: getdents d0/d18/d81 0 2024-09-13T18:30:28.793 INFO:tasks.workunit.client.1.smithi149.stdout:9/651: chown d0/d2e/d42/d59/d86/c9d 49 1 2024-09-13T18:30:28.793 INFO:tasks.workunit.client.1.smithi149.stdout:9/652: chown d0/d18/d68/db2/fc8 73 1 2024-09-13T18:30:28.793 INFO:tasks.workunit.client.1.smithi149.stdout:9/653: readlink d0/d18/d27/l5a 0 2024-09-13T18:30:28.793 INFO:tasks.workunit.client.1.smithi149.stdout:9/654: dread - d0/d47/d54/d75/fcd zero size 2024-09-13T18:30:28.794 INFO:tasks.workunit.client.1.smithi149.stdout:7/888: sync 2024-09-13T18:30:28.795 INFO:tasks.workunit.client.0.smithi038.stdout:3/98: creat d0/dd/d19/d23/f26 x:0 0 0 2024-09-13T18:30:28.795 INFO:tasks.workunit.client.0.smithi038.stdout:3/99: stat d0/f2 0 2024-09-13T18:30:28.795 INFO:tasks.workunit.client.0.smithi038.stdout:3/100: getdents d0/dd/d19/d1d 0 2024-09-13T18:30:28.795 INFO:tasks.workunit.client.0.smithi038.stdout:3/101: chown d0 71393 1 2024-09-13T18:30:28.795 INFO:tasks.workunit.client.0.smithi038.stdout:3/102: truncate d0/fb 5031686 0 2024-09-13T18:30:28.798 INFO:tasks.workunit.client.1.smithi149.stdout:6/905: creat dc/d15/d23/d104/da1/dd1/f122 x:0 0 0 2024-09-13T18:30:28.798 INFO:tasks.workunit.client.1.smithi149.stdout:6/906: stat f8 0 2024-09-13T18:30:28.799 INFO:tasks.workunit.client.1.smithi149.stdout:6/907: chown dc/d70/fda 233466 1 2024-09-13T18:30:28.799 INFO:tasks.workunit.client.1.smithi149.stdout:6/908: chown dc/f22 372 1 2024-09-13T18:30:28.799 INFO:tasks.workunit.client.1.smithi149.stdout:6/909: creat dc/d15/d23/d104/da1/dd1/f123 x:0 0 0 2024-09-13T18:30:28.799 INFO:tasks.workunit.client.1.smithi149.stdout:6/910: chown dc/d15/d54/lad 1535081883 1 2024-09-13T18:30:28.799 INFO:tasks.workunit.client.1.smithi149.stdout:2/713: dwrite db/d1b/d1c/d20/d2b/fd8 [0,4194304] 0 2024-09-13T18:30:28.799 INFO:tasks.workunit.client.1.smithi149.stdout:2/714: fdatasync db/d1b/d6c/f73 0 2024-09-13T18:30:28.799 INFO:tasks.workunit.client.1.smithi149.stdout:5/744: rmdir d3/d10/d4c/d4e/d61/d63 39 2024-09-13T18:30:28.799 INFO:tasks.workunit.client.1.smithi149.stdout:1/806: dwrite d9/d10/d34/d53/f5f [0,4194304] 0 2024-09-13T18:30:28.801 INFO:tasks.workunit.client.0.smithi038.stdout:3/103: rename d0/fb to d0/dd/d17/f27 0 2024-09-13T18:30:28.804 INFO:tasks.workunit.client.1.smithi149.stdout:7/889: mkdir d7/d76/db3/d6f/d9d/d136 0 2024-09-13T18:30:28.804 INFO:tasks.workunit.client.1.smithi149.stdout:7/890: chown d7/d76/db3/d6f/d9d/cff 560646182 1 2024-09-13T18:30:28.812 INFO:tasks.workunit.client.1.smithi149.stdout:2/715: symlink db/d1b/dab/lef 0 2024-09-13T18:30:28.813 INFO:tasks.workunit.client.0.smithi038.stdout:2/129: dwrite d2/da/f28 [0,4194304] 0 2024-09-13T18:30:28.813 INFO:tasks.workunit.client.0.smithi038.stdout:2/130: chown d2/da/f15 0 1 2024-09-13T18:30:28.819 INFO:tasks.workunit.client.1.smithi149.stdout:3/775: sync 2024-09-13T18:30:28.819 INFO:tasks.workunit.client.1.smithi149.stdout:1/807: creat d9/d10/d34/dbe/dd7/ffd x:0 0 0 2024-09-13T18:30:28.821 INFO:tasks.workunit.client.1.smithi149.stdout:2/716: truncate db/d1b/d1c/d20/d3a/f53 6499665 0 2024-09-13T18:30:28.822 INFO:tasks.workunit.client.1.smithi149.stdout:5/745: dread d3/d10/d32/f38 [0,4194304] 0 2024-09-13T18:30:28.822 INFO:tasks.workunit.client.1.smithi149.stdout:8/821: dwrite d2/d12/dd8/f23 [0,4194304] 0 2024-09-13T18:30:28.822 INFO:tasks.workunit.client.1.smithi149.stdout:5/746: creat d3/d8/d13/fed x:0 0 0 2024-09-13T18:30:28.822 INFO:tasks.workunit.client.1.smithi149.stdout:8/822: write d2/d12/dd8/d58/f112 [606264,85124] 0 2024-09-13T18:30:28.823 INFO:tasks.workunit.client.1.smithi149.stdout:3/776: mkdir d1/d47/d30/d46/d10b 0 2024-09-13T18:30:28.824 INFO:tasks.workunit.client.1.smithi149.stdout:3/777: write d1/d48/ff8 [816758,5515] 0 2024-09-13T18:30:28.824 INFO:tasks.workunit.client.1.smithi149.stdout:3/778: fsync d1/d2c/d42/fc0 0 2024-09-13T18:30:28.827 INFO:tasks.workunit.client.0.smithi038.stdout:3/104: dwrite d0/dd/d19/d23/f26 [0,4194304] 0 2024-09-13T18:30:28.828 INFO:tasks.workunit.client.0.smithi038.stdout:3/105: read d0/fc [54375,116783] 0 2024-09-13T18:30:28.829 INFO:tasks.workunit.client.1.smithi149.stdout:1/808: dread d9/d10/d83/d97/f69 [0,4194304] 0 2024-09-13T18:30:28.835 INFO:tasks.workunit.client.1.smithi149.stdout:6/911: dwrite dc/d15/d23/fb6 [0,4194304] 0 2024-09-13T18:30:28.835 INFO:tasks.workunit.client.1.smithi149.stdout:6/912: creat dc/d2f/df2/f124 x:0 0 0 2024-09-13T18:30:28.835 INFO:tasks.workunit.client.1.smithi149.stdout:6/913: fsync dc/d2f/f3a 0 2024-09-13T18:30:28.835 INFO:tasks.workunit.client.1.smithi149.stdout:9/655: dwrite d0/d18/d68/db2/fc8 [0,4194304] 0 2024-09-13T18:30:28.835 INFO:tasks.workunit.client.1.smithi149.stdout:7/891: dwrite d7/d9/d11/f94 [0,4194304] 0 2024-09-13T18:30:28.839 INFO:tasks.workunit.client.1.smithi149.stdout:9/656: dread d0/f67 [0,4194304] 0 2024-09-13T18:30:28.846 INFO:tasks.workunit.client.1.smithi149.stdout:1/809: dwrite d9/d10/d34/dbe/d38/ff1 [0,4194304] 0 2024-09-13T18:30:28.857 INFO:tasks.workunit.client.1.smithi149.stdout:6/914: dwrite f8 [0,4194304] 0 2024-09-13T18:30:28.857 INFO:tasks.workunit.client.1.smithi149.stdout:6/915: fsync dc/d15/d23/d57/da5/fd0 0 2024-09-13T18:30:28.877 INFO:tasks.workunit.client.1.smithi149.stdout:6/916: dwrite dc/d15/d23/d5f/fa4 [8388608,4194304] 0 2024-09-13T18:30:28.877 INFO:tasks.workunit.client.1.smithi149.stdout:6/917: fdatasync dc/d15/d23/d57/d5c/f84 0 2024-09-13T18:30:28.886 INFO:tasks.workunit.client.1.smithi149.stdout:6/918: dread dc/d15/d23/f4c [0,4194304] 0 2024-09-13T18:30:28.886 INFO:tasks.workunit.client.1.smithi149.stdout:6/919: read - dc/d15/d23/d104/da1/dd1/f122 zero size 2024-09-13T18:30:28.902 INFO:tasks.workunit.client.1.smithi149.stdout:2/717: unlink db/d1b/d48/f74 0 2024-09-13T18:30:28.906 INFO:tasks.workunit.client.0.smithi038.stdout:2/131: creat d2/d2a/d2b/f31 x:0 0 0 2024-09-13T18:30:28.906 INFO:tasks.workunit.client.0.smithi038.stdout:2/132: creat d2/d2a/d2b/f32 x:0 0 0 2024-09-13T18:30:28.906 INFO:tasks.workunit.client.1.smithi149.stdout:0/838: sync 2024-09-13T18:30:28.909 INFO:tasks.workunit.client.1.smithi149.stdout:8/823: creat d2/d52/f115 x:0 0 0 2024-09-13T18:30:28.911 INFO:tasks.workunit.client.1.smithi149.stdout:5/747: rename d3/d8/d13/f52 to d3/d10/d32/d54/d97/fee 0 2024-09-13T18:30:28.911 INFO:tasks.workunit.client.1.smithi149.stdout:5/748: readlink d3/d10/l24 0 2024-09-13T18:30:28.911 INFO:tasks.workunit.client.0.smithi038.stdout:3/106: symlink d0/dd/d19/d1d/l28 0 2024-09-13T18:30:28.911 INFO:tasks.workunit.client.0.smithi038.stdout:3/107: truncate d0/f2 1798752 0 2024-09-13T18:30:28.912 INFO:tasks.workunit.client.1.smithi149.stdout:8/824: dread d2/d13/fad [0,4194304] 0 2024-09-13T18:30:28.913 INFO:tasks.workunit.client.1.smithi149.stdout:3/779: unlink d1/d2e/d1d/d6c/dcd/fd9 0 2024-09-13T18:30:28.914 INFO:tasks.workunit.client.0.smithi038.stdout:1/109: sync 2024-09-13T18:30:28.914 INFO:tasks.workunit.client.0.smithi038.stdout:1/110: creat d12/d15/f22 x:0 0 0 2024-09-13T18:30:28.914 INFO:tasks.workunit.client.0.smithi038.stdout:1/111: chown d12 1 1 2024-09-13T18:30:28.915 INFO:tasks.workunit.client.0.smithi038.stdout:3/108: mkdir d0/dd/d19/d1d/d29 0 2024-09-13T18:30:28.916 INFO:tasks.workunit.client.0.smithi038.stdout:3/109: dread - d0/dd/d17/f1c zero size 2024-09-13T18:30:28.920 INFO:tasks.workunit.client.0.smithi038.stdout:1/112: rmdir d12 39 2024-09-13T18:30:28.922 INFO:tasks.workunit.client.0.smithi038.stdout:3/110: unlink d0/dd/d17/f27 0 2024-09-13T18:30:28.923 INFO:tasks.workunit.client.0.smithi038.stdout:3/111: write d0/dd/d19/f21 [588402,28693] 0 2024-09-13T18:30:28.923 INFO:tasks.workunit.client.0.smithi038.stdout:3/112: fsync d0/f24 0 2024-09-13T18:30:28.925 INFO:tasks.workunit.client.0.smithi038.stdout:1/113: creat d12/f23 x:0 0 0 2024-09-13T18:30:28.925 INFO:tasks.workunit.client.0.smithi038.stdout:1/114: dread - fe zero size 2024-09-13T18:30:28.926 INFO:tasks.workunit.client.1.smithi149.stdout:2/718: dwrite db/d1b/d2f/f52 [0,4194304] 0 2024-09-13T18:30:28.927 INFO:tasks.workunit.client.0.smithi038.stdout:2/133: dwrite d2/d2a/f30 [0,4194304] 0 2024-09-13T18:30:28.927 INFO:tasks.workunit.client.0.smithi038.stdout:1/115: fsync d12/f1a 0 2024-09-13T18:30:28.927 INFO:tasks.workunit.client.0.smithi038.stdout:2/134: dread - d2/d1e/f2f zero size 2024-09-13T18:30:28.927 INFO:tasks.workunit.client.0.smithi038.stdout:2/135: dread - d2/d2a/d2b/f2d zero size 2024-09-13T18:30:28.929 INFO:tasks.workunit.client.1.smithi149.stdout:7/892: mkdir d7/d137 0 2024-09-13T18:30:28.932 INFO:tasks.workunit.client.1.smithi149.stdout:1/810: symlink d9/d10/d34/d3c/d50/lfe 0 2024-09-13T18:30:28.937 INFO:tasks.workunit.client.0.smithi038.stdout:2/136: rename d2/l13 to d2/da/l33 0 2024-09-13T18:30:28.940 INFO:tasks.workunit.client.0.smithi038.stdout:2/137: write d2/d2a/d2b/f2e [21321,80250] 0 2024-09-13T18:30:28.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/920: mknod dc/d15/d23/d5f/c125 0 2024-09-13T18:30:28.943 INFO:tasks.workunit.client.1.smithi149.stdout:6/921: write dc/d15/d23/d5b/d91/db0/fca [1239833,17740] 0 2024-09-13T18:30:28.944 INFO:tasks.workunit.client.0.smithi038.stdout:2/138: link d2/d2a/d2b/f2d d2/f34 0 2024-09-13T18:30:28.944 INFO:tasks.workunit.client.0.smithi038.stdout:2/139: creat d2/d2a/f35 x:0 0 0 2024-09-13T18:30:28.945 INFO:tasks.workunit.client.1.smithi149.stdout:0/839: symlink d1/d29/d31/d44/d47/l122 0 2024-09-13T18:30:28.947 INFO:tasks.workunit.client.1.smithi149.stdout:9/657: rename d0/d2e/d42/l4d to d0/d47/d54/lcf 0 2024-09-13T18:30:28.950 INFO:tasks.workunit.client.1.smithi149.stdout:5/749: truncate d3/d10/d4c/d4e/da4/fa6 878783 0 2024-09-13T18:30:28.952 INFO:tasks.workunit.client.0.smithi038.stdout:2/140: link d2/d2a/d2b/f2d d2/da/f36 0 2024-09-13T18:30:28.952 INFO:tasks.workunit.client.0.smithi038.stdout:2/141: readlink d2/l4 0 2024-09-13T18:30:28.952 INFO:tasks.workunit.client.0.smithi038.stdout:2/142: creat d2/f37 x:0 0 0 2024-09-13T18:30:28.954 INFO:tasks.workunit.client.1.smithi149.stdout:8/825: mknod d2/d5b/d86/c116 0 2024-09-13T18:30:28.955 INFO:tasks.workunit.client.1.smithi149.stdout:3/780: symlink d1/d2c/d38/d8d/l10c 0 2024-09-13T18:30:28.955 INFO:tasks.workunit.client.1.smithi149.stdout:3/781: chown d1/d47/d30/fbd 6338093 1 2024-09-13T18:30:28.958 INFO:tasks.workunit.client.0.smithi038.stdout:2/143: symlink d2/d2a/d2b/l38 0 2024-09-13T18:30:28.958 INFO:tasks.workunit.client.0.smithi038.stdout:2/144: truncate d2/d2a/d2b/f2e 1485665 0 2024-09-13T18:30:28.958 INFO:tasks.workunit.client.0.smithi038.stdout:3/113: dwrite d0/dd/fe [0,4194304] 0 2024-09-13T18:30:28.959 INFO:tasks.workunit.client.1.smithi149.stdout:1/811: dwrite d9/d10/d83/d97/f9a [4194304,4194304] 0 2024-09-13T18:30:28.959 INFO:tasks.workunit.client.1.smithi149.stdout:1/812: write d9/d58/f93 [292138,74651] 0 2024-09-13T18:30:28.959 INFO:tasks.workunit.client.1.smithi149.stdout:1/813: chown d9/d10/d43/dcb/dee 0 1 2024-09-13T18:30:28.960 INFO:tasks.workunit.client.0.smithi038.stdout:1/116: dwrite ff [0,4194304] 0 2024-09-13T18:30:28.976 INFO:tasks.workunit.client.1.smithi149.stdout:1/814: dread d9/d10/d34/dbe/d38/f9c [0,4194304] 0 2024-09-13T18:30:28.976 INFO:tasks.workunit.client.1.smithi149.stdout:3/782: dwrite d1/f11 [0,4194304] 0 2024-09-13T18:30:29.004 INFO:tasks.workunit.client.1.smithi149.stdout:7/893: creat d7/d76/db3/f138 x:0 0 0 2024-09-13T18:30:29.005 INFO:tasks.workunit.client.0.smithi038.stdout:2/145: mkdir d2/d2a/d2b/d39 0 2024-09-13T18:30:29.006 INFO:tasks.workunit.client.1.smithi149.stdout:6/922: creat dc/d15/daa/de5/de6/d113/f126 x:0 0 0 2024-09-13T18:30:29.008 INFO:tasks.workunit.client.0.smithi038.stdout:3/114: creat d0/dd/f2a x:0 0 0 2024-09-13T18:30:29.008 INFO:tasks.workunit.client.1.smithi149.stdout:4/856: sync 2024-09-13T18:30:29.009 INFO:tasks.workunit.client.1.smithi149.stdout:9/658: truncate d0/d2e/d42/d59/f69 7353767 0 2024-09-13T18:30:29.011 INFO:tasks.workunit.client.1.smithi149.stdout:5/750: symlink d3/d5e/lef 0 2024-09-13T18:30:29.011 INFO:tasks.workunit.client.1.smithi149.stdout:5/751: chown d3/d10/d32/d54/d76/d7a 382 1 2024-09-13T18:30:29.017 INFO:tasks.workunit.client.1.smithi149.stdout:8/826: rename d2/d12/dd8/d66/ded/df6 to d2/d12/dd8/d117 0 2024-09-13T18:30:29.017 INFO:tasks.workunit.client.1.smithi149.stdout:8/827: stat d2/d5b/d86/fa7 0 2024-09-13T18:30:29.017 INFO:tasks.workunit.client.1.smithi149.stdout:8/828: chown d2/d12/d40/l98 171 1 2024-09-13T18:30:29.017 INFO:tasks.workunit.client.1.smithi149.stdout:8/829: chown d2/db1/fd0 37 1 2024-09-13T18:30:29.017 INFO:tasks.workunit.client.1.smithi149.stdout:8/830: write d2/d13/f81 [833221,66968] 0 2024-09-13T18:30:29.025 INFO:tasks.workunit.client.0.smithi038.stdout:3/115: dwrite d0/f9 [0,4194304] 0 2024-09-13T18:30:29.026 INFO:tasks.workunit.client.0.smithi038.stdout:2/146: dwrite d2/d2a/f35 [0,4194304] 0 2024-09-13T18:30:29.026 INFO:tasks.workunit.client.0.smithi038.stdout:2/147: readlink d2/lb 0 2024-09-13T18:30:29.029 INFO:tasks.workunit.client.0.smithi038.stdout:1/117: getdents d12 0 2024-09-13T18:30:29.029 INFO:tasks.workunit.client.0.smithi038.stdout:1/118: creat d12/d15/f24 x:0 0 0 2024-09-13T18:30:29.031 INFO:tasks.workunit.client.1.smithi149.stdout:3/783: rmdir d1/d47/d30/d46/d10b 0 2024-09-13T18:30:29.031 INFO:tasks.workunit.client.1.smithi149.stdout:3/784: truncate d1/d48/ddb/ff2 711300 0 2024-09-13T18:30:29.033 INFO:tasks.workunit.client.1.smithi149.stdout:1/815: creat d9/d10/dca/fff x:0 0 0 2024-09-13T18:30:29.036 INFO:tasks.workunit.client.0.smithi038.stdout:3/116: dread d0/f9 [0,4194304] 0 2024-09-13T18:30:29.036 INFO:tasks.workunit.client.1.smithi149.stdout:2/719: truncate db/d1b/d2f/f52 781299 0 2024-09-13T18:30:29.039 INFO:tasks.workunit.client.1.smithi149.stdout:7/894: mkdir d7/d9/d1c/d1f/d21/d49/d102/d10f/d139 0 2024-09-13T18:30:29.041 INFO:tasks.workunit.client.0.smithi038.stdout:2/148: unlink d2/d2a/f29 0 2024-09-13T18:30:29.043 INFO:tasks.workunit.client.0.smithi038.stdout:3/117: write d0/dd/fe [3280206,120209] 0 2024-09-13T18:30:29.044 INFO:tasks.workunit.client.0.smithi038.stdout:3/118: stat d0/dd/d19 0 2024-09-13T18:30:29.044 INFO:tasks.workunit.client.0.smithi038.stdout:3/119: write d0/fc [791345,6458] 0 2024-09-13T18:30:29.044 INFO:tasks.workunit.client.0.smithi038.stdout:3/120: fdatasync d0/f24 0 2024-09-13T18:30:29.044 INFO:tasks.workunit.client.0.smithi038.stdout:3/121: write d0/dd/f1a [610893,7509] 0 2024-09-13T18:30:29.044 INFO:tasks.workunit.client.1.smithi149.stdout:6/923: mknod dc/d15/d54/da9/db3/c127 0 2024-09-13T18:30:29.045 INFO:tasks.workunit.client.1.smithi149.stdout:4/857: mknod df/da0/d12/d21/d22/d30/d56/d91/c129 0 2024-09-13T18:30:29.046 INFO:tasks.workunit.client.1.smithi149.stdout:9/659: symlink d0/d2e/d42/d70/d84/dae/ld0 0 2024-09-13T18:30:29.047 INFO:tasks.workunit.client.1.smithi149.stdout:4/858: dread df/f20 [4194304,4194304] 0 2024-09-13T18:30:29.048 INFO:tasks.workunit.client.1.smithi149.stdout:5/752: mknod d3/d10/d32/d67/d83/cf0 0 2024-09-13T18:30:29.049 INFO:tasks.workunit.client.0.smithi038.stdout:3/122: mkdir d0/dd/d19/d1d/d29/d2b 0 2024-09-13T18:30:29.050 INFO:tasks.workunit.client.1.smithi149.stdout:8/831: mknod d2/d12/d2a/d4d/dbb/c118 0 2024-09-13T18:30:29.050 INFO:tasks.workunit.client.1.smithi149.stdout:8/832: fdatasync d2/fd4 0 2024-09-13T18:30:29.050 INFO:tasks.workunit.client.1.smithi149.stdout:8/833: fsync d2/d12/d2a/d4d/fe0 0 2024-09-13T18:30:29.051 INFO:tasks.workunit.client.1.smithi149.stdout:5/753: dread d3/d10/d4c/d4e/fc4 [0,4194304] 0 2024-09-13T18:30:29.051 INFO:tasks.workunit.client.0.smithi038.stdout:2/149: dread d2/d2a/f30 [0,4194304] 0 2024-09-13T18:30:29.053 INFO:tasks.workunit.client.0.smithi038.stdout:1/119: rename d12/f14 to d12/f25 0 2024-09-13T18:30:29.053 INFO:tasks.workunit.client.0.smithi038.stdout:1/120: chown d12/d15/f24 0 1 2024-09-13T18:30:29.053 INFO:tasks.workunit.client.0.smithi038.stdout:1/121: dread - d12/d15/f22 zero size 2024-09-13T18:30:29.053 INFO:tasks.workunit.client.0.smithi038.stdout:1/122: write d12/f17 [609264,96962] 0 2024-09-13T18:30:29.053 INFO:tasks.workunit.client.0.smithi038.stdout:1/123: creat d12/d15/f26 x:0 0 0 2024-09-13T18:30:29.054 INFO:tasks.workunit.client.1.smithi149.stdout:3/785: link d1/d2e/d1d/d49/fbf d1/d2c/d38/d88/f10d 0 2024-09-13T18:30:29.054 INFO:tasks.workunit.client.0.smithi038.stdout:3/123: rmdir d0/dd/d19/d1d/d29 39 2024-09-13T18:30:29.054 INFO:tasks.workunit.client.0.smithi038.stdout:3/124: chown d0/l11 0 1 2024-09-13T18:30:29.055 INFO:tasks.workunit.client.1.smithi149.stdout:1/816: mknod d9/d15/d73/c100 0 2024-09-13T18:30:29.057 INFO:tasks.workunit.client.0.smithi038.stdout:2/150: rename d2/da/l18 to d2/d1e/l3a 0 2024-09-13T18:30:29.059 INFO:tasks.workunit.client.1.smithi149.stdout:2/720: unlink db/f97 0 2024-09-13T18:30:29.060 INFO:tasks.workunit.client.1.smithi149.stdout:0/840: sync 2024-09-13T18:30:29.062 INFO:tasks.workunit.client.1.smithi149.stdout:7/895: truncate d7/d9/d1c/d2c/f9a 1270982 0 2024-09-13T18:30:29.062 INFO:tasks.workunit.client.1.smithi149.stdout:7/896: stat d7/d9/d1b/c67 0 2024-09-13T18:30:29.062 INFO:tasks.workunit.client.1.smithi149.stdout:7/897: dread - d7/d9/d1c/d1f/d21/d49/d102/f12a zero size 2024-09-13T18:30:29.063 INFO:tasks.workunit.client.0.smithi038.stdout:1/124: rename d12/d15/l1b to d12/d15/l27 0 2024-09-13T18:30:29.065 INFO:tasks.workunit.client.1.smithi149.stdout:6/924: rename dc/d15/d54/da9/d112/l11e to dc/d15/d23/d57/d5c/l128 0 2024-09-13T18:30:29.068 INFO:tasks.workunit.client.1.smithi149.stdout:9/660: rmdir d0/d18/d27/d5c/d99/d9f/daa 0 2024-09-13T18:30:29.068 INFO:tasks.workunit.client.1.smithi149.stdout:9/661: dread - d0/d47/f89 zero size 2024-09-13T18:30:29.068 INFO:tasks.workunit.client.1.smithi149.stdout:9/662: fdatasync d0/d47/f83 0 2024-09-13T18:30:29.069 INFO:tasks.workunit.client.1.smithi149.stdout:5/754: creat d3/d10/d32/d54/d76/d7a/ff1 x:0 0 0 2024-09-13T18:30:29.069 INFO:tasks.workunit.client.1.smithi149.stdout:0/841: write d1/f1a [7785312,68247] 0 2024-09-13T18:30:29.074 INFO:tasks.workunit.client.1.smithi149.stdout:2/721: truncate db/d1b/d1c/d20/d2b/fd8 1337824 0 2024-09-13T18:30:29.075 INFO:tasks.workunit.client.1.smithi149.stdout:2/722: chown db/d1b/l8b 4 1 2024-09-13T18:30:29.075 INFO:tasks.workunit.client.0.smithi038.stdout:3/125: dwrite d0/f9 [0,4194304] 0 2024-09-13T18:30:29.075 INFO:tasks.workunit.client.0.smithi038.stdout:3/126: creat d0/dd/d19/d23/f2c x:0 0 0 2024-09-13T18:30:29.075 INFO:tasks.workunit.client.0.smithi038.stdout:9/141: sync 2024-09-13T18:30:29.076 INFO:tasks.workunit.client.0.smithi038.stdout:9/142: chown d0/d2e/f29 62381875 1 2024-09-13T18:30:29.077 INFO:tasks.workunit.client.1.smithi149.stdout:7/898: link d7/d9/d1b/d71/ddc/lb1 d7/d9/d11/d50/dde/l13a 0 2024-09-13T18:30:29.077 INFO:tasks.workunit.client.0.smithi038.stdout:9/143: read d0/d2e/f27 [813222,70344] 0 2024-09-13T18:30:29.077 INFO:tasks.workunit.client.0.smithi038.stdout:2/151: rmdir d2/da 39 2024-09-13T18:30:29.078 INFO:tasks.workunit.client.0.smithi038.stdout:2/152: chown d2/l14 167725 1 2024-09-13T18:30:29.079 INFO:tasks.workunit.client.0.smithi038.stdout:2/153: write d2/d2a/d2b/f2e [945270,5705] 0 2024-09-13T18:30:29.081 INFO:tasks.workunit.client.1.smithi149.stdout:4/859: rename df/da0/d70/ced to df/da0/d12/d7c/d122/c12a 0 2024-09-13T18:30:29.085 INFO:tasks.workunit.client.1.smithi149.stdout:9/663: link d0/d2e/d42/d70/lcb d0/d18/d27/d5c/d99/ld1 0 2024-09-13T18:30:29.090 INFO:tasks.workunit.client.0.smithi038.stdout:3/127: mknod d0/dd/d19/d1d/d29/c2d 0 2024-09-13T18:30:29.093 INFO:tasks.workunit.client.0.smithi038.stdout:9/144: creat d0/d7/f31 x:0 0 0 2024-09-13T18:30:29.095 INFO:tasks.workunit.client.0.smithi038.stdout:2/154: creat d2/d2a/d2b/d39/f3b x:0 0 0 2024-09-13T18:30:29.095 INFO:tasks.workunit.client.1.smithi149.stdout:7/899: creat d7/d76/db3/d31/ddb/f13b x:0 0 0 2024-09-13T18:30:29.096 INFO:tasks.workunit.client.0.smithi038.stdout:3/128: link d0/f9 d0/dd/d19/d23/f2e 0 2024-09-13T18:30:29.098 INFO:tasks.workunit.client.1.smithi149.stdout:3/786: rename d1/d2c/d38/f81 to d1/d2e/d1d/d6c/dcd/f10e 0 2024-09-13T18:30:29.099 INFO:tasks.workunit.client.0.smithi038.stdout:9/145: rename d0/d7/d13/c26 to d0/d7/d13/c32 0 2024-09-13T18:30:29.099 INFO:tasks.workunit.client.0.smithi038.stdout:1/125: dwrite d12/f25 [0,4194304] 0 2024-09-13T18:30:29.100 INFO:tasks.workunit.client.1.smithi149.stdout:5/755: dwrite d3/d8/d13/f18 [0,4194304] 0 2024-09-13T18:30:29.100 INFO:tasks.workunit.client.1.smithi149.stdout:5/756: creat d3/d8/d6d/ff2 x:0 0 0 2024-09-13T18:30:29.100 INFO:tasks.workunit.client.1.smithi149.stdout:4/860: symlink df/da0/d12/d21/d22/d30/d56/l12b 0 2024-09-13T18:30:29.100 INFO:tasks.workunit.client.1.smithi149.stdout:4/861: creat df/da0/d1c/d69/f12c x:0 0 0 2024-09-13T18:30:29.100 INFO:tasks.workunit.client.1.smithi149.stdout:4/862: dread - df/da0/d1c/fd2 zero size 2024-09-13T18:30:29.104 INFO:tasks.workunit.client.1.smithi149.stdout:0/842: symlink d1/d29/d31/l123 0 2024-09-13T18:30:29.104 INFO:tasks.workunit.client.1.smithi149.stdout:0/843: fsync d1/d48/d92/db4/dbe/ffc 0 2024-09-13T18:30:29.104 INFO:tasks.workunit.client.1.smithi149.stdout:2/723: dwrite db/d10/d8d/fa3 [0,4194304] 0 2024-09-13T18:30:29.106 INFO:tasks.workunit.client.1.smithi149.stdout:7/900: creat d7/d76/db3/d6f/d9d/f13c x:0 0 0 2024-09-13T18:30:29.112 INFO:tasks.workunit.client.1.smithi149.stdout:6/925: rename dc/d15/d54/d85/lb4 to dc/d15/d23/d5f/dac/l129 0 2024-09-13T18:30:29.112 INFO:tasks.workunit.client.1.smithi149.stdout:6/926: write dc/d70/dbc/f6e [595916,164] 0 2024-09-13T18:30:29.112 INFO:tasks.workunit.client.1.smithi149.stdout:6/927: write dc/d15/d23/d5f/dac/fe8 [287166,105085] 0 2024-09-13T18:30:29.112 INFO:tasks.workunit.client.1.smithi149.stdout:3/787: mkdir d1/d12/d20/d54/dd1/d10f 0 2024-09-13T18:30:29.118 INFO:tasks.workunit.client.1.smithi149.stdout:5/757: truncate d3/d10/d32/f3c 1909077 0 2024-09-13T18:30:29.123 INFO:tasks.workunit.client.1.smithi149.stdout:4/863: mkdir df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3/dc8/d12d 0 2024-09-13T18:30:29.125 INFO:tasks.workunit.client.1.smithi149.stdout:0/844: link d1/d29/d31/d44/d81/f63 d1/d2/d8a/d90/f124 0 2024-09-13T18:30:29.126 INFO:tasks.workunit.client.0.smithi038.stdout:9/146: truncate d0/fb 3839137 0 2024-09-13T18:30:29.127 INFO:tasks.workunit.client.0.smithi038.stdout:9/147: fsync d0/f11 0 2024-09-13T18:30:29.127 INFO:tasks.workunit.client.0.smithi038.stdout:2/155: dwrite d2/da/d16/f21 [0,4194304] 0 2024-09-13T18:30:29.130 INFO:tasks.workunit.client.0.smithi038.stdout:2/156: mknod d2/da/d16/c3c 0 2024-09-13T18:30:29.131 INFO:tasks.workunit.client.0.smithi038.stdout:2/157: read d2/da/fd [687531,28403] 0 2024-09-13T18:30:29.131 INFO:tasks.workunit.client.0.smithi038.stdout:2/158: creat d2/d2a/f3d x:0 0 0 2024-09-13T18:30:29.131 INFO:tasks.workunit.client.1.smithi149.stdout:2/724: link db/d13/f4a db/d1b/d2f/d69/deb/ff0 0 2024-09-13T18:30:29.132 INFO:tasks.workunit.client.0.smithi038.stdout:1/126: symlink d12/l28 0 2024-09-13T18:30:29.133 INFO:tasks.workunit.client.0.smithi038.stdout:1/127: write f10 [175082,64980] 0 2024-09-13T18:30:29.133 INFO:tasks.workunit.client.0.smithi038.stdout:1/128: fsync fb 0 2024-09-13T18:30:29.134 INFO:tasks.workunit.client.0.smithi038.stdout:3/129: dwrite d0/f2 [0,4194304] 0 2024-09-13T18:30:29.134 INFO:tasks.workunit.client.1.smithi149.stdout:5/758: dwrite d3/d10/d4c/d4e/da4/fa6 [0,4194304] 0 2024-09-13T18:30:29.135 INFO:tasks.workunit.client.1.smithi149.stdout:9/664: rename d0/d18/d27/d5c/d99/fb9 to d0/d18/d68/fd2 0 2024-09-13T18:30:29.137 INFO:tasks.workunit.client.0.smithi038.stdout:2/159: link d2/d1e/f2f d2/d1e/f3e 0 2024-09-13T18:30:29.139 INFO:tasks.workunit.client.1.smithi149.stdout:6/928: creat dc/d15/daa/de5/de6/f12a x:0 0 0 2024-09-13T18:30:29.139 INFO:tasks.workunit.client.0.smithi038.stdout:9/148: write d0/ff [2567844,107981] 0 2024-09-13T18:30:29.141 INFO:tasks.workunit.client.1.smithi149.stdout:3/788: mkdir d1/d12/d20/d54/d110 0 2024-09-13T18:30:29.141 INFO:tasks.workunit.client.0.smithi038.stdout:9/149: dread d0/d7/f23 [0,4194304] 0 2024-09-13T18:30:29.142 INFO:tasks.workunit.client.0.smithi038.stdout:9/150: read d0/d2e/f27 [287547,24586] 0 2024-09-13T18:30:29.144 INFO:tasks.workunit.client.0.smithi038.stdout:3/130: write d0/f9 [819939,96763] 0 2024-09-13T18:30:29.149 INFO:tasks.workunit.client.0.smithi038.stdout:2/160: mknod d2/da/d16/c3f 0 2024-09-13T18:30:29.149 INFO:tasks.workunit.client.0.smithi038.stdout:5/106: sync 2024-09-13T18:30:29.149 INFO:tasks.workunit.client.0.smithi038.stdout:8/244: sync 2024-09-13T18:30:29.149 INFO:tasks.workunit.client.0.smithi038.stdout:6/142: sync 2024-09-13T18:30:29.149 INFO:tasks.workunit.client.0.smithi038.stdout:4/227: sync 2024-09-13T18:30:29.150 INFO:tasks.workunit.client.0.smithi038.stdout:4/228: creat d2/df/d22/dc/f44 x:0 0 0 2024-09-13T18:30:29.150 INFO:tasks.workunit.client.0.smithi038.stdout:4/229: readlink d2/df/d22/dc/l3c 0 2024-09-13T18:30:29.150 INFO:tasks.workunit.client.0.smithi038.stdout:4/230: write d2/df/d22/f29 [509275,118467] 0 2024-09-13T18:30:29.150 INFO:tasks.workunit.client.0.smithi038.stdout:0/122: sync 2024-09-13T18:30:29.150 INFO:tasks.workunit.client.0.smithi038.stdout:1/129: mknod d12/c29 0 2024-09-13T18:30:29.150 INFO:tasks.workunit.client.0.smithi038.stdout:1/130: dread - fe zero size 2024-09-13T18:30:29.151 INFO:tasks.workunit.client.1.smithi149.stdout:8/834: sync 2024-09-13T18:30:29.152 INFO:tasks.workunit.client.0.smithi038.stdout:9/151: mkdir d0/d7/d2c/d33 0 2024-09-13T18:30:29.159 INFO:tasks.workunit.client.1.smithi149.stdout:4/864: mknod df/da0/dcc/c12e 0 2024-09-13T18:30:29.162 INFO:tasks.workunit.client.1.smithi149.stdout:0/845: creat d1/d48/d92/d10c/f125 x:0 0 0 2024-09-13T18:30:29.162 INFO:tasks.workunit.client.1.smithi149.stdout:0/846: chown d1/d29/d31/d3e 0 1 2024-09-13T18:30:29.168 INFO:tasks.workunit.client.0.smithi038.stdout:8/245: write d1/de/f10 [605945,8438] 0 2024-09-13T18:30:29.168 INFO:tasks.workunit.client.0.smithi038.stdout:8/246: truncate d1/d4/f4f 956750 0 2024-09-13T18:30:29.168 INFO:tasks.workunit.client.0.smithi038.stdout:8/247: creat d1/d4/f59 x:0 0 0 2024-09-13T18:30:29.170 INFO:tasks.workunit.client.1.smithi149.stdout:2/725: creat db/d13/d70/dad/ff1 x:0 0 0 2024-09-13T18:30:29.171 INFO:tasks.workunit.client.0.smithi038.stdout:4/231: mknod d2/df/d22/dc/d8/c45 0 2024-09-13T18:30:29.173 INFO:tasks.workunit.client.1.smithi149.stdout:0/847: dread d1/d2/d8a/d90/f82 [0,4194304] 0 2024-09-13T18:30:29.174 INFO:tasks.workunit.client.1.smithi149.stdout:7/901: rmdir d7/d12 39 2024-09-13T18:30:29.174 INFO:tasks.workunit.client.1.smithi149.stdout:7/902: chown d7/d9/d1b/d71/ddc 7 1 2024-09-13T18:30:29.176 INFO:tasks.workunit.client.1.smithi149.stdout:1/817: sync 2024-09-13T18:30:29.177 INFO:tasks.workunit.client.1.smithi149.stdout:1/818: dread - d9/d15/d60/d80/d8b/ff4 zero size 2024-09-13T18:30:29.180 INFO:tasks.workunit.client.0.smithi038.stdout:4/232: creat d2/df/d1b/d10/f46 x:0 0 0 2024-09-13T18:30:29.181 INFO:tasks.workunit.client.0.smithi038.stdout:1/131: mkdir d12/d2a 0 2024-09-13T18:30:29.182 INFO:tasks.workunit.client.1.smithi149.stdout:5/759: mknod d3/d10/d32/d67/cf3 0 2024-09-13T18:30:29.182 INFO:tasks.workunit.client.1.smithi149.stdout:0/848: dread d1/d2/f9e [0,4194304] 0 2024-09-13T18:30:29.182 INFO:tasks.workunit.client.1.smithi149.stdout:0/849: fdatasync d1/d2/d41/fae 0 2024-09-13T18:30:29.182 INFO:tasks.workunit.client.1.smithi149.stdout:0/850: fsync d1/d29/d31/d44/f99 0 2024-09-13T18:30:29.182 INFO:tasks.workunit.client.1.smithi149.stdout:0/851: chown d1/d48/f6d 101395 1 2024-09-13T18:30:29.183 INFO:tasks.workunit.client.0.smithi038.stdout:7/131: sync 2024-09-13T18:30:29.183 INFO:tasks.workunit.client.0.smithi038.stdout:7/132: chown db/d12/d13/f17 0 1 2024-09-13T18:30:29.183 INFO:tasks.workunit.client.0.smithi038.stdout:2/161: dwrite d2/da/f25 [0,4194304] 0 2024-09-13T18:30:29.183 INFO:tasks.workunit.client.0.smithi038.stdout:5/107: dwrite df/d13/f21 [0,4194304] 0 2024-09-13T18:30:29.183 INFO:tasks.workunit.client.0.smithi038.stdout:5/108: truncate fd 562607 0 2024-09-13T18:30:29.184 INFO:tasks.workunit.client.0.smithi038.stdout:5/109: chown df 1421 1 2024-09-13T18:30:29.184 INFO:tasks.workunit.client.1.smithi149.stdout:8/835: dwrite d2/d13/d3a/d7f/da8/fe7 [0,4194304] 0 2024-09-13T18:30:29.184 INFO:tasks.workunit.client.1.smithi149.stdout:8/836: chown d2/d12/dd8/d58/feb 44218988 1 2024-09-13T18:30:29.187 INFO:tasks.workunit.client.0.smithi038.stdout:4/233: rename d2/df/d22/l2a to d2/df/d1b/d10/l47 0 2024-09-13T18:30:29.187 INFO:tasks.workunit.client.1.smithi149.stdout:6/929: rename dc/d2f/fcf to dc/d15/d54/d5e/df7/f12b 0 2024-09-13T18:30:29.188 INFO:tasks.workunit.client.1.smithi149.stdout:3/789: symlink d1/d47/l111 0 2024-09-13T18:30:29.188 INFO:tasks.workunit.client.1.smithi149.stdout:3/790: dread - d1/fec zero size 2024-09-13T18:30:29.191 INFO:tasks.workunit.client.0.smithi038.stdout:7/133: link db/d12/d1c/f20 db/d12/f34 0 2024-09-13T18:30:29.193 INFO:tasks.workunit.client.1.smithi149.stdout:4/865: creat df/da0/d12/d7c/d122/f12f x:0 0 0 2024-09-13T18:30:29.195 INFO:tasks.workunit.client.1.smithi149.stdout:5/760: dread d3/d10/d4c/d4e/d61/d63/fc5 [0,4194304] 0 2024-09-13T18:30:29.195 INFO:tasks.workunit.client.1.smithi149.stdout:1/819: dread d9/d10/d83/d97/fc1 [0,4194304] 0 2024-09-13T18:30:29.195 INFO:tasks.workunit.client.1.smithi149.stdout:5/761: readlink d3/d10/d4c/d4e/d61/d75/le9 0 2024-09-13T18:30:29.196 INFO:tasks.workunit.client.1.smithi149.stdout:2/726: symlink db/d1b/d6c/lf2 0 2024-09-13T18:30:29.197 INFO:tasks.workunit.client.1.smithi149.stdout:5/762: dread d3/d8/d13/f6c [4194304,4194304] 0 2024-09-13T18:30:29.198 INFO:tasks.workunit.client.1.smithi149.stdout:7/903: truncate d7/f6b 3965927 0 2024-09-13T18:30:29.198 INFO:tasks.workunit.client.1.smithi149.stdout:7/904: fdatasync d7/d9/d11/de2/f124 0 2024-09-13T18:30:29.198 INFO:tasks.workunit.client.1.smithi149.stdout:7/905: chown d7/d9/d11/de2 5670 1 2024-09-13T18:30:29.200 INFO:tasks.workunit.client.0.smithi038.stdout:9/152: dwrite d0/d7/f31 [0,4194304] 0 2024-09-13T18:30:29.201 INFO:tasks.workunit.client.0.smithi038.stdout:9/153: chown d0/f1 36 1 2024-09-13T18:30:29.201 INFO:tasks.workunit.client.0.smithi038.stdout:9/154: truncate d0/d7/d13/f1e 1769287 0 2024-09-13T18:30:29.201 INFO:tasks.workunit.client.0.smithi038.stdout:9/155: write d0/f2a [1823693,115319] 0 2024-09-13T18:30:29.201 INFO:tasks.workunit.client.1.smithi149.stdout:9/665: mknod d0/d18/cd3 0 2024-09-13T18:30:29.202 INFO:tasks.workunit.client.0.smithi038.stdout:2/162: rmdir d2/da 39 2024-09-13T18:30:29.204 INFO:tasks.workunit.client.1.smithi149.stdout:8/837: write d2/d12/d2a/d4d/f78 [1025119,109218] 0 2024-09-13T18:30:29.207 INFO:tasks.workunit.client.0.smithi038.stdout:1/132: link d12/f1c d12/f2b 0 2024-09-13T18:30:29.207 INFO:tasks.workunit.client.0.smithi038.stdout:1/133: fdatasync f8 0 2024-09-13T18:30:29.207 INFO:tasks.workunit.client.0.smithi038.stdout:1/134: readlink d12/l28 0 2024-09-13T18:30:29.209 INFO:tasks.workunit.client.1.smithi149.stdout:3/791: mknod d1/d48/d75/c112 0 2024-09-13T18:30:29.209 INFO:tasks.workunit.client.1.smithi149.stdout:3/792: chown d1/d48/ddb 12688 1 2024-09-13T18:30:29.209 INFO:tasks.workunit.client.1.smithi149.stdout:3/793: chown d1/d2e/d1d/d6c/dcd 1532 1 2024-09-13T18:30:29.211 INFO:tasks.workunit.client.1.smithi149.stdout:0/852: rename d1/d2/d4e/cc4 to d1/d2/d41/c126 0 2024-09-13T18:30:29.212 INFO:tasks.workunit.client.0.smithi038.stdout:7/134: mknod db/d21/c35 0 2024-09-13T18:30:29.212 INFO:tasks.workunit.client.0.smithi038.stdout:7/135: truncate db/d12/d13/f17 707686 0 2024-09-13T18:30:29.213 INFO:tasks.workunit.client.0.smithi038.stdout:9/156: dread d0/d7/f31 [0,4194304] 0 2024-09-13T18:30:29.214 INFO:tasks.workunit.client.1.smithi149.stdout:4/866: symlink df/da0/d12/d21/d22/d30/d41/d57/d75/da1/l130 0 2024-09-13T18:30:29.214 INFO:tasks.workunit.client.1.smithi149.stdout:4/867: stat df/c39 0 2024-09-13T18:30:29.214 INFO:tasks.workunit.client.1.smithi149.stdout:4/868: write df/da0/d112/fff [464480,98090] 0 2024-09-13T18:30:29.214 INFO:tasks.workunit.client.1.smithi149.stdout:4/869: dread - df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fb3 zero size 2024-09-13T18:30:29.214 INFO:tasks.workunit.client.1.smithi149.stdout:4/870: getdents df/da0/d12/d21/d22/d30/d56/ddb 0 2024-09-13T18:30:29.214 INFO:tasks.workunit.client.1.smithi149.stdout:4/871: write df/da0/d12/d21/d22/d30/d41/d57/f127 [1005439,122540] 0 2024-09-13T18:30:29.215 INFO:tasks.workunit.client.0.smithi038.stdout:8/248: dwrite d1/d8/f1f [0,4194304] 0 2024-09-13T18:30:29.215 INFO:tasks.workunit.client.0.smithi038.stdout:8/249: truncate d1/de/d21/f52 189089 0 2024-09-13T18:30:29.215 INFO:tasks.workunit.client.0.smithi038.stdout:8/250: chown d1/de/d21/d24 28335 1 2024-09-13T18:30:29.217 INFO:tasks.workunit.client.1.smithi149.stdout:1/820: mkdir d9/d10/d101 0 2024-09-13T18:30:29.217 INFO:tasks.workunit.client.1.smithi149.stdout:1/821: chown d9/d10/d83/d97/f87 7973 1 2024-09-13T18:30:29.220 INFO:tasks.workunit.client.1.smithi149.stdout:2/727: link db/d1b/d6c/lf2 db/d10/d8d/lf3 0 2024-09-13T18:30:29.220 INFO:tasks.workunit.client.1.smithi149.stdout:4/872: dread df/fc0 [0,4194304] 0 2024-09-13T18:30:29.223 INFO:tasks.workunit.client.0.smithi038.stdout:2/163: mkdir d2/d2a/d2b/d39/d40 0 2024-09-13T18:30:29.226 INFO:tasks.workunit.client.1.smithi149.stdout:8/838: unlink d2/d12/c56 0 2024-09-13T18:30:29.226 INFO:tasks.workunit.client.1.smithi149.stdout:8/839: stat d2/l26 0 2024-09-13T18:30:29.233 INFO:tasks.workunit.client.1.smithi149.stdout:5/763: dwrite d3/d10/d4c/d4e/d61/f96 [0,4194304] 0 2024-09-13T18:30:29.233 INFO:tasks.workunit.client.1.smithi149.stdout:7/906: dwrite d7/f8 [0,4194304] 0 2024-09-13T18:30:29.233 INFO:tasks.workunit.client.1.smithi149.stdout:7/907: creat d7/d9/d1b/d71/ddc/f13d x:0 0 0 2024-09-13T18:30:29.233 INFO:tasks.workunit.client.1.smithi149.stdout:3/794: dwrite d1/d48/f102 [0,4194304] 0 2024-09-13T18:30:29.234 INFO:tasks.workunit.client.1.smithi149.stdout:6/930: dwrite dc/d15/daa/de5/de6/fe4 [0,4194304] 0 2024-09-13T18:30:29.245 INFO:tasks.workunit.client.1.smithi149.stdout:3/795: dread d1/d12/d20/d54/f6a [0,4194304] 0 2024-09-13T18:30:29.245 INFO:tasks.workunit.client.1.smithi149.stdout:3/796: truncate d1/d48/ff8 1489159 0 2024-09-13T18:30:29.393 INFO:tasks.workunit.client.0.smithi038.stdout:4/234: link d2/df/l20 d2/df/d22/l48 0 2024-09-13T18:30:29.393 INFO:tasks.workunit.client.1.smithi149.stdout:0/853: mknod d1/d48/c127 0 2024-09-13T18:30:29.394 INFO:tasks.workunit.client.1.smithi149.stdout:0/854: truncate d1/d29/d31/d83/fb2 1388959 0 2024-09-13T18:30:29.394 INFO:tasks.workunit.client.0.smithi038.stdout:7/136: symlink db/d12/d1a/d22/l36 0 2024-09-13T18:30:29.394 INFO:tasks.workunit.client.0.smithi038.stdout:7/137: creat db/d12/d13/f37 x:0 0 0 2024-09-13T18:30:29.395 INFO:tasks.workunit.client.1.smithi149.stdout:1/822: symlink d9/d10/d34/dbe/d38/df2/l102 0 2024-09-13T18:30:29.396 INFO:tasks.workunit.client.0.smithi038.stdout:9/157: mknod d0/d2e/c34 0 2024-09-13T18:30:29.396 INFO:tasks.workunit.client.0.smithi038.stdout:9/158: creat d0/d7/f35 x:0 0 0 2024-09-13T18:30:29.398 INFO:tasks.workunit.client.1.smithi149.stdout:2/728: creat db/d10/da9/ff4 x:0 0 0 2024-09-13T18:30:29.399 INFO:tasks.workunit.client.1.smithi149.stdout:2/729: fdatasync db/d13/d70/f9b 0 2024-09-13T18:30:29.400 INFO:tasks.workunit.client.0.smithi038.stdout:8/251: truncate d1/fc 1171959 0 2024-09-13T18:30:29.400 INFO:tasks.workunit.client.0.smithi038.stdout:8/252: write d1/d4/f13 [431952,112056] 0 2024-09-13T18:30:29.400 INFO:tasks.workunit.client.0.smithi038.stdout:8/253: creat d1/de/f5a x:0 0 0 2024-09-13T18:30:29.401 INFO:tasks.workunit.client.1.smithi149.stdout:4/873: truncate df/da0/d12/fd6 700078 0 2024-09-13T18:30:29.401 INFO:tasks.workunit.client.1.smithi149.stdout:4/874: read - df/da0/d70/db5/db9/fe7 zero size 2024-09-13T18:30:29.402 INFO:tasks.workunit.client.0.smithi038.stdout:1/135: getdents d12/d15 0 2024-09-13T18:30:29.402 INFO:tasks.workunit.client.0.smithi038.stdout:1/136: chown d12/d15 0 1 2024-09-13T18:30:29.404 INFO:tasks.workunit.client.1.smithi149.stdout:9/666: getdents d0/d18/d93 0 2024-09-13T18:30:29.404 INFO:tasks.workunit.client.1.smithi149.stdout:9/667: dread - d0/d18/d27/d5c/d7e/fb8 zero size 2024-09-13T18:30:29.404 INFO:tasks.workunit.client.1.smithi149.stdout:9/668: chown d0/d47/l4a 1 1 2024-09-13T18:30:29.404 INFO:tasks.workunit.client.1.smithi149.stdout:9/669: chown d0/d18/d27/d5c/d7e/cb3 125943841 1 2024-09-13T18:30:29.405 INFO:tasks.workunit.client.1.smithi149.stdout:8/840: mknod d2/dc4/c119 0 2024-09-13T18:30:29.405 INFO:tasks.workunit.client.1.smithi149.stdout:8/841: chown d2/d5b/f104 8 1 2024-09-13T18:30:29.409 INFO:tasks.workunit.client.1.smithi149.stdout:5/764: symlink d3/d10/d32/d54/d97/de7/lf4 0 2024-09-13T18:30:29.409 INFO:tasks.workunit.client.1.smithi149.stdout:5/765: readlink d3/d10/d32/l77 0 2024-09-13T18:30:29.409 INFO:tasks.workunit.client.1.smithi149.stdout:5/766: write d3/d10/d4c/d4e/d61/d75/fa1 [1116859,14807] 0 2024-09-13T18:30:29.413 INFO:tasks.workunit.client.1.smithi149.stdout:7/908: creat d7/d9/d11/f13e x:0 0 0 2024-09-13T18:30:29.415 INFO:tasks.workunit.client.1.smithi149.stdout:8/842: write d2/f34 [1089811,10162] 0 2024-09-13T18:30:29.415 INFO:tasks.workunit.client.1.smithi149.stdout:8/843: write d2/d13/d3a/d7f/da8/fa9 [545251,68524] 0 2024-09-13T18:30:29.421 INFO:tasks.workunit.client.1.smithi149.stdout:6/931: creat dc/d15/d23/d104/da1/dcb/d118/f12c x:0 0 0 2024-09-13T18:30:29.422 INFO:tasks.workunit.client.0.smithi038.stdout:7/138: rename db/d12/d1a/d26/f2e to db/d12/d1a/d22/f38 0 2024-09-13T18:30:29.422 INFO:tasks.workunit.client.0.smithi038.stdout:8/254: dwrite d1/de/d3a/f53 [0,4194304] 0 2024-09-13T18:30:29.424 INFO:tasks.workunit.client.1.smithi149.stdout:3/797: rename d1/d48/df0 to d1/d2e/d1d/d6c/daa/dfb/d113 0 2024-09-13T18:30:29.426 INFO:tasks.workunit.client.0.smithi038.stdout:9/159: mknod d0/d7/d13/d2d/c36 0 2024-09-13T18:30:29.427 INFO:tasks.workunit.client.0.smithi038.stdout:9/160: write d0/f1 [1183715,112980] 0 2024-09-13T18:30:29.427 INFO:tasks.workunit.client.0.smithi038.stdout:9/161: chown d0/d7/c1d 448 1 2024-09-13T18:30:29.429 INFO:tasks.workunit.client.1.smithi149.stdout:2/730: mknod db/d10/d8d/daf/cf5 0 2024-09-13T18:30:29.430 INFO:tasks.workunit.client.0.smithi038.stdout:1/137: symlink d12/d15/l2c 0 2024-09-13T18:30:29.433 INFO:tasks.workunit.client.0.smithi038.stdout:8/255: dread d1/d2a/f38 [0,4194304] 0 2024-09-13T18:30:29.439 INFO:tasks.workunit.client.1.smithi149.stdout:4/875: mknod df/da0/d12/d21/d22/d30/d41/d57/d60/dc4/c131 0 2024-09-13T18:30:29.439 INFO:tasks.workunit.client.1.smithi149.stdout:4/876: read df/da0/d112/fe0 [3177232,75465] 0 2024-09-13T18:30:29.441 INFO:tasks.workunit.client.1.smithi149.stdout:9/670: mknod d0/d18/d68/cd4 0 2024-09-13T18:30:29.441 INFO:tasks.workunit.client.0.smithi038.stdout:4/235: rmdir d2 39 2024-09-13T18:30:29.441 INFO:tasks.workunit.client.1.smithi149.stdout:2/731: dread db/d10/d12/f3d [0,4194304] 0 2024-09-13T18:30:29.442 INFO:tasks.workunit.client.0.smithi038.stdout:7/139: chown db/l15 0 1 2024-09-13T18:30:29.444 INFO:tasks.workunit.client.1.smithi149.stdout:7/909: symlink d7/d9/d1c/d2c/d60/l13f 0 2024-09-13T18:30:29.444 INFO:tasks.workunit.client.1.smithi149.stdout:7/910: write d7/d9/d1c/d1f/d3d/f11b [898303,127921] 0 2024-09-13T18:30:29.446 INFO:tasks.workunit.client.1.smithi149.stdout:8/844: symlink d2/d12/dd8/d66/l11a 0 2024-09-13T18:30:29.447 INFO:tasks.workunit.client.1.smithi149.stdout:6/932: mknod dc/d15/d23/d5f/d10f/c12d 0 2024-09-13T18:30:29.448 INFO:tasks.workunit.client.0.smithi038.stdout:9/162: symlink d0/d7/d2c/d33/l37 0 2024-09-13T18:30:29.450 INFO:tasks.workunit.client.0.smithi038.stdout:4/236: mkdir d2/d49 0 2024-09-13T18:30:29.452 INFO:tasks.workunit.client.0.smithi038.stdout:1/138: dwrite ff [4194304,4194304] 0 2024-09-13T18:30:29.452 INFO:tasks.workunit.client.1.smithi149.stdout:5/767: rename d3/d10/d32/d67/c9f to d3/d10/d4c/d4e/de8/cf5 0 2024-09-13T18:30:29.455 INFO:tasks.workunit.client.1.smithi149.stdout:3/798: mkdir d1/d114 0 2024-09-13T18:30:29.456 INFO:tasks.workunit.client.1.smithi149.stdout:5/768: dread d3/d10/d4c/f59 [0,4194304] 0 2024-09-13T18:30:29.456 INFO:tasks.workunit.client.0.smithi038.stdout:1/139: dread f3 [0,4194304] 0 2024-09-13T18:30:29.456 INFO:tasks.workunit.client.0.smithi038.stdout:7/140: dread db/d12/d1a/f1f [0,4194304] 0 2024-09-13T18:30:29.456 INFO:tasks.workunit.client.0.smithi038.stdout:9/163: creat d0/d2e/f38 x:0 0 0 2024-09-13T18:30:29.457 INFO:tasks.workunit.client.1.smithi149.stdout:7/911: dread d7/d76/db3/d31/f5b [0,4194304] 0 2024-09-13T18:30:29.457 INFO:tasks.workunit.client.1.smithi149.stdout:5/769: write d3/d10/d4c/d4e/fc4 [255795,115988] 0 2024-09-13T18:30:29.457 INFO:tasks.workunit.client.1.smithi149.stdout:0/855: symlink d1/d2/l128 0 2024-09-13T18:30:29.458 INFO:tasks.workunit.client.1.smithi149.stdout:0/856: creat d1/d29/d31/d3e/f129 x:0 0 0 2024-09-13T18:30:29.459 INFO:tasks.workunit.client.1.smithi149.stdout:4/877: symlink df/da0/d12/d7c/d109/l132 0 2024-09-13T18:30:29.459 INFO:tasks.workunit.client.0.smithi038.stdout:4/237: dread d2/df/d22/dc/f18 [0,4194304] 0 2024-09-13T18:30:29.461 INFO:tasks.workunit.client.0.smithi038.stdout:1/140: creat d12/f2d x:0 0 0 2024-09-13T18:30:29.464 INFO:tasks.workunit.client.1.smithi149.stdout:9/671: creat d0/d2e/d42/d70/d84/dae/fd5 x:0 0 0 2024-09-13T18:30:29.464 INFO:tasks.workunit.client.1.smithi149.stdout:9/672: chown d0/d2e/d42/d59/d86/f9b 57 1 2024-09-13T18:30:29.465 INFO:tasks.workunit.client.0.smithi038.stdout:7/141: mknod db/d12/d1a/d22/c39 0 2024-09-13T18:30:29.465 INFO:tasks.workunit.client.0.smithi038.stdout:7/142: read db/d12/d1a/d22/f38 [5870518,84459] 0 2024-09-13T18:30:29.465 INFO:tasks.workunit.client.0.smithi038.stdout:7/143: chown db/d12/d1a/d22/f30 0 1 2024-09-13T18:30:29.465 INFO:tasks.workunit.client.0.smithi038.stdout:7/144: write db/d12/d1a/d22/f2c [1027958,52333] 0 2024-09-13T18:30:29.467 INFO:tasks.workunit.client.1.smithi149.stdout:2/732: symlink db/d1b/dab/lf6 0 2024-09-13T18:30:29.467 INFO:tasks.workunit.client.1.smithi149.stdout:2/733: readlink db/d13/d70/l8e 0 2024-09-13T18:30:29.467 INFO:tasks.workunit.client.1.smithi149.stdout:2/734: truncate db/d10/d8d/fc6 173991 0 2024-09-13T18:30:29.468 INFO:tasks.workunit.client.0.smithi038.stdout:4/238: unlink d2/df/d22/dc/f42 0 2024-09-13T18:30:29.469 INFO:tasks.workunit.client.1.smithi149.stdout:8/845: rmdir d2/d12/dd8/d58/d97/d107 0 2024-09-13T18:30:29.471 INFO:tasks.workunit.client.1.smithi149.stdout:4/878: dread df/f90 [0,4194304] 0 2024-09-13T18:30:29.471 INFO:tasks.workunit.client.1.smithi149.stdout:4/879: write df/da0/f80 [14862,44759] 0 2024-09-13T18:30:29.473 INFO:tasks.workunit.client.0.smithi038.stdout:4/239: mknod d2/df/d1b/c4a 0 2024-09-13T18:30:29.476 INFO:tasks.workunit.client.1.smithi149.stdout:3/799: creat d1/d2e/d1d/d6c/daa/dfb/d113/f115 x:0 0 0 2024-09-13T18:30:29.477 INFO:tasks.workunit.client.0.smithi038.stdout:1/141: dread ff [0,4194304] 0 2024-09-13T18:30:29.478 INFO:tasks.workunit.client.1.smithi149.stdout:5/770: creat d3/d10/d32/d54/dbd/ff6 x:0 0 0 2024-09-13T18:30:29.479 INFO:tasks.workunit.client.1.smithi149.stdout:8/846: dread d2/d13/d3a/d7f/f82 [0,4194304] 0 2024-09-13T18:30:29.479 INFO:tasks.workunit.client.1.smithi149.stdout:6/933: dwrite dc/d76/f7b [0,4194304] 0 2024-09-13T18:30:29.480 INFO:tasks.workunit.client.1.smithi149.stdout:7/912: symlink d7/d9/d11/d50/dde/l140 0 2024-09-13T18:30:29.481 INFO:tasks.workunit.client.0.smithi038.stdout:9/164: dwrite d0/d7/d13/f17 [0,4194304] 0 2024-09-13T18:30:29.483 INFO:tasks.workunit.client.0.smithi038.stdout:4/240: dread d2/df/d22/dc/d8/f2e [0,4194304] 0 2024-09-13T18:30:29.485 INFO:tasks.workunit.client.1.smithi149.stdout:0/857: rename d1/d2/d41/ldc to d1/d29/d31/d44/d81/d62/l12a 0 2024-09-13T18:30:29.487 INFO:tasks.workunit.client.1.smithi149.stdout:9/673: dwrite d0/d18/d27/d5c/d7e/f97 [0,4194304] 0 2024-09-13T18:30:29.487 INFO:tasks.workunit.client.1.smithi149.stdout:9/674: write d0/d2e/fb1 [909338,12295] 0 2024-09-13T18:30:29.488 INFO:tasks.workunit.client.1.smithi149.stdout:9/675: write d0/f67 [790805,26303] 0 2024-09-13T18:30:29.488 INFO:tasks.workunit.client.1.smithi149.stdout:9/676: write d0/d2e/d42/d59/f7c [5132124,47766] 0 2024-09-13T18:30:29.488 INFO:tasks.workunit.client.1.smithi149.stdout:2/735: mknod db/cf7 0 2024-09-13T18:30:29.491 INFO:tasks.workunit.client.1.smithi149.stdout:4/880: creat df/da0/d12/d21/d22/d30/d41/d57/d60/dc4/f133 x:0 0 0 2024-09-13T18:30:29.491 INFO:tasks.workunit.client.1.smithi149.stdout:5/771: dread d3/d10/d32/f38 [0,4194304] 0 2024-09-13T18:30:29.492 INFO:tasks.workunit.client.1.smithi149.stdout:5/772: write d3/d10/d4c/d4e/fc4 [162813,99997] 0 2024-09-13T18:30:29.492 INFO:tasks.workunit.client.1.smithi149.stdout:5/773: write d3/d10/d32/d67/d83/fd1 [156202,84260] 0 2024-09-13T18:30:29.492 INFO:tasks.workunit.client.0.smithi038.stdout:1/142: mknod d12/c2e 0 2024-09-13T18:30:29.493 INFO:tasks.workunit.client.1.smithi149.stdout:3/800: link d1/d2e/d1d/l32 d1/d2c/d38/l116 0 2024-09-13T18:30:29.494 INFO:tasks.workunit.client.0.smithi038.stdout:4/241: mkdir d2/d49/d4b 0 2024-09-13T18:30:29.495 INFO:tasks.workunit.client.1.smithi149.stdout:8/847: rmdir d2/d12/d87/ddf 39 2024-09-13T18:30:29.496 INFO:tasks.workunit.client.0.smithi038.stdout:7/145: rename db/d12/d1a to db/d12/d1c/d3a 0 2024-09-13T18:30:29.499 INFO:tasks.workunit.client.1.smithi149.stdout:6/934: mknod dc/d15/d54/d85/dcc/d108/c12e 0 2024-09-13T18:30:29.501 INFO:tasks.workunit.client.0.smithi038.stdout:4/242: creat d2/df/f4c x:0 0 0 2024-09-13T18:30:29.501 INFO:tasks.workunit.client.0.smithi038.stdout:4/243: fsync d2/df/d22/dc/f1e 0 2024-09-13T18:30:29.502 INFO:tasks.workunit.client.1.smithi149.stdout:7/913: unlink d7/d76/db3/d6f/d9d/cff 0 2024-09-13T18:30:29.504 INFO:tasks.workunit.client.1.smithi149.stdout:0/858: symlink d1/d1b/l12b 0 2024-09-13T18:30:29.504 INFO:tasks.workunit.client.1.smithi149.stdout:0/859: chown d1/d29/d31/d3e/ce1 48780800 1 2024-09-13T18:30:29.504 INFO:tasks.workunit.client.1.smithi149.stdout:4/881: dread df/da0/d112/d3d/f73 [0,4194304] 0 2024-09-13T18:30:29.505 INFO:tasks.workunit.client.0.smithi038.stdout:1/143: write ff [5826245,44158] 0 2024-09-13T18:30:29.505 INFO:tasks.workunit.client.0.smithi038.stdout:1/144: read - d12/f2d zero size 2024-09-13T18:30:29.505 INFO:tasks.workunit.client.0.smithi038.stdout:4/244: mknod d2/df/d1b/c4d 0 2024-09-13T18:30:29.505 INFO:tasks.workunit.client.0.smithi038.stdout:4/245: chown d2/df/l20 934706 1 2024-09-13T18:30:29.508 INFO:tasks.workunit.client.1.smithi149.stdout:6/935: dread dc/d15/d23/d57/f59 [0,4194304] 0 2024-09-13T18:30:29.508 INFO:tasks.workunit.client.1.smithi149.stdout:6/936: write dc/d2f/fbe [467715,11814] 0 2024-09-13T18:30:29.508 INFO:tasks.workunit.client.0.smithi038.stdout:4/246: mknod d2/d49/d4b/c4e 0 2024-09-13T18:30:29.509 INFO:tasks.workunit.client.0.smithi038.stdout:9/165: dwrite d0/d2e/f38 [0,4194304] 0 2024-09-13T18:30:29.510 INFO:tasks.workunit.client.1.smithi149.stdout:0/860: dread d1/d29/d31/fe8 [0,4194304] 0 2024-09-13T18:30:29.510 INFO:tasks.workunit.client.1.smithi149.stdout:0/861: write d1/d2/d4e/fe7 [206121,114943] 0 2024-09-13T18:30:29.510 INFO:tasks.workunit.client.1.smithi149.stdout:0/862: chown d1/d29/dad/f10a 3833948 1 2024-09-13T18:30:29.513 INFO:tasks.workunit.client.1.smithi149.stdout:5/774: dwrite d3/d10/d32/fc1 [4194304,4194304] 0 2024-09-13T18:30:29.513 INFO:tasks.workunit.client.1.smithi149.stdout:5/775: dread - d3/d10/d4c/db8/fda zero size 2024-09-13T18:30:29.516 INFO:tasks.workunit.client.1.smithi149.stdout:9/677: unlink d0/d18/d27/f8b 0 2024-09-13T18:30:29.516 INFO:tasks.workunit.client.1.smithi149.stdout:2/736: rename db/fd to db/d13/d70/dad/ff8 0 2024-09-13T18:30:29.516 INFO:tasks.workunit.client.1.smithi149.stdout:4/882: rename df/da0 to df/da0/d12/d21/d22/d30/d41/d134 22 2024-09-13T18:30:29.516 INFO:tasks.workunit.client.1.smithi149.stdout:2/737: fsync db/d1b/d1c/d20/d2b/f65 0 2024-09-13T18:30:29.516 INFO:tasks.workunit.client.1.smithi149.stdout:4/883: creat df/da0/d1c/f135 x:0 0 0 2024-09-13T18:30:29.516 INFO:tasks.workunit.client.1.smithi149.stdout:4/884: getdents df/da0/d12/d21/d22/d30/d41/d57/d75/da1/de3 0 2024-09-13T18:30:29.516 INFO:tasks.workunit.client.1.smithi149.stdout:3/801: symlink d1/d2c/d38/d88/l117 0 2024-09-13T18:30:29.517 INFO:tasks.workunit.client.1.smithi149.stdout:8/848: truncate d2/d13/d3a/d7f/fb5 478064 0 2024-09-13T18:30:29.517 INFO:tasks.workunit.client.0.smithi038.stdout:9/166: dread d0/d7/f23 [0,4194304] 0 2024-09-13T18:30:29.518 INFO:tasks.workunit.client.0.smithi038.stdout:9/167: stat d0/l1c 0 2024-09-13T18:30:29.518 INFO:tasks.workunit.client.0.smithi038.stdout:9/168: write d0/f2f [129626,4104] 0 2024-09-13T18:30:29.518 INFO:tasks.workunit.client.0.smithi038.stdout:7/146: dwrite db/d12/d1c/d3a/f1f [4194304,4194304] 0 2024-09-13T18:30:29.518 INFO:tasks.workunit.client.0.smithi038.stdout:4/247: dread d2/f2f [0,4194304] 0 2024-09-13T18:30:29.520 INFO:tasks.workunit.client.1.smithi149.stdout:7/914: truncate d7/d9/d1b/f36 1686571 0 2024-09-13T18:30:29.520 INFO:tasks.workunit.client.1.smithi149.stdout:7/915: readlink d7/d76/db3/d6f/l62 0 2024-09-13T18:30:29.522 INFO:tasks.workunit.client.0.smithi038.stdout:7/147: write db/d12/d13/f1b [1208597,108068] 0 2024-09-13T18:30:29.523 INFO:tasks.workunit.client.1.smithi149.stdout:6/937: unlink dc/d2f/f11a 0 2024-09-13T18:30:29.523 INFO:tasks.workunit.client.1.smithi149.stdout:6/938: creat dc/d15/d23/d104/da1/dd1/f12f x:0 0 0 2024-09-13T18:30:29.523 INFO:tasks.workunit.client.0.smithi038.stdout:1/145: rmdir d12 39 2024-09-13T18:30:29.524 INFO:tasks.workunit.client.0.smithi038.stdout:1/146: chown f10 433261875 1 2024-09-13T18:30:29.525 INFO:tasks.workunit.client.0.smithi038.stdout:4/248: rename d2/df/d22/dc/d8/c45 to d2/d49/c4f 0 2024-09-13T18:30:29.527 INFO:tasks.workunit.client.0.smithi038.stdout:7/148: truncate db/d12/f18 160144 0 2024-09-13T18:30:29.530 INFO:tasks.workunit.client.0.smithi038.stdout:1/147: link d12/d15/l2c d12/d2a/l2f 0 2024-09-13T18:30:29.531 INFO:tasks.workunit.client.0.smithi038.stdout:1/148: write f9 [496136,16171] 0 2024-09-13T18:30:29.532 INFO:tasks.workunit.client.1.smithi149.stdout:9/678: rename d0/d9e/c1e to d0/d47/d54/cd6 0 2024-09-13T18:30:29.532 INFO:tasks.workunit.client.1.smithi149.stdout:9/679: truncate d0/d18/d27/d5c/d7e/fb8 854124 0 2024-09-13T18:30:29.533 INFO:tasks.workunit.client.0.smithi038.stdout:4/249: mkdir d2/d49/d50 0 2024-09-13T18:30:29.534 INFO:tasks.workunit.client.1.smithi149.stdout:2/738: symlink db/d1b/d1c/d20/d3a/lf9 0 2024-09-13T18:30:29.534 INFO:tasks.workunit.client.1.smithi149.stdout:2/739: chown db/d1b/f98 0 1 2024-09-13T18:30:29.537 INFO:tasks.workunit.client.1.smithi149.stdout:6/939: write dc/f3f [1775833,91862] 0 2024-09-13T18:30:29.537 INFO:tasks.workunit.client.1.smithi149.stdout:5/776: dwrite d3/d10/d4c/f71 [0,4194304] 0 2024-09-13T18:30:29.539 INFO:tasks.workunit.client.1.smithi149.stdout:8/849: truncate d2/d5b/d86/fa7 3553598 0 2024-09-13T18:30:29.540 INFO:tasks.workunit.client.0.smithi038.stdout:9/169: dread d0/f11 [0,4194304] 0 2024-09-13T18:30:29.541 INFO:tasks.workunit.client.0.smithi038.stdout:9/170: fsync d0/d7/d13/f1e 0 2024-09-13T18:30:29.541 INFO:tasks.workunit.client.0.smithi038.stdout:9/171: fsync d0/f1 0 2024-09-13T18:30:29.542 INFO:tasks.workunit.client.1.smithi149.stdout:9/680: dread d0/d2e/f58 [0,4194304] 0 2024-09-13T18:30:29.544 INFO:tasks.workunit.client.0.smithi038.stdout:1/149: unlink d12/c1d 0 2024-09-13T18:30:29.544 INFO:tasks.workunit.client.1.smithi149.stdout:1/823: sync 2024-09-13T18:30:29.545 INFO:tasks.workunit.client.1.smithi149.stdout:1/824: fdatasync d9/d10/d3f/f67 0 2024-09-13T18:30:29.547 INFO:tasks.workunit.client.0.smithi038.stdout:9/172: creat d0/d7/d13/d2d/f39 x:0 0 0 2024-09-13T18:30:29.547 INFO:tasks.workunit.client.0.smithi038.stdout:9/173: truncate d0/f6 831162 0 2024-09-13T18:30:29.549 INFO:tasks.workunit.client.1.smithi149.stdout:9/681: dread d0/d9e/d3b/f53 [0,4194304] 0 2024-09-13T18:30:29.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/863: link d1/d2/c30 d1/d2/d41/d46/d7b/d98/c12c 0 2024-09-13T18:30:29.554 INFO:tasks.workunit.client.1.smithi149.stdout:6/940: read dc/d15/f44 [3680357,103161] 0 2024-09-13T18:30:29.555 INFO:tasks.workunit.client.1.smithi149.stdout:7/916: rename d7/d9/d11/de2/l120 to d7/d9/d1c/d1f/d21/d49/d102/d10f/d10b/l141 0 2024-09-13T18:30:29.556 INFO:tasks.workunit.client.0.smithi038.stdout:4/250: read d2/df/d22/dc/d8/f27 [3139073,41461] 0 2024-09-13T18:30:29.560 INFO:tasks.workunit.client.1.smithi149.stdout:2/740: mknod db/d10/cfa 0 2024-09-13T18:30:29.560 INFO:tasks.workunit.client.1.smithi149.stdout:2/741: fsync db/d1b/dab/fce 0 2024-09-13T18:30:29.560 INFO:tasks.workunit.client.1.smithi149.stdout:2/742: chown db/d1b/d6c/f73 8 1 2024-09-13T18:30:29.560 INFO:tasks.workunit.client.1.smithi149.stdout:2/743: readlink db/d1b/l58 0 2024-09-13T18:30:29.563 INFO:tasks.workunit.client.0.smithi038.stdout:4/251: creat d2/df/d1b/f51 x:0 0 0 2024-09-13T18:30:29.564 INFO:tasks.workunit.client.0.smithi038.stdout:1/150: dread d12/d15/f1e [0,4194304] 0 2024-09-13T18:30:29.565 INFO:tasks.workunit.client.0.smithi038.stdout:4/252: stat d2/df/d1b/d10/l47 0 2024-09-13T18:30:29.570 INFO:tasks.workunit.client.1.smithi149.stdout:8/850: read d2/d13/d3a/f4f [330348,110809] 0 2024-09-13T18:30:29.571 INFO:tasks.workunit.client.0.smithi038.stdout:4/253: creat d2/d49/d4b/f52 x:0 0 0 2024-09-13T18:30:29.571 INFO:tasks.workunit.client.0.smithi038.stdout:4/254: chown d2/d49/d50 276246440 1 2024-09-13T18:30:29.571 INFO:tasks.workunit.client.0.smithi038.stdout:4/255: fsync d2/df/d1b/d10/f46 0 2024-09-13T18:30:29.575 INFO:tasks.workunit.client.1.smithi149.stdout:4/885: mkdir df/da0/d136 0 2024-09-13T18:30:29.575 INFO:tasks.workunit.client.1.smithi149.stdout:4/886: chown df/da0/d12/d21/d22/d30/d41/d57 5062440 1 2024-09-13T18:30:29.577 INFO:tasks.workunit.client.0.smithi038.stdout:4/256: creat d2/df/d22/dc/d8/d3b/f53 x:0 0 0 2024-09-13T18:30:29.577 INFO:tasks.workunit.client.0.smithi038.stdout:4/257: chown d2/df/d22/dc/d8/f2e 186959936 1 2024-09-13T18:30:29.577 INFO:tasks.workunit.client.0.smithi038.stdout:4/258: readlink d2/df/d1b/d10/l34 0 2024-09-13T18:30:29.577 INFO:tasks.workunit.client.0.smithi038.stdout:4/259: chown d2/d49/d4b/c4e 2 1 2024-09-13T18:30:29.580 INFO:tasks.workunit.client.1.smithi149.stdout:9/682: link d0/d2e/d42/f6d d0/d18/d93/fd7 0 2024-09-13T18:30:29.580 INFO:tasks.workunit.client.1.smithi149.stdout:9/683: read - d0/d18/d27/d5c/d7e/fcc zero size 2024-09-13T18:30:29.580 INFO:tasks.workunit.client.1.smithi149.stdout:9/684: stat d0/d2e/d42/d59/f7c 0 2024-09-13T18:30:29.580 INFO:tasks.workunit.client.0.smithi038.stdout:7/149: dwrite db/fe [0,4194304] 0 2024-09-13T18:30:29.581 INFO:tasks.workunit.client.0.smithi038.stdout:1/151: rename d12/d15/f24 to d12/f30 0 2024-09-13T18:30:29.582 INFO:tasks.workunit.client.1.smithi149.stdout:1/825: rename d9/d10/d34/dbe/d38/ff1 to d9/d10/d3f/f103 0 2024-09-13T18:30:29.584 INFO:tasks.workunit.client.0.smithi038.stdout:4/260: symlink d2/df/l54 0 2024-09-13T18:30:29.584 INFO:tasks.workunit.client.0.smithi038.stdout:4/261: write d2/df/d22/f40 [1154817,34887] 0 2024-09-13T18:30:29.585 INFO:tasks.workunit.client.1.smithi149.stdout:5/777: dwrite d3/d8/d6d/ff2 [0,4194304] 0 2024-09-13T18:30:29.585 INFO:tasks.workunit.client.1.smithi149.stdout:1/826: symlink d9/d15/d40/l104 0 2024-09-13T18:30:29.588 INFO:tasks.workunit.client.0.smithi038.stdout:4/262: mkdir d2/df/d1b/d10/d55 0 2024-09-13T18:30:29.589 INFO:tasks.workunit.client.0.smithi038.stdout:4/263: chown d2/df/d1b/d10/l31 11340989 1 2024-09-13T18:30:29.589 INFO:tasks.workunit.client.1.smithi149.stdout:7/917: symlink d7/d9/d1c/d51/daf/l142 0 2024-09-13T18:30:29.590 INFO:tasks.workunit.client.0.smithi038.stdout:4/264: truncate d2/df/d1b/d10/f25 1156157 0 2024-09-13T18:30:29.591 INFO:tasks.workunit.client.0.smithi038.stdout:7/150: dread db/d12/d1c/d3a/f1f [4194304,4194304] 0 2024-09-13T18:30:29.593 INFO:tasks.workunit.client.0.smithi038.stdout:4/265: creat d2/f56 x:0 0 0 2024-09-13T18:30:29.594 INFO:tasks.workunit.client.0.smithi038.stdout:9/174: dwrite d0/f2f [0,4194304] 0 2024-09-13T18:30:29.594 INFO:tasks.workunit.client.0.smithi038.stdout:9/175: fsync d0/d7/d13/f1e 0 2024-09-13T18:30:29.595 INFO:tasks.workunit.client.0.smithi038.stdout:9/176: fsync d0/d7/d13/f1e 0 2024-09-13T18:30:29.595 INFO:tasks.workunit.client.0.smithi038.stdout:9/177: getdents d0/d7/d13/d30 0 2024-09-13T18:30:29.595 INFO:tasks.workunit.client.1.smithi149.stdout:1/827: mknod d9/d15/d60/d80/c105 0 2024-09-13T18:30:29.595 INFO:tasks.workunit.client.0.smithi038.stdout:7/151: symlink db/d21/d33/l3b 0 2024-09-13T18:30:29.598 INFO:tasks.workunit.client.1.smithi149.stdout:6/941: dwrite dc/d2f/f6c [0,4194304] 0 2024-09-13T18:30:29.598 INFO:tasks.workunit.client.1.smithi149.stdout:6/942: chown dc/d15/d23/d57/d5c/c9d 1 1 2024-09-13T18:30:29.598 INFO:tasks.workunit.client.1.smithi149.stdout:6/943: creat dc/d15/d23/d104/da1/dcb/d118/f130 x:0 0 0 2024-09-13T18:30:29.600 INFO:tasks.workunit.client.1.smithi149.stdout:1/828: mkdir d9/d15/d73/d106 0 2024-09-13T18:30:29.600 INFO:tasks.workunit.client.1.smithi149.stdout:1/829: write d9/d10/d34/d53/d57/fa1 [909161,5149] 0 2024-09-13T18:30:29.605 INFO:tasks.workunit.client.1.smithi149.stdout:6/944: unlink dc/d15/d54/d85/dcc/ldf 0 2024-09-13T18:30:29.607 INFO:tasks.workunit.client.0.smithi038.stdout:7/152: mkdir db/d12/d1c/d3a/d3c 0 2024-09-13T18:30:29.610 INFO:tasks.workunit.client.1.smithi149.stdout:6/945: unlink dc/d15/d23/d57/d5c/lfd 0 2024-09-13T18:30:29.611 INFO:tasks.workunit.client.0.smithi038.stdout:7/153: mknod db/d21/c3d 0 2024-09-13T18:30:29.611 INFO:tasks.workunit.client.0.smithi038.stdout:7/154: truncate db/d12/d1c/d3a/d22/f38 8888511 0 2024-09-13T18:30:29.612 INFO:tasks.workunit.client.0.smithi038.stdout:7/155: rename db/d21 to db/d21/d3e 22 2024-09-13T18:30:29.613 INFO:tasks.workunit.client.1.smithi149.stdout:6/946: mkdir dc/d15/d11d/d131 0 2024-09-13T18:30:29.613 INFO:tasks.workunit.client.0.smithi038.stdout:7/156: stat db/d12/d1c/d3a/d26/l2d 0 2024-09-13T18:30:29.614 INFO:tasks.workunit.client.0.smithi038.stdout:9/178: write d0/f11 [3459447,50764] 0 2024-09-13T18:30:29.614 INFO:tasks.workunit.client.0.smithi038.stdout:9/179: chown d0 3 1 2024-09-13T18:30:29.614 INFO:tasks.workunit.client.1.smithi149.stdout:2/744: dwrite db/d13/f79 [0,4194304] 0 2024-09-13T18:30:29.614 INFO:tasks.workunit.client.1.smithi149.stdout:2/745: readlink db/d1b/d6c/lf2 0 2024-09-13T18:30:29.615 INFO:tasks.workunit.client.0.smithi038.stdout:7/157: truncate db/d12/f34 142331 0 2024-09-13T18:30:29.616 INFO:tasks.workunit.client.0.smithi038.stdout:4/266: dread d2/df/d1b/d10/f3d [4194304,4194304] 0 2024-09-13T18:30:29.618 INFO:tasks.workunit.client.0.smithi038.stdout:7/158: rename f5 to db/d12/f3f 0 2024-09-13T18:30:29.620 INFO:tasks.workunit.client.0.smithi038.stdout:4/267: symlink d2/df/d1b/d10/d55/l57 0 2024-09-13T18:30:29.620 INFO:tasks.workunit.client.0.smithi038.stdout:4/268: chown d2/df/d1b/d10/l3f 2825 1 2024-09-13T18:30:29.620 INFO:tasks.workunit.client.0.smithi038.stdout:4/269: write d2/df/d1b/d10/f46 [330424,116235] 0 2024-09-13T18:30:29.621 INFO:tasks.workunit.client.1.smithi149.stdout:2/746: unlink db/d10/da9/ff4 0 2024-09-13T18:30:29.622 INFO:tasks.workunit.client.0.smithi038.stdout:7/159: creat db/d12/d1c/d3a/d3c/f40 x:0 0 0 2024-09-13T18:30:29.622 INFO:tasks.workunit.client.0.smithi038.stdout:7/160: read db/d12/d1c/d3a/f1f [315605,81997] 0 2024-09-13T18:30:29.622 INFO:tasks.workunit.client.1.smithi149.stdout:2/747: mknod db/d1b/cfb 0 2024-09-13T18:30:29.623 INFO:tasks.workunit.client.0.smithi038.stdout:9/180: dread d0/d2e/f38 [0,4194304] 0 2024-09-13T18:30:29.624 INFO:tasks.workunit.client.1.smithi149.stdout:2/748: truncate db/d1b/d1c/d20/d2b/db7/f6d 4102624 0 2024-09-13T18:30:29.625 INFO:tasks.workunit.client.1.smithi149.stdout:2/749: mknod db/d13/ddc/cfc 0 2024-09-13T18:30:29.637 INFO:tasks.workunit.client.1.smithi149.stdout:0/864: dwrite d1/f21 [0,4194304] 0 2024-09-13T18:30:29.637 INFO:tasks.workunit.client.1.smithi149.stdout:0/865: write d1/d29/d31/d3e/f129 [853863,71855] 0 2024-09-13T18:30:29.640 INFO:tasks.workunit.client.1.smithi149.stdout:4/887: dwrite df/da0/d112/fe0 [4194304,4194304] 0 2024-09-13T18:30:29.641 INFO:tasks.workunit.client.1.smithi149.stdout:1/830: dread d9/d10/d83/d97/f9a [0,4194304] 0 2024-09-13T18:30:29.641 INFO:tasks.workunit.client.1.smithi149.stdout:6/947: dread dc/d15/d54/d85/f89 [0,4194304] 0 2024-09-13T18:30:29.648 INFO:tasks.workunit.client.1.smithi149.stdout:4/888: unlink df/da0/d12/d21/f4a 0 2024-09-13T18:30:29.648 INFO:tasks.workunit.client.0.smithi038.stdout:4/270: fsync d2/f19 0 2024-09-13T18:30:29.650 INFO:tasks.workunit.client.1.smithi149.stdout:4/889: rename df/da0/d1c/f135 to df/da0/d70/db5/f137 0 2024-09-13T18:30:29.652 INFO:tasks.workunit.client.1.smithi149.stdout:4/890: link df/da0/d112/d3d/ff1 df/da0/d12/d21/d22/d30/d41/d57/d75/da1/f138 0 2024-09-13T18:30:29.652 INFO:tasks.workunit.client.1.smithi149.stdout:4/891: fdatasync df/da0/d1c/d69/f12c 0 2024-09-13T18:30:29.653 INFO:tasks.workunit.client.1.smithi149.stdout:0/866: write d1/d2/fd [1489831,58517] 0 2024-09-13T18:30:29.657 INFO:tasks.workunit.client.1.smithi149.stdout:0/867: rename d1/d2/f9e to d1/d29/d31/d3e/f12d 0 2024-09-13T18:30:29.659 INFO:tasks.workunit.client.1.smithi149.stdout:8/851: dwrite d2/f96 [0,4194304] 0 2024-09-13T18:30:29.660 INFO:tasks.workunit.client.1.smithi149.stdout:0/868: mkdir d1/d29/d31/d44/d81/d62/d12e 0 2024-09-13T18:30:29.661 INFO:tasks.workunit.client.1.smithi149.stdout:8/852: symlink d2/d12/dd8/d117/dca/l11b 0 2024-09-13T18:30:29.663 INFO:tasks.workunit.client.0.smithi038.stdout:1/152: dwrite d12/f2b [4194304,4194304] 0 2024-09-13T18:30:29.663 INFO:tasks.workunit.client.1.smithi149.stdout:0/869: mknod d1/d2/d41/d46/d7b/c12f 0 2024-09-13T18:30:29.663 INFO:tasks.workunit.client.1.smithi149.stdout:0/870: write d1/fdd [6300,91311] 0 2024-09-13T18:30:29.664 INFO:tasks.workunit.client.1.smithi149.stdout:9/685: dwrite d0/d9e/f80 [0,4194304] 0 2024-09-13T18:30:29.664 INFO:tasks.workunit.client.1.smithi149.stdout:9/686: chown d0/d18/d68/cd4 53 1 2024-09-13T18:30:29.667 INFO:tasks.workunit.client.1.smithi149.stdout:0/871: symlink d1/d29/d31/d44/d81/d62/l130 0 2024-09-13T18:30:29.668 INFO:tasks.workunit.client.0.smithi038.stdout:1/153: getdents d12/d15 0 2024-09-13T18:30:29.669 INFO:tasks.workunit.client.1.smithi149.stdout:2/750: dwrite db/d1b/fd3 [0,4194304] 0 2024-09-13T18:30:29.673 INFO:tasks.workunit.client.0.smithi038.stdout:4/271: dread d2/f19 [0,4194304] 0 2024-09-13T18:30:29.674 INFO:tasks.workunit.client.1.smithi149.stdout:9/687: dread d0/d47/f65 [0,4194304] 0 2024-09-13T18:30:29.676 INFO:tasks.workunit.client.1.smithi149.stdout:0/872: mknod d1/d29/d31/d83/c131 0 2024-09-13T18:30:29.679 INFO:tasks.workunit.client.0.smithi038.stdout:9/181: dwrite d0/d7/d13/f1e [0,4194304] 0 2024-09-13T18:30:29.679 INFO:tasks.workunit.client.1.smithi149.stdout:2/751: mknod db/d1b/d1c/d20/d3a/d75/cfd 0 2024-09-13T18:30:29.679 INFO:tasks.workunit.client.1.smithi149.stdout:2/752: chown db/d1b/d1c/d85/fde 853378491 1 2024-09-13T18:30:29.680 INFO:tasks.workunit.client.0.smithi038.stdout:4/272: getdents d2 0 2024-09-13T18:30:29.680 INFO:tasks.workunit.client.0.smithi038.stdout:4/273: truncate d2/df/d1b/f51 493774 0 2024-09-13T18:30:29.683 INFO:tasks.workunit.client.1.smithi149.stdout:2/753: creat db/d13/d70/ffe x:0 0 0 2024-09-13T18:30:29.686 INFO:tasks.workunit.client.1.smithi149.stdout:8/853: dread d2/d12/d2a/d4d/f6b [0,4194304] 0 2024-09-13T18:30:29.687 INFO:tasks.workunit.client.0.smithi038.stdout:4/274: creat d2/f58 x:0 0 0 2024-09-13T18:30:29.687 INFO:tasks.workunit.client.0.smithi038.stdout:4/275: readlink d2/df/l20 0 2024-09-13T18:30:29.687 INFO:tasks.workunit.client.0.smithi038.stdout:3/131: sync 2024-09-13T18:30:29.688 INFO:tasks.workunit.client.0.smithi038.stdout:3/132: write d0/dd/d19/d23/f2c [380896,16457] 0 2024-09-13T18:30:29.688 INFO:tasks.workunit.client.1.smithi149.stdout:2/754: mkdir db/d1b/d1c/d20/dff 0 2024-09-13T18:30:29.689 INFO:tasks.workunit.client.0.smithi038.stdout:3/133: write d0/dd/f1a [91820,130784] 0 2024-09-13T18:30:29.691 INFO:tasks.workunit.client.0.smithi038.stdout:7/161: dwrite db/d12/d13/f1b [0,4194304] 0 2024-09-13T18:30:29.691 INFO:tasks.workunit.client.0.smithi038.stdout:9/182: read d0/d7/f23 [1140763,1650] 0 2024-09-13T18:30:29.693 INFO:tasks.workunit.client.0.smithi038.stdout:4/276: rename d2/d49/d4b/f52 to d2/df/d22/dc/d8/f59 0 2024-09-13T18:30:29.699 INFO:tasks.workunit.client.0.smithi038.stdout:4/277: dread d2/f19 [0,4194304] 0 2024-09-13T18:30:29.699 INFO:tasks.workunit.client.0.smithi038.stdout:4/278: creat d2/d49/d4b/f5a x:0 0 0 2024-09-13T18:30:29.699 INFO:tasks.workunit.client.0.smithi038.stdout:4/279: truncate d2/df/d22/dc/d8/f59 1047773 0 2024-09-13T18:30:29.700 INFO:tasks.workunit.client.0.smithi038.stdout:4/280: chown d2/df/d22/dc/f1a 1 1 2024-09-13T18:30:29.700 INFO:tasks.workunit.client.0.smithi038.stdout:4/281: truncate d2/df/d22/dc/d8/f59 1836206 0 2024-09-13T18:30:29.703 INFO:tasks.workunit.client.1.smithi149.stdout:6/948: dwrite dc/d15/daa/de5/de6/f12a [0,4194304] 0 2024-09-13T18:30:29.703 INFO:tasks.workunit.client.1.smithi149.stdout:1/831: dwrite d9/d10/d34/dbe/d38/fe2 [0,4194304] 0 2024-09-13T18:30:29.703 INFO:tasks.workunit.client.1.smithi149.stdout:1/832: chown d9/d10/d34/d3c/d50 43 1 2024-09-13T18:30:29.703 INFO:tasks.workunit.client.0.smithi038.stdout:7/162: mkdir db/d12/d1c/d3a/d26/d41 0 2024-09-13T18:30:29.704 INFO:tasks.workunit.client.0.smithi038.stdout:4/282: dread d2/df/d22/f40 [0,4194304] 0 2024-09-13T18:30:29.704 INFO:tasks.workunit.client.0.smithi038.stdout:4/283: truncate d2/df/f4c 470646 0 2024-09-13T18:30:29.705 INFO:tasks.workunit.client.0.smithi038.stdout:9/183: mknod d0/d7/d13/c3a 0 2024-09-13T18:30:29.705 INFO:tasks.workunit.client.0.smithi038.stdout:9/184: truncate d0/d2e/f29 485802 0 2024-09-13T18:30:29.708 INFO:tasks.workunit.client.0.smithi038.stdout:1/154: dwrite d12/f1a [0,4194304] 0 2024-09-13T18:30:29.709 INFO:tasks.workunit.client.0.smithi038.stdout:7/163: link db/d21/c35 db/d12/d1c/d3a/c42 0 2024-09-13T18:30:29.709 INFO:tasks.workunit.client.0.smithi038.stdout:7/164: chown db/d12/d1c/d3a/d26/c29 0 1 2024-09-13T18:30:29.710 INFO:tasks.workunit.client.0.smithi038.stdout:4/284: creat d2/d49/f5b x:0 0 0 2024-09-13T18:30:29.711 INFO:tasks.workunit.client.1.smithi149.stdout:9/688: dwrite d0/d47/d54/d75/fcd [0,4194304] 0 2024-09-13T18:30:29.712 INFO:tasks.workunit.client.0.smithi038.stdout:4/285: write d2/df/d22/dc/d8/f59 [404997,103105] 0 2024-09-13T18:30:29.712 INFO:tasks.workunit.client.0.smithi038.stdout:4/286: dread - d2/f56 zero size 2024-09-13T18:30:29.713 INFO:tasks.workunit.client.0.smithi038.stdout:9/185: rename d0/d7/d13/f17 to d0/d7/d13/d30/f3b 0 2024-09-13T18:30:29.716 INFO:tasks.workunit.client.1.smithi149.stdout:5/778: dwrite d3/d10/d32/f3c [0,4194304] 0 2024-09-13T18:30:29.716 INFO:tasks.workunit.client.1.smithi149.stdout:0/873: dwrite d1/d48/f101 [0,4194304] 0 2024-09-13T18:30:29.718 INFO:tasks.workunit.client.1.smithi149.stdout:4/892: rmdir df/da0/d12/d21/d22/d30/d41/d57 39 2024-09-13T18:30:29.718 INFO:tasks.workunit.client.1.smithi149.stdout:2/755: dwrite db/d1b/d1c/d20/d3a/d75/fdf [4194304,4194304] 0 2024-09-13T18:30:29.721 INFO:tasks.workunit.client.0.smithi038.stdout:3/134: dread d0/dd/d19/d23/f2c [0,4194304] 0 2024-09-13T18:30:29.722 INFO:tasks.workunit.client.1.smithi149.stdout:1/833: creat d9/d10/d43/f107 x:0 0 0 2024-09-13T18:30:29.724 INFO:tasks.workunit.client.1.smithi149.stdout:6/949: mknod dc/d15/c132 0 2024-09-13T18:30:29.728 INFO:tasks.workunit.client.1.smithi149.stdout:9/689: symlink d0/d47/d54/d75/ld8 0 2024-09-13T18:30:29.728 INFO:tasks.workunit.client.1.smithi149.stdout:3/802: sync 2024-09-13T18:30:29.732 INFO:tasks.workunit.client.0.smithi038.stdout:4/287: mknod d2/df/d1b/c5c 0 2024-09-13T18:30:29.733 INFO:tasks.workunit.client.1.smithi149.stdout:5/779: mkdir d3/d10/df7 0 2024-09-13T18:30:29.733 INFO:tasks.workunit.client.0.smithi038.stdout:4/288: dread d2/df/d1b/f51 [0,4194304] 0 2024-09-13T18:30:29.734 INFO:tasks.workunit.client.0.smithi038.stdout:9/186: mkdir d0/d7/d13/d2d/d3c 0 2024-09-13T18:30:29.736 INFO:tasks.workunit.client.0.smithi038.stdout:3/135: unlink d0/dd/d17/f18 0 2024-09-13T18:30:29.736 INFO:tasks.workunit.client.0.smithi038.stdout:3/136: stat d0/dd/d19/d23/f2e 0 2024-09-13T18:30:29.738 INFO:tasks.workunit.client.0.smithi038.stdout:4/289: rename d2/d49/d4b/f5a to d2/df/d22/dc/d8/d3b/f5d 0 2024-09-13T18:30:29.739 INFO:tasks.workunit.client.0.smithi038.stdout:7/165: dwrite db/d12/f18 [0,4194304] 0 2024-09-13T18:30:29.739 INFO:tasks.workunit.client.0.smithi038.stdout:1/155: dwrite d12/f1c [4194304,4194304] 0 2024-09-13T18:30:29.740 INFO:tasks.workunit.client.1.smithi149.stdout:0/874: mkdir d1/d2/d8a/da9/dd7/d132 0 2024-09-13T18:30:29.742 INFO:tasks.workunit.client.0.smithi038.stdout:9/187: link d0/d7/d13/c3a d0/d7/d13/d30/c3d 0 2024-09-13T18:30:29.744 INFO:tasks.workunit.client.1.smithi149.stdout:4/893: getdents df/da0 0 2024-09-13T18:30:29.744 INFO:tasks.workunit.client.1.smithi149.stdout:4/894: read - df/da0/d112/d3d/ff1 zero size 2024-09-13T18:30:29.745 INFO:tasks.workunit.client.0.smithi038.stdout:6/143: sync 2024-09-13T18:30:29.745 INFO:tasks.workunit.client.0.smithi038.stdout:0/123: sync 2024-09-13T18:30:29.746 INFO:tasks.workunit.client.0.smithi038.stdout:3/137: mknod d0/dd/d19/d1d/d29/d2b/c2f 0 2024-09-13T18:30:29.748 INFO:tasks.workunit.client.1.smithi149.stdout:2/756: mkdir db/d100 0 2024-09-13T18:30:29.749 INFO:tasks.workunit.client.0.smithi038.stdout:6/144: dread dd/de/d2e/d30/f22 [0,4194304] 0 2024-09-13T18:30:29.749 INFO:tasks.workunit.client.0.smithi038.stdout:6/145: chown dd/de/d2e/d30/f29 32384250 1 2024-09-13T18:30:29.751 INFO:tasks.workunit.client.1.smithi149.stdout:1/834: creat d9/d10/d43/dcb/f108 x:0 0 0 2024-09-13T18:30:29.751 INFO:tasks.workunit.client.1.smithi149.stdout:1/835: truncate d9/d10/d34/d53/f82 883213 0 2024-09-13T18:30:29.752 INFO:tasks.workunit.client.0.smithi038.stdout:9/188: mkdir d0/d7/d13/d2d/d3e 0 2024-09-13T18:30:29.755 INFO:tasks.workunit.client.1.smithi149.stdout:6/950: creat dc/d15/d23/d5b/d10a/f133 x:0 0 0 2024-09-13T18:30:29.756 INFO:tasks.workunit.client.1.smithi149.stdout:5/780: dwrite d3/d10/d32/d54/d97/fee [4194304,4194304] 0 2024-09-13T18:30:29.756 INFO:tasks.workunit.client.1.smithi149.stdout:5/781: fsync d3/d10/d32/f2e 0 2024-09-13T18:30:29.756 INFO:tasks.workunit.client.1.smithi149.stdout:5/782: readlink d3/d10/d32/l77 0 2024-09-13T18:30:29.756 INFO:tasks.workunit.client.0.smithi038.stdout:7/166: dwrite db/d12/f3f [4194304,4194304] 0 2024-09-13T18:30:29.756 INFO:tasks.workunit.client.0.smithi038.stdout:7/167: fdatasync db/d12/f3f 0 2024-09-13T18:30:29.760 INFO:tasks.workunit.client.1.smithi149.stdout:9/690: unlink d0/f29 0 2024-09-13T18:30:29.762 INFO:tasks.workunit.client.0.smithi038.stdout:3/138: unlink d0/dd/d19/d23/f26 0 2024-09-13T18:30:29.762 INFO:tasks.workunit.client.0.smithi038.stdout:3/139: write d0/dd/d19/d23/f2e [5777828,118925] 0 2024-09-13T18:30:29.763 INFO:tasks.workunit.client.1.smithi149.stdout:3/803: creat d1/d2e/d6f/f118 x:0 0 0 2024-09-13T18:30:29.765 INFO:tasks.workunit.client.0.smithi038.stdout:6/146: truncate dd/f14 1143792 0 2024-09-13T18:30:29.765 INFO:tasks.workunit.client.0.smithi038.stdout:6/147: write dd/de/d2e/d30/d27/f33 [571897,21295] 0 2024-09-13T18:30:29.767 INFO:tasks.workunit.client.1.smithi149.stdout:4/895: dread df/f90 [0,4194304] 0 2024-09-13T18:30:29.768 INFO:tasks.workunit.client.0.smithi038.stdout:9/189: creat d0/d7/d13/d2d/d3c/f3f x:0 0 0 2024-09-13T18:30:29.770 INFO:tasks.workunit.client.1.smithi149.stdout:1/836: unlink d9/d10/d34/dbe/f5a 0 2024-09-13T18:30:29.770 INFO:tasks.workunit.client.1.smithi149.stdout:1/837: chown d9/d15/c26 0 1 2024-09-13T18:30:29.770 INFO:tasks.workunit.client.1.smithi149.stdout:1/838: stat d9/d10/d3f/d76 0 2024-09-13T18:30:29.772 INFO:tasks.workunit.client.0.smithi038.stdout:7/168: unlink db/d12/d13/f17 0 2024-09-13T18:30:29.772 INFO:tasks.workunit.client.0.smithi038.stdout:7/169: write db/d12/d1c/f20 [170061,38727] 0 2024-09-13T18:30:29.772 INFO:tasks.workunit.client.0.smithi038.stdout:7/170: chown db/d12/f34 1 1 2024-09-13T18:30:29.773 INFO:tasks.workunit.client.1.smithi149.stdout:6/951: truncate f8 3085118 0 2024-09-13T18:30:29.774 INFO:tasks.workunit.client.0.smithi038.stdout:3/140: rmdir d0/dd/d19/d1d/d29/d2b 39 2024-09-13T18:30:29.775 INFO:tasks.workunit.client.0.smithi038.stdout:2/164: sync 2024-09-13T18:30:29.775 INFO:tasks.workunit.client.0.smithi038.stdout:5/110: sync 2024-09-13T18:30:29.775 INFO:tasks.workunit.client.0.smithi038.stdout:8/256: sync 2024-09-13T18:30:29.776 INFO:tasks.workunit.client.0.smithi038.stdout:5/111: readlink df/d15/l17 0 2024-09-13T18:30:29.776 INFO:tasks.workunit.client.0.smithi038.stdout:8/257: write d1/d4/f13 [1108313,126367] 0 2024-09-13T18:30:29.776 INFO:tasks.workunit.client.0.smithi038.stdout:8/258: write d1/d4/f13 [1935718,9018] 0 2024-09-13T18:30:29.776 INFO:tasks.workunit.client.0.smithi038.stdout:8/259: fsync d1/de/d3a/f53 0 2024-09-13T18:30:29.776 INFO:tasks.workunit.client.0.smithi038.stdout:8/260: truncate d1/d2a/f2e 1015975 0 2024-09-13T18:30:29.778 INFO:tasks.workunit.client.0.smithi038.stdout:9/190: rename d0/l1f to d0/d7/d13/d30/l40 0 2024-09-13T18:30:29.781 INFO:tasks.workunit.client.1.smithi149.stdout:5/783: rename d3/d10/d4c/d4e/de8 to d3/d10/d32/d54/d97/dba/df8 0 2024-09-13T18:30:29.781 INFO:tasks.workunit.client.1.smithi149.stdout:5/784: readlink d3/d10/d32/d54/d97/de7/lf4 0 2024-09-13T18:30:29.781 INFO:tasks.workunit.client.0.smithi038.stdout:1/156: dwrite d12/f23 [0,4194304] 0 2024-09-13T18:30:29.782 INFO:tasks.workunit.client.0.smithi038.stdout:7/171: mkdir db/d12/d13/d43 0 2024-09-13T18:30:29.783 INFO:tasks.workunit.client.1.smithi149.stdout:9/691: creat d0/d47/d61/fd9 x:0 0 0 2024-09-13T18:30:29.785 INFO:tasks.workunit.client.0.smithi038.stdout:3/141: mkdir d0/dd/d19/d1d/d30 0 2024-09-13T18:30:29.785 INFO:tasks.workunit.client.0.smithi038.stdout:3/142: chown d0/l11 229 1 2024-09-13T18:30:29.787 INFO:tasks.workunit.client.1.smithi149.stdout:3/804: creat d1/d2c/d38/d8d/de1/f119 x:0 0 0 2024-09-13T18:30:29.787 INFO:tasks.workunit.client.0.smithi038.stdout:8/261: mkdir d1/d2a/d5b 0 2024-09-13T18:30:29.788 INFO:tasks.workunit.client.0.smithi038.stdout:4/290: dwrite d2/df/d22/dc/d8/d3b/f5d [0,4194304] 0 2024-09-13T18:30:29.789 INFO:tasks.workunit.client.1.smithi149.stdout:7/918: sync 2024-09-13T18:30:29.789 INFO:tasks.workunit.client.1.smithi149.stdout:7/919: getdents d7/d9/d1c/d1f/d21 0 2024-09-13T18:30:29.789 INFO:tasks.workunit.client.1.smithi149.stdout:2/757: rmdir db/d1b/d1c/d20/d2b/d3e/d95 39 2024-09-13T18:30:29.789 INFO:tasks.workunit.client.1.smithi149.stdout:2/758: creat db/d13/d70/d89/f101 x:0 0 0 2024-09-13T18:30:29.789 INFO:tasks.workunit.client.1.smithi149.stdout:2/759: fsync db/d13/fcf 0 2024-09-13T18:30:29.789 INFO:tasks.workunit.client.1.smithi149.stdout:0/875: dwrite d1/d2/d8a/d90/f124 [0,4194304] 0 2024-09-13T18:30:29.789 INFO:tasks.workunit.client.1.smithi149.stdout:0/876: fsync d1/d29/d31/d83/d87/fc1 0 2024-09-13T18:30:29.790 INFO:tasks.workunit.client.0.smithi038.stdout:1/157: dread f8 [0,4194304] 0 2024-09-13T18:30:29.791 INFO:tasks.workunit.client.0.smithi038.stdout:5/112: dread f1 [4194304,4194304] 0 2024-09-13T18:30:29.791 INFO:tasks.workunit.client.0.smithi038.stdout:5/113: chown df/d13/c1c 12 1 2024-09-13T18:30:29.792 INFO:tasks.workunit.client.1.smithi149.stdout:1/839: symlink d9/d10/d34/d53/d57/l109 0 2024-09-13T18:30:29.793 INFO:tasks.workunit.client.0.smithi038.stdout:7/172: read db/d12/d1c/d3a/d22/f38 [2153270,106815] 0 2024-09-13T18:30:29.794 INFO:tasks.workunit.client.1.smithi149.stdout:5/785: write d3/d10/d4c/d4e/da4/fa6 [46443,58144] 0 2024-09-13T18:30:29.794 INFO:tasks.workunit.client.0.smithi038.stdout:5/114: rename df/d15 to df/d15/d25 22 2024-09-13T18:30:29.794 INFO:tasks.workunit.client.0.smithi038.stdout:2/165: rename d2/d2a/d2b/d39/f3b to d2/f41 0 2024-09-13T18:30:29.796 INFO:tasks.workunit.client.1.smithi149.stdout:4/896: rename df/da0/d112/d3d/c120 to df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3/dc8/c139 0 2024-09-13T18:30:29.796 INFO:tasks.workunit.client.1.smithi149.stdout:4/897: creat df/da0/d1c/d7e/d9f/f13a x:0 0 0 2024-09-13T18:30:29.797 INFO:tasks.workunit.client.0.smithi038.stdout:3/143: dread d0/dd/f1a [0,4194304] 0 2024-09-13T18:30:29.797 INFO:tasks.workunit.client.0.smithi038.stdout:0/124: dwrite d2/dc/f14 [0,4194304] 0 2024-09-13T18:30:29.799 INFO:tasks.workunit.client.1.smithi149.stdout:9/692: getdents d0/d18/d68/db2 0 2024-09-13T18:30:29.804 INFO:tasks.workunit.client.0.smithi038.stdout:7/173: write db/d12/f3f [2141675,61625] 0 2024-09-13T18:30:29.804 INFO:tasks.workunit.client.1.smithi149.stdout:3/805: dread d1/d2e/d1d/d6c/fba [0,4194304] 0 2024-09-13T18:30:29.804 INFO:tasks.workunit.client.1.smithi149.stdout:6/952: dwrite dc/f9f [0,4194304] 0 2024-09-13T18:30:29.805 INFO:tasks.workunit.client.0.smithi038.stdout:8/262: dread d1/de/d21/d24/d41/f48 [0,4194304] 0 2024-09-13T18:30:29.806 INFO:tasks.workunit.client.1.smithi149.stdout:2/760: unlink db/d1b/d1c/d20/d3a/f3f 0 2024-09-13T18:30:29.811 INFO:tasks.workunit.client.1.smithi149.stdout:5/786: dread d3/d10/d32/d67/d83/f8a [0,4194304] 0 2024-09-13T18:30:29.811 INFO:tasks.workunit.client.1.smithi149.stdout:5/787: fsync d3/d10/d32/d67/d83/fb0 0 2024-09-13T18:30:29.811 INFO:tasks.workunit.client.0.smithi038.stdout:1/158: write d12/f1a [1753085,35678] 0 2024-09-13T18:30:29.814 INFO:tasks.workunit.client.0.smithi038.stdout:4/291: dwrite d2/df/d22/dc/f18 [0,4194304] 0 2024-09-13T18:30:29.818 INFO:tasks.workunit.client.1.smithi149.stdout:1/840: creat d9/d10/de4/f10a x:0 0 0 2024-09-13T18:30:29.819 INFO:tasks.workunit.client.0.smithi038.stdout:9/191: symlink d0/l41 0 2024-09-13T18:30:29.819 INFO:tasks.workunit.client.0.smithi038.stdout:9/192: write d0/d2e/f29 [302304,63937] 0 2024-09-13T18:30:29.823 INFO:tasks.workunit.client.0.smithi038.stdout:1/159: dread f9 [0,4194304] 0 2024-09-13T18:30:29.823 INFO:tasks.workunit.client.1.smithi149.stdout:9/693: truncate d0/d2e/d42/d70/f7d 1946633 0 2024-09-13T18:30:29.824 INFO:tasks.workunit.client.1.smithi149.stdout:9/694: creat d0/d18/d27/d5c/d99/fda x:0 0 0 2024-09-13T18:30:29.825 INFO:tasks.workunit.client.0.smithi038.stdout:0/125: creat d2/f32 x:0 0 0 2024-09-13T18:30:29.826 INFO:tasks.workunit.client.0.smithi038.stdout:0/126: stat d2/dc/f28 0 2024-09-13T18:30:29.829 INFO:tasks.workunit.client.0.smithi038.stdout:8/263: getdents d1/de/d21/d24 0 2024-09-13T18:30:29.829 INFO:tasks.workunit.client.0.smithi038.stdout:8/264: truncate d1/f3 1741902 0 2024-09-13T18:30:29.832 INFO:tasks.workunit.client.0.smithi038.stdout:2/166: dwrite d2/da/f15 [0,4194304] 0 2024-09-13T18:30:29.833 INFO:tasks.workunit.client.1.smithi149.stdout:6/953: mkdir dc/d15/daa/de5/de6/d134 0 2024-09-13T18:30:29.834 INFO:tasks.workunit.client.1.smithi149.stdout:4/898: dwrite df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fd1 [0,4194304] 0 2024-09-13T18:30:29.834 INFO:tasks.workunit.client.0.smithi038.stdout:2/167: dread d2/f26 [0,4194304] 0 2024-09-13T18:30:29.835 INFO:tasks.workunit.client.0.smithi038.stdout:2/168: creat d2/d2a/d2b/d39/f42 x:0 0 0 2024-09-13T18:30:29.836 INFO:tasks.workunit.client.1.smithi149.stdout:2/761: symlink db/d100/l102 0 2024-09-13T18:30:29.836 INFO:tasks.workunit.client.1.smithi149.stdout:2/762: creat db/d1b/d1c/d20/f103 x:0 0 0 2024-09-13T18:30:29.836 INFO:tasks.workunit.client.1.smithi149.stdout:2/763: dread - db/d1b/d1c/d20/d2b/d3e/d95/fd5 zero size 2024-09-13T18:30:29.837 INFO:tasks.workunit.client.0.smithi038.stdout:4/292: symlink d2/df/d22/dc/d8/d3b/l5e 0 2024-09-13T18:30:29.841 INFO:tasks.workunit.client.0.smithi038.stdout:5/115: link lc df/d13/l26 0 2024-09-13T18:30:29.846 INFO:tasks.workunit.client.1.smithi149.stdout:1/841: mkdir d9/d10/d34/dbe/d38/d10b 0 2024-09-13T18:30:29.846 INFO:tasks.workunit.client.0.smithi038.stdout:9/193: creat d0/d7/d13/f42 x:0 0 0 2024-09-13T18:30:29.848 INFO:tasks.workunit.client.0.smithi038.stdout:3/144: symlink d0/dd/l31 0 2024-09-13T18:30:29.849 INFO:tasks.workunit.client.0.smithi038.stdout:1/160: getdents d12/d2a 0 2024-09-13T18:30:29.850 INFO:tasks.workunit.client.1.smithi149.stdout:9/695: mknod d0/d18/d27/d5c/d7e/dbc/cdb 0 2024-09-13T18:30:29.851 INFO:tasks.workunit.client.0.smithi038.stdout:0/127: symlink d2/d7/d24/l33 0 2024-09-13T18:30:29.852 INFO:tasks.workunit.client.1.smithi149.stdout:6/954: mkdir dc/d15/d54/da9/d112/d135 0 2024-09-13T18:30:29.852 INFO:tasks.workunit.client.1.smithi149.stdout:6/955: stat dc/c101 0 2024-09-13T18:30:29.852 INFO:tasks.workunit.client.1.smithi149.stdout:6/956: truncate dc/d70/f97 4239303 0 2024-09-13T18:30:29.852 INFO:tasks.workunit.client.1.smithi149.stdout:6/957: write dc/d15/f36 [4460616,20229] 0 2024-09-13T18:30:29.852 INFO:tasks.workunit.client.1.smithi149.stdout:6/958: chown dc/f1a 298706 1 2024-09-13T18:30:29.853 INFO:tasks.workunit.client.0.smithi038.stdout:8/265: mknod d1/de/d21/d24/d41/c5c 0 2024-09-13T18:30:29.853 INFO:tasks.workunit.client.0.smithi038.stdout:8/266: write d1/de/d21/d24/f2f [413440,87953] 0 2024-09-13T18:30:29.853 INFO:tasks.workunit.client.0.smithi038.stdout:8/267: write d1/f54 [1256878,129667] 0 2024-09-13T18:30:29.853 INFO:tasks.workunit.client.0.smithi038.stdout:8/268: dread - d1/de/f23 zero size 2024-09-13T18:30:29.858 INFO:tasks.workunit.client.0.smithi038.stdout:8/269: write d1/de/d21/d24/d41/f48 [3224767,22983] 0 2024-09-13T18:30:29.859 INFO:tasks.workunit.client.0.smithi038.stdout:8/270: dread d1/de/d21/f52 [0,4194304] 0 2024-09-13T18:30:29.859 INFO:tasks.workunit.client.0.smithi038.stdout:8/271: stat d1/de/d21/d24/d4d 0 2024-09-13T18:30:29.859 INFO:tasks.workunit.client.0.smithi038.stdout:8/272: chown d1/d2a/f38 0 1 2024-09-13T18:30:29.862 INFO:tasks.workunit.client.0.smithi038.stdout:2/169: truncate d2/da/d16/f21 3221663 0 2024-09-13T18:30:29.863 INFO:tasks.workunit.client.1.smithi149.stdout:5/788: unlink d3/l1d 0 2024-09-13T18:30:29.864 INFO:tasks.workunit.client.1.smithi149.stdout:1/842: creat d9/d15/d60/d80/dcd/dab/f10c x:0 0 0 2024-09-13T18:30:29.865 INFO:tasks.workunit.client.0.smithi038.stdout:5/116: unlink df/f11 0 2024-09-13T18:30:29.865 INFO:tasks.workunit.client.0.smithi038.stdout:5/117: rename df/d13 to df/d13/d27 22 2024-09-13T18:30:29.865 INFO:tasks.workunit.client.1.smithi149.stdout:8/854: sync 2024-09-13T18:30:29.866 INFO:tasks.workunit.client.0.smithi038.stdout:9/194: symlink d0/d7/d2c/l43 0 2024-09-13T18:30:29.866 INFO:tasks.workunit.client.1.smithi149.stdout:6/959: symlink dc/d15/d23/d57/d5c/l136 0 2024-09-13T18:30:29.866 INFO:tasks.workunit.client.1.smithi149.stdout:1/843: read d9/d15/d60/da5/fd4 [603841,95740] 0 2024-09-13T18:30:29.866 INFO:tasks.workunit.client.1.smithi149.stdout:4/899: dwrite df/da0/d70/db5/db9/fe7 [0,4194304] 0 2024-09-13T18:30:29.867 INFO:tasks.workunit.client.0.smithi038.stdout:3/145: mkdir d0/dd/d19/d1d/d29/d32 0 2024-09-13T18:30:29.867 INFO:tasks.workunit.client.0.smithi038.stdout:5/118: write df/f10 [1267608,7464] 0 2024-09-13T18:30:29.867 INFO:tasks.workunit.client.0.smithi038.stdout:5/119: read - df/d15/f22 zero size 2024-09-13T18:30:29.868 INFO:tasks.workunit.client.1.smithi149.stdout:8/855: mknod d2/db1/dd1/ddd/c11c 0 2024-09-13T18:30:29.869 INFO:tasks.workunit.client.0.smithi038.stdout:8/273: mkdir d1/de/d21/d45/d5d 0 2024-09-13T18:30:29.869 INFO:tasks.workunit.client.0.smithi038.stdout:4/293: dwrite d2/df/d22/dc/f18 [0,4194304] 0 2024-09-13T18:30:29.870 INFO:tasks.workunit.client.0.smithi038.stdout:2/170: symlink d2/l43 0 2024-09-13T18:30:29.872 INFO:tasks.workunit.client.1.smithi149.stdout:1/844: symlink d9/d15/d60/d80/d8b/d42/da4/l10d 0 2024-09-13T18:30:29.872 INFO:tasks.workunit.client.1.smithi149.stdout:2/764: dwrite db/d1b/d1c/d20/d3a/fe8 [0,4194304] 0 2024-09-13T18:30:29.873 INFO:tasks.workunit.client.1.smithi149.stdout:5/789: dread d3/d10/d32/f40 [0,4194304] 0 2024-09-13T18:30:29.873 INFO:tasks.workunit.client.0.smithi038.stdout:9/195: creat d0/d7/d2c/d33/f44 x:0 0 0 2024-09-13T18:30:29.873 INFO:tasks.workunit.client.0.smithi038.stdout:9/196: chown d0/d7/d13/c2b 1 1 2024-09-13T18:30:29.873 INFO:tasks.workunit.client.0.smithi038.stdout:9/197: chown d0/d7/d13/l20 411 1 2024-09-13T18:30:29.873 INFO:tasks.workunit.client.0.smithi038.stdout:9/198: creat d0/d7/f45 x:0 0 0 2024-09-13T18:30:29.874 INFO:tasks.workunit.client.1.smithi149.stdout:4/900: symlink df/da0/d112/dc2/l13b 0 2024-09-13T18:30:29.874 INFO:tasks.workunit.client.1.smithi149.stdout:4/901: write df/da0/d12/d21/d22/d30/d41/d57/d75/da1/f138 [496741,19670] 0 2024-09-13T18:30:29.874 INFO:tasks.workunit.client.1.smithi149.stdout:4/902: fsync df/da0/d112/d3d/f73 0 2024-09-13T18:30:29.874 INFO:tasks.workunit.client.1.smithi149.stdout:9/696: write d0/d2e/d42/d70/d84/dae/fbf [254511,422] 0 2024-09-13T18:30:29.877 INFO:tasks.workunit.client.1.smithi149.stdout:8/856: rename d2/d12/dd8/d58/d97/db6/ffb to d2/db1/dd1/ddd/f11d 0 2024-09-13T18:30:29.877 INFO:tasks.workunit.client.1.smithi149.stdout:8/857: write d2/fc [1658605,82943] 0 2024-09-13T18:30:29.877 INFO:tasks.workunit.client.0.smithi038.stdout:1/161: symlink d12/l31 0 2024-09-13T18:30:29.878 INFO:tasks.workunit.client.0.smithi038.stdout:8/274: mkdir d1/de/d21/d24/d56/d5e 0 2024-09-13T18:30:29.880 INFO:tasks.workunit.client.1.smithi149.stdout:1/845: unlink d9/d15/d40/c81 0 2024-09-13T18:30:29.880 INFO:tasks.workunit.client.1.smithi149.stdout:1/846: creat d9/d10/dca/f10e x:0 0 0 2024-09-13T18:30:29.881 INFO:tasks.workunit.client.0.smithi038.stdout:2/171: mkdir d2/d1e/d44 0 2024-09-13T18:30:29.881 INFO:tasks.workunit.client.0.smithi038.stdout:2/172: readlink d2/l17 0 2024-09-13T18:30:29.881 INFO:tasks.workunit.client.0.smithi038.stdout:2/173: read - d2/d2a/d2b/f32 zero size 2024-09-13T18:30:29.881 INFO:tasks.workunit.client.0.smithi038.stdout:2/174: truncate d2/d1e/f2f 479601 0 2024-09-13T18:30:29.882 INFO:tasks.workunit.client.1.smithi149.stdout:5/790: chown d3/f4 7232 1 2024-09-13T18:30:29.883 INFO:tasks.workunit.client.0.smithi038.stdout:9/199: link d0/d7/d13/l14 d0/d7/l46 0 2024-09-13T18:30:29.884 INFO:tasks.workunit.client.0.smithi038.stdout:3/146: dread d0/f2 [0,4194304] 0 2024-09-13T18:30:29.885 INFO:tasks.workunit.client.0.smithi038.stdout:1/162: unlink d12/c29 0 2024-09-13T18:30:29.885 INFO:tasks.workunit.client.0.smithi038.stdout:1/163: dread - d12/d15/f20 zero size 2024-09-13T18:30:29.887 INFO:tasks.workunit.client.0.smithi038.stdout:2/175: mkdir d2/d2a/d2b/d39/d45 0 2024-09-13T18:30:29.887 INFO:tasks.workunit.client.0.smithi038.stdout:2/176: read - d2/d2a/d2b/f32 zero size 2024-09-13T18:30:29.889 INFO:tasks.workunit.client.1.smithi149.stdout:2/765: dread db/d1b/d1c/d20/d3a/fe8 [0,4194304] 0 2024-09-13T18:30:29.889 INFO:tasks.workunit.client.1.smithi149.stdout:2/766: dread - db/d13/d70/dad/ff1 zero size 2024-09-13T18:30:29.889 INFO:tasks.workunit.client.1.smithi149.stdout:9/697: dread d0/d18/d68/db2/fc8 [0,4194304] 0 2024-09-13T18:30:29.890 INFO:tasks.workunit.client.1.smithi149.stdout:9/698: readlink d0/d18/d27/d5c/d79/lc6 0 2024-09-13T18:30:29.890 INFO:tasks.workunit.client.1.smithi149.stdout:9/699: chown d0/d2e/d42/d59/f69 24270 1 2024-09-13T18:30:29.890 INFO:tasks.workunit.client.1.smithi149.stdout:8/858: unlink d2/d12/dd8/d58/f112 0 2024-09-13T18:30:29.890 INFO:tasks.workunit.client.0.smithi038.stdout:9/200: creat d0/d7/d2c/f47 x:0 0 0 2024-09-13T18:30:29.891 INFO:tasks.workunit.client.0.smithi038.stdout:0/128: dwrite d2/dc/f17 [0,4194304] 0 2024-09-13T18:30:29.892 INFO:tasks.workunit.client.1.smithi149.stdout:9/700: dread d0/d47/fca [0,4194304] 0 2024-09-13T18:30:29.893 INFO:tasks.workunit.client.0.smithi038.stdout:3/147: truncate d0/f2 147356 0 2024-09-13T18:30:29.893 INFO:tasks.workunit.client.0.smithi038.stdout:3/148: dread - d0/dd/d17/f1c zero size 2024-09-13T18:30:29.893 INFO:tasks.workunit.client.0.smithi038.stdout:4/294: dread d2/df/d22/dc/f16 [0,4194304] 0 2024-09-13T18:30:29.893 INFO:tasks.workunit.client.0.smithi038.stdout:5/120: fsync df/f10 0 2024-09-13T18:30:29.894 INFO:tasks.workunit.client.1.smithi149.stdout:1/847: creat d9/d10/d34/d3c/d50/def/f10f x:0 0 0 2024-09-13T18:30:29.894 INFO:tasks.workunit.client.1.smithi149.stdout:1/848: creat d9/d10/d34/dbe/d38/df2/f110 x:0 0 0 2024-09-13T18:30:29.896 INFO:tasks.workunit.client.0.smithi038.stdout:2/177: mkdir d2/d2a/d2b/d46 0 2024-09-13T18:30:29.896 INFO:tasks.workunit.client.0.smithi038.stdout:2/178: creat d2/f47 x:0 0 0 2024-09-13T18:30:29.896 INFO:tasks.workunit.client.0.smithi038.stdout:2/179: fdatasync d2/f26 0 2024-09-13T18:30:29.896 INFO:tasks.workunit.client.0.smithi038.stdout:2/180: dread - d2/d2a/d2b/f31 zero size 2024-09-13T18:30:29.896 INFO:tasks.workunit.client.0.smithi038.stdout:2/181: write d2/da/fd [1761966,53355] 0 2024-09-13T18:30:29.896 INFO:tasks.workunit.client.0.smithi038.stdout:2/182: stat d2/da/d16/c1f 0 2024-09-13T18:30:29.897 INFO:tasks.workunit.client.0.smithi038.stdout:2/183: write d2/f11 [523713,125240] 0 2024-09-13T18:30:29.897 INFO:tasks.workunit.client.0.smithi038.stdout:2/184: stat d2/d2a/f3d 0 2024-09-13T18:30:29.897 INFO:tasks.workunit.client.1.smithi149.stdout:6/960: dwrite dc/d15/d23/d57/d5c/f9b [0,4194304] 0 2024-09-13T18:30:29.899 INFO:tasks.workunit.client.0.smithi038.stdout:9/201: mknod d0/d7/d13/d2d/d3e/c48 0 2024-09-13T18:30:29.899 INFO:tasks.workunit.client.0.smithi038.stdout:9/202: chown d0/d7/d13/d2d/d3c/f3f 11864 1 2024-09-13T18:30:29.900 INFO:tasks.workunit.client.0.smithi038.stdout:9/203: creat d0/d7/d2c/f49 x:0 0 0 2024-09-13T18:30:29.902 INFO:tasks.workunit.client.1.smithi149.stdout:5/791: creat d3/d10/d32/d54/d97/de7/ff9 x:0 0 0 2024-09-13T18:30:29.903 INFO:tasks.workunit.client.1.smithi149.stdout:8/859: symlink d2/dc4/l11e 0 2024-09-13T18:30:29.903 INFO:tasks.workunit.client.1.smithi149.stdout:8/860: write d2/d12/d2a/d4d/f83 [842953,66472] 0 2024-09-13T18:30:29.909 INFO:tasks.workunit.client.1.smithi149.stdout:9/701: creat d0/d18/d68/fdc x:0 0 0 2024-09-13T18:30:29.909 INFO:tasks.workunit.client.1.smithi149.stdout:9/702: creat d0/d47/d61/fdd x:0 0 0 2024-09-13T18:30:29.911 INFO:tasks.workunit.client.0.smithi038.stdout:3/149: mknod d0/dd/d19/d1d/d29/d32/c33 0 2024-09-13T18:30:29.911 INFO:tasks.workunit.client.0.smithi038.stdout:3/150: write d0/fa [3038064,54218] 0 2024-09-13T18:30:29.911 INFO:tasks.workunit.client.0.smithi038.stdout:3/151: chown d0/dd 1321426 1 2024-09-13T18:30:29.912 INFO:tasks.workunit.client.0.smithi038.stdout:9/204: dread d0/d2e/f29 [0,4194304] 0 2024-09-13T18:30:29.915 INFO:tasks.workunit.client.1.smithi149.stdout:2/767: write db/d1b/f98 [544551,73981] 0 2024-09-13T18:30:29.918 INFO:tasks.workunit.client.1.smithi149.stdout:5/792: dread d3/d8/d13/f6c [0,4194304] 0 2024-09-13T18:30:29.918 INFO:tasks.workunit.client.1.smithi149.stdout:5/793: chown d3/d8/lb 2911732 1 2024-09-13T18:30:29.919 INFO:tasks.workunit.client.0.smithi038.stdout:5/121: unlink df/d15/f1d 0 2024-09-13T18:30:29.924 INFO:tasks.workunit.client.0.smithi038.stdout:3/152: symlink d0/dd/d19/d1d/d29/d2b/l34 0 2024-09-13T18:30:29.926 INFO:tasks.workunit.client.1.smithi149.stdout:6/961: creat dc/d15/f137 x:0 0 0 2024-09-13T18:30:29.926 INFO:tasks.workunit.client.1.smithi149.stdout:6/962: truncate dc/d15/d23/d104/f8e 1412632 0 2024-09-13T18:30:29.926 INFO:tasks.workunit.client.1.smithi149.stdout:6/963: dread - dc/d15/d23/f107 zero size 2024-09-13T18:30:29.927 INFO:tasks.workunit.client.0.smithi038.stdout:4/295: getdents d2/df/d22/dc 0 2024-09-13T18:30:29.927 INFO:tasks.workunit.client.0.smithi038.stdout:8/275: dwrite d1/d8/f44 [0,4194304] 0 2024-09-13T18:30:29.929 INFO:tasks.workunit.client.1.smithi149.stdout:8/861: symlink d2/l11f 0 2024-09-13T18:30:29.929 INFO:tasks.workunit.client.1.smithi149.stdout:8/862: chown d2/d5b/lc1 4597410 1 2024-09-13T18:30:29.929 INFO:tasks.workunit.client.1.smithi149.stdout:8/863: readlink d2/d12/dd8/d66/ld6 0 2024-09-13T18:30:29.930 INFO:tasks.workunit.client.0.smithi038.stdout:9/205: dread d0/f2f [0,4194304] 0 2024-09-13T18:30:29.930 INFO:tasks.workunit.client.0.smithi038.stdout:9/206: fsync d0/d7/d13/f19 0 2024-09-13T18:30:29.930 INFO:tasks.workunit.client.0.smithi038.stdout:5/122: truncate fb 5445178 0 2024-09-13T18:30:29.931 INFO:tasks.workunit.client.1.smithi149.stdout:8/864: write d2/fc [1533543,16697] 0 2024-09-13T18:30:29.931 INFO:tasks.workunit.client.1.smithi149.stdout:8/865: chown d2/d13/d3a/c95 6676 1 2024-09-13T18:30:29.932 INFO:tasks.workunit.client.1.smithi149.stdout:8/866: fdatasync d2/d12/f9d 0 2024-09-13T18:30:29.933 INFO:tasks.workunit.client.0.smithi038.stdout:3/153: link d0/f9 d0/dd/d19/d1d/d29/d32/f35 0 2024-09-13T18:30:29.936 INFO:tasks.workunit.client.0.smithi038.stdout:1/164: dwrite d12/f25 [0,4194304] 0 2024-09-13T18:30:29.936 INFO:tasks.workunit.client.0.smithi038.stdout:1/165: readlink d12/l31 0 2024-09-13T18:30:29.936 INFO:tasks.workunit.client.0.smithi038.stdout:1/166: truncate d12/d15/f21 676367 0 2024-09-13T18:30:29.937 INFO:tasks.workunit.client.0.smithi038.stdout:9/207: mkdir d0/d7/d2c/d33/d4a 0 2024-09-13T18:30:29.939 INFO:tasks.workunit.client.0.smithi038.stdout:5/123: rename df/d13/c1c to df/c28 0 2024-09-13T18:30:29.939 INFO:tasks.workunit.client.0.smithi038.stdout:5/124: fsync f9 0 2024-09-13T18:30:29.941 INFO:tasks.workunit.client.1.smithi149.stdout:2/768: unlink db/d10/d8d/fd4 0 2024-09-13T18:30:29.941 INFO:tasks.workunit.client.0.smithi038.stdout:3/154: truncate d0/dd/d19/f21 573786 0 2024-09-13T18:30:29.946 INFO:tasks.workunit.client.0.smithi038.stdout:0/129: dwrite d2/d7/d24/d2b/f2d [0,4194304] 0 2024-09-13T18:30:29.946 INFO:tasks.workunit.client.1.smithi149.stdout:6/964: rename dc/d15/d23/d5b/d91/db0 to dc/d15/d54/da9/d112/d138 0 2024-09-13T18:30:29.948 INFO:tasks.workunit.client.0.smithi038.stdout:4/296: write d2/f41 [5811925,117121] 0 2024-09-13T18:30:29.951 INFO:tasks.workunit.client.1.smithi149.stdout:9/703: dwrite d0/f88 [0,4194304] 0 2024-09-13T18:30:29.951 INFO:tasks.workunit.client.1.smithi149.stdout:8/867: unlink d2/l10 0 2024-09-13T18:30:29.951 INFO:tasks.workunit.client.1.smithi149.stdout:8/868: creat d2/d12/d6e/f120 x:0 0 0 2024-09-13T18:30:29.953 INFO:tasks.workunit.client.0.smithi038.stdout:3/155: write d0/f4 [2837660,99934] 0 2024-09-13T18:30:29.953 INFO:tasks.workunit.client.0.smithi038.stdout:3/156: readlink d0/l3 0 2024-09-13T18:30:29.953 INFO:tasks.workunit.client.0.smithi038.stdout:9/208: mknod d0/d7/d13/d30/c4b 0 2024-09-13T18:30:29.953 INFO:tasks.workunit.client.0.smithi038.stdout:9/209: truncate d0/d7/d2c/f49 89062 0 2024-09-13T18:30:29.954 INFO:tasks.workunit.client.1.smithi149.stdout:2/769: dread db/d1b/d1c/d20/d2b/f57 [0,4194304] 0 2024-09-13T18:30:29.955 INFO:tasks.workunit.client.0.smithi038.stdout:5/125: truncate df/d13/f21 4125883 0 2024-09-13T18:30:29.955 INFO:tasks.workunit.client.0.smithi038.stdout:5/126: stat df 0 2024-09-13T18:30:29.960 INFO:tasks.workunit.client.0.smithi038.stdout:5/127: read f2 [91747,80086] 0 2024-09-13T18:30:29.961 INFO:tasks.workunit.client.1.smithi149.stdout:9/704: creat d0/d47/fde x:0 0 0 2024-09-13T18:30:29.962 INFO:tasks.workunit.client.0.smithi038.stdout:0/130: mknod d2/c34 0 2024-09-13T18:30:29.962 INFO:tasks.workunit.client.0.smithi038.stdout:0/131: creat d2/d7/f35 x:0 0 0 2024-09-13T18:30:29.962 INFO:tasks.workunit.client.0.smithi038.stdout:0/132: chown d2/d7 15460065 1 2024-09-13T18:30:29.962 INFO:tasks.workunit.client.0.smithi038.stdout:2/185: dwrite d2/d2a/d2b/d39/f42 [0,4194304] 0 2024-09-13T18:30:29.962 INFO:tasks.workunit.client.0.smithi038.stdout:2/186: write d2/f11 [758288,93176] 0 2024-09-13T18:30:29.965 INFO:tasks.workunit.client.1.smithi149.stdout:6/965: dread dc/d15/f4d [0,4194304] 0 2024-09-13T18:30:29.965 INFO:tasks.workunit.client.1.smithi149.stdout:8/869: dread d2/d12/d40/f5e [0,4194304] 0 2024-09-13T18:30:29.966 INFO:tasks.workunit.client.0.smithi038.stdout:3/157: creat d0/dd/d19/d1d/d29/d2b/f36 x:0 0 0 2024-09-13T18:30:29.966 INFO:tasks.workunit.client.0.smithi038.stdout:3/158: write d0/dd/d19/d1d/d29/d2b/f36 [134783,48188] 0 2024-09-13T18:30:29.967 INFO:tasks.workunit.client.1.smithi149.stdout:1/849: dwrite d9/fce [0,4194304] 0 2024-09-13T18:30:29.967 INFO:tasks.workunit.client.1.smithi149.stdout:1/850: fdatasync d9/f3d 0 2024-09-13T18:30:29.968 INFO:tasks.workunit.client.0.smithi038.stdout:8/276: dwrite d1/de/d21/f28 [0,4194304] 0 2024-09-13T18:30:29.968 INFO:tasks.workunit.client.0.smithi038.stdout:8/277: getdents d1/d2a/d3f 0 2024-09-13T18:30:29.968 INFO:tasks.workunit.client.0.smithi038.stdout:8/278: read - d1/de/f33 zero size 2024-09-13T18:30:29.968 INFO:tasks.workunit.client.0.smithi038.stdout:9/210: link d0/d2e/f27 d0/d7/d2c/d33/f4c 0 2024-09-13T18:30:29.969 INFO:tasks.workunit.client.0.smithi038.stdout:9/211: chown d0/d7/l24 3987 1 2024-09-13T18:30:29.969 INFO:tasks.workunit.client.0.smithi038.stdout:9/212: chown d0/d7/d13/d30/c4b 544770 1 2024-09-13T18:30:29.969 INFO:tasks.workunit.client.0.smithi038.stdout:1/167: dwrite ff [0,4194304] 0 2024-09-13T18:30:29.969 INFO:tasks.workunit.client.1.smithi149.stdout:9/705: creat d0/d18/d93/fdf x:0 0 0 2024-09-13T18:30:29.969 INFO:tasks.workunit.client.1.smithi149.stdout:5/794: dwrite d3/d10/d32/d54/d76/f89 [0,4194304] 0 2024-09-13T18:30:29.971 INFO:tasks.workunit.client.0.smithi038.stdout:5/128: mkdir df/d29 0 2024-09-13T18:30:29.971 INFO:tasks.workunit.client.0.smithi038.stdout:5/129: creat df/f2a x:0 0 0 2024-09-13T18:30:29.971 INFO:tasks.workunit.client.0.smithi038.stdout:0/133: dread d2/d7/f1d [0,4194304] 0 2024-09-13T18:30:29.971 INFO:tasks.workunit.client.1.smithi149.stdout:9/706: dread d0/d18/d27/d5c/d7e/fb8 [0,4194304] 0 2024-09-13T18:30:29.971 INFO:tasks.workunit.client.1.smithi149.stdout:2/770: rmdir db/d1b/d1c/d20/d2b/d3e 39 2024-09-13T18:30:29.971 INFO:tasks.workunit.client.1.smithi149.stdout:2/771: chown db/d13/d70/dad/ff8 55 1 2024-09-13T18:30:29.973 INFO:tasks.workunit.client.1.smithi149.stdout:6/966: truncate dc/d2f/fce 423074 0 2024-09-13T18:30:29.973 INFO:tasks.workunit.client.1.smithi149.stdout:6/967: write dc/d15/d23/d57/da5/fed [760760,39854] 0 2024-09-13T18:30:29.973 INFO:tasks.workunit.client.1.smithi149.stdout:6/968: write dc/d15/d23/f58 [310846,125785] 0 2024-09-13T18:30:29.976 INFO:tasks.workunit.client.1.smithi149.stdout:8/870: link d2/d12/dd8/d66/ld6 d2/dc4/l121 0 2024-09-13T18:30:29.976 INFO:tasks.workunit.client.1.smithi149.stdout:8/871: creat d2/d12/dd8/d58/f122 x:0 0 0 2024-09-13T18:30:29.982 INFO:tasks.workunit.client.1.smithi149.stdout:1/851: dread d9/d15/f29 [0,4194304] 0 2024-09-13T18:30:29.989 INFO:tasks.workunit.client.1.smithi149.stdout:9/707: dread d0/f4e [0,4194304] 0 2024-09-13T18:30:29.991 INFO:tasks.workunit.client.0.smithi038.stdout:2/187: dwrite d2/da/f15 [0,4194304] 0 2024-09-13T18:30:29.992 INFO:tasks.workunit.client.0.smithi038.stdout:8/279: rename d1/d8/l37 to d1/de/d3a/l5f 0 2024-09-13T18:30:29.993 INFO:tasks.workunit.client.0.smithi038.stdout:8/280: write d1/d2a/f2e [148117,89819] 0 2024-09-13T18:30:29.993 INFO:tasks.workunit.client.0.smithi038.stdout:8/281: getdents d1/de/d21/d24 0 2024-09-13T18:30:29.993 INFO:tasks.workunit.client.0.smithi038.stdout:8/282: write d1/d8/f2b [4165173,97992] 0 2024-09-13T18:30:29.994 INFO:tasks.workunit.client.0.smithi038.stdout:9/213: link d0/d7/d13/f1e d0/d7/d13/d30/f4d 0 2024-09-13T18:30:29.995 INFO:tasks.workunit.client.0.smithi038.stdout:9/214: dread - d0/d7/d13/f42 zero size 2024-09-13T18:30:29.997 INFO:tasks.workunit.client.1.smithi149.stdout:5/795: symlink d3/d10/d32/d54/d97/dba/df8/lfa 0 2024-09-13T18:30:29.997 INFO:tasks.workunit.client.1.smithi149.stdout:5/796: stat d3/d10/d4c/d4e/f50 0 2024-09-13T18:30:29.997 INFO:tasks.workunit.client.0.smithi038.stdout:1/168: mkdir d12/d2a/d32 0 2024-09-13T18:30:29.999 INFO:tasks.workunit.client.1.smithi149.stdout:6/969: symlink dc/d15/daa/de5/de6/d113/l139 0 2024-09-13T18:30:30.000 INFO:tasks.workunit.client.0.smithi038.stdout:2/188: dread d2/d2a/d2b/d39/f42 [0,4194304] 0 2024-09-13T18:30:30.001 INFO:tasks.workunit.client.0.smithi038.stdout:1/169: dread fc [0,4194304] 0 2024-09-13T18:30:30.001 INFO:tasks.workunit.client.0.smithi038.stdout:1/170: write f3 [1926236,65479] 0 2024-09-13T18:30:30.001 INFO:tasks.workunit.client.0.smithi038.stdout:1/171: dread - d12/f30 zero size 2024-09-13T18:30:30.002 INFO:tasks.workunit.client.0.smithi038.stdout:5/130: symlink df/d15/l2b 0 2024-09-13T18:30:30.003 INFO:tasks.workunit.client.0.smithi038.stdout:5/131: dread - df/f2a zero size 2024-09-13T18:30:30.003 INFO:tasks.workunit.client.0.smithi038.stdout:5/132: readlink df/d13/l23 0 2024-09-13T18:30:30.004 INFO:tasks.workunit.client.1.smithi149.stdout:8/872: rename d2/d12/dc2/f106 to d2/d12/dd8/f123 0 2024-09-13T18:30:30.010 INFO:tasks.workunit.client.1.smithi149.stdout:6/970: read dc/f2d [4699190,86093] 0 2024-09-13T18:30:30.011 INFO:tasks.workunit.client.1.smithi149.stdout:9/708: rename d0/d2e/d42/d59/d86/lb5 to d0/d18/d68/le0 0 2024-09-13T18:30:30.012 INFO:tasks.workunit.client.1.smithi149.stdout:9/709: write d0/d9e/f56 [1465309,2790] 0 2024-09-13T18:30:30.012 INFO:tasks.workunit.client.1.smithi149.stdout:9/710: readlink d0/d47/d54/lcf 0 2024-09-13T18:30:30.013 INFO:tasks.workunit.client.1.smithi149.stdout:8/873: truncate d2/d13/d3a/d7f/fdc 1345311 0 2024-09-13T18:30:30.015 INFO:tasks.workunit.client.1.smithi149.stdout:5/797: getdents d3/d10/d32/d54/db9 0 2024-09-13T18:30:30.015 INFO:tasks.workunit.client.1.smithi149.stdout:5/798: chown d3/d10/d4c/d4e/f50 6 1 2024-09-13T18:30:30.015 INFO:tasks.workunit.client.1.smithi149.stdout:5/799: fdatasync d3/d10/d32/d54/d97/fd9 0 2024-09-13T18:30:30.018 INFO:tasks.workunit.client.1.smithi149.stdout:6/971: write dc/d15/f9e [3324759,31215] 0 2024-09-13T18:30:30.018 INFO:tasks.workunit.client.1.smithi149.stdout:6/972: truncate dc/d70/dc7/fd2 60387 0 2024-09-13T18:30:30.019 INFO:tasks.workunit.client.0.smithi038.stdout:1/172: read d12/f25 [2007013,33775] 0 2024-09-13T18:30:30.019 INFO:tasks.workunit.client.1.smithi149.stdout:9/711: unlink d0/l6 0 2024-09-13T18:30:30.021 INFO:tasks.workunit.client.1.smithi149.stdout:6/973: dread dc/d15/d54/da9/fc0 [0,4194304] 0 2024-09-13T18:30:30.021 INFO:tasks.workunit.client.1.smithi149.stdout:6/974: truncate dc/d2f/df2/f10d 934414 0 2024-09-13T18:30:30.021 INFO:tasks.workunit.client.1.smithi149.stdout:8/874: rename d2/dc4/ddb/c108 to d2/d13/d3a/c124 0 2024-09-13T18:30:30.026 INFO:tasks.workunit.client.1.smithi149.stdout:9/712: symlink d0/d47/d54/d75/le1 0 2024-09-13T18:30:30.026 INFO:tasks.workunit.client.1.smithi149.stdout:9/713: write d0/d18/d93/fb6 [912812,38194] 0 2024-09-13T18:30:30.026 INFO:tasks.workunit.client.1.smithi149.stdout:9/714: fdatasync d0/d18/d93/fd7 0 2024-09-13T18:30:30.026 INFO:tasks.workunit.client.1.smithi149.stdout:9/715: chown d0/d18/d27/l5a 926 1 2024-09-13T18:30:30.028 INFO:tasks.workunit.client.1.smithi149.stdout:6/975: mkdir dc/d70/dc7/d13a 0 2024-09-13T18:30:30.031 INFO:tasks.workunit.client.1.smithi149.stdout:2/772: dwrite f4 [0,4194304] 0 2024-09-13T18:30:30.033 INFO:tasks.workunit.client.0.smithi038.stdout:0/134: unlink l1 0 2024-09-13T18:30:30.034 INFO:tasks.workunit.client.1.smithi149.stdout:1/852: dwrite d9/d10/d34/d53/d57/f64 [0,4194304] 0 2024-09-13T18:30:30.034 INFO:tasks.workunit.client.0.smithi038.stdout:4/297: dwrite d2/f41 [4194304,4194304] 0 2024-09-13T18:30:30.034 INFO:tasks.workunit.client.0.smithi038.stdout:4/298: fsync d2/df/d22/dc/f16 0 2024-09-13T18:30:30.035 INFO:tasks.workunit.client.0.smithi038.stdout:8/283: dwrite d1/d4/f59 [0,4194304] 0 2024-09-13T18:30:30.035 INFO:tasks.workunit.client.1.smithi149.stdout:8/875: symlink d2/d12/dd8/d58/d97/l125 0 2024-09-13T18:30:30.038 INFO:tasks.workunit.client.1.smithi149.stdout:8/876: dread d2/d12/f16 [0,4194304] 0 2024-09-13T18:30:30.038 INFO:tasks.workunit.client.1.smithi149.stdout:8/877: chown d2/d12/d2a/d4d/dbb/c118 650166157 1 2024-09-13T18:30:30.038 INFO:tasks.workunit.client.1.smithi149.stdout:6/976: creat dc/d70/dc7/d13a/f13b x:0 0 0 2024-09-13T18:30:30.039 INFO:tasks.workunit.client.0.smithi038.stdout:3/159: rmdir d0/dd/d19 39 2024-09-13T18:30:30.039 INFO:tasks.workunit.client.0.smithi038.stdout:3/160: chown d0/dd/d19/d1d/d30 6839364 1 2024-09-13T18:30:30.041 INFO:tasks.workunit.client.1.smithi149.stdout:3/806: sync 2024-09-13T18:30:30.041 INFO:tasks.workunit.client.1.smithi149.stdout:7/920: sync 2024-09-13T18:30:30.042 INFO:tasks.workunit.client.1.smithi149.stdout:0/877: sync 2024-09-13T18:30:30.042 INFO:tasks.workunit.client.1.smithi149.stdout:0/878: stat d1/d2/d41/d46/d7b/daf 0 2024-09-13T18:30:30.042 INFO:tasks.workunit.client.1.smithi149.stdout:7/921: creat d7/f143 x:0 0 0 2024-09-13T18:30:30.042 INFO:tasks.workunit.client.1.smithi149.stdout:4/903: sync 2024-09-13T18:30:30.042 INFO:tasks.workunit.client.1.smithi149.stdout:4/904: fsync df/da0/dcc/ff2 0 2024-09-13T18:30:30.042 INFO:tasks.workunit.client.1.smithi149.stdout:4/905: truncate df/da0/d12/d7c/f117 749564 0 2024-09-13T18:30:30.043 INFO:tasks.workunit.client.0.smithi038.stdout:9/215: creat d0/d7/d13/d2d/d3e/f4e x:0 0 0 2024-09-13T18:30:30.044 INFO:tasks.workunit.client.0.smithi038.stdout:8/284: write d1/d8/f51 [1619051,52054] 0 2024-09-13T18:30:30.045 INFO:tasks.workunit.client.0.smithi038.stdout:2/189: unlink d2/d1e/f3e 0 2024-09-13T18:30:30.047 INFO:tasks.workunit.client.0.smithi038.stdout:5/133: unlink df/d13/l23 0 2024-09-13T18:30:30.049 INFO:tasks.workunit.client.0.smithi038.stdout:1/173: symlink d12/d15/l33 0 2024-09-13T18:30:30.051 INFO:tasks.workunit.client.0.smithi038.stdout:0/135: mknod d2/d2f/c36 0 2024-09-13T18:30:30.052 INFO:tasks.workunit.client.0.smithi038.stdout:0/136: chown d2/dc/f17 7434 1 2024-09-13T18:30:30.054 INFO:tasks.workunit.client.1.smithi149.stdout:2/773: mknod db/d1b/d6c/c104 0 2024-09-13T18:30:30.054 INFO:tasks.workunit.client.1.smithi149.stdout:2/774: creat db/d10/da9/f105 x:0 0 0 2024-09-13T18:30:30.054 INFO:tasks.workunit.client.0.smithi038.stdout:5/134: dread df/f10 [0,4194304] 0 2024-09-13T18:30:30.054 INFO:tasks.workunit.client.0.smithi038.stdout:5/135: dread - df/f1e zero size 2024-09-13T18:30:30.055 INFO:tasks.workunit.client.0.smithi038.stdout:4/299: creat d2/df/d1b/d10/f5f x:0 0 0 2024-09-13T18:30:30.057 INFO:tasks.workunit.client.1.smithi149.stdout:1/853: rmdir d9/d15/d25 39 2024-09-13T18:30:30.059 INFO:tasks.workunit.client.1.smithi149.stdout:9/716: unlink d0/d18/d68/le0 0 2024-09-13T18:30:30.060 INFO:tasks.workunit.client.1.smithi149.stdout:8/878: symlink d2/d13/d3a/d7f/d8d/l126 0 2024-09-13T18:30:30.060 INFO:tasks.workunit.client.1.smithi149.stdout:8/879: write d2/d5b/fe5 [115834,30596] 0 2024-09-13T18:30:30.060 INFO:tasks.workunit.client.1.smithi149.stdout:8/880: dread - d2/d5b/f104 zero size 2024-09-13T18:30:30.061 INFO:tasks.workunit.client.0.smithi038.stdout:3/161: rename d0/dd/l1f to d0/dd/d19/d1d/d29/d2b/l37 0 2024-09-13T18:30:30.063 INFO:tasks.workunit.client.1.smithi149.stdout:3/807: unlink d1/d12/d20/d54/d6d/l100 0 2024-09-13T18:30:30.067 INFO:tasks.workunit.client.1.smithi149.stdout:0/879: creat d1/d2/d8a/da9/dd7/f133 x:0 0 0 2024-09-13T18:30:30.069 INFO:tasks.workunit.client.1.smithi149.stdout:4/906: symlink df/da0/d12/d7c/d109/l13c 0 2024-09-13T18:30:30.075 INFO:tasks.workunit.client.0.smithi038.stdout:9/216: mknod d0/d7/d13/d30/c4f 0 2024-09-13T18:30:30.078 INFO:tasks.workunit.client.0.smithi038.stdout:2/190: mkdir d2/d1e/d48 0 2024-09-13T18:30:30.078 INFO:tasks.workunit.client.0.smithi038.stdout:2/191: write d2/d2a/d2b/f31 [77696,13391] 0 2024-09-13T18:30:30.081 INFO:tasks.workunit.client.0.smithi038.stdout:5/136: mknod df/c2c 0 2024-09-13T18:30:30.081 INFO:tasks.workunit.client.0.smithi038.stdout:5/137: fdatasync df/d13/f21 0 2024-09-13T18:30:30.081 INFO:tasks.workunit.client.0.smithi038.stdout:1/174: dwrite d12/f2b [0,4194304] 0 2024-09-13T18:30:30.082 INFO:tasks.workunit.client.0.smithi038.stdout:0/137: dwrite d2/dc/f11 [0,4194304] 0 2024-09-13T18:30:30.082 INFO:tasks.workunit.client.0.smithi038.stdout:4/300: symlink d2/df/d22/dc/l60 0 2024-09-13T18:30:30.089 INFO:tasks.workunit.client.1.smithi149.stdout:0/880: dread d1/d29/d31/d44/d47/f59 [0,4194304] 0 2024-09-13T18:30:30.090 INFO:tasks.workunit.client.1.smithi149.stdout:0/881: truncate d1/d2/f11d 582798 0 2024-09-13T18:30:30.091 INFO:tasks.workunit.client.0.smithi038.stdout:4/301: read d2/df/d22/dc/f18 [430035,39253] 0 2024-09-13T18:30:30.092 INFO:tasks.workunit.client.0.smithi038.stdout:4/302: write d2/df/d1b/d10/f5f [2154,19987] 0 2024-09-13T18:30:30.092 INFO:tasks.workunit.client.0.smithi038.stdout:4/303: fdatasync d2/f41 0 2024-09-13T18:30:30.098 INFO:tasks.workunit.client.1.smithi149.stdout:0/882: write d1/d29/d31/f88 [3817774,45532] 0 2024-09-13T18:30:30.121 INFO:tasks.workunit.client.0.smithi038.stdout:4/304: dwrite d2/df/d22/dc/d8/f27 [0,4194304] 0 2024-09-13T18:30:30.146 INFO:tasks.workunit.client.0.smithi038.stdout:8/285: rename d1/d4/fa to d1/f60 0 2024-09-13T18:30:30.147 INFO:tasks.workunit.client.0.smithi038.stdout:8/286: write d1/de/d21/d24/d41/f48 [1029048,83872] 0 2024-09-13T18:30:30.147 INFO:tasks.workunit.client.0.smithi038.stdout:8/287: chown d1/d4/f4f 0 1 2024-09-13T18:30:30.147 INFO:tasks.workunit.client.0.smithi038.stdout:8/288: write d1/d4/f2d [3752661,30799] 0 2024-09-13T18:30:30.149 INFO:tasks.workunit.client.1.smithi149.stdout:5/800: rename d3/d10/d32 to d3/d10/d98/dfb 0 2024-09-13T18:30:30.149 INFO:tasks.workunit.client.1.smithi149.stdout:5/801: fsync d3/d10/d98/dfb/d54/f84 0 2024-09-13T18:30:30.149 INFO:tasks.workunit.client.1.smithi149.stdout:5/802: truncate d3/d10/d4c/db8/fc2 185758 0 2024-09-13T18:30:30.149 INFO:tasks.workunit.client.1.smithi149.stdout:5/803: fsync d3/d8/d13/f18 0 2024-09-13T18:30:30.151 INFO:tasks.workunit.client.0.smithi038.stdout:9/217: mkdir d0/d7/d13/d2d/d3c/d50 0 2024-09-13T18:30:30.155 INFO:tasks.workunit.client.0.smithi038.stdout:2/192: symlink d2/d1e/l49 0 2024-09-13T18:30:30.155 INFO:tasks.workunit.client.0.smithi038.stdout:2/193: chown d2/d2a/d2b/f2e 381789548 1 2024-09-13T18:30:30.156 INFO:tasks.workunit.client.1.smithi149.stdout:5/804: write d3/d10/d4c/f71 [3052709,34226] 0 2024-09-13T18:30:30.157 INFO:tasks.workunit.client.1.smithi149.stdout:2/775: unlink db/d1b/dab/cc9 0 2024-09-13T18:30:30.157 INFO:tasks.workunit.client.1.smithi149.stdout:2/776: stat db/cf7 0 2024-09-13T18:30:30.159 INFO:tasks.workunit.client.0.smithi038.stdout:9/218: write d0/d7/f31 [1785309,120720] 0 2024-09-13T18:30:30.163 INFO:tasks.workunit.client.1.smithi149.stdout:1/854: unlink c4 0 2024-09-13T18:30:30.164 INFO:tasks.workunit.client.0.smithi038.stdout:5/138: mknod df/d29/c2d 0 2024-09-13T18:30:30.165 INFO:tasks.workunit.client.0.smithi038.stdout:5/139: read fd [21264,2923] 0 2024-09-13T18:30:30.166 INFO:tasks.workunit.client.0.smithi038.stdout:2/194: dread d2/f5 [0,4194304] 0 2024-09-13T18:30:30.166 INFO:tasks.workunit.client.0.smithi038.stdout:2/195: chown d2/d1e/f2f 121359596 1 2024-09-13T18:30:30.167 INFO:tasks.workunit.client.1.smithi149.stdout:9/717: mknod d0/d18/d68/db2/ce2 0 2024-09-13T18:30:30.167 INFO:tasks.workunit.client.1.smithi149.stdout:9/718: write d0/d9e/f51 [4565674,9328] 0 2024-09-13T18:30:30.169 INFO:tasks.workunit.client.0.smithi038.stdout:1/175: creat d12/d2a/d32/f34 x:0 0 0 2024-09-13T18:30:30.172 INFO:tasks.workunit.client.1.smithi149.stdout:8/881: creat d2/d12/dd8/d117/f127 x:0 0 0 2024-09-13T18:30:30.173 INFO:tasks.workunit.client.0.smithi038.stdout:9/219: write d0/d2e/f38 [71802,40223] 0 2024-09-13T18:30:30.173 INFO:tasks.workunit.client.0.smithi038.stdout:0/138: fsync d2/d7/f13 0 2024-09-13T18:30:30.178 INFO:tasks.workunit.client.0.smithi038.stdout:4/305: mknod d2/df/d1b/c61 0 2024-09-13T18:30:30.178 INFO:tasks.workunit.client.0.smithi038.stdout:4/306: fsync d2/df/d1b/d10/f3d 0 2024-09-13T18:30:30.181 INFO:tasks.workunit.client.1.smithi149.stdout:4/907: symlink df/da0/d1c/d69/l13d 0 2024-09-13T18:30:30.181 INFO:tasks.workunit.client.1.smithi149.stdout:5/805: dwrite d3/d10/d4c/d4e/d61/d75/d88/fe1 [0,4194304] 0 2024-09-13T18:30:30.190 INFO:tasks.workunit.client.1.smithi149.stdout:2/777: dwrite db/d1b/fd3 [0,4194304] 0 2024-09-13T18:30:30.191 INFO:tasks.workunit.client.0.smithi038.stdout:2/196: dwrite d2/d2a/d2b/f2e [0,4194304] 0 2024-09-13T18:30:30.202 INFO:tasks.workunit.client.0.smithi038.stdout:6/148: sync 2024-09-13T18:30:30.202 INFO:tasks.workunit.client.0.smithi038.stdout:6/149: chown dd/de/f2c 58106831 1 2024-09-13T18:30:30.202 INFO:tasks.workunit.client.0.smithi038.stdout:6/150: write dd/f32 [33710,41242] 0 2024-09-13T18:30:30.202 INFO:tasks.workunit.client.0.smithi038.stdout:6/151: dread - dd/de/f35 zero size 2024-09-13T18:30:30.203 INFO:tasks.workunit.client.0.smithi038.stdout:7/174: sync 2024-09-13T18:30:30.203 INFO:tasks.workunit.client.0.smithi038.stdout:7/175: write db/d12/d1c/d3a/d26/f2b [7183,7966] 0 2024-09-13T18:30:30.203 INFO:tasks.workunit.client.1.smithi149.stdout:2/778: write f6 [7895661,122887] 0 2024-09-13T18:30:30.208 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:29 smithi149 ceph-mon[35845]: pgmap v17: 65 pgs: 65 active+clean; 1.8 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 219 MiB/s rd, 274 MiB/s wr, 685 op/s 2024-09-13T18:30:30.218 INFO:tasks.workunit.client.0.smithi038.stdout:8/289: mkdir d1/de/d21/d45/d61 0 2024-09-13T18:30:30.229 INFO:tasks.workunit.client.0.smithi038.stdout:5/140: mknod df/d15/c2e 0 2024-09-13T18:30:30.231 INFO:tasks.workunit.client.0.smithi038.stdout:9/220: symlink d0/d7/d2c/d33/l51 0 2024-09-13T18:30:30.242 INFO:tasks.workunit.client.0.smithi038.stdout:4/307: mknod d2/df/d22/dc/c62 0 2024-09-13T18:30:30.242 INFO:tasks.workunit.client.0.smithi038.stdout:4/308: write d2/df/d22/dc/f44 [518034,41058] 0 2024-09-13T18:30:30.242 INFO:tasks.workunit.client.0.smithi038.stdout:4/309: write d2/df/d22/dc/d8/d3b/f53 [21431,21186] 0 2024-09-13T18:30:30.244 INFO:tasks.workunit.client.0.smithi038.stdout:8/290: dwrite d1/de/d21/d24/f2f [0,4194304] 0 2024-09-13T18:30:30.245 INFO:tasks.workunit.client.0.smithi038.stdout:8/291: stat d1/d4/f39 0 2024-09-13T18:30:30.257 INFO:tasks.workunit.client.0.smithi038.stdout:5/141: dwrite f8 [0,4194304] 0 2024-09-13T18:30:30.257 INFO:tasks.workunit.client.0.smithi038.stdout:5/142: fdatasync df/d15/f22 0 2024-09-13T18:30:30.257 INFO:tasks.workunit.client.0.smithi038.stdout:9/221: dwrite d0/d7/d13/d30/f4d [0,4194304] 0 2024-09-13T18:30:30.258 INFO:tasks.workunit.client.0.smithi038.stdout:9/222: getdents d0/d7/d13/d2d/d3c/d50 0 2024-09-13T18:30:30.258 INFO:tasks.workunit.client.0.smithi038.stdout:6/152: mknod dd/de/d31/c38 0 2024-09-13T18:30:30.265 INFO:tasks.workunit.client.0.smithi038.stdout:0/139: chown d2/dc/l1f 589 1 2024-09-13T18:30:30.269 INFO:tasks.workunit.client.0.smithi038.stdout:4/310: mknod d2/df/d22/dc/d8/c63 0 2024-09-13T18:30:30.269 INFO:tasks.workunit.client.0.smithi038.stdout:4/311: chown d2/f58 0 1 2024-09-13T18:30:30.269 INFO:tasks.workunit.client.0.smithi038.stdout:4/312: chown d2/df/d1b 1432 1 2024-09-13T18:30:30.269 INFO:tasks.workunit.client.0.smithi038.stdout:4/313: fsync d2/df/d22/dc/d8/f59 0 2024-09-13T18:30:30.279 INFO:tasks.workunit.client.0.smithi038.stdout:8/292: mkdir d1/de/d21/d24/d4d/d50/d62 0 2024-09-13T18:30:30.284 INFO:tasks.workunit.client.0.smithi038.stdout:5/143: creat df/d29/f2f x:0 0 0 2024-09-13T18:30:30.288 INFO:tasks.workunit.client.0.smithi038.stdout:0/140: dwrite d2/d7/f1d [0,4194304] 0 2024-09-13T18:30:30.290 INFO:tasks.workunit.client.0.smithi038.stdout:6/153: rmdir dd/de/d2e/d30/d27 39 2024-09-13T18:30:30.297 INFO:tasks.workunit.client.0.smithi038.stdout:4/314: mkdir d2/d49/d4b/d64 0 2024-09-13T18:30:30.297 INFO:tasks.workunit.client.0.smithi038.stdout:4/315: truncate d2/df/f4c 723450 0 2024-09-13T18:30:30.300 INFO:tasks.workunit.client.0.smithi038.stdout:4/316: dread d2/f19 [0,4194304] 0 2024-09-13T18:30:30.300 INFO:tasks.workunit.client.0.smithi038.stdout:4/317: chown d2/df/d1b/c5c 231570 1 2024-09-13T18:30:30.301 INFO:tasks.workunit.client.0.smithi038.stdout:8/293: creat d1/de/d21/d45/d5d/f63 x:0 0 0 2024-09-13T18:30:30.301 INFO:tasks.workunit.client.0.smithi038.stdout:8/294: chown d1/de/d21/d45/d5d 1 1 2024-09-13T18:30:30.301 INFO:tasks.workunit.client.0.smithi038.stdout:8/295: fsync d1/de/d21/f28 0 2024-09-13T18:30:30.304 INFO:tasks.workunit.client.0.smithi038.stdout:5/144: symlink df/d13/l30 0 2024-09-13T18:30:30.304 INFO:tasks.workunit.client.0.smithi038.stdout:5/145: readlink lc 0 2024-09-13T18:30:30.307 INFO:tasks.workunit.client.0.smithi038.stdout:9/223: getdents d0/d7/d13/d2d 0 2024-09-13T18:30:30.310 INFO:tasks.workunit.client.0.smithi038.stdout:4/318: creat d2/df/d22/f65 x:0 0 0 2024-09-13T18:30:30.311 INFO:tasks.workunit.client.0.smithi038.stdout:5/146: dread fb [4194304,4194304] 0 2024-09-13T18:30:30.311 INFO:tasks.workunit.client.0.smithi038.stdout:5/147: creat df/d29/f31 x:0 0 0 2024-09-13T18:30:30.311 INFO:tasks.workunit.client.0.smithi038.stdout:0/141: dwrite d2/d7/d24/d2b/f2d [0,4194304] 0 2024-09-13T18:30:30.311 INFO:tasks.workunit.client.0.smithi038.stdout:4/319: dread d2/df/d1b/d10/f5f [0,4194304] 0 2024-09-13T18:30:30.317 INFO:tasks.workunit.client.0.smithi038.stdout:4/320: write d2/df/d22/dc/f1a [6513195,84730] 0 2024-09-13T18:30:30.319 INFO:tasks.workunit.client.0.smithi038.stdout:8/296: symlink d1/de/d15/d30/l64 0 2024-09-13T18:30:30.322 INFO:tasks.workunit.client.0.smithi038.stdout:9/224: mknod d0/d7/d2c/c52 0 2024-09-13T18:30:30.322 INFO:tasks.workunit.client.0.smithi038.stdout:9/225: truncate d0/d7/d2c/d33/f44 62573 0 2024-09-13T18:30:30.322 INFO:tasks.workunit.client.0.smithi038.stdout:9/226: fdatasync d0/d7/f31 0 2024-09-13T18:30:30.327 INFO:tasks.workunit.client.0.smithi038.stdout:4/321: read d2/df/d22/dc/d8/d3b/f5d [114131,108117] 0 2024-09-13T18:30:30.327 INFO:tasks.workunit.client.0.smithi038.stdout:4/322: chown d2/f56 2287 1 2024-09-13T18:30:30.329 INFO:tasks.workunit.client.0.smithi038.stdout:0/142: dread - d2/f1c zero size 2024-09-13T18:30:30.329 INFO:tasks.workunit.client.0.smithi038.stdout:4/323: write d2/df/d22/f40 [350142,78399] 0 2024-09-13T18:30:30.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:29 smithi038 ceph-mon[27689]: pgmap v17: 65 pgs: 65 active+clean; 1.8 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 219 MiB/s rd, 274 MiB/s wr, 685 op/s 2024-09-13T18:30:30.333 INFO:tasks.workunit.client.0.smithi038.stdout:9/227: symlink d0/d7/d13/d30/l53 0 2024-09-13T18:30:30.337 INFO:tasks.workunit.client.0.smithi038.stdout:0/143: dread d2/d7/fb [0,4194304] 0 2024-09-13T18:30:30.338 INFO:tasks.workunit.client.0.smithi038.stdout:4/324: mkdir d2/d49/d4b/d66 0 2024-09-13T18:30:30.340 INFO:tasks.workunit.client.0.smithi038.stdout:9/228: creat d0/d7/d13/d2d/d3c/d50/f54 x:0 0 0 2024-09-13T18:30:30.340 INFO:tasks.workunit.client.0.smithi038.stdout:9/229: write d0/d2e/f25 [1353431,91765] 0 2024-09-13T18:30:30.340 INFO:tasks.workunit.client.0.smithi038.stdout:9/230: chown d0/d7/f31 79 1 2024-09-13T18:30:30.342 INFO:tasks.workunit.client.0.smithi038.stdout:0/144: fdatasync d2/f32 0 2024-09-13T18:30:30.345 INFO:tasks.workunit.client.0.smithi038.stdout:4/325: mknod d2/df/d1b/c67 0 2024-09-13T18:30:30.350 INFO:tasks.workunit.client.0.smithi038.stdout:9/231: creat d0/d7/d13/d30/f55 x:0 0 0 2024-09-13T18:30:30.350 INFO:tasks.workunit.client.0.smithi038.stdout:9/232: write d0/d2e/f38 [3209885,23294] 0 2024-09-13T18:30:30.354 INFO:tasks.workunit.client.0.smithi038.stdout:4/326: mkdir d2/df/d1b/d10/d68 0 2024-09-13T18:30:30.356 INFO:tasks.workunit.client.0.smithi038.stdout:0/145: dwrite d2/d7/fb [0,4194304] 0 2024-09-13T18:30:30.356 INFO:tasks.workunit.client.0.smithi038.stdout:0/146: fsync d2/f32 0 2024-09-13T18:30:30.358 INFO:tasks.workunit.client.0.smithi038.stdout:4/327: mknod d2/c69 0 2024-09-13T18:30:30.358 INFO:tasks.workunit.client.0.smithi038.stdout:4/328: write d2/df/d1b/d10/f3d [2169343,60982] 0 2024-09-13T18:30:30.360 INFO:tasks.workunit.client.0.smithi038.stdout:9/233: mknod d0/c56 0 2024-09-13T18:30:30.367 INFO:tasks.workunit.client.0.smithi038.stdout:9/234: creat d0/d7/d2c/d33/d4a/f57 x:0 0 0 2024-09-13T18:30:30.367 INFO:tasks.workunit.client.0.smithi038.stdout:9/235: write d0/f11 [2007705,9176] 0 2024-09-13T18:30:30.367 INFO:tasks.workunit.client.0.smithi038.stdout:9/236: creat d0/d7/d13/f58 x:0 0 0 2024-09-13T18:30:30.372 INFO:tasks.workunit.client.0.smithi038.stdout:9/237: mknod d0/d2e/c59 0 2024-09-13T18:30:30.373 INFO:tasks.workunit.client.1.smithi149.stdout:1/855: mkdir d9/d10/d83/d97/d111 0 2024-09-13T18:30:30.373 INFO:tasks.workunit.client.1.smithi149.stdout:1/856: chown d9/d10/d43/f107 13715814 1 2024-09-13T18:30:30.376 INFO:tasks.workunit.client.1.smithi149.stdout:4/908: getdents df/da0/d70 0 2024-09-13T18:30:30.380 INFO:tasks.workunit.client.1.smithi149.stdout:5/806: getdents d3/d10/d4c/d4e/d61/d75 0 2024-09-13T18:30:30.384 INFO:tasks.workunit.client.1.smithi149.stdout:2/779: creat db/d100/f106 x:0 0 0 2024-09-13T18:30:30.385 INFO:tasks.workunit.client.1.smithi149.stdout:1/857: creat d9/d10/d34/d3c/f112 x:0 0 0 2024-09-13T18:30:30.386 INFO:tasks.workunit.client.1.smithi149.stdout:5/807: write d3/d10/d98/dfb/fc1 [8064539,56489] 0 2024-09-13T18:30:30.388 INFO:tasks.workunit.client.1.smithi149.stdout:4/909: rmdir df/da0/deb/d10d 0 2024-09-13T18:30:30.390 INFO:tasks.workunit.client.1.smithi149.stdout:2/780: link db/d1b/d1c/d20/d2b/d3e/d95/fd5 db/d1b/d1c/d20/dff/f107 0 2024-09-13T18:30:30.390 INFO:tasks.workunit.client.1.smithi149.stdout:2/781: chown db/d13/d70/ffe 5159 1 2024-09-13T18:30:30.391 INFO:tasks.workunit.client.1.smithi149.stdout:1/858: creat d9/d10/d3f/dc9/ddf/f113 x:0 0 0 2024-09-13T18:30:30.391 INFO:tasks.workunit.client.1.smithi149.stdout:1/859: chown d9/d10/d34/d53/d7b/ld9 726165567 1 2024-09-13T18:30:30.391 INFO:tasks.workunit.client.1.smithi149.stdout:1/860: fdatasync d9/d15/d60/da5/faf 0 2024-09-13T18:30:30.391 INFO:tasks.workunit.client.1.smithi149.stdout:5/808: creat d3/d10/d98/ffc x:0 0 0 2024-09-13T18:30:30.392 INFO:tasks.workunit.client.1.smithi149.stdout:2/782: getdents db/d1b/d48 0 2024-09-13T18:30:30.392 INFO:tasks.workunit.client.1.smithi149.stdout:2/783: getdents db/d1b/d1c/d20/d2b/db7/de2 0 2024-09-13T18:30:30.392 INFO:tasks.workunit.client.1.smithi149.stdout:1/861: rmdir d9/d10/d34/d53/d57 39 2024-09-13T18:30:30.395 INFO:tasks.workunit.client.1.smithi149.stdout:2/784: unlink db/d1b/d1c/d20/d2b/db7/f6d 0 2024-09-13T18:30:30.397 INFO:tasks.workunit.client.1.smithi149.stdout:2/785: fdatasync f6 0 2024-09-13T18:30:30.398 INFO:tasks.workunit.client.0.smithi038.stdout:3/162: rename d0/l11 to d0/dd/d19/d1d/l38 0 2024-09-13T18:30:30.398 INFO:tasks.workunit.client.0.smithi038.stdout:3/163: write d0/dd/d19/d23/f2e [6883630,3411] 0 2024-09-13T18:30:30.398 INFO:tasks.workunit.client.0.smithi038.stdout:3/164: chown d0/dd/l31 127167 1 2024-09-13T18:30:30.401 INFO:tasks.workunit.client.0.smithi038.stdout:3/165: truncate d0/fc 707088 0 2024-09-13T18:30:30.403 INFO:tasks.workunit.client.0.smithi038.stdout:1/176: rename d12/f30 to d12/d15/f35 0 2024-09-13T18:30:30.403 INFO:tasks.workunit.client.0.smithi038.stdout:1/177: creat d12/d2a/d32/f36 x:0 0 0 2024-09-13T18:30:30.405 INFO:tasks.workunit.client.0.smithi038.stdout:3/166: unlink d0/f24 0 2024-09-13T18:30:30.405 INFO:tasks.workunit.client.0.smithi038.stdout:3/167: chown d0/dd/d19/d1d/d29/d2b/l34 0 1 2024-09-13T18:30:30.407 INFO:tasks.workunit.client.0.smithi038.stdout:6/154: rename dd/f14 to dd/de/d2e/d2f/f39 0 2024-09-13T18:30:30.410 INFO:tasks.workunit.client.0.smithi038.stdout:5/148: rename lc to df/d29/l32 0 2024-09-13T18:30:30.411 INFO:tasks.workunit.client.0.smithi038.stdout:0/147: rename d2/d7/f35 to d2/d7/d24/d2b/f37 0 2024-09-13T18:30:30.413 INFO:tasks.workunit.client.0.smithi038.stdout:6/155: rename cb to dd/de/d2e/c3a 0 2024-09-13T18:30:30.414 INFO:tasks.workunit.client.0.smithi038.stdout:1/178: write d12/f23 [514722,27460] 0 2024-09-13T18:30:30.415 INFO:tasks.workunit.client.0.smithi038.stdout:0/148: symlink d2/d7/d24/d2b/l38 0 2024-09-13T18:30:30.416 INFO:tasks.workunit.client.0.smithi038.stdout:6/156: creat dd/de/d2e/d2f/f3b x:0 0 0 2024-09-13T18:30:30.416 INFO:tasks.workunit.client.0.smithi038.stdout:1/179: dread f10 [0,4194304] 0 2024-09-13T18:30:30.416 INFO:tasks.workunit.client.0.smithi038.stdout:6/157: creat dd/de/f3c x:0 0 0 2024-09-13T18:30:30.417 INFO:tasks.workunit.client.0.smithi038.stdout:0/149: rmdir d2/d7/d24 39 2024-09-13T18:30:30.418 INFO:tasks.workunit.client.1.smithi149.stdout:2/786: dwrite db/d1b/d1c/d20/d3a/fe8 [0,4194304] 0 2024-09-13T18:30:30.418 INFO:tasks.workunit.client.1.smithi149.stdout:1/862: dwrite d9/d15/d60/d80/dcd/dab/ffc [0,4194304] 0 2024-09-13T18:30:30.418 INFO:tasks.workunit.client.0.smithi038.stdout:5/149: write f1 [5893380,52990] 0 2024-09-13T18:30:30.419 INFO:tasks.workunit.client.0.smithi038.stdout:5/150: creat df/d29/f33 x:0 0 0 2024-09-13T18:30:30.419 INFO:tasks.workunit.client.0.smithi038.stdout:5/151: truncate fd 1103783 0 2024-09-13T18:30:30.422 INFO:tasks.workunit.client.0.smithi038.stdout:6/158: link dd/c15 dd/de/d2e/d2f/c3d 0 2024-09-13T18:30:30.422 INFO:tasks.workunit.client.0.smithi038.stdout:6/159: fdatasync dd/f11 0 2024-09-13T18:30:30.422 INFO:tasks.workunit.client.0.smithi038.stdout:6/160: dread - dd/de/f35 zero size 2024-09-13T18:30:30.427 INFO:tasks.workunit.client.1.smithi149.stdout:2/787: dread db/d1b/d1c/d20/d2b/f6b [0,4194304] 0 2024-09-13T18:30:30.428 INFO:tasks.workunit.client.1.smithi149.stdout:2/788: fdatasync db/d1b/d1c/f5b 0 2024-09-13T18:30:30.429 INFO:tasks.workunit.client.0.smithi038.stdout:1/180: link f3 d12/f37 0 2024-09-13T18:30:30.433 INFO:tasks.workunit.client.1.smithi149.stdout:3/808: unlink d1/d2e/d1d/cb0 0 2024-09-13T18:30:30.433 INFO:tasks.workunit.client.1.smithi149.stdout:3/809: chown d1/d48/ddb/lde 6 1 2024-09-13T18:30:30.434 INFO:tasks.workunit.client.0.smithi038.stdout:0/150: dwrite d2/f32 [0,4194304] 0 2024-09-13T18:30:30.435 INFO:tasks.workunit.client.1.smithi149.stdout:1/863: link d9/d15/d60/da5/fd4 d9/d15/d60/d80/dcd/dab/df3/f114 0 2024-09-13T18:30:30.436 INFO:tasks.workunit.client.0.smithi038.stdout:6/161: creat dd/de/d31/f3e x:0 0 0 2024-09-13T18:30:30.437 INFO:tasks.workunit.client.1.smithi149.stdout:3/810: symlink d1/d48/ddb/l11a 0 2024-09-13T18:30:30.440 INFO:tasks.workunit.client.1.smithi149.stdout:1/864: truncate d9/d10/d3f/f7a 1422523 0 2024-09-13T18:30:30.443 INFO:tasks.workunit.client.0.smithi038.stdout:3/168: dwrite d0/dd/d19/d23/f2e [0,4194304] 0 2024-09-13T18:30:30.445 INFO:tasks.workunit.client.1.smithi149.stdout:1/865: mknod d9/d10/de4/c115 0 2024-09-13T18:30:30.445 INFO:tasks.workunit.client.1.smithi149.stdout:1/866: readlink d9/l17 0 2024-09-13T18:30:30.448 INFO:tasks.workunit.client.1.smithi149.stdout:5/809: unlink d3/d10/d4c/d4e/d61/l78 0 2024-09-13T18:30:30.448 INFO:tasks.workunit.client.0.smithi038.stdout:1/181: mknod d12/c38 0 2024-09-13T18:30:30.449 INFO:tasks.workunit.client.0.smithi038.stdout:3/169: rename d0/dd/d19/d1d/d29/d2b/l37 to d0/dd/d19/d1d/l39 0 2024-09-13T18:30:30.450 INFO:tasks.workunit.client.0.smithi038.stdout:3/170: chown d0/dd/c25 1 1 2024-09-13T18:30:30.453 INFO:tasks.workunit.client.0.smithi038.stdout:3/171: symlink d0/dd/l3a 0 2024-09-13T18:30:30.453 INFO:tasks.workunit.client.0.smithi038.stdout:3/172: write d0/dd/fe [1786124,39004] 0 2024-09-13T18:30:30.456 INFO:tasks.workunit.client.0.smithi038.stdout:3/173: creat d0/dd/d19/d1d/d29/f3b x:0 0 0 2024-09-13T18:30:30.458 INFO:tasks.workunit.client.0.smithi038.stdout:3/174: rename d0/dd/l3a to d0/dd/d19/d1d/d29/d2b/l3c 0 2024-09-13T18:30:30.462 INFO:tasks.workunit.client.0.smithi038.stdout:3/175: dread d0/dd/f1a [0,4194304] 0 2024-09-13T18:30:30.464 INFO:tasks.workunit.client.0.smithi038.stdout:3/176: write d0/f9 [4608778,27814] 0 2024-09-13T18:30:30.465 INFO:tasks.workunit.client.0.smithi038.stdout:3/177: truncate d0/f2 438386 0 2024-09-13T18:30:30.469 INFO:tasks.workunit.client.1.smithi149.stdout:3/811: dwrite d1/fec [0,4194304] 0 2024-09-13T18:30:30.469 INFO:tasks.workunit.client.1.smithi149.stdout:2/789: dwrite db/d10/f4e [0,4194304] 0 2024-09-13T18:30:30.469 INFO:tasks.workunit.client.1.smithi149.stdout:2/790: fsync f4 0 2024-09-13T18:30:30.469 INFO:tasks.workunit.client.0.smithi038.stdout:0/151: dwrite d2/d7/d24/d2b/f37 [0,4194304] 0 2024-09-13T18:30:30.469 INFO:tasks.workunit.client.0.smithi038.stdout:6/162: dwrite dd/de/d31/f3e [0,4194304] 0 2024-09-13T18:30:30.475 INFO:tasks.workunit.client.1.smithi149.stdout:3/812: mknod d1/d47/d30/c11b 0 2024-09-13T18:30:30.480 INFO:tasks.workunit.client.1.smithi149.stdout:2/791: creat db/d10/da9/ddb/f108 x:0 0 0 2024-09-13T18:30:30.480 INFO:tasks.workunit.client.1.smithi149.stdout:2/792: truncate db/d1b/d1c/d85/fde 5693758 0 2024-09-13T18:30:30.480 INFO:tasks.workunit.client.1.smithi149.stdout:2/793: readlink db/d1b/d1c/d20/d3a/lf9 0 2024-09-13T18:30:30.480 INFO:tasks.workunit.client.1.smithi149.stdout:2/794: chown db/d1b/d1c/d20/d2b/d3e/d95/cbb 114134 1 2024-09-13T18:30:30.484 INFO:tasks.workunit.client.1.smithi149.stdout:3/813: getdents d1/d2c/d38/d8d/de1 0 2024-09-13T18:30:30.484 INFO:tasks.workunit.client.1.smithi149.stdout:3/814: fdatasync d1/d2e/d1d/d6c/daa/dad/f104 0 2024-09-13T18:30:30.484 INFO:tasks.workunit.client.1.smithi149.stdout:3/815: creat d1/d47/d30/d5a/f11c x:0 0 0 2024-09-13T18:30:30.485 INFO:tasks.workunit.client.0.smithi038.stdout:5/152: getdents df/d13 0 2024-09-13T18:30:30.486 INFO:tasks.workunit.client.0.smithi038.stdout:5/153: dread fd [0,4194304] 0 2024-09-13T18:30:30.486 INFO:tasks.workunit.client.0.smithi038.stdout:3/178: dwrite d0/f2 [0,4194304] 0 2024-09-13T18:30:30.486 INFO:tasks.workunit.client.0.smithi038.stdout:3/179: write d0/f2 [4956771,15663] 0 2024-09-13T18:30:30.489 INFO:tasks.workunit.client.1.smithi149.stdout:3/816: creat d1/d2e/d1d/f11d x:0 0 0 2024-09-13T18:30:30.491 INFO:tasks.workunit.client.0.smithi038.stdout:0/152: dread d2/f5 [0,4194304] 0 2024-09-13T18:30:30.491 INFO:tasks.workunit.client.0.smithi038.stdout:0/153: dread - d2/d7/f31 zero size 2024-09-13T18:30:30.491 INFO:tasks.workunit.client.0.smithi038.stdout:0/154: fdatasync d2/dc/f28 0 2024-09-13T18:30:30.491 INFO:tasks.workunit.client.1.smithi149.stdout:3/817: symlink d1/d47/d30/d46/l11e 0 2024-09-13T18:30:30.495 INFO:tasks.workunit.client.1.smithi149.stdout:3/818: mknod d1/d47/d30/d46/c11f 0 2024-09-13T18:30:30.495 INFO:tasks.workunit.client.1.smithi149.stdout:3/819: truncate d1/d2e/d6f/f118 336310 0 2024-09-13T18:30:30.495 INFO:tasks.workunit.client.1.smithi149.stdout:3/820: write d1/d47/f92 [631679,23889] 0 2024-09-13T18:30:30.498 INFO:tasks.workunit.client.1.smithi149.stdout:9/719: rename d0/d2e/d42/d59/c6f to d0/d18/d27/ce3 0 2024-09-13T18:30:30.498 INFO:tasks.workunit.client.1.smithi149.stdout:9/720: fsync d0/f4e 0 2024-09-13T18:30:30.499 INFO:tasks.workunit.client.1.smithi149.stdout:3/821: mkdir d1/d2e/d6f/d120 0 2024-09-13T18:30:30.501 INFO:tasks.workunit.client.1.smithi149.stdout:4/910: rename df/f90 to df/da0/d12/d21/d22/f13e 0 2024-09-13T18:30:30.504 INFO:tasks.workunit.client.1.smithi149.stdout:4/911: creat df/da0/d12/d21/d22/d30/d41/d57/f13f x:0 0 0 2024-09-13T18:30:30.506 INFO:tasks.workunit.client.1.smithi149.stdout:0/883: creat d1/d48/d92/f134 x:0 0 0 2024-09-13T18:30:30.506 INFO:tasks.workunit.client.1.smithi149.stdout:4/912: symlink df/da0/d12/d7c/d9a/l140 0 2024-09-13T18:30:30.508 INFO:tasks.workunit.client.1.smithi149.stdout:0/884: unlink d1/d29/d31/d44/d81/d62/l130 0 2024-09-13T18:30:30.509 INFO:tasks.workunit.client.0.smithi038.stdout:6/163: dwrite dd/de/f1a [0,4194304] 0 2024-09-13T18:30:30.509 INFO:tasks.workunit.client.1.smithi149.stdout:2/795: dwrite db/d1b/d1c/d20/d2b/f65 [0,4194304] 0 2024-09-13T18:30:30.509 INFO:tasks.workunit.client.1.smithi149.stdout:4/913: creat df/da0/d12/d21/d22/d30/d41/d110/d11a/f141 x:0 0 0 2024-09-13T18:30:30.510 INFO:tasks.workunit.client.1.smithi149.stdout:0/885: symlink d1/d29/l135 0 2024-09-13T18:30:30.512 INFO:tasks.workunit.client.1.smithi149.stdout:3/822: dread d1/d2c/d38/d88/d96/fd8 [0,4194304] 0 2024-09-13T18:30:30.514 INFO:tasks.workunit.client.0.smithi038.stdout:0/155: read d2/f15 [113573,68129] 0 2024-09-13T18:30:30.515 INFO:tasks.workunit.client.1.smithi149.stdout:4/914: truncate df/f2b 1881493 0 2024-09-13T18:30:30.520 INFO:tasks.workunit.client.1.smithi149.stdout:9/721: dwrite d0/d2e/f43 [0,4194304] 0 2024-09-13T18:30:30.521 INFO:tasks.workunit.client.0.smithi038.stdout:6/164: symlink dd/de/d2e/d30/l3f 0 2024-09-13T18:30:30.522 INFO:tasks.workunit.client.0.smithi038.stdout:9/238: rmdir d0/d7/d13/d2d/d3c 39 2024-09-13T18:30:30.522 INFO:tasks.workunit.client.0.smithi038.stdout:9/239: dread - d0/d7/f45 zero size 2024-09-13T18:30:30.525 INFO:tasks.workunit.client.0.smithi038.stdout:6/165: link dd/de/d2e/d30/l2b dd/de/d2e/d30/l40 0 2024-09-13T18:30:30.527 INFO:tasks.workunit.client.0.smithi038.stdout:0/156: rename d2/dc/f17 to d2/dc/f39 0 2024-09-13T18:30:30.528 INFO:tasks.workunit.client.0.smithi038.stdout:6/166: truncate f9 1311275 0 2024-09-13T18:30:30.530 INFO:tasks.workunit.client.0.smithi038.stdout:9/240: dread d0/fb [0,4194304] 0 2024-09-13T18:30:30.530 INFO:tasks.workunit.client.0.smithi038.stdout:0/157: symlink d2/d7/l3a 0 2024-09-13T18:30:30.531 INFO:tasks.workunit.client.1.smithi149.stdout:9/722: dread d0/f38 [0,4194304] 0 2024-09-13T18:30:30.531 INFO:tasks.workunit.client.1.smithi149.stdout:9/723: creat d0/d2e/d42/d59/fe4 x:0 0 0 2024-09-13T18:30:30.531 INFO:tasks.workunit.client.1.smithi149.stdout:9/724: creat d0/d47/d61/fe5 x:0 0 0 2024-09-13T18:30:30.532 INFO:tasks.workunit.client.0.smithi038.stdout:6/167: unlink dd/de/f35 0 2024-09-13T18:30:30.533 INFO:tasks.workunit.client.1.smithi149.stdout:9/725: dread d0/d18/d27/d5c/d79/fbe [0,4194304] 0 2024-09-13T18:30:30.534 INFO:tasks.workunit.client.0.smithi038.stdout:0/158: symlink d2/d7/d24/d2b/l3b 0 2024-09-13T18:30:30.536 INFO:tasks.workunit.client.0.smithi038.stdout:6/168: stat l7 0 2024-09-13T18:30:30.536 INFO:tasks.workunit.client.0.smithi038.stdout:9/241: dread d0/d7/f31 [0,4194304] 0 2024-09-13T18:30:30.538 INFO:tasks.workunit.client.0.smithi038.stdout:0/159: unlink d2/d7/f27 0 2024-09-13T18:30:30.538 INFO:tasks.workunit.client.0.smithi038.stdout:4/329: getdents d2 0 2024-09-13T18:30:30.539 INFO:tasks.workunit.client.1.smithi149.stdout:9/726: truncate d0/d47/d54/f55 706830 0 2024-09-13T18:30:30.541 INFO:tasks.workunit.client.0.smithi038.stdout:6/169: link cc dd/de/d31/c41 0 2024-09-13T18:30:30.542 INFO:tasks.workunit.client.0.smithi038.stdout:9/242: mkdir d0/d7/d2c/d5a 0 2024-09-13T18:30:30.543 INFO:tasks.workunit.client.1.smithi149.stdout:0/886: symlink d1/d29/dad/l136 0 2024-09-13T18:30:30.543 INFO:tasks.workunit.client.1.smithi149.stdout:9/727: stat d0/d9e/l36 0 2024-09-13T18:30:30.548 INFO:tasks.workunit.client.1.smithi149.stdout:0/887: mkdir d1/d29/d31/d3e/d137 0 2024-09-13T18:30:30.548 INFO:tasks.workunit.client.1.smithi149.stdout:0/888: read - d1/d29/d31/d44/f99 zero size 2024-09-13T18:30:30.548 INFO:tasks.workunit.client.1.smithi149.stdout:0/889: write d1/f27 [1859855,37730] 0 2024-09-13T18:30:30.549 INFO:tasks.workunit.client.0.smithi038.stdout:6/170: rename dd/f2a to dd/de/d2e/d30/f42 0 2024-09-13T18:30:30.550 INFO:tasks.workunit.client.1.smithi149.stdout:9/728: truncate d0/d9e/f24 5150219 0 2024-09-13T18:30:30.551 INFO:tasks.workunit.client.1.smithi149.stdout:9/729: truncate d0/d9e/f80 5120989 0 2024-09-13T18:30:30.551 INFO:tasks.workunit.client.1.smithi149.stdout:9/730: creat d0/d18/d27/d5c/d79/fe6 x:0 0 0 2024-09-13T18:30:30.551 INFO:tasks.workunit.client.1.smithi149.stdout:0/890: mknod d1/d2/d8a/c138 0 2024-09-13T18:30:30.552 INFO:tasks.workunit.client.0.smithi038.stdout:9/243: rename d0/d7/d13/d30/f55 to d0/d7/d13/d2d/d3c/f5b 0 2024-09-13T18:30:30.553 INFO:tasks.workunit.client.1.smithi149.stdout:0/891: write d1/d2/d41/d46/d7b/fbc [205587,92932] 0 2024-09-13T18:30:30.554 INFO:tasks.workunit.client.0.smithi038.stdout:6/171: creat dd/de/d2e/d30/d27/f43 x:0 0 0 2024-09-13T18:30:30.555 INFO:tasks.workunit.client.0.smithi038.stdout:6/172: fsync dd/de/d2e/d30/f22 0 2024-09-13T18:30:30.555 INFO:tasks.workunit.client.0.smithi038.stdout:6/173: creat dd/f44 x:0 0 0 2024-09-13T18:30:30.556 INFO:tasks.workunit.client.0.smithi038.stdout:9/244: symlink d0/d2e/l5c 0 2024-09-13T18:30:30.556 INFO:tasks.workunit.client.0.smithi038.stdout:9/245: stat d0/f8 0 2024-09-13T18:30:30.557 INFO:tasks.workunit.client.0.smithi038.stdout:9/246: write d0/d7/d13/d2d/d3c/f3f [990742,30282] 0 2024-09-13T18:30:30.558 INFO:tasks.workunit.client.0.smithi038.stdout:6/174: mknod dd/de/d2e/c45 0 2024-09-13T18:30:30.564 INFO:tasks.workunit.client.1.smithi149.stdout:2/796: fsync db/d1b/d1c/d20/d2b/d3e/d95/fd5 0 2024-09-13T18:30:30.567 INFO:tasks.workunit.client.1.smithi149.stdout:9/731: dread d0/f67 [0,4194304] 0 2024-09-13T18:30:30.567 INFO:tasks.workunit.client.0.smithi038.stdout:4/330: dwrite d2/df/d22/dc/d8/f2e [0,4194304] 0 2024-09-13T18:30:30.570 INFO:tasks.workunit.client.0.smithi038.stdout:4/331: mknod d2/d49/d4b/c6a 0 2024-09-13T18:30:30.571 INFO:tasks.workunit.client.1.smithi149.stdout:9/732: symlink d0/d2e/d42/d59/le7 0 2024-09-13T18:30:30.571 INFO:tasks.workunit.client.1.smithi149.stdout:9/733: read d0/d18/f41 [2788193,1986] 0 2024-09-13T18:30:30.574 INFO:tasks.workunit.client.0.smithi038.stdout:4/332: truncate d2/df/d22/dc/d8/f23 5856871 0 2024-09-13T18:30:30.576 INFO:tasks.workunit.client.0.smithi038.stdout:1/182: rmdir d12/d2a/d32 39 2024-09-13T18:30:30.581 INFO:tasks.workunit.client.0.smithi038.stdout:1/183: dread f3 [0,4194304] 0 2024-09-13T18:30:30.582 INFO:tasks.workunit.client.1.smithi149.stdout:9/734: dread d0/f38 [0,4194304] 0 2024-09-13T18:30:30.584 INFO:tasks.workunit.client.1.smithi149.stdout:9/735: link d0/d9e/c52 d0/d2e/d42/d70/d84/dae/ce8 0 2024-09-13T18:30:30.584 INFO:tasks.workunit.client.1.smithi149.stdout:9/736: chown d0/d18/ca5 23199442 1 2024-09-13T18:30:30.591 INFO:tasks.workunit.client.0.smithi038.stdout:0/160: dwrite d2/d2f/f30 [0,4194304] 0 2024-09-13T18:30:30.591 INFO:tasks.workunit.client.0.smithi038.stdout:4/333: dread d2/df/d22/dc/d8/f27 [0,4194304] 0 2024-09-13T18:30:30.591 INFO:tasks.workunit.client.0.smithi038.stdout:0/161: dread - d2/f1c zero size 2024-09-13T18:30:30.594 INFO:tasks.workunit.client.1.smithi149.stdout:0/892: dwrite d1/d29/d31/d44/d81/f97 [0,4194304] 0 2024-09-13T18:30:30.594 INFO:tasks.workunit.client.1.smithi149.stdout:0/893: chown d1/l74 0 1 2024-09-13T18:30:30.595 INFO:tasks.workunit.client.1.smithi149.stdout:0/894: creat d1/d29/d31/d44/d47/f139 x:0 0 0 2024-09-13T18:30:30.595 INFO:tasks.workunit.client.1.smithi149.stdout:0/895: chown d1/d48/d92/lab 807388 1 2024-09-13T18:30:30.595 INFO:tasks.workunit.client.1.smithi149.stdout:0/896: fsync d1/d29/d31/d44/d81/f75 0 2024-09-13T18:30:30.595 INFO:tasks.workunit.client.0.smithi038.stdout:9/247: dwrite d0/d7/f31 [0,4194304] 0 2024-09-13T18:30:30.595 INFO:tasks.workunit.client.1.smithi149.stdout:1/867: rename d9/fce to d9/d15/d60/d80/f116 0 2024-09-13T18:30:30.600 INFO:tasks.workunit.client.1.smithi149.stdout:5/810: rename d3/d8/d6d/d91/f9c to d3/d10/d98/dfb/d54/d76/d7a/ffd 0 2024-09-13T18:30:30.602 INFO:tasks.workunit.client.1.smithi149.stdout:4/915: rename df/da0/d12/d21/d22/d30/d41/d57/d75/d104 to df/da0/d12/d21/d22/d142 0 2024-09-13T18:30:30.605 INFO:tasks.workunit.client.0.smithi038.stdout:9/248: dread d0/d7/d13/d2d/d3c/f3f [0,4194304] 0 2024-09-13T18:30:30.605 INFO:tasks.workunit.client.1.smithi149.stdout:2/797: rename db/d1b/d2f/d69/l7f to db/d1b/d1c/d85/l109 0 2024-09-13T18:30:30.605 INFO:tasks.workunit.client.1.smithi149.stdout:2/798: chown f6 69048761 1 2024-09-13T18:30:30.605 INFO:tasks.workunit.client.1.smithi149.stdout:2/799: dread - db/d10/da9/fb0 zero size 2024-09-13T18:30:30.606 INFO:tasks.workunit.client.1.smithi149.stdout:0/897: dread d1/f10 [0,4194304] 0 2024-09-13T18:30:30.606 INFO:tasks.workunit.client.1.smithi149.stdout:0/898: fdatasync d1/d48/d92/db4/dbe/ffc 0 2024-09-13T18:30:30.606 INFO:tasks.workunit.client.1.smithi149.stdout:0/899: creat d1/d2/d41/d46/d7b/d98/f13a x:0 0 0 2024-09-13T18:30:30.607 INFO:tasks.workunit.client.1.smithi149.stdout:5/811: dread d3/d10/d98/dfb/d67/d83/fd1 [0,4194304] 0 2024-09-13T18:30:30.607 INFO:tasks.workunit.client.1.smithi149.stdout:4/916: link df/da0/f61 df/da0/d12/d7c/d122/f143 0 2024-09-13T18:30:30.612 INFO:tasks.workunit.client.0.smithi038.stdout:1/184: dwrite d12/f23 [0,4194304] 0 2024-09-13T18:30:30.614 INFO:tasks.workunit.client.0.smithi038.stdout:3/180: truncate d0/dd/d19/d1d/d29/d32/f35 3336615 0 2024-09-13T18:30:30.614 INFO:tasks.workunit.client.0.smithi038.stdout:9/249: dread d0/f1 [0,4194304] 0 2024-09-13T18:30:30.615 INFO:tasks.workunit.client.0.smithi038.stdout:9/250: chown d0/d7/f35 64 1 2024-09-13T18:30:30.615 INFO:tasks.workunit.client.0.smithi038.stdout:9/251: dread - d0/d7/d13/f58 zero size 2024-09-13T18:30:30.615 INFO:tasks.workunit.client.0.smithi038.stdout:4/334: dwrite d2/df/d1b/f51 [0,4194304] 0 2024-09-13T18:30:30.615 INFO:tasks.workunit.client.0.smithi038.stdout:4/335: write d2/df/d22/dc/d8/f27 [4582206,24012] 0 2024-09-13T18:30:30.616 INFO:tasks.workunit.client.1.smithi149.stdout:0/900: mknod d1/d29/d31/d44/d81/d62/d102/c13b 0 2024-09-13T18:30:30.616 INFO:tasks.workunit.client.1.smithi149.stdout:0/901: fdatasync d1/f11e 0 2024-09-13T18:30:30.617 INFO:tasks.workunit.client.0.smithi038.stdout:1/185: dread d12/f16 [0,4194304] 0 2024-09-13T18:30:30.619 INFO:tasks.workunit.client.1.smithi149.stdout:9/737: getdents d0/d18/d27 0 2024-09-13T18:30:30.624 INFO:tasks.workunit.client.1.smithi149.stdout:4/917: link df/da0/d12/d21/d22/d30/d41/d57/cab df/da0/d1c/c144 0 2024-09-13T18:30:30.624 INFO:tasks.workunit.client.1.smithi149.stdout:4/918: creat df/da0/d12/d21/d22/d30/d41/d110/d11a/f145 x:0 0 0 2024-09-13T18:30:30.624 INFO:tasks.workunit.client.1.smithi149.stdout:4/919: truncate df/da0/d12/d21/d22/d30/d41/d57/d8a/f126 651035 0 2024-09-13T18:30:30.624 INFO:tasks.workunit.client.1.smithi149.stdout:4/920: chown df/da0/d12/d21/d22/d30/d41/d57/d60/cc5 1572 1 2024-09-13T18:30:30.624 INFO:tasks.workunit.client.1.smithi149.stdout:4/921: chown df/da0/d70/db5/dc7/f103 87 1 2024-09-13T18:30:30.626 INFO:tasks.workunit.client.0.smithi038.stdout:9/252: dread d0/f2f [0,4194304] 0 2024-09-13T18:30:30.627 INFO:tasks.workunit.client.0.smithi038.stdout:9/253: creat d0/d7/d13/f5d x:0 0 0 2024-09-13T18:30:30.630 INFO:tasks.workunit.client.0.smithi038.stdout:4/336: symlink d2/d49/d4b/d66/l6b 0 2024-09-13T18:30:30.630 INFO:tasks.workunit.client.0.smithi038.stdout:4/337: write d2/df/d1b/d10/f5f [652519,68856] 0 2024-09-13T18:30:30.632 INFO:tasks.workunit.client.0.smithi038.stdout:1/186: getdents d12/d15 0 2024-09-13T18:30:30.633 INFO:tasks.workunit.client.1.smithi149.stdout:3/823: creat d1/d48/f121 x:0 0 0 2024-09-13T18:30:30.633 INFO:tasks.workunit.client.1.smithi149.stdout:9/738: dread d0/d2e/d42/d59/d86/fa4 [0,4194304] 0 2024-09-13T18:30:30.634 INFO:tasks.workunit.client.1.smithi149.stdout:8/882: sync 2024-09-13T18:30:30.634 INFO:tasks.workunit.client.1.smithi149.stdout:6/977: sync 2024-09-13T18:30:30.634 INFO:tasks.workunit.client.1.smithi149.stdout:7/922: sync 2024-09-13T18:30:30.635 INFO:tasks.workunit.client.0.smithi038.stdout:3/181: dwrite d0/dd/d17/f1c [0,4194304] 0 2024-09-13T18:30:30.635 INFO:tasks.workunit.client.0.smithi038.stdout:3/182: chown d0/f4 30343 1 2024-09-13T18:30:30.637 INFO:tasks.workunit.client.1.smithi149.stdout:0/902: symlink d1/d29/d31/d44/d81/d9f/l13c 0 2024-09-13T18:30:30.646 INFO:tasks.workunit.client.1.smithi149.stdout:9/739: dread d0/d9e/f56 [4194304,4194304] 0 2024-09-13T18:30:30.648 INFO:tasks.workunit.client.0.smithi038.stdout:1/187: rename f11 to d12/f39 0 2024-09-13T18:30:30.649 INFO:tasks.workunit.client.1.smithi149.stdout:4/922: mkdir df/da0/d112/d3d/d146 0 2024-09-13T18:30:30.649 INFO:tasks.workunit.client.1.smithi149.stdout:4/923: readlink df/l28 0 2024-09-13T18:30:30.650 INFO:tasks.workunit.client.1.smithi149.stdout:3/824: mkdir d1/d2e/d93/d122 0 2024-09-13T18:30:30.652 INFO:tasks.workunit.client.1.smithi149.stdout:8/883: mknod d2/d12/d87/df1/c128 0 2024-09-13T18:30:30.652 INFO:tasks.workunit.client.1.smithi149.stdout:7/923: write d7/d9/f46 [5341032,85770] 0 2024-09-13T18:30:30.652 INFO:tasks.workunit.client.1.smithi149.stdout:7/924: write d7/d12/f125 [964731,47991] 0 2024-09-13T18:30:30.653 INFO:tasks.workunit.client.0.smithi038.stdout:3/183: getdents d0/dd/d19/d1d/d29 0 2024-09-13T18:30:30.657 INFO:tasks.workunit.client.1.smithi149.stdout:9/740: rename d0/d47/d54/lcf to d0/d18/d27/d5c/d99/le9 0 2024-09-13T18:30:30.657 INFO:tasks.workunit.client.1.smithi149.stdout:9/741: write d0/d18/d93/fb6 [1501927,105954] 0 2024-09-13T18:30:30.659 INFO:tasks.workunit.client.1.smithi149.stdout:4/924: mknod df/da0/d12/d21/d22/d30/d56/c147 0 2024-09-13T18:30:30.659 INFO:tasks.workunit.client.1.smithi149.stdout:4/925: creat df/da0/d70/db5/dc7/f148 x:0 0 0 2024-09-13T18:30:30.659 INFO:tasks.workunit.client.1.smithi149.stdout:4/926: dread - df/da0/d12/d7c/d9a/fd5 zero size 2024-09-13T18:30:30.659 INFO:tasks.workunit.client.0.smithi038.stdout:1/188: mknod d12/d2a/d32/c3a 0 2024-09-13T18:30:30.659 INFO:tasks.workunit.client.0.smithi038.stdout:1/189: read d12/f1a [824232,108532] 0 2024-09-13T18:30:30.664 INFO:tasks.workunit.client.0.smithi038.stdout:3/184: link d0/dd/c15 d0/dd/d19/d1d/c3d 0 2024-09-13T18:30:30.667 INFO:tasks.workunit.client.1.smithi149.stdout:4/927: truncate df/da0/d112/faf 2731617 0 2024-09-13T18:30:30.672 INFO:tasks.workunit.client.0.smithi038.stdout:4/338: dwrite d2/df/d22/dc/f18 [0,4194304] 0 2024-09-13T18:30:30.677 INFO:tasks.workunit.client.1.smithi149.stdout:0/903: dwrite d1/d29/d31/d44/d81/d62/fea [0,4194304] 0 2024-09-13T18:30:30.677 INFO:tasks.workunit.client.1.smithi149.stdout:0/904: dread - d1/d48/f64 zero size 2024-09-13T18:30:30.677 INFO:tasks.workunit.client.1.smithi149.stdout:0/905: dread - d1/d2/d8a/d90/fff zero size 2024-09-13T18:30:30.679 INFO:tasks.workunit.client.0.smithi038.stdout:4/339: link d2/f56 d2/df/d22/dc/d8/f6c 0 2024-09-13T18:30:30.679 INFO:tasks.workunit.client.0.smithi038.stdout:4/340: fdatasync d2/df/d22/dc/d8/f27 0 2024-09-13T18:30:30.680 INFO:tasks.workunit.client.1.smithi149.stdout:4/928: dread df/da0/f78 [0,4194304] 0 2024-09-13T18:30:30.682 INFO:tasks.workunit.client.0.smithi038.stdout:4/341: symlink d2/d49/d4b/l6d 0 2024-09-13T18:30:30.682 INFO:tasks.workunit.client.0.smithi038.stdout:4/342: chown d2/f56 9691 1 2024-09-13T18:30:30.685 INFO:tasks.workunit.client.1.smithi149.stdout:3/825: dwrite d1/d47/d30/f3c [0,4194304] 0 2024-09-13T18:30:30.686 INFO:tasks.workunit.client.1.smithi149.stdout:7/925: dwrite d7/d9/d11/de2/f124 [0,4194304] 0 2024-09-13T18:30:30.687 INFO:tasks.workunit.client.0.smithi038.stdout:4/343: mknod d2/df/d22/c6e 0 2024-09-13T18:30:30.690 INFO:tasks.workunit.client.1.smithi149.stdout:9/742: dwrite d0/d2e/d42/d70/f7d [0,4194304] 0 2024-09-13T18:30:30.690 INFO:tasks.workunit.client.1.smithi149.stdout:4/929: mknod df/da0/dcc/c149 0 2024-09-13T18:30:30.690 INFO:tasks.workunit.client.1.smithi149.stdout:4/930: write df/da0/d112/d3d/f6c [6146667,2962] 0 2024-09-13T18:30:30.693 INFO:tasks.workunit.client.0.smithi038.stdout:4/344: symlink d2/d49/d4b/d66/l6f 0 2024-09-13T18:30:30.697 INFO:tasks.workunit.client.0.smithi038.stdout:4/345: creat d2/df/d22/f70 x:0 0 0 2024-09-13T18:30:30.699 INFO:tasks.workunit.client.1.smithi149.stdout:7/926: getdents d7/d9/d11/d50/dde 0 2024-09-13T18:30:30.699 INFO:tasks.workunit.client.1.smithi149.stdout:7/927: creat d7/d9/d1c/d1f/d21/d49/d102/f144 x:0 0 0 2024-09-13T18:30:30.699 INFO:tasks.workunit.client.0.smithi038.stdout:4/346: dread d2/df/d1b/fd [0,4194304] 0 2024-09-13T18:30:30.700 INFO:tasks.workunit.client.0.smithi038.stdout:4/347: stat d2/df/d22/dc/d8/d3b/l5e 0 2024-09-13T18:30:30.701 INFO:tasks.workunit.client.1.smithi149.stdout:0/906: dwrite d1/d48/f64 [0,4194304] 0 2024-09-13T18:30:30.701 INFO:tasks.workunit.client.1.smithi149.stdout:0/907: dread - d1/d29/d31/ff8 zero size 2024-09-13T18:30:30.703 INFO:tasks.workunit.client.1.smithi149.stdout:4/931: unlink df/da0/d12/d21/l6b 0 2024-09-13T18:30:30.707 INFO:tasks.workunit.client.1.smithi149.stdout:7/928: symlink d7/d9/d1b/d71/ddc/l145 0 2024-09-13T18:30:30.708 INFO:tasks.workunit.client.1.smithi149.stdout:2/800: write db/d13/d70/dad/fbc [962979,103785] 0 2024-09-13T18:30:30.709 INFO:tasks.workunit.client.1.smithi149.stdout:9/743: rmdir d0/d2e/d42/d70/d84/dae 39 2024-09-13T18:30:30.709 INFO:tasks.workunit.client.1.smithi149.stdout:9/744: fsync d0/d47/f65 0 2024-09-13T18:30:30.714 INFO:tasks.workunit.client.1.smithi149.stdout:9/745: getdents d0/d18/d68 0 2024-09-13T18:30:30.716 INFO:tasks.workunit.client.1.smithi149.stdout:9/746: mkdir d0/d2e/d42/d70/d84/dea 0 2024-09-13T18:30:30.716 INFO:tasks.workunit.client.0.smithi038.stdout:1/190: truncate d12/f23 1438549 0 2024-09-13T18:30:30.717 INFO:tasks.workunit.client.0.smithi038.stdout:1/191: dread - d12/d2a/d32/f34 zero size 2024-09-13T18:30:30.721 INFO:tasks.workunit.client.1.smithi149.stdout:4/932: dread df/da0/d112/d3d/f5d [0,4194304] 0 2024-09-13T18:30:30.721 INFO:tasks.workunit.client.1.smithi149.stdout:4/933: fdatasync df/da0/d1c/d7e/ddd/fe5 0 2024-09-13T18:30:30.722 INFO:tasks.workunit.client.1.smithi149.stdout:0/908: dwrite d1/d29/d31/d3e/f115 [0,4194304] 0 2024-09-13T18:30:30.723 INFO:tasks.workunit.client.1.smithi149.stdout:0/909: chown d1/d2/d41/df3 30 1 2024-09-13T18:30:30.723 INFO:tasks.workunit.client.1.smithi149.stdout:0/910: stat d1/d29/dad/l136 0 2024-09-13T18:30:30.723 INFO:tasks.workunit.client.1.smithi149.stdout:5/812: write d3/d10/f5d [26573,125467] 0 2024-09-13T18:30:30.723 INFO:tasks.workunit.client.1.smithi149.stdout:3/826: dwrite d1/d2e/d1d/f6b [0,4194304] 0 2024-09-13T18:30:30.724 INFO:tasks.workunit.client.1.smithi149.stdout:3/827: truncate d1/d12/db9/fbc 157433 0 2024-09-13T18:30:30.724 INFO:tasks.workunit.client.1.smithi149.stdout:2/801: dread db/d1b/d2f/d69/f5c [0,4194304] 0 2024-09-13T18:30:30.728 INFO:tasks.workunit.client.1.smithi149.stdout:0/911: mkdir d1/d29/d31/d44/d81/d62/d102/d13d 0 2024-09-13T18:30:30.736 INFO:tasks.workunit.client.1.smithi149.stdout:5/813: write d3/d8/d6d/ff2 [3016235,112964] 0 2024-09-13T18:30:30.736 INFO:tasks.workunit.client.1.smithi149.stdout:5/814: chown d3/d10/d98/dfb/d54/db9 1290638 1 2024-09-13T18:30:30.737 INFO:tasks.workunit.client.0.smithi038.stdout:3/185: rmdir d0/dd 39 2024-09-13T18:30:30.738 INFO:tasks.workunit.client.1.smithi149.stdout:3/828: rename d1/d47/f26 to d1/d48/d75/f123 0 2024-09-13T18:30:30.739 INFO:tasks.workunit.client.1.smithi149.stdout:2/802: mkdir db/d100/d10a 0 2024-09-13T18:30:30.740 INFO:tasks.workunit.client.1.smithi149.stdout:0/912: rmdir d1/d48 39 2024-09-13T18:30:30.741 INFO:tasks.workunit.client.1.smithi149.stdout:5/815: getdents d3/d10/d98/dfb/d54/d97/de7 0 2024-09-13T18:30:30.744 INFO:tasks.workunit.client.1.smithi149.stdout:3/829: mkdir d1/d2c/d38/d88/d124 0 2024-09-13T18:30:30.744 INFO:tasks.workunit.client.1.smithi149.stdout:3/830: dread - d1/d48/d75/fdd zero size 2024-09-13T18:30:30.744 INFO:tasks.workunit.client.1.smithi149.stdout:7/929: dwrite d7/d9/d1c/d1f/f73 [0,4194304] 0 2024-09-13T18:30:30.745 INFO:tasks.workunit.client.1.smithi149.stdout:0/913: mknod d1/d2/d41/df3/c13e 0 2024-09-13T18:30:30.747 INFO:tasks.workunit.client.1.smithi149.stdout:3/831: rename d1/d2c/d38/d8d/fe3 to d1/d12/f125 0 2024-09-13T18:30:30.747 INFO:tasks.workunit.client.1.smithi149.stdout:3/832: dread - d1/d2e/d1d/d6c/daa/dfb/d113/f115 zero size 2024-09-13T18:30:30.747 INFO:tasks.workunit.client.1.smithi149.stdout:7/930: mkdir d7/d137/d146 0 2024-09-13T18:30:30.748 INFO:tasks.workunit.client.1.smithi149.stdout:0/914: mkdir d1/d2/d8a/da9/dd7/dfe/d13f 0 2024-09-13T18:30:30.748 INFO:tasks.workunit.client.1.smithi149.stdout:0/915: write d1/d29/fee [1370205,64536] 0 2024-09-13T18:30:30.752 INFO:tasks.workunit.client.1.smithi149.stdout:2/803: read db/d1b/d1c/f5b [3262885,130929] 0 2024-09-13T18:30:30.752 INFO:tasks.workunit.client.1.smithi149.stdout:4/934: dwrite df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fd1 [0,4194304] 0 2024-09-13T18:30:30.752 INFO:tasks.workunit.client.1.smithi149.stdout:4/935: fsync df/da0/d112/f3a 0 2024-09-13T18:30:30.752 INFO:tasks.workunit.client.1.smithi149.stdout:5/816: write d3/d10/d98/dfb/f3c [1636436,99143] 0 2024-09-13T18:30:30.752 INFO:tasks.workunit.client.1.smithi149.stdout:3/833: link d1/d2c/d38/d8d/fbb d1/d2e/d1d/d9a/dfa/f126 0 2024-09-13T18:30:30.752 INFO:tasks.workunit.client.1.smithi149.stdout:3/834: write d1/d47/d30/f71 [5023501,125285] 0 2024-09-13T18:30:30.753 INFO:tasks.workunit.client.0.smithi038.stdout:4/348: rename d2/d49/d4b/d66 to d2/df/d1b/d10/d71 0 2024-09-13T18:30:30.753 INFO:tasks.workunit.client.0.smithi038.stdout:4/349: stat d2/df/d1b/d10/f5f 0 2024-09-13T18:30:30.754 INFO:tasks.workunit.client.1.smithi149.stdout:7/931: creat d7/d9/d1c/d51/d52/f147 x:0 0 0 2024-09-13T18:30:30.755 INFO:tasks.workunit.client.1.smithi149.stdout:0/916: mknod d1/d29/d31/d44/d47/c140 0 2024-09-13T18:30:30.755 INFO:tasks.workunit.client.1.smithi149.stdout:0/917: read d1/fdd [1580,15291] 0 2024-09-13T18:30:30.757 INFO:tasks.workunit.client.0.smithi038.stdout:1/192: rename d12/c1f to d12/d15/c3b 0 2024-09-13T18:30:30.757 INFO:tasks.workunit.client.0.smithi038.stdout:1/193: write f3 [72147,116549] 0 2024-09-13T18:30:30.757 INFO:tasks.workunit.client.0.smithi038.stdout:1/194: write fe [945409,61413] 0 2024-09-13T18:30:30.757 INFO:tasks.workunit.client.0.smithi038.stdout:1/195: chown f10 499805 1 2024-09-13T18:30:30.757 INFO:tasks.workunit.client.0.smithi038.stdout:1/196: readlink d12/l28 0 2024-09-13T18:30:30.758 INFO:tasks.workunit.client.1.smithi149.stdout:3/835: dread d1/d2e/d1d/f2b [0,4194304] 0 2024-09-13T18:30:30.761 INFO:tasks.workunit.client.0.smithi038.stdout:3/186: rename d0/dd/d19/d1d/d29/d2b/l34 to d0/dd/d19/d1d/d30/l3e 0 2024-09-13T18:30:30.761 INFO:tasks.workunit.client.0.smithi038.stdout:3/187: write d0/dd/d19/d1d/d29/f3b [1038020,112018] 0 2024-09-13T18:30:30.764 INFO:tasks.workunit.client.0.smithi038.stdout:1/197: getdents d12/d2a/d32 0 2024-09-13T18:30:30.764 INFO:tasks.workunit.client.0.smithi038.stdout:1/198: write d12/d2a/d32/f36 [572507,87088] 0 2024-09-13T18:30:30.767 INFO:tasks.workunit.client.1.smithi149.stdout:0/918: write d1/d48/d92/db4/dbe/fe0 [770713,76405] 0 2024-09-13T18:30:30.767 INFO:tasks.workunit.client.1.smithi149.stdout:0/919: fdatasync d1/d48/d92/db4/dbe/ffc 0 2024-09-13T18:30:30.767 INFO:tasks.workunit.client.1.smithi149.stdout:0/920: write d1/d2/d41/d46/fcb [960178,1141] 0 2024-09-13T18:30:30.767 INFO:tasks.workunit.client.1.smithi149.stdout:0/921: write d1/d2/fe4 [898157,44774] 0 2024-09-13T18:30:30.771 INFO:tasks.workunit.client.1.smithi149.stdout:4/936: symlink df/da0/d112/l14a 0 2024-09-13T18:30:30.771 INFO:tasks.workunit.client.1.smithi149.stdout:4/937: write df/da0/d1c/d7e/d9f/fde [865565,57311] 0 2024-09-13T18:30:30.773 INFO:tasks.workunit.client.1.smithi149.stdout:5/817: mknod d3/d10/d98/dfb/d54/d76/cfe 0 2024-09-13T18:30:30.775 INFO:tasks.workunit.client.0.smithi038.stdout:1/199: mkdir d12/d3c 0 2024-09-13T18:30:30.775 INFO:tasks.workunit.client.0.smithi038.stdout:1/200: write d12/d15/f22 [206568,18631] 0 2024-09-13T18:30:30.775 INFO:tasks.workunit.client.0.smithi038.stdout:1/201: truncate d12/f1a 4731085 0 2024-09-13T18:30:30.776 INFO:tasks.workunit.client.1.smithi149.stdout:7/932: getdents d7/d9/d11/d50 0 2024-09-13T18:30:30.777 INFO:tasks.workunit.client.0.smithi038.stdout:1/202: read fe [875136,8744] 0 2024-09-13T18:30:30.778 INFO:tasks.workunit.client.1.smithi149.stdout:3/836: mkdir d1/d2c/d38/d127 0 2024-09-13T18:30:30.778 INFO:tasks.workunit.client.1.smithi149.stdout:3/837: chown d1/d48/d75/c112 4946 1 2024-09-13T18:30:30.778 INFO:tasks.workunit.client.1.smithi149.stdout:3/838: write d1/d2c/d38/d88/d96/fd7 [4533447,47938] 0 2024-09-13T18:30:30.778 INFO:tasks.workunit.client.1.smithi149.stdout:3/839: stat d1/d2c/d42/fc0 0 2024-09-13T18:30:30.778 INFO:tasks.workunit.client.1.smithi149.stdout:3/840: dread - d1/d2c/d42/ff3 zero size 2024-09-13T18:30:30.779 INFO:tasks.workunit.client.0.smithi038.stdout:4/350: dwrite d2/f33 [0,4194304] 0 2024-09-13T18:30:30.780 INFO:tasks.workunit.client.1.smithi149.stdout:2/804: dwrite db/d13/d70/d89/fa2 [0,4194304] 0 2024-09-13T18:30:30.780 INFO:tasks.workunit.client.0.smithi038.stdout:4/351: read d2/df/d1b/f2b [727581,106513] 0 2024-09-13T18:30:30.782 INFO:tasks.workunit.client.1.smithi149.stdout:5/818: creat d3/d10/d98/dfb/fff x:0 0 0 2024-09-13T18:30:30.784 INFO:tasks.workunit.client.1.smithi149.stdout:7/933: rename d7/d9/d1b/c3b to d7/d9/d1c/d51/daf/c148 0 2024-09-13T18:30:30.793 INFO:tasks.workunit.client.1.smithi149.stdout:4/938: dwrite df/da0/d12/d7c/f11e [0,4194304] 0 2024-09-13T18:30:30.793 INFO:tasks.workunit.client.1.smithi149.stdout:4/939: read fc [3290339,125532] 0 2024-09-13T18:30:30.793 INFO:tasks.workunit.client.1.smithi149.stdout:4/940: fdatasync df/da0/d112/d3d/fd4 0 2024-09-13T18:30:30.795 INFO:tasks.workunit.client.1.smithi149.stdout:2/805: unlink f6 0 2024-09-13T18:30:30.796 INFO:tasks.workunit.client.1.smithi149.stdout:0/922: dwrite d1/d2/d8a/fd0 [0,4194304] 0 2024-09-13T18:30:30.799 INFO:tasks.workunit.client.1.smithi149.stdout:3/841: rename d1/d12/f1a to d1/d47/d97/d9b/f128 0 2024-09-13T18:30:30.805 INFO:tasks.workunit.client.1.smithi149.stdout:2/806: creat db/d1b/d1c/d85/f10b x:0 0 0 2024-09-13T18:30:30.805 INFO:tasks.workunit.client.1.smithi149.stdout:2/807: readlink db/d1b/d6c/lf2 0 2024-09-13T18:30:30.809 INFO:tasks.workunit.client.1.smithi149.stdout:3/842: creat d1/d2e/d1d/d6c/daa/dfb/f129 x:0 0 0 2024-09-13T18:30:30.810 INFO:tasks.workunit.client.1.smithi149.stdout:7/934: dwrite d7/d9/f72 [0,4194304] 0 2024-09-13T18:30:30.810 INFO:tasks.workunit.client.1.smithi149.stdout:2/808: mkdir db/d1b/d6c/d10c 0 2024-09-13T18:30:30.813 INFO:tasks.workunit.client.1.smithi149.stdout:2/809: read db/d1b/d2f/d30/fc0 [54971,59229] 0 2024-09-13T18:30:30.813 INFO:tasks.workunit.client.1.smithi149.stdout:2/810: dread - db/d13/d70/dad/ff1 zero size 2024-09-13T18:30:30.813 INFO:tasks.workunit.client.1.smithi149.stdout:2/811: creat db/d10/f10d x:0 0 0 2024-09-13T18:30:30.813 INFO:tasks.workunit.client.1.smithi149.stdout:5/819: read d3/f20 [1823600,52710] 0 2024-09-13T18:30:30.814 INFO:tasks.workunit.client.1.smithi149.stdout:7/935: rmdir d7/d9/d11/d50/dde/df7 39 2024-09-13T18:30:30.814 INFO:tasks.workunit.client.0.smithi038.stdout:4/352: dwrite d2/df/d22/dc/d8/f2e [0,4194304] 0 2024-09-13T18:30:30.817 INFO:tasks.workunit.client.1.smithi149.stdout:2/812: mknod db/d1b/d1c/d20/d3a/c10e 0 2024-09-13T18:30:30.819 INFO:tasks.workunit.client.1.smithi149.stdout:5/820: creat d3/d10/d98/dfb/d54/dbd/f100 x:0 0 0 2024-09-13T18:30:30.821 INFO:tasks.workunit.client.0.smithi038.stdout:3/188: link d0/dd/d19/d1d/d30/l3e d0/dd/d19/d23/l3f 0 2024-09-13T18:30:30.821 INFO:tasks.workunit.client.0.smithi038.stdout:3/189: chown d0/f2 429 1 2024-09-13T18:30:30.823 INFO:tasks.workunit.client.1.smithi149.stdout:2/813: mkdir db/d1b/d2f/d69/deb/d10f 0 2024-09-13T18:30:30.823 INFO:tasks.workunit.client.1.smithi149.stdout:2/814: chown db/d1b/d1c/d20/d3a/fe8 214535 1 2024-09-13T18:30:30.823 INFO:tasks.workunit.client.1.smithi149.stdout:2/815: chown db/d1b/d1c/d20/d3a/d75/cfd 929492432 1 2024-09-13T18:30:30.825 INFO:tasks.workunit.client.1.smithi149.stdout:1/868: sync 2024-09-13T18:30:30.825 INFO:tasks.workunit.client.1.smithi149.stdout:1/869: fsync d9/d10/fbc 0 2024-09-13T18:30:30.825 INFO:tasks.workunit.client.1.smithi149.stdout:1/870: fdatasync d9/d10/f1a 0 2024-09-13T18:30:30.825 INFO:tasks.workunit.client.1.smithi149.stdout:1/871: read d9/d15/d60/da5/fd4 [452922,37306] 0 2024-09-13T18:30:30.833 INFO:tasks.workunit.client.1.smithi149.stdout:5/821: write d3/f4 [1098544,35927] 0 2024-09-13T18:30:30.844 INFO:tasks.workunit.client.1.smithi149.stdout:4/941: dwrite df/da0/d1c/d69/fce [0,4194304] 0 2024-09-13T18:30:30.844 INFO:tasks.workunit.client.1.smithi149.stdout:4/942: chown df/da0/d112/d3d/f40 74922 1 2024-09-13T18:30:30.844 INFO:tasks.workunit.client.0.smithi038.stdout:1/203: dwrite d12/d2a/d32/f36 [0,4194304] 0 2024-09-13T18:30:30.845 INFO:tasks.workunit.client.1.smithi149.stdout:3/843: dread d1/d2c/d38/d88/d96/fd7 [0,4194304] 0 2024-09-13T18:30:30.845 INFO:tasks.workunit.client.1.smithi149.stdout:7/936: dwrite d7/d9/d1c/d1f/d21/d49/d102/f12a [0,4194304] 0 2024-09-13T18:30:30.845 INFO:tasks.workunit.client.1.smithi149.stdout:0/923: dwrite d1/d29/d31/ff8 [0,4194304] 0 2024-09-13T18:30:30.845 INFO:tasks.workunit.client.1.smithi149.stdout:7/937: chown d7/d9/d1c/d1f/d21/d7b/d96/l128 0 1 2024-09-13T18:30:30.845 INFO:tasks.workunit.client.1.smithi149.stdout:7/938: fsync d7/d9/d1c/d2c/f38 0 2024-09-13T18:30:30.867 INFO:tasks.workunit.client.0.smithi038.stdout:4/353: creat d2/d49/d50/f72 x:0 0 0 2024-09-13T18:30:30.867 INFO:tasks.workunit.client.0.smithi038.stdout:4/354: creat d2/df/d1b/f73 x:0 0 0 2024-09-13T18:30:30.868 INFO:tasks.workunit.client.0.smithi038.stdout:3/190: truncate d0/f4 4003636 0 2024-09-13T18:30:30.869 INFO:tasks.workunit.client.1.smithi149.stdout:2/816: rename db/d13/d70/lc4 to db/d1b/dab/l110 0 2024-09-13T18:30:30.871 INFO:tasks.workunit.client.1.smithi149.stdout:1/872: symlink d9/d10/d3f/dc9/ddf/l117 0 2024-09-13T18:30:30.879 INFO:tasks.workunit.client.1.smithi149.stdout:1/873: write d9/d15/d60/da5/faf [3742699,91884] 0 2024-09-13T18:30:30.879 INFO:tasks.workunit.client.1.smithi149.stdout:1/874: chown d9/d10/d3f/dc9/fdb 8722225 1 2024-09-13T18:30:30.879 INFO:tasks.workunit.client.1.smithi149.stdout:1/875: stat d9/d10/d34/dbe/d38/f9c 0 2024-09-13T18:30:30.984 INFO:tasks.workunit.client.1.smithi149.stdout:5/822: mkdir d3/d10/d98/dfb/d101 0 2024-09-13T18:30:30.999 INFO:tasks.workunit.client.1.smithi149.stdout:3/844: mkdir d1/d2e/d93/d122/d12a 0 2024-09-13T18:30:30.999 INFO:tasks.workunit.client.1.smithi149.stdout:6/978: sync 2024-09-13T18:30:30.999 INFO:tasks.workunit.client.1.smithi149.stdout:6/979: dread - dc/d15/d23/d5b/f8b zero size 2024-09-13T18:30:31.000 INFO:tasks.workunit.client.1.smithi149.stdout:3/845: read d1/d2e/d1d/d6c/dcd/fe5 [78991,848] 0 2024-09-13T18:30:31.000 INFO:tasks.workunit.client.1.smithi149.stdout:7/939: mkdir d7/d76/db3/d149 0 2024-09-13T18:30:31.002 INFO:tasks.workunit.client.1.smithi149.stdout:4/943: rename df/da0/d1c/d69/lf6 to df/da0/d12/l14b 0 2024-09-13T18:30:31.003 INFO:tasks.workunit.client.1.smithi149.stdout:2/817: mknod db/d13/d70/d89/c111 0 2024-09-13T18:30:31.007 INFO:tasks.workunit.client.1.smithi149.stdout:1/876: creat d9/d10/d34/f118 x:0 0 0 2024-09-13T18:30:31.010 INFO:tasks.workunit.client.1.smithi149.stdout:5/823: mkdir d3/d10/d98/dfb/d54/d102 0 2024-09-13T18:30:31.013 INFO:tasks.workunit.client.1.smithi149.stdout:3/846: read d1/d2e/d1d/d9a/f5f [541686,48053] 0 2024-09-13T18:30:31.014 INFO:tasks.workunit.client.1.smithi149.stdout:6/980: creat dc/d15/d23/d104/f13c x:0 0 0 2024-09-13T18:30:31.014 INFO:tasks.workunit.client.1.smithi149.stdout:4/944: write df/da0/d1c/f42 [8051746,69936] 0 2024-09-13T18:30:31.015 INFO:tasks.workunit.client.0.smithi038.stdout:4/355: link d2/d49/c4f d2/df/d1b/d10/c74 0 2024-09-13T18:30:31.017 INFO:tasks.workunit.client.1.smithi149.stdout:0/924: rename d1/l74 to d1/d29/d31/d44/d81/d62/d102/d13d/l141 0 2024-09-13T18:30:31.017 INFO:tasks.workunit.client.1.smithi149.stdout:0/925: read d1/d29/d31/d3e/f45 [703333,78815] 0 2024-09-13T18:30:31.017 INFO:tasks.workunit.client.1.smithi149.stdout:0/926: fdatasync d1/d29/d31/d44/d81/d62/f77 0 2024-09-13T18:30:31.017 INFO:tasks.workunit.client.0.smithi038.stdout:4/356: dread d2/df/d22/dc/d8/f59 [0,4194304] 0 2024-09-13T18:30:31.018 INFO:tasks.workunit.client.0.smithi038.stdout:3/191: rename d0/c20 to d0/dd/d19/d1d/d29/d32/c40 0 2024-09-13T18:30:31.019 INFO:tasks.workunit.client.1.smithi149.stdout:2/818: symlink db/d1b/dab/l112 0 2024-09-13T18:30:31.019 INFO:tasks.workunit.client.1.smithi149.stdout:2/819: chown db/d1b/d2f/d30/l64 2118584 1 2024-09-13T18:30:31.019 INFO:tasks.workunit.client.0.smithi038.stdout:1/204: rmdir d12 39 2024-09-13T18:30:31.020 INFO:tasks.workunit.client.0.smithi038.stdout:1/205: write d12/f2d [182034,94013] 0 2024-09-13T18:30:31.020 INFO:tasks.workunit.client.1.smithi149.stdout:1/877: mkdir d9/d10/d34/d3c/d119 0 2024-09-13T18:30:31.021 INFO:tasks.workunit.client.1.smithi149.stdout:8/884: sync 2024-09-13T18:30:31.021 INFO:tasks.workunit.client.1.smithi149.stdout:9/747: sync 2024-09-13T18:30:31.021 INFO:tasks.workunit.client.1.smithi149.stdout:8/885: fdatasync d2/d12/dd8/f123 0 2024-09-13T18:30:31.021 INFO:tasks.workunit.client.1.smithi149.stdout:9/748: read - d0/d2e/d42/d59/fe4 zero size 2024-09-13T18:30:31.021 INFO:tasks.workunit.client.1.smithi149.stdout:8/886: chown d2/d13/l10d 203393 1 2024-09-13T18:30:31.022 INFO:tasks.workunit.client.1.smithi149.stdout:9/749: write d0/d2e/d42/d59/fa7 [672927,35639] 0 2024-09-13T18:30:31.022 INFO:tasks.workunit.client.1.smithi149.stdout:9/750: write d0/d2e/d42/d70/f7d [4434061,34153] 0 2024-09-13T18:30:31.023 INFO:tasks.workunit.client.1.smithi149.stdout:6/981: rmdir dc/d15/d54/da9 39 2024-09-13T18:30:31.023 INFO:tasks.workunit.client.1.smithi149.stdout:6/982: creat dc/d15/d23/d104/da1/dd1/f13d x:0 0 0 2024-09-13T18:30:31.023 INFO:tasks.workunit.client.1.smithi149.stdout:6/983: chown dc/d15/d23/f107 3221235 1 2024-09-13T18:30:31.024 INFO:tasks.workunit.client.0.smithi038.stdout:1/206: symlink d12/d2a/d32/l3d 0 2024-09-13T18:30:31.024 INFO:tasks.workunit.client.0.smithi038.stdout:1/207: write d12/f16 [927021,19921] 0 2024-09-13T18:30:31.025 INFO:tasks.workunit.client.1.smithi149.stdout:5/824: dread d3/d10/d4c/db8/fd4 [0,4194304] 0 2024-09-13T18:30:31.025 INFO:tasks.workunit.client.1.smithi149.stdout:5/825: chown d3/d10/d98/dfb/d54 494 1 2024-09-13T18:30:31.025 INFO:tasks.workunit.client.1.smithi149.stdout:4/945: mkdir df/da0/d12/d7c/d109/d14c 0 2024-09-13T18:30:31.025 INFO:tasks.workunit.client.1.smithi149.stdout:7/940: dwrite d7/d9/d11/d50/fb0 [4194304,4194304] 0 2024-09-13T18:30:31.026 INFO:tasks.workunit.client.1.smithi149.stdout:4/946: write df/da0/d12/d21/d22/d30/d41/d57/d8a/f126 [740426,89859] 0 2024-09-13T18:30:31.026 INFO:tasks.workunit.client.0.smithi038.stdout:3/192: symlink d0/dd/l41 0 2024-09-13T18:30:31.030 INFO:tasks.workunit.client.1.smithi149.stdout:0/927: mkdir d1/d48/d92/d10c/d142 0 2024-09-13T18:30:31.032 INFO:tasks.workunit.client.1.smithi149.stdout:3/847: write d1/d47/d30/fbd [1204181,66686] 0 2024-09-13T18:30:31.033 INFO:tasks.workunit.client.1.smithi149.stdout:2/820: rename db/d1b/d2f/d30/le6 to db/d10/d8d/l113 0 2024-09-13T18:30:31.033 INFO:tasks.workunit.client.1.smithi149.stdout:2/821: write db/d1b/fe9 [86265,44521] 0 2024-09-13T18:30:31.034 INFO:tasks.workunit.client.0.smithi038.stdout:3/193: dread d0/fa [0,4194304] 0 2024-09-13T18:30:31.035 INFO:tasks.workunit.client.1.smithi149.stdout:1/878: link d9/d10/d34/d3c/f112 d9/d10/d34/dbe/d38/d10b/f11a 0 2024-09-13T18:30:31.037 INFO:tasks.workunit.client.1.smithi149.stdout:8/887: symlink d2/d52/l129 0 2024-09-13T18:30:31.042 INFO:tasks.workunit.client.1.smithi149.stdout:6/984: mkdir dc/d15/d54/d85/d13e 0 2024-09-13T18:30:31.045 INFO:tasks.workunit.client.1.smithi149.stdout:4/947: link df/da0/d1c/d69/l89 df/da0/d12/d7c/d109/d11b/l14d 0 2024-09-13T18:30:31.045 INFO:tasks.workunit.client.1.smithi149.stdout:4/948: chown df/da0/d112/d3d/f73 39 1 2024-09-13T18:30:31.046 INFO:tasks.workunit.client.1.smithi149.stdout:0/928: mkdir d1/d29/d31/d83/d87/d143 0 2024-09-13T18:30:31.047 INFO:tasks.workunit.client.1.smithi149.stdout:3/848: symlink d1/d12/db9/l12b 0 2024-09-13T18:30:31.050 INFO:tasks.workunit.client.1.smithi149.stdout:3/849: fdatasync d1/d2e/d1d/d6c/daa/dfb/d113/f115 0 2024-09-13T18:30:31.050 INFO:tasks.workunit.client.1.smithi149.stdout:2/822: rmdir db/d1b/d1c/d20/d2b/d3e 39 2024-09-13T18:30:31.050 INFO:tasks.workunit.client.1.smithi149.stdout:3/850: write d1/d2c/d38/d88/d96/fd8 [4583492,826] 0 2024-09-13T18:30:31.050 INFO:tasks.workunit.client.1.smithi149.stdout:2/823: creat db/d1b/dab/f114 x:0 0 0 2024-09-13T18:30:31.050 INFO:tasks.workunit.client.1.smithi149.stdout:8/888: mkdir d2/d12/dd8/d12a 0 2024-09-13T18:30:31.052 INFO:tasks.workunit.client.1.smithi149.stdout:9/751: dread d0/d9e/f3f [0,4194304] 0 2024-09-13T18:30:31.053 INFO:tasks.workunit.client.0.smithi038.stdout:4/357: dwrite d2/df/d22/dc/f44 [0,4194304] 0 2024-09-13T18:30:31.053 INFO:tasks.workunit.client.0.smithi038.stdout:4/358: chown d2/df/d22/dc/f18 1445669 1 2024-09-13T18:30:31.054 INFO:tasks.workunit.client.1.smithi149.stdout:6/985: rename dc/d15/d23/dcd to dc/d15/d54/d85/d13f 0 2024-09-13T18:30:31.054 INFO:tasks.workunit.client.1.smithi149.stdout:1/879: truncate d9/d10/d34/dbe/d38/f9c 444332 0 2024-09-13T18:30:31.062 INFO:tasks.workunit.client.1.smithi149.stdout:9/752: creat d0/d2e/d42/d70/d84/dea/feb x:0 0 0 2024-09-13T18:30:31.063 INFO:tasks.workunit.client.0.smithi038.stdout:4/359: truncate d2/f41 1951091 0 2024-09-13T18:30:31.065 INFO:tasks.workunit.client.1.smithi149.stdout:6/986: getdents dc/d15/d54/d85/d13f 0 2024-09-13T18:30:31.067 INFO:tasks.workunit.client.1.smithi149.stdout:9/753: mknod d0/d18/d27/d5c/d7e/cec 0 2024-09-13T18:30:31.068 INFO:tasks.workunit.client.0.smithi038.stdout:4/360: mkdir d2/df/d1b/d10/d75 0 2024-09-13T18:30:31.068 INFO:tasks.workunit.client.0.smithi038.stdout:4/361: getdents d2/d49/d4b/d64 0 2024-09-13T18:30:31.069 INFO:tasks.workunit.client.0.smithi038.stdout:4/362: chown d2/df/d22/f65 161 1 2024-09-13T18:30:31.070 INFO:tasks.workunit.client.0.smithi038.stdout:1/208: dwrite f10 [0,4194304] 0 2024-09-13T18:30:31.070 INFO:tasks.workunit.client.0.smithi038.stdout:1/209: dread - d12/f39 zero size 2024-09-13T18:30:31.072 INFO:tasks.workunit.client.0.smithi038.stdout:4/363: mkdir d2/d49/d4b/d76 0 2024-09-13T18:30:31.072 INFO:tasks.workunit.client.0.smithi038.stdout:4/364: chown d2/df/d1b/d10/d55 634692 1 2024-09-13T18:30:31.072 INFO:tasks.workunit.client.0.smithi038.stdout:4/365: creat d2/d49/d50/f77 x:0 0 0 2024-09-13T18:30:31.073 INFO:tasks.workunit.client.1.smithi149.stdout:1/880: dread d9/d15/d40/d90/fb8 [0,4194304] 0 2024-09-13T18:30:31.073 INFO:tasks.workunit.client.1.smithi149.stdout:1/881: creat d9/d15/d40/f11b x:0 0 0 2024-09-13T18:30:31.073 INFO:tasks.workunit.client.1.smithi149.stdout:1/882: write d9/d15/d60/d80/d8b/d42/fa7 [943629,10432] 0 2024-09-13T18:30:31.074 INFO:tasks.workunit.client.1.smithi149.stdout:6/987: creat dc/d15/f140 x:0 0 0 2024-09-13T18:30:31.074 INFO:tasks.workunit.client.1.smithi149.stdout:6/988: write dc/d70/f97 [353506,3264] 0 2024-09-13T18:30:31.074 INFO:tasks.workunit.client.1.smithi149.stdout:2/824: dwrite db/d10/f2c [0,4194304] 0 2024-09-13T18:30:31.074 INFO:tasks.workunit.client.1.smithi149.stdout:2/825: fdatasync db/d1b/d2f/d69/f5c 0 2024-09-13T18:30:31.074 INFO:tasks.workunit.client.1.smithi149.stdout:0/929: dread d1/d2/d8a/d90/f124 [4194304,4194304] 0 2024-09-13T18:30:31.078 INFO:tasks.workunit.client.1.smithi149.stdout:1/883: mknod d9/d15/d73/d106/c11c 0 2024-09-13T18:30:31.079 INFO:tasks.workunit.client.1.smithi149.stdout:7/941: dwrite d7/d9/d1c/d51/d52/d86/fda [0,4194304] 0 2024-09-13T18:30:31.081 INFO:tasks.workunit.client.1.smithi149.stdout:0/930: dread d1/d29/d31/d44/d47/f11c [0,4194304] 0 2024-09-13T18:30:31.082 INFO:tasks.workunit.client.0.smithi038.stdout:1/210: creat d12/f3e x:0 0 0 2024-09-13T18:30:31.084 INFO:tasks.workunit.client.1.smithi149.stdout:6/989: mkdir dc/d15/d23/d5b/d10a/d141 0 2024-09-13T18:30:31.084 INFO:tasks.workunit.client.1.smithi149.stdout:6/990: creat dc/d15/d54/d85/dcc/f142 x:0 0 0 2024-09-13T18:30:31.084 INFO:tasks.workunit.client.1.smithi149.stdout:6/991: write dc/d70/ff5 [810547,124580] 0 2024-09-13T18:30:31.086 INFO:tasks.workunit.client.1.smithi149.stdout:1/884: dread d9/d10/d3f/f7a [0,4194304] 0 2024-09-13T18:30:31.087 INFO:tasks.workunit.client.0.smithi038.stdout:4/366: rmdir d2/df/d1b/d10/d55 39 2024-09-13T18:30:31.088 INFO:tasks.workunit.client.1.smithi149.stdout:3/851: dwrite d1/d2c/d56/f76 [0,4194304] 0 2024-09-13T18:30:31.089 INFO:tasks.workunit.client.1.smithi149.stdout:5/826: dwrite d3/f95 [0,4194304] 0 2024-09-13T18:30:31.089 INFO:tasks.workunit.client.1.smithi149.stdout:5/827: truncate d3/d10/d98/dfb/d54/d76/fa0 772072 0 2024-09-13T18:30:31.090 INFO:tasks.workunit.client.0.smithi038.stdout:4/367: stat d2/df/l20 0 2024-09-13T18:30:31.093 INFO:tasks.workunit.client.0.smithi038.stdout:4/368: truncate d2/df/d1b/d10/f25 578004 0 2024-09-13T18:30:31.095 INFO:tasks.workunit.client.1.smithi149.stdout:7/942: rename d7/d9/d1c/d1f/d21/d49/c54 to d7/d9/d11/de2/d101/c14a 0 2024-09-13T18:30:31.095 INFO:tasks.workunit.client.1.smithi149.stdout:7/943: stat d7/d9/d11/d50/dde/df7/dae/ff8 0 2024-09-13T18:30:31.096 INFO:tasks.workunit.client.0.smithi038.stdout:4/369: unlink d2/df/d22/dc/d8/c63 0 2024-09-13T18:30:31.099 INFO:tasks.workunit.client.1.smithi149.stdout:0/931: truncate d1/d2/d41/f94 1170495 0 2024-09-13T18:30:31.099 INFO:tasks.workunit.client.1.smithi149.stdout:2/826: dread db/d13/d70/fa7 [0,4194304] 0 2024-09-13T18:30:31.099 INFO:tasks.workunit.client.1.smithi149.stdout:2/827: creat db/d1b/d1c/d20/f115 x:0 0 0 2024-09-13T18:30:31.105 INFO:tasks.workunit.client.1.smithi149.stdout:9/754: dwrite d0/d2e/d42/f8c [0,4194304] 0 2024-09-13T18:30:31.105 INFO:tasks.workunit.client.1.smithi149.stdout:9/755: write d0/d2e/f71 [715232,103199] 0 2024-09-13T18:30:31.105 INFO:tasks.workunit.client.1.smithi149.stdout:9/756: write d0/d18/d27/d5c/d7e/fcc [322114,89663] 0 2024-09-13T18:30:31.105 INFO:tasks.workunit.client.1.smithi149.stdout:9/757: readlink d0/l16 0 2024-09-13T18:30:31.105 INFO:tasks.workunit.client.1.smithi149.stdout:6/992: truncate dc/d15/d54/d85/f89 1569682 0 2024-09-13T18:30:31.106 INFO:tasks.workunit.client.1.smithi149.stdout:1/885: mkdir d9/d10/d34/d53/d7b/d11d 0 2024-09-13T18:30:31.108 INFO:tasks.workunit.client.1.smithi149.stdout:3/852: symlink d1/l12c 0 2024-09-13T18:30:31.108 INFO:tasks.workunit.client.1.smithi149.stdout:3/853: creat d1/d48/f12d x:0 0 0 2024-09-13T18:30:31.108 INFO:tasks.workunit.client.1.smithi149.stdout:3/854: write d1/d2e/d1d/d6c/dcd/fe5 [1531556,106052] 0 2024-09-13T18:30:31.109 INFO:tasks.workunit.client.1.smithi149.stdout:5/828: rmdir d3/d10/d98/dfb/d54/d102 0 2024-09-13T18:30:31.111 INFO:tasks.workunit.client.0.smithi038.stdout:4/370: dread d2/df/d22/f29 [0,4194304] 0 2024-09-13T18:30:31.111 INFO:tasks.workunit.client.0.smithi038.stdout:3/194: dwrite d0/f2 [0,4194304] 0 2024-09-13T18:30:31.111 INFO:tasks.workunit.client.1.smithi149.stdout:7/944: symlink d7/d9/d1c/d1f/d21/d7b/l14b 0 2024-09-13T18:30:31.112 INFO:tasks.workunit.client.1.smithi149.stdout:3/855: write d1/d2c/d38/d88/d96/fd7 [41019,115090] 0 2024-09-13T18:30:31.114 INFO:tasks.workunit.client.1.smithi149.stdout:0/932: rename d1/d2/d8a/da9/dd7/d132 to d1/d48/d92/d10c/d144 0 2024-09-13T18:30:31.114 INFO:tasks.workunit.client.1.smithi149.stdout:0/933: chown d1/d2/f119 6153 1 2024-09-13T18:30:31.114 INFO:tasks.workunit.client.1.smithi149.stdout:0/934: fsync d1/d29/d31/f88 0 2024-09-13T18:30:31.115 INFO:tasks.workunit.client.1.smithi149.stdout:0/935: chown d1/d2/d8a/da9/fc3 0 1 2024-09-13T18:30:31.124 INFO:tasks.workunit.client.1.smithi149.stdout:9/758: link d0/f4e d0/d18/d81/fed 0 2024-09-13T18:30:31.125 INFO:tasks.workunit.client.1.smithi149.stdout:1/886: creat d9/d10/d83/de1/f11e x:0 0 0 2024-09-13T18:30:31.127 INFO:tasks.workunit.client.1.smithi149.stdout:1/887: write d9/d10/d62/f8d [442887,40652] 0 2024-09-13T18:30:31.127 INFO:tasks.workunit.client.1.smithi149.stdout:7/945: symlink d7/d9/d11/d50/d133/l14c 0 2024-09-13T18:30:31.128 INFO:tasks.workunit.client.1.smithi149.stdout:3/856: mkdir d1/d47/d30/d5a/d12e 0 2024-09-13T18:30:31.128 INFO:tasks.workunit.client.1.smithi149.stdout:3/857: write d1/d2e/d1d/d6c/daa/dfb/d113/f115 [587410,43504] 0 2024-09-13T18:30:31.130 INFO:tasks.workunit.client.1.smithi149.stdout:2/828: rename db/d1b/dab/lf6 to db/d1b/d2f/l116 0 2024-09-13T18:30:31.131 INFO:tasks.workunit.client.1.smithi149.stdout:0/936: symlink d1/d48/d92/d10c/l145 0 2024-09-13T18:30:31.133 INFO:tasks.workunit.client.0.smithi038.stdout:3/195: dwrite d0/dd/fe [0,4194304] 0 2024-09-13T18:30:31.133 INFO:tasks.workunit.client.0.smithi038.stdout:3/196: stat d0/dd/c25 0 2024-09-13T18:30:31.134 INFO:tasks.workunit.client.1.smithi149.stdout:1/888: mkdir d9/d10/d43/dcb/d11f 0 2024-09-13T18:30:31.136 INFO:tasks.workunit.client.1.smithi149.stdout:7/946: mkdir d7/d9/d11/d50/d14d 0 2024-09-13T18:30:31.138 INFO:tasks.workunit.client.1.smithi149.stdout:2/829: rmdir db/d1b/d1c/d20/dff 39 2024-09-13T18:30:31.138 INFO:tasks.workunit.client.1.smithi149.stdout:2/830: chown db/d1b/dab/lef 24 1 2024-09-13T18:30:31.141 INFO:tasks.workunit.client.1.smithi149.stdout:6/993: rename dc/f22 to dc/d2f/df2/f143 0 2024-09-13T18:30:31.143 INFO:tasks.workunit.client.1.smithi149.stdout:5/829: dwrite d3/d10/d98/dfb/d54/f9e [0,4194304] 0 2024-09-13T18:30:31.143 INFO:tasks.workunit.client.1.smithi149.stdout:5/830: write d3/d10/f5d [1299801,64659] 0 2024-09-13T18:30:31.143 INFO:tasks.workunit.client.1.smithi149.stdout:5/831: creat d3/d8/d6d/d91/f103 x:0 0 0 2024-09-13T18:30:31.143 INFO:tasks.workunit.client.1.smithi149.stdout:9/759: dwrite d0/d18/d93/fdf [0,4194304] 0 2024-09-13T18:30:31.143 INFO:tasks.workunit.client.1.smithi149.stdout:9/760: chown d0/d18/d27/d5c/d79/lc6 3083377 1 2024-09-13T18:30:31.143 INFO:tasks.workunit.client.1.smithi149.stdout:0/937: symlink d1/d2/d8a/dc2/l146 0 2024-09-13T18:30:31.143 INFO:tasks.workunit.client.1.smithi149.stdout:0/938: stat d1/d1b/f3d 0 2024-09-13T18:30:31.145 INFO:tasks.workunit.client.1.smithi149.stdout:1/889: creat d9/d10/d62/f120 x:0 0 0 2024-09-13T18:30:31.149 INFO:tasks.workunit.client.1.smithi149.stdout:7/947: mknod d7/d9/d1c/d1f/d21/d7b/d96/d9e/c14e 0 2024-09-13T18:30:31.150 INFO:tasks.workunit.client.1.smithi149.stdout:3/858: getdents d1/d47/d30 0 2024-09-13T18:30:31.152 INFO:tasks.workunit.client.1.smithi149.stdout:2/831: mkdir db/d1b/d6c/d117 0 2024-09-13T18:30:31.153 INFO:tasks.workunit.client.1.smithi149.stdout:0/939: write d1/d29/d31/d44/d81/d62/fea [3586930,11763] 0 2024-09-13T18:30:31.156 INFO:tasks.workunit.client.1.smithi149.stdout:6/994: creat dc/d15/d23/d104/da1/dcb/f144 x:0 0 0 2024-09-13T18:30:31.159 INFO:tasks.workunit.client.1.smithi149.stdout:5/832: link d3/d10/d4c/d4e/d61/d63/fc5 d3/d10/d98/dfb/d67/d83/f104 0 2024-09-13T18:30:31.160 INFO:tasks.workunit.client.0.smithi038.stdout:3/197: dwrite d0/fc [0,4194304] 0 2024-09-13T18:30:31.172 INFO:tasks.workunit.client.1.smithi149.stdout:9/761: dwrite d0/d47/f65 [0,4194304] 0 2024-09-13T18:30:31.175 INFO:tasks.workunit.client.1.smithi149.stdout:7/948: link d7/d9/d1c/d51/c121 d7/d9/d1b/d71/ddc/c14f 0 2024-09-13T18:30:31.175 INFO:tasks.workunit.client.1.smithi149.stdout:7/949: write d7/d9/d1c/d1f/d21/d49/d102/d10f/fe1 [606217,93396] 0 2024-09-13T18:30:31.176 INFO:tasks.workunit.client.1.smithi149.stdout:3/859: mkdir d1/d47/df9/d12f 0 2024-09-13T18:30:31.181 INFO:tasks.workunit.client.1.smithi149.stdout:9/762: creat d0/d18/d68/db2/dc9/fee x:0 0 0 2024-09-13T18:30:31.181 INFO:tasks.workunit.client.1.smithi149.stdout:1/890: getdents d9/d10/d34/d3c/d50 0 2024-09-13T18:30:31.183 INFO:tasks.workunit.client.1.smithi149.stdout:7/950: truncate d7/d9/d1c/d1f/f73 3282514 0 2024-09-13T18:30:31.183 INFO:tasks.workunit.client.1.smithi149.stdout:7/951: write d7/d9/d11/d50/dde/df7/ddf/f117 [4017905,85285] 0 2024-09-13T18:30:31.184 INFO:tasks.workunit.client.1.smithi149.stdout:3/860: creat d1/d2c/d38/d88/f130 x:0 0 0 2024-09-13T18:30:31.184 INFO:tasks.workunit.client.1.smithi149.stdout:3/861: chown d1/d2c/d38/d88/l117 1927 1 2024-09-13T18:30:31.195 INFO:tasks.workunit.client.1.smithi149.stdout:6/995: getdents dc/d8c 0 2024-09-13T18:30:31.197 INFO:tasks.workunit.client.1.smithi149.stdout:1/891: creat d9/d15/d60/d80/dcd/f121 x:0 0 0 2024-09-13T18:30:31.197 INFO:tasks.workunit.client.1.smithi149.stdout:7/952: symlink d7/d9/d1c/d34/l150 0 2024-09-13T18:30:31.198 INFO:tasks.workunit.client.1.smithi149.stdout:7/953: fdatasync d7/d9/d1c/d1f/f25 0 2024-09-13T18:30:31.199 INFO:tasks.workunit.client.1.smithi149.stdout:2/832: rename db/d10 to db/d13/d70/d118 0 2024-09-13T18:30:31.199 INFO:tasks.workunit.client.1.smithi149.stdout:1/892: write d9/d15/d60/d80/d8b/f9b [631,63726] 0 2024-09-13T18:30:31.202 INFO:tasks.workunit.client.1.smithi149.stdout:0/940: rename d1/d2/d4e/fe7 to d1/d2/d41/d46/d7b/daf/f147 0 2024-09-13T18:30:31.204 INFO:tasks.workunit.client.1.smithi149.stdout:2/833: creat db/d1b/d6c/d10c/f119 x:0 0 0 2024-09-13T18:30:31.204 INFO:tasks.workunit.client.1.smithi149.stdout:6/996: mknod dc/d2f/c145 0 2024-09-13T18:30:31.204 INFO:tasks.workunit.client.1.smithi149.stdout:6/997: write dc/d15/d23/d5b/d10a/f133 [871976,98052] 0 2024-09-13T18:30:31.206 INFO:tasks.workunit.client.1.smithi149.stdout:1/893: unlink d9/d15/d60/cb0 0 2024-09-13T18:30:31.207 INFO:tasks.workunit.client.1.smithi149.stdout:5/833: rename d3/d8/d13/f18 to d3/d10/d98/dfb/d67/d83/f105 0 2024-09-13T18:30:31.207 INFO:tasks.workunit.client.1.smithi149.stdout:5/834: dread - d3/d10/d4c/d4e/fe5 zero size 2024-09-13T18:30:31.207 INFO:tasks.workunit.client.0.smithi038.stdout:3/198: truncate d0/fc 1035544 0 2024-09-13T18:30:31.211 INFO:tasks.workunit.client.0.smithi038.stdout:7/176: sync 2024-09-13T18:30:31.211 INFO:tasks.workunit.client.0.smithi038.stdout:7/177: write db/d12/d1c/d3a/d22/f30 [331665,128985] 0 2024-09-13T18:30:31.211 INFO:tasks.workunit.client.0.smithi038.stdout:7/178: chown db/d12/d13/f37 66 1 2024-09-13T18:30:31.211 INFO:tasks.workunit.client.0.smithi038.stdout:7/179: write db/d12/d1c/d3a/d22/f2c [1355155,79264] 0 2024-09-13T18:30:31.211 INFO:tasks.workunit.client.0.smithi038.stdout:5/154: sync 2024-09-13T18:30:31.211 INFO:tasks.workunit.client.0.smithi038.stdout:5/155: stat c6 0 2024-09-13T18:30:31.211 INFO:tasks.workunit.client.0.smithi038.stdout:2/197: sync 2024-09-13T18:30:31.211 INFO:tasks.workunit.client.0.smithi038.stdout:5/156: fsync df/f1b 0 2024-09-13T18:30:31.211 INFO:tasks.workunit.client.0.smithi038.stdout:8/297: sync 2024-09-13T18:30:31.212 INFO:tasks.workunit.client.1.smithi149.stdout:6/998: creat dc/d15/d23/d57/f146 x:0 0 0 2024-09-13T18:30:31.212 INFO:tasks.workunit.client.1.smithi149.stdout:1/894: mknod d9/d10/d43/dcb/c122 0 2024-09-13T18:30:31.212 INFO:tasks.workunit.client.1.smithi149.stdout:1/895: write d9/d10/d34/d3c/f112 [184723,123758] 0 2024-09-13T18:30:31.212 INFO:tasks.workunit.client.1.smithi149.stdout:9/763: dwrite d0/d9e/f3f [0,4194304] 0 2024-09-13T18:30:31.212 INFO:tasks.workunit.client.1.smithi149.stdout:9/764: readlink d0/d18/d27/l60 0 2024-09-13T18:30:31.212 INFO:tasks.workunit.client.1.smithi149.stdout:3/862: dwrite d1/d48/d75/fdd [0,4194304] 0 2024-09-13T18:30:31.212 INFO:tasks.workunit.client.1.smithi149.stdout:3/863: chown d1/d48 2 1 2024-09-13T18:30:31.216 INFO:tasks.workunit.client.0.smithi038.stdout:5/157: creat df/d13/f34 x:0 0 0 2024-09-13T18:30:31.216 INFO:tasks.workunit.client.0.smithi038.stdout:5/158: write df/d29/f31 [855999,28561] 0 2024-09-13T18:30:31.219 INFO:tasks.workunit.client.1.smithi149.stdout:6/999: mknod dc/d15/d23/c147 0 2024-09-13T18:30:31.219 INFO:tasks.workunit.client.1.smithi149.stdout:1/896: symlink d9/d10/d34/dbe/dd7/l123 0 2024-09-13T18:30:31.219 INFO:tasks.workunit.client.0.smithi038.stdout:2/198: dread d2/f8 [4194304,4194304] 0 2024-09-13T18:30:31.219 INFO:tasks.workunit.client.0.smithi038.stdout:2/199: write d2/da/f1b [4874239,86777] 0 2024-09-13T18:30:31.220 INFO:tasks.workunit.client.1.smithi149.stdout:8/889: sync 2024-09-13T18:30:31.223 INFO:tasks.workunit.client.1.smithi149.stdout:5/835: dread d3/d8/fe [0,4194304] 0 2024-09-13T18:30:31.224 INFO:tasks.workunit.client.1.smithi149.stdout:5/836: write d3/d10/d98/dfb/d54/d76/d7a/fe6 [224518,5787] 0 2024-09-13T18:30:31.227 INFO:tasks.workunit.client.1.smithi149.stdout:4/949: sync 2024-09-13T18:30:31.227 INFO:tasks.workunit.client.1.smithi149.stdout:1/897: mkdir d9/d10/d34/dbe/dd7/d124 0 2024-09-13T18:30:31.227 INFO:tasks.workunit.client.1.smithi149.stdout:1/898: chown d9/d10/c19 0 1 2024-09-13T18:30:31.227 INFO:tasks.workunit.client.1.smithi149.stdout:1/899: write d9/d15/d60/da5/faf [2649412,59085] 0 2024-09-13T18:30:31.227 INFO:tasks.workunit.client.0.smithi038.stdout:2/200: write d2/f11 [610883,2809] 0 2024-09-13T18:30:31.235 INFO:tasks.workunit.client.0.smithi038.stdout:2/201: creat d2/d2a/d2b/d39/d45/f4a x:0 0 0 2024-09-13T18:30:31.235 INFO:tasks.workunit.client.1.smithi149.stdout:3/864: dread d1/d48/d75/fdd [0,4194304] 0 2024-09-13T18:30:31.235 INFO:tasks.workunit.client.1.smithi149.stdout:9/765: write d0/f4e [2380525,14038] 0 2024-09-13T18:30:31.236 INFO:tasks.workunit.client.1.smithi149.stdout:9/766: fdatasync d0/d2e/d42/d59/f7c 0 2024-09-13T18:30:31.236 INFO:tasks.workunit.client.1.smithi149.stdout:9/767: dread - d0/d18/d27/d5c/d99/fda zero size 2024-09-13T18:30:31.236 INFO:tasks.workunit.client.1.smithi149.stdout:9/768: write d0/d47/fca [1521998,4768] 0 2024-09-13T18:30:31.236 INFO:tasks.workunit.client.1.smithi149.stdout:9/769: write d0/f9 [4961555,16302] 0 2024-09-13T18:30:31.236 INFO:tasks.workunit.client.1.smithi149.stdout:9/770: stat d0/d2e/d42/d70/d84/dae/fbf 0 2024-09-13T18:30:31.237 INFO:tasks.workunit.client.1.smithi149.stdout:8/890: rmdir d2/d12/dd8/d117 39 2024-09-13T18:30:31.238 INFO:tasks.workunit.client.0.smithi038.stdout:2/202: rename d2/l9 to d2/d1e/d48/l4b 0 2024-09-13T18:30:31.241 INFO:tasks.workunit.client.1.smithi149.stdout:7/954: dwrite d7/d9/f1d [0,4194304] 0 2024-09-13T18:30:31.241 INFO:tasks.workunit.client.1.smithi149.stdout:7/955: creat d7/d11d/f151 x:0 0 0 2024-09-13T18:30:31.242 INFO:tasks.workunit.client.0.smithi038.stdout:2/203: rename d2/l6 to d2/d2a/d2b/d39/d40/l4c 0 2024-09-13T18:30:31.242 INFO:tasks.workunit.client.1.smithi149.stdout:0/941: dwrite d1/d2/fb [4194304,4194304] 0 2024-09-13T18:30:31.247 INFO:tasks.workunit.client.1.smithi149.stdout:4/950: rmdir df/da0/d1c 39 2024-09-13T18:30:31.247 INFO:tasks.workunit.client.1.smithi149.stdout:4/951: write df/da0/d70/db5/dc7/df9/f10e [390351,63442] 0 2024-09-13T18:30:31.249 INFO:tasks.workunit.client.0.smithi038.stdout:2/204: creat d2/d2a/d2b/d46/f4d x:0 0 0 2024-09-13T18:30:31.249 INFO:tasks.workunit.client.0.smithi038.stdout:2/205: chown d2/d1e/l3a 0 1 2024-09-13T18:30:31.250 INFO:tasks.workunit.client.1.smithi149.stdout:3/865: symlink d1/d12/d20/d54/dd1/l131 0 2024-09-13T18:30:31.253 INFO:tasks.workunit.client.0.smithi038.stdout:2/206: rename d2/da/d16/f21 to d2/d1e/f4e 0 2024-09-13T18:30:31.253 INFO:tasks.workunit.client.0.smithi038.stdout:2/207: fsync d2/da/f25 0 2024-09-13T18:30:31.255 INFO:tasks.workunit.client.1.smithi149.stdout:9/771: mkdir d0/d47/d61/def 0 2024-09-13T18:30:31.255 INFO:tasks.workunit.client.1.smithi149.stdout:9/772: chown d0/d2e/d42/d70 3438 1 2024-09-13T18:30:31.257 INFO:tasks.workunit.client.1.smithi149.stdout:1/900: rmdir d9/d10/d43/dcb 39 2024-09-13T18:30:31.257 INFO:tasks.workunit.client.1.smithi149.stdout:1/901: readlink d9/d10/d34/dbe/d38/lc3 0 2024-09-13T18:30:31.257 INFO:tasks.workunit.client.1.smithi149.stdout:1/902: creat d9/d10/d62/f125 x:0 0 0 2024-09-13T18:30:31.257 INFO:tasks.workunit.client.1.smithi149.stdout:1/903: fsync d9/d15/d60/d80/f84 0 2024-09-13T18:30:31.258 INFO:tasks.workunit.client.1.smithi149.stdout:1/904: fsync d9/d10/dca/fff 0 2024-09-13T18:30:31.258 INFO:tasks.workunit.client.1.smithi149.stdout:8/891: write d2/d12/f5c [5054514,66678] 0 2024-09-13T18:30:31.258 INFO:tasks.workunit.client.0.smithi038.stdout:3/199: truncate d0/dd/fe 3896520 0 2024-09-13T18:30:31.261 INFO:tasks.workunit.client.0.smithi038.stdout:2/208: getdents d2/d2a/d2b/d39 0 2024-09-13T18:30:31.262 INFO:tasks.workunit.client.1.smithi149.stdout:2/834: dwrite db/d1b/d1c/d20/f45 [0,4194304] 0 2024-09-13T18:30:31.262 INFO:tasks.workunit.client.1.smithi149.stdout:2/835: chown db/d1b/d2f 98091 1 2024-09-13T18:30:31.263 INFO:tasks.workunit.client.0.smithi038.stdout:5/159: dwrite f3 [4194304,4194304] 0 2024-09-13T18:30:31.264 INFO:tasks.workunit.client.0.smithi038.stdout:5/160: dread fd [0,4194304] 0 2024-09-13T18:30:31.264 INFO:tasks.workunit.client.0.smithi038.stdout:5/161: dread - df/d29/f33 zero size 2024-09-13T18:30:31.265 INFO:tasks.workunit.client.0.smithi038.stdout:2/209: rename d2/d2a/f30 to d2/d1e/d48/f4f 0 2024-09-13T18:30:31.265 INFO:tasks.workunit.client.0.smithi038.stdout:2/210: chown d2/da/f1d 2506 1 2024-09-13T18:30:31.268 INFO:tasks.workunit.client.0.smithi038.stdout:5/162: write df/f10 [313080,29457] 0 2024-09-13T18:30:31.268 INFO:tasks.workunit.client.0.smithi038.stdout:5/163: chown df/d29/f2f 7008524 1 2024-09-13T18:30:31.268 INFO:tasks.workunit.client.0.smithi038.stdout:5/164: write df/f2a [607432,28817] 0 2024-09-13T18:30:31.268 INFO:tasks.workunit.client.0.smithi038.stdout:5/165: creat df/d13/f35 x:0 0 0 2024-09-13T18:30:31.268 INFO:tasks.workunit.client.1.smithi149.stdout:7/956: mkdir d7/d9/d1c/d1f/d3d/d152 0 2024-09-13T18:30:31.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:30 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:30:31.270 INFO:tasks.workunit.client.1.smithi149.stdout:0/942: mkdir d1/d29/d31/d44/d47/dfb/d148 0 2024-09-13T18:30:31.271 INFO:tasks.workunit.client.1.smithi149.stdout:4/952: dwrite df/da0/d1c/d69/f12c [0,4194304] 0 2024-09-13T18:30:31.271 INFO:tasks.workunit.client.1.smithi149.stdout:4/953: stat df/da0/d12/laa 0 2024-09-13T18:30:31.275 INFO:tasks.workunit.client.0.smithi038.stdout:3/200: dread d0/f9 [0,4194304] 0 2024-09-13T18:30:31.275 INFO:tasks.workunit.client.0.smithi038.stdout:3/201: readlink d0/dd/d19/d1d/l38 0 2024-09-13T18:30:31.276 INFO:tasks.workunit.client.1.smithi149.stdout:3/866: creat d1/d2c/d38/f132 x:0 0 0 2024-09-13T18:30:31.276 INFO:tasks.workunit.client.1.smithi149.stdout:3/867: creat d1/d2e/d1d/d6c/daa/dfb/f133 x:0 0 0 2024-09-13T18:30:31.277 INFO:tasks.workunit.client.0.smithi038.stdout:5/166: mkdir df/d15/d36 0 2024-09-13T18:30:31.278 INFO:tasks.workunit.client.1.smithi149.stdout:9/773: dwrite d0/d2e/d42/d59/fe4 [0,4194304] 0 2024-09-13T18:30:31.280 INFO:tasks.workunit.client.1.smithi149.stdout:1/905: getdents d9/d15/d60/d80/d8b/d42/da4 0 2024-09-13T18:30:31.285 INFO:tasks.workunit.client.0.smithi038.stdout:3/202: mkdir d0/dd/d17/d42 0 2024-09-13T18:30:31.288 INFO:tasks.workunit.client.1.smithi149.stdout:8/892: dwrite d2/d5b/f8a [0,4194304] 0 2024-09-13T18:30:31.289 INFO:tasks.workunit.client.0.smithi038.stdout:2/211: rename d2/d2a/d2b to d2/d1e/d44/d50 0 2024-09-13T18:30:31.291 INFO:tasks.workunit.client.1.smithi149.stdout:9/774: write d0/f9 [2986191,56796] 0 2024-09-13T18:30:31.298 INFO:tasks.workunit.client.1.smithi149.stdout:2/836: symlink db/d100/l11a 0 2024-09-13T18:30:31.301 INFO:tasks.workunit.client.0.smithi038.stdout:5/167: rmdir df/d13 39 2024-09-13T18:30:31.301 INFO:tasks.workunit.client.0.smithi038.stdout:5/168: write df/d29/f2f [1019411,104487] 0 2024-09-13T18:30:31.303 INFO:tasks.workunit.client.1.smithi149.stdout:0/943: rename d1/d2/f5b to d1/d48/d92/d10c/d10e/f149 0 2024-09-13T18:30:31.303 INFO:tasks.workunit.client.1.smithi149.stdout:7/957: dread d7/d9/d1c/d2c/f9a [0,4194304] 0 2024-09-13T18:30:31.304 INFO:tasks.workunit.client.0.smithi038.stdout:2/212: symlink d2/d1e/d44/d50/d39/d40/l51 0 2024-09-13T18:30:31.306 INFO:tasks.workunit.client.0.smithi038.stdout:5/169: mknod df/d15/d36/c37 0 2024-09-13T18:30:31.307 INFO:tasks.workunit.client.0.smithi038.stdout:2/213: mkdir d2/d1e/d44/d50/d39/d52 0 2024-09-13T18:30:31.308 INFO:tasks.workunit.client.1.smithi149.stdout:4/954: unlink df/da0/d1c/f42 0 2024-09-13T18:30:31.311 INFO:tasks.workunit.client.0.smithi038.stdout:2/214: link d2/d1e/d44/d50/f32 d2/da/f53 0 2024-09-13T18:30:31.311 INFO:tasks.workunit.client.1.smithi149.stdout:0/944: write d1/d29/d31/d3e/f45 [8956755,8069] 0 2024-09-13T18:30:31.311 INFO:tasks.workunit.client.1.smithi149.stdout:3/868: creat d1/d114/f134 x:0 0 0 2024-09-13T18:30:31.312 INFO:tasks.workunit.client.0.smithi038.stdout:6/175: sync 2024-09-13T18:30:31.312 INFO:tasks.workunit.client.0.smithi038.stdout:0/162: sync 2024-09-13T18:30:31.312 INFO:tasks.workunit.client.0.smithi038.stdout:9/254: sync 2024-09-13T18:30:31.312 INFO:tasks.workunit.client.1.smithi149.stdout:7/958: write d7/d9/d1c/d1f/d21/d49/d102/f12a [3822109,3891] 0 2024-09-13T18:30:31.316 INFO:tasks.workunit.client.1.smithi149.stdout:1/906: creat d9/d10/d34/d3c/d50/f126 x:0 0 0 2024-09-13T18:30:31.316 INFO:tasks.workunit.client.1.smithi149.stdout:1/907: chown d9/d15 158 1 2024-09-13T18:30:31.317 INFO:tasks.workunit.client.0.smithi038.stdout:5/170: rmdir df 39 2024-09-13T18:30:31.317 INFO:tasks.workunit.client.0.smithi038.stdout:5/171: fdatasync df/d13/f35 0 2024-09-13T18:30:31.320 INFO:tasks.workunit.client.1.smithi149.stdout:2/837: getdents db/d13/d70/d118/d12 0 2024-09-13T18:30:31.320 INFO:tasks.workunit.client.1.smithi149.stdout:2/838: fsync db/d1b/d6c/f73 0 2024-09-13T18:30:31.320 INFO:tasks.workunit.client.1.smithi149.stdout:2/839: write db/d1b/d1c/d20/f115 [760677,20797] 0 2024-09-13T18:30:31.322 INFO:tasks.workunit.client.0.smithi038.stdout:6/176: mknod dd/de/c46 0 2024-09-13T18:30:31.324 INFO:tasks.workunit.client.0.smithi038.stdout:5/172: rmdir df/d15/d36 39 2024-09-13T18:30:31.325 INFO:tasks.workunit.client.0.smithi038.stdout:0/163: dread d2/dc/f39 [0,4194304] 0 2024-09-13T18:30:31.325 INFO:tasks.workunit.client.0.smithi038.stdout:0/164: chown d2/d7/d24/c2e 1208823 1 2024-09-13T18:30:31.325 INFO:tasks.workunit.client.0.smithi038.stdout:9/255: getdents d0/d7/d13/d30 0 2024-09-13T18:30:31.327 INFO:tasks.workunit.client.1.smithi149.stdout:4/955: link df/da0/d1c/d7e/ddd/ff5 df/da0/dcc/f14e 0 2024-09-13T18:30:31.329 INFO:tasks.workunit.client.0.smithi038.stdout:0/165: mkdir d2/d7/d24/d3c 0 2024-09-13T18:30:31.329 INFO:tasks.workunit.client.0.smithi038.stdout:0/166: readlink d2/dc/l22 0 2024-09-13T18:30:31.330 INFO:tasks.workunit.client.0.smithi038.stdout:9/256: mkdir d0/d7/d2c/d5e 0 2024-09-13T18:30:31.330 INFO:tasks.workunit.client.0.smithi038.stdout:9/257: chown d0/d7/c15 333 1 2024-09-13T18:30:31.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:30 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:30:31.332 INFO:tasks.workunit.client.0.smithi038.stdout:0/167: creat d2/d7/d24/d3c/f3d x:0 0 0 2024-09-13T18:30:31.334 INFO:tasks.workunit.client.1.smithi149.stdout:0/945: mknod d1/d29/d31/d3e/d137/c14a 0 2024-09-13T18:30:31.334 INFO:tasks.workunit.client.1.smithi149.stdout:0/946: dread - d1/d2/d8a/d90/fd5 zero size 2024-09-13T18:30:31.335 INFO:tasks.workunit.client.1.smithi149.stdout:3/869: rename d1/d2e/d1d/d9a/d39/lfe to d1/d12/d20/d91/l135 0 2024-09-13T18:30:31.336 INFO:tasks.workunit.client.1.smithi149.stdout:7/959: write d7/d9/d1c/d51/ffc [172743,64687] 0 2024-09-13T18:30:31.338 INFO:tasks.workunit.client.1.smithi149.stdout:1/908: unlink d9/d10/d34/d53/f72 0 2024-09-13T18:30:31.338 INFO:tasks.workunit.client.1.smithi149.stdout:1/909: stat d9/d10/d62/f120 0 2024-09-13T18:30:31.338 INFO:tasks.workunit.client.0.smithi038.stdout:2/215: dwrite d2/d1e/d44/d50/f2d [0,4194304] 0 2024-09-13T18:30:31.339 INFO:tasks.workunit.client.0.smithi038.stdout:5/173: dread df/f10 [0,4194304] 0 2024-09-13T18:30:31.339 INFO:tasks.workunit.client.0.smithi038.stdout:5/174: truncate df/d29/f33 838094 0 2024-09-13T18:30:31.339 INFO:tasks.workunit.client.0.smithi038.stdout:5/175: readlink df/d13/l24 0 2024-09-13T18:30:31.339 INFO:tasks.workunit.client.1.smithi149.stdout:8/893: symlink d2/d13/d6d/l12b 0 2024-09-13T18:30:31.339 INFO:tasks.workunit.client.1.smithi149.stdout:9/775: rmdir d0/d47/d54/d75 39 2024-09-13T18:30:31.340 INFO:tasks.workunit.client.1.smithi149.stdout:9/776: write d0/d18/d27/d5c/d79/fe6 [1034539,25311] 0 2024-09-13T18:30:31.340 INFO:tasks.workunit.client.1.smithi149.stdout:9/777: write d0/d47/d61/fd9 [978196,51880] 0 2024-09-13T18:30:31.341 INFO:tasks.workunit.client.1.smithi149.stdout:2/840: mkdir db/d13/d70/d11b 0 2024-09-13T18:30:31.345 INFO:tasks.workunit.client.1.smithi149.stdout:0/947: getdents d1/d29/d31/d83 0 2024-09-13T18:30:31.349 INFO:tasks.workunit.client.1.smithi149.stdout:3/870: rename d1/d2c/d8b/lb2 to d1/d47/df9/d12f/l136 0 2024-09-13T18:30:31.349 INFO:tasks.workunit.client.1.smithi149.stdout:3/871: stat d1/d2e/d1d/d9a/d39 0 2024-09-13T18:30:31.349 INFO:tasks.workunit.client.1.smithi149.stdout:3/872: getdents d1/d12/d20/d54/dd1/d10f 0 2024-09-13T18:30:31.349 INFO:tasks.workunit.client.1.smithi149.stdout:3/873: write d1/d2e/d1d/d6c/daa/dfb/f133 [990749,87028] 0 2024-09-13T18:30:31.350 INFO:tasks.workunit.client.0.smithi038.stdout:2/216: creat d2/d1e/d44/d50/d39/d45/f54 x:0 0 0 2024-09-13T18:30:31.354 INFO:tasks.workunit.client.0.smithi038.stdout:5/176: mknod df/d29/c38 0 2024-09-13T18:30:31.354 INFO:tasks.workunit.client.0.smithi038.stdout:6/177: write f6 [2992731,115091] 0 2024-09-13T18:30:31.355 INFO:tasks.workunit.client.1.smithi149.stdout:8/894: creat d2/d12/d2a/f12c x:0 0 0 2024-09-13T18:30:31.355 INFO:tasks.workunit.client.1.smithi149.stdout:5/837: sync 2024-09-13T18:30:31.355 INFO:tasks.workunit.client.1.smithi149.stdout:2/841: mkdir db/d1b/d1c/d20/d2b/db7/de2/d11c 0 2024-09-13T18:30:31.356 INFO:tasks.workunit.client.1.smithi149.stdout:2/842: write db/d1b/d1c/d85/fde [4761840,121648] 0 2024-09-13T18:30:31.356 INFO:tasks.workunit.client.1.smithi149.stdout:2/843: chown db/d1b/d1c/d20/d3a/d75/fdf 472644 1 2024-09-13T18:30:31.356 INFO:tasks.workunit.client.1.smithi149.stdout:2/844: fdatasync db/d13/d70/d118/f10d 0 2024-09-13T18:30:31.357 INFO:tasks.workunit.client.0.smithi038.stdout:5/177: dread df/f2a [0,4194304] 0 2024-09-13T18:30:31.357 INFO:tasks.workunit.client.0.smithi038.stdout:2/217: symlink d2/da/d16/l55 0 2024-09-13T18:30:31.360 INFO:tasks.workunit.client.1.smithi149.stdout:0/948: symlink d1/d48/d92/d10c/d142/l14b 0 2024-09-13T18:30:31.361 INFO:tasks.workunit.client.0.smithi038.stdout:6/178: mknod dd/de/c47 0 2024-09-13T18:30:31.364 INFO:tasks.workunit.client.0.smithi038.stdout:5/178: creat df/d15/f39 x:0 0 0 2024-09-13T18:30:31.364 INFO:tasks.workunit.client.0.smithi038.stdout:5/179: write f3 [9097990,71497] 0 2024-09-13T18:30:31.365 INFO:tasks.workunit.client.1.smithi149.stdout:8/895: dread d2/d13/d3a/d7f/fdc [0,4194304] 0 2024-09-13T18:30:31.365 INFO:tasks.workunit.client.1.smithi149.stdout:8/896: fdatasync d2/d13/d3a/d7f/fdc 0 2024-09-13T18:30:31.365 INFO:tasks.workunit.client.1.smithi149.stdout:8/897: write d2/d12/dd8/d58/f109 [997868,90841] 0 2024-09-13T18:30:31.365 INFO:tasks.workunit.client.1.smithi149.stdout:8/898: chown d2/d13/f50 30049 1 2024-09-13T18:30:31.366 INFO:tasks.workunit.client.1.smithi149.stdout:1/910: rename d9/d10/d34/f118 to d9/d10/d34/dbe/d38/f127 0 2024-09-13T18:30:31.367 INFO:tasks.workunit.client.0.smithi038.stdout:2/218: mkdir d2/d1e/d44/d50/d39/d56 0 2024-09-13T18:30:31.368 INFO:tasks.workunit.client.1.smithi149.stdout:3/874: unlink d1/d2e/d1d/f6b 0 2024-09-13T18:30:31.368 INFO:tasks.workunit.client.1.smithi149.stdout:7/960: dwrite d7/d76/db3/f138 [0,4194304] 0 2024-09-13T18:30:31.369 INFO:tasks.workunit.client.0.smithi038.stdout:6/179: symlink dd/de/l48 0 2024-09-13T18:30:31.369 INFO:tasks.workunit.client.0.smithi038.stdout:6/180: chown dd/de/d2e/d30/f29 995338 1 2024-09-13T18:30:31.370 INFO:tasks.workunit.client.1.smithi149.stdout:0/949: getdents d1/d2/d8a/d90 0 2024-09-13T18:30:31.372 INFO:tasks.workunit.client.0.smithi038.stdout:2/219: symlink d2/d1e/d44/d50/d39/l57 0 2024-09-13T18:30:31.374 INFO:tasks.workunit.client.1.smithi149.stdout:1/911: mkdir d9/d15/d60/d80/dcd/dab/df3/da2/d128 0 2024-09-13T18:30:31.374 INFO:tasks.workunit.client.0.smithi038.stdout:5/180: write df/d13/f21 [904524,104348] 0 2024-09-13T18:30:31.375 INFO:tasks.workunit.client.0.smithi038.stdout:5/181: write fd [709441,131040] 0 2024-09-13T18:30:31.376 INFO:tasks.workunit.client.0.smithi038.stdout:6/181: rename dd/de/l48 to dd/de/d2e/l49 0 2024-09-13T18:30:31.376 INFO:tasks.workunit.client.0.smithi038.stdout:6/182: readlink dd/de/d2e/d30/l2b 0 2024-09-13T18:30:31.376 INFO:tasks.workunit.client.0.smithi038.stdout:6/183: chown dd/de/d2e/c45 10295 1 2024-09-13T18:30:31.376 INFO:tasks.workunit.client.0.smithi038.stdout:6/184: chown dd/f44 1376 1 2024-09-13T18:30:31.378 INFO:tasks.workunit.client.1.smithi149.stdout:3/875: unlink d1/d47/d30/d5a/c99 0 2024-09-13T18:30:31.382 INFO:tasks.workunit.client.0.smithi038.stdout:6/185: mkdir dd/de/d4a 0 2024-09-13T18:30:31.383 INFO:tasks.workunit.client.1.smithi149.stdout:0/950: rmdir d1/d2/d41 39 2024-09-13T18:30:31.383 INFO:tasks.workunit.client.1.smithi149.stdout:0/951: chown d1/d2/d41/c11b 31912 1 2024-09-13T18:30:31.385 INFO:tasks.workunit.client.1.smithi149.stdout:0/952: creat d1/d29/d31/d3e/d137/f14c x:0 0 0 2024-09-13T18:30:31.385 INFO:tasks.workunit.client.1.smithi149.stdout:0/953: truncate d1/d2/d41/fae 1005736 0 2024-09-13T18:30:31.387 INFO:tasks.workunit.client.1.smithi149.stdout:0/954: creat d1/d2/d8a/da9/dd7/dfe/f14d x:0 0 0 2024-09-13T18:30:31.387 INFO:tasks.workunit.client.1.smithi149.stdout:0/955: chown d1/d48/d92/d10c/l9a 0 1 2024-09-13T18:30:31.392 INFO:tasks.workunit.client.1.smithi149.stdout:0/956: symlink d1/d48/d92/d10c/d142/l14e 0 2024-09-13T18:30:31.392 INFO:tasks.workunit.client.1.smithi149.stdout:0/957: write d1/d29/d31/d83/fb2 [1561586,60905] 0 2024-09-13T18:30:31.393 INFO:tasks.workunit.client.1.smithi149.stdout:7/961: dread d7/d9/d1c/d1f/d21/d7b/fed [0,4194304] 0 2024-09-13T18:30:31.393 INFO:tasks.workunit.client.0.smithi038.stdout:9/258: dwrite d0/f8 [0,4194304] 0 2024-09-13T18:30:31.395 INFO:tasks.workunit.client.1.smithi149.stdout:7/962: symlink d7/d9/d1c/d51/daf/l153 0 2024-09-13T18:30:31.395 INFO:tasks.workunit.client.1.smithi149.stdout:7/963: dread - d7/d9/d1c/d51/f100 zero size 2024-09-13T18:30:31.399 INFO:tasks.workunit.client.0.smithi038.stdout:9/259: rename d0/d2e/l5c to d0/d7/d13/d2d/d3c/d50/l5f 0 2024-09-13T18:30:31.400 INFO:tasks.workunit.client.0.smithi038.stdout:6/186: dread dd/f13 [0,4194304] 0 2024-09-13T18:30:31.402 INFO:tasks.workunit.client.1.smithi149.stdout:7/964: mknod d7/d9/d1b/d71/ddc/c154 0 2024-09-13T18:30:31.402 INFO:tasks.workunit.client.1.smithi149.stdout:7/965: creat d7/d9/d1c/d1f/d21/d49/d102/f155 x:0 0 0 2024-09-13T18:30:31.404 INFO:tasks.workunit.client.0.smithi038.stdout:9/260: rmdir d0/d7/d13/d2d 39 2024-09-13T18:30:31.404 INFO:tasks.workunit.client.0.smithi038.stdout:5/182: dread fd [0,4194304] 0 2024-09-13T18:30:31.404 INFO:tasks.workunit.client.1.smithi149.stdout:0/958: write d1/d2/d8a/f9b [318711,38470] 0 2024-09-13T18:30:31.406 INFO:tasks.workunit.client.0.smithi038.stdout:5/183: dread fd [0,4194304] 0 2024-09-13T18:30:31.406 INFO:tasks.workunit.client.0.smithi038.stdout:5/184: fsync f9 0 2024-09-13T18:30:31.406 INFO:tasks.workunit.client.0.smithi038.stdout:5/185: readlink df/d15/l2b 0 2024-09-13T18:30:31.406 INFO:tasks.workunit.client.0.smithi038.stdout:6/187: creat dd/de/d2e/f4b x:0 0 0 2024-09-13T18:30:31.411 INFO:tasks.workunit.client.0.smithi038.stdout:0/168: dwrite d2/d7/f1d [4194304,4194304] 0 2024-09-13T18:30:31.412 INFO:tasks.workunit.client.0.smithi038.stdout:0/169: chown d2/dc/l22 463861 1 2024-09-13T18:30:31.412 INFO:tasks.workunit.client.1.smithi149.stdout:4/956: dwrite df/da0/d70/db5/f137 [0,4194304] 0 2024-09-13T18:30:31.412 INFO:tasks.workunit.client.1.smithi149.stdout:9/778: dwrite d0/d18/d27/d5c/d79/fa1 [0,4194304] 0 2024-09-13T18:30:31.412 INFO:tasks.workunit.client.1.smithi149.stdout:9/779: truncate d0/d9e/f32 5020818 0 2024-09-13T18:30:31.412 INFO:tasks.workunit.client.0.smithi038.stdout:9/261: mknod d0/d7/d13/d2d/d3c/d50/c60 0 2024-09-13T18:30:31.412 INFO:tasks.workunit.client.0.smithi038.stdout:9/262: write d0/d2e/f38 [3967093,67626] 0 2024-09-13T18:30:31.413 INFO:tasks.workunit.client.0.smithi038.stdout:9/263: write d0/d7/d13/f5d [18406,33350] 0 2024-09-13T18:30:31.414 INFO:tasks.workunit.client.1.smithi149.stdout:7/966: unlink d7/d9/d1c/c7d 0 2024-09-13T18:30:31.415 INFO:tasks.workunit.client.1.smithi149.stdout:7/967: write d7/d9/f46 [8362075,156] 0 2024-09-13T18:30:31.415 INFO:tasks.workunit.client.1.smithi149.stdout:8/899: dwrite d2/d13/d3a/d7f/da8/fa9 [0,4194304] 0 2024-09-13T18:30:31.416 INFO:tasks.workunit.client.0.smithi038.stdout:2/220: dwrite d2/d2a/f3d [0,4194304] 0 2024-09-13T18:30:31.417 INFO:tasks.workunit.client.1.smithi149.stdout:1/912: dwrite d9/d10/d34/f51 [0,4194304] 0 2024-09-13T18:30:31.417 INFO:tasks.workunit.client.1.smithi149.stdout:1/913: truncate d9/d10/d34/d53/f7d 670219 0 2024-09-13T18:30:31.417 INFO:tasks.workunit.client.1.smithi149.stdout:1/914: chown d9/d15/d60/d80/d8b/f9b 253954109 1 2024-09-13T18:30:31.417 INFO:tasks.workunit.client.1.smithi149.stdout:0/959: mknod d1/d2/d8a/da9/d117/c14f 0 2024-09-13T18:30:31.417 INFO:tasks.workunit.client.1.smithi149.stdout:0/960: fsync d1/d29/d31/d3e/fd9 0 2024-09-13T18:30:31.418 INFO:tasks.workunit.client.1.smithi149.stdout:2/845: dwrite db/d13/fcf [0,4194304] 0 2024-09-13T18:30:31.420 INFO:tasks.workunit.client.0.smithi038.stdout:6/188: unlink dd/de/d31/c38 0 2024-09-13T18:30:31.420 INFO:tasks.workunit.client.0.smithi038.stdout:6/189: readlink dd/de/d2e/l49 0 2024-09-13T18:30:31.420 INFO:tasks.workunit.client.0.smithi038.stdout:6/190: chown f5 0 1 2024-09-13T18:30:31.420 INFO:tasks.workunit.client.0.smithi038.stdout:6/191: write dd/de/d2e/d30/f29 [616320,116937] 0 2024-09-13T18:30:31.425 INFO:tasks.workunit.client.0.smithi038.stdout:0/170: dread d2/d7/d24/d2b/f37 [0,4194304] 0 2024-09-13T18:30:31.425 INFO:tasks.workunit.client.0.smithi038.stdout:0/171: stat d2/dc/le 0 2024-09-13T18:30:31.425 INFO:tasks.workunit.client.0.smithi038.stdout:0/172: readlink d2/d7/d24/l25 0 2024-09-13T18:30:31.433 INFO:tasks.workunit.client.0.smithi038.stdout:0/173: truncate d2/d7/f13 1294289 0 2024-09-13T18:30:31.436 INFO:tasks.workunit.client.0.smithi038.stdout:0/174: creat d2/dc/f3e x:0 0 0 2024-09-13T18:30:31.436 INFO:tasks.workunit.client.0.smithi038.stdout:0/175: truncate d2/f1c 817800 0 2024-09-13T18:30:31.436 INFO:tasks.workunit.client.0.smithi038.stdout:0/176: readlink d2/d7/d24/l33 0 2024-09-13T18:30:31.439 INFO:tasks.workunit.client.1.smithi149.stdout:8/900: rmdir d2/d12/dd8/d117/dca/dd9 0 2024-09-13T18:30:31.439 INFO:tasks.workunit.client.1.smithi149.stdout:8/901: chown d2/d13/d3a/d7f/f82 202865011 1 2024-09-13T18:30:31.439 INFO:tasks.workunit.client.1.smithi149.stdout:8/902: dread - d2/d12/dd8/d117/f127 zero size 2024-09-13T18:30:31.441 INFO:tasks.workunit.client.1.smithi149.stdout:1/915: symlink d9/d10/d62/l129 0 2024-09-13T18:30:31.442 INFO:tasks.workunit.client.0.smithi038.stdout:9/264: dwrite d0/d7/d2c/d33/f4c [0,4194304] 0 2024-09-13T18:30:31.442 INFO:tasks.workunit.client.1.smithi149.stdout:4/957: write df/da0/d12/d21/d22/d30/d56/fef [1066206,24344] 0 2024-09-13T18:30:31.442 INFO:tasks.workunit.client.1.smithi149.stdout:4/958: write df/da0/dcc/f14e [662541,91917] 0 2024-09-13T18:30:31.444 INFO:tasks.workunit.client.1.smithi149.stdout:0/961: creat d1/d2/d41/df3/f150 x:0 0 0 2024-09-13T18:30:31.449 INFO:tasks.workunit.client.0.smithi038.stdout:9/265: rename d0/fb to d0/d7/d13/d2d/f61 0 2024-09-13T18:30:31.451 INFO:tasks.workunit.client.1.smithi149.stdout:9/780: getdents d0/d18/d27/d5c/d7e 0 2024-09-13T18:30:31.451 INFO:tasks.workunit.client.1.smithi149.stdout:9/781: write d0/d47/d61/fdd [376443,114627] 0 2024-09-13T18:30:31.451 INFO:tasks.workunit.client.1.smithi149.stdout:9/782: readlink d0/d18/d27/d5c/d99/le9 0 2024-09-13T18:30:31.451 INFO:tasks.workunit.client.1.smithi149.stdout:8/903: mknod d2/d12/d87/c12d 0 2024-09-13T18:30:31.451 INFO:tasks.workunit.client.1.smithi149.stdout:8/904: write d2/d12/d2a/d4d/f78 [245572,45692] 0 2024-09-13T18:30:31.452 INFO:tasks.workunit.client.0.smithi038.stdout:9/266: symlink d0/d7/d13/d30/l62 0 2024-09-13T18:30:31.452 INFO:tasks.workunit.client.0.smithi038.stdout:9/267: rename d0 to d0/d2e/d63 22 2024-09-13T18:30:31.454 INFO:tasks.workunit.client.1.smithi149.stdout:1/916: truncate d9/d15/d60/d80/d8b/d42/f5b 3229803 0 2024-09-13T18:30:31.457 INFO:tasks.workunit.client.1.smithi149.stdout:4/959: creat df/da0/d112/d3d/d146/f14f x:0 0 0 2024-09-13T18:30:31.458 INFO:tasks.workunit.client.1.smithi149.stdout:0/962: creat d1/d48/d92/db4/f151 x:0 0 0 2024-09-13T18:30:31.458 INFO:tasks.workunit.client.1.smithi149.stdout:0/963: chown d1/d2/d8a/d90/f124 80 1 2024-09-13T18:30:31.461 INFO:tasks.workunit.client.1.smithi149.stdout:9/783: mknod d0/d2e/d42/d70/d84/cf0 0 2024-09-13T18:30:31.461 INFO:tasks.workunit.client.1.smithi149.stdout:9/784: dread - d0/d18/d93/fce zero size 2024-09-13T18:30:31.461 INFO:tasks.workunit.client.1.smithi149.stdout:7/968: dwrite d7/d76/fb7 [0,4194304] 0 2024-09-13T18:30:31.461 INFO:tasks.workunit.client.1.smithi149.stdout:7/969: truncate d7/d9/d1c/d51/f100 677975 0 2024-09-13T18:30:31.461 INFO:tasks.workunit.client.0.smithi038.stdout:2/221: dwrite d2/d1e/d44/d50/f2e [0,4194304] 0 2024-09-13T18:30:31.463 INFO:tasks.workunit.client.0.smithi038.stdout:6/192: dwrite dd/de/f3c [0,4194304] 0 2024-09-13T18:30:31.465 INFO:tasks.workunit.client.1.smithi149.stdout:2/846: dwrite f4 [0,4194304] 0 2024-09-13T18:30:31.466 INFO:tasks.workunit.client.1.smithi149.stdout:1/917: mkdir d9/d10/d34/d53/d7b/d11d/d12a 0 2024-09-13T18:30:31.470 INFO:tasks.workunit.client.1.smithi149.stdout:0/964: mkdir d1/d2/d8a/da9/d117/d152 0 2024-09-13T18:30:31.472 INFO:tasks.workunit.client.1.smithi149.stdout:9/785: rmdir d0/d47/d61/d9c 0 2024-09-13T18:30:31.474 INFO:tasks.workunit.client.0.smithi038.stdout:2/222: rmdir d2/d2a 39 2024-09-13T18:30:31.474 INFO:tasks.workunit.client.1.smithi149.stdout:7/970: mknod d7/d9/d1c/d51/d52/d86/da3/c156 0 2024-09-13T18:30:31.475 INFO:tasks.workunit.client.0.smithi038.stdout:6/193: rmdir dd/de/d2e/d30/d27 39 2024-09-13T18:30:31.477 INFO:tasks.workunit.client.1.smithi149.stdout:2/847: write db/d13/d70/d118/f14 [1863417,9306] 0 2024-09-13T18:30:31.477 INFO:tasks.workunit.client.1.smithi149.stdout:2/848: read db/d1b/d1c/d20/d2b/f92 [433214,115696] 0 2024-09-13T18:30:31.477 INFO:tasks.workunit.client.1.smithi149.stdout:2/849: truncate db/d1b/d1c/d20/d2b/fd8 1537881 0 2024-09-13T18:30:31.478 INFO:tasks.workunit.client.0.smithi038.stdout:2/223: dread d2/f26 [0,4194304] 0 2024-09-13T18:30:31.478 INFO:tasks.workunit.client.1.smithi149.stdout:1/918: rename d9/d15/c16 to d9/d10/d34/d3c/d50/c12b 0 2024-09-13T18:30:31.479 INFO:tasks.workunit.client.1.smithi149.stdout:8/905: dwrite d2/d12/d40/f75 [0,4194304] 0 2024-09-13T18:30:31.480 INFO:tasks.workunit.client.0.smithi038.stdout:9/268: dwrite d0/d7/d13/d30/f3b [4194304,4194304] 0 2024-09-13T18:30:31.480 INFO:tasks.workunit.client.0.smithi038.stdout:6/194: mkdir dd/de/d2e/d2f/d4c 0 2024-09-13T18:30:31.482 INFO:tasks.workunit.client.1.smithi149.stdout:0/965: symlink d1/d2/d41/l153 0 2024-09-13T18:30:31.484 INFO:tasks.workunit.client.0.smithi038.stdout:2/224: rmdir d2/d1e/d44/d50/d39/d56 0 2024-09-13T18:30:31.487 INFO:tasks.workunit.client.1.smithi149.stdout:7/971: mkdir d7/d76/db3/d149/d157 0 2024-09-13T18:30:31.490 INFO:tasks.workunit.client.0.smithi038.stdout:6/195: dread dd/f11 [0,4194304] 0 2024-09-13T18:30:31.490 INFO:tasks.workunit.client.0.smithi038.stdout:6/196: write f5 [464886,28031] 0 2024-09-13T18:30:31.490 INFO:tasks.workunit.client.0.smithi038.stdout:6/197: fsync dd/de/d2e/d30/f42 0 2024-09-13T18:30:31.491 INFO:tasks.workunit.client.0.smithi038.stdout:9/269: creat d0/d7/d2c/d5a/f64 x:0 0 0 2024-09-13T18:30:31.493 INFO:tasks.workunit.client.1.smithi149.stdout:2/850: link db/d13/d70/dad/ff8 db/f11d 0 2024-09-13T18:30:31.494 INFO:tasks.workunit.client.0.smithi038.stdout:2/225: mkdir d2/d1e/d44/d50/d46/d58 0 2024-09-13T18:30:31.495 INFO:tasks.workunit.client.1.smithi149.stdout:1/919: write d9/f3d [2032023,129255] 0 2024-09-13T18:30:31.495 INFO:tasks.workunit.client.1.smithi149.stdout:1/920: read d9/d15/d60/d80/d8b/f31 [745382,92267] 0 2024-09-13T18:30:31.495 INFO:tasks.workunit.client.1.smithi149.stdout:1/921: chown d9/d15/d60/da5/fd4 1389943239 1 2024-09-13T18:30:31.498 INFO:tasks.workunit.client.0.smithi038.stdout:6/198: creat dd/de/d2e/d2f/d4c/f4d x:0 0 0 2024-09-13T18:30:31.498 INFO:tasks.workunit.client.0.smithi038.stdout:6/199: dread - dd/de/d2e/d30/d27/f43 zero size 2024-09-13T18:30:31.498 INFO:tasks.workunit.client.1.smithi149.stdout:4/960: dwrite df/da0/d112/d3d/f40 [0,4194304] 0 2024-09-13T18:30:31.499 INFO:tasks.workunit.client.0.smithi038.stdout:9/270: creat d0/d7/d13/d2d/d3c/d50/f65 x:0 0 0 2024-09-13T18:30:31.501 INFO:tasks.workunit.client.0.smithi038.stdout:2/226: mkdir d2/d1e/d44/d50/d46/d58/d59 0 2024-09-13T18:30:31.504 INFO:tasks.workunit.client.0.smithi038.stdout:9/271: unlink d0/d7/d2c/d33/l37 0 2024-09-13T18:30:31.504 INFO:tasks.workunit.client.0.smithi038.stdout:9/272: creat d0/d7/d13/f66 x:0 0 0 2024-09-13T18:30:31.504 INFO:tasks.workunit.client.0.smithi038.stdout:9/273: truncate d0/d7/d13/f58 284415 0 2024-09-13T18:30:31.505 INFO:tasks.workunit.client.0.smithi038.stdout:2/227: creat d2/d1e/d44/d50/d46/d58/d59/f5a x:0 0 0 2024-09-13T18:30:31.506 INFO:tasks.workunit.client.0.smithi038.stdout:9/274: dread d0/d7/d13/f58 [0,4194304] 0 2024-09-13T18:30:31.506 INFO:tasks.workunit.client.0.smithi038.stdout:9/275: readlink d0/d7/d13/d30/l53 0 2024-09-13T18:30:31.509 INFO:tasks.workunit.client.1.smithi149.stdout:9/786: dwrite d0/d18/d27/d5c/d7e/f97 [0,4194304] 0 2024-09-13T18:30:31.509 INFO:tasks.workunit.client.1.smithi149.stdout:0/966: dwrite d1/d29/fee [0,4194304] 0 2024-09-13T18:30:31.509 INFO:tasks.workunit.client.1.smithi149.stdout:9/787: write d0/d2e/d42/d70/d84/dea/feb [587230,94198] 0 2024-09-13T18:30:31.510 INFO:tasks.workunit.client.0.smithi038.stdout:2/228: creat d2/d1e/d44/d50/d39/d52/f5b x:0 0 0 2024-09-13T18:30:31.511 INFO:tasks.workunit.client.0.smithi038.stdout:9/276: mkdir d0/d7/d2c/d5a/d67 0 2024-09-13T18:30:31.515 INFO:tasks.workunit.client.0.smithi038.stdout:9/277: mknod d0/d7/d13/d2d/d3c/c68 0 2024-09-13T18:30:31.515 INFO:tasks.workunit.client.0.smithi038.stdout:9/278: chown d0/d7/l46 0 1 2024-09-13T18:30:31.519 INFO:tasks.workunit.client.0.smithi038.stdout:6/200: dwrite dd/de/d2e/d2f/f39 [0,4194304] 0 2024-09-13T18:30:31.519 INFO:tasks.workunit.client.1.smithi149.stdout:8/906: unlink d2/d12/dd8/d117/f127 0 2024-09-13T18:30:31.519 INFO:tasks.workunit.client.1.smithi149.stdout:8/907: chown d2/d13/d3a/l93 4119 1 2024-09-13T18:30:31.519 INFO:tasks.workunit.client.1.smithi149.stdout:8/908: write d2/d13/d3a/d7f/da8/fce [65905,32582] 0 2024-09-13T18:30:31.520 INFO:tasks.workunit.client.1.smithi149.stdout:2/851: rename db/d1b/d1c/d20/f115 to db/d1b/d6c/dc8/f11e 0 2024-09-13T18:30:31.521 INFO:tasks.workunit.client.1.smithi149.stdout:2/852: chown db/d1b/d1c/d20/cbf 4834 1 2024-09-13T18:30:31.524 INFO:tasks.workunit.client.0.smithi038.stdout:6/201: rename dd/de/d4a to dd/de/d2e/d2f/d4e 0 2024-09-13T18:30:31.524 INFO:tasks.workunit.client.1.smithi149.stdout:1/922: link d9/d15/d60/da5/ce9 d9/d10/dca/c12c 0 2024-09-13T18:30:31.527 INFO:tasks.workunit.client.1.smithi149.stdout:4/961: symlink df/da0/d12/d7c/d109/l150 0 2024-09-13T18:30:31.535 INFO:tasks.workunit.client.1.smithi149.stdout:0/967: link d1/d29/d31/d83/d87/l11a d1/d2/d4e/l154 0 2024-09-13T18:30:31.537 INFO:tasks.workunit.client.1.smithi149.stdout:9/788: creat d0/d9e/dc5/ff1 x:0 0 0 2024-09-13T18:30:31.538 INFO:tasks.workunit.client.1.smithi149.stdout:8/909: truncate d2/d12/dd8/f4c 3949584 0 2024-09-13T18:30:31.540 INFO:tasks.workunit.client.1.smithi149.stdout:4/962: creat df/da0/d70/db5/f151 x:0 0 0 2024-09-13T18:30:31.545 INFO:tasks.workunit.client.1.smithi149.stdout:8/910: creat d2/d12/d87/f12e x:0 0 0 2024-09-13T18:30:31.545 INFO:tasks.workunit.client.0.smithi038.stdout:2/229: getdents d2/d1e/d44/d50/d46/d58/d59 0 2024-09-13T18:30:31.547 INFO:tasks.workunit.client.1.smithi149.stdout:4/963: symlink df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3/dc8/d12d/l152 0 2024-09-13T18:30:31.548 INFO:tasks.workunit.client.0.smithi038.stdout:2/230: mkdir d2/d5c 0 2024-09-13T18:30:31.549 INFO:tasks.workunit.client.1.smithi149.stdout:0/968: mknod d1/d29/d31/c155 0 2024-09-13T18:30:31.550 INFO:tasks.workunit.client.1.smithi149.stdout:4/964: symlink df/da0/d1c/l153 0 2024-09-13T18:30:31.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/969: mknod d1/d29/d31/d44/d81/d62/d102/d13d/c156 0 2024-09-13T18:30:31.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/970: write d1/f10 [554698,52387] 0 2024-09-13T18:30:31.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/971: chown d1/fbf 219122 1 2024-09-13T18:30:31.552 INFO:tasks.workunit.client.1.smithi149.stdout:0/972: fdatasync d1/d1b/f56 0 2024-09-13T18:30:31.555 INFO:tasks.workunit.client.1.smithi149.stdout:0/973: dread d1/d2/fe4 [0,4194304] 0 2024-09-13T18:30:31.557 INFO:tasks.workunit.client.1.smithi149.stdout:0/974: symlink d1/d2/d8a/da9/l157 0 2024-09-13T18:30:31.557 INFO:tasks.workunit.client.1.smithi149.stdout:0/975: creat d1/d2/d41/d46/d7b/d98/f158 x:0 0 0 2024-09-13T18:30:31.557 INFO:tasks.workunit.client.1.smithi149.stdout:0/976: write d1/d29/d31/d3e/d137/f14c [667562,100443] 0 2024-09-13T18:30:31.559 INFO:tasks.workunit.client.0.smithi038.stdout:9/279: dwrite d0/d7/d13/d2d/d3c/f5b [0,4194304] 0 2024-09-13T18:30:31.559 INFO:tasks.workunit.client.1.smithi149.stdout:0/977: mknod d1/d29/d31/d44/d81/d9f/c159 0 2024-09-13T18:30:31.559 INFO:tasks.workunit.client.1.smithi149.stdout:0/978: stat d1/f5 0 2024-09-13T18:30:31.559 INFO:tasks.workunit.client.1.smithi149.stdout:0/979: creat d1/d29/d31/d44/d47/f15a x:0 0 0 2024-09-13T18:30:31.561 INFO:tasks.workunit.client.1.smithi149.stdout:0/980: link d1/d29/lec d1/d2/d41/d46/d7b/d10b/l15b 0 2024-09-13T18:30:31.562 INFO:tasks.workunit.client.1.smithi149.stdout:3/876: sync 2024-09-13T18:30:31.562 INFO:tasks.workunit.client.1.smithi149.stdout:5/838: sync 2024-09-13T18:30:31.562 INFO:tasks.workunit.client.1.smithi149.stdout:5/839: fdatasync d3/d10/d98/dfb/d54/db9/fdb 0 2024-09-13T18:30:31.562 INFO:tasks.workunit.client.1.smithi149.stdout:2/853: dwrite db/d1b/d6c/d10c/f119 [0,4194304] 0 2024-09-13T18:30:31.564 INFO:tasks.workunit.client.1.smithi149.stdout:4/965: dread df/da0/d112/f49 [0,4194304] 0 2024-09-13T18:30:31.565 INFO:tasks.workunit.client.0.smithi038.stdout:6/202: dwrite dd/de/d2e/f4b [0,4194304] 0 2024-09-13T18:30:31.565 INFO:tasks.workunit.client.0.smithi038.stdout:6/203: fdatasync dd/f11 0 2024-09-13T18:30:31.565 INFO:tasks.workunit.client.0.smithi038.stdout:6/204: dread - dd/f44 zero size 2024-09-13T18:30:31.565 INFO:tasks.workunit.client.0.smithi038.stdout:6/205: creat dd/de/f4f x:0 0 0 2024-09-13T18:30:31.566 INFO:tasks.workunit.client.1.smithi149.stdout:3/877: creat d1/d2e/d1d/d6c/f137 x:0 0 0 2024-09-13T18:30:31.566 INFO:tasks.workunit.client.1.smithi149.stdout:3/878: readlink d1/d2e/d1d/d9a/l1e 0 2024-09-13T18:30:31.566 INFO:tasks.workunit.client.1.smithi149.stdout:3/879: fsync d1/d2e/d6f/daf/de8/f108 0 2024-09-13T18:30:31.566 INFO:tasks.workunit.client.1.smithi149.stdout:1/923: dwrite d9/d10/fbc [0,4194304] 0 2024-09-13T18:30:31.567 INFO:tasks.workunit.client.1.smithi149.stdout:1/924: dread - d9/d10/d34/d3c/d50/f126 zero size 2024-09-13T18:30:31.567 INFO:tasks.workunit.client.0.smithi038.stdout:0/177: truncate d2/d2f/f30 72697 0 2024-09-13T18:30:31.567 INFO:tasks.workunit.client.0.smithi038.stdout:0/178: chown d2/d7/f9 7 1 2024-09-13T18:30:31.567 INFO:tasks.workunit.client.1.smithi149.stdout:8/911: write d2/d5b/f114 [8317531,126784] 0 2024-09-13T18:30:31.569 INFO:tasks.workunit.client.1.smithi149.stdout:5/840: creat d3/d10/d4c/d4e/f106 x:0 0 0 2024-09-13T18:30:31.572 INFO:tasks.workunit.client.0.smithi038.stdout:2/231: write d2/da/f28 [760053,70412] 0 2024-09-13T18:30:31.578 INFO:tasks.workunit.client.1.smithi149.stdout:4/966: getdents df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3 0 2024-09-13T18:30:31.581 INFO:tasks.workunit.client.0.smithi038.stdout:2/232: rename d2/da/f15 to d2/d1e/d44/d50/d39/f5d 0 2024-09-13T18:30:31.582 INFO:tasks.workunit.client.1.smithi149.stdout:1/925: creat d9/d10/d101/f12d x:0 0 0 2024-09-13T18:30:31.584 INFO:tasks.workunit.client.0.smithi038.stdout:6/206: rmdir dd/de/d2e/d2f/d4c 39 2024-09-13T18:30:31.584 INFO:tasks.workunit.client.0.smithi038.stdout:6/207: truncate dd/de/d2e/d30/f42 210568 0 2024-09-13T18:30:31.585 INFO:tasks.workunit.client.0.smithi038.stdout:9/280: dwrite d0/d7/d13/f19 [0,4194304] 0 2024-09-13T18:30:31.588 INFO:tasks.workunit.client.0.smithi038.stdout:2/233: symlink d2/d1e/d44/l5e 0 2024-09-13T18:30:31.591 INFO:tasks.workunit.client.0.smithi038.stdout:6/208: creat dd/de/d2e/d2f/d4c/f50 x:0 0 0 2024-09-13T18:30:31.592 INFO:tasks.workunit.client.1.smithi149.stdout:8/912: mknod d2/d13/d3a/d7f/da8/c12f 0 2024-09-13T18:30:31.592 INFO:tasks.workunit.client.1.smithi149.stdout:8/913: chown d2/d13/d3a/d7f/d8d 14307 1 2024-09-13T18:30:31.595 INFO:tasks.workunit.client.1.smithi149.stdout:5/841: link d3/d10/d4c/f81 d3/d10/d98/dfb/d54/d76/f107 0 2024-09-13T18:30:31.595 INFO:tasks.workunit.client.1.smithi149.stdout:5/842: readlink d3/d10/d98/lb2 0 2024-09-13T18:30:31.596 INFO:tasks.workunit.client.0.smithi038.stdout:9/281: mkdir d0/d7/d2c/d5a/d69 0 2024-09-13T18:30:31.597 INFO:tasks.workunit.client.1.smithi149.stdout:8/914: write d2/d12/f16 [427956,68217] 0 2024-09-13T18:30:31.597 INFO:tasks.workunit.client.1.smithi149.stdout:4/967: getdents df/da0/d12/d21/d22/d30/d41/d57/d60/dc4 0 2024-09-13T18:30:31.602 INFO:tasks.workunit.client.1.smithi149.stdout:1/926: creat d9/d10/d83/d97/d111/f12e x:0 0 0 2024-09-13T18:30:31.602 INFO:tasks.workunit.client.1.smithi149.stdout:1/927: fdatasync d9/d10/d34/d53/d57/f98 0 2024-09-13T18:30:31.603 INFO:tasks.workunit.client.1.smithi149.stdout:4/968: rmdir df/da0/d12/d21/d22/d30/d41/d110 39 2024-09-13T18:30:31.603 INFO:tasks.workunit.client.0.smithi038.stdout:0/179: dwrite d2/f5 [0,4194304] 0 2024-09-13T18:30:31.604 INFO:tasks.workunit.client.1.smithi149.stdout:1/928: dread d9/d10/d34/d53/f82 [0,4194304] 0 2024-09-13T18:30:31.605 INFO:tasks.workunit.client.1.smithi149.stdout:2/854: dwrite db/d13/d70/d118/f2c [0,4194304] 0 2024-09-13T18:30:31.605 INFO:tasks.workunit.client.1.smithi149.stdout:9/789: dwrite d0/d9e/f24 [0,4194304] 0 2024-09-13T18:30:31.606 INFO:tasks.workunit.client.1.smithi149.stdout:2/855: getdents db/d1b/d6c/d117 0 2024-09-13T18:30:31.606 INFO:tasks.workunit.client.1.smithi149.stdout:4/969: truncate df/da0/d12/d7c/d9a/fc3 1547993 0 2024-09-13T18:30:31.606 INFO:tasks.workunit.client.1.smithi149.stdout:9/790: truncate d0/d2e/f62 121860 0 2024-09-13T18:30:31.607 INFO:tasks.workunit.client.1.smithi149.stdout:1/929: rename d9/d15/f5e to d9/d10/d3f/dc9/ddf/f12f 0 2024-09-13T18:30:31.610 INFO:tasks.workunit.client.1.smithi149.stdout:2/856: symlink db/d1b/d2f/d69/deb/l11f 0 2024-09-13T18:30:31.611 INFO:tasks.workunit.client.1.smithi149.stdout:5/843: write d3/d10/d98/dfb/d67/f86 [755436,83301] 0 2024-09-13T18:30:31.611 INFO:tasks.workunit.client.1.smithi149.stdout:5/844: chown d3/d10/d98/dfb/d54/c51 85890 1 2024-09-13T18:30:31.613 INFO:tasks.workunit.client.1.smithi149.stdout:4/970: creat df/da0/d12/d21/d22/d30/d41/d57/d60/d11f/f154 x:0 0 0 2024-09-13T18:30:31.613 INFO:tasks.workunit.client.1.smithi149.stdout:4/971: fsync df/da0/d12/f3c 0 2024-09-13T18:30:31.619 INFO:tasks.workunit.client.0.smithi038.stdout:6/209: dwrite dd/de/d2e/f4b [0,4194304] 0 2024-09-13T18:30:31.619 INFO:tasks.workunit.client.0.smithi038.stdout:6/210: creat dd/de/d2e/d2f/f51 x:0 0 0 2024-09-13T18:30:31.619 INFO:tasks.workunit.client.0.smithi038.stdout:6/211: creat dd/de/d31/f52 x:0 0 0 2024-09-13T18:30:31.619 INFO:tasks.workunit.client.0.smithi038.stdout:6/212: dread - dd/de/f2c zero size 2024-09-13T18:30:31.619 INFO:tasks.workunit.client.0.smithi038.stdout:6/213: truncate dd/de/d2e/d2f/d4c/f50 966404 0 2024-09-13T18:30:31.619 INFO:tasks.workunit.client.1.smithi149.stdout:9/791: dread d0/d18/d27/d5c/d79/fa1 [0,4194304] 0 2024-09-13T18:30:31.626 INFO:tasks.workunit.client.1.smithi149.stdout:1/930: mknod d9/d15/d40/d90/c130 0 2024-09-13T18:30:31.626 INFO:tasks.workunit.client.1.smithi149.stdout:1/931: chown d9/d15/d40/d90 0 1 2024-09-13T18:30:31.626 INFO:tasks.workunit.client.1.smithi149.stdout:1/932: read d9/d15/d60/d80/dcd/dab/df3/f114 [554057,90544] 0 2024-09-13T18:30:31.630 INFO:tasks.workunit.client.0.smithi038.stdout:0/180: dwrite d2/d7/f21 [0,4194304] 0 2024-09-13T18:30:31.631 INFO:tasks.workunit.client.1.smithi149.stdout:2/857: dwrite db/d13/d70/d89/fa2 [0,4194304] 0 2024-09-13T18:30:31.631 INFO:tasks.workunit.client.1.smithi149.stdout:5/845: rename d3/d10/d98/dfb/d54/d76/d7a/fe6 to d3/d10/d98/dfb/d54/d97/dba/df8/f108 0 2024-09-13T18:30:31.634 INFO:tasks.workunit.client.1.smithi149.stdout:4/972: link df/da0/d1c/d7e/d9f/f13a df/da0/d12/d21/d22/d30/d41/d57/d75/da1/f155 0 2024-09-13T18:30:31.635 INFO:tasks.workunit.client.0.smithi038.stdout:6/214: getdents dd/de/d2e/d30 0 2024-09-13T18:30:31.636 INFO:tasks.workunit.client.1.smithi149.stdout:9/792: creat d0/d9e/d3b/ff2 x:0 0 0 2024-09-13T18:30:31.639 INFO:tasks.workunit.client.0.smithi038.stdout:0/181: mkdir d2/d7/d24/d3c/d3f 0 2024-09-13T18:30:31.642 INFO:tasks.workunit.client.0.smithi038.stdout:6/215: creat dd/de/d2e/d30/d27/f53 x:0 0 0 2024-09-13T18:30:31.643 INFO:tasks.workunit.client.1.smithi149.stdout:9/793: symlink d0/d18/d68/db2/dc9/lf3 0 2024-09-13T18:30:31.643 INFO:tasks.workunit.client.1.smithi149.stdout:9/794: truncate d0/d47/f89 423502 0 2024-09-13T18:30:31.646 INFO:tasks.workunit.client.0.smithi038.stdout:6/216: truncate dd/f16 3810286 0 2024-09-13T18:30:31.646 INFO:tasks.workunit.client.0.smithi038.stdout:6/217: getdents dd/de/d2e/d2f/d4e 0 2024-09-13T18:30:31.646 INFO:tasks.workunit.client.0.smithi038.stdout:6/218: fdatasync dd/de/d2e/d2f/f51 0 2024-09-13T18:30:31.648 INFO:tasks.workunit.client.1.smithi149.stdout:7/972: sync 2024-09-13T18:30:31.648 INFO:tasks.workunit.client.1.smithi149.stdout:7/973: chown d7/d9/d1c/d1f/d21/d49/c7e 12589717 1 2024-09-13T18:30:31.649 INFO:tasks.workunit.client.1.smithi149.stdout:5/846: dwrite d3/d10/f23 [0,4194304] 0 2024-09-13T18:30:31.649 INFO:tasks.workunit.client.0.smithi038.stdout:6/219: unlink f5 0 2024-09-13T18:30:31.652 INFO:tasks.workunit.client.1.smithi149.stdout:5/847: mknod d3/d10/d4c/d4e/d61/d63/c109 0 2024-09-13T18:30:31.654 INFO:tasks.workunit.client.1.smithi149.stdout:1/933: dread d9/d15/d60/d80/d8b/d42/f5b [0,4194304] 0 2024-09-13T18:30:31.654 INFO:tasks.workunit.client.1.smithi149.stdout:5/848: symlink d3/d8/d6d/d91/l10a 0 2024-09-13T18:30:31.654 INFO:tasks.workunit.client.1.smithi149.stdout:5/849: creat d3/d10/d98/f10b x:0 0 0 2024-09-13T18:30:31.657 INFO:tasks.workunit.client.1.smithi149.stdout:1/934: stat d9/d15/d60/lcc 0 2024-09-13T18:30:31.664 INFO:tasks.workunit.client.1.smithi149.stdout:5/850: dread d3/d10/d98/dfb/f3c [0,4194304] 0 2024-09-13T18:30:31.664 INFO:tasks.workunit.client.1.smithi149.stdout:5/851: readlink d3/d8/d13/l5f 0 2024-09-13T18:30:31.668 INFO:tasks.workunit.client.0.smithi038.stdout:6/220: dread dd/de/f3c [0,4194304] 0 2024-09-13T18:30:31.681 INFO:tasks.workunit.client.1.smithi149.stdout:5/852: write d3/d10/d98/dfb/d54/f9e [2076603,23927] 0 2024-09-13T18:30:31.682 INFO:tasks.workunit.client.0.smithi038.stdout:6/221: read dd/de/f1a [1152936,126185] 0 2024-09-13T18:30:31.682 INFO:tasks.workunit.client.0.smithi038.stdout:6/222: creat dd/de/d31/f54 x:0 0 0 2024-09-13T18:30:31.682 INFO:tasks.workunit.client.1.smithi149.stdout:5/853: link d3/d10/d98/dfb/d54/d97/fd9 d3/d10/d4c/d4e/d61/f10c 0 2024-09-13T18:30:31.684 INFO:tasks.workunit.client.1.smithi149.stdout:9/795: dwrite d0/d9e/dc5/ff1 [0,4194304] 0 2024-09-13T18:30:31.684 INFO:tasks.workunit.client.0.smithi038.stdout:0/182: dwrite d2/d7/f1d [0,4194304] 0 2024-09-13T18:30:31.685 INFO:tasks.workunit.client.1.smithi149.stdout:5/854: link d3/d10/d98/dfb/l4a d3/d10/d98/dfb/d54/d76/d7a/l10d 0 2024-09-13T18:30:31.685 INFO:tasks.workunit.client.1.smithi149.stdout:4/973: dwrite df/da0/d112/d3d/fd4 [0,4194304] 0 2024-09-13T18:30:31.685 INFO:tasks.workunit.client.1.smithi149.stdout:4/974: creat df/da0/d12/d21/d22/d30/d41/d57/f156 x:0 0 0 2024-09-13T18:30:31.685 INFO:tasks.workunit.client.1.smithi149.stdout:4/975: chown df/da0/dcc/c12e 535496 1 2024-09-13T18:30:31.686 INFO:tasks.workunit.client.1.smithi149.stdout:1/935: dwrite d9/d15/d60/d80/dcd/dab/df3/f114 [0,4194304] 0 2024-09-13T18:30:31.689 INFO:tasks.workunit.client.0.smithi038.stdout:6/223: rmdir dd/de/d2e 39 2024-09-13T18:30:31.690 INFO:tasks.workunit.client.1.smithi149.stdout:5/855: dread d3/d10/d4c/d4e/d61/d75/d88/faf [0,4194304] 0 2024-09-13T18:30:31.691 INFO:tasks.workunit.client.0.smithi038.stdout:0/183: mkdir d2/d2f/d40 0 2024-09-13T18:30:31.694 INFO:tasks.workunit.client.0.smithi038.stdout:6/224: mkdir dd/de/d2e/d2f/d4c/d55 0 2024-09-13T18:30:31.694 INFO:tasks.workunit.client.0.smithi038.stdout:6/225: stat dd/de/d2e 0 2024-09-13T18:30:31.694 INFO:tasks.workunit.client.0.smithi038.stdout:6/226: dread - dd/de/f4f zero size 2024-09-13T18:30:31.698 INFO:tasks.workunit.client.0.smithi038.stdout:6/227: unlink dd/de/d2e/d2f/f3b 0 2024-09-13T18:30:31.699 INFO:tasks.workunit.client.1.smithi149.stdout:0/981: sync 2024-09-13T18:30:31.699 INFO:tasks.workunit.client.1.smithi149.stdout:9/796: write d0/d2e/f58 [443013,128042] 0 2024-09-13T18:30:31.699 INFO:tasks.workunit.client.1.smithi149.stdout:0/982: truncate d1/d29/d31/d44/d81/d62/ff7 774461 0 2024-09-13T18:30:31.699 INFO:tasks.workunit.client.1.smithi149.stdout:9/797: creat d0/d18/d93/ff4 x:0 0 0 2024-09-13T18:30:31.699 INFO:tasks.workunit.client.1.smithi149.stdout:4/976: creat df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3/dc8/f157 x:0 0 0 2024-09-13T18:30:31.701 INFO:tasks.workunit.client.0.smithi038.stdout:0/184: rename d2/c1b to d2/d7/d24/d3c/d3f/c41 0 2024-09-13T18:30:31.703 INFO:tasks.workunit.client.0.smithi038.stdout:0/185: dread - d2/f1e zero size 2024-09-13T18:30:31.703 INFO:tasks.workunit.client.0.smithi038.stdout:0/186: chown d2/d7/d24/c29 108186 1 2024-09-13T18:30:31.703 INFO:tasks.workunit.client.0.smithi038.stdout:0/187: readlink d2/d7/d24/l33 0 2024-09-13T18:30:31.706 INFO:tasks.workunit.client.0.smithi038.stdout:0/188: mknod d2/d7/d24/d3c/c42 0 2024-09-13T18:30:31.706 INFO:tasks.workunit.client.0.smithi038.stdout:0/189: creat d2/d7/d24/d2b/f43 x:0 0 0 2024-09-13T18:30:31.706 INFO:tasks.workunit.client.1.smithi149.stdout:0/983: mknod d1/d29/d31/d3e/d108/c15c 0 2024-09-13T18:30:31.709 INFO:tasks.workunit.client.1.smithi149.stdout:1/936: dwrite d9/d10/d34/dbe/d38/f127 [0,4194304] 0 2024-09-13T18:30:31.709 INFO:tasks.workunit.client.1.smithi149.stdout:1/937: stat d9/d10/d34/dbe/d38/l94 0 2024-09-13T18:30:31.709 INFO:tasks.workunit.client.1.smithi149.stdout:9/798: creat d0/d18/d27/d5c/d7e/ff5 x:0 0 0 2024-09-13T18:30:31.711 INFO:tasks.workunit.client.1.smithi149.stdout:4/977: symlink df/da0/d1c/d7e/l158 0 2024-09-13T18:30:31.711 INFO:tasks.workunit.client.1.smithi149.stdout:4/978: write fc [2486042,48889] 0 2024-09-13T18:30:31.712 INFO:tasks.workunit.client.0.smithi038.stdout:0/190: mkdir d2/d2f/d44 0 2024-09-13T18:30:31.712 INFO:tasks.workunit.client.1.smithi149.stdout:9/799: dread d0/d18/d27/d5c/d7e/fcc [0,4194304] 0 2024-09-13T18:30:31.713 INFO:tasks.workunit.client.1.smithi149.stdout:5/856: dwrite d3/d10/d98/dfb/d54/d97/fee [8388608,4194304] 0 2024-09-13T18:30:31.718 INFO:tasks.workunit.client.0.smithi038.stdout:0/191: mknod d2/dc/c45 0 2024-09-13T18:30:31.718 INFO:tasks.workunit.client.0.smithi038.stdout:6/228: dwrite dd/de/d31/f54 [0,4194304] 0 2024-09-13T18:30:31.719 INFO:tasks.workunit.client.1.smithi149.stdout:9/800: unlink d0/d18/ca5 0 2024-09-13T18:30:31.723 INFO:tasks.workunit.client.1.smithi149.stdout:0/984: dread d1/d2/d8a/da9/fc3 [0,4194304] 0 2024-09-13T18:30:31.723 INFO:tasks.workunit.client.1.smithi149.stdout:0/985: dread - d1/d2/fdb zero size 2024-09-13T18:30:31.725 INFO:tasks.workunit.client.1.smithi149.stdout:5/857: rename d3/d10/d98/dfb/f38 to d3/d10/d98/dfb/d54/f10e 0 2024-09-13T18:30:31.727 INFO:tasks.workunit.client.1.smithi149.stdout:9/801: mkdir d0/d18/d68/df6 0 2024-09-13T18:30:31.727 INFO:tasks.workunit.client.1.smithi149.stdout:9/802: write d0/d9e/d3b/f4f [1263247,10723] 0 2024-09-13T18:30:31.728 INFO:tasks.workunit.client.1.smithi149.stdout:0/986: creat d1/d29/d31/d44/d47/dfb/d148/f15d x:0 0 0 2024-09-13T18:30:31.729 INFO:tasks.workunit.client.0.smithi038.stdout:0/192: read d2/dc/f39 [2734095,1873] 0 2024-09-13T18:30:31.729 INFO:tasks.workunit.client.0.smithi038.stdout:0/193: creat d2/d7/d24/d3c/f46 x:0 0 0 2024-09-13T18:30:31.729 INFO:tasks.workunit.client.0.smithi038.stdout:0/194: chown d2/d7/l2c 10403 1 2024-09-13T18:30:31.729 INFO:tasks.workunit.client.0.smithi038.stdout:6/229: symlink dd/de/d2e/l56 0 2024-09-13T18:30:31.743 INFO:tasks.workunit.client.1.smithi149.stdout:5/858: mknod d3/d10/d98/dfb/d54/d97/c10f 0 2024-09-13T18:30:31.743 INFO:tasks.workunit.client.0.smithi038.stdout:0/195: write d2/f15 [6249861,32897] 0 2024-09-13T18:30:31.744 INFO:tasks.workunit.client.1.smithi149.stdout:1/938: dwrite d9/d10/d83/d97/f9a [0,4194304] 0 2024-09-13T18:30:31.744 INFO:tasks.workunit.client.1.smithi149.stdout:1/939: fdatasync d9/d10/d3f/f67 0 2024-09-13T18:30:31.745 INFO:tasks.workunit.client.1.smithi149.stdout:9/803: rename d0/d2e/d42/f5e to d0/d18/d81/ff7 0 2024-09-13T18:30:31.746 INFO:tasks.workunit.client.1.smithi149.stdout:9/804: write d0/f9 [5515322,84800] 0 2024-09-13T18:30:31.747 INFO:tasks.workunit.client.0.smithi038.stdout:6/230: creat dd/de/d2e/d2f/d4c/d55/f57 x:0 0 0 2024-09-13T18:30:31.748 INFO:tasks.workunit.client.0.smithi038.stdout:0/196: link d2/f1c d2/d2f/f47 0 2024-09-13T18:30:31.750 INFO:tasks.workunit.client.1.smithi149.stdout:5/859: read d3/f95 [3537752,90299] 0 2024-09-13T18:30:31.750 INFO:tasks.workunit.client.1.smithi149.stdout:4/979: dwrite df/da0/d12/d21/d22/d30/d41/d57/f127 [0,4194304] 0 2024-09-13T18:30:31.750 INFO:tasks.workunit.client.1.smithi149.stdout:4/980: chown df/da0/d12/d21/d22/d30/d41/d57/d75/da1/f138 33552653 1 2024-09-13T18:30:31.750 INFO:tasks.workunit.client.1.smithi149.stdout:0/987: rename d1/d48/d92/d10c/d142/l14b to d1/d48/d92/d10c/l15e 0 2024-09-13T18:30:31.752 INFO:tasks.workunit.client.1.smithi149.stdout:5/860: chown d3/f8b 21609 1 2024-09-13T18:30:31.752 INFO:tasks.workunit.client.1.smithi149.stdout:5/861: write d3/f8b [466392,39901] 0 2024-09-13T18:30:31.753 INFO:tasks.workunit.client.0.smithi038.stdout:0/197: getdents d2/d7/d24/d2b 0 2024-09-13T18:30:31.755 INFO:tasks.workunit.client.1.smithi149.stdout:8/915: sync 2024-09-13T18:30:31.755 INFO:tasks.workunit.client.1.smithi149.stdout:3/880: sync 2024-09-13T18:30:31.755 INFO:tasks.workunit.client.1.smithi149.stdout:8/916: write d2/d12/d2a/d4d/f78 [24579,100782] 0 2024-09-13T18:30:31.756 INFO:tasks.workunit.client.0.smithi038.stdout:6/231: read dd/de/d31/f54 [1358900,113934] 0 2024-09-13T18:30:31.756 INFO:tasks.workunit.client.0.smithi038.stdout:0/198: symlink d2/d7/d24/l48 0 2024-09-13T18:30:31.758 INFO:tasks.workunit.client.0.smithi038.stdout:6/232: link dd/de/d31/f52 dd/de/d2e/f58 0 2024-09-13T18:30:31.760 INFO:tasks.workunit.client.0.smithi038.stdout:0/199: mkdir d2/d2f/d44/d49 0 2024-09-13T18:30:31.760 INFO:tasks.workunit.client.0.smithi038.stdout:0/200: chown d2/d7/d24/l48 21 1 2024-09-13T18:30:31.760 INFO:tasks.workunit.client.0.smithi038.stdout:0/201: dread - d2/d7/f31 zero size 2024-09-13T18:30:31.760 INFO:tasks.workunit.client.0.smithi038.stdout:0/202: creat d2/d7/f4a x:0 0 0 2024-09-13T18:30:31.760 INFO:tasks.workunit.client.0.smithi038.stdout:0/203: chown d2/d7/l2c 1 1 2024-09-13T18:30:31.762 INFO:tasks.workunit.client.0.smithi038.stdout:0/204: dread d2/d2f/f47 [0,4194304] 0 2024-09-13T18:30:31.763 INFO:tasks.workunit.client.0.smithi038.stdout:6/233: creat dd/de/d2e/d30/f59 x:0 0 0 2024-09-13T18:30:31.763 INFO:tasks.workunit.client.0.smithi038.stdout:6/234: chown dd/de/d2e/f4b 366236 1 2024-09-13T18:30:31.765 INFO:tasks.workunit.client.1.smithi149.stdout:8/917: read d2/d12/dd8/f3c [1650868,66094] 0 2024-09-13T18:30:31.767 INFO:tasks.workunit.client.0.smithi038.stdout:6/235: creat dd/de/d2e/d2f/d4e/f5a x:0 0 0 2024-09-13T18:30:31.767 INFO:tasks.workunit.client.0.smithi038.stdout:6/236: creat dd/de/d2e/d2f/d4c/d55/f5b x:0 0 0 2024-09-13T18:30:31.769 INFO:tasks.workunit.client.1.smithi149.stdout:4/981: mkdir df/da0/d12/d7c/d159 0 2024-09-13T18:30:31.770 INFO:tasks.workunit.client.0.smithi038.stdout:0/205: write d2/f5 [3414380,94445] 0 2024-09-13T18:30:31.770 INFO:tasks.workunit.client.0.smithi038.stdout:0/206: readlink d2/dc/l1f 0 2024-09-13T18:30:31.772 INFO:tasks.workunit.client.1.smithi149.stdout:1/940: rename d9/d15/d60/d80/dcd/dab/df3/da2/lae to d9/d15/d40/l131 0 2024-09-13T18:30:31.774 INFO:tasks.workunit.client.1.smithi149.stdout:0/988: stat d1/d2/c30 0 2024-09-13T18:30:31.776 INFO:tasks.workunit.client.0.smithi038.stdout:6/237: rename dd/de/d2e/l56 to dd/de/d2e/d30/l5c 0 2024-09-13T18:30:31.778 INFO:tasks.workunit.client.1.smithi149.stdout:5/862: creat d3/d10/d4c/db8/dd6/f110 x:0 0 0 2024-09-13T18:30:31.778 INFO:tasks.workunit.client.1.smithi149.stdout:2/858: sync 2024-09-13T18:30:31.778 INFO:tasks.workunit.client.1.smithi149.stdout:7/974: sync 2024-09-13T18:30:31.781 INFO:tasks.workunit.client.1.smithi149.stdout:3/881: getdents d1/d2e/d1d/d6c/daa 0 2024-09-13T18:30:31.781 INFO:tasks.workunit.client.1.smithi149.stdout:3/882: creat d1/d21/f138 x:0 0 0 2024-09-13T18:30:31.781 INFO:tasks.workunit.client.1.smithi149.stdout:3/883: write d1/d2c/fa8 [655486,9697] 0 2024-09-13T18:30:31.781 INFO:tasks.workunit.client.1.smithi149.stdout:3/884: truncate d1/d47/d30/d5a/f11c 286873 0 2024-09-13T18:30:31.782 INFO:tasks.workunit.client.1.smithi149.stdout:8/918: dwrite d2/d12/d40/f7a [0,4194304] 0 2024-09-13T18:30:31.782 INFO:tasks.workunit.client.0.smithi038.stdout:0/207: dread d2/f5 [0,4194304] 0 2024-09-13T18:30:31.782 INFO:tasks.workunit.client.0.smithi038.stdout:6/238: symlink dd/l5d 0 2024-09-13T18:30:31.782 INFO:tasks.workunit.client.0.smithi038.stdout:6/239: dread - dd/de/d2e/d30/d27/f53 zero size 2024-09-13T18:30:31.782 INFO:tasks.workunit.client.0.smithi038.stdout:6/240: chown dd/de/l25 229789 1 2024-09-13T18:30:31.783 INFO:tasks.workunit.client.0.smithi038.stdout:6/241: creat dd/de/d2e/d2f/d4c/d55/f5e x:0 0 0 2024-09-13T18:30:31.783 INFO:tasks.workunit.client.0.smithi038.stdout:0/208: mknod d2/d7/d24/d3c/c4b 0 2024-09-13T18:30:31.783 INFO:tasks.workunit.client.0.smithi038.stdout:0/209: stat d2/dc/l1f 0 2024-09-13T18:30:31.784 INFO:tasks.workunit.client.1.smithi149.stdout:4/982: mknod df/da0/d12/d21/d22/d30/d41/c15a 0 2024-09-13T18:30:31.784 INFO:tasks.workunit.client.1.smithi149.stdout:4/983: write df/da0/d12/ff8 [1443912,120734] 0 2024-09-13T18:30:31.784 INFO:tasks.workunit.client.1.smithi149.stdout:4/984: write df/da0/d70/db5/f137 [4810915,58257] 0 2024-09-13T18:30:31.785 INFO:tasks.workunit.client.0.smithi038.stdout:0/210: read d2/f1c [456920,28597] 0 2024-09-13T18:30:31.785 INFO:tasks.workunit.client.0.smithi038.stdout:0/211: chown d2/f32 13 1 2024-09-13T18:30:31.786 INFO:tasks.workunit.client.1.smithi149.stdout:9/805: rename d0/cc to d0/d18/d27/d5c/d99/cf8 0 2024-09-13T18:30:31.786 INFO:tasks.workunit.client.1.smithi149.stdout:9/806: chown d0/d9e 7 1 2024-09-13T18:30:31.786 INFO:tasks.workunit.client.0.smithi038.stdout:6/242: rename dd/de/d2e/d30/d27/c28 to dd/de/c5f 0 2024-09-13T18:30:31.787 INFO:tasks.workunit.client.0.smithi038.stdout:1/211: sync 2024-09-13T18:30:31.787 INFO:tasks.workunit.client.0.smithi038.stdout:4/371: sync 2024-09-13T18:30:31.787 INFO:tasks.workunit.client.1.smithi149.stdout:1/941: creat d9/d10/d34/d53/d57/f132 x:0 0 0 2024-09-13T18:30:31.787 INFO:tasks.workunit.client.0.smithi038.stdout:0/212: link d2/d7/c12 d2/d7/d24/d2b/c4c 0 2024-09-13T18:30:31.789 INFO:tasks.workunit.client.0.smithi038.stdout:6/243: mkdir dd/de/d2e/d2f/d4c/d60 0 2024-09-13T18:30:31.789 INFO:tasks.workunit.client.0.smithi038.stdout:6/244: truncate f1 847511 0 2024-09-13T18:30:31.789 INFO:tasks.workunit.client.0.smithi038.stdout:6/245: write f9 [1463288,82713] 0 2024-09-13T18:30:31.790 INFO:tasks.workunit.client.1.smithi149.stdout:5/863: rmdir d3/d10/d98/dfb/d67/d83 39 2024-09-13T18:30:31.790 INFO:tasks.workunit.client.1.smithi149.stdout:5/864: readlink d3/d5e/l6e 0 2024-09-13T18:30:31.791 INFO:tasks.workunit.client.0.smithi038.stdout:1/212: getdents d12/d2a/d32 0 2024-09-13T18:30:31.793 INFO:tasks.workunit.client.0.smithi038.stdout:6/246: unlink dd/de/d2e/d2f/d4c/f50 0 2024-09-13T18:30:31.801 INFO:tasks.workunit.client.1.smithi149.stdout:3/885: mknod d1/d12/d20/ded/c139 0 2024-09-13T18:30:31.801 INFO:tasks.workunit.client.1.smithi149.stdout:3/886: fdatasync d1/d47/d30/d5a/fc6 0 2024-09-13T18:30:31.801 INFO:tasks.workunit.client.1.smithi149.stdout:3/887: stat d1/d2c/d38/d88/d96/c10a 0 2024-09-13T18:30:31.803 INFO:tasks.workunit.client.0.smithi038.stdout:1/213: dread d12/f1c [4194304,4194304] 0 2024-09-13T18:30:31.803 INFO:tasks.workunit.client.0.smithi038.stdout:6/247: write dd/de/f3c [3564036,52319] 0 2024-09-13T18:30:31.804 INFO:tasks.workunit.client.0.smithi038.stdout:6/248: chown dd/de/d2e/d2f/d4c/f4d 243 1 2024-09-13T18:30:31.804 INFO:tasks.workunit.client.0.smithi038.stdout:6/249: read - dd/de/d2e/d30/d27/f43 zero size 2024-09-13T18:30:31.804 INFO:tasks.workunit.client.1.smithi149.stdout:8/919: creat d2/d12/f130 x:0 0 0 2024-09-13T18:30:31.807 INFO:tasks.workunit.client.1.smithi149.stdout:9/807: creat d0/d2e/d42/ff9 x:0 0 0 2024-09-13T18:30:31.808 INFO:tasks.workunit.client.1.smithi149.stdout:4/985: dwrite df/da0/d12/d21/d22/d30/d41/d57/d75/da1/fca [0,4194304] 0 2024-09-13T18:30:31.811 INFO:tasks.workunit.client.1.smithi149.stdout:5/865: rename d3/d10/f23 to d3/d10/d4c/f111 0 2024-09-13T18:30:31.811 INFO:tasks.workunit.client.0.smithi038.stdout:6/250: dread dd/f11 [0,4194304] 0 2024-09-13T18:30:31.813 INFO:tasks.workunit.client.1.smithi149.stdout:7/975: mknod d7/d9/c158 0 2024-09-13T18:30:31.815 INFO:tasks.workunit.client.1.smithi149.stdout:3/888: creat d1/d47/d97/d9b/f13a x:0 0 0 2024-09-13T18:30:31.818 INFO:tasks.workunit.client.1.smithi149.stdout:8/920: link d2/d13/d3a/ce8 d2/db1/c131 0 2024-09-13T18:30:31.818 INFO:tasks.workunit.client.0.smithi038.stdout:1/214: dread d12/f1a [0,4194304] 0 2024-09-13T18:30:31.820 INFO:tasks.workunit.client.1.smithi149.stdout:4/986: creat df/da0/d12/d21/d22/d30/d56/d91/dcb/f15b x:0 0 0 2024-09-13T18:30:31.822 INFO:tasks.workunit.client.1.smithi149.stdout:9/808: rename d0/d9e/c78 to d0/d2e/d42/d59/cfa 0 2024-09-13T18:30:31.823 INFO:tasks.workunit.client.1.smithi149.stdout:2/859: dwrite db/d13/f79 [0,4194304] 0 2024-09-13T18:30:31.824 INFO:tasks.workunit.client.0.smithi038.stdout:0/213: dwrite d2/f1c [0,4194304] 0 2024-09-13T18:30:31.824 INFO:tasks.workunit.client.0.smithi038.stdout:0/214: chown d2/d2f/c36 42503848 1 2024-09-13T18:30:31.824 INFO:tasks.workunit.client.0.smithi038.stdout:0/215: chown d2/dc/c45 221 1 2024-09-13T18:30:31.824 INFO:tasks.workunit.client.1.smithi149.stdout:9/809: write d0/d2e/f43 [5119593,102506] 0 2024-09-13T18:30:31.825 INFO:tasks.workunit.client.1.smithi149.stdout:5/866: unlink d3/d10/d98/dfb/d54/d76/d7a/ff1 0 2024-09-13T18:30:31.826 INFO:tasks.workunit.client.1.smithi149.stdout:7/976: mkdir d7/d9/d11/d50/dde/df7/d159 0 2024-09-13T18:30:31.828 INFO:tasks.workunit.client.0.smithi038.stdout:1/215: link d12/l31 d12/l3f 0 2024-09-13T18:30:31.829 INFO:tasks.workunit.client.0.smithi038.stdout:6/251: dwrite dd/f16 [0,4194304] 0 2024-09-13T18:30:31.829 INFO:tasks.workunit.client.0.smithi038.stdout:6/252: dread - dd/f44 zero size 2024-09-13T18:30:31.830 INFO:tasks.workunit.client.1.smithi149.stdout:3/889: creat d1/d12/d20/d54/d6d/f13b x:0 0 0 2024-09-13T18:30:31.830 INFO:tasks.workunit.client.1.smithi149.stdout:3/890: fsync d1/d2e/d1d/d6c/f137 0 2024-09-13T18:30:31.830 INFO:tasks.workunit.client.1.smithi149.stdout:1/942: dwrite d9/d10/d34/dbe/d38/f9c [0,4194304] 0 2024-09-13T18:30:31.832 INFO:tasks.workunit.client.1.smithi149.stdout:8/921: mkdir d2/d13/d3a/d7f/da8/d132 0 2024-09-13T18:30:31.834 INFO:tasks.workunit.client.0.smithi038.stdout:0/216: getdents d2/d7/d24/d3c/d3f 0 2024-09-13T18:30:31.837 INFO:tasks.workunit.client.1.smithi149.stdout:4/987: read df/da0/d12/d21/f8e [603109,112630] 0 2024-09-13T18:30:31.837 INFO:tasks.workunit.client.1.smithi149.stdout:4/988: chown df/da0/dcc/c12e 4 1 2024-09-13T18:30:31.837 INFO:tasks.workunit.client.1.smithi149.stdout:4/989: chown df/da0/d12/d21/d22/d30/d41/d57/d75/da1/da3/dc8 147762 1 2024-09-13T18:30:31.837 INFO:tasks.workunit.client.1.smithi149.stdout:2/860: unlink db/d13/d70/d118/f2c 0 2024-09-13T18:30:31.837 INFO:tasks.workunit.client.1.smithi149.stdout:2/861: creat db/d13/d70/d89/f120 x:0 0 0 2024-09-13T18:30:31.837 INFO:tasks.workunit.client.1.smithi149.stdout:2/862: stat db/d100 0 2024-09-13T18:30:31.837 INFO:tasks.workunit.client.1.smithi149.stdout:2/863: stat db/d13/d70/ffe 0 2024-09-13T18:30:31.837 INFO:tasks.workunit.client.1.smithi149.stdout:2/864: creat db/d1b/d1c/d20/f121 x:0 0 0 2024-09-13T18:30:31.838 INFO:tasks.workunit.client.0.smithi038.stdout:1/216: creat d12/d3c/f40 x:0 0 0 2024-09-13T18:30:31.843 INFO:tasks.workunit.client.1.smithi149.stdout:5/867: creat d3/d10/d98/dfb/d54/db9/f112 x:0 0 0 2024-09-13T18:30:31.844 INFO:tasks.workunit.client.1.smithi149.stdout:5/868: write d3/d10/d98/dfb/d54/dbd/f100 [474512,70223] 0 2024-09-13T18:30:31.847 INFO:tasks.workunit.client.0.smithi038.stdout:6/253: rename dd/de/d2e/d2f/d4e to dd/de/d61 0 2024-09-13T18:30:31.849 INFO:tasks.workunit.client.0.smithi038.stdout:0/217: rmdir d2/d2f/d44 39 2024-09-13T18:30:31.849 INFO:tasks.workunit.client.0.smithi038.stdout:0/218: creat d2/d7/d24/d3c/f4d x:0 0 0 2024-09-13T18:30:31.849 INFO:tasks.workunit.client.0.smithi038.stdout:0/219: chown d2/f1e 3839 1 2024-09-13T18:30:31.849 INFO:tasks.workunit.client.0.smithi038.stdout:0/220: stat d2/d2f/f47 0 2024-09-13T18:30:31.851 INFO:tasks.workunit.client.0.smithi038.stdout:6/254: mkdir dd/de/d61/d62 0 2024-09-13T18:30:31.852 INFO:tasks.workunit.client.1.smithi149.stdout:9/810: dwrite d0/d2e/d42/d59/f69 [0,4194304] 0 2024-09-13T18:30:31.856 INFO:tasks.workunit.client.0.smithi038.stdout:1/217: dwrite d12/d15/f22 [0,4194304] 0 2024-09-13T18:30:31.856 INFO:tasks.workunit.client.0.smithi038.stdout:1/218: read f9 [3085216,112177] 0 2024-09-13T18:30:31.857 INFO:tasks.workunit.client.1.smithi149.stdout:9/811: write d0/d9e/d3b/f4f [640304,128920] 0 2024-09-13T18:30:31.858 INFO:tasks.workunit.client.0.smithi038.stdout:6/255: mkdir dd/de/d31/d63 0 2024-09-13T18:30:31.858 INFO:tasks.workunit.client.0.smithi038.stdout:6/256: truncate dd/de/f2c 637428 0 2024-09-13T18:30:31.862 INFO:tasks.workunit.client.1.smithi149.stdout:1/943: symlink d9/d58/l133 0 2024-09-13T18:30:31.862 INFO:tasks.workunit.client.1.smithi149.stdout:1/944: write d9/d10/f1a [2364958,63563] 0 2024-09-13T18:30:31.862 INFO:tasks.workunit.client.1.smithi149.stdout:1/945: creat d9/f134 x:0 0 0 2024-09-13T18:30:31.863 INFO:tasks.workunit.client.1.smithi149.stdout:3/891: write d1/f85 [1021866,38780] 0 2024-09-13T18:30:31.864 INFO:tasks.workunit.client.1.smithi149.stdout:3/892: fdatasync d1/d2e/d1d/f11d 0 2024-09-13T18:30:31.864 INFO:tasks.workunit.client.1.smithi149.stdout:7/977: dwrite d7/d9/d1c/d51/d52/fa0 [0,4194304] 0 2024-09-13T18:30:31.864 INFO:tasks.workunit.client.0.smithi038.stdout:0/221: symlink d2/l4e 0 2024-09-13T18:30:31.866 INFO:tasks.workunit.client.1.smithi149.stdout:5/869: write d3/f4 [9990789,106732] 0 2024-09-13T18:30:31.866 INFO:tasks.workunit.client.1.smithi149.stdout:5/870: truncate d3/d10/d4c/d4e/f62 802183 0 2024-09-13T18:30:31.866 INFO:tasks.workunit.client.1.smithi149.stdout:5/871: chown d3/d10/d98/dfb/c85 2666441 1 2024-09-13T18:30:31.867 INFO:tasks.workunit.client.0.smithi038.stdout:6/257: creat dd/de/d2e/f64 x:0 0 0 2024-09-13T18:30:31.867 INFO:tasks.workunit.client.0.smithi038.stdout:6/258: chown dd/de/d2e/f64 224753 1 2024-09-13T18:30:31.867 INFO:tasks.workunit.client.0.smithi038.stdout:6/259: chown dd/de/d2e/d2f/c3d 695 1 2024-09-13T18:30:31.868 INFO:tasks.workunit.client.1.smithi149.stdout:8/922: getdents d2/d12/dd8/d66 0 2024-09-13T18:30:31.870 INFO:tasks.workunit.client.0.smithi038.stdout:6/260: rename dd/de/d2e/d30/l3f to dd/l65 0 2024-09-13T18:30:31.870 INFO:tasks.workunit.client.0.smithi038.stdout:6/261: rename dd/de to dd/de/d2e/d30/d27/d66 22 2024-09-13T18:30:31.870 INFO:tasks.workunit.client.0.smithi038.stdout:6/262: chown c8 51 1 2024-09-13T18:30:31.871 INFO:tasks.workunit.client.1.smithi149.stdout:4/990: read df/da0/d12/f3c [3760285,87273] 0 2024-09-13T18:30:31.872 INFO:tasks.workunit.client.1.smithi149.stdout:4/991: read - df/da0/d12/d21/d22/d30/d41/d57/d60/d11f/f154 zero size 2024-09-13T18:30:31.873 INFO:tasks.workunit.client.0.smithi038.stdout:0/222: write d2/d7/d24/d2b/f2d [1699855,88572] 0 2024-09-13T18:30:31.878 INFO:tasks.workunit.client.1.smithi149.stdout:0/989: sync 2024-09-13T18:30:31.897 INFO:tasks.workunit.client.1.smithi149.stdout:8/923: unlink d2/d5b/fe5 0 2024-09-13T18:30:31.897 INFO:tasks.workunit.client.1.smithi149.stdout:8/924: chown d2/d5b/f113 7575 1 2024-09-13T18:30:31.897 INFO:tasks.workunit.client.1.smithi149.stdout:2/865: dread db/d1b/d1c/d20/f50 [0,4194304] 0 2024-09-13T18:30:31.897 INFO:tasks.workunit.client.1.smithi149.stdout:9/812: dwrite d0/d47/fca [0,4194304] 0 2024-09-13T18:30:31.897 INFO:tasks.workunit.client.0.smithi038.stdout:6/263: dread dd/de/d2e/d2f/f39 [0,4194304] 0 2024-09-13T18:30:31.898 INFO:tasks.workunit.client.0.smithi038.stdout:0/223: unlink d2/f15 0 2024-09-13T18:30:31.898 INFO:tasks.workunit.client.0.smithi038.stdout:0/224: stat d2/d7/l3a 0 2024-09-13T18:30:31.898 INFO:tasks.workunit.client.1.smithi149.stdout:3/893: rename d1/d47/d97 to d1/d48/ddb/d13c 0 2024-09-13T18:30:31.902 INFO:tasks.workunit.client.1.smithi149.stdout:8/925: mknod d2/d12/dd8/d66/ded/c133 0 2024-09-13T18:30:31.905 INFO:tasks.workunit.client.1.smithi149.stdout:2/866: creat db/d13/d70/d11b/f122 x:0 0 0 2024-09-13T18:30:31.905 INFO:tasks.workunit.client.1.smithi149.stdout:2/867: creat db/d13/d70/dad/f123 x:0 0 0 2024-09-13T18:30:31.906 INFO:tasks.workunit.client.0.smithi038.stdout:6/264: getdents dd/de/d31 0 2024-09-13T18:30:31.909 INFO:tasks.workunit.client.0.smithi038.stdout:0/225: rename d2/l8 to d2/d7/d24/l4f 0 2024-09-13T18:30:31.909 INFO:tasks.workunit.client.0.smithi038.stdout:0/226: fdatasync d2/d7/d24/d3c/f3d 0 2024-09-13T18:30:31.910 INFO:tasks.workunit.client.0.smithi038.stdout:6/265: dread dd/f32 [0,4194304] 0 2024-09-13T18:30:31.911 INFO:tasks.workunit.client.1.smithi149.stdout:9/813: mknod d0/d2e/d42/d70/d84/cfb 0 2024-09-13T18:30:31.914 INFO:tasks.workunit.client.1.smithi149.stdout:0/990: rename d1/d2/d41/c78 to d1/d2/d41/d46/d7b/d98/c15f 0 2024-09-13T18:30:31.915 INFO:tasks.workunit.client.1.smithi149.stdout:8/926: creat d2/d12/dd8/f134 x:0 0 0 2024-09-13T18:30:31.916 INFO:tasks.workunit.client.1.smithi149.stdout:1/946: dwrite d9/d10/d62/f99 [0,4194304] 0 2024-09-13T18:30:31.917 INFO:tasks.workunit.client.1.smithi149.stdout:2/868: creat db/d13/d70/d118/d8d/daf/f124 x:0 0 0 2024-09-13T18:30:31.917 INFO:tasks.workunit.client.1.smithi149.stdout:2/869: fsync db/d1b/d2f/fc5 0 2024-09-13T18:30:31.918 INFO:tasks.workunit.client.1.smithi149.stdout:9/814: mkdir d0/d18/d68/db2/dfc 0 2024-09-13T18:30:31.918 INFO:tasks.workunit.client.1.smithi149.stdout:0/991: symlink d1/d2/d8a/l160 0 2024-09-13T18:30:31.919 INFO:tasks.workunit.client.1.smithi149.stdout:0/992: write d1/d48/fa2 [673706,49957] 0 2024-09-13T18:30:31.919 INFO:tasks.workunit.client.1.smithi149.stdout:8/927: creat d2/d10f/f135 x:0 0 0 2024-09-13T18:30:31.919 INFO:tasks.workunit.client.1.smithi149.stdout:8/928: chown d2/d52/f115 2446 1 2024-09-13T18:30:31.920 INFO:tasks.workunit.client.1.smithi149.stdout:8/929: fsync d2/d13/d3a/f4f 0 2024-09-13T18:30:31.920 INFO:tasks.workunit.client.1.smithi149.stdout:8/930: write d2/d12/d2a/d4d/f103 [5057991,84338] 0 2024-09-13T18:30:31.920 INFO:tasks.workunit.client.1.smithi149.stdout:8/931: stat d2/d12/dd8/f8f 0 2024-09-13T18:30:31.920 INFO:tasks.workunit.client.1.smithi149.stdout:8/932: write d2/d12/d2a/d4d/f83 [1062067,18865] 0 2024-09-13T18:30:31.922 INFO:tasks.workunit.client.1.smithi149.stdout:2/870: creat db/d1b/d6c/d117/f125 x:0 0 0 2024-09-13T18:30:31.922 INFO:tasks.workunit.client.1.smithi149.stdout:2/871: creat db/d13/d70/d118/d8d/daf/f126 x:0 0 0 2024-09-13T18:30:31.923 INFO:tasks.workunit.client.0.smithi038.stdout:1/219: dwrite d12/f1c [8388608,4194304] 0 2024-09-13T18:30:31.923 INFO:tasks.workunit.client.0.smithi038.stdout:0/227: dread d2/d7/f1d [4194304,4194304] 0 2024-09-13T18:30:31.923 INFO:tasks.workunit.client.0.smithi038.stdout:0/228: write d2/d7/f31 [643014,42325] 0 2024-09-13T18:30:31.923 INFO:tasks.workunit.client.1.smithi149.stdout:0/993: mkdir d1/d48/d92/db4/dbe/d161 0 2024-09-13T18:30:31.924 INFO:tasks.workunit.client.1.smithi149.stdout:0/994: write d1/d29/d31/d83/fb2 [2499287,59194] 0 2024-09-13T18:30:31.926 INFO:tasks.workunit.client.1.smithi149.stdout:1/947: getdents d9/d10/d34/dbe/d38/df2 0 2024-09-13T18:30:31.926 INFO:tasks.workunit.client.1.smithi149.stdout:1/948: fdatasync d9/d10/d34/d53/d57/fa1 0 2024-09-13T18:30:31.928 INFO:tasks.workunit.client.0.smithi038.stdout:6/266: dwrite dd/de/d2e/d30/f42 [0,4194304] 0 2024-09-13T18:30:31.928 INFO:tasks.workunit.client.0.smithi038.stdout:6/267: dread - dd/de/d2e/f58 zero size 2024-09-13T18:30:31.928 INFO:tasks.workunit.client.0.smithi038.stdout:6/268: creat dd/de/d2e/f67 x:0 0 0 2024-09-13T18:30:31.928 INFO:tasks.workunit.client.0.smithi038.stdout:6/269: chown l7 1 1 2024-09-13T18:30:31.929 INFO:tasks.workunit.client.1.smithi149.stdout:7/978: dwrite f3 [0,4194304] 0 2024-09-13T18:30:31.929 INFO:tasks.workunit.client.1.smithi149.stdout:5/872: dwrite d3/d10/d98/dfb/d54/f84 [0,4194304] 0 2024-09-13T18:30:31.929 INFO:tasks.workunit.client.1.smithi149.stdout:5/873: chown d3/d10/d98/dfb/d54/db9/fc6 854091 1 2024-09-13T18:30:31.930 INFO:tasks.workunit.client.1.smithi149.stdout:4/992: dwrite df/da0/d12/d21/d22/d30/d56/d91/fb2 [0,4194304] 0 2024-09-13T18:30:31.931 INFO:tasks.workunit.client.1.smithi149.stdout:2/872: symlink db/d1b/d6c/l127 0 2024-09-13T18:30:31.931 INFO:tasks.workunit.client.1.smithi149.stdout:3/894: dwrite d1/d2e/d1d/d6c/daa/dfb/f133 [0,4194304] 0 2024-09-13T18:30:31.932 INFO:tasks.workunit.client.1.smithi149.stdout:5/874: dread d3/d10/f5d [0,4194304] 0 2024-09-13T18:30:31.933 INFO:tasks.workunit.client.1.smithi149.stdout:9/815: mkdir d0/d18/dfd 0 2024-09-13T18:30:31.933 INFO:tasks.workunit.client.1.smithi149.stdout:9/816: write d0/f8a [2051251,31625] 0 2024-09-13T18:30:31.936 INFO:tasks.workunit.client.1.smithi149.stdout:8/933: write d2/d13/d3a/d7f/da8/fe7 [2498787,54250] 0 2024-09-13T18:30:31.937 INFO:tasks.workunit.client.0.smithi038.stdout:1/220: creat d12/d15/f41 x:0 0 0 2024-09-13T18:30:31.938 INFO:tasks.workunit.client.1.smithi149.stdout:1/949: rename d9/d15/d60/d80/dcd/dab/cda to d9/d10/d34/d53/d7b/d11d/c135 0 2024-09-13T18:30:31.948 INFO:tasks.workunit.client.0.smithi038.stdout:6/270: symlink dd/de/d61/l68 0 2024-09-13T18:30:31.952 INFO:tasks.workunit.client.1.smithi149.stdout:4/993: creat df/da0/d1c/d7e/d9f/f15c x:0 0 0 2024-09-13T18:30:31.953 INFO:tasks.workunit.client.1.smithi149.stdout:4/994: read df/da0/f80 [1131313,75844] 0 2024-09-13T18:30:31.953 INFO:tasks.workunit.client.1.smithi149.stdout:1/950: dwrite d9/d10/d3f/f7a [0,4194304] 0 2024-09-13T18:30:31.954 INFO:tasks.workunit.client.0.smithi038.stdout:0/229: rename d2/f32 to d2/dc/f50 0 2024-09-13T18:30:31.955 INFO:tasks.workunit.client.1.smithi149.stdout:2/873: mkdir db/d1b/d1c/d20/d2b/d3e/de4/d128 0 2024-09-13T18:30:31.962 INFO:tasks.workunit.client.0.smithi038.stdout:1/221: rename f8 to d12/d15/f42 0 2024-09-13T18:30:31.963 INFO:tasks.workunit.client.1.smithi149.stdout:3/895: link d1/d47/l111 d1/d47/d30/l13d 0 2024-09-13T18:30:31.963 INFO:tasks.workunit.client.1.smithi149.stdout:3/896: write d1/d12/f4c [3895284,3881] 0 2024-09-13T18:30:31.965 INFO:tasks.workunit.client.1.smithi149.stdout:1/951: dread d9/d10/d62/fd1 [0,4194304] 0 2024-09-13T18:30:31.966 INFO:tasks.workunit.client.1.smithi149.stdout:9/817: mkdir d0/d9e/dc5/dfe 0 2024-09-13T18:30:31.966 INFO:tasks.workunit.client.1.smithi149.stdout:9/818: stat d0/d18/d27/f91 0 2024-09-13T18:30:31.967 INFO:tasks.workunit.client.0.smithi038.stdout:7/180: sync 2024-09-13T18:30:31.967 INFO:tasks.workunit.client.0.smithi038.stdout:6/271: dwrite dd/de/d2e/f67 [0,4194304] 0 2024-09-13T18:30:31.968 INFO:tasks.workunit.client.0.smithi038.stdout:6/272: getdents dd/de/d61/d62 0 2024-09-13T18:30:31.968 INFO:tasks.workunit.client.0.smithi038.stdout:6/273: chown dd/de/d2e/c3a 227627 1 2024-09-13T18:30:31.969 INFO:tasks.workunit.client.0.smithi038.stdout:0/230: rename d2/d2f/f47 to d2/dc/f51 0 2024-09-13T18:30:31.974 INFO:tasks.workunit.client.0.smithi038.stdout:7/181: symlink db/d12/d1c/d3a/d26/l44 0 2024-09-13T18:30:31.982 INFO:tasks.workunit.client.0.smithi038.stdout:1/222: dwrite f3 [0,4194304] 0 2024-09-13T18:30:31.984 INFO:tasks.workunit.client.0.smithi038.stdout:6/274: mknod dd/de/d2e/d2f/c69 0 2024-09-13T18:30:31.986 INFO:tasks.workunit.client.0.smithi038.stdout:6/275: mkdir dd/de/d2e/d30/d27/d6a 0 2024-09-13T18:30:31.987 INFO:tasks.workunit.client.0.smithi038.stdout:1/223: symlink d12/l43 0 2024-09-13T18:30:31.988 INFO:tasks.workunit.client.1.smithi149.stdout:0/995: rmdir d1/d29/d31 39 2024-09-13T18:30:31.990 INFO:tasks.workunit.client.0.smithi038.stdout:6/276: symlink dd/de/d2e/d2f/d4c/l6b 0 2024-09-13T18:30:31.991 INFO:tasks.workunit.client.1.smithi149.stdout:8/934: truncate d2/d12/d87/f9e 10891918 0 2024-09-13T18:30:31.993 INFO:tasks.workunit.client.1.smithi149.stdout:5/875: rename d3/f8b to d3/d10/d98/dfb/d54/d97/f113 0 2024-09-13T18:30:31.994 INFO:tasks.workunit.client.1.smithi149.stdout:7/979: rmdir d7/d9/d1c/d34 39 2024-09-13T18:30:31.996 INFO:tasks.workunit.client.1.smithi149.stdout:4/995: symlink df/da0/d12/d21/d22/d30/d41/d57/d8a/l15d 0 2024-09-13T18:30:31.997 INFO:tasks.workunit.client.1.smithi149.stdout:3/897: rmdir d1/d12/d20/d54/dd1 39 2024-09-13T18:30:31.997 INFO:tasks.workunit.client.1.smithi149.stdout:3/898: creat d1/d2e/d1d/d6c/f13e x:0 0 0 2024-09-13T18:30:32.000 INFO:tasks.workunit.client.1.smithi149.stdout:1/952: creat d9/d15/d60/d80/f136 x:0 0 0 2024-09-13T18:30:32.004 INFO:tasks.workunit.client.1.smithi149.stdout:0/996: truncate d1/d29/d31/d44/d81/d9f/fb0 468649 0 2024-09-13T18:30:32.004 INFO:tasks.workunit.client.1.smithi149.stdout:4/996: truncate df/da0/d12/d21/d22/f62 3580113 0 2024-09-13T18:30:32.004 INFO:tasks.workunit.client.1.smithi149.stdout:8/935: creat d2/d13/d6d/f136 x:0 0 0 2024-09-13T18:30:32.004 INFO:tasks.workunit.client.1.smithi149.stdout:9/819: dwrite d0/f38 [0,4194304] 0 2024-09-13T18:30:32.004 INFO:tasks.workunit.client.1.smithi149.stdout:4/997: getdents df/da0 0 2024-09-13T18:30:32.005 INFO:tasks.workunit.client.1.smithi149.stdout:5/876: getdents d3/d8 0 2024-09-13T18:30:32.006 INFO:tasks.workunit.client.1.smithi149.stdout:7/980: dread d7/d9/d1b/f36 [0,4194304] 0 2024-09-13T18:30:32.006 INFO:tasks.workunit.client.1.smithi149.stdout:8/936: link d2/d12/d2a/d4d/dbb/cbd d2/d13/d3a/d7f/c137 0 2024-09-13T18:30:32.007 INFO:tasks.workunit.client.0.smithi038.stdout:0/231: dwrite d2/f5 [0,4194304] 0 2024-09-13T18:30:32.007 INFO:tasks.workunit.client.0.smithi038.stdout:0/232: fdatasync d2/dc/f51 0 2024-09-13T18:30:32.008 INFO:tasks.workunit.client.1.smithi149.stdout:4/998: rename df/da0/d12/d21/d22/d30/d41/d110/d11a/f141 to df/da0/d112/d3d/d146/f15e 0 2024-09-13T18:30:32.009 INFO:tasks.workunit.client.1.smithi149.stdout:9/820: dread d0/d2e/f71 [0,4194304] 0 2024-09-13T18:30:32.010 INFO:tasks.workunit.client.1.smithi149.stdout:7/981: link d7/d9/d1c/d51/c121 d7/d9/d1c/d34/c15a 0 2024-09-13T18:30:32.011 INFO:tasks.workunit.client.0.smithi038.stdout:6/277: dread dd/de/d2e/f4b [0,4194304] 0 2024-09-13T18:30:32.011 INFO:tasks.workunit.client.0.smithi038.stdout:6/278: getdents dd/de/d31 0 2024-09-13T18:30:32.011 INFO:tasks.workunit.client.0.smithi038.stdout:6/279: chown dd/de/d2e/d2f/c3d 52 1 2024-09-13T18:30:32.011 INFO:tasks.workunit.client.0.smithi038.stdout:0/233: creat d2/d2f/f52 x:0 0 0 2024-09-13T18:30:32.012 INFO:tasks.workunit.client.0.smithi038.stdout:7/182: dwrite db/d12/d1c/d3a/f1d [0,4194304] 0 2024-09-13T18:30:32.013 INFO:tasks.workunit.client.1.smithi149.stdout:8/937: creat d2/d13/d3a/d7f/da8/f138 x:0 0 0 2024-09-13T18:30:32.014 INFO:tasks.workunit.client.1.smithi149.stdout:1/953: dread d9/d10/d34/d53/d57/f98 [0,4194304] 0 2024-09-13T18:30:32.017 INFO:tasks.workunit.client.1.smithi149.stdout:9/821: creat d0/d9e/fff x:0 0 0 2024-09-13T18:30:32.017 INFO:tasks.workunit.client.1.smithi149.stdout:9/822: chown d0/c92 8677663 1 2024-09-13T18:30:32.019 INFO:tasks.workunit.client.1.smithi149.stdout:2/874: dread db/d1b/d2f/d69/deb/ff0 [0,4194304] 0 2024-09-13T18:30:32.020 INFO:tasks.workunit.client.1.smithi149.stdout:4/999: dread df/da0/d12/f3c [0,4194304] 0 2024-09-13T18:30:32.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/234: truncate d2/dc/f11 3436881 0 2024-09-13T18:30:32.023 INFO:tasks.workunit.client.0.smithi038.stdout:7/183: write db/d12/d1c/d3a/f1d [2390462,22471] 0 2024-09-13T18:30:32.023 INFO:tasks.workunit.client.0.smithi038.stdout:7/184: write db/d12/f3f [1594073,118589] 0 2024-09-13T18:30:32.023 INFO:tasks.workunit.client.0.smithi038.stdout:1/224: dwrite d12/d15/f42 [4194304,4194304] 0 2024-09-13T18:30:32.024 INFO:tasks.workunit.client.0.smithi038.stdout:1/225: chown d12/d2a/d32/f34 32685 1 2024-09-13T18:30:32.024 INFO:tasks.workunit.client.0.smithi038.stdout:1/226: chown ff 13967 1 2024-09-13T18:30:32.025 INFO:tasks.workunit.client.1.smithi149.stdout:8/938: rename d2/d12/dd8/d12a to d2/d13/d3a/d7f/d139 0 2024-09-13T18:30:32.026 INFO:tasks.workunit.client.1.smithi149.stdout:1/954: creat d9/d15/d25/f137 x:0 0 0 2024-09-13T18:30:32.028 INFO:tasks.workunit.client.0.smithi038.stdout:6/280: write dd/de/d31/f3e [3930247,104545] 0 2024-09-13T18:30:32.033 INFO:tasks.workunit.client.1.smithi149.stdout:9/823: link d0/d18/d68/db2/dc9/fee d0/d2e/d42/d70/d84/dea/f100 0 2024-09-13T18:30:32.033 INFO:tasks.workunit.client.1.smithi149.stdout:9/824: chown d0/f67 73 1 2024-09-13T18:30:32.036 INFO:tasks.workunit.client.1.smithi149.stdout:5/877: dwrite d3/d10/d98/dfb/d54/d97/dba/fdc [0,4194304] 0 2024-09-13T18:30:32.036 INFO:tasks.workunit.client.1.smithi149.stdout:2/875: truncate db/d1b/f42 3734762 0 2024-09-13T18:30:32.042 INFO:tasks.workunit.client.1.smithi149.stdout:1/955: dread d9/d15/d60/d80/d8b/f31 [0,4194304] 0 2024-09-13T18:30:32.042 INFO:tasks.workunit.client.1.smithi149.stdout:1/956: chown d9/d10/dca/fff 174979191 1 2024-09-13T18:30:32.048 INFO:tasks.workunit.client.0.smithi038.stdout:0/235: write d2/d7/f21 [2956724,41326] 0 2024-09-13T18:30:32.049 INFO:tasks.workunit.client.0.smithi038.stdout:7/185: symlink db/d12/l45 0 2024-09-13T18:30:32.053 INFO:tasks.workunit.client.0.smithi038.stdout:1/227: mknod d12/d2a/d32/c44 0 2024-09-13T18:30:32.053 INFO:tasks.workunit.client.0.smithi038.stdout:1/228: chown d12/f37 2555039 1 2024-09-13T18:30:32.055 INFO:tasks.workunit.client.0.smithi038.stdout:0/236: dread - d2/d7/d24/d2b/f43 zero size 2024-09-13T18:30:32.055 INFO:tasks.workunit.client.0.smithi038.stdout:0/237: fdatasync d2/dc/f14 0 2024-09-13T18:30:32.057 INFO:tasks.workunit.client.0.smithi038.stdout:1/229: truncate d12/f1c 492133 0 2024-09-13T18:30:32.058 INFO:tasks.workunit.client.0.smithi038.stdout:0/238: chown d2/c6 384 1 2024-09-13T18:30:32.060 INFO:tasks.workunit.client.1.smithi149.stdout:8/939: dwrite d2/d12/dd8/d58/feb [0,4194304] 0 2024-09-13T18:30:32.062 INFO:tasks.workunit.client.1.smithi149.stdout:7/982: dwrite d7/d9/d11/d50/f12d [4194304,4194304] 0 2024-09-13T18:30:32.062 INFO:tasks.workunit.client.1.smithi149.stdout:7/983: write d7/d76/db3/d31/f3f [4835537,57933] 0 2024-09-13T18:30:32.062 INFO:tasks.workunit.client.1.smithi149.stdout:7/984: dread - d7/d9/d1b/d71/ddc/fe8 zero size 2024-09-13T18:30:32.062 INFO:tasks.workunit.client.1.smithi149.stdout:7/985: write d7/d9/d11/ff5 [284091,126541] 0 2024-09-13T18:30:32.063 INFO:tasks.workunit.client.0.smithi038.stdout:6/281: dwrite dd/f11 [0,4194304] 0 2024-09-13T18:30:32.063 INFO:tasks.workunit.client.0.smithi038.stdout:6/282: creat dd/de/f6c x:0 0 0 2024-09-13T18:30:32.063 INFO:tasks.workunit.client.0.smithi038.stdout:6/283: write dd/de/d31/f3e [4345609,4396] 0 2024-09-13T18:30:32.063 INFO:tasks.workunit.client.0.smithi038.stdout:6/284: stat l7 0 2024-09-13T18:30:32.063 INFO:tasks.workunit.client.0.smithi038.stdout:8/298: sync 2024-09-13T18:30:32.064 INFO:tasks.workunit.client.0.smithi038.stdout:5/186: sync 2024-09-13T18:30:32.064 INFO:tasks.workunit.client.0.smithi038.stdout:3/203: sync 2024-09-13T18:30:32.064 INFO:tasks.workunit.client.0.smithi038.stdout:3/204: stat d0/dd/d17/f1c 0 2024-09-13T18:30:32.064 INFO:tasks.workunit.client.0.smithi038.stdout:3/205: chown d0/fa 471063 1 2024-09-13T18:30:32.064 INFO:tasks.workunit.client.0.smithi038.stdout:9/282: sync 2024-09-13T18:30:32.064 INFO:tasks.workunit.client.0.smithi038.stdout:4/372: sync 2024-09-13T18:30:32.064 INFO:tasks.workunit.client.0.smithi038.stdout:2/234: sync 2024-09-13T18:30:32.064 INFO:tasks.workunit.client.0.smithi038.stdout:4/373: stat d2/d49/d50/f77 0 2024-09-13T18:30:32.065 INFO:tasks.workunit.client.0.smithi038.stdout:7/186: dread db/d12/d13/f1b [0,4194304] 0 2024-09-13T18:30:32.066 INFO:tasks.workunit.client.0.smithi038.stdout:3/206: write d0/dd/d19/f21 [77063,67050] 0 2024-09-13T18:30:32.066 INFO:tasks.workunit.client.0.smithi038.stdout:0/239: write d2/d7/fb [4781746,42725] 0 2024-09-13T18:30:32.066 INFO:tasks.workunit.client.0.smithi038.stdout:0/240: creat d2/d7/d24/d3c/f53 x:0 0 0 2024-09-13T18:30:32.066 INFO:tasks.workunit.client.0.smithi038.stdout:0/241: getdents d2/d2f/d44/d49 0 2024-09-13T18:30:32.066 INFO:tasks.workunit.client.1.smithi149.stdout:5/878: symlink d3/d10/d98/dfb/d67/l114 0 2024-09-13T18:30:32.068 INFO:tasks.workunit.client.1.smithi149.stdout:2/876: symlink db/d1b/d6c/dc8/l129 0 2024-09-13T18:30:32.068 INFO:tasks.workunit.client.0.smithi038.stdout:1/230: write f10 [2698340,37171] 0 2024-09-13T18:30:32.068 INFO:tasks.workunit.client.0.smithi038.stdout:1/231: chown fe 81503330 1 2024-09-13T18:30:32.069 INFO:tasks.workunit.client.0.smithi038.stdout:6/285: mknod dd/de/d2e/d2f/c6d 0 2024-09-13T18:30:32.070 INFO:tasks.workunit.client.0.smithi038.stdout:6/286: write dd/de/d2e/d2f/d4c/f4d [366915,50658] 0 2024-09-13T18:30:32.070 INFO:tasks.workunit.client.0.smithi038.stdout:6/287: creat dd/de/d2e/f6e x:0 0 0 2024-09-13T18:30:32.072 INFO:tasks.workunit.client.0.smithi038.stdout:8/299: getdents d1/de 0 2024-09-13T18:30:32.075 INFO:tasks.workunit.client.0.smithi038.stdout:5/187: link f1 df/d15/d36/f3a 0 2024-09-13T18:30:32.075 INFO:tasks.workunit.client.0.smithi038.stdout:5/188: chown df/d15/l2b 2386284 1 2024-09-13T18:30:32.075 INFO:tasks.workunit.client.0.smithi038.stdout:5/189: truncate df/d13/f21 5160166 0 2024-09-13T18:30:32.078 INFO:tasks.workunit.client.0.smithi038.stdout:9/283: creat d0/d7/d13/d2d/f6a x:0 0 0 2024-09-13T18:30:32.081 INFO:tasks.workunit.client.0.smithi038.stdout:2/235: creat d2/d1e/d44/d50/d46/f5f x:0 0 0 2024-09-13T18:30:32.083 INFO:tasks.workunit.client.0.smithi038.stdout:4/374: mknod d2/df/d1b/d10/d55/c78 0 2024-09-13T18:30:32.087 INFO:tasks.workunit.client.0.smithi038.stdout:1/232: mknod d12/d2a/c45 0 2024-09-13T18:30:32.087 INFO:tasks.workunit.client.0.smithi038.stdout:3/207: dwrite d0/dd/f1a [0,4194304] 0 2024-09-13T18:30:32.087 INFO:tasks.workunit.client.0.smithi038.stdout:6/288: fsync dd/de/d31/f3e 0 2024-09-13T18:30:32.092 INFO:tasks.workunit.client.1.smithi149.stdout:7/986: rmdir d7/d9/d1c/d1f/d21/d49/d102/d10f/d139 0 2024-09-13T18:30:32.092 INFO:tasks.workunit.client.0.smithi038.stdout:8/300: truncate d1/d4/f2d 3668172 0 2024-09-13T18:30:32.094 INFO:tasks.workunit.client.1.smithi149.stdout:2/877: creat db/d1b/d2f/d69/deb/d10f/f12a x:0 0 0 2024-09-13T18:30:32.095 INFO:tasks.workunit.client.0.smithi038.stdout:5/190: mkdir df/d13/d3b 0 2024-09-13T18:30:32.096 INFO:tasks.workunit.client.0.smithi038.stdout:7/187: dwrite db/d12/d1c/d3a/f1d [0,4194304] 0 2024-09-13T18:30:32.097 INFO:tasks.workunit.client.0.smithi038.stdout:4/375: symlink d2/d49/d50/l79 0 2024-09-13T18:30:32.100 INFO:tasks.workunit.client.0.smithi038.stdout:0/242: symlink d2/l54 0 2024-09-13T18:30:32.104 INFO:tasks.workunit.client.1.smithi149.stdout:1/957: getdents d9/d10/d3f/dc9/ddf 0 2024-09-13T18:30:32.107 INFO:tasks.workunit.client.1.smithi149.stdout:9/825: rename d0/d9e/d3b to d0/d18/d68/db2/d101 0 2024-09-13T18:30:32.108 INFO:tasks.workunit.client.0.smithi038.stdout:7/188: write db/d12/f3f [5517156,34622] 0 2024-09-13T18:30:32.108 INFO:tasks.workunit.client.0.smithi038.stdout:7/189: write db/d12/d1c/d3a/d22/f30 [857082,90806] 0 2024-09-13T18:30:32.109 INFO:tasks.workunit.client.0.smithi038.stdout:3/208: mkdir d0/dd/d17/d43 0 2024-09-13T18:30:32.110 INFO:tasks.workunit.client.0.smithi038.stdout:2/236: dwrite d2/f37 [0,4194304] 0 2024-09-13T18:30:32.110 INFO:tasks.workunit.client.0.smithi038.stdout:9/284: dwrite d0/d7/f23 [0,4194304] 0 2024-09-13T18:30:32.110 INFO:tasks.workunit.client.0.smithi038.stdout:9/285: stat d0/d7/d13/d30/c4b 0 2024-09-13T18:30:32.110 INFO:tasks.workunit.client.1.smithi149.stdout:8/940: rmdir d2/d12/d6e 39 2024-09-13T18:30:32.114 INFO:tasks.workunit.client.1.smithi149.stdout:7/987: creat d7/d9/d1b/d71/ddc/d53/f15b x:0 0 0 2024-09-13T18:30:32.119 INFO:tasks.workunit.client.0.smithi038.stdout:8/301: symlink d1/de/d15/l65 0 2024-09-13T18:30:32.122 INFO:tasks.workunit.client.1.smithi149.stdout:9/826: mkdir d0/d18/d27/d5c/d79/d102 0 2024-09-13T18:30:32.122 INFO:tasks.workunit.client.1.smithi149.stdout:9/827: chown d0/d47/fde 4464 1 2024-09-13T18:30:32.123 INFO:tasks.workunit.client.0.smithi038.stdout:5/191: creat df/d15/d36/f3c x:0 0 0 2024-09-13T18:30:32.123 INFO:tasks.workunit.client.0.smithi038.stdout:5/192: read df/d13/f21 [4646829,84919] 0 2024-09-13T18:30:32.125 INFO:tasks.workunit.client.1.smithi149.stdout:8/941: unlink d2/d12/dd8/d58/d97/l125 0 2024-09-13T18:30:32.125 INFO:tasks.workunit.client.1.smithi149.stdout:8/942: write d2/d13/d6d/f136 [164722,25140] 0 2024-09-13T18:30:32.125 INFO:tasks.workunit.client.0.smithi038.stdout:0/243: unlink d2/d7/d24/l33 0 2024-09-13T18:30:32.127 INFO:tasks.workunit.client.1.smithi149.stdout:7/988: mknod d7/d9/d1c/c15c 0 2024-09-13T18:30:32.128 INFO:tasks.workunit.client.0.smithi038.stdout:4/376: dwrite d2/df/d22/dc/f1a [4194304,4194304] 0 2024-09-13T18:30:32.129 INFO:tasks.workunit.client.0.smithi038.stdout:4/377: chown d2/df/d22/c6e 5259 1 2024-09-13T18:30:32.129 INFO:tasks.workunit.client.0.smithi038.stdout:4/378: creat d2/df/f7a x:0 0 0 2024-09-13T18:30:32.129 INFO:tasks.workunit.client.1.smithi149.stdout:2/878: rmdir db/d1b/d2f/d30 39 2024-09-13T18:30:32.129 INFO:tasks.workunit.client.1.smithi149.stdout:2/879: chown db/d13/d70/d118/le3 4 1 2024-09-13T18:30:32.129 INFO:tasks.workunit.client.1.smithi149.stdout:2/880: truncate db/d1b/d1c/d20/fd6 747869 0 2024-09-13T18:30:32.131 INFO:tasks.workunit.client.1.smithi149.stdout:9/828: rmdir d0/d2e 39 2024-09-13T18:30:32.131 INFO:tasks.workunit.client.1.smithi149.stdout:9/829: fsync d0/d2e/d42/d70/d84/dea/f100 0 2024-09-13T18:30:32.131 INFO:tasks.workunit.client.0.smithi038.stdout:1/233: rmdir d12 39 2024-09-13T18:30:32.133 INFO:tasks.workunit.client.1.smithi149.stdout:8/943: mknod d2/dc4/ddb/dff/c13a 0 2024-09-13T18:30:32.137 INFO:tasks.workunit.client.1.smithi149.stdout:2/881: rename db/d1b/d1c/d20/d2b/db7/de2/d11c to db/d1b/d1c/d85/d12b 0 2024-09-13T18:30:32.137 INFO:tasks.workunit.client.1.smithi149.stdout:2/882: fdatasync db/d13/d70/dad/f123 0 2024-09-13T18:30:32.140 INFO:tasks.workunit.client.0.smithi038.stdout:2/237: symlink d2/d1e/d48/l60 0 2024-09-13T18:30:32.142 INFO:tasks.workunit.client.1.smithi149.stdout:8/944: mkdir d2/d5b/d86/d13b 0 2024-09-13T18:30:32.143 INFO:tasks.workunit.client.1.smithi149.stdout:7/989: dread d7/d9/d1c/d1f/d21/d49/d102/d10f/d10b/f112 [0,4194304] 0 2024-09-13T18:30:32.143 INFO:tasks.workunit.client.1.smithi149.stdout:7/990: write d7/d9/d1c/d51/d52/d86/d9f/ff0 [962480,44073] 0 2024-09-13T18:30:32.143 INFO:tasks.workunit.client.1.smithi149.stdout:3/899: sync 2024-09-13T18:30:32.143 INFO:tasks.workunit.client.1.smithi149.stdout:0/997: sync 2024-09-13T18:30:32.143 INFO:tasks.workunit.client.1.smithi149.stdout:0/998: write d1/d29/d31/d44/d47/f59 [4668867,122102] 0 2024-09-13T18:30:32.144 INFO:tasks.workunit.client.1.smithi149.stdout:1/958: dwrite d9/d10/d34/f51 [0,4194304] 0 2024-09-13T18:30:32.145 INFO:tasks.workunit.client.0.smithi038.stdout:8/302: rename d1/de/f10 to d1/de/d21/d24/d4d/f66 0 2024-09-13T18:30:32.146 INFO:tasks.workunit.client.0.smithi038.stdout:8/303: fsync d1/f3 0 2024-09-13T18:30:32.146 INFO:tasks.workunit.client.0.smithi038.stdout:3/209: dwrite d0/fc [0,4194304] 0 2024-09-13T18:30:32.146 INFO:tasks.workunit.client.0.smithi038.stdout:7/190: dwrite db/d12/f34 [0,4194304] 0 2024-09-13T18:30:32.146 INFO:tasks.workunit.client.0.smithi038.stdout:7/191: write db/d12/d1c/d3a/f1d [4810749,34124] 0 2024-09-13T18:30:32.146 INFO:tasks.workunit.client.0.smithi038.stdout:7/192: creat db/d12/d1c/d3a/d3c/f46 x:0 0 0 2024-09-13T18:30:32.146 INFO:tasks.workunit.client.0.smithi038.stdout:9/286: dwrite d0/d7/d13/d30/f3b [8388608,4194304] 0 2024-09-13T18:30:32.146 INFO:tasks.workunit.client.1.smithi149.stdout:2/883: symlink db/d1b/d2f/l12c 0 2024-09-13T18:30:32.147 INFO:tasks.workunit.client.1.smithi149.stdout:2/884: chown db/fc1 4115571 1 2024-09-13T18:30:32.152 INFO:tasks.workunit.client.0.smithi038.stdout:5/193: unlink df/l12 0 2024-09-13T18:30:32.153 INFO:tasks.workunit.client.0.smithi038.stdout:5/194: creat df/d15/f3d x:0 0 0 2024-09-13T18:30:32.155 INFO:tasks.workunit.client.0.smithi038.stdout:9/287: dread d0/d7/d13/f19 [0,4194304] 0 2024-09-13T18:30:32.157 INFO:tasks.workunit.client.1.smithi149.stdout:8/945: unlink d2/d12/dd8/d66/l11a 0 2024-09-13T18:30:32.161 INFO:tasks.workunit.client.1.smithi149.stdout:7/991: rmdir d7/d76/db3/d6f/d9d/d136 0 2024-09-13T18:30:32.162 INFO:tasks.workunit.client.1.smithi149.stdout:3/900: creat d1/d47/df9/f13f x:0 0 0 2024-09-13T18:30:32.162 INFO:tasks.workunit.client.1.smithi149.stdout:3/901: fdatasync d1/f11 0 2024-09-13T18:30:32.166 INFO:tasks.workunit.client.0.smithi038.stdout:4/379: creat d2/df/d1b/d10/d75/f7b x:0 0 0 2024-09-13T18:30:32.166 INFO:tasks.workunit.client.0.smithi038.stdout:4/380: creat d2/df/d1b/d10/f7c x:0 0 0 2024-09-13T18:30:32.166 INFO:tasks.workunit.client.0.smithi038.stdout:4/381: chown d2/df/d22/f29 284367331 1 2024-09-13T18:30:32.167 INFO:tasks.workunit.client.0.smithi038.stdout:4/382: write d2/df/d22/dc/d8/f6c [529121,65076] 0 2024-09-13T18:30:32.167 INFO:tasks.workunit.client.1.smithi149.stdout:9/830: write d0/d2e/f62 [713071,128926] 0 2024-09-13T18:30:32.168 INFO:tasks.workunit.client.1.smithi149.stdout:2/885: dwrite db/d1b/fd3 [0,4194304] 0 2024-09-13T18:30:32.168 INFO:tasks.workunit.client.1.smithi149.stdout:2/886: dread - db/d13/d70/d118/f10d zero size 2024-09-13T18:30:32.168 INFO:tasks.workunit.client.0.smithi038.stdout:1/234: mkdir d12/d3c/d46 0 2024-09-13T18:30:32.168 INFO:tasks.workunit.client.0.smithi038.stdout:1/235: chown d12/f1a 22646867 1 2024-09-13T18:30:32.170 INFO:tasks.workunit.client.1.smithi149.stdout:1/959: mknod d9/c138 0 2024-09-13T18:30:32.170 INFO:tasks.workunit.client.0.smithi038.stdout:6/289: truncate dd/de/d2e/d2f/d4c/f4d 408647 0 2024-09-13T18:30:32.172 INFO:tasks.workunit.client.0.smithi038.stdout:2/238: unlink d2/d1e/d44/d50/d46/f4d 0 2024-09-13T18:30:32.172 INFO:tasks.workunit.client.0.smithi038.stdout:2/239: truncate d2/d1e/d44/d50/d39/d45/f54 573618 0 2024-09-13T18:30:32.174 INFO:tasks.workunit.client.1.smithi149.stdout:8/946: symlink d2/d5b/d88/l13c 0 2024-09-13T18:30:32.180 INFO:tasks.workunit.client.0.smithi038.stdout:3/210: chown d0/dd/c10 54328020 1 2024-09-13T18:30:32.181 INFO:tasks.workunit.client.1.smithi149.stdout:7/992: write f3 [1893057,109708] 0 2024-09-13T18:30:32.183 INFO:tasks.workunit.client.1.smithi149.stdout:3/902: creat d1/d47/df9/d12f/f140 x:0 0 0 2024-09-13T18:30:32.183 INFO:tasks.workunit.client.1.smithi149.stdout:9/831: dread d0/d9e/f3f [0,4194304] 0 2024-09-13T18:30:32.183 INFO:tasks.workunit.client.1.smithi149.stdout:2/887: symlink db/d1b/d6c/d117/l12d 0 2024-09-13T18:30:32.184 INFO:tasks.workunit.client.1.smithi149.stdout:1/960: link d9/d10/d34/dbe/d38/f9c d9/d10/d43/f139 0 2024-09-13T18:30:32.184 INFO:tasks.workunit.client.1.smithi149.stdout:9/832: fdatasync d0/d18/d68/db2/fc8 0 2024-09-13T18:30:32.184 INFO:tasks.workunit.client.1.smithi149.stdout:9/833: write d0/d18/d27/d5c/d7e/ff5 [78902,129860] 0 2024-09-13T18:30:32.184 INFO:tasks.workunit.client.1.smithi149.stdout:9/834: truncate d0/f3c 1307118 0 2024-09-13T18:30:32.184 INFO:tasks.workunit.client.0.smithi038.stdout:7/193: fsync db/fc 0 2024-09-13T18:30:32.184 INFO:tasks.workunit.client.0.smithi038.stdout:6/290: dread dd/de/f3c [0,4194304] 0 2024-09-13T18:30:32.188 INFO:tasks.workunit.client.0.smithi038.stdout:8/304: dwrite d1/ff [0,4194304] 0 2024-09-13T18:30:32.188 INFO:tasks.workunit.client.0.smithi038.stdout:8/305: getdents d1/de/d21/d24/d4d/d50/d62 0 2024-09-13T18:30:32.189 INFO:tasks.workunit.client.0.smithi038.stdout:8/306: stat d1/d2a 0 2024-09-13T18:30:32.189 INFO:tasks.workunit.client.1.smithi149.stdout:7/993: symlink d7/d9/d1c/d51/d52/l15d 0 2024-09-13T18:30:32.189 INFO:tasks.workunit.client.1.smithi149.stdout:1/961: stat d9/d15/d60/d80/d8b/lbd 0 2024-09-13T18:30:32.189 INFO:tasks.workunit.client.1.smithi149.stdout:1/962: truncate d9/d10/de4/f10a 183250 0 2024-09-13T18:30:32.190 INFO:tasks.workunit.client.0.smithi038.stdout:0/244: rmdir d2/d7/d24 39 2024-09-13T18:30:32.193 INFO:tasks.workunit.client.1.smithi149.stdout:0/999: dwrite d1/d2/f119 [0,4194304] 0 2024-09-13T18:30:32.193 INFO:tasks.workunit.client.1.smithi149.stdout:3/903: creat d1/d12/d20/d54/dd1/f141 x:0 0 0 2024-09-13T18:30:32.195 INFO:tasks.workunit.client.1.smithi149.stdout:2/888: mkdir db/d13/d70/d89/d12e 0 2024-09-13T18:30:32.196 INFO:tasks.workunit.client.0.smithi038.stdout:4/383: rename d2/df/d22/dc/f1a to d2/df/d1b/d10/d55/f7d 0 2024-09-13T18:30:32.198 INFO:tasks.workunit.client.0.smithi038.stdout:1/236: rmdir d12/d2a/d32 39 2024-09-13T18:30:32.199 INFO:tasks.workunit.client.1.smithi149.stdout:1/963: creat d9/d10/d3f/f13a x:0 0 0 2024-09-13T18:30:32.199 INFO:tasks.workunit.client.1.smithi149.stdout:1/964: read - d9/d10/d34/d53/d7b/f89 zero size 2024-09-13T18:30:32.199 INFO:tasks.workunit.client.1.smithi149.stdout:8/947: dread d2/db1/fd0 [0,4194304] 0 2024-09-13T18:30:32.199 INFO:tasks.workunit.client.0.smithi038.stdout:2/240: link d2/f26 d2/d1e/f61 0 2024-09-13T18:30:32.199 INFO:tasks.workunit.client.0.smithi038.stdout:5/195: dwrite df/f1e [0,4194304] 0 2024-09-13T18:30:32.200 INFO:tasks.workunit.client.1.smithi149.stdout:8/948: fsync d2/d12/dd8/d58/d97/fa0 0 2024-09-13T18:30:32.202 INFO:tasks.workunit.client.0.smithi038.stdout:6/291: truncate dd/de/d2e/d2f/f39 315550 0 2024-09-13T18:30:32.204 INFO:tasks.workunit.client.0.smithi038.stdout:8/307: mkdir d1/de/d21/d67 0 2024-09-13T18:30:32.204 INFO:tasks.workunit.client.0.smithi038.stdout:8/308: chown d1/de/f33 754295 1 2024-09-13T18:30:32.204 INFO:tasks.workunit.client.0.smithi038.stdout:8/309: write d1/de/d4c/f31 [357970,80281] 0 2024-09-13T18:30:32.204 INFO:tasks.workunit.client.0.smithi038.stdout:8/310: dread - d1/de/d21/d24/d41/f42 zero size 2024-09-13T18:30:32.207 INFO:tasks.workunit.client.0.smithi038.stdout:9/288: dwrite d0/d7/d13/f42 [0,4194304] 0 2024-09-13T18:30:32.208 INFO:tasks.workunit.client.0.smithi038.stdout:1/237: mkdir d12/d15/d47 0 2024-09-13T18:30:32.209 INFO:tasks.workunit.client.0.smithi038.stdout:3/211: dwrite d0/f9 [0,4194304] 0 2024-09-13T18:30:32.210 INFO:tasks.workunit.client.0.smithi038.stdout:0/245: dread d2/d7/f13 [0,4194304] 0 2024-09-13T18:30:32.211 INFO:tasks.workunit.client.0.smithi038.stdout:0/246: fsync d2/dc/f39 0 2024-09-13T18:30:32.212 INFO:tasks.workunit.client.0.smithi038.stdout:7/194: symlink db/l47 0 2024-09-13T18:30:32.212 INFO:tasks.workunit.client.1.smithi149.stdout:2/889: write db/d1b/d1c/f3c [2425392,68015] 0 2024-09-13T18:30:32.213 INFO:tasks.workunit.client.0.smithi038.stdout:6/292: mkdir dd/de/d2e/d2f/d4c/d6f 0 2024-09-13T18:30:32.214 INFO:tasks.workunit.client.0.smithi038.stdout:6/293: chown dd/de/d2e/d30/f29 66436226 1 2024-09-13T18:30:32.214 INFO:tasks.workunit.client.0.smithi038.stdout:8/311: mknod d1/de/d21/d24/d4d/d50/c68 0 2024-09-13T18:30:32.216 INFO:tasks.workunit.client.1.smithi149.stdout:2/890: creat db/d1b/d1c/d85/d12b/f12f x:0 0 0 2024-09-13T18:30:32.216 INFO:tasks.workunit.client.1.smithi149.stdout:2/891: chown db/d1b/l58 2635 1 2024-09-13T18:30:32.220 INFO:tasks.workunit.client.0.smithi038.stdout:1/238: creat d12/d3c/d46/f48 x:0 0 0 2024-09-13T18:30:32.220 INFO:tasks.workunit.client.0.smithi038.stdout:1/239: fdatasync d12/f13 0 2024-09-13T18:30:32.222 INFO:tasks.workunit.client.0.smithi038.stdout:3/212: symlink d0/dd/d19/d1d/d29/d2b/l44 0 2024-09-13T18:30:32.222 INFO:tasks.workunit.client.0.smithi038.stdout:3/213: write d0/fa [954497,78235] 0 2024-09-13T18:30:32.222 INFO:tasks.workunit.client.0.smithi038.stdout:3/214: write d0/f4 [4383551,56953] 0 2024-09-13T18:30:32.222 INFO:tasks.workunit.client.0.smithi038.stdout:0/247: dread d2/dc/f14 [0,4194304] 0 2024-09-13T18:30:32.224 INFO:tasks.workunit.client.0.smithi038.stdout:3/215: write d0/dd/d19/d1d/d29/f3b [176020,7831] 0 2024-09-13T18:30:32.224 INFO:tasks.workunit.client.0.smithi038.stdout:3/216: fsync d0/dd/fe 0 2024-09-13T18:30:32.224 INFO:tasks.workunit.client.0.smithi038.stdout:9/289: getdents d0/d7/d13 0 2024-09-13T18:30:32.225 INFO:tasks.workunit.client.1.smithi149.stdout:7/994: dwrite d7/d9/d1b/d71/ddc/fe8 [0,4194304] 0 2024-09-13T18:30:32.225 INFO:tasks.workunit.client.1.smithi149.stdout:7/995: chown d7/d9/d11/d50/dde/l140 5 1 2024-09-13T18:30:32.225 INFO:tasks.workunit.client.1.smithi149.stdout:8/949: dwrite d2/d13/f85 [0,4194304] 0 2024-09-13T18:30:32.226 INFO:tasks.workunit.client.0.smithi038.stdout:1/240: symlink d12/d2a/l49 0 2024-09-13T18:30:32.229 INFO:tasks.workunit.client.0.smithi038.stdout:2/241: dwrite d2/f11 [0,4194304] 0 2024-09-13T18:30:32.230 INFO:tasks.workunit.client.0.smithi038.stdout:8/312: read d1/d2a/f38 [3181312,18684] 0 2024-09-13T18:30:32.232 INFO:tasks.workunit.client.0.smithi038.stdout:6/294: getdents dd/de/d2e 0 2024-09-13T18:30:32.235 INFO:tasks.workunit.client.1.smithi149.stdout:8/950: link d2/d5b/d88/lf5 d2/d12/dd8/d66/l13d 0 2024-09-13T18:30:32.236 INFO:tasks.workunit.client.0.smithi038.stdout:1/241: write f3 [1518535,7158] 0 2024-09-13T18:30:32.237 INFO:tasks.workunit.client.0.smithi038.stdout:4/384: rename d2/df/d1b/d10/d55/f7d to d2/d49/d4b/d64/f7e 0 2024-09-13T18:30:32.237 INFO:tasks.workunit.client.0.smithi038.stdout:4/385: chown d2/df 16 1 2024-09-13T18:30:32.237 INFO:tasks.workunit.client.0.smithi038.stdout:4/386: write d2/d49/d50/f77 [256685,70950] 0 2024-09-13T18:30:32.237 INFO:tasks.workunit.client.0.smithi038.stdout:9/290: write d0/d7/d2c/d33/f4c [3126318,50624] 0 2024-09-13T18:30:32.238 INFO:tasks.workunit.client.0.smithi038.stdout:3/217: unlink d0/dd/d19/d23/l3f 0 2024-09-13T18:30:32.242 INFO:tasks.workunit.client.0.smithi038.stdout:1/242: dread d12/f17 [0,4194304] 0 2024-09-13T18:30:32.245 INFO:tasks.workunit.client.0.smithi038.stdout:2/242: rmdir d2/d1e/d44/d50 39 2024-09-13T18:30:32.245 INFO:tasks.workunit.client.0.smithi038.stdout:2/243: chown d2/d1e/d44/d50/d39/f5d 25287371 1 2024-09-13T18:30:32.247 INFO:tasks.workunit.client.0.smithi038.stdout:0/248: getdents d2/d2f 0 2024-09-13T18:30:32.249 INFO:tasks.workunit.client.0.smithi038.stdout:8/313: symlink d1/de/d4c/l69 0 2024-09-13T18:30:32.250 INFO:tasks.workunit.client.0.smithi038.stdout:6/295: link dd/de/d2e/d30/l40 dd/de/l70 0 2024-09-13T18:30:32.252 INFO:tasks.workunit.client.0.smithi038.stdout:4/387: truncate d2/df/d1b/f2b 352245 0 2024-09-13T18:30:32.254 INFO:tasks.workunit.client.0.smithi038.stdout:3/218: creat d0/dd/d17/d43/f45 x:0 0 0 2024-09-13T18:30:32.254 INFO:tasks.workunit.client.0.smithi038.stdout:3/219: fdatasync d0/f4 0 2024-09-13T18:30:32.255 INFO:tasks.workunit.client.0.smithi038.stdout:2/244: write d2/d1e/d44/d50/d39/f42 [3760365,127551] 0 2024-09-13T18:30:32.261 INFO:tasks.workunit.client.0.smithi038.stdout:0/249: stat d2/l3 0 2024-09-13T18:30:32.261 INFO:tasks.workunit.client.0.smithi038.stdout:0/250: truncate d2/d7/d24/d3c/f46 719398 0 2024-09-13T18:30:32.261 INFO:tasks.workunit.client.0.smithi038.stdout:0/251: getdents d2/d7/d24/d3c/d3f 0 2024-09-13T18:30:32.261 INFO:tasks.workunit.client.0.smithi038.stdout:0/252: chown d2/d2f/d44 594936304 1 2024-09-13T18:30:32.262 INFO:tasks.workunit.client.1.smithi149.stdout:5/879: sync 2024-09-13T18:30:32.262 INFO:tasks.workunit.client.1.smithi149.stdout:5/880: chown d3/d10/d98/dfb/d67/d83/fb0 25 1 2024-09-13T18:30:32.264 INFO:tasks.workunit.client.1.smithi149.stdout:5/881: creat d3/d10/d4c/d4e/d61/d63/f115 x:0 0 0 2024-09-13T18:30:32.264 INFO:tasks.workunit.client.0.smithi038.stdout:8/314: mknod d1/de/d15/d30/c6a 0 2024-09-13T18:30:32.266 INFO:tasks.workunit.client.0.smithi038.stdout:6/296: unlink dd/de/d2e/d30/c37 0 2024-09-13T18:30:32.266 INFO:tasks.workunit.client.0.smithi038.stdout:6/297: dread - dd/de/d2e/d30/d27/f2d zero size 2024-09-13T18:30:32.268 INFO:tasks.workunit.client.0.smithi038.stdout:7/195: rename db/d12/d13/f37 to db/f48 0 2024-09-13T18:30:32.268 INFO:tasks.workunit.client.0.smithi038.stdout:7/196: chown db/d12/d1c/d3a/d26/f2b 375050237 1 2024-09-13T18:30:32.268 INFO:tasks.workunit.client.0.smithi038.stdout:7/197: fdatasync db/d12/d1c/d3a/d22/f23 0 2024-09-13T18:30:32.269 INFO:tasks.workunit.client.0.smithi038.stdout:4/388: unlink d2/df/d1b/d10/l3f 0 2024-09-13T18:30:32.269 INFO:tasks.workunit.client.0.smithi038.stdout:4/389: truncate d2/df/d1b/d10/d75/f7b 131121 0 2024-09-13T18:30:32.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:31 smithi149 ceph-mon[35845]: pgmap v18: 65 pgs: 65 active+clean; 1.8 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 207 MiB/s rd, 251 MiB/s wr, 352 op/s 2024-09-13T18:30:32.270 INFO:tasks.workunit.client.0.smithi038.stdout:2/245: mkdir d2/d1e/d44/d50/d46/d58/d59/d62 0 2024-09-13T18:30:32.276 INFO:tasks.workunit.client.0.smithi038.stdout:6/298: mkdir dd/de/d2e/d2f/d71 0 2024-09-13T18:30:32.276 INFO:tasks.workunit.client.0.smithi038.stdout:6/299: chown dd/l20 0 1 2024-09-13T18:30:32.277 INFO:tasks.workunit.client.0.smithi038.stdout:3/220: write d0/f2 [23717,73573] 0 2024-09-13T18:30:32.278 INFO:tasks.workunit.client.0.smithi038.stdout:8/315: rename d1/de/d21/d24/d41/f48 to d1/f6b 0 2024-09-13T18:30:32.279 INFO:tasks.workunit.client.0.smithi038.stdout:7/198: mknod db/d12/d13/d43/c49 0 2024-09-13T18:30:32.280 INFO:tasks.workunit.client.0.smithi038.stdout:4/390: creat d2/df/d1b/d10/d55/f7f x:0 0 0 2024-09-13T18:30:32.280 INFO:tasks.workunit.client.0.smithi038.stdout:4/391: chown d2/l26 0 1 2024-09-13T18:30:32.280 INFO:tasks.workunit.client.0.smithi038.stdout:4/392: chown d2/df/d1b/d10/d55/f7f 7926892 1 2024-09-13T18:30:32.281 INFO:tasks.workunit.client.0.smithi038.stdout:4/393: write d2/df/d22/dc/f1e [633269,15561] 0 2024-09-13T18:30:32.281 INFO:tasks.workunit.client.0.smithi038.stdout:2/246: mkdir d2/d1e/d44/d50/d46/d63 0 2024-09-13T18:30:32.282 INFO:tasks.workunit.client.0.smithi038.stdout:0/253: mkdir d2/d7/d55 0 2024-09-13T18:30:32.283 INFO:tasks.workunit.client.0.smithi038.stdout:1/243: dwrite d12/f1c [0,4194304] 0 2024-09-13T18:30:32.283 INFO:tasks.workunit.client.0.smithi038.stdout:6/300: mkdir dd/de/d31/d63/d72 0 2024-09-13T18:30:32.283 INFO:tasks.workunit.client.0.smithi038.stdout:6/301: write dd/de/d2e/d30/f22 [1184921,26231] 0 2024-09-13T18:30:32.284 INFO:tasks.workunit.client.0.smithi038.stdout:3/221: creat d0/dd/d19/d1d/d30/f46 x:0 0 0 2024-09-13T18:30:32.285 INFO:tasks.workunit.client.0.smithi038.stdout:8/316: truncate d1/d8/f2b 4156976 0 2024-09-13T18:30:32.287 INFO:tasks.workunit.client.0.smithi038.stdout:7/199: truncate db/d12/d1c/d3a/d22/f2c 1393088 0 2024-09-13T18:30:32.288 INFO:tasks.workunit.client.0.smithi038.stdout:4/394: mkdir d2/df/d22/dc/d8/d80 0 2024-09-13T18:30:32.288 INFO:tasks.workunit.client.0.smithi038.stdout:4/395: chown d2/df/d1b/d10/d55/l57 48 1 2024-09-13T18:30:32.290 INFO:tasks.workunit.client.0.smithi038.stdout:1/244: link d12/l28 d12/d2a/d32/l4a 0 2024-09-13T18:30:32.290 INFO:tasks.workunit.client.0.smithi038.stdout:1/245: write d12/f2d [614655,38070] 0 2024-09-13T18:30:32.291 INFO:tasks.workunit.client.0.smithi038.stdout:6/302: creat dd/de/d2e/d2f/d4c/d60/f73 x:0 0 0 2024-09-13T18:30:32.291 INFO:tasks.workunit.client.0.smithi038.stdout:6/303: readlink dd/de/d2e/d30/l40 0 2024-09-13T18:30:32.291 INFO:tasks.workunit.client.0.smithi038.stdout:6/304: fsync dd/de/d2e/f4b 0 2024-09-13T18:30:32.292 INFO:tasks.workunit.client.0.smithi038.stdout:6/305: chown dd/f16 95 1 2024-09-13T18:30:32.292 INFO:tasks.workunit.client.0.smithi038.stdout:2/247: dread d2/da/f25 [0,4194304] 0 2024-09-13T18:30:32.292 INFO:tasks.workunit.client.0.smithi038.stdout:3/222: creat d0/dd/d19/f47 x:0 0 0 2024-09-13T18:30:32.294 INFO:tasks.workunit.client.1.smithi149.stdout:7/996: dwrite d7/d11d/f12b [0,4194304] 0 2024-09-13T18:30:32.294 INFO:tasks.workunit.client.1.smithi149.stdout:7/997: write d7/f135 [287714,110391] 0 2024-09-13T18:30:32.294 INFO:tasks.workunit.client.0.smithi038.stdout:0/254: dread d2/dc/f50 [0,4194304] 0 2024-09-13T18:30:32.294 INFO:tasks.workunit.client.0.smithi038.stdout:0/255: chown d2/d2f/d44 2807 1 2024-09-13T18:30:32.294 INFO:tasks.workunit.client.0.smithi038.stdout:7/200: symlink db/d12/d1c/d3a/l4a 0 2024-09-13T18:30:32.294 INFO:tasks.workunit.client.0.smithi038.stdout:7/201: chown db/d12/f3f 0 1 2024-09-13T18:30:32.295 INFO:tasks.workunit.client.0.smithi038.stdout:4/396: creat d2/df/d1b/d10/d71/f81 x:0 0 0 2024-09-13T18:30:32.295 INFO:tasks.workunit.client.1.smithi149.stdout:8/951: dwrite d2/d12/f2f [0,4194304] 0 2024-09-13T18:30:32.295 INFO:tasks.workunit.client.1.smithi149.stdout:5/882: dwrite d3/d10/d98/dfb/d67/d83/f104 [4194304,4194304] 0 2024-09-13T18:30:32.296 INFO:tasks.workunit.client.1.smithi149.stdout:5/883: chown d3/d10/d4c/db8/fd4 1453 1 2024-09-13T18:30:32.296 INFO:tasks.workunit.client.1.smithi149.stdout:5/884: write d3/d10/d4c/d4e/d61/d63/f115 [168213,103880] 0 2024-09-13T18:30:32.296 INFO:tasks.workunit.client.1.smithi149.stdout:5/885: chown d3/d10/d4c/d4e/d61/dea/lec 48290 1 2024-09-13T18:30:32.296 INFO:tasks.workunit.client.1.smithi149.stdout:5/886: chown d3/d10/d4c/d4e/d61/d63/c109 608 1 2024-09-13T18:30:32.296 INFO:tasks.workunit.client.0.smithi038.stdout:1/246: mknod d12/d3c/d46/c4b 0 2024-09-13T18:30:32.296 INFO:tasks.workunit.client.0.smithi038.stdout:5/196: dwrite df/f1e [4194304,4194304] 0 2024-09-13T18:30:32.299 INFO:tasks.workunit.client.0.smithi038.stdout:2/248: truncate d2/d1e/f2f 3480022 0 2024-09-13T18:30:32.299 INFO:tasks.workunit.client.0.smithi038.stdout:2/249: fdatasync d2/d1e/d44/d50/d46/d58/d59/f5a 0 2024-09-13T18:30:32.299 INFO:tasks.workunit.client.0.smithi038.stdout:2/250: readlink d2/d1e/d44/d50/l38 0 2024-09-13T18:30:32.300 INFO:tasks.workunit.client.0.smithi038.stdout:7/202: dread db/d12/d1c/d3a/d22/f30 [0,4194304] 0 2024-09-13T18:30:32.300 INFO:tasks.workunit.client.0.smithi038.stdout:3/223: symlink d0/dd/d19/d1d/d30/l48 0 2024-09-13T18:30:32.304 INFO:tasks.workunit.client.0.smithi038.stdout:0/256: stat d2/c34 0 2024-09-13T18:30:32.306 INFO:tasks.workunit.client.1.smithi149.stdout:7/998: creat d7/d12/f15e x:0 0 0 2024-09-13T18:30:32.306 INFO:tasks.workunit.client.0.smithi038.stdout:8/317: dwrite d1/d4/f12 [4194304,4194304] 0 2024-09-13T18:30:32.309 INFO:tasks.workunit.client.0.smithi038.stdout:5/197: rename df/d29 to df/d13/d3b/d3e 0 2024-09-13T18:30:32.311 INFO:tasks.workunit.client.1.smithi149.stdout:8/952: write d2/f96 [1701316,18472] 0 2024-09-13T18:30:32.311 INFO:tasks.workunit.client.1.smithi149.stdout:8/953: fdatasync d2/d13/f7d 0 2024-09-13T18:30:32.318 INFO:tasks.workunit.client.0.smithi038.stdout:8/318: creat d1/de/d15/d30/f6c x:0 0 0 2024-09-13T18:30:32.318 INFO:tasks.workunit.client.0.smithi038.stdout:8/319: write d1/de/d3a/f3e [377651,4106] 0 2024-09-13T18:30:32.319 INFO:tasks.workunit.client.0.smithi038.stdout:6/306: dwrite dd/de/f1a [4194304,4194304] 0 2024-09-13T18:30:32.321 INFO:tasks.workunit.client.0.smithi038.stdout:3/224: rename d0/dd/d19/d1d/d30/f46 to d0/dd/d19/d1d/d29/d2b/f49 0 2024-09-13T18:30:32.323 INFO:tasks.workunit.client.0.smithi038.stdout:5/198: symlink df/d13/l3f 0 2024-09-13T18:30:32.326 INFO:tasks.workunit.client.0.smithi038.stdout:2/251: rmdir d2/d1e/d44/d50/d39/d45 39 2024-09-13T18:30:32.326 INFO:tasks.workunit.client.0.smithi038.stdout:2/252: readlink d2/d1e/d44/l5e 0 2024-09-13T18:30:32.326 INFO:tasks.workunit.client.0.smithi038.stdout:2/253: chown d2/da/f28 2101 1 2024-09-13T18:30:32.328 INFO:tasks.workunit.client.0.smithi038.stdout:8/320: mkdir d1/de/d21/d45/d5d/d6d 0 2024-09-13T18:30:32.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:31 smithi038 ceph-mon[27689]: pgmap v18: 65 pgs: 65 active+clean; 1.8 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 207 MiB/s rd, 251 MiB/s wr, 352 op/s 2024-09-13T18:30:32.333 INFO:tasks.workunit.client.0.smithi038.stdout:1/247: dwrite d12/d2a/d32/f34 [0,4194304] 0 2024-09-13T18:30:32.333 INFO:tasks.workunit.client.0.smithi038.stdout:1/248: write d12/f23 [2064011,27838] 0 2024-09-13T18:30:32.334 INFO:tasks.workunit.client.0.smithi038.stdout:6/307: link dd/de/d2e/d2f/f39 dd/de/d31/f74 0 2024-09-13T18:30:32.334 INFO:tasks.workunit.client.0.smithi038.stdout:1/249: write d12/f17 [16345,72782] 0 2024-09-13T18:30:32.338 INFO:tasks.workunit.client.1.smithi149.stdout:7/999: rename d7/d9/d11/d50/dde/df7/ddf to d7/d9/d1c/d1f/d21/d7b/de6/d15f 0 2024-09-13T18:30:32.340 INFO:tasks.workunit.client.0.smithi038.stdout:2/254: dread d2/d1e/d44/d50/f2e [0,4194304] 0 2024-09-13T18:30:32.340 INFO:tasks.workunit.client.0.smithi038.stdout:4/397: dwrite d2/df/d22/dc/d8/f6c [0,4194304] 0 2024-09-13T18:30:32.340 INFO:tasks.workunit.client.0.smithi038.stdout:2/255: fdatasync d2/da/f1b 0 2024-09-13T18:30:32.341 INFO:tasks.workunit.client.0.smithi038.stdout:3/225: unlink d0/dd/c15 0 2024-09-13T18:30:32.342 INFO:tasks.workunit.client.0.smithi038.stdout:8/321: mknod d1/de/d21/d45/c6e 0 2024-09-13T18:30:32.344 INFO:tasks.workunit.client.0.smithi038.stdout:4/398: dread d2/df/d1b/d10/f46 [0,4194304] 0 2024-09-13T18:30:32.344 INFO:tasks.workunit.client.0.smithi038.stdout:4/399: readlink d2/df/d1b/d10/l31 0 2024-09-13T18:30:32.345 INFO:tasks.workunit.client.1.smithi149.stdout:8/954: rename d2/d12/f4b to d2/d12/d2a/f13e 0 2024-09-13T18:30:32.345 INFO:tasks.workunit.client.1.smithi149.stdout:8/955: creat d2/d12/d87/f13f x:0 0 0 2024-09-13T18:30:32.348 INFO:tasks.workunit.client.0.smithi038.stdout:6/308: write dd/de/f1a [4356739,9377] 0 2024-09-13T18:30:32.350 INFO:tasks.workunit.client.0.smithi038.stdout:0/257: rename d2/d7/f31 to d2/d7/d24/d3c/f56 0 2024-09-13T18:30:32.352 INFO:tasks.workunit.client.0.smithi038.stdout:6/309: dread f1 [0,4194304] 0 2024-09-13T18:30:32.354 INFO:tasks.workunit.client.0.smithi038.stdout:8/322: creat d1/de/d15/f6f x:0 0 0 2024-09-13T18:30:32.355 INFO:tasks.workunit.client.1.smithi149.stdout:3/904: sync 2024-09-13T18:30:32.355 INFO:tasks.workunit.client.1.smithi149.stdout:1/965: sync 2024-09-13T18:30:32.355 INFO:tasks.workunit.client.1.smithi149.stdout:2/892: sync 2024-09-13T18:30:32.355 INFO:tasks.workunit.client.1.smithi149.stdout:9/835: sync 2024-09-13T18:30:32.355 INFO:tasks.workunit.client.1.smithi149.stdout:9/836: chown d0/d18/d81/ff7 16205 1 2024-09-13T18:30:32.355 INFO:tasks.workunit.client.1.smithi149.stdout:2/893: creat db/d13/d70/d89/f130 x:0 0 0 2024-09-13T18:30:32.355 INFO:tasks.workunit.client.0.smithi038.stdout:3/226: dread d0/dd/d19/d1d/d29/d32/f35 [0,4194304] 0 2024-09-13T18:30:32.355 INFO:tasks.workunit.client.0.smithi038.stdout:3/227: fdatasync d0/dd/d19/d1d/d29/d2b/f49 0 2024-09-13T18:30:32.355 INFO:tasks.workunit.client.0.smithi038.stdout:3/228: chown d0/dd/l16 9744557 1 2024-09-13T18:30:32.356 INFO:tasks.workunit.client.1.smithi149.stdout:8/956: read d2/d12/f5c [70267,2804] 0 2024-09-13T18:30:32.357 INFO:tasks.workunit.client.0.smithi038.stdout:4/400: mkdir d2/df/d1b/d10/d75/d82 0 2024-09-13T18:30:32.357 INFO:tasks.workunit.client.0.smithi038.stdout:5/199: dwrite df/d15/f22 [0,4194304] 0 2024-09-13T18:30:32.357 INFO:tasks.workunit.client.0.smithi038.stdout:1/250: dwrite fe [0,4194304] 0 2024-09-13T18:30:32.357 INFO:tasks.workunit.client.0.smithi038.stdout:1/251: truncate fe 4583384 0 2024-09-13T18:30:32.361 INFO:tasks.workunit.client.0.smithi038.stdout:0/258: write d2/d7/d24/d2b/f37 [2704407,60771] 0 2024-09-13T18:30:32.363 INFO:tasks.workunit.client.1.smithi149.stdout:3/905: symlink d1/d2c/d38/d88/d124/l142 0 2024-09-13T18:30:32.366 INFO:tasks.workunit.client.0.smithi038.stdout:6/310: creat dd/de/d2e/d2f/d71/f75 x:0 0 0 2024-09-13T18:30:32.368 INFO:tasks.workunit.client.1.smithi149.stdout:9/837: link d0/d18/d68/fdc d0/d18/d93/f103 0 2024-09-13T18:30:32.368 INFO:tasks.workunit.client.0.smithi038.stdout:5/200: read df/d15/f22 [870618,3026] 0 2024-09-13T18:30:32.391 INFO:tasks.workunit.client.0.smithi038.stdout:8/323: dwrite d1/f60 [0,4194304] 0 2024-09-13T18:30:32.392 INFO:tasks.workunit.client.0.smithi038.stdout:8/324: fdatasync d1/de/d15/f1c 0 2024-09-13T18:30:32.393 INFO:tasks.workunit.client.0.smithi038.stdout:1/252: dwrite ff [0,4194304] 0 2024-09-13T18:30:32.409 INFO:tasks.workunit.client.0.smithi038.stdout:0/259: dwrite d2/f1c [0,4194304] 0 2024-09-13T18:30:32.409 INFO:tasks.workunit.client.1.smithi149.stdout:5/887: dwrite d3/d10/d98/dfb/d54/d76/fa0 [0,4194304] 0 2024-09-13T18:30:32.409 INFO:tasks.workunit.client.1.smithi149.stdout:3/906: dwrite d1/d2c/d38/d88/f130 [0,4194304] 0 2024-09-13T18:30:32.409 INFO:tasks.workunit.client.0.smithi038.stdout:0/260: dread d2/d7/d24/d3c/f46 [0,4194304] 0 2024-09-13T18:30:32.410 INFO:tasks.workunit.client.0.smithi038.stdout:0/261: dread d2/d7/d24/d3c/f46 [0,4194304] 0 2024-09-13T18:30:32.427 INFO:tasks.workunit.client.1.smithi149.stdout:5/888: dwrite d3/d10/d4c/d4e/fc4 [0,4194304] 0 2024-09-13T18:30:32.465 INFO:tasks.workunit.client.0.smithi038.stdout:3/229: rename d0/dd/d19/d1d/d29/d32/c33 to d0/dd/d17/c4a 0 2024-09-13T18:30:32.465 INFO:tasks.workunit.client.0.smithi038.stdout:8/325: rename d1/de/d21/d24 to d1/de/d21/d24/d4d/d50/d70 22 2024-09-13T18:30:32.465 INFO:tasks.workunit.client.0.smithi038.stdout:3/230: readlink d0/dd/d19/d1d/d29/d2b/l44 0 2024-09-13T18:30:32.470 INFO:tasks.workunit.client.1.smithi149.stdout:9/838: getdents d0/d18/d27/d5c 0 2024-09-13T18:30:32.470 INFO:tasks.workunit.client.1.smithi149.stdout:9/839: fsync d0/d18/d27/d5c/d99/fda 0 2024-09-13T18:30:32.472 INFO:tasks.workunit.client.1.smithi149.stdout:2/894: rmdir db/d100 39 2024-09-13T18:30:32.475 INFO:tasks.workunit.client.0.smithi038.stdout:4/401: creat d2/df/d1b/d10/d75/d82/f83 x:0 0 0 2024-09-13T18:30:32.489 INFO:tasks.workunit.client.1.smithi149.stdout:5/889: symlink d3/d10/d98/dfb/d54/d97/dba/l116 0 2024-09-13T18:30:32.489 INFO:tasks.workunit.client.1.smithi149.stdout:5/890: write d3/d10/d98/dfb/fc1 [9073186,77302] 0 2024-09-13T18:30:32.492 INFO:tasks.workunit.client.0.smithi038.stdout:6/311: mknod dd/de/d2e/d2f/d4c/d60/c76 0 2024-09-13T18:30:32.492 INFO:tasks.workunit.client.0.smithi038.stdout:6/312: creat dd/de/d2e/d2f/d4c/d55/f77 x:0 0 0 2024-09-13T18:30:32.493 INFO:tasks.workunit.client.0.smithi038.stdout:6/313: dread dd/de/f2c [0,4194304] 0 2024-09-13T18:30:32.494 INFO:tasks.workunit.client.1.smithi149.stdout:9/840: mkdir d0/d18/d27/d5c/d79/d102/d104 0 2024-09-13T18:30:32.494 INFO:tasks.workunit.client.1.smithi149.stdout:9/841: read - d0/d18/d68/db2/dc9/fee zero size 2024-09-13T18:30:32.495 INFO:tasks.workunit.client.0.smithi038.stdout:5/201: truncate f9 345629 0 2024-09-13T18:30:32.500 INFO:tasks.workunit.client.0.smithi038.stdout:0/262: creat d2/d2f/d44/f57 x:0 0 0 2024-09-13T18:30:32.502 INFO:tasks.workunit.client.1.smithi149.stdout:2/895: getdents db/d13/d70/d11b 0 2024-09-13T18:30:32.502 INFO:tasks.workunit.client.1.smithi149.stdout:2/896: creat db/d1b/d6c/d10c/f131 x:0 0 0 2024-09-13T18:30:32.502 INFO:tasks.workunit.client.1.smithi149.stdout:2/897: chown db/d1b/d48/l84 6 1 2024-09-13T18:30:32.502 INFO:tasks.workunit.client.1.smithi149.stdout:2/898: readlink db/d13/d70/d118/lac 0 2024-09-13T18:30:32.502 INFO:tasks.workunit.client.1.smithi149.stdout:2/899: fsync db/d1b/d6c/d117/f125 0 2024-09-13T18:30:32.503 INFO:tasks.workunit.client.0.smithi038.stdout:8/326: mkdir d1/de/d21/d24/d4d/d50/d62/d71 0 2024-09-13T18:30:32.505 INFO:tasks.workunit.client.1.smithi149.stdout:1/966: sync 2024-09-13T18:30:32.505 INFO:tasks.workunit.client.0.smithi038.stdout:4/402: link d2/df/d22/f70 d2/d49/f84 0 2024-09-13T18:30:32.510 INFO:tasks.workunit.client.1.smithi149.stdout:9/842: dwrite d0/d18/d93/ff4 [0,4194304] 0 2024-09-13T18:30:32.511 INFO:tasks.workunit.client.1.smithi149.stdout:1/967: truncate d9/d10/d83/d97/fc1 243888 0 2024-09-13T18:30:32.511 INFO:tasks.workunit.client.1.smithi149.stdout:1/968: stat d9/d10/d34/dbe/d38/c63 0 2024-09-13T18:30:32.513 INFO:tasks.workunit.client.1.smithi149.stdout:9/843: dread d0/d18/d93/fb6 [0,4194304] 0 2024-09-13T18:30:32.514 INFO:tasks.workunit.client.0.smithi038.stdout:6/314: rename dd/f26 to dd/de/d31/f78 0 2024-09-13T18:30:32.514 INFO:tasks.workunit.client.0.smithi038.stdout:6/315: write dd/de/f4f [634107,56000] 0 2024-09-13T18:30:32.516 INFO:tasks.workunit.client.0.smithi038.stdout:7/203: truncate db/d12/d1c/d3a/d22/f2c 1243808 0 2024-09-13T18:30:32.517 INFO:tasks.workunit.client.0.smithi038.stdout:8/327: dread d1/f60 [0,4194304] 0 2024-09-13T18:30:32.517 INFO:tasks.workunit.client.0.smithi038.stdout:8/328: write d1/de/f33 [35406,104962] 0 2024-09-13T18:30:32.517 INFO:tasks.workunit.client.0.smithi038.stdout:8/329: write d1/de/d21/d24/d4d/f66 [2251522,85421] 0 2024-09-13T18:30:32.519 INFO:tasks.workunit.client.1.smithi149.stdout:2/900: dread db/d13/d70/d118/d8d/fbd [0,4194304] 0 2024-09-13T18:30:32.519 INFO:tasks.workunit.client.1.smithi149.stdout:2/901: chown db/d13/d70/d118/le3 494 1 2024-09-13T18:30:32.519 INFO:tasks.workunit.client.1.smithi149.stdout:2/902: stat db/d13/d70/d118/d12/c62 0 2024-09-13T18:30:32.519 INFO:tasks.workunit.client.1.smithi149.stdout:1/969: mkdir d9/d10/d34/d53/d13b 0 2024-09-13T18:30:32.520 INFO:tasks.workunit.client.1.smithi149.stdout:8/957: sync 2024-09-13T18:30:32.520 INFO:tasks.workunit.client.1.smithi149.stdout:8/958: fsync d2/d12/d40/ff0 0 2024-09-13T18:30:32.520 INFO:tasks.workunit.client.0.smithi038.stdout:4/403: truncate d2/f2f 3379548 0 2024-09-13T18:30:32.522 INFO:tasks.workunit.client.1.smithi149.stdout:9/844: dread d0/d2e/d42/d59/fe4 [0,4194304] 0 2024-09-13T18:30:32.522 INFO:tasks.workunit.client.1.smithi149.stdout:9/845: chown d0/d47/d61 2199810 1 2024-09-13T18:30:32.522 INFO:tasks.workunit.client.1.smithi149.stdout:2/903: unlink db/d13/d70/d89/lcb 0 2024-09-13T18:30:32.522 INFO:tasks.workunit.client.1.smithi149.stdout:2/904: stat db/d13/d70/d118/lac 0 2024-09-13T18:30:32.523 INFO:tasks.workunit.client.0.smithi038.stdout:6/316: mknod dd/de/d2e/d2f/d4c/d6f/c79 0 2024-09-13T18:30:32.523 INFO:tasks.workunit.client.1.smithi149.stdout:3/907: sync 2024-09-13T18:30:32.524 INFO:tasks.workunit.client.1.smithi149.stdout:3/908: read d1/d2e/f14 [1659306,41189] 0 2024-09-13T18:30:32.524 INFO:tasks.workunit.client.1.smithi149.stdout:3/909: creat d1/d2c/d38/d88/f143 x:0 0 0 2024-09-13T18:30:32.524 INFO:tasks.workunit.client.0.smithi038.stdout:6/317: dread dd/de/f2c [0,4194304] 0 2024-09-13T18:30:32.528 INFO:tasks.workunit.client.1.smithi149.stdout:2/905: symlink db/d13/d70/l132 0 2024-09-13T18:30:32.531 INFO:tasks.workunit.client.0.smithi038.stdout:8/330: creat d1/de/d21/d45/f72 x:0 0 0 2024-09-13T18:30:32.531 INFO:tasks.workunit.client.0.smithi038.stdout:8/331: creat d1/de/d21/d45/f73 x:0 0 0 2024-09-13T18:30:32.531 INFO:tasks.workunit.client.1.smithi149.stdout:1/970: write d9/d15/d60/da5/fd4 [1939893,91269] 0 2024-09-13T18:30:32.533 INFO:tasks.workunit.client.1.smithi149.stdout:3/910: unlink d1/d2c/d42/ff3 0 2024-09-13T18:30:32.534 INFO:tasks.workunit.client.0.smithi038.stdout:5/202: getdents df/d15/d36 0 2024-09-13T18:30:32.535 INFO:tasks.workunit.client.0.smithi038.stdout:0/263: dwrite d2/d7/d24/d2b/f2d [0,4194304] 0 2024-09-13T18:30:32.536 INFO:tasks.workunit.client.1.smithi149.stdout:1/971: link d9/d15/d60/d80/dcd/dab/f10c d9/d10/d83/d97/f13c 0 2024-09-13T18:30:32.536 INFO:tasks.workunit.client.1.smithi149.stdout:1/972: chown d9/d15/d60/d80/dcd/db7 98 1 2024-09-13T18:30:32.537 INFO:tasks.workunit.client.0.smithi038.stdout:4/404: mknod d2/d49/d50/c85 0 2024-09-13T18:30:32.537 INFO:tasks.workunit.client.0.smithi038.stdout:7/204: write db/f11 [188319,25382] 0 2024-09-13T18:30:32.538 INFO:tasks.workunit.client.1.smithi149.stdout:3/911: mkdir d1/d48/ddb/d13c/d144 0 2024-09-13T18:30:32.540 INFO:tasks.workunit.client.1.smithi149.stdout:1/973: truncate d9/d10/d34/d53/f9e 4066662 0 2024-09-13T18:30:32.541 INFO:tasks.workunit.client.1.smithi149.stdout:2/906: dread db/f11d [0,4194304] 0 2024-09-13T18:30:32.543 INFO:tasks.workunit.client.1.smithi149.stdout:3/912: rename d1/d2c/d38/d88/d124/l142 to d1/d2e/d1d/d49/l145 0 2024-09-13T18:30:32.543 INFO:tasks.workunit.client.1.smithi149.stdout:9/846: dwrite d0/d2e/d42/d59/fa7 [0,4194304] 0 2024-09-13T18:30:32.545 INFO:tasks.workunit.client.0.smithi038.stdout:8/332: unlink d1/de/d15/d30/c4b 0 2024-09-13T18:30:32.548 INFO:tasks.workunit.client.0.smithi038.stdout:8/333: dread d1/de/d4c/f31 [0,4194304] 0 2024-09-13T18:30:32.550 INFO:tasks.workunit.client.1.smithi149.stdout:3/913: unlink d1/d47/d30/fbd 0 2024-09-13T18:30:32.551 INFO:tasks.workunit.client.1.smithi149.stdout:1/974: dread d9/d10/d34/d53/d57/fa1 [0,4194304] 0 2024-09-13T18:30:32.552 INFO:tasks.workunit.client.0.smithi038.stdout:0/264: unlink d2/d7/f21 0 2024-09-13T18:30:32.552 INFO:tasks.workunit.client.0.smithi038.stdout:5/203: write f3 [5794543,105401] 0 2024-09-13T18:30:32.557 INFO:tasks.workunit.client.0.smithi038.stdout:4/405: mknod d2/d49/c86 0 2024-09-13T18:30:32.559 INFO:tasks.workunit.client.0.smithi038.stdout:7/205: mkdir db/d12/d1c/d3a/d4b 0 2024-09-13T18:30:32.560 INFO:tasks.workunit.client.1.smithi149.stdout:3/914: truncate d1/d2c/d38/d88/fd3 2925644 0 2024-09-13T18:30:32.560 INFO:tasks.workunit.client.1.smithi149.stdout:3/915: truncate d1/d48/f121 1000515 0 2024-09-13T18:30:32.560 INFO:tasks.workunit.client.1.smithi149.stdout:3/916: truncate d1/d48/f12d 442644 0 2024-09-13T18:30:32.563 INFO:tasks.workunit.client.0.smithi038.stdout:5/204: unlink df/d13/f35 0 2024-09-13T18:30:32.564 INFO:tasks.workunit.client.0.smithi038.stdout:7/206: mknod db/d12/d1c/d3a/d22/d28/c4c 0 2024-09-13T18:30:32.565 INFO:tasks.workunit.client.0.smithi038.stdout:5/205: rename df/d13/d3b/d3e/l32 to df/d15/l40 0 2024-09-13T18:30:32.566 INFO:tasks.workunit.client.0.smithi038.stdout:5/206: getdents df/d15/d36 0 2024-09-13T18:30:32.567 INFO:tasks.workunit.client.0.smithi038.stdout:7/207: creat db/d21/d33/f4d x:0 0 0 2024-09-13T18:30:32.567 INFO:tasks.workunit.client.1.smithi149.stdout:2/907: dwrite db/d1b/d48/fd9 [0,4194304] 0 2024-09-13T18:30:32.567 INFO:tasks.workunit.client.1.smithi149.stdout:2/908: dread - db/d1b/d1c/d20/dff/f107 zero size 2024-09-13T18:30:32.568 INFO:tasks.workunit.client.0.smithi038.stdout:5/207: mkdir df/d13/d3b/d41 0 2024-09-13T18:30:32.568 INFO:tasks.workunit.client.0.smithi038.stdout:5/208: fdatasync df/d13/f34 0 2024-09-13T18:30:32.569 INFO:tasks.workunit.client.0.smithi038.stdout:5/209: write f2 [1259154,59154] 0 2024-09-13T18:30:32.569 INFO:tasks.workunit.client.1.smithi149.stdout:1/975: rmdir d9/d10/d34/d53/d57 39 2024-09-13T18:30:32.570 INFO:tasks.workunit.client.0.smithi038.stdout:5/210: symlink df/d13/l42 0 2024-09-13T18:30:32.570 INFO:tasks.workunit.client.0.smithi038.stdout:5/211: truncate df/d15/f22 4701616 0 2024-09-13T18:30:32.575 INFO:tasks.workunit.client.0.smithi038.stdout:5/212: rename df/d13/l24 to df/d15/l43 0 2024-09-13T18:30:32.576 INFO:tasks.workunit.client.0.smithi038.stdout:4/406: write d2/df/d1b/f51 [1903423,119897] 0 2024-09-13T18:30:32.576 INFO:tasks.workunit.client.0.smithi038.stdout:5/213: readlink df/d15/l43 0 2024-09-13T18:30:32.576 INFO:tasks.workunit.client.0.smithi038.stdout:5/214: chown df/d13/l30 1014 1 2024-09-13T18:30:32.576 INFO:tasks.workunit.client.0.smithi038.stdout:5/215: fsync df/d13/d3b/d3e/f33 0 2024-09-13T18:30:32.576 INFO:tasks.workunit.client.1.smithi149.stdout:3/917: getdents d1/d48/d75 0 2024-09-13T18:30:32.576 INFO:tasks.workunit.client.0.smithi038.stdout:8/334: dwrite d1/de/f23 [0,4194304] 0 2024-09-13T18:30:32.577 INFO:tasks.workunit.client.0.smithi038.stdout:5/216: read df/f2a [440037,41291] 0 2024-09-13T18:30:32.577 INFO:tasks.workunit.client.1.smithi149.stdout:1/976: stat d9/d10/d34/d53/d7b/d11d/c135 0 2024-09-13T18:30:32.580 INFO:tasks.workunit.client.0.smithi038.stdout:0/265: dwrite d2/d7/d24/d3c/f56 [0,4194304] 0 2024-09-13T18:30:32.581 INFO:tasks.workunit.client.1.smithi149.stdout:3/918: stat d1/d2e/l1b 0 2024-09-13T18:30:32.581 INFO:tasks.workunit.client.1.smithi149.stdout:3/919: chown d1/d2e/d1d/d9a/d39/ca5 24287 1 2024-09-13T18:30:32.581 INFO:tasks.workunit.client.1.smithi149.stdout:3/920: write d1/d2e/f14 [3611219,122910] 0 2024-09-13T18:30:32.581 INFO:tasks.workunit.client.1.smithi149.stdout:3/921: chown d1/d2c/d38/d88/le4 68959 1 2024-09-13T18:30:32.581 INFO:tasks.workunit.client.1.smithi149.stdout:3/922: truncate d1/d47/fd0 641195 0 2024-09-13T18:30:32.582 INFO:tasks.workunit.client.1.smithi149.stdout:3/923: creat d1/d2e/d1d/d6c/f146 x:0 0 0 2024-09-13T18:30:32.582 INFO:tasks.workunit.client.0.smithi038.stdout:7/208: write db/d12/f34 [542295,101888] 0 2024-09-13T18:30:32.584 INFO:tasks.workunit.client.0.smithi038.stdout:4/407: rename d2/df/d22/f40 to d2/df/d1b/d10/d75/d82/f87 0 2024-09-13T18:30:32.584 INFO:tasks.workunit.client.0.smithi038.stdout:4/408: dread - d2/d49/f84 zero size 2024-09-13T18:30:32.584 INFO:tasks.workunit.client.0.smithi038.stdout:4/409: stat d2/df 0 2024-09-13T18:30:32.584 INFO:tasks.workunit.client.0.smithi038.stdout:4/410: fdatasync d2/d49/f5b 0 2024-09-13T18:30:32.584 INFO:tasks.workunit.client.0.smithi038.stdout:4/411: creat d2/df/d1b/d10/f88 x:0 0 0 2024-09-13T18:30:32.584 INFO:tasks.workunit.client.0.smithi038.stdout:4/412: fsync d2/f33 0 2024-09-13T18:30:32.585 INFO:tasks.workunit.client.1.smithi149.stdout:1/977: creat d9/d15/d60/d80/d8b/d42/f13d x:0 0 0 2024-09-13T18:30:32.589 INFO:tasks.workunit.client.1.smithi149.stdout:2/909: dwrite db/d1b/d1c/d85/fde [4194304,4194304] 0 2024-09-13T18:30:32.589 INFO:tasks.workunit.client.1.smithi149.stdout:2/910: write db/d1b/dab/f114 [503626,10535] 0 2024-09-13T18:30:32.590 INFO:tasks.workunit.client.1.smithi149.stdout:3/924: creat d1/d48/d75/f147 x:0 0 0 2024-09-13T18:30:32.590 INFO:tasks.workunit.client.1.smithi149.stdout:3/925: dread - d1/d47/d30/d5a/f109 zero size 2024-09-13T18:30:32.592 INFO:tasks.workunit.client.0.smithi038.stdout:0/266: dread d2/d7/d24/d2b/f37 [0,4194304] 0 2024-09-13T18:30:32.594 INFO:tasks.workunit.client.1.smithi149.stdout:1/978: rename d9/d10/d43/f139 to d9/d10/de4/f13e 0 2024-09-13T18:30:32.600 INFO:tasks.workunit.client.1.smithi149.stdout:2/911: dread db/d1b/d1c/d85/fde [4194304,4194304] 0 2024-09-13T18:30:32.601 INFO:tasks.workunit.client.0.smithi038.stdout:8/335: rename d1/d2a/c49 to d1/de/d21/d24/d56/c74 0 2024-09-13T18:30:32.605 INFO:tasks.workunit.client.1.smithi149.stdout:3/926: dread d1/d2e/d1d/d6c/f8c [0,4194304] 0 2024-09-13T18:30:32.605 INFO:tasks.workunit.client.0.smithi038.stdout:7/209: dwrite db/d12/d1c/d3a/d26/f2b [0,4194304] 0 2024-09-13T18:30:32.607 INFO:tasks.workunit.client.0.smithi038.stdout:4/413: rename d2/df/d1b/d10/l47 to d2/d49/l89 0 2024-09-13T18:30:32.610 INFO:tasks.workunit.client.0.smithi038.stdout:8/336: creat d1/de/d21/f75 x:0 0 0 2024-09-13T18:30:32.615 INFO:tasks.workunit.client.1.smithi149.stdout:1/979: link d9/d10/d34/d53/d57/f64 d9/d15/d40/f13f 0 2024-09-13T18:30:32.616 INFO:tasks.workunit.client.1.smithi149.stdout:1/980: readlink d9/d58/l133 0 2024-09-13T18:30:32.616 INFO:tasks.workunit.client.1.smithi149.stdout:1/981: write d9/d10/d34/d3c/d50/def/f10f [876859,34236] 0 2024-09-13T18:30:32.616 INFO:tasks.workunit.client.1.smithi149.stdout:1/982: creat d9/d10/d101/f140 x:0 0 0 2024-09-13T18:30:32.616 INFO:tasks.workunit.client.0.smithi038.stdout:7/210: creat db/d12/d13/d43/f4e x:0 0 0 2024-09-13T18:30:32.618 INFO:tasks.workunit.client.0.smithi038.stdout:4/414: readlink d2/df/d22/l9 0 2024-09-13T18:30:32.619 INFO:tasks.workunit.client.0.smithi038.stdout:0/267: rename d2/d7/d24/d3c/c42 to d2/d7/d24/d2b/c58 0 2024-09-13T18:30:32.621 INFO:tasks.workunit.client.0.smithi038.stdout:5/217: rmdir df/d13 39 2024-09-13T18:30:32.624 INFO:tasks.workunit.client.1.smithi149.stdout:1/983: getdents d9/d10/d34/d3c/d50/def 0 2024-09-13T18:30:32.625 INFO:tasks.workunit.client.1.smithi149.stdout:2/912: dwrite db/d1b/d1c/d20/f45 [0,4194304] 0 2024-09-13T18:30:32.627 INFO:tasks.workunit.client.1.smithi149.stdout:2/913: mkdir db/d13/d70/d118/d133 0 2024-09-13T18:30:32.627 INFO:tasks.workunit.client.1.smithi149.stdout:2/914: truncate db/d13/d70/d118/f14 4510202 0 2024-09-13T18:30:32.627 INFO:tasks.workunit.client.1.smithi149.stdout:2/915: chown db/d1b/d1c/d20/d2b/d3e/d95/cbb 340115404 1 2024-09-13T18:30:32.630 INFO:tasks.workunit.client.1.smithi149.stdout:2/916: mkdir db/d1b/d1c/d20/d3a/d134 0 2024-09-13T18:30:32.634 INFO:tasks.workunit.client.1.smithi149.stdout:5/891: sync 2024-09-13T18:30:32.637 INFO:tasks.workunit.client.1.smithi149.stdout:8/959: sync 2024-09-13T18:30:32.638 INFO:tasks.workunit.client.1.smithi149.stdout:9/847: sync 2024-09-13T18:30:32.638 INFO:tasks.workunit.client.1.smithi149.stdout:1/984: write d9/d10/d3f/f7a [1169794,26371] 0 2024-09-13T18:30:32.639 INFO:tasks.workunit.client.0.smithi038.stdout:4/415: rename d2/df/d22/dc/d8/f59 to d2/df/d1b/f8a 0 2024-09-13T18:30:32.640 INFO:tasks.workunit.client.0.smithi038.stdout:0/268: mknod d2/d2f/d44/d49/c59 0 2024-09-13T18:30:32.641 INFO:tasks.workunit.client.1.smithi149.stdout:1/985: mkdir d9/d10/d34/d53/d13b/d141 0 2024-09-13T18:30:32.641 INFO:tasks.workunit.client.1.smithi149.stdout:1/986: chown d9/d10/d3f/dc9/ddf/f12f 936450817 1 2024-09-13T18:30:32.642 INFO:tasks.workunit.client.0.smithi038.stdout:5/218: mkdir df/d13/d3b/d44 0 2024-09-13T18:30:32.642 INFO:tasks.workunit.client.0.smithi038.stdout:5/219: chown df/d15/f39 47217 1 2024-09-13T18:30:32.643 INFO:tasks.workunit.client.0.smithi038.stdout:7/211: mknod db/c4f 0 2024-09-13T18:30:32.643 INFO:tasks.workunit.client.0.smithi038.stdout:7/212: readlink db/d12/d1c/l1e 0 2024-09-13T18:30:32.645 INFO:tasks.workunit.client.1.smithi149.stdout:1/987: unlink d9/d10/d3f/dc9/fdb 0 2024-09-13T18:30:32.645 INFO:tasks.workunit.client.0.smithi038.stdout:4/416: write d2/df/d22/dc/f1e [534253,25119] 0 2024-09-13T18:30:32.647 INFO:tasks.workunit.client.0.smithi038.stdout:0/269: creat d2/d7/d24/d3c/d3f/f5a x:0 0 0 2024-09-13T18:30:32.649 INFO:tasks.workunit.client.0.smithi038.stdout:5/220: symlink df/d15/l45 0 2024-09-13T18:30:32.650 INFO:tasks.workunit.client.1.smithi149.stdout:1/988: mkdir d9/d15/d40/d90/d142 0 2024-09-13T18:30:32.651 INFO:tasks.workunit.client.0.smithi038.stdout:7/213: chown db/f10 3177 1 2024-09-13T18:30:32.652 INFO:tasks.workunit.client.1.smithi149.stdout:9/848: write d0/d2e/d42/d70/d84/fac [2803879,92523] 0 2024-09-13T18:30:32.655 INFO:tasks.workunit.client.0.smithi038.stdout:4/417: rename d2/d49/f84 to d2/df/d1b/d10/d75/f8b 0 2024-09-13T18:30:32.656 INFO:tasks.workunit.client.1.smithi149.stdout:1/989: symlink d9/d10/d43/dcb/dee/l143 0 2024-09-13T18:30:32.656 INFO:tasks.workunit.client.1.smithi149.stdout:1/990: chown d9/d10/d3f/f13a 42263 1 2024-09-13T18:30:32.656 INFO:tasks.workunit.client.1.smithi149.stdout:2/917: dwrite db/d1b/d2f/f52 [4194304,4194304] 0 2024-09-13T18:30:32.657 INFO:tasks.workunit.client.0.smithi038.stdout:0/270: mknod d2/d2f/c5b 0 2024-09-13T18:30:32.657 INFO:tasks.workunit.client.0.smithi038.stdout:0/271: chown d2/f5 27 1 2024-09-13T18:30:32.659 INFO:tasks.workunit.client.0.smithi038.stdout:7/214: mknod db/d12/d13/d43/c50 0 2024-09-13T18:30:32.664 INFO:tasks.workunit.client.1.smithi149.stdout:2/918: unlink db/d13/d70/d118/f10d 0 2024-09-13T18:30:32.664 INFO:tasks.workunit.client.1.smithi149.stdout:2/919: truncate db/d1b/d1c/d20/dff/f107 869723 0 2024-09-13T18:30:32.664 INFO:tasks.workunit.client.1.smithi149.stdout:2/920: read db/d13/d70/d118/f61 [1639160,126279] 0 2024-09-13T18:30:32.667 INFO:tasks.workunit.client.1.smithi149.stdout:2/921: dread db/d1b/d1c/d20/d2b/d3e/d95/fd5 [0,4194304] 0 2024-09-13T18:30:32.669 INFO:tasks.workunit.client.0.smithi038.stdout:7/215: read db/d12/f18 [1877781,95699] 0 2024-09-13T18:30:32.671 INFO:tasks.workunit.client.1.smithi149.stdout:2/922: rename db/d1b/dab/l110 to db/d1b/d1c/l135 0 2024-09-13T18:30:32.671 INFO:tasks.workunit.client.1.smithi149.stdout:2/923: chown db/d1b/d1c/d20/d2b/d3e/d95/fb6 1836 1 2024-09-13T18:30:32.672 INFO:tasks.workunit.client.0.smithi038.stdout:7/216: mkdir db/d21/d33/d51 0 2024-09-13T18:30:32.672 INFO:tasks.workunit.client.0.smithi038.stdout:0/272: write d2/dc/f11 [2299631,101374] 0 2024-09-13T18:30:32.675 INFO:tasks.workunit.client.0.smithi038.stdout:0/273: readlink d2/d7/l3a 0 2024-09-13T18:30:32.678 INFO:tasks.workunit.client.1.smithi149.stdout:5/892: dwrite d3/d10/d98/f10b [0,4194304] 0 2024-09-13T18:30:32.678 INFO:tasks.workunit.client.1.smithi149.stdout:5/893: fdatasync d3/d10/d98/dfb/d54/d76/d7a/ffd 0 2024-09-13T18:30:32.678 INFO:tasks.workunit.client.1.smithi149.stdout:5/894: fsync d3/d10/d98/dfb/d54/d97/fee 0 2024-09-13T18:30:32.678 INFO:tasks.workunit.client.1.smithi149.stdout:5/895: chown d3/d10/d98/dfb/d54/d97/dba/df8/cf5 275981335 1 2024-09-13T18:30:32.683 INFO:tasks.workunit.client.1.smithi149.stdout:5/896: truncate d3/d10/f80 135167 0 2024-09-13T18:30:32.693 INFO:tasks.workunit.client.0.smithi038.stdout:5/221: dwrite df/d15/d36/f3a [0,4194304] 0 2024-09-13T18:30:32.694 INFO:tasks.workunit.client.1.smithi149.stdout:9/849: dwrite d0/d18/d27/d5c/d99/d9f/fa9 [0,4194304] 0 2024-09-13T18:30:32.694 INFO:tasks.workunit.client.0.smithi038.stdout:4/418: dwrite d2/df/d1b/f73 [0,4194304] 0 2024-09-13T18:30:32.699 INFO:tasks.workunit.client.0.smithi038.stdout:7/217: rename db/d21/d33 to db/d12/d1c/d3a/d3c/d52 0 2024-09-13T18:30:32.699 INFO:tasks.workunit.client.0.smithi038.stdout:7/218: chown db/d12/d1c/d3a/d26/f2b 120 1 2024-09-13T18:30:32.701 INFO:tasks.workunit.client.0.smithi038.stdout:4/419: rename d2/df/l20 to d2/df/d22/dc/d8/d3b/l8c 0 2024-09-13T18:30:32.702 INFO:tasks.workunit.client.0.smithi038.stdout:5/222: dread df/d15/f22 [0,4194304] 0 2024-09-13T18:30:32.703 INFO:tasks.workunit.client.0.smithi038.stdout:5/223: creat df/d13/d3b/d44/f46 x:0 0 0 2024-09-13T18:30:32.706 INFO:tasks.workunit.client.1.smithi149.stdout:9/850: write d0/d47/fca [2540313,529] 0 2024-09-13T18:30:32.707 INFO:tasks.workunit.client.0.smithi038.stdout:5/224: dread fd [0,4194304] 0 2024-09-13T18:30:32.708 INFO:tasks.workunit.client.0.smithi038.stdout:5/225: readlink df/d15/l45 0 2024-09-13T18:30:32.708 INFO:tasks.workunit.client.1.smithi149.stdout:9/851: mkdir d0/d2e/d42/d70/d84/d105 0 2024-09-13T18:30:32.708 INFO:tasks.workunit.client.1.smithi149.stdout:9/852: write d0/d18/d93/fb6 [1387818,118724] 0 2024-09-13T18:30:32.709 INFO:tasks.workunit.client.0.smithi038.stdout:4/420: dread d2/df/d22/dc/f16 [4194304,4194304] 0 2024-09-13T18:30:32.709 INFO:tasks.workunit.client.1.smithi149.stdout:1/991: dwrite d9/d10/d34/d53/d57/f65 [4194304,4194304] 0 2024-09-13T18:30:32.709 INFO:tasks.workunit.client.1.smithi149.stdout:1/992: chown d9/d15/d40/l104 11266356 1 2024-09-13T18:30:32.709 INFO:tasks.workunit.client.1.smithi149.stdout:1/993: chown d9/d10/d34/c4d 1022411 1 2024-09-13T18:30:32.710 INFO:tasks.workunit.client.0.smithi038.stdout:5/226: rename df/d15/l17 to df/d13/d3b/d41/l47 0 2024-09-13T18:30:32.710 INFO:tasks.workunit.client.0.smithi038.stdout:5/227: truncate df/d13/d3b/d3e/f31 926697 0 2024-09-13T18:30:32.711 INFO:tasks.workunit.client.1.smithi149.stdout:2/924: dwrite db/d1b/d6c/d10c/f131 [0,4194304] 0 2024-09-13T18:30:32.711 INFO:tasks.workunit.client.0.smithi038.stdout:7/219: dread db/d12/d1c/f20 [0,4194304] 0 2024-09-13T18:30:32.712 INFO:tasks.workunit.client.1.smithi149.stdout:5/897: dwrite d3/d10/d4c/d4e/d61/f96 [0,4194304] 0 2024-09-13T18:30:32.713 INFO:tasks.workunit.client.1.smithi149.stdout:5/898: readlink d3/d8/d13/l5f 0 2024-09-13T18:30:32.713 INFO:tasks.workunit.client.1.smithi149.stdout:5/899: read d3/d10/d4c/d4e/d61/d63/f115 [150760,124673] 0 2024-09-13T18:30:32.717 INFO:tasks.workunit.client.1.smithi149.stdout:9/853: symlink d0/d18/d27/d5c/d79/d102/d104/l106 0 2024-09-13T18:30:32.718 INFO:tasks.workunit.client.1.smithi149.stdout:1/994: truncate d9/d15/d60/d80/f116 3411544 0 2024-09-13T18:30:32.719 INFO:tasks.workunit.client.0.smithi038.stdout:0/274: dread d2/dc/f11 [0,4194304] 0 2024-09-13T18:30:32.722 INFO:tasks.workunit.client.1.smithi149.stdout:5/900: symlink d3/d10/d4c/d4e/d61/d75/l117 0 2024-09-13T18:30:32.724 INFO:tasks.workunit.client.1.smithi149.stdout:2/925: write db/d1b/fd3 [2645754,13757] 0 2024-09-13T18:30:32.726 INFO:tasks.workunit.client.1.smithi149.stdout:9/854: rename d0/d18/d27/d5c/d7e/dbc to d0/d18/d27/d5c/d7e/d107 0 2024-09-13T18:30:32.726 INFO:tasks.workunit.client.1.smithi149.stdout:9/855: chown d0/d18/d27/d5c/d7e/ff5 2 1 2024-09-13T18:30:32.727 INFO:tasks.workunit.client.1.smithi149.stdout:1/995: getdents d9/d15/d60/d80/d8b/d42 0 2024-09-13T18:30:32.728 INFO:tasks.workunit.client.1.smithi149.stdout:2/926: dread db/d1b/fe9 [0,4194304] 0 2024-09-13T18:30:32.732 INFO:tasks.workunit.client.1.smithi149.stdout:1/996: creat d9/d10/d34/d53/d13b/d141/f144 x:0 0 0 2024-09-13T18:30:32.732 INFO:tasks.workunit.client.1.smithi149.stdout:1/997: readlink d9/d15/d60/d80/d8b/d42/l6d 0 2024-09-13T18:30:32.736 INFO:tasks.workunit.client.0.smithi038.stdout:0/275: write d2/f5 [1365115,64802] 0 2024-09-13T18:30:32.737 INFO:tasks.workunit.client.1.smithi149.stdout:2/927: mknod db/d1b/d1c/d20/d2b/db7/c136 0 2024-09-13T18:30:32.740 INFO:tasks.workunit.client.0.smithi038.stdout:0/276: creat d2/f5c x:0 0 0 2024-09-13T18:30:32.740 INFO:tasks.workunit.client.0.smithi038.stdout:0/277: fsync d2/d7/d24/d2b/f37 0 2024-09-13T18:30:32.742 INFO:tasks.workunit.client.0.smithi038.stdout:0/278: creat d2/d7/d24/d2b/f5d x:0 0 0 2024-09-13T18:30:32.749 INFO:tasks.workunit.client.1.smithi149.stdout:3/927: sync 2024-09-13T18:30:32.750 INFO:tasks.workunit.client.0.smithi038.stdout:7/220: dwrite db/d12/d13/f32 [0,4194304] 0 2024-09-13T18:30:32.751 INFO:tasks.workunit.client.0.smithi038.stdout:7/221: chown db/d12/d13/d43/c50 1969401658 1 2024-09-13T18:30:32.751 INFO:tasks.workunit.client.0.smithi038.stdout:7/222: stat db/l47 0 2024-09-13T18:30:32.751 INFO:tasks.workunit.client.1.smithi149.stdout:3/928: dread d1/d12/db9/fbc [0,4194304] 0 2024-09-13T18:30:32.752 INFO:tasks.workunit.client.0.smithi038.stdout:5/228: dwrite df/d13/d3b/d3e/f2f [0,4194304] 0 2024-09-13T18:30:32.753 INFO:tasks.workunit.client.0.smithi038.stdout:5/229: read df/d13/d3b/d3e/f33 [601800,51080] 0 2024-09-13T18:30:32.753 INFO:tasks.workunit.client.0.smithi038.stdout:5/230: dread - df/d13/d3b/d44/f46 zero size 2024-09-13T18:30:32.760 INFO:tasks.workunit.client.0.smithi038.stdout:4/421: dwrite d2/df/d22/dc/d8/d3b/f53 [0,4194304] 0 2024-09-13T18:30:32.760 INFO:tasks.workunit.client.0.smithi038.stdout:4/422: write d2/df/d1b/d10/d75/f8b [908501,74951] 0 2024-09-13T18:30:32.760 INFO:tasks.workunit.client.0.smithi038.stdout:0/279: dread d2/dc/f51 [0,4194304] 0 2024-09-13T18:30:32.760 INFO:tasks.workunit.client.1.smithi149.stdout:8/960: sync 2024-09-13T18:30:32.762 INFO:tasks.workunit.client.0.smithi038.stdout:4/423: creat d2/df/d22/dc/f8d x:0 0 0 2024-09-13T18:30:32.763 INFO:tasks.workunit.client.0.smithi038.stdout:0/280: rmdir d2/d7/d24/d3c 39 2024-09-13T18:30:32.766 INFO:tasks.workunit.client.0.smithi038.stdout:4/424: rmdir d2/d49/d4b/d76 0 2024-09-13T18:30:32.766 INFO:tasks.workunit.client.1.smithi149.stdout:1/998: dwrite d9/d10/d34/d53/d57/f132 [0,4194304] 0 2024-09-13T18:30:32.768 INFO:tasks.workunit.client.1.smithi149.stdout:2/928: dwrite db/d13/d70/d118/d12/f43 [4194304,4194304] 0 2024-09-13T18:30:32.768 INFO:tasks.workunit.client.0.smithi038.stdout:4/425: unlink d2/f56 0 2024-09-13T18:30:32.769 INFO:tasks.workunit.client.0.smithi038.stdout:4/426: chown d2/df/d1b/d10/d55/f7f 6766059 1 2024-09-13T18:30:32.769 INFO:tasks.workunit.client.0.smithi038.stdout:0/281: rmdir d2/d7/d24/d3c/d3f 39 2024-09-13T18:30:32.769 INFO:tasks.workunit.client.0.smithi038.stdout:0/282: write d2/d2f/f30 [216059,79892] 0 2024-09-13T18:30:32.769 INFO:tasks.workunit.client.0.smithi038.stdout:0/283: readlink d2/d7/d24/l48 0 2024-09-13T18:30:32.770 INFO:tasks.workunit.client.0.smithi038.stdout:0/284: creat d2/d2f/d44/f5e x:0 0 0 2024-09-13T18:30:32.775 INFO:tasks.workunit.client.1.smithi149.stdout:2/929: mkdir db/d13/d70/d118/d12/d137 0 2024-09-13T18:30:32.775 INFO:tasks.workunit.client.1.smithi149.stdout:2/930: write db/d1b/d1c/d20/d3a/d75/f82 [1052263,20748] 0 2024-09-13T18:30:32.775 INFO:tasks.workunit.client.1.smithi149.stdout:2/931: write db/d1b/d6c/dc8/f11e [1813141,116146] 0 2024-09-13T18:30:32.777 INFO:tasks.workunit.client.1.smithi149.stdout:2/932: unlink db/d13/d70/dad/fbc 0 2024-09-13T18:30:32.777 INFO:tasks.workunit.client.1.smithi149.stdout:2/933: chown db/d13/d70/dad/led 3 1 2024-09-13T18:30:32.777 INFO:tasks.workunit.client.1.smithi149.stdout:2/934: dread - db/d1b/d1c/d20/d2b/d3e/d95/fb6 zero size 2024-09-13T18:30:32.777 INFO:tasks.workunit.client.1.smithi149.stdout:2/935: write db/d1b/d2f/fdd [2916458,81200] 0 2024-09-13T18:30:32.777 INFO:tasks.workunit.client.0.smithi038.stdout:7/223: dwrite db/fe [0,4194304] 0 2024-09-13T18:30:32.778 INFO:tasks.workunit.client.1.smithi149.stdout:1/999: dread d9/d10/d62/fd1 [0,4194304] 0 2024-09-13T18:30:32.778 INFO:tasks.workunit.client.0.smithi038.stdout:7/224: creat db/d12/d1c/d3a/d4b/f53 x:0 0 0 2024-09-13T18:30:32.778 INFO:tasks.workunit.client.0.smithi038.stdout:7/225: creat db/d12/d13/f54 x:0 0 0 2024-09-13T18:30:32.779 INFO:tasks.workunit.client.0.smithi038.stdout:7/226: dread - db/d12/d13/d43/f4e zero size 2024-09-13T18:30:32.779 INFO:tasks.workunit.client.1.smithi149.stdout:2/936: truncate db/d1b/d1c/d20/d2b/f6b 1615954 0 2024-09-13T18:30:32.780 INFO:tasks.workunit.client.0.smithi038.stdout:7/227: mknod db/d12/d1c/c55 0 2024-09-13T18:30:32.782 INFO:tasks.workunit.client.1.smithi149.stdout:2/937: link db/d100/l11a db/d1b/d6c/d10c/l138 0 2024-09-13T18:30:32.796 INFO:tasks.workunit.client.0.smithi038.stdout:4/427: dwrite d2/df/d1b/fd [0,4194304] 0 2024-09-13T18:30:32.796 INFO:tasks.workunit.client.0.smithi038.stdout:4/428: rmdir d2/df/d1b/d10/d55 39 2024-09-13T18:30:32.800 INFO:tasks.workunit.client.0.smithi038.stdout:7/228: dwrite db/d12/d1c/d3a/f1d [0,4194304] 0 2024-09-13T18:30:32.823 INFO:tasks.workunit.client.1.smithi149.stdout:9/856: dwrite d0/d47/d54/d75/f95 [0,4194304] 0 2024-09-13T18:30:32.842 INFO:tasks.workunit.client.0.smithi038.stdout:5/231: dwrite df/d15/f39 [0,4194304] 0 2024-09-13T18:30:32.842 INFO:tasks.workunit.client.0.smithi038.stdout:5/232: write df/d13/f21 [3432706,106793] 0 2024-09-13T18:30:32.842 INFO:tasks.workunit.client.0.smithi038.stdout:7/229: dwrite db/d12/d1c/d3a/f1d [0,4194304] 0 2024-09-13T18:30:32.843 INFO:tasks.workunit.client.1.smithi149.stdout:2/938: dread db/d13/d70/d118/d8d/fa3 [0,4194304] 0 2024-09-13T18:30:32.843 INFO:tasks.workunit.client.1.smithi149.stdout:9/857: dwrite d0/d47/d61/fdd [0,4194304] 0 2024-09-13T18:30:32.843 INFO:tasks.workunit.client.0.smithi038.stdout:0/285: dwrite d2/d7/f9 [4194304,4194304] 0 2024-09-13T18:30:32.843 INFO:tasks.workunit.client.0.smithi038.stdout:4/429: dwrite d2/df/d1b/d10/f46 [0,4194304] 0 2024-09-13T18:30:32.843 INFO:tasks.workunit.client.0.smithi038.stdout:4/430: write d2/f41 [2586737,39250] 0 2024-09-13T18:30:32.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/233: mkdir df/d13/d3b/d44/d48 0 2024-09-13T18:30:32.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/234: write df/f2a [516912,20135] 0 2024-09-13T18:30:32.848 INFO:tasks.workunit.client.0.smithi038.stdout:7/230: unlink db/d12/f3f 0 2024-09-13T18:30:32.851 INFO:tasks.workunit.client.1.smithi149.stdout:2/939: truncate db/d13/d70/d118/f72 1105910 0 2024-09-13T18:30:32.851 INFO:tasks.workunit.client.1.smithi149.stdout:2/940: chown db/d13/d70/d118/le3 1798706 1 2024-09-13T18:30:32.851 INFO:tasks.workunit.client.0.smithi038.stdout:0/286: write d2/d7/d24/d2b/f2d [376306,35372] 0 2024-09-13T18:30:32.856 INFO:tasks.workunit.client.0.smithi038.stdout:4/431: rmdir d2/df/d1b/d10/d68 0 2024-09-13T18:30:32.857 INFO:tasks.workunit.client.1.smithi149.stdout:9/858: truncate d0/d18/d27/d5c/d99/d9f/fa9 3738129 0 2024-09-13T18:30:32.861 INFO:tasks.workunit.client.1.smithi149.stdout:2/941: getdents db/d13/d70/d118/da9/ddb 0 2024-09-13T18:30:32.863 INFO:tasks.workunit.client.1.smithi149.stdout:9/859: truncate d0/f67 965707 0 2024-09-13T18:30:32.864 INFO:tasks.workunit.client.0.smithi038.stdout:7/231: symlink db/d12/d1c/d3a/d3c/l56 0 2024-09-13T18:30:32.865 INFO:tasks.workunit.client.1.smithi149.stdout:2/942: truncate db/d1b/d1c/d20/d3a/d75/fd1 3440189 0 2024-09-13T18:30:32.866 INFO:tasks.workunit.client.1.smithi149.stdout:2/943: getdents db/d13/d70/d118/da9/ddb 0 2024-09-13T18:30:32.866 INFO:tasks.workunit.client.0.smithi038.stdout:0/287: read - d2/d7/f4a zero size 2024-09-13T18:30:32.870 INFO:tasks.workunit.client.0.smithi038.stdout:4/432: mkdir d2/d49/d4b/d8e 0 2024-09-13T18:30:32.870 INFO:tasks.workunit.client.0.smithi038.stdout:4/433: creat d2/df/d1b/d10/d75/f8f x:0 0 0 2024-09-13T18:30:32.870 INFO:tasks.workunit.client.0.smithi038.stdout:4/434: creat d2/d49/f90 x:0 0 0 2024-09-13T18:30:32.871 INFO:tasks.workunit.client.1.smithi149.stdout:2/944: mknod db/d1b/d6c/dc8/c139 0 2024-09-13T18:30:32.872 INFO:tasks.workunit.client.0.smithi038.stdout:4/435: dread d2/df/d1b/f8a [0,4194304] 0 2024-09-13T18:30:32.872 INFO:tasks.workunit.client.0.smithi038.stdout:4/436: creat d2/d49/d50/f91 x:0 0 0 2024-09-13T18:30:32.872 INFO:tasks.workunit.client.0.smithi038.stdout:0/288: creat d2/d2f/d44/d49/f5f x:0 0 0 2024-09-13T18:30:32.874 INFO:tasks.workunit.client.1.smithi149.stdout:2/945: mknod db/d1b/d48/c13a 0 2024-09-13T18:30:32.878 INFO:tasks.workunit.client.1.smithi149.stdout:2/946: mknod db/d1b/d6c/dc8/c13b 0 2024-09-13T18:30:32.878 INFO:tasks.workunit.client.1.smithi149.stdout:2/947: chown db/d1b/d1c/d85/ca1 52088422 1 2024-09-13T18:30:32.879 INFO:tasks.workunit.client.0.smithi038.stdout:4/437: read d2/df/d22/dc/f44 [1799961,109697] 0 2024-09-13T18:30:32.879 INFO:tasks.workunit.client.0.smithi038.stdout:4/438: write d2/df/d22/f29 [3156582,101941] 0 2024-09-13T18:30:32.880 INFO:tasks.workunit.client.1.smithi149.stdout:2/948: rename db/d100/d10a to db/d1b/d13c 0 2024-09-13T18:30:32.882 INFO:tasks.workunit.client.0.smithi038.stdout:0/289: rename d2/d7/d24/l4f to d2/d7/l60 0 2024-09-13T18:30:32.885 INFO:tasks.workunit.client.1.smithi149.stdout:5/901: sync 2024-09-13T18:30:32.885 INFO:tasks.workunit.client.1.smithi149.stdout:5/902: chown d3/d10/d98/dfb/d54/c51 38 1 2024-09-13T18:30:32.885 INFO:tasks.workunit.client.1.smithi149.stdout:5/903: chown d3/d10/d98 0 1 2024-09-13T18:30:32.885 INFO:tasks.workunit.client.0.smithi038.stdout:7/232: dwrite db/f11 [0,4194304] 0 2024-09-13T18:30:32.886 INFO:tasks.workunit.client.1.smithi149.stdout:2/949: creat db/d1b/d1c/d20/d2b/db7/f13d x:0 0 0 2024-09-13T18:30:32.886 INFO:tasks.workunit.client.1.smithi149.stdout:2/950: dread - db/d1b/d1c/d20/d2b/d3e/d95/fb6 zero size 2024-09-13T18:30:32.888 INFO:tasks.workunit.client.0.smithi038.stdout:7/233: creat db/d12/d1c/d3a/d22/f57 x:0 0 0 2024-09-13T18:30:32.891 INFO:tasks.workunit.client.1.smithi149.stdout:2/951: mknod db/d1b/d1c/d85/d12b/c13e 0 2024-09-13T18:30:32.891 INFO:tasks.workunit.client.1.smithi149.stdout:2/952: dread - db/d1b/d1c/d20/f121 zero size 2024-09-13T18:30:32.893 INFO:tasks.workunit.client.0.smithi038.stdout:7/234: symlink db/d12/d1c/d3a/d22/l58 0 2024-09-13T18:30:32.893 INFO:tasks.workunit.client.0.smithi038.stdout:7/235: truncate db/f48 259762 0 2024-09-13T18:30:32.893 INFO:tasks.workunit.client.0.smithi038.stdout:7/236: fsync db/d12/f34 0 2024-09-13T18:30:32.893 INFO:tasks.workunit.client.0.smithi038.stdout:7/237: readlink db/l15 0 2024-09-13T18:30:32.893 INFO:tasks.workunit.client.0.smithi038.stdout:7/238: write db/d12/d13/f54 [734288,105990] 0 2024-09-13T18:30:32.894 INFO:tasks.workunit.client.1.smithi149.stdout:2/953: mknod db/d1b/d13c/c13f 0 2024-09-13T18:30:32.896 INFO:tasks.workunit.client.0.smithi038.stdout:7/239: rename db/d12/d1c/d3a/d22/f57 to db/d12/d1c/d3a/f59 0 2024-09-13T18:30:32.897 INFO:tasks.workunit.client.1.smithi149.stdout:2/954: truncate db/d1b/d6c/d10c/f131 14899 0 2024-09-13T18:30:32.901 INFO:tasks.workunit.client.1.smithi149.stdout:8/961: sync 2024-09-13T18:30:32.901 INFO:tasks.workunit.client.1.smithi149.stdout:3/929: sync 2024-09-13T18:30:32.902 INFO:tasks.workunit.client.1.smithi149.stdout:8/962: mkdir d2/d13/d140 0 2024-09-13T18:30:32.904 INFO:tasks.workunit.client.1.smithi149.stdout:3/930: creat d1/d12/db9/f148 x:0 0 0 2024-09-13T18:30:32.904 INFO:tasks.workunit.client.1.smithi149.stdout:3/931: chown d1/d2e/d1d/d6c/daa/dfb/d113/f115 10795 1 2024-09-13T18:30:32.905 INFO:tasks.workunit.client.1.smithi149.stdout:8/963: rename d2/d13/d3a/d7f/fdc to d2/d12/dd8/d58/f141 0 2024-09-13T18:30:32.906 INFO:tasks.workunit.client.1.smithi149.stdout:8/964: fsync d2/d12/d2a/d4d/f103 0 2024-09-13T18:30:32.908 INFO:tasks.workunit.client.1.smithi149.stdout:8/965: creat d2/dc4/df4/f142 x:0 0 0 2024-09-13T18:30:32.908 INFO:tasks.workunit.client.1.smithi149.stdout:2/955: write db/d1b/d1c/d85/fde [8381749,108648] 0 2024-09-13T18:30:32.909 INFO:tasks.workunit.client.1.smithi149.stdout:2/956: truncate db/d13/d70/ffe 295276 0 2024-09-13T18:30:32.909 INFO:tasks.workunit.client.1.smithi149.stdout:2/957: getdents db/d13/d70/d118/da9/ddb 0 2024-09-13T18:30:32.911 INFO:tasks.workunit.client.1.smithi149.stdout:2/958: read db/d13/d70/d118/f1a [335668,9624] 0 2024-09-13T18:30:32.911 INFO:tasks.workunit.client.1.smithi149.stdout:2/959: dread - db/d1b/d1c/d20/d2b/d3e/d95/fae zero size 2024-09-13T18:30:32.911 INFO:tasks.workunit.client.1.smithi149.stdout:2/960: chown db/f7a 398 1 2024-09-13T18:30:32.912 INFO:tasks.workunit.client.0.smithi038.stdout:7/240: dread db/fe [0,4194304] 0 2024-09-13T18:30:32.913 INFO:tasks.workunit.client.1.smithi149.stdout:2/961: rename db/d1b/d1c/d20/d2b/db7/f90 to db/d13/d70/f140 0 2024-09-13T18:30:32.913 INFO:tasks.workunit.client.1.smithi149.stdout:2/962: write db/d1b/d2f/d69/deb/ff0 [428385,66179] 0 2024-09-13T18:30:32.913 INFO:tasks.workunit.client.1.smithi149.stdout:2/963: creat db/d1b/dab/f141 x:0 0 0 2024-09-13T18:30:32.914 INFO:tasks.workunit.client.0.smithi038.stdout:7/241: symlink db/d12/d1c/d3a/d3c/d52/l5a 0 2024-09-13T18:30:32.914 INFO:tasks.workunit.client.0.smithi038.stdout:7/242: creat db/d12/d13/d43/f5b x:0 0 0 2024-09-13T18:30:32.916 INFO:tasks.workunit.client.1.smithi149.stdout:5/904: dwrite d3/d10/d98/dfb/fff [0,4194304] 0 2024-09-13T18:30:32.916 INFO:tasks.workunit.client.1.smithi149.stdout:5/905: chown d3/d10/d98/dfb/d67/l114 52201 1 2024-09-13T18:30:32.916 INFO:tasks.workunit.client.1.smithi149.stdout:5/906: fdatasync d3/d10/d98/dfb/d67/d83/fb0 0 2024-09-13T18:30:32.917 INFO:tasks.workunit.client.1.smithi149.stdout:5/907: write d3/d10/d4c/d4e/d61/d75/f87 [480542,96357] 0 2024-09-13T18:30:32.918 INFO:tasks.workunit.client.0.smithi038.stdout:4/439: truncate d2/df/d22/f29 195935 0 2024-09-13T18:30:32.921 INFO:tasks.workunit.client.1.smithi149.stdout:2/964: rename db/d1b/d1c/d20/d2b/cee to db/d1b/d1c/d20/d2b/d3e/de4/d128/c142 0 2024-09-13T18:30:32.921 INFO:tasks.workunit.client.1.smithi149.stdout:2/965: read db/d13/d70/f7c [2702071,18099] 0 2024-09-13T18:30:32.921 INFO:tasks.workunit.client.1.smithi149.stdout:2/966: stat db/d1b/f98 0 2024-09-13T18:30:32.928 INFO:tasks.workunit.client.1.smithi149.stdout:2/967: dread db/d1b/d1c/d20/d3a/d75/fd1 [0,4194304] 0 2024-09-13T18:30:32.928 INFO:tasks.workunit.client.1.smithi149.stdout:2/968: chown db/d1b/d1c/d20/d3a/fe8 1 1 2024-09-13T18:30:32.928 INFO:tasks.workunit.client.1.smithi149.stdout:5/908: symlink d3/d5e/l118 0 2024-09-13T18:30:32.928 INFO:tasks.workunit.client.1.smithi149.stdout:5/909: write d3/d10/d98/ffc [575433,18817] 0 2024-09-13T18:30:32.929 INFO:tasks.workunit.client.0.smithi038.stdout:4/440: rmdir d2/df/d1b/d10/d75 39 2024-09-13T18:30:32.929 INFO:tasks.workunit.client.0.smithi038.stdout:4/441: chown d2/f41 153 1 2024-09-13T18:30:32.930 INFO:tasks.workunit.client.0.smithi038.stdout:4/442: dread d2/df/d1b/d10/d75/f7b [0,4194304] 0 2024-09-13T18:30:32.930 INFO:tasks.workunit.client.0.smithi038.stdout:4/443: fsync d2/df/d22/dc/f8d 0 2024-09-13T18:30:32.931 INFO:tasks.workunit.client.1.smithi149.stdout:3/932: dwrite d1/d114/f134 [0,4194304] 0 2024-09-13T18:30:32.931 INFO:tasks.workunit.client.1.smithi149.stdout:2/969: unlink db/d13/d70/d89/f120 0 2024-09-13T18:30:32.931 INFO:tasks.workunit.client.1.smithi149.stdout:2/970: truncate db/d1b/f98 4785492 0 2024-09-13T18:30:32.933 INFO:tasks.workunit.client.1.smithi149.stdout:5/910: unlink d3/d10/d98/dfb/f40 0 2024-09-13T18:30:32.936 INFO:tasks.workunit.client.1.smithi149.stdout:3/933: mknod d1/d2e/d93/c149 0 2024-09-13T18:30:32.937 INFO:tasks.workunit.client.1.smithi149.stdout:3/934: creat d1/d48/ddb/d13c/f14a x:0 0 0 2024-09-13T18:30:32.941 INFO:tasks.workunit.client.0.smithi038.stdout:7/243: dwrite db/d12/d13/f1b [4194304,4194304] 0 2024-09-13T18:30:32.942 INFO:tasks.workunit.client.1.smithi149.stdout:8/966: dwrite d2/d12/d2a/f59 [0,4194304] 0 2024-09-13T18:30:32.942 INFO:tasks.workunit.client.1.smithi149.stdout:2/971: dread db/d1b/d6c/d10c/f131 [0,4194304] 0 2024-09-13T18:30:32.942 INFO:tasks.workunit.client.1.smithi149.stdout:2/972: readlink db/d1b/d2f/d69/deb/l11f 0 2024-09-13T18:30:32.943 INFO:tasks.workunit.client.1.smithi149.stdout:3/935: rename d1/d47/d30/d5a to d1/d2c/d38/d127/d14b 0 2024-09-13T18:30:32.947 INFO:tasks.workunit.client.1.smithi149.stdout:5/911: dread d3/d10/d98/dfb/d54/d76/fa0 [0,4194304] 0 2024-09-13T18:30:32.947 INFO:tasks.workunit.client.1.smithi149.stdout:5/912: stat d3/d10/d98/f10b 0 2024-09-13T18:30:32.952 INFO:tasks.workunit.client.0.smithi038.stdout:4/444: dread d2/df/d22/dc/d8/d3b/f5d [0,4194304] 0 2024-09-13T18:30:32.957 INFO:tasks.workunit.client.1.smithi149.stdout:2/973: rename db/d1b/d2f/d30 to db/d1b/d1c/d20/d2b/d3e/de4/d128/d143 0 2024-09-13T18:30:32.960 INFO:tasks.workunit.client.1.smithi149.stdout:8/967: unlink d2/d13/d6d/l6a 0 2024-09-13T18:30:32.960 INFO:tasks.workunit.client.1.smithi149.stdout:8/968: creat d2/d10f/f143 x:0 0 0 2024-09-13T18:30:32.961 INFO:tasks.workunit.client.0.smithi038.stdout:7/244: dwrite db/d12/f18 [0,4194304] 0 2024-09-13T18:30:32.961 INFO:tasks.workunit.client.0.smithi038.stdout:7/245: readlink db/d12/d1c/d3a/l4a 0 2024-09-13T18:30:32.961 INFO:tasks.workunit.client.0.smithi038.stdout:7/246: read - db/d12/d1c/d3a/d4b/f53 zero size 2024-09-13T18:30:32.963 INFO:tasks.workunit.client.1.smithi149.stdout:3/936: rmdir d1/d2e/d6f 39 2024-09-13T18:30:32.963 INFO:tasks.workunit.client.1.smithi149.stdout:3/937: creat d1/d48/ddb/d13c/f14c x:0 0 0 2024-09-13T18:30:32.963 INFO:tasks.workunit.client.1.smithi149.stdout:3/938: creat d1/d48/ddb/d13c/f14d x:0 0 0 2024-09-13T18:30:32.963 INFO:tasks.workunit.client.1.smithi149.stdout:3/939: creat d1/d48/f14e x:0 0 0 2024-09-13T18:30:32.963 INFO:tasks.workunit.client.1.smithi149.stdout:3/940: read d1/d2e/f17 [2971463,91158] 0 2024-09-13T18:30:32.964 INFO:tasks.workunit.client.1.smithi149.stdout:2/974: creat db/d1b/d1c/d20/dff/f144 x:0 0 0 2024-09-13T18:30:32.967 INFO:tasks.workunit.client.1.smithi149.stdout:5/913: truncate d3/f4f 751581 0 2024-09-13T18:30:32.967 INFO:tasks.workunit.client.1.smithi149.stdout:5/914: creat d3/d10/d98/dfb/d54/db9/f119 x:0 0 0 2024-09-13T18:30:32.970 INFO:tasks.workunit.client.1.smithi149.stdout:8/969: symlink d2/d5b/d88/l144 0 2024-09-13T18:30:32.970 INFO:tasks.workunit.client.1.smithi149.stdout:9/860: sync 2024-09-13T18:30:32.970 INFO:tasks.workunit.client.1.smithi149.stdout:9/861: chown d0/d47/d54/d75/ld8 0 1 2024-09-13T18:30:32.971 INFO:tasks.workunit.client.0.smithi038.stdout:4/445: dwrite d2/df/d1b/f2b [0,4194304] 0 2024-09-13T18:30:32.973 INFO:tasks.workunit.client.0.smithi038.stdout:7/247: truncate db/d12/d13/f1b 238051 0 2024-09-13T18:30:32.974 INFO:tasks.workunit.client.1.smithi149.stdout:3/941: dread d1/d2e/f17 [0,4194304] 0 2024-09-13T18:30:32.974 INFO:tasks.workunit.client.1.smithi149.stdout:3/942: write d1/d2e/d1d/d9a/d39/f5d [4519607,110845] 0 2024-09-13T18:30:32.977 INFO:tasks.workunit.client.0.smithi038.stdout:7/248: dread db/d12/d1c/d3a/d22/f30 [0,4194304] 0 2024-09-13T18:30:32.977 INFO:tasks.workunit.client.0.smithi038.stdout:7/249: stat db/d12/d1c/d3a/d22/l36 0 2024-09-13T18:30:32.977 INFO:tasks.workunit.client.1.smithi149.stdout:2/975: rename db/d1b/d1c/d85/l9f to db/d1b/d1c/d20/d2b/d3e/de4/l145 0 2024-09-13T18:30:32.977 INFO:tasks.workunit.client.1.smithi149.stdout:2/976: creat db/d1b/d1c/d20/d3a/f146 x:0 0 0 2024-09-13T18:30:32.977 INFO:tasks.workunit.client.1.smithi149.stdout:2/977: readlink db/d1b/l8b 0 2024-09-13T18:30:32.978 INFO:tasks.workunit.client.1.smithi149.stdout:2/978: stat db/d1b/dab/f114 0 2024-09-13T18:30:32.978 INFO:tasks.workunit.client.1.smithi149.stdout:2/979: write db/d13/fcf [4758074,78122] 0 2024-09-13T18:30:32.978 INFO:tasks.workunit.client.1.smithi149.stdout:9/862: write d0/d18/d27/d5c/d99/d9f/fa9 [1650920,105722] 0 2024-09-13T18:30:32.979 INFO:tasks.workunit.client.1.smithi149.stdout:9/863: creat d0/d9e/f108 x:0 0 0 2024-09-13T18:30:32.984 INFO:tasks.workunit.client.1.smithi149.stdout:5/915: creat d3/d10/d4c/d4e/d61/d75/f11a x:0 0 0 2024-09-13T18:30:32.985 INFO:tasks.workunit.client.0.smithi038.stdout:7/250: mknod db/c5c 0 2024-09-13T18:30:32.986 INFO:tasks.workunit.client.1.smithi149.stdout:8/970: mknod d2/dc4/ddb/dff/c145 0 2024-09-13T18:30:32.988 INFO:tasks.workunit.client.0.smithi038.stdout:4/446: write d2/df/d22/dc/d8/f2e [2994039,55740] 0 2024-09-13T18:30:32.990 INFO:tasks.workunit.client.1.smithi149.stdout:3/943: mknod d1/d12/d20/d54/c14f 0 2024-09-13T18:30:33.000 INFO:tasks.workunit.client.1.smithi149.stdout:5/916: dread d3/d8/fe [0,4194304] 0 2024-09-13T18:30:33.000 INFO:tasks.workunit.client.0.smithi038.stdout:7/251: rmdir db/d12/d13 39 2024-09-13T18:30:33.000 INFO:tasks.workunit.client.0.smithi038.stdout:7/252: readlink db/d12/d1c/l1e 0 2024-09-13T18:30:33.001 INFO:tasks.workunit.client.1.smithi149.stdout:3/944: dread d1/d12/d20/d54/dd1/fe6 [0,4194304] 0 2024-09-13T18:30:33.001 INFO:tasks.workunit.client.1.smithi149.stdout:9/864: mkdir d0/d47/d54/d75/d109 0 2024-09-13T18:30:33.002 INFO:tasks.workunit.client.0.smithi038.stdout:4/447: write d2/df/d1b/f2b [1521239,34062] 0 2024-09-13T18:30:33.003 INFO:tasks.workunit.client.1.smithi149.stdout:9/865: write d0/d2e/f71 [413775,7943] 0 2024-09-13T18:30:33.003 INFO:tasks.workunit.client.1.smithi149.stdout:9/866: fdatasync d0/d2e/d42/d59/d86/f9b 0 2024-09-13T18:30:33.003 INFO:tasks.workunit.client.1.smithi149.stdout:9/867: truncate d0/d2e/d42/d70/d84/dae/fd5 1033643 0 2024-09-13T18:30:33.003 INFO:tasks.workunit.client.1.smithi149.stdout:9/868: fsync d0/f38 0 2024-09-13T18:30:33.003 INFO:tasks.workunit.client.1.smithi149.stdout:9/869: readlink d0/d2e/d42/d70/lcb 0 2024-09-13T18:30:33.004 INFO:tasks.workunit.client.1.smithi149.stdout:9/870: read d0/d18/d27/d5c/d99/d9f/fa9 [1729199,130354] 0 2024-09-13T18:30:33.004 INFO:tasks.workunit.client.1.smithi149.stdout:9/871: creat d0/d2e/d42/d70/d84/f10a x:0 0 0 2024-09-13T18:30:33.006 INFO:tasks.workunit.client.1.smithi149.stdout:2/980: getdents db/d1b/d6c/d10c 0 2024-09-13T18:30:33.006 INFO:tasks.workunit.client.1.smithi149.stdout:2/981: stat db/d1b/d6c/d117 0 2024-09-13T18:30:33.007 INFO:tasks.workunit.client.1.smithi149.stdout:5/917: rmdir d3/d10/d98/dfb/d54/d97/de7 39 2024-09-13T18:30:33.007 INFO:tasks.workunit.client.0.smithi038.stdout:7/253: write db/d12/d1c/d3a/f1d [1656503,3085] 0 2024-09-13T18:30:33.007 INFO:tasks.workunit.client.0.smithi038.stdout:7/254: write db/d12/d1c/d3a/d3c/d52/f4d [198876,71321] 0 2024-09-13T18:30:33.008 INFO:tasks.workunit.client.0.smithi038.stdout:7/255: getdents db/d12/d13/d43 0 2024-09-13T18:30:33.008 INFO:tasks.workunit.client.1.smithi149.stdout:5/918: dread d3/d10/d98/dfb/d54/db9/fc6 [0,4194304] 0 2024-09-13T18:30:33.009 INFO:tasks.workunit.client.1.smithi149.stdout:9/872: truncate d0/d18/d27/d5c/d7e/fcc 314089 0 2024-09-13T18:30:33.009 INFO:tasks.workunit.client.1.smithi149.stdout:9/873: creat d0/d18/d27/d5c/d99/d9f/f10b x:0 0 0 2024-09-13T18:30:33.011 INFO:tasks.workunit.client.1.smithi149.stdout:8/971: mknod d2/dc4/c146 0 2024-09-13T18:30:33.012 INFO:tasks.workunit.client.0.smithi038.stdout:7/256: creat db/d12/d1c/d3a/d26/d41/f5d x:0 0 0 2024-09-13T18:30:33.012 INFO:tasks.workunit.client.0.smithi038.stdout:7/257: creat db/d12/d1c/f5e x:0 0 0 2024-09-13T18:30:33.013 INFO:tasks.workunit.client.0.smithi038.stdout:7/258: chown db/d12/d1c/d3a/d3c/d52/d51 16 1 2024-09-13T18:30:33.013 INFO:tasks.workunit.client.1.smithi149.stdout:2/982: creat db/d1b/d1c/d20/d3a/d134/f147 x:0 0 0 2024-09-13T18:30:33.014 INFO:tasks.workunit.client.1.smithi149.stdout:2/983: fdatasync db/d1b/d1c/d20/d3a/d134/f147 0 2024-09-13T18:30:33.014 INFO:tasks.workunit.client.1.smithi149.stdout:2/984: write db/d1b/f98 [1552451,55260] 0 2024-09-13T18:30:33.014 INFO:tasks.workunit.client.1.smithi149.stdout:2/985: readlink db/d1b/dab/l112 0 2024-09-13T18:30:33.014 INFO:tasks.workunit.client.0.smithi038.stdout:4/448: dread d2/f33 [0,4194304] 0 2024-09-13T18:30:33.015 INFO:tasks.workunit.client.0.smithi038.stdout:9/291: sync 2024-09-13T18:30:33.016 INFO:tasks.workunit.client.1.smithi149.stdout:5/919: rename d3/d10/d4c/d4e/f106 to d3/d10/d98/dfb/d67/f11b 0 2024-09-13T18:30:33.016 INFO:tasks.workunit.client.1.smithi149.stdout:5/920: write d3/d10/d4c/d4e/d61/d75/f87 [1371070,113629] 0 2024-09-13T18:30:33.017 INFO:tasks.workunit.client.0.smithi038.stdout:7/259: mknod db/d12/d13/d43/c5f 0 2024-09-13T18:30:33.017 INFO:tasks.workunit.client.1.smithi149.stdout:3/945: dwrite d1/d47/d30/d46/f52 [0,4194304] 0 2024-09-13T18:30:33.020 INFO:tasks.workunit.client.0.smithi038.stdout:9/292: creat d0/d7/d2c/d5a/d69/f6b x:0 0 0 2024-09-13T18:30:33.021 INFO:tasks.workunit.client.1.smithi149.stdout:9/874: mknod d0/d18/d68/c10c 0 2024-09-13T18:30:33.021 INFO:tasks.workunit.client.0.smithi038.stdout:7/260: fsync db/d12/d1c/d3a/d26/d41/f5d 0 2024-09-13T18:30:33.022 INFO:tasks.workunit.client.1.smithi149.stdout:8/972: rmdir d2/d13/d3a/d7f/d8d 39 2024-09-13T18:30:33.022 INFO:tasks.workunit.client.1.smithi149.stdout:8/973: fsync d2/d12/d6e/fde 0 2024-09-13T18:30:33.023 INFO:tasks.workunit.client.0.smithi038.stdout:4/449: dread d2/df/d22/dc/d8/d3b/f53 [0,4194304] 0 2024-09-13T18:30:33.025 INFO:tasks.workunit.client.1.smithi149.stdout:5/921: mknod d3/d10/d4c/d4e/d61/c11c 0 2024-09-13T18:30:33.030 INFO:tasks.workunit.client.1.smithi149.stdout:3/946: creat d1/d2c/d38/d127/d14b/d12e/f150 x:0 0 0 2024-09-13T18:30:33.030 INFO:tasks.workunit.client.1.smithi149.stdout:3/947: chown d1/d2c/d38/d127/d14b 53957 1 2024-09-13T18:30:33.031 INFO:tasks.workunit.client.0.smithi038.stdout:4/450: rename d2/df/d22/f29 to d2/df/d1b/d10/d71/f92 0 2024-09-13T18:30:33.032 INFO:tasks.workunit.client.1.smithi149.stdout:9/875: mknod d0/d9e/c10d 0 2024-09-13T18:30:33.032 INFO:tasks.workunit.client.0.smithi038.stdout:9/293: rmdir d0/d7/d13/d2d/d3e 39 2024-09-13T18:30:33.034 INFO:tasks.workunit.client.1.smithi149.stdout:8/974: creat d2/d12/dd8/d58/d97/f147 x:0 0 0 2024-09-13T18:30:33.034 INFO:tasks.workunit.client.1.smithi149.stdout:8/975: fsync d2/d13/f41 0 2024-09-13T18:30:33.035 INFO:tasks.workunit.client.0.smithi038.stdout:4/451: unlink d2/df/d1b/c61 0 2024-09-13T18:30:33.036 INFO:tasks.workunit.client.1.smithi149.stdout:5/922: truncate d3/d10/d4c/d4e/d61/d63/faa 1460213 0 2024-09-13T18:30:33.036 INFO:tasks.workunit.client.1.smithi149.stdout:5/923: write d3/d10/d4c/d4e/d61/d63/f9d [715301,41500] 0 2024-09-13T18:30:33.036 INFO:tasks.workunit.client.0.smithi038.stdout:9/294: mknod d0/d7/d2c/d5e/c6c 0 2024-09-13T18:30:33.036 INFO:tasks.workunit.client.0.smithi038.stdout:9/295: getdents d0/d7/d13 0 2024-09-13T18:30:33.037 INFO:tasks.workunit.client.0.smithi038.stdout:9/296: dread - d0/d7/d13/f66 zero size 2024-09-13T18:30:33.039 INFO:tasks.workunit.client.0.smithi038.stdout:4/452: rename d2/df/d1b/d10/c74 to d2/df/d1b/d10/d55/c93 0 2024-09-13T18:30:33.041 INFO:tasks.workunit.client.1.smithi149.stdout:9/876: rmdir d0/d47/d54/d75/d109 0 2024-09-13T18:30:33.042 INFO:tasks.workunit.client.0.smithi038.stdout:9/297: rmdir d0/d7/d13/d2d/d3c 39 2024-09-13T18:30:33.045 INFO:tasks.workunit.client.0.smithi038.stdout:9/298: truncate d0/d7/d13/f5d 43947 0 2024-09-13T18:30:33.046 INFO:tasks.workunit.client.0.smithi038.stdout:9/299: chown d0/d7/d2c/d5a/d69 1004 1 2024-09-13T18:30:33.046 INFO:tasks.workunit.client.0.smithi038.stdout:9/300: chown d0/d7/d13/d30/c4b 900422 1 2024-09-13T18:30:33.046 INFO:tasks.workunit.client.1.smithi149.stdout:2/986: dwrite db/d13/f4a [0,4194304] 0 2024-09-13T18:30:33.047 INFO:tasks.workunit.client.1.smithi149.stdout:3/948: rename d1/d2e/d1d/d49 to d1/d12/db9/d151 0 2024-09-13T18:30:33.048 INFO:tasks.workunit.client.0.smithi038.stdout:4/453: dread d2/f2f [0,4194304] 0 2024-09-13T18:30:33.049 INFO:tasks.workunit.client.0.smithi038.stdout:9/301: mkdir d0/d7/d2c/d6d 0 2024-09-13T18:30:33.049 INFO:tasks.workunit.client.1.smithi149.stdout:2/987: fdatasync db/d13/fcf 0 2024-09-13T18:30:33.049 INFO:tasks.workunit.client.1.smithi149.stdout:2/988: write db/d1b/dab/fce [189729,89606] 0 2024-09-13T18:30:33.050 INFO:tasks.workunit.client.1.smithi149.stdout:2/989: fsync db/d1b/d6c/d10c/f131 0 2024-09-13T18:30:33.050 INFO:tasks.workunit.client.1.smithi149.stdout:2/990: write db/d1b/d1c/d20/d3a/f47 [691150,60449] 0 2024-09-13T18:30:33.051 INFO:tasks.workunit.client.1.smithi149.stdout:5/924: rename d3/d10/d98/dfb/d101 to d3/d10/d4c/d4e/d61/d75/d11d 0 2024-09-13T18:30:33.055 INFO:tasks.workunit.client.1.smithi149.stdout:3/949: unlink d1/d2e/d1d/d9a/d39/f5d 0 2024-09-13T18:30:33.057 INFO:tasks.workunit.client.1.smithi149.stdout:2/991: mkdir db/d1b/d1c/d20/dff/d148 0 2024-09-13T18:30:33.058 INFO:tasks.workunit.client.1.smithi149.stdout:9/877: dwrite d0/d18/d93/fdf [0,4194304] 0 2024-09-13T18:30:33.060 INFO:tasks.workunit.client.1.smithi149.stdout:9/878: read d0/d2e/f62 [603844,19864] 0 2024-09-13T18:30:33.060 INFO:tasks.workunit.client.1.smithi149.stdout:3/950: creat d1/d2e/d93/d122/d12a/f152 x:0 0 0 2024-09-13T18:30:33.060 INFO:tasks.workunit.client.1.smithi149.stdout:9/879: write d0/d47/f83 [1036634,88327] 0 2024-09-13T18:30:33.061 INFO:tasks.workunit.client.1.smithi149.stdout:8/976: rename d2/d13/d3a/d7f to d2/dc4/ddb/dff/d148 0 2024-09-13T18:30:33.062 INFO:tasks.workunit.client.1.smithi149.stdout:8/977: chown d2/f9 39986399 1 2024-09-13T18:30:33.062 INFO:tasks.workunit.client.1.smithi149.stdout:9/880: creat d0/d18/f10e x:0 0 0 2024-09-13T18:30:33.062 INFO:tasks.workunit.client.1.smithi149.stdout:9/881: chown d0/d47/d54/d75/le1 299969833 1 2024-09-13T18:30:33.062 INFO:tasks.workunit.client.1.smithi149.stdout:9/882: chown d0 7241044 1 2024-09-13T18:30:33.063 INFO:tasks.workunit.client.1.smithi149.stdout:5/925: rename d3/d10/d4c/c93 to d3/d10/d4c/d4e/d61/d75/c11e 0 2024-09-13T18:30:33.063 INFO:tasks.workunit.client.1.smithi149.stdout:8/978: mknod d2/d5b/d88/c149 0 2024-09-13T18:30:33.065 INFO:tasks.workunit.client.1.smithi149.stdout:9/883: rename d0/d18/d68/db2/dc9/lf3 to d0/d18/d93/l10f 0 2024-09-13T18:30:33.066 INFO:tasks.workunit.client.1.smithi149.stdout:5/926: link d3/d10/d4c/l7f d3/d10/d98/dfb/d54/d97/l11f 0 2024-09-13T18:30:33.071 INFO:tasks.workunit.client.1.smithi149.stdout:8/979: write d2/d12/d2a/d4d/f83 [648347,19385] 0 2024-09-13T18:30:33.072 INFO:tasks.workunit.client.0.smithi038.stdout:4/454: dwrite d2/d49/f90 [0,4194304] 0 2024-09-13T18:30:33.076 INFO:tasks.workunit.client.1.smithi149.stdout:2/992: dread db/d13/f18 [0,4194304] 0 2024-09-13T18:30:33.076 INFO:tasks.workunit.client.1.smithi149.stdout:2/993: chown db/d1b/d6c/dc8/f11e 97 1 2024-09-13T18:30:33.077 INFO:tasks.workunit.client.1.smithi149.stdout:5/927: dread d3/d10/d98/dfb/f45 [0,4194304] 0 2024-09-13T18:30:33.078 INFO:tasks.workunit.client.1.smithi149.stdout:2/994: truncate db/d1b/d1c/d20/d2b/f65 7390036 0 2024-09-13T18:30:33.078 INFO:tasks.workunit.client.1.smithi149.stdout:8/980: dread d2/d12/d40/fda [0,4194304] 0 2024-09-13T18:30:33.078 INFO:tasks.workunit.client.1.smithi149.stdout:5/928: creat d3/d10/d98/dfb/d54/d97/de7/f120 x:0 0 0 2024-09-13T18:30:33.080 INFO:tasks.workunit.client.1.smithi149.stdout:8/981: rename d2/db1/ce9 to d2/d12/dd8/d117/dca/c14a 0 2024-09-13T18:30:33.080 INFO:tasks.workunit.client.1.smithi149.stdout:8/982: chown d2/d12/dd8/f23 24 1 2024-09-13T18:30:33.080 INFO:tasks.workunit.client.1.smithi149.stdout:9/884: dread d0/d18/d27/d5c/d7e/f97 [0,4194304] 0 2024-09-13T18:30:33.080 INFO:tasks.workunit.client.1.smithi149.stdout:5/929: mknod d3/d10/d98/dfb/d54/d97/c121 0 2024-09-13T18:30:33.081 INFO:tasks.workunit.client.1.smithi149.stdout:9/885: write d0/d18/d27/f66 [123941,6904] 0 2024-09-13T18:30:33.081 INFO:tasks.workunit.client.1.smithi149.stdout:2/995: symlink db/d13/ddc/l149 0 2024-09-13T18:30:33.081 INFO:tasks.workunit.client.1.smithi149.stdout:9/886: chown d0/d2e/d42/d59/d86/c9d 1992846 1 2024-09-13T18:30:33.081 INFO:tasks.workunit.client.1.smithi149.stdout:2/996: stat db/d13/d70/d89/d12e 0 2024-09-13T18:30:33.082 INFO:tasks.workunit.client.1.smithi149.stdout:5/930: unlink d3/d10/d4c/d4e/f62 0 2024-09-13T18:30:33.082 INFO:tasks.workunit.client.1.smithi149.stdout:5/931: chown d3/d10/f5d 3 1 2024-09-13T18:30:33.083 INFO:tasks.workunit.client.1.smithi149.stdout:2/997: mknod db/d1b/d6c/dc8/c14a 0 2024-09-13T18:30:33.083 INFO:tasks.workunit.client.1.smithi149.stdout:2/998: creat db/d1b/d1c/d85/f14b x:0 0 0 2024-09-13T18:30:33.083 INFO:tasks.workunit.client.1.smithi149.stdout:2/999: truncate db/d13/d70/d118/fd0 771107 0 2024-09-13T18:30:33.101 INFO:tasks.workunit.client.1.smithi149.stdout:3/951: dwrite d1/d12/d20/d54/dd1/f141 [0,4194304] 0 2024-09-13T18:30:33.102 INFO:tasks.workunit.client.0.smithi038.stdout:9/302: dwrite d0/d2e/f27 [0,4194304] 0 2024-09-13T18:30:33.102 INFO:tasks.workunit.client.0.smithi038.stdout:9/303: write d0/d2e/f38 [3303488,46597] 0 2024-09-13T18:30:33.102 INFO:tasks.workunit.client.0.smithi038.stdout:9/304: truncate d0/d7/d2c/f47 902417 0 2024-09-13T18:30:33.102 INFO:tasks.workunit.client.0.smithi038.stdout:9/305: write d0/d7/d13/f5d [1025945,57836] 0 2024-09-13T18:30:33.102 INFO:tasks.workunit.client.0.smithi038.stdout:4/455: write d2/df/d1b/fd [3862087,106574] 0 2024-09-13T18:30:33.105 INFO:tasks.workunit.client.0.smithi038.stdout:9/306: rename d0/d7/d13/d2d/d3e/f4e to d0/d7/d13/d2d/d3e/f6e 0 2024-09-13T18:30:33.108 INFO:tasks.workunit.client.0.smithi038.stdout:4/456: link d2/f58 d2/df/d22/dc/d8/d3b/f94 0 2024-09-13T18:30:33.125 INFO:tasks.workunit.client.1.smithi149.stdout:3/952: dwrite d1/d48/fc5 [0,4194304] 0 2024-09-13T18:30:33.127 INFO:tasks.workunit.client.1.smithi149.stdout:8/983: dwrite d2/d12/d40/fda [0,4194304] 0 2024-09-13T18:30:33.127 INFO:tasks.workunit.client.1.smithi149.stdout:8/984: chown d2/d5b/d88/cc6 226 1 2024-09-13T18:30:33.127 INFO:tasks.workunit.client.1.smithi149.stdout:5/932: dwrite d3/d10/d98/dfb/d54/d76/f107 [4194304,4194304] 0 2024-09-13T18:30:33.127 INFO:tasks.workunit.client.1.smithi149.stdout:5/933: truncate d3/d8/d13/fed 156453 0 2024-09-13T18:30:33.136 INFO:tasks.workunit.client.1.smithi149.stdout:3/953: dread d1/d2c/d38/d88/d96/fd7 [0,4194304] 0 2024-09-13T18:30:33.143 INFO:tasks.workunit.client.0.smithi038.stdout:9/307: creat d0/d7/d13/d30/f6f x:0 0 0 2024-09-13T18:30:33.144 INFO:tasks.workunit.client.0.smithi038.stdout:9/308: fdatasync d0/d7/d13/f19 0 2024-09-13T18:30:33.144 INFO:tasks.workunit.client.0.smithi038.stdout:9/309: chown d0/d7/f31 853 1 2024-09-13T18:30:33.144 INFO:tasks.workunit.client.0.smithi038.stdout:9/310: chown d0/d7/d13/d2d 2 1 2024-09-13T18:30:33.147 INFO:tasks.workunit.client.0.smithi038.stdout:9/311: mkdir d0/d7/d13/d2d/d3e/d70 0 2024-09-13T18:30:33.149 INFO:tasks.workunit.client.0.smithi038.stdout:4/457: symlink d2/df/d22/l95 0 2024-09-13T18:30:33.150 INFO:tasks.workunit.client.0.smithi038.stdout:4/458: fdatasync d2/df/d22/dc/d8/d3b/f94 0 2024-09-13T18:30:33.150 INFO:tasks.workunit.client.0.smithi038.stdout:4/459: write d2/df/d22/dc/f16 [3155113,13982] 0 2024-09-13T18:30:33.152 INFO:tasks.workunit.client.0.smithi038.stdout:4/460: mkdir d2/df/d1b/d10/d71/d96 0 2024-09-13T18:30:33.153 INFO:tasks.workunit.client.0.smithi038.stdout:1/253: sync 2024-09-13T18:30:33.153 INFO:tasks.workunit.client.0.smithi038.stdout:2/256: sync 2024-09-13T18:30:33.153 INFO:tasks.workunit.client.0.smithi038.stdout:3/231: sync 2024-09-13T18:30:33.154 INFO:tasks.workunit.client.0.smithi038.stdout:3/232: chown d0/dd/l41 14805810 1 2024-09-13T18:30:33.154 INFO:tasks.workunit.client.0.smithi038.stdout:2/257: read - d2/d1e/d44/d50/d46/d58/d59/f5a zero size 2024-09-13T18:30:33.154 INFO:tasks.workunit.client.0.smithi038.stdout:3/233: fsync d0/f2 0 2024-09-13T18:30:33.155 INFO:tasks.workunit.client.1.smithi149.stdout:5/934: creat d3/d10/d4c/d4e/d61/dd0/f122 x:0 0 0 2024-09-13T18:30:33.155 INFO:tasks.workunit.client.1.smithi149.stdout:8/985: dwrite d2/fa5 [0,4194304] 0 2024-09-13T18:30:33.155 INFO:tasks.workunit.client.1.smithi149.stdout:8/986: write d2/d5b/f114 [7664994,94121] 0 2024-09-13T18:30:33.155 INFO:tasks.workunit.client.1.smithi149.stdout:8/987: chown d2/d13/f50 1791897 1 2024-09-13T18:30:33.155 INFO:tasks.workunit.client.0.smithi038.stdout:4/461: truncate d2/df/d22/dc/f44 2703125 0 2024-09-13T18:30:33.156 INFO:tasks.workunit.client.0.smithi038.stdout:4/462: fdatasync d2/df/d1b/d10/d71/f81 0 2024-09-13T18:30:33.156 INFO:tasks.workunit.client.1.smithi149.stdout:3/954: dwrite d1/d48/ddb/d13c/f14c [0,4194304] 0 2024-09-13T18:30:33.157 INFO:tasks.workunit.client.1.smithi149.stdout:3/955: write d1/d2e/d1d/d6c/daa/dad/f104 [1280227,11352] 0 2024-09-13T18:30:33.157 INFO:tasks.workunit.client.0.smithi038.stdout:1/254: creat d12/d2a/f4c x:0 0 0 2024-09-13T18:30:33.158 INFO:tasks.workunit.client.0.smithi038.stdout:1/255: creat d12/d2a/f4d x:0 0 0 2024-09-13T18:30:33.158 INFO:tasks.workunit.client.0.smithi038.stdout:3/234: symlink d0/dd/d17/d43/l4b 0 2024-09-13T18:30:33.160 INFO:tasks.workunit.client.0.smithi038.stdout:4/463: creat d2/d49/d4b/d64/f97 x:0 0 0 2024-09-13T18:30:33.160 INFO:tasks.workunit.client.0.smithi038.stdout:4/464: write d2/df/f7a [104957,52482] 0 2024-09-13T18:30:33.163 INFO:tasks.workunit.client.0.smithi038.stdout:1/256: mknod d12/d3c/d46/c4e 0 2024-09-13T18:30:33.163 INFO:tasks.workunit.client.0.smithi038.stdout:1/257: stat d12/d15 0 2024-09-13T18:30:33.163 INFO:tasks.workunit.client.0.smithi038.stdout:1/258: read - d12/d2a/f4d zero size 2024-09-13T18:30:33.166 INFO:tasks.workunit.client.0.smithi038.stdout:9/312: dwrite d0/d7/d13/f58 [0,4194304] 0 2024-09-13T18:30:33.167 INFO:tasks.workunit.client.0.smithi038.stdout:4/465: symlink d2/d49/d4b/l98 0 2024-09-13T18:30:33.167 INFO:tasks.workunit.client.0.smithi038.stdout:4/466: write d2/df/d1b/d10/d55/f7f [626105,125176] 0 2024-09-13T18:30:33.167 INFO:tasks.workunit.client.0.smithi038.stdout:4/467: write d2/d49/d50/f72 [134839,75292] 0 2024-09-13T18:30:33.169 INFO:tasks.workunit.client.0.smithi038.stdout:1/259: link d12/d15/l2c d12/d15/d47/l4f 0 2024-09-13T18:30:33.169 INFO:tasks.workunit.client.0.smithi038.stdout:1/260: fsync d12/f39 0 2024-09-13T18:30:33.170 INFO:tasks.workunit.client.1.smithi149.stdout:5/935: creat d3/d10/d98/dfb/d54/d76/f123 x:0 0 0 2024-09-13T18:30:33.174 INFO:tasks.workunit.client.0.smithi038.stdout:9/313: creat d0/d7/d2c/d5e/f71 x:0 0 0 2024-09-13T18:30:33.175 INFO:tasks.workunit.client.0.smithi038.stdout:4/468: creat d2/df/d1b/d10/d55/f99 x:0 0 0 2024-09-13T18:30:33.177 INFO:tasks.workunit.client.1.smithi149.stdout:3/956: unlink d1/d48/d75/f147 0 2024-09-13T18:30:33.179 INFO:tasks.workunit.client.0.smithi038.stdout:1/261: stat d12/l31 0 2024-09-13T18:30:33.181 INFO:tasks.workunit.client.0.smithi038.stdout:4/469: dread d2/df/d22/dc/f44 [0,4194304] 0 2024-09-13T18:30:33.181 INFO:tasks.workunit.client.0.smithi038.stdout:4/470: truncate d2/df/d1b/d10/d75/f7b 577780 0 2024-09-13T18:30:33.181 INFO:tasks.workunit.client.0.smithi038.stdout:4/471: stat d2/df/d1b 0 2024-09-13T18:30:33.183 INFO:tasks.workunit.client.0.smithi038.stdout:9/314: rename d0/d7/d13/d30/f3b to d0/d7/d2c/d5a/f72 0 2024-09-13T18:30:33.183 INFO:tasks.workunit.client.0.smithi038.stdout:9/315: dread - d0/d7/f45 zero size 2024-09-13T18:30:33.184 INFO:tasks.workunit.client.0.smithi038.stdout:3/235: dwrite d0/f4 [4194304,4194304] 0 2024-09-13T18:30:33.184 INFO:tasks.workunit.client.1.smithi149.stdout:5/936: mknod d3/d10/d4c/d4e/d61/d63/c124 0 2024-09-13T18:30:33.187 INFO:tasks.workunit.client.1.smithi149.stdout:8/988: rename d2/d13/d6d/c67 to d2/d12/dd8/d58/d97/db6/c14b 0 2024-09-13T18:30:33.189 INFO:tasks.workunit.client.1.smithi149.stdout:3/957: mkdir d1/d48/d75/d153 0 2024-09-13T18:30:33.189 INFO:tasks.workunit.client.1.smithi149.stdout:3/958: truncate d1/d2e/d93/d122/d12a/f152 816245 0 2024-09-13T18:30:33.190 INFO:tasks.workunit.client.0.smithi038.stdout:3/236: mknod d0/dd/d17/d43/c4c 0 2024-09-13T18:30:33.193 INFO:tasks.workunit.client.1.smithi149.stdout:3/959: rename d1/d2e/d1d/d6c/f137 to d1/d48/ddb/d13c/f154 0 2024-09-13T18:30:33.194 INFO:tasks.workunit.client.1.smithi149.stdout:3/960: stat d1/l7 0 2024-09-13T18:30:33.194 INFO:tasks.workunit.client.1.smithi149.stdout:3/961: creat d1/d2e/d1d/d6c/f155 x:0 0 0 2024-09-13T18:30:33.194 INFO:tasks.workunit.client.0.smithi038.stdout:4/472: unlink d2/df/d22/l1f 0 2024-09-13T18:30:33.195 INFO:tasks.workunit.client.0.smithi038.stdout:4/473: readlink d2/df/d1b/l3a 0 2024-09-13T18:30:33.195 INFO:tasks.workunit.client.0.smithi038.stdout:4/474: read d2/df/d1b/d10/d75/d82/f87 [469789,43443] 0 2024-09-13T18:30:33.196 INFO:tasks.workunit.client.1.smithi149.stdout:9/887: sync 2024-09-13T18:30:33.212 INFO:tasks.workunit.client.1.smithi149.stdout:9/888: read d0/d2e/f43 [452629,14471] 0 2024-09-13T18:30:33.212 INFO:tasks.workunit.client.1.smithi149.stdout:9/889: stat d0/d47/d54/f55 0 2024-09-13T18:30:33.213 INFO:tasks.workunit.client.1.smithi149.stdout:5/937: dwrite d3/d8/f27 [0,4194304] 0 2024-09-13T18:30:33.213 INFO:tasks.workunit.client.1.smithi149.stdout:5/938: creat d3/d5e/f125 x:0 0 0 2024-09-13T18:30:33.213 INFO:tasks.workunit.client.1.smithi149.stdout:5/939: write d3/d10/d4c/f111 [4921901,101840] 0 2024-09-13T18:30:33.214 INFO:tasks.workunit.client.1.smithi149.stdout:5/940: mknod d3/d10/d4c/d4e/d61/d75/c126 0 2024-09-13T18:30:33.215 INFO:tasks.workunit.client.1.smithi149.stdout:9/890: rmdir d0/d18/d27/d5c/d99/d9f 39 2024-09-13T18:30:33.216 INFO:tasks.workunit.client.1.smithi149.stdout:9/891: write d0/d18/d27/d5c/d99/fda [147683,90487] 0 2024-09-13T18:30:33.216 INFO:tasks.workunit.client.1.smithi149.stdout:9/892: fsync d0/d9e/f32 0 2024-09-13T18:30:33.218 INFO:tasks.workunit.client.0.smithi038.stdout:4/475: read d2/df/d22/dc/d8/f6c [3684790,5255] 0 2024-09-13T18:30:33.221 INFO:tasks.workunit.client.1.smithi149.stdout:8/989: dwrite d2/d12/dd8/d58/d97/fa0 [0,4194304] 0 2024-09-13T18:30:33.223 INFO:tasks.workunit.client.1.smithi149.stdout:8/990: mknod d2/d5b/d86/c14c 0 2024-09-13T18:30:33.223 INFO:tasks.workunit.client.0.smithi038.stdout:3/237: dwrite d0/dd/d19/f47 [0,4194304] 0 2024-09-13T18:30:33.224 INFO:tasks.workunit.client.1.smithi149.stdout:3/962: dwrite d1/d2c/d56/fea [0,4194304] 0 2024-09-13T18:30:33.225 INFO:tasks.workunit.client.1.smithi149.stdout:3/963: chown d1/d12/db9/d151/l145 1 1 2024-09-13T18:30:33.228 INFO:tasks.workunit.client.1.smithi149.stdout:8/991: symlink d2/d12/dd8/d66/ded/l14d 0 2024-09-13T18:30:33.229 INFO:tasks.workunit.client.1.smithi149.stdout:5/941: dread d3/d8/fe [0,4194304] 0 2024-09-13T18:30:33.229 INFO:tasks.workunit.client.1.smithi149.stdout:5/942: stat d3/d10/d98/dfb/d54/f2a 0 2024-09-13T18:30:33.229 INFO:tasks.workunit.client.1.smithi149.stdout:5/943: chown d3/d10/d98/dfb/d54/c74 606039092 1 2024-09-13T18:30:33.233 INFO:tasks.workunit.client.1.smithi149.stdout:3/964: creat d1/d2e/d93/d122/f156 x:0 0 0 2024-09-13T18:30:33.234 INFO:tasks.workunit.client.1.smithi149.stdout:3/965: read d1/d2e/d1d/d6c/daa/dad/f104 [2475480,61957] 0 2024-09-13T18:30:33.234 INFO:tasks.workunit.client.1.smithi149.stdout:8/992: mkdir d2/d12/dd8/d58/d97/d14e 0 2024-09-13T18:30:33.235 INFO:tasks.workunit.client.1.smithi149.stdout:5/944: mknod d3/d10/d98/dfb/d54/d97/de7/c127 0 2024-09-13T18:30:33.238 INFO:tasks.workunit.client.1.smithi149.stdout:3/966: unlink d1/d2e/d1d/d6c/daa/dfb/f129 0 2024-09-13T18:30:33.238 INFO:tasks.workunit.client.1.smithi149.stdout:3/967: write d1/d47/df9/f13f [296204,64602] 0 2024-09-13T18:30:33.239 INFO:tasks.workunit.client.1.smithi149.stdout:3/968: unlink d1/d2e/d1d/d6c/fba 0 2024-09-13T18:30:33.240 INFO:tasks.workunit.client.1.smithi149.stdout:3/969: creat d1/d48/ddb/d13c/d9b/f157 x:0 0 0 2024-09-13T18:30:33.241 INFO:tasks.workunit.client.1.smithi149.stdout:3/970: rename d1/d12/d20/d54/l57 to d1/d2c/d38/d8d/de1/l158 0 2024-09-13T18:30:33.242 INFO:tasks.workunit.client.0.smithi038.stdout:4/476: dwrite d2/d49/f5b [0,4194304] 0 2024-09-13T18:30:33.242 INFO:tasks.workunit.client.1.smithi149.stdout:9/893: dwrite d0/f9 [0,4194304] 0 2024-09-13T18:30:33.244 INFO:tasks.workunit.client.0.smithi038.stdout:3/238: dwrite d0/dd/d19/d1d/d29/d32/f35 [0,4194304] 0 2024-09-13T18:30:33.247 INFO:tasks.workunit.client.1.smithi149.stdout:9/894: link d0/d2e/f58 d0/d18/d81/f110 0 2024-09-13T18:30:33.249 INFO:tasks.workunit.client.1.smithi149.stdout:8/993: write d2/d12/dd8/f68 [2469393,45383] 0 2024-09-13T18:30:33.251 INFO:tasks.workunit.client.0.smithi038.stdout:3/239: rename d0/f9 to d0/dd/d19/d1d/d29/d2b/f4d 0 2024-09-13T18:30:33.253 INFO:tasks.workunit.client.0.smithi038.stdout:4/477: mkdir d2/df/d22/d9a 0 2024-09-13T18:30:33.253 INFO:tasks.workunit.client.0.smithi038.stdout:4/478: fdatasync d2/df/d1b/d10/f7c 0 2024-09-13T18:30:33.255 INFO:tasks.workunit.client.0.smithi038.stdout:3/240: link d0/f2 d0/dd/d19/d1d/d29/d32/f4e 0 2024-09-13T18:30:33.255 INFO:tasks.workunit.client.0.smithi038.stdout:3/241: truncate d0/f2 5351994 0 2024-09-13T18:30:33.256 INFO:tasks.workunit.client.1.smithi149.stdout:5/945: dread d3/d10/d98/dfb/fc1 [0,4194304] 0 2024-09-13T18:30:33.257 INFO:tasks.workunit.client.0.smithi038.stdout:4/479: rename d2/f2f to d2/d49/d4b/f9b 0 2024-09-13T18:30:33.257 INFO:tasks.workunit.client.0.smithi038.stdout:4/480: write d2/df/d1b/d10/d75/f8b [1024633,58582] 0 2024-09-13T18:30:33.258 INFO:tasks.workunit.client.1.smithi149.stdout:8/994: mkdir d2/d10f/d14f 0 2024-09-13T18:30:33.261 INFO:tasks.workunit.client.0.smithi038.stdout:3/242: truncate d0/fa 692548 0 2024-09-13T18:30:33.265 INFO:tasks.workunit.client.1.smithi149.stdout:3/971: dwrite d1/d2c/d8b/fac [0,4194304] 0 2024-09-13T18:30:33.265 INFO:tasks.workunit.client.0.smithi038.stdout:3/243: rename d0/dd/l31 to d0/dd/d17/d43/l4f 0 2024-09-13T18:30:33.266 INFO:tasks.workunit.client.1.smithi149.stdout:5/946: symlink d3/d10/d98/dfb/d54/d97/dba/l128 0 2024-09-13T18:30:33.266 INFO:tasks.workunit.client.1.smithi149.stdout:5/947: dread - d3/d10/d98/dfb/d54/dbd/ff6 zero size 2024-09-13T18:30:33.268 INFO:tasks.workunit.client.0.smithi038.stdout:3/244: mkdir d0/dd/d17/d50 0 2024-09-13T18:30:33.268 INFO:tasks.workunit.client.0.smithi038.stdout:3/245: getdents d0/dd/d19/d1d/d29 0 2024-09-13T18:30:33.271 INFO:tasks.workunit.client.0.smithi038.stdout:4/481: dwrite d2/df/d1b/f8a [0,4194304] 0 2024-09-13T18:30:33.271 INFO:tasks.workunit.client.0.smithi038.stdout:4/482: fdatasync d2/df/d22/dc/d8/d3b/f53 0 2024-09-13T18:30:33.271 INFO:tasks.workunit.client.0.smithi038.stdout:3/246: mkdir d0/dd/d17/d50/d51 0 2024-09-13T18:30:33.272 INFO:tasks.workunit.client.1.smithi149.stdout:8/995: symlink d2/dc4/ddb/l150 0 2024-09-13T18:30:33.272 INFO:tasks.workunit.client.1.smithi149.stdout:8/996: chown d2/d12/d2a/d4d/f78 34952 1 2024-09-13T18:30:33.279 INFO:tasks.workunit.client.1.smithi149.stdout:3/972: unlink d1/d12/d20/l61 0 2024-09-13T18:30:33.280 INFO:tasks.workunit.client.0.smithi038.stdout:3/247: read d0/dd/d19/d1d/d29/d2b/f4d [1945415,36412] 0 2024-09-13T18:30:33.280 INFO:tasks.workunit.client.0.smithi038.stdout:3/248: fsync d0/dd/d19/d1d/d29/d2b/f4d 0 2024-09-13T18:30:33.280 INFO:tasks.workunit.client.0.smithi038.stdout:3/249: fsync d0/dd/d19/d1d/d29/d2b/f4d 0 2024-09-13T18:30:33.280 INFO:tasks.workunit.client.0.smithi038.stdout:3/250: chown d0/fa 25037829 1 2024-09-13T18:30:33.280 INFO:tasks.workunit.client.0.smithi038.stdout:3/251: chown d0/fc 45 1 2024-09-13T18:30:33.281 INFO:tasks.workunit.client.0.smithi038.stdout:3/252: chown d0/f2 170406 1 2024-09-13T18:30:33.281 INFO:tasks.workunit.client.1.smithi149.stdout:8/997: dread d2/d12/dd8/f68 [0,4194304] 0 2024-09-13T18:30:33.281 INFO:tasks.workunit.client.1.smithi149.stdout:8/998: write d2/f96 [3245061,23179] 0 2024-09-13T18:30:33.283 INFO:tasks.workunit.client.0.smithi038.stdout:4/483: symlink d2/l9c 0 2024-09-13T18:30:33.285 INFO:tasks.workunit.client.1.smithi149.stdout:8/999: chown d2/dc4/lee 408034 1 2024-09-13T18:30:33.286 INFO:tasks.workunit.client.0.smithi038.stdout:3/253: dread d0/dd/d19/d23/f2e [0,4194304] 0 2024-09-13T18:30:33.288 INFO:tasks.workunit.client.1.smithi149.stdout:3/973: write d1/d2c/d56/fd5 [1836785,96618] 0 2024-09-13T18:30:33.290 INFO:tasks.workunit.client.1.smithi149.stdout:3/974: symlink d1/d12/d20/d54/d110/l159 0 2024-09-13T18:30:33.291 INFO:tasks.workunit.client.1.smithi149.stdout:3/975: symlink d1/d2e/d1d/d9a/d39/l15a 0 2024-09-13T18:30:33.292 INFO:tasks.workunit.client.1.smithi149.stdout:3/976: getdents d1/d12/d20/ded 0 2024-09-13T18:30:33.294 INFO:tasks.workunit.client.0.smithi038.stdout:3/254: dread d0/dd/f1a [0,4194304] 0 2024-09-13T18:30:33.295 INFO:tasks.workunit.client.0.smithi038.stdout:3/255: rmdir d0/dd/d17 39 2024-09-13T18:30:33.295 INFO:tasks.workunit.client.0.smithi038.stdout:3/256: chown d0/dd/d19/d1d/d29/d2b/f49 93480423 1 2024-09-13T18:30:33.295 INFO:tasks.workunit.client.0.smithi038.stdout:3/257: chown d0/dd/d19/d1d/d29/d2b/c2f 73237 1 2024-09-13T18:30:33.296 INFO:tasks.workunit.client.0.smithi038.stdout:3/258: mkdir d0/dd/d19/d23/d52 0 2024-09-13T18:30:33.296 INFO:tasks.workunit.client.0.smithi038.stdout:3/259: fdatasync d0/dd/d19/d23/f2e 0 2024-09-13T18:30:33.307 INFO:tasks.workunit.client.0.smithi038.stdout:4/484: dwrite d2/df/d1b/d10/d55/f99 [0,4194304] 0 2024-09-13T18:30:33.307 INFO:tasks.workunit.client.0.smithi038.stdout:4/485: chown d2/df/d1b/d10/d71 278 1 2024-09-13T18:30:33.315 INFO:tasks.workunit.client.1.smithi149.stdout:3/977: dwrite d1/d48/f14e [0,4194304] 0 2024-09-13T18:30:33.315 INFO:tasks.workunit.client.0.smithi038.stdout:3/260: dwrite d0/dd/d17/d43/f45 [0,4194304] 0 2024-09-13T18:30:33.317 INFO:tasks.workunit.client.1.smithi149.stdout:3/978: stat d1/d2c/d38/l116 0 2024-09-13T18:30:33.318 INFO:tasks.workunit.client.0.smithi038.stdout:3/261: mknod d0/dd/d17/d50/c53 0 2024-09-13T18:30:33.319 INFO:tasks.workunit.client.1.smithi149.stdout:3/979: mknod d1/d2e/d1d/d6c/daa/dfb/d113/c15b 0 2024-09-13T18:30:33.322 INFO:tasks.workunit.client.1.smithi149.stdout:9/895: sync 2024-09-13T18:30:33.327 INFO:tasks.workunit.client.1.smithi149.stdout:3/980: dread d1/d48/ddb/d13c/f14c [0,4194304] 0 2024-09-13T18:30:33.328 INFO:tasks.workunit.client.1.smithi149.stdout:3/981: read d1/d2e/d1d/d9a/f5f [1910439,48597] 0 2024-09-13T18:30:33.328 INFO:tasks.workunit.client.1.smithi149.stdout:3/982: write d1/d2c/d38/d127/d14b/f11c [1092743,8187] 0 2024-09-13T18:30:33.329 INFO:tasks.workunit.client.0.smithi038.stdout:6/318: sync 2024-09-13T18:30:33.329 INFO:tasks.workunit.client.0.smithi038.stdout:8/337: sync 2024-09-13T18:30:33.329 INFO:tasks.workunit.client.0.smithi038.stdout:6/319: chown dd/de/d61/f5a 1822 1 2024-09-13T18:30:33.330 INFO:tasks.workunit.client.1.smithi149.stdout:3/983: getdents d1/d48 0 2024-09-13T18:30:33.330 INFO:tasks.workunit.client.0.smithi038.stdout:8/338: unlink d1/de/d4c/f31 0 2024-09-13T18:30:33.332 INFO:tasks.workunit.client.0.smithi038.stdout:6/320: creat dd/de/d31/f7a x:0 0 0 2024-09-13T18:30:33.333 INFO:tasks.workunit.client.0.smithi038.stdout:8/339: rename d1/d4/f13 to d1/de/d21/d24/f76 0 2024-09-13T18:30:33.333 INFO:tasks.workunit.client.0.smithi038.stdout:8/340: write d1/de/d15/d30/f6c [711560,4028] 0 2024-09-13T18:30:33.333 INFO:tasks.workunit.client.0.smithi038.stdout:8/341: dread - d1/de/d21/f75 zero size 2024-09-13T18:30:33.334 INFO:tasks.workunit.client.0.smithi038.stdout:8/342: fdatasync d1/d8/f51 0 2024-09-13T18:30:33.334 INFO:tasks.workunit.client.0.smithi038.stdout:8/343: creat d1/de/d3a/f77 x:0 0 0 2024-09-13T18:30:33.334 INFO:tasks.workunit.client.0.smithi038.stdout:8/344: readlink d1/l16 0 2024-09-13T18:30:33.335 INFO:tasks.workunit.client.1.smithi149.stdout:3/984: getdents d1/d2c/d56 0 2024-09-13T18:30:33.335 INFO:tasks.workunit.client.1.smithi149.stdout:3/985: creat d1/d2e/d1d/d6c/daa/dfb/f15c x:0 0 0 2024-09-13T18:30:33.335 INFO:tasks.workunit.client.0.smithi038.stdout:6/321: symlink dd/de/d61/l7b 0 2024-09-13T18:30:33.335 INFO:tasks.workunit.client.0.smithi038.stdout:3/262: dwrite d0/dd/d19/d23/f2e [0,4194304] 0 2024-09-13T18:30:33.335 INFO:tasks.workunit.client.0.smithi038.stdout:3/263: write d0/dd/d19/d1d/d29/d2b/f49 [478410,98672] 0 2024-09-13T18:30:33.337 INFO:tasks.workunit.client.0.smithi038.stdout:8/345: symlink d1/de/d15/d30/l78 0 2024-09-13T18:30:33.337 INFO:tasks.workunit.client.1.smithi149.stdout:3/986: mkdir d1/d2e/d1d/d6c/d15d 0 2024-09-13T18:30:33.337 INFO:tasks.workunit.client.1.smithi149.stdout:3/987: chown d1/d47/l3a 798410230 1 2024-09-13T18:30:33.338 INFO:tasks.workunit.client.0.smithi038.stdout:6/322: rmdir dd/de/d2e/d30/d27/d6a 0 2024-09-13T18:30:33.339 INFO:tasks.workunit.client.0.smithi038.stdout:6/323: stat dd/de/f1a 0 2024-09-13T18:30:33.339 INFO:tasks.workunit.client.0.smithi038.stdout:6/324: fsync dd/de/d2e/d2f/d4c/d55/f5b 0 2024-09-13T18:30:33.339 INFO:tasks.workunit.client.0.smithi038.stdout:6/325: stat dd/de/d2e/d2f/d4c/d60 0 2024-09-13T18:30:33.339 INFO:tasks.workunit.client.0.smithi038.stdout:6/326: chown cc 80148134 1 2024-09-13T18:30:33.339 INFO:tasks.workunit.client.0.smithi038.stdout:6/327: fsync f6 0 2024-09-13T18:30:33.340 INFO:tasks.workunit.client.1.smithi149.stdout:3/988: mkdir d1/d2c/d38/d8d/de1/d15e 0 2024-09-13T18:30:33.340 INFO:tasks.workunit.client.1.smithi149.stdout:3/989: truncate d1/d2e/d1d/d6c/f146 715958 0 2024-09-13T18:30:33.340 INFO:tasks.workunit.client.1.smithi149.stdout:3/990: symlink d1/d2c/d38/d8d/de1/d15e/l15f 0 2024-09-13T18:30:33.340 INFO:tasks.workunit.client.1.smithi149.stdout:3/991: chown d1/d47/df9/f13f 35145 1 2024-09-13T18:30:33.342 INFO:tasks.workunit.client.1.smithi149.stdout:3/992: mkdir d1/d2c/d8b/d160 0 2024-09-13T18:30:33.342 INFO:tasks.workunit.client.1.smithi149.stdout:3/993: creat d1/d2e/d1d/d6c/dcd/f161 x:0 0 0 2024-09-13T18:30:33.348 INFO:tasks.workunit.client.1.smithi149.stdout:3/994: creat d1/d2c/d38/d8d/de1/d15e/f162 x:0 0 0 2024-09-13T18:30:33.349 INFO:tasks.workunit.client.1.smithi149.stdout:3/995: mkdir d1/d47/d30/d163 0 2024-09-13T18:30:33.350 INFO:tasks.workunit.client.1.smithi149.stdout:3/996: write d1/d2c/d38/d88/f143 [692074,39302] 0 2024-09-13T18:30:33.351 INFO:tasks.workunit.client.0.smithi038.stdout:8/346: dread d1/d4/f2d [0,4194304] 0 2024-09-13T18:30:33.352 INFO:tasks.workunit.client.0.smithi038.stdout:8/347: unlink d1/de/d21/d24/f2f 0 2024-09-13T18:30:33.353 INFO:tasks.workunit.client.0.smithi038.stdout:6/328: dwrite dd/de/f1a [8388608,4194304] 0 2024-09-13T18:30:33.355 INFO:tasks.workunit.client.0.smithi038.stdout:6/329: link dd/de/lf dd/de/d2e/d2f/d4c/d6f/l7c 0 2024-09-13T18:30:33.356 INFO:tasks.workunit.client.0.smithi038.stdout:8/348: getdents d1/d4 0 2024-09-13T18:30:33.357 INFO:tasks.workunit.client.0.smithi038.stdout:8/349: chown d1/de/d15 0 1 2024-09-13T18:30:33.357 INFO:tasks.workunit.client.0.smithi038.stdout:3/264: dwrite d0/dd/d19/d1d/d29/d2b/f49 [0,4194304] 0 2024-09-13T18:30:33.357 INFO:tasks.workunit.client.0.smithi038.stdout:3/265: chown d0/dd/d19/d1d/d29/d2b/f49 1 1 2024-09-13T18:30:33.359 INFO:tasks.workunit.client.0.smithi038.stdout:6/330: link dd/de/d2e/f64 dd/de/d31/d63/f7d 0 2024-09-13T18:30:33.360 INFO:tasks.workunit.client.0.smithi038.stdout:8/350: creat d1/de/d21/d24/d41/f79 x:0 0 0 2024-09-13T18:30:33.360 INFO:tasks.workunit.client.0.smithi038.stdout:8/351: write d1/d8/f44 [5009281,57978] 0 2024-09-13T18:30:33.363 INFO:tasks.workunit.client.0.smithi038.stdout:3/266: mknod d0/dd/d17/d50/c54 0 2024-09-13T18:30:33.366 INFO:tasks.workunit.client.1.smithi149.stdout:5/948: sync 2024-09-13T18:30:33.366 INFO:tasks.workunit.client.1.smithi149.stdout:5/949: chown d3/d8/f1e 1322 1 2024-09-13T18:30:33.366 INFO:tasks.workunit.client.1.smithi149.stdout:5/950: readlink d3/d10/d98/dfb/d54/d97/de7/lf4 0 2024-09-13T18:30:33.368 INFO:tasks.workunit.client.0.smithi038.stdout:8/352: creat d1/de/d21/d24/f7a x:0 0 0 2024-09-13T18:30:33.383 INFO:tasks.workunit.client.0.smithi038.stdout:6/331: dwrite dd/de/d2e/d30/d27/f43 [0,4194304] 0 2024-09-13T18:30:33.393 INFO:tasks.workunit.client.0.smithi038.stdout:6/332: dread dd/de/d31/f74 [0,4194304] 0 2024-09-13T18:30:33.402 INFO:tasks.workunit.client.0.smithi038.stdout:6/333: dread f9 [0,4194304] 0 2024-09-13T18:30:33.402 INFO:tasks.workunit.client.0.smithi038.stdout:6/334: fsync dd/de/d31/f74 0 2024-09-13T18:30:33.410 INFO:tasks.workunit.client.0.smithi038.stdout:3/267: dwrite d0/f4 [4194304,4194304] 0 2024-09-13T18:30:33.411 INFO:tasks.workunit.client.0.smithi038.stdout:3/268: creat d0/dd/d19/f55 x:0 0 0 2024-09-13T18:30:33.416 INFO:tasks.workunit.client.1.smithi149.stdout:9/896: sync 2024-09-13T18:30:33.416 INFO:tasks.workunit.client.1.smithi149.stdout:5/951: dwrite d3/d10/d4c/d4e/d61/d63/faa [0,4194304] 0 2024-09-13T18:30:33.416 INFO:tasks.workunit.client.0.smithi038.stdout:8/353: dwrite d1/de/f5a [0,4194304] 0 2024-09-13T18:30:33.416 INFO:tasks.workunit.client.0.smithi038.stdout:6/335: write dd/de/d2e/f4b [3900523,66110] 0 2024-09-13T18:30:33.416 INFO:tasks.workunit.client.0.smithi038.stdout:8/354: creat d1/d8/f7b x:0 0 0 2024-09-13T18:30:33.416 INFO:tasks.workunit.client.0.smithi038.stdout:6/336: creat dd/de/d2e/d2f/d4c/d55/f7e x:0 0 0 2024-09-13T18:30:33.419 INFO:tasks.workunit.client.1.smithi149.stdout:9/897: rename d0/d2e/d42/f8c to d0/d47/d54/d75/f111 0 2024-09-13T18:30:33.426 INFO:tasks.workunit.client.0.smithi038.stdout:6/337: write dd/f16 [281889,117722] 0 2024-09-13T18:30:33.427 INFO:tasks.workunit.client.0.smithi038.stdout:6/338: creat dd/de/d31/d63/d72/f7f x:0 0 0 2024-09-13T18:30:33.428 INFO:tasks.workunit.client.0.smithi038.stdout:6/339: chown dd/de/d2e/d30/d27/f33 140647156 1 2024-09-13T18:30:33.428 INFO:tasks.workunit.client.0.smithi038.stdout:6/340: fdatasync dd/de/d2e/d2f/d4c/f4d 0 2024-09-13T18:30:33.428 INFO:tasks.workunit.client.0.smithi038.stdout:6/341: chown dd/de/d31/f52 696 1 2024-09-13T18:30:33.428 INFO:tasks.workunit.client.0.smithi038.stdout:6/342: creat dd/de/d31/d63/d72/f80 x:0 0 0 2024-09-13T18:30:33.429 INFO:tasks.workunit.client.0.smithi038.stdout:3/269: dread d0/f4 [4194304,4194304] 0 2024-09-13T18:30:33.430 INFO:tasks.workunit.client.0.smithi038.stdout:6/343: symlink dd/de/d2e/d2f/d4c/d55/l81 0 2024-09-13T18:30:33.430 INFO:tasks.workunit.client.0.smithi038.stdout:3/270: read d0/dd/d19/d23/f2c [197497,104259] 0 2024-09-13T18:30:33.431 INFO:tasks.workunit.client.0.smithi038.stdout:6/344: creat dd/de/d61/d62/f82 x:0 0 0 2024-09-13T18:30:33.431 INFO:tasks.workunit.client.0.smithi038.stdout:3/271: chown d0/dd/d19/d1d/l28 1775793 1 2024-09-13T18:30:33.432 INFO:tasks.workunit.client.0.smithi038.stdout:6/345: mkdir dd/de/d31/d63/d83 0 2024-09-13T18:30:33.432 INFO:tasks.workunit.client.0.smithi038.stdout:3/272: symlink d0/dd/d19/d1d/d29/l56 0 2024-09-13T18:30:33.432 INFO:tasks.workunit.client.0.smithi038.stdout:7/261: sync 2024-09-13T18:30:33.432 INFO:tasks.workunit.client.0.smithi038.stdout:2/258: sync 2024-09-13T18:30:33.433 INFO:tasks.workunit.client.1.smithi149.stdout:9/898: write d0/d9e/f23 [232910,102042] 0 2024-09-13T18:30:33.433 INFO:tasks.workunit.client.0.smithi038.stdout:6/346: rename dd/de/f6c to dd/de/d2e/d2f/d4c/f84 0 2024-09-13T18:30:33.434 INFO:tasks.workunit.client.0.smithi038.stdout:3/273: mknod d0/dd/d19/d1d/d29/c57 0 2024-09-13T18:30:33.434 INFO:tasks.workunit.client.0.smithi038.stdout:5/235: sync 2024-09-13T18:30:33.434 INFO:tasks.workunit.client.0.smithi038.stdout:0/290: sync 2024-09-13T18:30:33.434 INFO:tasks.workunit.client.0.smithi038.stdout:5/236: chown f9 3 1 2024-09-13T18:30:33.434 INFO:tasks.workunit.client.0.smithi038.stdout:0/291: dread - d2/d7/d24/d3c/f53 zero size 2024-09-13T18:30:33.434 INFO:tasks.workunit.client.1.smithi149.stdout:5/952: dwrite d3/d10/d4c/d4e/d61/d63/f115 [0,4194304] 0 2024-09-13T18:30:33.435 INFO:tasks.workunit.client.0.smithi038.stdout:2/259: unlink d2/da/f25 0 2024-09-13T18:30:33.435 INFO:tasks.workunit.client.0.smithi038.stdout:7/262: link db/d12/d1c/d3a/d26/f2b db/d12/d1c/f60 0 2024-09-13T18:30:33.436 INFO:tasks.workunit.client.0.smithi038.stdout:6/347: symlink dd/de/d31/d63/d83/l85 0 2024-09-13T18:30:33.439 INFO:tasks.workunit.client.0.smithi038.stdout:3/274: getdents d0/dd/d19/d1d 0 2024-09-13T18:30:33.439 INFO:tasks.workunit.client.0.smithi038.stdout:3/275: write d0/dd/d19/f21 [1464628,66022] 0 2024-09-13T18:30:33.439 INFO:tasks.workunit.client.0.smithi038.stdout:8/355: dwrite d1/d8/f51 [0,4194304] 0 2024-09-13T18:30:33.439 INFO:tasks.workunit.client.0.smithi038.stdout:8/356: truncate d1/d8/f1f 4840351 0 2024-09-13T18:30:33.439 INFO:tasks.workunit.client.0.smithi038.stdout:5/237: mkdir df/d13/d49 0 2024-09-13T18:30:33.441 INFO:tasks.workunit.client.0.smithi038.stdout:2/260: creat d2/d1e/d48/f64 x:0 0 0 2024-09-13T18:30:33.441 INFO:tasks.workunit.client.0.smithi038.stdout:8/357: dread d1/de/f33 [0,4194304] 0 2024-09-13T18:30:33.442 INFO:tasks.workunit.client.0.smithi038.stdout:7/263: truncate db/d12/d1c/d3a/f1f 628339 0 2024-09-13T18:30:33.448 INFO:tasks.workunit.client.0.smithi038.stdout:5/238: creat df/d13/d3b/f4a x:0 0 0 2024-09-13T18:30:33.448 INFO:tasks.workunit.client.0.smithi038.stdout:5/239: getdents df/d15/d36 0 2024-09-13T18:30:33.450 INFO:tasks.workunit.client.0.smithi038.stdout:2/261: link d2/d1e/f2f d2/f65 0 2024-09-13T18:30:33.450 INFO:tasks.workunit.client.1.smithi149.stdout:9/899: write d0/d2e/d42/d59/d86/fa4 [3398027,29251] 0 2024-09-13T18:30:33.450 INFO:tasks.workunit.client.1.smithi149.stdout:9/900: fsync d0/d2e/d42/d70/f7d 0 2024-09-13T18:30:33.451 INFO:tasks.workunit.client.0.smithi038.stdout:2/262: mkdir d2/d5c/d66 0 2024-09-13T18:30:33.455 INFO:tasks.workunit.client.1.smithi149.stdout:3/997: sync 2024-09-13T18:30:33.457 INFO:tasks.workunit.client.0.smithi038.stdout:9/316: sync 2024-09-13T18:30:33.457 INFO:tasks.workunit.client.0.smithi038.stdout:1/262: sync 2024-09-13T18:30:33.457 INFO:tasks.workunit.client.0.smithi038.stdout:4/486: sync 2024-09-13T18:30:33.457 INFO:tasks.workunit.client.1.smithi149.stdout:3/998: symlink d1/d2e/d1d/d6c/daa/dfb/d113/l164 0 2024-09-13T18:30:33.457 INFO:tasks.workunit.client.1.smithi149.stdout:3/999: write d1/d2e/f14 [4227589,121657] 0 2024-09-13T18:30:33.463 INFO:tasks.workunit.client.1.smithi149.stdout:5/953: dwrite d3/d10/d4c/d4e/da4/fa6 [0,4194304] 0 2024-09-13T18:30:33.466 INFO:tasks.workunit.client.0.smithi038.stdout:0/292: dwrite d2/d7/f4a [0,4194304] 0 2024-09-13T18:30:33.482 INFO:tasks.workunit.client.1.smithi149.stdout:5/954: dread d3/d8/fe [0,4194304] 0 2024-09-13T18:30:33.486 INFO:tasks.workunit.client.1.smithi149.stdout:9/901: dwrite d0/f67 [0,4194304] 0 2024-09-13T18:30:33.486 INFO:tasks.workunit.client.0.smithi038.stdout:6/348: dwrite dd/de/d31/f52 [0,4194304] 0 2024-09-13T18:30:33.495 INFO:tasks.workunit.client.0.smithi038.stdout:3/276: dwrite d0/dd/f2a [0,4194304] 0 2024-09-13T18:30:33.511 INFO:tasks.workunit.client.0.smithi038.stdout:3/277: write d0/dd/f2a [583729,31612] 0 2024-09-13T18:30:33.512 INFO:tasks.workunit.client.0.smithi038.stdout:3/278: stat d0/dd/d17/d43/f45 0 2024-09-13T18:30:33.512 INFO:tasks.workunit.client.0.smithi038.stdout:3/279: getdents d0/dd/d19/d23/d52 0 2024-09-13T18:30:33.513 INFO:tasks.workunit.client.0.smithi038.stdout:8/358: dwrite d1/de/d15/d30/f6c [0,4194304] 0 2024-09-13T18:30:33.513 INFO:tasks.workunit.client.0.smithi038.stdout:8/359: write d1/d8/f51 [5132435,78633] 0 2024-09-13T18:30:33.514 INFO:tasks.workunit.client.1.smithi149.stdout:5/955: dwrite d3/d10/d4c/d4e/d61/d63/faa [0,4194304] 0 2024-09-13T18:30:33.528 INFO:tasks.workunit.client.1.smithi149.stdout:9/902: dwrite d0/d18/d68/fdc [0,4194304] 0 2024-09-13T18:30:33.528 INFO:tasks.workunit.client.1.smithi149.stdout:9/903: write d0/f67 [4879365,128801] 0 2024-09-13T18:30:33.528 INFO:tasks.workunit.client.1.smithi149.stdout:9/904: write d0/d47/d61/f77 [2679731,87736] 0 2024-09-13T18:30:33.528 INFO:tasks.workunit.client.1.smithi149.stdout:9/905: creat d0/d18/d68/db2/dc9/f112 x:0 0 0 2024-09-13T18:30:33.533 INFO:tasks.workunit.client.0.smithi038.stdout:3/280: dwrite d0/dd/d19/d1d/d29/f3b [0,4194304] 0 2024-09-13T18:30:33.536 INFO:tasks.workunit.client.0.smithi038.stdout:7/264: dwrite db/d12/d13/d43/f5b [0,4194304] 0 2024-09-13T18:30:33.540 INFO:tasks.workunit.client.0.smithi038.stdout:7/265: dread db/d12/d1c/d3a/d3c/d52/f4d [0,4194304] 0 2024-09-13T18:30:33.542 INFO:tasks.workunit.client.1.smithi149.stdout:5/956: dwrite d3/d10/d4c/d4e/d61/d63/f9d [0,4194304] 0 2024-09-13T18:30:33.543 INFO:tasks.workunit.client.1.smithi149.stdout:5/957: dread d3/d10/d4c/db8/fc2 [0,4194304] 0 2024-09-13T18:30:33.563 INFO:tasks.workunit.client.0.smithi038.stdout:4/487: link d2/d49/d4b/l6d d2/l9d 0 2024-09-13T18:30:33.564 INFO:tasks.workunit.client.0.smithi038.stdout:9/317: unlink d0/d7/c1d 0 2024-09-13T18:30:33.564 INFO:tasks.workunit.client.0.smithi038.stdout:9/318: fdatasync d0/d7/d2c/f49 0 2024-09-13T18:30:33.616 INFO:tasks.workunit.client.0.smithi038.stdout:1/263: creat d12/d3c/f50 x:0 0 0 2024-09-13T18:30:33.621 INFO:tasks.workunit.client.0.smithi038.stdout:0/293: rmdir d2/d7/d24/d3c 39 2024-09-13T18:30:33.622 INFO:tasks.workunit.client.1.smithi149.stdout:9/906: mkdir d0/d2e/d42/d113 0 2024-09-13T18:30:33.622 INFO:tasks.workunit.client.1.smithi149.stdout:9/907: fsync d0/d18/d68/db2/fc8 0 2024-09-13T18:30:33.627 INFO:tasks.workunit.client.1.smithi149.stdout:5/958: symlink d3/d10/d4c/d4e/d61/dd0/l129 0 2024-09-13T18:30:33.627 INFO:tasks.workunit.client.1.smithi149.stdout:5/959: chown d3/d10/d4c/d4e/d61/d63/fc5 0 1 2024-09-13T18:30:33.629 INFO:tasks.workunit.client.1.smithi149.stdout:9/908: mknod d0/d18/d27/d5c/d99/c114 0 2024-09-13T18:30:33.629 INFO:tasks.workunit.client.1.smithi149.stdout:9/909: fdatasync d0/d18/d27/d5c/d99/d9f/f10b 0 2024-09-13T18:30:33.629 INFO:tasks.workunit.client.1.smithi149.stdout:9/910: getdents d0/d2e/d42/d70/d84/d105 0 2024-09-13T18:30:33.631 INFO:tasks.workunit.client.1.smithi149.stdout:5/960: creat d3/d8/f12a x:0 0 0 2024-09-13T18:30:33.634 INFO:tasks.workunit.client.1.smithi149.stdout:5/961: creat d3/f12b x:0 0 0 2024-09-13T18:30:33.635 INFO:tasks.workunit.client.0.smithi038.stdout:8/360: link d1/d4/f3d d1/de/d21/d24/d56/d5e/f7c 0 2024-09-13T18:30:33.636 INFO:tasks.workunit.client.1.smithi149.stdout:9/911: rmdir d0/d2e/d42/d70/d84/dea 39 2024-09-13T18:30:33.639 INFO:tasks.workunit.client.1.smithi149.stdout:9/912: dread d0/d47/d61/fd9 [0,4194304] 0 2024-09-13T18:30:33.639 INFO:tasks.workunit.client.0.smithi038.stdout:3/281: truncate d0/dd/d19/d1d/d29/d2b/f49 2829907 0 2024-09-13T18:30:33.639 INFO:tasks.workunit.client.0.smithi038.stdout:3/282: truncate d0/dd/d19/f55 891971 0 2024-09-13T18:30:33.642 INFO:tasks.workunit.client.1.smithi149.stdout:9/913: unlink d0/d2e/c8f 0 2024-09-13T18:30:33.643 INFO:tasks.workunit.client.0.smithi038.stdout:7/266: rename db/d12/d1c/d3a/d22/d28/c4c to db/d12/d13/d43/c61 0 2024-09-13T18:30:33.644 INFO:tasks.workunit.client.0.smithi038.stdout:7/267: fdatasync db/d12/d13/f54 0 2024-09-13T18:30:33.644 INFO:tasks.workunit.client.0.smithi038.stdout:7/268: stat db/d12/d13 0 2024-09-13T18:30:33.644 INFO:tasks.workunit.client.0.smithi038.stdout:9/319: truncate d0/f2a 2918405 0 2024-09-13T18:30:33.645 INFO:tasks.workunit.client.1.smithi149.stdout:5/962: dread d3/d10/d4c/d4e/d61/d63/f9d [0,4194304] 0 2024-09-13T18:30:33.646 INFO:tasks.workunit.client.1.smithi149.stdout:5/963: write d3/d10/d98/dfb/d67/f86 [3912279,11916] 0 2024-09-13T18:30:33.648 INFO:tasks.workunit.client.0.smithi038.stdout:1/264: unlink d12/d15/c3b 0 2024-09-13T18:30:33.649 INFO:tasks.workunit.client.0.smithi038.stdout:0/294: symlink d2/d2f/d40/l61 0 2024-09-13T18:30:33.650 INFO:tasks.workunit.client.1.smithi149.stdout:5/964: stat d3/d10/d4c/d4e/d61/d63/c99 0 2024-09-13T18:30:33.652 INFO:tasks.workunit.client.0.smithi038.stdout:8/361: rmdir d1/de 39 2024-09-13T18:30:33.654 INFO:tasks.workunit.client.0.smithi038.stdout:3/283: creat d0/dd/d17/d50/d51/f58 x:0 0 0 2024-09-13T18:30:33.657 INFO:tasks.workunit.client.0.smithi038.stdout:4/488: rename d2/df/d1b/d10/d75/d82/f87 to d2/df/d22/dc/d8/d3b/f9e 0 2024-09-13T18:30:33.659 INFO:tasks.workunit.client.1.smithi149.stdout:9/914: dwrite d0/d47/d54/d75/fcd [0,4194304] 0 2024-09-13T18:30:33.659 INFO:tasks.workunit.client.0.smithi038.stdout:7/269: link db/l15 db/d12/d1c/d3a/l62 0 2024-09-13T18:30:33.661 INFO:tasks.workunit.client.0.smithi038.stdout:9/320: creat d0/d7/d13/d2d/d3c/f73 x:0 0 0 2024-09-13T18:30:33.661 INFO:tasks.workunit.client.0.smithi038.stdout:9/321: truncate d0/d7/d13/f5d 1718351 0 2024-09-13T18:30:33.662 INFO:tasks.workunit.client.1.smithi149.stdout:9/915: truncate d0/d2e/f71 261971 0 2024-09-13T18:30:33.662 INFO:tasks.workunit.client.1.smithi149.stdout:9/916: stat d0/d18/d27/d5c/d79 0 2024-09-13T18:30:33.662 INFO:tasks.workunit.client.1.smithi149.stdout:9/917: chown d0/d2e/d42/d70/d84/dea 512 1 2024-09-13T18:30:33.663 INFO:tasks.workunit.client.0.smithi038.stdout:1/265: link d12/f13 d12/d2a/f51 0 2024-09-13T18:30:33.663 INFO:tasks.workunit.client.0.smithi038.stdout:1/266: stat d12/f25 0 2024-09-13T18:30:33.663 INFO:tasks.workunit.client.0.smithi038.stdout:1/267: fsync d12/f25 0 2024-09-13T18:30:33.664 INFO:tasks.workunit.client.0.smithi038.stdout:0/295: creat d2/dc/f62 x:0 0 0 2024-09-13T18:30:33.665 INFO:tasks.workunit.client.0.smithi038.stdout:4/489: creat d2/df/d1b/d10/d75/f9f x:0 0 0 2024-09-13T18:30:33.665 INFO:tasks.workunit.client.0.smithi038.stdout:1/268: write d12/f17 [352302,67366] 0 2024-09-13T18:30:33.665 INFO:tasks.workunit.client.0.smithi038.stdout:1/269: stat d12/d3c 0 2024-09-13T18:30:33.665 INFO:tasks.workunit.client.0.smithi038.stdout:1/270: chown d12/f1a 155392 1 2024-09-13T18:30:33.667 INFO:tasks.workunit.client.0.smithi038.stdout:3/284: rename d0/dd/d17/d42 to d0/dd/d17/d50/d59 0 2024-09-13T18:30:33.667 INFO:tasks.workunit.client.0.smithi038.stdout:3/285: fdatasync d0/dd/f2a 0 2024-09-13T18:30:33.670 INFO:tasks.workunit.client.0.smithi038.stdout:7/270: unlink db/d12/d1c/f60 0 2024-09-13T18:30:33.670 INFO:tasks.workunit.client.0.smithi038.stdout:7/271: chown db/d12/d1c/d3a/l62 0 1 2024-09-13T18:30:33.672 INFO:tasks.workunit.client.0.smithi038.stdout:1/271: symlink d12/d2a/l52 0 2024-09-13T18:30:33.672 INFO:tasks.workunit.client.0.smithi038.stdout:1/272: write d12/d2a/f4d [908429,31305] 0 2024-09-13T18:30:33.675 INFO:tasks.workunit.client.0.smithi038.stdout:8/362: dwrite d1/f7 [0,4194304] 0 2024-09-13T18:30:33.676 INFO:tasks.workunit.client.1.smithi149.stdout:5/965: dread d3/d10/d98/dfb/fff [0,4194304] 0 2024-09-13T18:30:33.678 INFO:tasks.workunit.client.0.smithi038.stdout:1/273: getdents d12/d3c/d46 0 2024-09-13T18:30:33.678 INFO:tasks.workunit.client.0.smithi038.stdout:1/274: read - d12/d15/f26 zero size 2024-09-13T18:30:33.682 INFO:tasks.workunit.client.0.smithi038.stdout:7/272: write db/f48 [147847,21660] 0 2024-09-13T18:30:33.682 INFO:tasks.workunit.client.0.smithi038.stdout:9/322: read d0/d2e/f27 [1098088,121003] 0 2024-09-13T18:30:33.682 INFO:tasks.workunit.client.0.smithi038.stdout:9/323: chown d0/d7/d13/d2d/d3c 323 1 2024-09-13T18:30:33.682 INFO:tasks.workunit.client.0.smithi038.stdout:1/275: mknod d12/d2a/d32/c53 0 2024-09-13T18:30:33.682 INFO:tasks.workunit.client.0.smithi038.stdout:1/276: write d12/d2a/f4c [846323,50027] 0 2024-09-13T18:30:33.684 INFO:tasks.workunit.client.0.smithi038.stdout:9/324: mknod d0/c74 0 2024-09-13T18:30:33.684 INFO:tasks.workunit.client.0.smithi038.stdout:9/325: truncate d0/d7/d13/d2d/f39 993180 0 2024-09-13T18:30:33.685 INFO:tasks.workunit.client.0.smithi038.stdout:1/277: link fe d12/f54 0 2024-09-13T18:30:33.685 INFO:tasks.workunit.client.0.smithi038.stdout:1/278: readlink d12/d2a/d32/l4a 0 2024-09-13T18:30:33.686 INFO:tasks.workunit.client.1.smithi149.stdout:5/966: write d3/d10/d4c/f71 [1566257,44051] 0 2024-09-13T18:30:33.687 INFO:tasks.workunit.client.0.smithi038.stdout:9/326: creat d0/d7/d2c/d6d/f75 x:0 0 0 2024-09-13T18:30:33.690 INFO:tasks.workunit.client.0.smithi038.stdout:9/327: rename d0/d7/d2c/d33/f44 to d0/d7/d2c/f76 0 2024-09-13T18:30:33.691 INFO:tasks.workunit.client.0.smithi038.stdout:4/490: dwrite d2/df/d1b/d10/d75/f9f [0,4194304] 0 2024-09-13T18:30:33.719 INFO:tasks.workunit.client.1.smithi149.stdout:9/918: dwrite d0/d18/d27/d5c/d79/fa1 [0,4194304] 0 2024-09-13T18:30:33.720 INFO:tasks.workunit.client.1.smithi149.stdout:9/919: creat d0/d47/f115 x:0 0 0 2024-09-13T18:30:33.731 INFO:tasks.workunit.client.1.smithi149.stdout:9/920: dread d0/d9e/dc5/ff1 [0,4194304] 0 2024-09-13T18:30:33.731 INFO:tasks.workunit.client.1.smithi149.stdout:9/921: write d0/d18/d27/d5c/d99/fda [455980,81039] 0 2024-09-13T18:30:33.731 INFO:tasks.workunit.client.1.smithi149.stdout:9/922: rmdir d0/d2e/d42/d59/d86 39 2024-09-13T18:30:33.732 INFO:tasks.workunit.client.1.smithi149.stdout:9/923: chown d0/d18/d93/f103 106 1 2024-09-13T18:30:33.732 INFO:tasks.workunit.client.1.smithi149.stdout:9/924: stat d0/d47/d61/fdd 0 2024-09-13T18:30:33.733 INFO:tasks.workunit.client.1.smithi149.stdout:9/925: rename d0/d18/d68/db2/dc9/f112 to d0/d9e/f116 0 2024-09-13T18:30:33.733 INFO:tasks.workunit.client.1.smithi149.stdout:9/926: mknod d0/d2e/d42/d70/d84/dad/c117 0 2024-09-13T18:30:33.733 INFO:tasks.workunit.client.1.smithi149.stdout:9/927: stat d0/d2e/d42/d59/d86/f9b 0 2024-09-13T18:30:33.738 INFO:tasks.workunit.client.0.smithi038.stdout:1/279: write ff [858576,42432] 0 2024-09-13T18:30:33.739 INFO:tasks.workunit.client.0.smithi038.stdout:1/280: truncate d12/d3c/d46/f48 685699 0 2024-09-13T18:30:33.740 INFO:tasks.workunit.client.0.smithi038.stdout:1/281: creat d12/d15/d47/f55 x:0 0 0 2024-09-13T18:30:33.740 INFO:tasks.workunit.client.0.smithi038.stdout:1/282: creat d12/d15/d47/f56 x:0 0 0 2024-09-13T18:30:33.741 INFO:tasks.workunit.client.0.smithi038.stdout:1/283: mkdir d12/d3c/d46/d57 0 2024-09-13T18:30:33.751 INFO:tasks.workunit.client.0.smithi038.stdout:3/286: dwrite d0/fa [0,4194304] 0 2024-09-13T18:30:33.751 INFO:tasks.workunit.client.0.smithi038.stdout:3/287: readlink d0/dd/d19/d1d/d29/d2b/l44 0 2024-09-13T18:30:33.753 INFO:tasks.workunit.client.0.smithi038.stdout:1/284: dread d12/f2b [0,4194304] 0 2024-09-13T18:30:33.753 INFO:tasks.workunit.client.1.smithi149.stdout:5/967: dwrite d3/d10/d4c/f111 [0,4194304] 0 2024-09-13T18:30:33.754 INFO:tasks.workunit.client.0.smithi038.stdout:4/491: dwrite d2/df/d1b/fd [0,4194304] 0 2024-09-13T18:30:33.754 INFO:tasks.workunit.client.0.smithi038.stdout:8/363: dwrite d1/f60 [0,4194304] 0 2024-09-13T18:30:33.755 INFO:tasks.workunit.client.0.smithi038.stdout:9/328: dwrite d0/d7/d13/d2d/d3e/f6e [0,4194304] 0 2024-09-13T18:30:33.755 INFO:tasks.workunit.client.0.smithi038.stdout:9/329: write d0/d7/d13/d2d/d3c/f73 [992120,45719] 0 2024-09-13T18:30:33.755 INFO:tasks.workunit.client.0.smithi038.stdout:9/330: stat d0/d7/f45 0 2024-09-13T18:30:33.755 INFO:tasks.workunit.client.0.smithi038.stdout:9/331: write d0/d7/d2c/f49 [27319,1877] 0 2024-09-13T18:30:33.755 INFO:tasks.workunit.client.0.smithi038.stdout:7/273: dwrite db/d12/d1c/d3a/f1f [0,4194304] 0 2024-09-13T18:30:33.755 INFO:tasks.workunit.client.0.smithi038.stdout:1/285: mkdir d12/d3c/d46/d58 0 2024-09-13T18:30:33.755 INFO:tasks.workunit.client.0.smithi038.stdout:7/274: write db/d12/d1c/d3a/d26/d41/f5d [638675,115024] 0 2024-09-13T18:30:33.755 INFO:tasks.workunit.client.1.smithi149.stdout:9/928: getdents d0/d47 0 2024-09-13T18:30:33.758 INFO:tasks.workunit.client.0.smithi038.stdout:4/492: unlink d2/df/d1b/l38 0 2024-09-13T18:30:33.759 INFO:tasks.workunit.client.0.smithi038.stdout:3/288: dread d0/fa [0,4194304] 0 2024-09-13T18:30:33.759 INFO:tasks.workunit.client.0.smithi038.stdout:3/289: chown d0/dd/f1a 23672973 1 2024-09-13T18:30:33.763 INFO:tasks.workunit.client.0.smithi038.stdout:1/286: mkdir d12/d2a/d32/d59 0 2024-09-13T18:30:33.771 INFO:tasks.workunit.client.1.smithi149.stdout:5/968: dread d3/d10/d98/dfb/f2e [0,4194304] 0 2024-09-13T18:30:33.771 INFO:tasks.workunit.client.1.smithi149.stdout:5/969: stat d3/d10/d98/dfb/d54/d97/dba/df8/lfa 0 2024-09-13T18:30:33.772 INFO:tasks.workunit.client.0.smithi038.stdout:4/493: rename d2/df/d22/dc to d2/d49/d50/da0 0 2024-09-13T18:30:33.772 INFO:tasks.workunit.client.0.smithi038.stdout:1/287: rename d12 to d12/d3c/d46/d5a 22 2024-09-13T18:30:33.772 INFO:tasks.workunit.client.0.smithi038.stdout:1/288: truncate d12/d3c/d46/f48 1157797 0 2024-09-13T18:30:33.773 INFO:tasks.workunit.client.0.smithi038.stdout:7/275: dread db/d12/f34 [0,4194304] 0 2024-09-13T18:30:33.774 INFO:tasks.workunit.client.0.smithi038.stdout:7/276: creat db/d12/d13/f63 x:0 0 0 2024-09-13T18:30:33.775 INFO:tasks.workunit.client.0.smithi038.stdout:8/364: dread d1/de/f5a [0,4194304] 0 2024-09-13T18:30:33.775 INFO:tasks.workunit.client.0.smithi038.stdout:8/365: write d1/ff [4483903,23720] 0 2024-09-13T18:30:33.776 INFO:tasks.workunit.client.0.smithi038.stdout:8/366: truncate d1/de/f33 12565 0 2024-09-13T18:30:33.776 INFO:tasks.workunit.client.0.smithi038.stdout:8/367: fsync d1/de/d21/f52 0 2024-09-13T18:30:33.777 INFO:tasks.workunit.client.0.smithi038.stdout:8/368: mkdir d1/de/d21/d24/d41/d7d 0 2024-09-13T18:30:33.778 INFO:tasks.workunit.client.0.smithi038.stdout:8/369: truncate d1/de/d15/d30/f3c 4369400 0 2024-09-13T18:30:33.778 INFO:tasks.workunit.client.1.smithi149.stdout:9/929: write d0/d47/d54/d75/f95 [1353165,45217] 0 2024-09-13T18:30:33.778 INFO:tasks.workunit.client.1.smithi149.stdout:9/930: readlink d0/d9e/l1c 0 2024-09-13T18:30:33.781 INFO:tasks.workunit.client.1.smithi149.stdout:9/931: creat d0/d2e/d42/d70/d84/dea/f118 x:0 0 0 2024-09-13T18:30:33.785 INFO:tasks.workunit.client.1.smithi149.stdout:9/932: dread d0/d2e/fb1 [0,4194304] 0 2024-09-13T18:30:33.787 INFO:tasks.workunit.client.1.smithi149.stdout:9/933: mkdir d0/d2e/d42/d70/d84/dae/d119 0 2024-09-13T18:30:33.795 INFO:tasks.workunit.client.0.smithi038.stdout:4/494: dread d2/df/d22/f70 [0,4194304] 0 2024-09-13T18:30:33.795 INFO:tasks.workunit.client.0.smithi038.stdout:4/495: dread - d2/df/d1b/d10/f88 zero size 2024-09-13T18:30:33.795 INFO:tasks.workunit.client.0.smithi038.stdout:9/332: dwrite d0/d2e/f25 [0,4194304] 0 2024-09-13T18:30:33.798 INFO:tasks.workunit.client.1.smithi149.stdout:5/970: dwrite d3/d10/d98/dfb/d54/d97/dba/fc9 [4194304,4194304] 0 2024-09-13T18:30:33.809 INFO:tasks.workunit.client.0.smithi038.stdout:7/277: dwrite db/d12/f18 [0,4194304] 0 2024-09-13T18:30:33.811 INFO:tasks.workunit.client.1.smithi149.stdout:9/934: write d0/d9e/f32 [2572633,33683] 0 2024-09-13T18:30:33.811 INFO:tasks.workunit.client.1.smithi149.stdout:9/935: write d0/d18/d93/fce [247467,108504] 0 2024-09-13T18:30:33.811 INFO:tasks.workunit.client.1.smithi149.stdout:9/936: read d0/d18/d93/fd7 [328165,67698] 0 2024-09-13T18:30:33.817 INFO:tasks.workunit.client.0.smithi038.stdout:1/289: dwrite d12/f13 [0,4194304] 0 2024-09-13T18:30:33.824 INFO:tasks.workunit.client.0.smithi038.stdout:1/290: dread d12/f54 [0,4194304] 0 2024-09-13T18:30:33.825 INFO:tasks.workunit.client.0.smithi038.stdout:8/370: dwrite d1/d8/f2b [0,4194304] 0 2024-09-13T18:30:33.825 INFO:tasks.workunit.client.0.smithi038.stdout:8/371: write d1/d2a/f38 [2756353,79384] 0 2024-09-13T18:30:33.825 INFO:tasks.workunit.client.0.smithi038.stdout:8/372: truncate d1/f6b 5419877 0 2024-09-13T18:30:33.825 INFO:tasks.workunit.client.0.smithi038.stdout:8/373: creat d1/d2a/d3f/f7e x:0 0 0 2024-09-13T18:30:33.826 INFO:tasks.workunit.client.0.smithi038.stdout:8/374: mknod d1/d2a/d3f/c7f 0 2024-09-13T18:30:33.829 INFO:tasks.workunit.client.0.smithi038.stdout:8/375: rename d1/de/d21/d67 to d1/de/d21/d24/d41/d80 0 2024-09-13T18:30:33.829 INFO:tasks.workunit.client.0.smithi038.stdout:8/376: fsync d1/de/d21/f75 0 2024-09-13T18:30:33.829 INFO:tasks.workunit.client.0.smithi038.stdout:8/377: write d1/d8/f19 [5435889,4934] 0 2024-09-13T18:30:33.830 INFO:tasks.workunit.client.0.smithi038.stdout:5/240: sync 2024-09-13T18:30:33.831 INFO:tasks.workunit.client.0.smithi038.stdout:5/241: mknod df/d13/d3b/d44/d48/c4b 0 2024-09-13T18:30:33.831 INFO:tasks.workunit.client.0.smithi038.stdout:5/242: write df/d13/d3b/d3e/f31 [1414789,88807] 0 2024-09-13T18:30:33.833 INFO:tasks.workunit.client.0.smithi038.stdout:5/243: dread df/f2a [0,4194304] 0 2024-09-13T18:30:33.835 INFO:tasks.workunit.client.0.smithi038.stdout:5/244: rename df/d13/c1f to df/d13/d49/c4c 0 2024-09-13T18:30:33.835 INFO:tasks.workunit.client.0.smithi038.stdout:5/245: creat df/d13/d3b/f4d x:0 0 0 2024-09-13T18:30:33.835 INFO:tasks.workunit.client.0.smithi038.stdout:5/246: chown df/f1e 112849 1 2024-09-13T18:30:33.837 INFO:tasks.workunit.client.0.smithi038.stdout:5/247: unlink df/d13/l3f 0 2024-09-13T18:30:33.843 INFO:tasks.workunit.client.1.smithi149.stdout:5/971: dwrite d3/d10/d4c/f111 [0,4194304] 0 2024-09-13T18:30:33.854 INFO:tasks.workunit.client.0.smithi038.stdout:4/496: dwrite d2/df/d1b/f8a [0,4194304] 0 2024-09-13T18:30:33.855 INFO:tasks.workunit.client.0.smithi038.stdout:4/497: symlink d2/df/d1b/d10/d71/la1 0 2024-09-13T18:30:33.856 INFO:tasks.workunit.client.0.smithi038.stdout:4/498: mknod d2/df/d1b/d10/ca2 0 2024-09-13T18:30:33.859 INFO:tasks.workunit.client.0.smithi038.stdout:4/499: rename d2/d49/d4b/d64 to d2/df/d1b/d10/da3 0 2024-09-13T18:30:33.860 INFO:tasks.workunit.client.0.smithi038.stdout:4/500: rename d2 to d2/df/d1b/d10/d55/da4 22 2024-09-13T18:30:33.860 INFO:tasks.workunit.client.0.smithi038.stdout:4/501: symlink d2/d49/d4b/d8e/la5 0 2024-09-13T18:30:33.860 INFO:tasks.workunit.client.0.smithi038.stdout:4/502: readlink d2/df/d22/l95 0 2024-09-13T18:30:33.861 INFO:tasks.workunit.client.0.smithi038.stdout:5/248: read f3 [2146340,3394] 0 2024-09-13T18:30:33.862 INFO:tasks.workunit.client.0.smithi038.stdout:5/249: rename df/d15/l16 to df/l4e 0 2024-09-13T18:30:33.868 INFO:tasks.workunit.client.0.smithi038.stdout:9/333: dwrite d0/d7/d2c/d33/d4a/f57 [0,4194304] 0 2024-09-13T18:30:33.874 INFO:tasks.workunit.client.1.smithi149.stdout:9/937: dwrite d0/d18/d68/f8e [0,4194304] 0 2024-09-13T18:30:33.874 INFO:tasks.workunit.client.1.smithi149.stdout:9/938: fsync d0/d18/f41 0 2024-09-13T18:30:33.876 INFO:tasks.workunit.client.0.smithi038.stdout:9/334: write d0/d2e/f25 [2259360,21319] 0 2024-09-13T18:30:33.876 INFO:tasks.workunit.client.0.smithi038.stdout:5/250: dread df/f1e [0,4194304] 0 2024-09-13T18:30:33.877 INFO:tasks.workunit.client.0.smithi038.stdout:5/251: fsync df/d13/d3b/f4a 0 2024-09-13T18:30:33.877 INFO:tasks.workunit.client.1.smithi149.stdout:9/939: creat d0/d2e/d42/d70/d84/dae/f11a x:0 0 0 2024-09-13T18:30:33.878 INFO:tasks.workunit.client.0.smithi038.stdout:9/335: mkdir d0/d7/d2c/d5e/d77 0 2024-09-13T18:30:33.878 INFO:tasks.workunit.client.0.smithi038.stdout:9/336: readlink d0/l41 0 2024-09-13T18:30:33.878 INFO:tasks.workunit.client.0.smithi038.stdout:1/291: dwrite d12/f25 [0,4194304] 0 2024-09-13T18:30:33.878 INFO:tasks.workunit.client.0.smithi038.stdout:1/292: getdents d12/d3c/d46/d58 0 2024-09-13T18:30:33.878 INFO:tasks.workunit.client.0.smithi038.stdout:9/337: symlink d0/d7/d2c/d5a/d67/l78 0 2024-09-13T18:30:33.879 INFO:tasks.workunit.client.0.smithi038.stdout:1/293: rmdir d12/d2a 39 2024-09-13T18:30:33.880 INFO:tasks.workunit.client.0.smithi038.stdout:1/294: fsync d12/d15/f1e 0 2024-09-13T18:30:33.880 INFO:tasks.workunit.client.0.smithi038.stdout:1/295: dread - d12/d3c/f50 zero size 2024-09-13T18:30:33.880 INFO:tasks.workunit.client.0.smithi038.stdout:1/296: write d12/f54 [5042916,82863] 0 2024-09-13T18:30:33.882 INFO:tasks.workunit.client.0.smithi038.stdout:4/503: dwrite d2/f58 [0,4194304] 0 2024-09-13T18:30:33.882 INFO:tasks.workunit.client.0.smithi038.stdout:8/378: dwrite d1/f60 [4194304,4194304] 0 2024-09-13T18:30:33.882 INFO:tasks.workunit.client.0.smithi038.stdout:8/379: creat d1/de/d21/d45/f81 x:0 0 0 2024-09-13T18:30:33.882 INFO:tasks.workunit.client.0.smithi038.stdout:4/504: creat d2/df/fa6 x:0 0 0 2024-09-13T18:30:33.882 INFO:tasks.workunit.client.0.smithi038.stdout:7/278: dwrite db/d12/d1c/d3a/d26/f2b [0,4194304] 0 2024-09-13T18:30:33.883 INFO:tasks.workunit.client.0.smithi038.stdout:1/297: rename d12/d15 to d12/d2a/d32/d59/d5b 0 2024-09-13T18:30:33.883 INFO:tasks.workunit.client.0.smithi038.stdout:1/298: write d12/f3e [278679,57916] 0 2024-09-13T18:30:33.883 INFO:tasks.workunit.client.0.smithi038.stdout:1/299: read - d12/f39 zero size 2024-09-13T18:30:33.885 INFO:tasks.workunit.client.0.smithi038.stdout:5/252: write f9 [2420213,2530] 0 2024-09-13T18:30:33.888 INFO:tasks.workunit.client.1.smithi149.stdout:9/940: dread d0/d2e/d42/d59/fe4 [0,4194304] 0 2024-09-13T18:30:33.888 INFO:tasks.workunit.client.1.smithi149.stdout:9/941: dread - d0/d2e/d42/d70/d84/f10a zero size 2024-09-13T18:30:33.888 INFO:tasks.workunit.client.1.smithi149.stdout:5/972: dwrite d3/d10/d98/f10b [4194304,4194304] 0 2024-09-13T18:30:33.888 INFO:tasks.workunit.client.1.smithi149.stdout:5/973: fsync d3/d10/d98/dfb/d54/f84 0 2024-09-13T18:30:33.889 INFO:tasks.workunit.client.1.smithi149.stdout:5/974: readlink d3/d8/l5a 0 2024-09-13T18:30:33.894 INFO:tasks.workunit.client.0.smithi038.stdout:8/380: write d1/ff [2967209,97547] 0 2024-09-13T18:30:33.896 INFO:tasks.workunit.client.0.smithi038.stdout:7/279: dread db/f11 [0,4194304] 0 2024-09-13T18:30:33.896 INFO:tasks.workunit.client.0.smithi038.stdout:4/505: creat d2/fa7 x:0 0 0 2024-09-13T18:30:33.901 INFO:tasks.workunit.client.1.smithi149.stdout:5/975: getdents d3/d10/d4c/d4e/da4 0 2024-09-13T18:30:33.909 INFO:tasks.workunit.client.1.smithi149.stdout:5/976: mkdir d3/d10/d98/dfb/d54/d97/dba/df8/d12c 0 2024-09-13T18:30:33.911 INFO:tasks.workunit.client.0.smithi038.stdout:1/300: dwrite d12/f1a [0,4194304] 0 2024-09-13T18:30:33.911 INFO:tasks.workunit.client.0.smithi038.stdout:1/301: chown d12/d2a/d32/f36 1 1 2024-09-13T18:30:33.911 INFO:tasks.workunit.client.0.smithi038.stdout:9/338: dwrite d0/d7/d2c/d5a/f64 [0,4194304] 0 2024-09-13T18:30:33.915 INFO:tasks.workunit.client.0.smithi038.stdout:1/302: write d12/f2b [219172,22461] 0 2024-09-13T18:30:33.917 INFO:tasks.workunit.client.1.smithi149.stdout:5/977: symlink d3/d10/d98/dfb/d54/l12d 0 2024-09-13T18:30:33.917 INFO:tasks.workunit.client.1.smithi149.stdout:5/978: dread - d3/d8/d13/f46 zero size 2024-09-13T18:30:33.918 INFO:tasks.workunit.client.0.smithi038.stdout:8/381: dwrite d1/f54 [0,4194304] 0 2024-09-13T18:30:33.921 INFO:tasks.workunit.client.0.smithi038.stdout:5/253: dwrite df/d13/f21 [0,4194304] 0 2024-09-13T18:30:33.922 INFO:tasks.workunit.client.0.smithi038.stdout:7/280: mknod db/d12/d13/c64 0 2024-09-13T18:30:33.922 INFO:tasks.workunit.client.0.smithi038.stdout:7/281: creat db/d12/d1c/d3a/d4b/f65 x:0 0 0 2024-09-13T18:30:33.925 INFO:tasks.workunit.client.0.smithi038.stdout:9/339: rename d0/d2e/f27 to d0/d7/d2c/d5e/d77/f79 0 2024-09-13T18:30:33.927 INFO:tasks.workunit.client.0.smithi038.stdout:1/303: mknod d12/d3c/d46/c5c 0 2024-09-13T18:30:33.927 INFO:tasks.workunit.client.0.smithi038.stdout:1/304: fsync fe 0 2024-09-13T18:30:33.927 INFO:tasks.workunit.client.0.smithi038.stdout:1/305: fdatasync fe 0 2024-09-13T18:30:33.927 INFO:tasks.workunit.client.0.smithi038.stdout:1/306: chown d12/d2a/d32/d59/d5b/f42 10509729 1 2024-09-13T18:30:33.928 INFO:tasks.workunit.client.0.smithi038.stdout:5/254: rmdir df/d13/d3b/d3e 39 2024-09-13T18:30:33.928 INFO:tasks.workunit.client.0.smithi038.stdout:5/255: write df/f2a [654106,27204] 0 2024-09-13T18:30:33.933 INFO:tasks.workunit.client.0.smithi038.stdout:7/282: symlink db/d12/d1c/d3a/l66 0 2024-09-13T18:30:33.933 INFO:tasks.workunit.client.0.smithi038.stdout:7/283: truncate db/d12/d1c/d3a/f59 664243 0 2024-09-13T18:30:33.933 INFO:tasks.workunit.client.0.smithi038.stdout:7/284: stat db/d12/d13/f1b 0 2024-09-13T18:30:33.935 INFO:tasks.workunit.client.1.smithi149.stdout:5/979: dread d3/d5e/fa2 [0,4194304] 0 2024-09-13T18:30:33.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/980: rename d3/d10/c72 to d3/d10/d4c/c12e 0 2024-09-13T18:30:33.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/981: write d3/d10/d4c/db8/fc2 [1167679,125073] 0 2024-09-13T18:30:33.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/982: chown d3/d10/d98/dfb/d54/d76/d7a/l10d 5145 1 2024-09-13T18:30:33.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/983: creat d3/d10/d98/dfb/d54/db9/f12f x:0 0 0 2024-09-13T18:30:33.938 INFO:tasks.workunit.client.1.smithi149.stdout:5/984: write d3/d10/d98/dfb/d54/f10e [2329096,42089] 0 2024-09-13T18:30:33.940 INFO:tasks.workunit.client.0.smithi038.stdout:4/506: rmdir d2/df 39 2024-09-13T18:30:33.940 INFO:tasks.workunit.client.0.smithi038.stdout:4/507: readlink d2/d49/d4b/d8e/la5 0 2024-09-13T18:30:33.944 INFO:tasks.workunit.client.0.smithi038.stdout:1/307: rmdir d12/d2a/d32/d59/d5b 39 2024-09-13T18:30:33.945 INFO:tasks.workunit.client.0.smithi038.stdout:9/340: dwrite d0/d7/d13/f66 [0,4194304] 0 2024-09-13T18:30:33.947 INFO:tasks.workunit.client.0.smithi038.stdout:5/256: truncate df/f1e 6581554 0 2024-09-13T18:30:33.949 INFO:tasks.workunit.client.0.smithi038.stdout:7/285: rename db/d12/l45 to db/d12/d1c/d3a/d3c/d52/d51/l67 0 2024-09-13T18:30:33.950 INFO:tasks.workunit.client.0.smithi038.stdout:7/286: stat db/d12 0 2024-09-13T18:30:33.950 INFO:tasks.workunit.client.0.smithi038.stdout:7/287: chown db/l47 119096904 1 2024-09-13T18:30:33.950 INFO:tasks.workunit.client.0.smithi038.stdout:1/308: rename d12 to d12/d2a/d32/d59/d5b/d47/d5d 22 2024-09-13T18:30:33.950 INFO:tasks.workunit.client.0.smithi038.stdout:1/309: chown d12/d3c/d46/d57 870407222 1 2024-09-13T18:30:33.950 INFO:tasks.workunit.client.0.smithi038.stdout:4/508: rmdir d2/df/d1b/d10 39 2024-09-13T18:30:33.950 INFO:tasks.workunit.client.0.smithi038.stdout:4/509: readlink d2/d49/d50/da0/l60 0 2024-09-13T18:30:33.950 INFO:tasks.workunit.client.0.smithi038.stdout:4/510: creat d2/d49/d50/fa8 x:0 0 0 2024-09-13T18:30:33.953 INFO:tasks.workunit.client.0.smithi038.stdout:5/257: truncate fb 2205582 0 2024-09-13T18:30:33.956 INFO:tasks.workunit.client.0.smithi038.stdout:7/288: unlink db/c5c 0 2024-09-13T18:30:33.957 INFO:tasks.workunit.client.0.smithi038.stdout:5/258: fsync df/f2a 0 2024-09-13T18:30:33.957 INFO:tasks.workunit.client.0.smithi038.stdout:5/259: write df/d13/d3b/d44/f46 [796369,32886] 0 2024-09-13T18:30:33.957 INFO:tasks.workunit.client.0.smithi038.stdout:5/260: read - df/d13/d3b/f4a zero size 2024-09-13T18:30:33.957 INFO:tasks.workunit.client.0.smithi038.stdout:9/341: rename d0/d7/l46 to d0/d7/d13/d2d/d3c/d50/l7a 0 2024-09-13T18:30:33.957 INFO:tasks.workunit.client.0.smithi038.stdout:9/342: readlink d0/d7/d2c/l43 0 2024-09-13T18:30:33.958 INFO:tasks.workunit.client.1.smithi149.stdout:5/985: dwrite d3/d10/d98/dfb/d54/d97/dba/fc9 [0,4194304] 0 2024-09-13T18:30:33.959 INFO:tasks.workunit.client.1.smithi149.stdout:5/986: unlink d3/d10/d4c/f71 0 2024-09-13T18:30:33.959 INFO:tasks.workunit.client.0.smithi038.stdout:7/289: getdents db/d21 0 2024-09-13T18:30:33.961 INFO:tasks.workunit.client.0.smithi038.stdout:5/261: creat df/d13/f4f x:0 0 0 2024-09-13T18:30:33.961 INFO:tasks.workunit.client.0.smithi038.stdout:5/262: write df/d13/f4f [575848,103399] 0 2024-09-13T18:30:33.963 INFO:tasks.workunit.client.1.smithi149.stdout:5/987: link d3/d10/d98/dfb/d54/c51 d3/d8/c130 0 2024-09-13T18:30:33.963 INFO:tasks.workunit.client.0.smithi038.stdout:9/343: mkdir d0/d7/d13/d2d/d3e/d70/d7b 0 2024-09-13T18:30:33.965 INFO:tasks.workunit.client.0.smithi038.stdout:7/290: rename db/d12/d1c/d3a/d3c/d52/f4d to db/d12/f68 0 2024-09-13T18:30:33.965 INFO:tasks.workunit.client.0.smithi038.stdout:7/291: write db/d12/d1c/f20 [1983509,38716] 0 2024-09-13T18:30:33.965 INFO:tasks.workunit.client.0.smithi038.stdout:7/292: write db/d12/d1c/f20 [3146137,29533] 0 2024-09-13T18:30:33.966 INFO:tasks.workunit.client.0.smithi038.stdout:5/263: mkdir df/d15/d50 0 2024-09-13T18:30:33.966 INFO:tasks.workunit.client.0.smithi038.stdout:5/264: creat df/d13/d3b/d44/f51 x:0 0 0 2024-09-13T18:30:33.968 INFO:tasks.workunit.client.0.smithi038.stdout:7/293: dread db/d12/d1c/d3a/d22/f2c [0,4194304] 0 2024-09-13T18:30:33.968 INFO:tasks.workunit.client.1.smithi149.stdout:5/988: link d3/d10/d4c/db8/dd6/f110 d3/d10/d98/dfb/d54/d97/dba/f131 0 2024-09-13T18:30:33.973 INFO:tasks.workunit.client.0.smithi038.stdout:5/265: mkdir df/d13/d3b/d44/d52 0 2024-09-13T18:30:33.975 INFO:tasks.workunit.client.0.smithi038.stdout:7/294: mknod db/d12/d1c/d3a/d22/c69 0 2024-09-13T18:30:33.975 INFO:tasks.workunit.client.0.smithi038.stdout:7/295: write db/d12/f34 [4761827,103625] 0 2024-09-13T18:30:33.975 INFO:tasks.workunit.client.0.smithi038.stdout:7/296: dread - db/d12/d1c/f5e zero size 2024-09-13T18:30:33.977 INFO:tasks.workunit.client.0.smithi038.stdout:5/266: rename df/d13/l30 to df/d13/d3b/d44/d52/l53 0 2024-09-13T18:30:33.977 INFO:tasks.workunit.client.0.smithi038.stdout:5/267: truncate df/d13/d3b/d3e/f2f 4416123 0 2024-09-13T18:30:33.978 INFO:tasks.workunit.client.1.smithi149.stdout:5/989: creat d3/d10/d98/dfb/d54/d97/f132 x:0 0 0 2024-09-13T18:30:33.978 INFO:tasks.workunit.client.1.smithi149.stdout:5/990: write d3/d10/d98/dfb/d54/d97/dba/df8/f108 [796788,42020] 0 2024-09-13T18:30:33.981 INFO:tasks.workunit.client.1.smithi149.stdout:5/991: unlink d3/d10/d98/dfb/d54/d97/cb5 0 2024-09-13T18:30:33.982 INFO:tasks.workunit.client.1.smithi149.stdout:5/992: mknod d3/d10/d4c/d4e/d61/d75/d11d/c133 0 2024-09-13T18:30:33.982 INFO:tasks.workunit.client.1.smithi149.stdout:5/993: read d3/d8/d13/f6c [579084,38479] 0 2024-09-13T18:30:33.983 INFO:tasks.workunit.client.0.smithi038.stdout:5/268: dread df/f10 [0,4194304] 0 2024-09-13T18:30:33.983 INFO:tasks.workunit.client.0.smithi038.stdout:5/269: write df/d13/f34 [124058,105271] 0 2024-09-13T18:30:33.984 INFO:tasks.workunit.client.0.smithi038.stdout:4/511: dwrite d2/df/d1b/f73 [0,4194304] 0 2024-09-13T18:30:33.984 INFO:tasks.workunit.client.0.smithi038.stdout:4/512: fdatasync d2/df/d22/f70 0 2024-09-13T18:30:33.984 INFO:tasks.workunit.client.0.smithi038.stdout:4/513: read d2/df/d1b/f51 [2194431,87833] 0 2024-09-13T18:30:33.984 INFO:tasks.workunit.client.0.smithi038.stdout:4/514: fdatasync d2/f58 0 2024-09-13T18:30:33.984 INFO:tasks.workunit.client.0.smithi038.stdout:4/515: fdatasync d2/df/d1b/d10/d55/f7f 0 2024-09-13T18:30:33.984 INFO:tasks.workunit.client.0.smithi038.stdout:1/310: dwrite d12/d2a/f51 [0,4194304] 0 2024-09-13T18:30:33.984 INFO:tasks.workunit.client.0.smithi038.stdout:1/311: readlink d12/d2a/d32/d59/d5b/d47/l4f 0 2024-09-13T18:30:33.984 INFO:tasks.workunit.client.0.smithi038.stdout:1/312: dread - d12/f39 zero size 2024-09-13T18:30:33.984 INFO:tasks.workunit.client.0.smithi038.stdout:1/313: write d12/d2a/d32/d59/d5b/f20 [978253,118203] 0 2024-09-13T18:30:33.985 INFO:tasks.workunit.client.1.smithi149.stdout:5/994: mknod d3/d10/d98/dfb/d67/d83/de2/c134 0 2024-09-13T18:30:33.987 INFO:tasks.workunit.client.0.smithi038.stdout:4/516: mknod d2/d49/d50/da0/d8/d3b/ca9 0 2024-09-13T18:30:33.994 INFO:tasks.workunit.client.0.smithi038.stdout:7/297: dwrite db/d12/f18 [0,4194304] 0 2024-09-13T18:30:33.994 INFO:tasks.workunit.client.0.smithi038.stdout:7/298: chown db/d12/d1c/d3a/d3c/d52/l5a 63625222 1 2024-09-13T18:30:33.996 INFO:tasks.workunit.client.0.smithi038.stdout:7/299: symlink db/d12/d1c/d3a/d4b/l6a 0 2024-09-13T18:30:33.997 INFO:tasks.workunit.client.0.smithi038.stdout:7/300: rename l6 to db/d12/d1c/d3a/d3c/d52/l6b 0 2024-09-13T18:30:33.999 INFO:tasks.workunit.client.0.smithi038.stdout:7/301: creat db/d12/d1c/d3a/d3c/d52/f6c x:0 0 0 2024-09-13T18:30:34.000 INFO:tasks.workunit.client.0.smithi038.stdout:7/302: rename db/d12/d1c/d3a/d4b/f53 to db/d12/f6d 0 2024-09-13T18:30:34.002 INFO:tasks.workunit.client.0.smithi038.stdout:5/270: rmdir df/d13 39 2024-09-13T18:30:34.002 INFO:tasks.workunit.client.0.smithi038.stdout:1/314: dwrite d12/f3e [0,4194304] 0 2024-09-13T18:30:34.003 INFO:tasks.workunit.client.1.smithi149.stdout:9/942: sync 2024-09-13T18:30:34.003 INFO:tasks.workunit.client.1.smithi149.stdout:9/943: dread - d0/d18/f10e zero size 2024-09-13T18:30:34.004 INFO:tasks.workunit.client.0.smithi038.stdout:5/271: mkdir df/d13/d3b/d44/d48/d54 0 2024-09-13T18:30:34.017 INFO:tasks.workunit.client.1.smithi149.stdout:5/995: dwrite d3/d10/d4c/d4e/d61/d63/f9d [0,4194304] 0 2024-09-13T18:30:34.018 INFO:tasks.workunit.client.1.smithi149.stdout:5/996: write d3/d10/d98/ffc [1170258,23295] 0 2024-09-13T18:30:34.018 INFO:tasks.workunit.client.1.smithi149.stdout:5/997: creat d3/d10/d4c/d4e/d61/dd0/f135 x:0 0 0 2024-09-13T18:30:34.018 INFO:tasks.workunit.client.1.smithi149.stdout:5/998: fdatasync d3/d10/d98/dfb/d54/d97/fd9 0 2024-09-13T18:30:34.018 INFO:tasks.workunit.client.1.smithi149.stdout:5/999: truncate d3/d10/d4c/db8/dd6/f110 15719 0 2024-09-13T18:30:34.019 INFO:tasks.workunit.client.1.smithi149.stdout:9/944: dread d0/d18/d81/f110 [0,4194304] 0 2024-09-13T18:30:34.019 INFO:tasks.workunit.client.0.smithi038.stdout:4/517: dwrite d2/d49/d50/f91 [0,4194304] 0 2024-09-13T18:30:34.019 INFO:tasks.workunit.client.0.smithi038.stdout:4/518: chown d2/df/d1b/f8a 2649 1 2024-09-13T18:30:34.022 INFO:tasks.workunit.client.0.smithi038.stdout:4/519: link d2/c69 d2/caa 0 2024-09-13T18:30:34.022 INFO:tasks.workunit.client.0.smithi038.stdout:4/520: fdatasync d2/f58 0 2024-09-13T18:30:34.022 INFO:tasks.workunit.client.0.smithi038.stdout:4/521: read - d2/df/d22/f65 zero size 2024-09-13T18:30:34.029 INFO:tasks.workunit.client.0.smithi038.stdout:7/303: dwrite db/d12/d1c/d3a/d22/f23 [0,4194304] 0 2024-09-13T18:30:34.030 INFO:tasks.workunit.client.0.smithi038.stdout:5/272: dwrite df/d13/d3b/f4d [0,4194304] 0 2024-09-13T18:30:34.030 INFO:tasks.workunit.client.0.smithi038.stdout:5/273: write df/d15/f3d [909263,25593] 0 2024-09-13T18:30:34.033 INFO:tasks.workunit.client.1.smithi149.stdout:9/945: dread d0/d18/d27/f6e [0,4194304] 0 2024-09-13T18:30:34.035 INFO:tasks.workunit.client.0.smithi038.stdout:7/304: creat db/d12/d1c/d3a/d22/d28/f6e x:0 0 0 2024-09-13T18:30:34.035 INFO:tasks.workunit.client.0.smithi038.stdout:7/305: chown db/d12/d1c/d3a/d22/c39 62015 1 2024-09-13T18:30:34.036 INFO:tasks.workunit.client.0.smithi038.stdout:5/274: symlink df/d13/d49/l55 0 2024-09-13T18:30:34.046 INFO:tasks.workunit.client.0.smithi038.stdout:5/275: read df/d13/f21 [1522007,94339] 0 2024-09-13T18:30:34.047 INFO:tasks.workunit.client.0.smithi038.stdout:5/276: chown df/d15/l43 58227729 1 2024-09-13T18:30:34.048 INFO:tasks.workunit.client.0.smithi038.stdout:5/277: mkdir df/d13/d3b/d44/d48/d56 0 2024-09-13T18:30:34.048 INFO:tasks.workunit.client.0.smithi038.stdout:5/278: chown df/d15/d36/f3c 1324 1 2024-09-13T18:30:34.048 INFO:tasks.workunit.client.0.smithi038.stdout:5/279: truncate fd 432630 0 2024-09-13T18:30:34.049 INFO:tasks.workunit.client.0.smithi038.stdout:5/280: link df/c2c df/d13/d3b/d41/c57 0 2024-09-13T18:30:34.051 INFO:tasks.workunit.client.1.smithi149.stdout:9/946: dwrite d0/d2e/d42/d70/d84/dea/f100 [0,4194304] 0 2024-09-13T18:30:34.051 INFO:tasks.workunit.client.0.smithi038.stdout:4/522: dwrite d2/df/f4c [0,4194304] 0 2024-09-13T18:30:34.051 INFO:tasks.workunit.client.0.smithi038.stdout:4/523: write d2/df/d1b/d10/d55/f7f [1306274,124236] 0 2024-09-13T18:30:34.057 INFO:tasks.workunit.client.0.smithi038.stdout:4/524: rename d2/df/d1b/d10/l30 to d2/d49/d50/da0/lab 0 2024-09-13T18:30:34.063 INFO:tasks.workunit.client.0.smithi038.stdout:4/525: dread d2/df/d1b/d10/d75/f8b [0,4194304] 0 2024-09-13T18:30:34.064 INFO:tasks.workunit.client.0.smithi038.stdout:4/526: stat d2/df/d1b/d10 0 2024-09-13T18:30:34.064 INFO:tasks.workunit.client.0.smithi038.stdout:4/527: dread - d2/df/d1b/d10/f88 zero size 2024-09-13T18:30:34.064 INFO:tasks.workunit.client.0.smithi038.stdout:4/528: symlink d2/df/d1b/d10/d75/lac 0 2024-09-13T18:30:34.082 INFO:tasks.workunit.client.1.smithi149.stdout:9/947: dwrite d0/d47/d54/f55 [0,4194304] 0 2024-09-13T18:30:34.082 INFO:tasks.workunit.client.1.smithi149.stdout:9/948: chown d0/f3c 2794475 1 2024-09-13T18:30:34.082 INFO:tasks.workunit.client.0.smithi038.stdout:5/281: dwrite fb [0,4194304] 0 2024-09-13T18:30:34.083 INFO:tasks.workunit.client.1.smithi149.stdout:9/949: creat d0/d18/d27/d5c/d79/d102/d104/f11b x:0 0 0 2024-09-13T18:30:34.083 INFO:tasks.workunit.client.1.smithi149.stdout:9/950: chown d0/d2e/d42/d70/d84/dae/fd5 0 1 2024-09-13T18:30:34.083 INFO:tasks.workunit.client.1.smithi149.stdout:9/951: write d0/d9e/fff [267347,18740] 0 2024-09-13T18:30:34.083 INFO:tasks.workunit.client.1.smithi149.stdout:9/952: chown d0/d47/d61/fdd 143 1 2024-09-13T18:30:34.084 INFO:tasks.workunit.client.0.smithi038.stdout:4/529: dwrite d2/df/d1b/d10/f5f [0,4194304] 0 2024-09-13T18:30:34.090 INFO:tasks.workunit.client.0.smithi038.stdout:3/290: sync 2024-09-13T18:30:34.090 INFO:tasks.workunit.client.0.smithi038.stdout:0/296: sync 2024-09-13T18:30:34.092 INFO:tasks.workunit.client.0.smithi038.stdout:0/297: write d2/d7/d24/d3c/f4d [193246,90587] 0 2024-09-13T18:30:34.092 INFO:tasks.workunit.client.0.smithi038.stdout:0/298: dread - d2/d7/d24/d2b/f5d zero size 2024-09-13T18:30:34.092 INFO:tasks.workunit.client.0.smithi038.stdout:0/299: stat d2/d7 0 2024-09-13T18:30:34.092 INFO:tasks.workunit.client.0.smithi038.stdout:2/263: sync 2024-09-13T18:30:34.092 INFO:tasks.workunit.client.0.smithi038.stdout:2/264: chown d2/d1e/d44/d50/d39/d52/f5b 273588 1 2024-09-13T18:30:34.092 INFO:tasks.workunit.client.0.smithi038.stdout:2/265: dread - d2/d1e/d44/d50/d46/d58/d59/f5a zero size 2024-09-13T18:30:34.092 INFO:tasks.workunit.client.0.smithi038.stdout:2/266: fsync d2/da/f53 0 2024-09-13T18:30:34.093 INFO:tasks.workunit.client.0.smithi038.stdout:2/267: creat d2/f67 x:0 0 0 2024-09-13T18:30:34.093 INFO:tasks.workunit.client.0.smithi038.stdout:6/349: sync 2024-09-13T18:30:34.095 INFO:tasks.workunit.client.0.smithi038.stdout:3/291: creat d0/dd/f5a x:0 0 0 2024-09-13T18:30:34.096 INFO:tasks.workunit.client.0.smithi038.stdout:0/300: rename d2/dc/l22 to d2/d7/d55/l63 0 2024-09-13T18:30:34.096 INFO:tasks.workunit.client.0.smithi038.stdout:6/350: dread dd/de/d2e/d30/f22 [0,4194304] 0 2024-09-13T18:30:34.097 INFO:tasks.workunit.client.0.smithi038.stdout:4/530: dread d2/df/d1b/f51 [0,4194304] 0 2024-09-13T18:30:34.098 INFO:tasks.workunit.client.0.smithi038.stdout:4/531: chown d2/df/d1b/d10/d55/f99 24636 1 2024-09-13T18:30:34.099 INFO:tasks.workunit.client.0.smithi038.stdout:2/268: mknod d2/d1e/d44/d50/d46/d58/c68 0 2024-09-13T18:30:34.099 INFO:tasks.workunit.client.0.smithi038.stdout:2/269: chown d2/d1e/d44/l5e 4097374 1 2024-09-13T18:30:34.100 INFO:tasks.workunit.client.0.smithi038.stdout:0/301: truncate d2/dc/f51 565754 0 2024-09-13T18:30:34.100 INFO:tasks.workunit.client.0.smithi038.stdout:0/302: fdatasync d2/dc/f39 0 2024-09-13T18:30:34.100 INFO:tasks.workunit.client.0.smithi038.stdout:0/303: stat d2/d2f/d44/f57 0 2024-09-13T18:30:34.101 INFO:tasks.workunit.client.0.smithi038.stdout:6/351: mkdir dd/de/d2e/d2f/d4c/d86 0 2024-09-13T18:30:34.102 INFO:tasks.workunit.client.0.smithi038.stdout:2/270: symlink d2/d2a/l69 0 2024-09-13T18:30:34.102 INFO:tasks.workunit.client.0.smithi038.stdout:2/271: write d2/f47 [544811,31526] 0 2024-09-13T18:30:34.102 INFO:tasks.workunit.client.0.smithi038.stdout:2/272: dread - d2/d1e/d44/d50/d46/d58/d59/f5a zero size 2024-09-13T18:30:34.102 INFO:tasks.workunit.client.0.smithi038.stdout:2/273: fsync d2/da/f1d 0 2024-09-13T18:30:34.102 INFO:tasks.workunit.client.0.smithi038.stdout:5/282: dwrite f9 [0,4194304] 0 2024-09-13T18:30:34.103 INFO:tasks.workunit.client.0.smithi038.stdout:0/304: mknod d2/d7/d24/d3c/c64 0 2024-09-13T18:30:34.103 INFO:tasks.workunit.client.0.smithi038.stdout:0/305: creat d2/d2f/d44/d49/f65 x:0 0 0 2024-09-13T18:30:34.105 INFO:tasks.workunit.client.1.smithi149.stdout:9/953: dwrite d0/d2e/d42/d70/d84/fac [0,4194304] 0 2024-09-13T18:30:34.105 INFO:tasks.workunit.client.0.smithi038.stdout:2/274: creat d2/d1e/d44/f6a x:0 0 0 2024-09-13T18:30:34.110 INFO:tasks.workunit.client.1.smithi149.stdout:9/954: mknod d0/d18/d27/d5c/d99/d9f/c11c 0 2024-09-13T18:30:34.110 INFO:tasks.workunit.client.1.smithi149.stdout:9/955: creat d0/d2e/d42/d59/f11d x:0 0 0 2024-09-13T18:30:34.111 INFO:tasks.workunit.client.0.smithi038.stdout:3/292: read d0/dd/d19/d23/f2e [3362896,77831] 0 2024-09-13T18:30:34.114 INFO:tasks.workunit.client.0.smithi038.stdout:5/283: dread df/d15/f22 [0,4194304] 0 2024-09-13T18:30:34.119 INFO:tasks.workunit.client.0.smithi038.stdout:2/275: read d2/d2a/f3d [29745,128438] 0 2024-09-13T18:30:34.119 INFO:tasks.workunit.client.0.smithi038.stdout:2/276: chown d2/da 9431 1 2024-09-13T18:30:34.119 INFO:tasks.workunit.client.0.smithi038.stdout:6/352: dwrite dd/de/d31/d63/d72/f7f [0,4194304] 0 2024-09-13T18:30:34.121 INFO:tasks.workunit.client.0.smithi038.stdout:3/293: getdents d0/dd/d17/d50/d51 0 2024-09-13T18:30:34.124 INFO:tasks.workunit.client.1.smithi149.stdout:9/956: dread d0/d2e/d42/d59/f69 [4194304,4194304] 0 2024-09-13T18:30:34.124 INFO:tasks.workunit.client.1.smithi149.stdout:9/957: truncate d0/d9e/f116 444937 0 2024-09-13T18:30:34.124 INFO:tasks.workunit.client.1.smithi149.stdout:9/958: read d0/d18/d27/f66 [109525,110199] 0 2024-09-13T18:30:34.126 INFO:tasks.workunit.client.0.smithi038.stdout:6/353: mknod dd/de/d31/d63/c87 0 2024-09-13T18:30:34.126 INFO:tasks.workunit.client.0.smithi038.stdout:6/354: chown dd/de/d2e/d30/l40 57361 1 2024-09-13T18:30:34.126 INFO:tasks.workunit.client.0.smithi038.stdout:6/355: write dd/de/d31/d63/f7d [247218,40358] 0 2024-09-13T18:30:34.126 INFO:tasks.workunit.client.0.smithi038.stdout:6/356: read dd/de/f3c [3736504,25273] 0 2024-09-13T18:30:34.127 INFO:tasks.workunit.client.1.smithi149.stdout:9/959: unlink d0/d2e/l76 0 2024-09-13T18:30:34.127 INFO:tasks.workunit.client.0.smithi038.stdout:3/294: getdents d0/dd/d19/d1d/d29/d32 0 2024-09-13T18:30:34.130 INFO:tasks.workunit.client.1.smithi149.stdout:9/960: link d0/d18/d68/db2/dc9/fee d0/d2e/d42/f11e 0 2024-09-13T18:30:34.130 INFO:tasks.workunit.client.0.smithi038.stdout:2/277: getdents d2/d1e/d44/d50/d46 0 2024-09-13T18:30:34.131 INFO:tasks.workunit.client.0.smithi038.stdout:6/357: rmdir dd/de/d2e 39 2024-09-13T18:30:34.131 INFO:tasks.workunit.client.0.smithi038.stdout:6/358: chown dd/de/d61/l68 648965 1 2024-09-13T18:30:34.132 INFO:tasks.workunit.client.0.smithi038.stdout:0/306: rename d2/d2f/d44 to d2/d2f/d66 0 2024-09-13T18:30:34.134 INFO:tasks.workunit.client.0.smithi038.stdout:2/278: truncate d2/d2a/f3d 2761675 0 2024-09-13T18:30:34.134 INFO:tasks.workunit.client.0.smithi038.stdout:2/279: fdatasync d2/da/f1d 0 2024-09-13T18:30:34.135 INFO:tasks.workunit.client.0.smithi038.stdout:0/307: symlink d2/d7/d24/d3c/d3f/l67 0 2024-09-13T18:30:34.135 INFO:tasks.workunit.client.0.smithi038.stdout:0/308: write d2/d2f/d66/f57 [650774,119793] 0 2024-09-13T18:30:34.137 INFO:tasks.workunit.client.0.smithi038.stdout:2/280: rmdir d2/d1e/d44/d50/d46/d63 0 2024-09-13T18:30:34.137 INFO:tasks.workunit.client.0.smithi038.stdout:5/284: dwrite f9 [4194304,4194304] 0 2024-09-13T18:30:34.137 INFO:tasks.workunit.client.0.smithi038.stdout:5/285: chown df/d15/c2e 175 1 2024-09-13T18:30:34.138 INFO:tasks.workunit.client.0.smithi038.stdout:2/281: symlink d2/d1e/l6b 0 2024-09-13T18:30:34.139 INFO:tasks.workunit.client.0.smithi038.stdout:6/359: write dd/de/d31/d63/d72/f7f [4847612,53804] 0 2024-09-13T18:30:34.140 INFO:tasks.workunit.client.0.smithi038.stdout:5/286: mkdir df/d13/d3b/d44/d58 0 2024-09-13T18:30:34.140 INFO:tasks.workunit.client.0.smithi038.stdout:5/287: chown df/d15 6986 1 2024-09-13T18:30:34.140 INFO:tasks.workunit.client.0.smithi038.stdout:5/288: chown df/d13/d3b/d3e/c2d 16577982 1 2024-09-13T18:30:34.143 INFO:tasks.workunit.client.0.smithi038.stdout:2/282: link d2/da/l33 d2/da/d16/l6c 0 2024-09-13T18:30:34.145 INFO:tasks.workunit.client.0.smithi038.stdout:6/360: symlink dd/de/d2e/l88 0 2024-09-13T18:30:34.145 INFO:tasks.workunit.client.0.smithi038.stdout:6/361: readlink dd/de/d2e/d2f/d4c/l6b 0 2024-09-13T18:30:34.145 INFO:tasks.workunit.client.0.smithi038.stdout:6/362: truncate dd/de/d31/d63/d72/f80 337559 0 2024-09-13T18:30:34.145 INFO:tasks.workunit.client.0.smithi038.stdout:6/363: chown f6 2794694 1 2024-09-13T18:30:34.146 INFO:tasks.workunit.client.0.smithi038.stdout:5/289: link df/d13/l42 df/d15/d50/l59 0 2024-09-13T18:30:34.147 INFO:tasks.workunit.client.0.smithi038.stdout:6/364: mknod dd/de/d2e/d2f/d71/c89 0 2024-09-13T18:30:34.148 INFO:tasks.workunit.client.0.smithi038.stdout:5/290: read df/f10 [1518635,130316] 0 2024-09-13T18:30:34.148 INFO:tasks.workunit.client.0.smithi038.stdout:5/291: stat df/d13/d3b/d3e/f2f 0 2024-09-13T18:30:34.148 INFO:tasks.workunit.client.0.smithi038.stdout:5/292: getdents df/d15/d36 0 2024-09-13T18:30:34.151 INFO:tasks.workunit.client.1.smithi149.stdout:9/961: dread d0/d47/d54/d75/f95 [0,4194304] 0 2024-09-13T18:30:34.157 INFO:tasks.workunit.client.1.smithi149.stdout:9/962: read d0/d2e/d42/d59/fe4 [4088905,22042] 0 2024-09-13T18:30:34.159 INFO:tasks.workunit.client.0.smithi038.stdout:0/309: dwrite d2/f5 [0,4194304] 0 2024-09-13T18:30:34.160 INFO:tasks.workunit.client.0.smithi038.stdout:0/310: creat d2/d7/d55/f68 x:0 0 0 2024-09-13T18:30:34.160 INFO:tasks.workunit.client.0.smithi038.stdout:0/311: write d2/d2f/d66/d49/f5f [319506,61581] 0 2024-09-13T18:30:34.161 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:33 smithi038 ceph-mon[27689]: pgmap v19: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 314 MiB/s rd, 386 MiB/s wr, 552 op/s 2024-09-13T18:30:34.165 INFO:tasks.workunit.client.0.smithi038.stdout:0/312: unlink d2/d2f/d66/f57 0 2024-09-13T18:30:34.165 INFO:tasks.workunit.client.0.smithi038.stdout:0/313: write d2/d7/d24/d2b/f5d [911796,115289] 0 2024-09-13T18:30:34.171 INFO:tasks.workunit.client.1.smithi149.stdout:9/963: dread d0/d18/d68/db2/d101/f4f [0,4194304] 0 2024-09-13T18:30:34.172 INFO:tasks.workunit.client.1.smithi149.stdout:9/964: chown d0/d47/d61/f77 832248 1 2024-09-13T18:30:34.174 INFO:tasks.workunit.client.1.smithi149.stdout:9/965: mknod d0/d2e/d42/d59/c11f 0 2024-09-13T18:30:34.174 INFO:tasks.workunit.client.1.smithi149.stdout:9/966: write d0/d18/d68/db2/d101/f53 [1936457,4969] 0 2024-09-13T18:30:34.177 INFO:tasks.workunit.client.1.smithi149.stdout:9/967: rmdir d0/d2e/d42/d70/d84/dae/d119 0 2024-09-13T18:30:34.177 INFO:tasks.workunit.client.1.smithi149.stdout:9/968: chown d0/d18/d93/f103 901893 1 2024-09-13T18:30:34.177 INFO:tasks.workunit.client.1.smithi149.stdout:9/969: chown d0/d9e/f116 39566 1 2024-09-13T18:30:34.177 INFO:tasks.workunit.client.1.smithi149.stdout:9/970: chown d0/d18/d27/fa8 362546 1 2024-09-13T18:30:34.178 INFO:tasks.workunit.client.1.smithi149.stdout:9/971: rename d0/d47/d61/f6b to d0/d47/d54/f120 0 2024-09-13T18:30:34.179 INFO:tasks.workunit.client.0.smithi038.stdout:2/283: dwrite d2/d1e/d44/d50/d39/f5d [0,4194304] 0 2024-09-13T18:30:34.185 INFO:tasks.workunit.client.0.smithi038.stdout:6/365: dwrite dd/de/d2e/d2f/f51 [0,4194304] 0 2024-09-13T18:30:34.186 INFO:tasks.workunit.client.0.smithi038.stdout:0/314: dwrite d2/d7/d24/d3c/f46 [0,4194304] 0 2024-09-13T18:30:34.188 INFO:tasks.workunit.client.0.smithi038.stdout:6/366: symlink dd/de/l8a 0 2024-09-13T18:30:34.188 INFO:tasks.workunit.client.0.smithi038.stdout:6/367: fsync dd/de/d2e/d30/d27/f33 0 2024-09-13T18:30:34.189 INFO:tasks.workunit.client.0.smithi038.stdout:0/315: creat d2/d7/d24/f69 x:0 0 0 2024-09-13T18:30:34.190 INFO:tasks.workunit.client.0.smithi038.stdout:0/316: chown d2/d2f/f52 745906378 1 2024-09-13T18:30:34.190 INFO:tasks.workunit.client.0.smithi038.stdout:0/317: chown d2/d2f/c5b 22 1 2024-09-13T18:30:34.190 INFO:tasks.workunit.client.0.smithi038.stdout:6/368: rmdir dd/de/d2e/d30/d27 39 2024-09-13T18:30:34.190 INFO:tasks.workunit.client.0.smithi038.stdout:6/369: chown dd/de/d2e/d30/l36 385 1 2024-09-13T18:30:34.191 INFO:tasks.workunit.client.0.smithi038.stdout:0/318: getdents d2/d7/d24/d3c/d3f 0 2024-09-13T18:30:34.191 INFO:tasks.workunit.client.0.smithi038.stdout:6/370: unlink dd/de/d31/d63/c87 0 2024-09-13T18:30:34.192 INFO:tasks.workunit.client.0.smithi038.stdout:0/319: mknod d2/d7/d24/d2b/c6a 0 2024-09-13T18:30:34.192 INFO:tasks.workunit.client.0.smithi038.stdout:6/371: truncate f9 804777 0 2024-09-13T18:30:34.193 INFO:tasks.workunit.client.0.smithi038.stdout:6/372: mknod dd/de/d31/d63/d72/c8b 0 2024-09-13T18:30:34.194 INFO:tasks.workunit.client.0.smithi038.stdout:6/373: symlink dd/de/d61/l8c 0 2024-09-13T18:30:34.198 INFO:tasks.workunit.client.1.smithi149.stdout:9/972: dwrite d0/d18/f41 [4194304,4194304] 0 2024-09-13T18:30:34.198 INFO:tasks.workunit.client.1.smithi149.stdout:9/973: fdatasync d0/d2e/d42/d59/f7c 0 2024-09-13T18:30:34.200 INFO:tasks.workunit.client.0.smithi038.stdout:2/284: dwrite d2/d1e/d44/d50/d39/d45/f4a [0,4194304] 0 2024-09-13T18:30:34.201 INFO:tasks.workunit.client.0.smithi038.stdout:0/320: read d2/f5 [2380389,14100] 0 2024-09-13T18:30:34.201 INFO:tasks.workunit.client.0.smithi038.stdout:0/321: write d2/d7/d24/d2b/f43 [646122,108597] 0 2024-09-13T18:30:34.208 INFO:tasks.workunit.client.0.smithi038.stdout:6/374: read dd/f11 [2102946,125707] 0 2024-09-13T18:30:34.209 INFO:tasks.workunit.client.0.smithi038.stdout:0/322: rmdir d2/d2f/d66 39 2024-09-13T18:30:34.209 INFO:tasks.workunit.client.0.smithi038.stdout:0/323: write d2/d7/d24/d3c/f4d [206309,35828] 0 2024-09-13T18:30:34.211 INFO:tasks.workunit.client.0.smithi038.stdout:6/375: mknod dd/de/d31/d63/d72/c8d 0 2024-09-13T18:30:34.214 INFO:tasks.workunit.client.0.smithi038.stdout:6/376: mkdir dd/de/d31/d63/d8e 0 2024-09-13T18:30:34.216 INFO:tasks.workunit.client.0.smithi038.stdout:6/377: rename dd/l20 to dd/de/d2e/d30/l8f 0 2024-09-13T18:30:34.221 INFO:tasks.workunit.client.0.smithi038.stdout:2/285: dwrite d2/d1e/d48/f64 [0,4194304] 0 2024-09-13T18:30:34.223 INFO:tasks.workunit.client.0.smithi038.stdout:2/286: symlink d2/d1e/d44/d50/d39/l6d 0 2024-09-13T18:30:34.224 INFO:tasks.workunit.client.0.smithi038.stdout:2/287: dread - d2/f67 zero size 2024-09-13T18:30:34.236 INFO:tasks.workunit.client.1.smithi149.stdout:9/974: dwrite d0/d9e/f23 [0,4194304] 0 2024-09-13T18:30:34.236 INFO:tasks.workunit.client.1.smithi149.stdout:9/975: truncate d0/d18/d27/f66 608757 0 2024-09-13T18:30:34.236 INFO:tasks.workunit.client.1.smithi149.stdout:9/976: chown d0/d18/d27/d5c/d79/lc6 288 1 2024-09-13T18:30:34.236 INFO:tasks.workunit.client.0.smithi038.stdout:0/324: dwrite d2/d7/d24/d3c/d3f/f5a [0,4194304] 0 2024-09-13T18:30:34.237 INFO:tasks.workunit.client.0.smithi038.stdout:2/288: write d2/d1e/d44/d50/d39/f5d [2536229,37242] 0 2024-09-13T18:30:34.237 INFO:tasks.workunit.client.0.smithi038.stdout:2/289: chown d2/d1e/d44/d50/d39/d45/f54 244677189 1 2024-09-13T18:30:34.237 INFO:tasks.workunit.client.0.smithi038.stdout:2/290: write d2/d1e/f2f [4162281,6322] 0 2024-09-13T18:30:34.240 INFO:tasks.workunit.client.0.smithi038.stdout:0/325: unlink d2/l54 0 2024-09-13T18:30:34.247 INFO:tasks.workunit.client.0.smithi038.stdout:0/326: dread d2/d7/f9 [4194304,4194304] 0 2024-09-13T18:30:34.250 INFO:tasks.workunit.client.1.smithi149.stdout:9/977: write d0/d18/d27/d5c/d7e/f97 [2747281,44176] 0 2024-09-13T18:30:34.250 INFO:tasks.workunit.client.0.smithi038.stdout:0/327: mknod d2/dc/c6b 0 2024-09-13T18:30:34.250 INFO:tasks.workunit.client.0.smithi038.stdout:0/328: write d2/d2f/f30 [855179,77113] 0 2024-09-13T18:30:34.251 INFO:tasks.workunit.client.1.smithi149.stdout:9/978: read d0/d2e/fb1 [557159,64756] 0 2024-09-13T18:30:34.251 INFO:tasks.workunit.client.1.smithi149.stdout:9/979: readlink d0/d18/d93/l10f 0 2024-09-13T18:30:34.251 INFO:tasks.workunit.client.0.smithi038.stdout:0/329: mknod d2/d2f/d66/d49/c6c 0 2024-09-13T18:30:34.252 INFO:tasks.workunit.client.1.smithi149.stdout:9/980: truncate d0/d2e/d42/d59/d86/fa4 3776472 0 2024-09-13T18:30:34.253 INFO:tasks.workunit.client.1.smithi149.stdout:9/981: read - d0/d2e/d42/d70/d84/f10a zero size 2024-09-13T18:30:34.254 INFO:tasks.workunit.client.0.smithi038.stdout:0/330: mkdir d2/d7/d24/d2b/d6d 0 2024-09-13T18:30:34.254 INFO:tasks.workunit.client.0.smithi038.stdout:0/331: chown d2/d7/f9 455611 1 2024-09-13T18:30:34.254 INFO:tasks.workunit.client.0.smithi038.stdout:0/332: write d2/dc/f39 [432485,117886] 0 2024-09-13T18:30:34.254 INFO:tasks.workunit.client.0.smithi038.stdout:0/333: dread - d2/f1e zero size 2024-09-13T18:30:34.256 INFO:tasks.workunit.client.0.smithi038.stdout:0/334: mknod d2/d7/d55/c6e 0 2024-09-13T18:30:34.256 INFO:tasks.workunit.client.0.smithi038.stdout:2/291: dwrite d2/d1e/d44/d50/f2d [0,4194304] 0 2024-09-13T18:30:34.256 INFO:tasks.workunit.client.0.smithi038.stdout:2/292: write d2/d1e/d44/f6a [588057,93087] 0 2024-09-13T18:30:34.266 INFO:tasks.workunit.client.0.smithi038.stdout:0/335: dread d2/f1c [0,4194304] 0 2024-09-13T18:30:34.266 INFO:tasks.workunit.client.0.smithi038.stdout:0/336: dread - d2/d7/d24/d3c/f3d zero size 2024-09-13T18:30:34.267 INFO:tasks.workunit.client.0.smithi038.stdout:0/337: fdatasync d2/d7/d24/d2b/f5d 0 2024-09-13T18:30:34.267 INFO:tasks.workunit.client.0.smithi038.stdout:0/338: rmdir d2/d2f/d66 39 2024-09-13T18:30:34.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:33 smithi149 ceph-mon[35845]: pgmap v19: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 314 MiB/s rd, 386 MiB/s wr, 552 op/s 2024-09-13T18:30:34.271 INFO:tasks.workunit.client.1.smithi149.stdout:9/982: dwrite d0/d18/d27/d5c/d7e/f97 [4194304,4194304] 0 2024-09-13T18:30:34.271 INFO:tasks.workunit.client.1.smithi149.stdout:9/983: chown d0/d2e/d42/d70/d84/dae/f11a 7 1 2024-09-13T18:30:34.271 INFO:tasks.workunit.client.1.smithi149.stdout:9/984: chown d0/d2e/f62 481591081 1 2024-09-13T18:30:34.272 INFO:tasks.workunit.client.0.smithi038.stdout:2/293: dread d2/d1e/f2f [0,4194304] 0 2024-09-13T18:30:34.273 INFO:tasks.workunit.client.1.smithi149.stdout:9/985: mknod d0/d2e/d42/d113/c121 0 2024-09-13T18:30:34.274 INFO:tasks.workunit.client.0.smithi038.stdout:2/294: link d2/d1e/f4e d2/d1e/d44/d50/d39/f6e 0 2024-09-13T18:30:34.274 INFO:tasks.workunit.client.0.smithi038.stdout:2/295: creat d2/f6f x:0 0 0 2024-09-13T18:30:34.275 INFO:tasks.workunit.client.1.smithi149.stdout:9/986: creat d0/d18/d81/f122 x:0 0 0 2024-09-13T18:30:34.276 INFO:tasks.workunit.client.0.smithi038.stdout:2/296: rename d2/f65 to d2/d1e/d44/d50/d46/d58/d59/d62/f70 0 2024-09-13T18:30:34.277 INFO:tasks.workunit.client.0.smithi038.stdout:0/339: dread d2/d7/f9 [4194304,4194304] 0 2024-09-13T18:30:34.278 INFO:tasks.workunit.client.1.smithi149.stdout:9/987: link d0/d18/d27/d5c/d99/d9f/f10b d0/d18/d68/df6/f123 0 2024-09-13T18:30:34.278 INFO:tasks.workunit.client.1.smithi149.stdout:9/988: creat d0/d18/d27/d5c/d7e/f124 x:0 0 0 2024-09-13T18:30:34.278 INFO:tasks.workunit.client.1.smithi149.stdout:9/989: fdatasync d0/d18/d27/d5c/d79/fa1 0 2024-09-13T18:30:34.279 INFO:tasks.workunit.client.0.smithi038.stdout:0/340: dread d2/d2f/d66/d49/f5f [0,4194304] 0 2024-09-13T18:30:34.279 INFO:tasks.workunit.client.0.smithi038.stdout:2/297: creat d2/d1e/d44/d50/d46/f71 x:0 0 0 2024-09-13T18:30:34.279 INFO:tasks.workunit.client.0.smithi038.stdout:2/298: creat d2/f72 x:0 0 0 2024-09-13T18:30:34.279 INFO:tasks.workunit.client.0.smithi038.stdout:2/299: fdatasync d2/d2a/f35 0 2024-09-13T18:30:34.280 INFO:tasks.workunit.client.1.smithi149.stdout:9/990: symlink d0/d47/d54/l125 0 2024-09-13T18:30:34.281 INFO:tasks.workunit.client.0.smithi038.stdout:2/300: creat d2/d1e/d44/d50/f73 x:0 0 0 2024-09-13T18:30:34.282 INFO:tasks.workunit.client.0.smithi038.stdout:2/301: getdents d2/d1e/d44/d50/d46/d58 0 2024-09-13T18:30:34.287 INFO:tasks.workunit.client.0.smithi038.stdout:0/341: write d2/d7/fb [264221,47202] 0 2024-09-13T18:30:34.292 INFO:tasks.workunit.client.1.smithi149.stdout:9/991: dread d0/d9e/f23 [0,4194304] 0 2024-09-13T18:30:34.292 INFO:tasks.workunit.client.1.smithi149.stdout:9/992: chown d0/d2e/d42/ff9 59474 1 2024-09-13T18:30:34.295 INFO:tasks.workunit.client.1.smithi149.stdout:9/993: rename d0/d47/d54/cd6 to d0/d18/d27/d5c/d7e/d107/c126 0 2024-09-13T18:30:34.295 INFO:tasks.workunit.client.1.smithi149.stdout:9/994: readlink d0/d9e/l36 0 2024-09-13T18:30:34.297 INFO:tasks.workunit.client.1.smithi149.stdout:9/995: rename d0/d18/d81/f110 to d0/d18/d27/d5c/d7e/d107/f127 0 2024-09-13T18:30:34.301 INFO:tasks.workunit.client.1.smithi149.stdout:9/996: dread d0/d18/d93/fb6 [0,4194304] 0 2024-09-13T18:30:34.302 INFO:tasks.workunit.client.1.smithi149.stdout:9/997: mkdir d0/d9e/dc5/dfe/d128 0 2024-09-13T18:30:34.303 INFO:tasks.workunit.client.0.smithi038.stdout:2/302: dwrite d2/f37 [4194304,4194304] 0 2024-09-13T18:30:34.305 INFO:tasks.workunit.client.0.smithi038.stdout:0/342: dwrite d2/d7/d24/f69 [0,4194304] 0 2024-09-13T18:30:34.305 INFO:tasks.workunit.client.0.smithi038.stdout:2/303: unlink d2/d1e/l3a 0 2024-09-13T18:30:34.310 INFO:tasks.workunit.client.0.smithi038.stdout:0/343: link d2/d7/f9 d2/d7/d24/d2b/d6d/f6f 0 2024-09-13T18:30:34.311 INFO:tasks.workunit.client.0.smithi038.stdout:2/304: mkdir d2/da/d74 0 2024-09-13T18:30:34.312 INFO:tasks.workunit.client.0.smithi038.stdout:2/305: creat d2/d1e/d44/f75 x:0 0 0 2024-09-13T18:30:34.312 INFO:tasks.workunit.client.0.smithi038.stdout:2/306: chown d2/da/f1d 12272871 1 2024-09-13T18:30:34.312 INFO:tasks.workunit.client.0.smithi038.stdout:2/307: fsync d2/da/f36 0 2024-09-13T18:30:34.312 INFO:tasks.workunit.client.0.smithi038.stdout:2/308: creat d2/d1e/d44/f76 x:0 0 0 2024-09-13T18:30:34.312 INFO:tasks.workunit.client.1.smithi149.stdout:9/998: write d0/f38 [969060,4453] 0 2024-09-13T18:30:34.316 INFO:tasks.workunit.client.1.smithi149.stdout:9/999: mkdir d0/d18/d129 0 2024-09-13T18:30:34.321 INFO:tasks.workunit.client.0.smithi038.stdout:2/309: write d2/d2a/f35 [1541376,32007] 0 2024-09-13T18:30:34.333 INFO:tasks.workunit.client.0.smithi038.stdout:0/344: creat d2/d2f/d40/f70 x:0 0 0 2024-09-13T18:30:34.333 INFO:tasks.workunit.client.1.smithi149.stderr:+ rm -rf -- ./tmp.dntWNOK7cd 2024-09-13T18:30:34.339 INFO:tasks.workunit.client.0.smithi038.stdout:2/310: rename d2/f41 to d2/da/f77 0 2024-09-13T18:30:34.344 INFO:tasks.workunit.client.0.smithi038.stdout:0/345: dread d2/dc/f11 [0,4194304] 0 2024-09-13T18:30:34.354 INFO:tasks.workunit.client.0.smithi038.stdout:0/346: write d2/d7/f4a [889673,24516] 0 2024-09-13T18:30:34.356 INFO:tasks.workunit.client.0.smithi038.stdout:0/347: unlink d2/dc/f11 0 2024-09-13T18:30:34.358 INFO:tasks.workunit.client.0.smithi038.stdout:0/348: symlink d2/d7/d24/d3c/d3f/l71 0 2024-09-13T18:30:34.361 INFO:tasks.workunit.client.0.smithi038.stdout:0/349: symlink d2/d7/d24/d3c/d3f/l72 0 2024-09-13T18:30:34.373 INFO:tasks.workunit.client.0.smithi038.stdout:0/350: write d2/dc/f28 [1429947,126085] 0 2024-09-13T18:30:34.373 INFO:tasks.workunit.client.0.smithi038.stdout:0/351: creat d2/d7/d55/f73 x:0 0 0 2024-09-13T18:30:34.380 INFO:tasks.workunit.client.0.smithi038.stdout:0/352: truncate d2/d7/f1d 6051542 0 2024-09-13T18:30:34.380 INFO:tasks.workunit.client.0.smithi038.stdout:0/353: fdatasync d2/f5 0 2024-09-13T18:30:34.383 INFO:tasks.workunit.client.0.smithi038.stdout:0/354: rmdir d2/d2f/d66/d49 39 2024-09-13T18:30:34.383 INFO:tasks.workunit.client.0.smithi038.stdout:0/355: write d2/d2f/d66/f5e [13282,94944] 0 2024-09-13T18:30:34.383 INFO:tasks.workunit.client.0.smithi038.stdout:8/382: sync 2024-09-13T18:30:34.384 INFO:tasks.workunit.client.0.smithi038.stdout:0/356: mkdir d2/d2f/d40/d74 0 2024-09-13T18:30:34.384 INFO:tasks.workunit.client.0.smithi038.stdout:0/357: write d2/d2f/d40/f70 [560775,53860] 0 2024-09-13T18:30:34.384 INFO:tasks.workunit.client.0.smithi038.stdout:0/358: write d2/d2f/d40/f70 [715890,41674] 0 2024-09-13T18:30:34.384 INFO:tasks.workunit.client.0.smithi038.stdout:0/359: write d2/f5 [15194,99144] 0 2024-09-13T18:30:34.385 INFO:tasks.workunit.client.0.smithi038.stdout:8/383: truncate d1/de/d21/d24/d56/d5e/f7c 250691 0 2024-09-13T18:30:34.386 INFO:tasks.workunit.client.0.smithi038.stdout:0/360: chown d2/l19 15 1 2024-09-13T18:30:34.386 INFO:tasks.workunit.client.0.smithi038.stdout:0/361: readlink d2/d7/d24/d2b/l38 0 2024-09-13T18:30:34.387 INFO:tasks.workunit.client.0.smithi038.stdout:0/362: write d2/d2f/d66/d49/f5f [188803,99109] 0 2024-09-13T18:30:34.387 INFO:tasks.workunit.client.0.smithi038.stdout:0/363: write d2/dc/f50 [4772612,83030] 0 2024-09-13T18:30:34.388 INFO:tasks.workunit.client.0.smithi038.stdout:8/384: truncate d1/f6b 976507 0 2024-09-13T18:30:34.396 INFO:tasks.workunit.client.0.smithi038.stdout:8/385: rename d1/de/d15/d30/f6c to d1/de/d21/d24/d4d/d50/d62/d71/f82 0 2024-09-13T18:30:34.399 INFO:tasks.workunit.client.0.smithi038.stdout:8/386: dread d1/de/d15/f1c [0,4194304] 0 2024-09-13T18:30:34.399 INFO:tasks.workunit.client.0.smithi038.stdout:8/387: dread - d1/d2a/d3f/f7e zero size 2024-09-13T18:30:34.401 INFO:tasks.workunit.client.0.smithi038.stdout:8/388: rename d1/de/d21/d45/d5d/f63 to d1/de/d21/d45/d5d/f83 0 2024-09-13T18:30:34.404 INFO:tasks.workunit.client.0.smithi038.stdout:8/389: truncate d1/d4/f12 6568750 0 2024-09-13T18:30:34.405 INFO:tasks.workunit.client.0.smithi038.stdout:8/390: symlink d1/d2a/d5b/l84 0 2024-09-13T18:30:34.407 INFO:tasks.workunit.client.0.smithi038.stdout:0/364: dwrite d2/f1c [0,4194304] 0 2024-09-13T18:30:34.407 INFO:tasks.workunit.client.0.smithi038.stdout:0/365: truncate d2/d7/d24/d3c/f56 4984567 0 2024-09-13T18:30:34.408 INFO:tasks.workunit.client.0.smithi038.stdout:0/366: rmdir d2/d2f 39 2024-09-13T18:30:34.408 INFO:tasks.workunit.client.0.smithi038.stdout:0/367: read - d2/d7/d55/f73 zero size 2024-09-13T18:30:34.408 INFO:tasks.workunit.client.0.smithi038.stdout:0/368: write d2/d7/d55/f68 [990716,9615] 0 2024-09-13T18:30:34.423 INFO:tasks.workunit.client.0.smithi038.stdout:8/391: dwrite d1/de/d21/d24/d4d/d50/d62/d71/f82 [4194304,4194304] 0 2024-09-13T18:30:34.423 INFO:tasks.workunit.client.0.smithi038.stdout:8/392: creat d1/de/d21/f85 x:0 0 0 2024-09-13T18:30:34.428 INFO:tasks.workunit.client.0.smithi038.stdout:8/393: unlink d1/d2a/d3f/c7f 0 2024-09-13T18:30:34.428 INFO:tasks.workunit.client.0.smithi038.stdout:8/394: fsync d1/d2a/f2e 0 2024-09-13T18:30:34.428 INFO:tasks.workunit.client.0.smithi038.stdout:8/395: rmdir d1/de/d21/d24/d56/d5e 39 2024-09-13T18:30:34.437 INFO:tasks.workunit.client.0.smithi038.stdout:8/396: read d1/d8/f2b [7103480,108852] 0 2024-09-13T18:30:34.441 INFO:tasks.workunit.client.0.smithi038.stdout:8/397: getdents d1/de/d21/d24 0 2024-09-13T18:30:34.461 INFO:tasks.workunit.client.0.smithi038.stdout:8/398: dwrite d1/de/d21/f85 [0,4194304] 0 2024-09-13T18:30:34.467 INFO:tasks.workunit.client.0.smithi038.stdout:8/399: unlink d1/de/d21/f28 0 2024-09-13T18:30:34.470 INFO:tasks.workunit.client.0.smithi038.stdout:8/400: mknod d1/de/d21/d24/d4d/d50/d62/c86 0 2024-09-13T18:30:34.470 INFO:tasks.workunit.client.0.smithi038.stdout:8/401: creat d1/de/d21/d45/d5d/f87 x:0 0 0 2024-09-13T18:30:34.470 INFO:tasks.workunit.client.0.smithi038.stdout:8/402: write d1/de/f23 [5124561,64690] 0 2024-09-13T18:30:34.470 INFO:tasks.workunit.client.0.smithi038.stdout:8/403: readlink d1/l6 0 2024-09-13T18:30:34.470 INFO:tasks.workunit.client.0.smithi038.stdout:8/404: stat d1/d8/f1f 0 2024-09-13T18:30:34.470 INFO:tasks.workunit.client.0.smithi038.stdout:8/405: chown d1/d2a/d40/c4e 2 1 2024-09-13T18:30:34.470 INFO:tasks.workunit.client.0.smithi038.stdout:8/406: creat d1/de/d21/d24/d41/f88 x:0 0 0 2024-09-13T18:30:34.483 INFO:tasks.workunit.client.0.smithi038.stdout:8/407: mkdir d1/de/d21/d24/d56/d89 0 2024-09-13T18:30:34.655 INFO:tasks.workunit.client.0.smithi038.stdout:1/315: sync 2024-09-13T18:30:34.656 INFO:tasks.workunit.client.0.smithi038.stdout:9/344: sync 2024-09-13T18:30:34.657 INFO:tasks.workunit.client.0.smithi038.stdout:1/316: mkdir d12/d2a/d32/d59/d5e 0 2024-09-13T18:30:34.663 INFO:tasks.workunit.client.0.smithi038.stdout:9/345: dread d0/f1 [0,4194304] 0 2024-09-13T18:30:34.686 INFO:tasks.workunit.client.0.smithi038.stdout:1/317: dwrite d12/d2a/d32/f36 [0,4194304] 0 2024-09-13T18:30:34.686 INFO:tasks.workunit.client.0.smithi038.stdout:1/318: fsync d12/d2a/d32/d59/d5b/f41 0 2024-09-13T18:30:34.686 INFO:tasks.workunit.client.0.smithi038.stdout:1/319: read - d12/f39 zero size 2024-09-13T18:30:34.686 INFO:tasks.workunit.client.0.smithi038.stdout:1/320: chown d12/d3c/d46 29 1 2024-09-13T18:30:34.686 INFO:tasks.workunit.client.0.smithi038.stdout:1/321: write d12/d2a/d32/d59/d5b/f42 [9112938,96766] 0 2024-09-13T18:30:34.686 INFO:tasks.workunit.client.0.smithi038.stdout:1/322: fsync d12/d2a/d32/d59/d5b/f22 0 2024-09-13T18:30:34.687 INFO:tasks.workunit.client.0.smithi038.stdout:1/323: fsync d12/d2a/f51 0 2024-09-13T18:30:34.687 INFO:tasks.workunit.client.0.smithi038.stdout:9/346: dwrite d0/d7/d13/f42 [0,4194304] 0 2024-09-13T18:30:34.687 INFO:tasks.workunit.client.0.smithi038.stdout:1/324: chown d12/d2a/d32/d59/d5b/l2c 864 1 2024-09-13T18:30:34.688 INFO:tasks.workunit.client.0.smithi038.stdout:9/347: truncate d0/d7/d13/f19 1241530 0 2024-09-13T18:30:34.690 INFO:tasks.workunit.client.0.smithi038.stdout:1/325: symlink d12/d2a/d32/d59/d5b/l5f 0 2024-09-13T18:30:34.691 INFO:tasks.workunit.client.0.smithi038.stdout:1/326: dread d12/d3c/d46/f48 [0,4194304] 0 2024-09-13T18:30:34.695 INFO:tasks.workunit.client.0.smithi038.stdout:9/348: dread d0/ff [0,4194304] 0 2024-09-13T18:30:34.702 INFO:tasks.workunit.client.0.smithi038.stdout:9/349: truncate d0/d7/d13/f42 833726 0 2024-09-13T18:30:34.704 INFO:tasks.workunit.client.0.smithi038.stdout:9/350: rename d0/f11 to d0/d2e/f7c 0 2024-09-13T18:30:34.705 INFO:tasks.workunit.client.0.smithi038.stdout:9/351: stat d0/d7/d13/d2d/f39 0 2024-09-13T18:30:34.706 INFO:tasks.workunit.client.0.smithi038.stdout:1/327: dwrite d12/f13 [4194304,4194304] 0 2024-09-13T18:30:34.708 INFO:tasks.workunit.client.0.smithi038.stdout:1/328: write d12/d2a/f4d [756335,119939] 0 2024-09-13T18:30:34.708 INFO:tasks.workunit.client.0.smithi038.stdout:1/329: readlink d12/l43 0 2024-09-13T18:30:34.710 INFO:tasks.workunit.client.0.smithi038.stdout:1/330: creat d12/d2a/d32/f60 x:0 0 0 2024-09-13T18:30:34.727 INFO:tasks.workunit.client.0.smithi038.stdout:1/331: dwrite d12/f37 [0,4194304] 0 2024-09-13T18:30:34.727 INFO:tasks.workunit.client.0.smithi038.stdout:1/332: stat d12/d2a/d32/d59/d5b/f41 0 2024-09-13T18:30:34.733 INFO:tasks.workunit.client.0.smithi038.stdout:1/333: dread d12/d2a/d32/d59/d5b/f42 [4194304,4194304] 0 2024-09-13T18:30:34.733 INFO:tasks.workunit.client.0.smithi038.stdout:1/334: chown d12/d3c/f50 97176 1 2024-09-13T18:30:34.742 INFO:tasks.workunit.client.0.smithi038.stdout:1/335: write d12/f25 [224315,98803] 0 2024-09-13T18:30:34.745 INFO:tasks.workunit.client.0.smithi038.stdout:1/336: creat d12/d2a/d32/d59/d5e/f61 x:0 0 0 2024-09-13T18:30:34.747 INFO:tasks.workunit.client.0.smithi038.stdout:1/337: symlink d12/d2a/d32/d59/d5e/l62 0 2024-09-13T18:30:34.747 INFO:tasks.workunit.client.0.smithi038.stdout:1/338: fdatasync d12/f1a 0 2024-09-13T18:30:34.747 INFO:tasks.workunit.client.0.smithi038.stdout:1/339: creat d12/d3c/f63 x:0 0 0 2024-09-13T18:30:34.747 INFO:tasks.workunit.client.0.smithi038.stdout:1/340: fdatasync d12/f16 0 2024-09-13T18:30:34.749 INFO:tasks.workunit.client.0.smithi038.stdout:1/341: link d12/d2a/d32/d59/d5b/f20 d12/d2a/f64 0 2024-09-13T18:30:34.749 INFO:tasks.workunit.client.0.smithi038.stdout:1/342: dread - d12/d3c/f50 zero size 2024-09-13T18:30:34.749 INFO:tasks.workunit.client.0.smithi038.stdout:1/343: dread - d12/d2a/d32/d59/d5e/f61 zero size 2024-09-13T18:30:34.749 INFO:tasks.workunit.client.0.smithi038.stdout:1/344: mkdir d12/d3c/d65 0 2024-09-13T18:30:34.751 INFO:tasks.workunit.client.0.smithi038.stdout:1/345: symlink d12/d2a/d32/d59/l66 0 2024-09-13T18:30:34.769 INFO:tasks.workunit.client.0.smithi038.stdout:1/346: dwrite d12/d2a/d32/d59/d5b/f41 [0,4194304] 0 2024-09-13T18:30:34.769 INFO:tasks.workunit.client.0.smithi038.stdout:1/347: write d12/d2a/d32/f60 [526911,114516] 0 2024-09-13T18:30:34.773 INFO:tasks.workunit.client.0.smithi038.stdout:1/348: creat d12/d3c/d46/f67 x:0 0 0 2024-09-13T18:30:34.774 INFO:tasks.workunit.client.0.smithi038.stdout:1/349: creat d12/d3c/d46/d57/f68 x:0 0 0 2024-09-13T18:30:34.775 INFO:tasks.workunit.client.0.smithi038.stdout:1/350: symlink d12/d2a/d32/d59/d5b/l69 0 2024-09-13T18:30:34.777 INFO:tasks.workunit.client.0.smithi038.stdout:1/351: unlink d12/d2a/d32/d59/d5b/l69 0 2024-09-13T18:30:34.788 INFO:tasks.workunit.client.0.smithi038.stdout:1/352: write d12/f3e [1206347,74633] 0 2024-09-13T18:30:34.805 INFO:tasks.workunit.client.0.smithi038.stdout:1/353: dwrite fb [0,4194304] 0 2024-09-13T18:30:34.806 INFO:tasks.workunit.client.0.smithi038.stdout:1/354: creat d12/d2a/d32/d59/f6a x:0 0 0 2024-09-13T18:30:34.807 INFO:tasks.workunit.client.0.smithi038.stdout:1/355: creat d12/f6b x:0 0 0 2024-09-13T18:30:34.809 INFO:tasks.workunit.client.0.smithi038.stdout:1/356: fdatasync d12/d2a/f4d 0 2024-09-13T18:30:34.830 INFO:tasks.workunit.client.0.smithi038.stdout:1/357: dwrite d12/f6b [0,4194304] 0 2024-09-13T18:30:34.830 INFO:tasks.workunit.client.0.smithi038.stdout:1/358: chown d12/d2a/d32/c3a 1 1 2024-09-13T18:30:34.839 INFO:tasks.workunit.client.0.smithi038.stdout:1/359: getdents d12/d3c 0 2024-09-13T18:30:34.839 INFO:tasks.workunit.client.0.smithi038.stdout:1/360: write d12/f25 [5090805,112940] 0 2024-09-13T18:30:34.855 INFO:tasks.workunit.client.0.smithi038.stdout:7/306: sync 2024-09-13T18:30:34.855 INFO:tasks.workunit.client.0.smithi038.stdout:7/307: creat db/d12/d1c/d3a/d22/d28/f6f x:0 0 0 2024-09-13T18:30:34.858 INFO:tasks.workunit.client.0.smithi038.stdout:7/308: dread db/d12/d13/f54 [0,4194304] 0 2024-09-13T18:30:34.858 INFO:tasks.workunit.client.0.smithi038.stdout:7/309: write db/d12/d1c/f5e [24193,46583] 0 2024-09-13T18:30:34.860 INFO:tasks.workunit.client.0.smithi038.stdout:7/310: dread db/d12/d13/f54 [0,4194304] 0 2024-09-13T18:30:34.860 INFO:tasks.workunit.client.0.smithi038.stdout:1/361: dwrite d12/d3c/f40 [0,4194304] 0 2024-09-13T18:30:34.861 INFO:tasks.workunit.client.0.smithi038.stdout:1/362: dread - d12/d2a/d32/d59/d5b/d47/f56 zero size 2024-09-13T18:30:34.861 INFO:tasks.workunit.client.0.smithi038.stdout:1/363: stat d12/f37 0 2024-09-13T18:30:34.862 INFO:tasks.workunit.client.0.smithi038.stdout:7/311: rename db/d12/d1c/d3a/d22/l58 to db/d12/d1c/d3a/d3c/d52/d51/l70 0 2024-09-13T18:30:34.865 INFO:tasks.workunit.client.0.smithi038.stdout:1/364: truncate f10 2238857 0 2024-09-13T18:30:34.865 INFO:tasks.workunit.client.0.smithi038.stdout:1/365: chown d12/d2a/d32/f34 19 1 2024-09-13T18:30:34.865 INFO:tasks.workunit.client.0.smithi038.stdout:1/366: readlink d12/d2a/d32/d59/d5b/l5f 0 2024-09-13T18:30:34.866 INFO:tasks.workunit.client.0.smithi038.stdout:7/312: symlink db/d12/d1c/d3a/d3c/d52/l71 0 2024-09-13T18:30:34.867 INFO:tasks.workunit.client.0.smithi038.stdout:7/313: mknod db/d12/d1c/d3a/d3c/d52/c72 0 2024-09-13T18:30:34.868 INFO:tasks.workunit.client.0.smithi038.stdout:7/314: symlink db/d12/d1c/d3a/l73 0 2024-09-13T18:30:34.869 INFO:tasks.workunit.client.0.smithi038.stdout:7/315: link db/d12/d1c/d3a/d4b/f65 db/d12/d1c/d3a/d3c/f74 0 2024-09-13T18:30:34.870 INFO:tasks.workunit.client.0.smithi038.stdout:1/367: read d12/d2a/d32/d59/d5b/f42 [5985764,93285] 0 2024-09-13T18:30:34.871 INFO:tasks.workunit.client.0.smithi038.stdout:7/316: rename db/d12/d1c/f20 to db/d21/f75 0 2024-09-13T18:30:34.873 INFO:tasks.workunit.client.0.smithi038.stdout:1/368: truncate d12/f37 1241621 0 2024-09-13T18:30:34.874 INFO:tasks.workunit.client.0.smithi038.stdout:7/317: truncate db/fe 3597445 0 2024-09-13T18:30:34.874 INFO:tasks.workunit.client.0.smithi038.stdout:7/318: rename db/d12/d1c/d3a/d26/d41 to db/d12/d1c/d3a/d26/d41/d76 22 2024-09-13T18:30:34.874 INFO:tasks.workunit.client.0.smithi038.stdout:7/319: dread - db/d12/d1c/d3a/d4b/f65 zero size 2024-09-13T18:30:34.875 INFO:tasks.workunit.client.0.smithi038.stdout:7/320: creat db/d12/d1c/d3a/d4b/f77 x:0 0 0 2024-09-13T18:30:34.875 INFO:tasks.workunit.client.0.smithi038.stdout:7/321: dread - db/d12/d1c/d3a/d4b/f77 zero size 2024-09-13T18:30:34.877 INFO:tasks.workunit.client.0.smithi038.stdout:1/369: rmdir d12/d3c/d65 0 2024-09-13T18:30:34.880 INFO:tasks.workunit.client.0.smithi038.stdout:7/322: mknod db/d12/d1c/d3a/d4b/c78 0 2024-09-13T18:30:34.885 INFO:tasks.workunit.client.0.smithi038.stdout:1/370: getdents d12 0 2024-09-13T18:30:34.885 INFO:tasks.workunit.client.0.smithi038.stdout:1/371: fsync d12/f54 0 2024-09-13T18:30:34.887 INFO:tasks.workunit.client.0.smithi038.stdout:7/323: getdents db/d12/d1c 0 2024-09-13T18:30:34.888 INFO:tasks.workunit.client.0.smithi038.stdout:1/372: mknod d12/d2a/c6c 0 2024-09-13T18:30:34.893 INFO:tasks.workunit.client.0.smithi038.stdout:1/373: dread d12/d3c/d46/f48 [0,4194304] 0 2024-09-13T18:30:34.905 INFO:tasks.workunit.client.0.smithi038.stdout:7/324: dwrite db/d12/d1c/d3a/d26/d41/f5d [0,4194304] 0 2024-09-13T18:30:34.909 INFO:tasks.workunit.client.0.smithi038.stdout:7/325: rename db/d12/d1c/d3a/d22/f38 to db/d12/d1c/f79 0 2024-09-13T18:30:34.911 INFO:tasks.workunit.client.0.smithi038.stdout:7/326: creat db/d12/d1c/d3a/d26/f7a x:0 0 0 2024-09-13T18:30:34.912 INFO:tasks.workunit.client.0.smithi038.stdout:1/374: dwrite d12/d2a/d32/d59/d5b/f20 [0,4194304] 0 2024-09-13T18:30:34.912 INFO:tasks.workunit.client.0.smithi038.stdout:7/327: creat db/d12/f7b x:0 0 0 2024-09-13T18:30:34.917 INFO:tasks.workunit.client.0.smithi038.stdout:7/328: write db/fe [134595,102315] 0 2024-09-13T18:30:34.920 INFO:tasks.workunit.client.0.smithi038.stdout:1/375: rename d12/d3c/d46/d57/f68 to d12/d2a/d32/d59/d5e/f6d 0 2024-09-13T18:30:34.920 INFO:tasks.workunit.client.0.smithi038.stdout:1/376: creat d12/d3c/d46/d57/f6e x:0 0 0 2024-09-13T18:30:34.921 INFO:tasks.workunit.client.0.smithi038.stdout:7/329: truncate db/d12/d1c/d3a/d22/f23 2102267 0 2024-09-13T18:30:34.923 INFO:tasks.workunit.client.0.smithi038.stdout:7/330: fsync db/d12/f7b 0 2024-09-13T18:30:34.923 INFO:tasks.workunit.client.0.smithi038.stdout:7/331: readlink db/d12/d1c/d3a/d3c/d52/l3b 0 2024-09-13T18:30:34.927 INFO:tasks.workunit.client.0.smithi038.stdout:7/332: mknod db/d12/d1c/d3a/d3c/d52/c7c 0 2024-09-13T18:30:34.927 INFO:tasks.workunit.client.0.smithi038.stdout:7/333: creat db/d12/d1c/d3a/d22/f7d x:0 0 0 2024-09-13T18:30:34.928 INFO:tasks.workunit.client.0.smithi038.stdout:7/334: read - db/d12/d1c/d3a/d3c/f74 zero size 2024-09-13T18:30:34.929 INFO:tasks.workunit.client.0.smithi038.stdout:1/377: getdents d12/d2a/d32/d59/d5b 0 2024-09-13T18:30:34.934 INFO:tasks.workunit.client.0.smithi038.stdout:1/378: creat d12/d2a/f6f x:0 0 0 2024-09-13T18:30:34.935 INFO:tasks.workunit.client.0.smithi038.stdout:7/335: dread db/d12/d1c/d3a/f1d [0,4194304] 0 2024-09-13T18:30:34.937 INFO:tasks.workunit.client.0.smithi038.stdout:7/336: mknod db/d21/c7e 0 2024-09-13T18:30:34.939 INFO:tasks.workunit.client.0.smithi038.stdout:7/337: creat db/d12/d1c/d3a/f7f x:0 0 0 2024-09-13T18:30:34.942 INFO:tasks.workunit.client.0.smithi038.stdout:7/338: rename db/d12/l2f to db/d12/d13/l80 0 2024-09-13T18:30:34.942 INFO:tasks.workunit.client.0.smithi038.stdout:7/339: rename db/d12/d1c/d3a/d3c to db/d12/d1c/d3a/d3c/d52/d51/d81 22 2024-09-13T18:30:34.944 INFO:tasks.workunit.client.0.smithi038.stdout:7/340: creat db/d12/d1c/d3a/d3c/d52/d51/f82 x:0 0 0 2024-09-13T18:30:34.947 INFO:tasks.workunit.client.0.smithi038.stdout:7/341: link db/f14 db/d21/f83 0 2024-09-13T18:30:34.947 INFO:tasks.workunit.client.0.smithi038.stdout:7/342: write db/d12/d1c/d3a/d22/d28/f6e [344439,79969] 0 2024-09-13T18:30:34.956 INFO:tasks.workunit.client.0.smithi038.stdout:1/379: dwrite d12/d2a/f4c [0,4194304] 0 2024-09-13T18:30:34.956 INFO:tasks.workunit.client.0.smithi038.stdout:1/380: stat d12/d3c/d46/d57 0 2024-09-13T18:30:34.966 INFO:tasks.workunit.client.0.smithi038.stdout:7/343: rmdir db/d12/d1c/d3a 39 2024-09-13T18:30:34.970 INFO:tasks.workunit.client.0.smithi038.stdout:1/381: dwrite d12/d2a/d32/d59/f6a [0,4194304] 0 2024-09-13T18:30:34.974 INFO:tasks.workunit.client.0.smithi038.stdout:1/382: mknod d12/c70 0 2024-09-13T18:30:34.975 INFO:tasks.workunit.client.0.smithi038.stdout:1/383: creat d12/d3c/d46/d58/f71 x:0 0 0 2024-09-13T18:30:34.981 INFO:tasks.workunit.client.0.smithi038.stdout:7/344: dwrite db/d12/d1c/d3a/d3c/f40 [0,4194304] 0 2024-09-13T18:30:34.981 INFO:tasks.workunit.client.0.smithi038.stdout:7/345: readlink db/d12/l27 0 2024-09-13T18:30:34.984 INFO:tasks.workunit.client.0.smithi038.stdout:1/384: dread f10 [0,4194304] 0 2024-09-13T18:30:34.986 INFO:tasks.workunit.client.0.smithi038.stdout:1/385: mkdir d12/d2a/d72 0 2024-09-13T18:30:34.989 INFO:tasks.workunit.client.0.smithi038.stdout:7/346: write db/d12/f18 [2707208,8124] 0 2024-09-13T18:30:34.989 INFO:tasks.workunit.client.0.smithi038.stdout:7/347: truncate db/d12/d1c/d3a/d3c/d52/d51/f82 175424 0 2024-09-13T18:30:35.020 INFO:tasks.workunit.client.0.smithi038.stdout:7/348: dwrite db/d12/d1c/d3a/d4b/f77 [0,4194304] 0 2024-09-13T18:30:35.021 INFO:tasks.workunit.client.0.smithi038.stdout:1/386: dwrite d12/d2a/d32/d59/d5e/f61 [0,4194304] 0 2024-09-13T18:30:35.027 INFO:tasks.workunit.client.0.smithi038.stdout:1/387: mknod d12/d2a/d32/d59/c73 0 2024-09-13T18:30:35.029 INFO:tasks.workunit.client.0.smithi038.stdout:1/388: unlink d12/f54 0 2024-09-13T18:30:35.029 INFO:tasks.workunit.client.0.smithi038.stdout:1/389: fdatasync d12/d2a/d32/d59/d5b/f42 0 2024-09-13T18:30:35.029 INFO:tasks.workunit.client.0.smithi038.stdout:1/390: link d12/c70 d12/d2a/d32/d59/d5b/c74 0 2024-09-13T18:30:35.030 INFO:tasks.workunit.client.0.smithi038.stdout:1/391: link d12/d2a/d32/d59/d5b/l2c d12/d2a/d32/d59/d5e/l75 0 2024-09-13T18:30:35.031 INFO:tasks.workunit.client.0.smithi038.stdout:1/392: symlink d12/d2a/d32/d59/d5b/d47/l76 0 2024-09-13T18:30:35.031 INFO:tasks.workunit.client.0.smithi038.stdout:1/393: chown d12/d2a/f4c 11 1 2024-09-13T18:30:35.032 INFO:tasks.workunit.client.0.smithi038.stdout:1/394: truncate d12/f3e 429429 0 2024-09-13T18:30:35.033 INFO:tasks.workunit.client.0.smithi038.stdout:1/395: fsync d12/d2a/d32/f34 0 2024-09-13T18:30:35.033 INFO:tasks.workunit.client.0.smithi038.stdout:1/396: chown d12/d2a/d32/d59/d5e/l75 992869 1 2024-09-13T18:30:35.033 INFO:tasks.workunit.client.0.smithi038.stdout:1/397: write d12/d2a/d32/d59/d5b/f22 [4341213,123379] 0 2024-09-13T18:30:35.033 INFO:tasks.workunit.client.0.smithi038.stdout:1/398: chown d12/d2a/d32/d59/d5e 31 1 2024-09-13T18:30:35.033 INFO:tasks.workunit.client.0.smithi038.stdout:1/399: write d12/d2a/f64 [4765616,59264] 0 2024-09-13T18:30:35.033 INFO:tasks.workunit.client.0.smithi038.stdout:1/400: fsync d12/d2a/f4c 0 2024-09-13T18:30:35.034 INFO:tasks.workunit.client.0.smithi038.stdout:1/401: mknod d12/d2a/d32/c77 0 2024-09-13T18:30:35.034 INFO:tasks.workunit.client.0.smithi038.stdout:1/402: symlink d12/d2a/d32/d59/l78 0 2024-09-13T18:30:35.046 INFO:tasks.workunit.client.0.smithi038.stdout:7/349: dread db/d12/d1c/f79 [4194304,4194304] 0 2024-09-13T18:30:35.054 INFO:tasks.workunit.client.0.smithi038.stdout:7/350: read db/d12/d1c/d3a/d3c/f40 [3844077,113196] 0 2024-09-13T18:30:35.054 INFO:tasks.workunit.client.0.smithi038.stdout:1/403: dwrite f10 [0,4194304] 0 2024-09-13T18:30:35.054 INFO:tasks.workunit.client.0.smithi038.stdout:1/404: creat d12/d3c/d46/d58/f79 x:0 0 0 2024-09-13T18:30:35.068 INFO:tasks.workunit.client.0.smithi038.stdout:1/405: dwrite d12/d2a/f51 [4194304,4194304] 0 2024-09-13T18:30:35.085 INFO:tasks.workunit.client.0.smithi038.stdout:1/406: dwrite d12/d2a/d32/d59/d5b/f42 [8388608,4194304] 0 2024-09-13T18:30:35.204 INFO:tasks.workunit.client.0.smithi038.stdout:1/407: mkdir d12/d7a 0 2024-09-13T18:30:35.217 INFO:tasks.workunit.client.0.smithi038.stdout:1/408: getdents d12/d2a/d32 0 2024-09-13T18:30:35.218 INFO:tasks.workunit.client.0.smithi038.stdout:1/409: creat d12/d2a/d32/d59/f7b x:0 0 0 2024-09-13T18:30:35.235 INFO:tasks.workunit.client.0.smithi038.stdout:1/410: dwrite d12/f23 [0,4194304] 0 2024-09-13T18:30:35.235 INFO:tasks.workunit.client.0.smithi038.stdout:1/411: creat d12/d3c/d46/f7c x:0 0 0 2024-09-13T18:30:35.243 INFO:tasks.workunit.client.0.smithi038.stdout:1/412: dread fb [0,4194304] 0 2024-09-13T18:30:35.248 INFO:tasks.workunit.client.0.smithi038.stdout:1/413: rename fe to d12/f7d 0 2024-09-13T18:30:35.248 INFO:tasks.workunit.client.0.smithi038.stdout:1/414: write d12/d2a/d32/d59/d5b/f26 [115556,83822] 0 2024-09-13T18:30:35.268 INFO:tasks.workunit.client.0.smithi038.stdout:1/415: dwrite d12/f16 [0,4194304] 0 2024-09-13T18:30:35.269 INFO:tasks.workunit.client.0.smithi038.stdout:1/416: rmdir d12/d2a/d32/d59/d5b/d47 39 2024-09-13T18:30:35.291 INFO:tasks.workunit.client.0.smithi038.stdout:1/417: dwrite d12/d2a/d32/f36 [0,4194304] 0 2024-09-13T18:30:35.293 INFO:tasks.workunit.client.0.smithi038.stdout:1/418: creat d12/d2a/d32/d59/d5b/f7e x:0 0 0 2024-09-13T18:30:35.294 INFO:tasks.workunit.client.0.smithi038.stdout:1/419: mknod d12/d2a/d32/d59/d5b/d47/c7f 0 2024-09-13T18:30:35.297 INFO:tasks.workunit.client.0.smithi038.stdout:1/420: rename d12/d2a/d32/f34 to d12/d2a/d32/d59/d5b/d47/f80 0 2024-09-13T18:30:35.298 INFO:tasks.workunit.client.0.smithi038.stdout:1/421: symlink d12/d3c/d46/d58/l81 0 2024-09-13T18:30:35.298 INFO:tasks.workunit.client.0.smithi038.stdout:1/422: write d12/d3c/d46/d57/f6e [672315,92733] 0 2024-09-13T18:30:35.300 INFO:tasks.workunit.client.0.smithi038.stdout:1/423: stat d12/c70 0 2024-09-13T18:30:35.300 INFO:tasks.workunit.client.0.smithi038.stdout:1/424: readlink d12/d2a/d32/d59/d5b/l27 0 2024-09-13T18:30:35.300 INFO:tasks.workunit.client.0.smithi038.stdout:1/425: chown d12/d3c/d46/d58/l81 1532166667 1 2024-09-13T18:30:35.356 INFO:tasks.workunit.client.0.smithi038.stdout:4/532: sync 2024-09-13T18:30:35.358 INFO:tasks.workunit.client.0.smithi038.stdout:4/533: creat d2/d49/d50/da0/fad x:0 0 0 2024-09-13T18:30:35.362 INFO:tasks.workunit.client.0.smithi038.stdout:4/534: creat d2/d49/d50/da0/d8/d80/fae x:0 0 0 2024-09-13T18:30:35.365 INFO:tasks.workunit.client.0.smithi038.stdout:4/535: creat d2/df/faf x:0 0 0 2024-09-13T18:30:35.365 INFO:tasks.workunit.client.0.smithi038.stdout:4/536: truncate d2/df/d1b/d10/d71/f81 88800 0 2024-09-13T18:30:35.368 INFO:tasks.workunit.client.0.smithi038.stdout:4/537: mknod d2/df/d1b/d10/d71/cb0 0 2024-09-13T18:30:35.374 INFO:tasks.workunit.client.0.smithi038.stdout:4/538: dread d2/df/d22/f70 [0,4194304] 0 2024-09-13T18:30:35.374 INFO:tasks.workunit.client.0.smithi038.stdout:4/539: write d2/df/d1b/d10/d75/f7b [1000312,11549] 0 2024-09-13T18:30:35.374 INFO:tasks.workunit.client.0.smithi038.stdout:4/540: fsync d2/d49/d50/da0/d8/f6c 0 2024-09-13T18:30:35.398 INFO:tasks.workunit.client.0.smithi038.stdout:4/541: dwrite d2/f19 [0,4194304] 0 2024-09-13T18:30:35.400 INFO:tasks.workunit.client.0.smithi038.stdout:4/542: mkdir d2/df/d1b/d10/d75/db1 0 2024-09-13T18:30:35.403 INFO:tasks.workunit.client.0.smithi038.stdout:4/543: rename d2/df/d1b/d10/d71/cb0 to d2/d49/d50/da0/cb2 0 2024-09-13T18:30:35.412 INFO:tasks.workunit.client.0.smithi038.stdout:4/544: rename d2/d49/d50/da0/cb2 to d2/d49/d50/cb3 0 2024-09-13T18:30:35.415 INFO:tasks.workunit.client.0.smithi038.stdout:4/545: link d2/df/c28 d2/d49/d50/cb4 0 2024-09-13T18:30:35.417 INFO:tasks.workunit.client.0.smithi038.stdout:4/546: unlink d2/d49/d50/c85 0 2024-09-13T18:30:35.419 INFO:tasks.workunit.client.0.smithi038.stdout:4/547: symlink d2/d49/d50/da0/d8/d3b/lb5 0 2024-09-13T18:30:35.419 INFO:tasks.workunit.client.0.smithi038.stdout:4/548: truncate d2/d49/d50/da0/f18 5540006 0 2024-09-13T18:30:35.420 INFO:tasks.workunit.client.0.smithi038.stdout:4/549: getdents d2/df/d1b/d10/d71 0 2024-09-13T18:30:35.440 INFO:tasks.workunit.client.0.smithi038.stdout:4/550: dwrite d2/df/d1b/d10/f46 [0,4194304] 0 2024-09-13T18:30:35.441 INFO:tasks.workunit.client.0.smithi038.stdout:4/551: rmdir d2/df/d1b/d10/da3 39 2024-09-13T18:30:35.443 INFO:tasks.workunit.client.0.smithi038.stdout:4/552: rename d2/df/d1b/c4a to d2/df/d1b/d10/d55/cb6 0 2024-09-13T18:30:35.443 INFO:tasks.workunit.client.0.smithi038.stdout:4/553: truncate d2/df/d1b/d10/f88 742539 0 2024-09-13T18:30:35.460 INFO:tasks.workunit.client.0.smithi038.stdout:4/554: dwrite d2/df/d1b/d10/d75/f8f [0,4194304] 0 2024-09-13T18:30:35.460 INFO:tasks.workunit.client.0.smithi038.stdout:4/555: write d2/df/d1b/f51 [2002283,30162] 0 2024-09-13T18:30:35.463 INFO:tasks.workunit.client.0.smithi038.stdout:4/556: rmdir d2/df/d1b/d10/d75/d82 39 2024-09-13T18:30:35.463 INFO:tasks.workunit.client.0.smithi038.stdout:4/557: readlink d2/l26 0 2024-09-13T18:30:35.465 INFO:tasks.workunit.client.0.smithi038.stdout:4/558: rmdir d2/df/d1b/d10/d71/d96 0 2024-09-13T18:30:35.465 INFO:tasks.workunit.client.0.smithi038.stdout:4/559: fdatasync d2/df/d1b/d10/da3/f7e 0 2024-09-13T18:30:35.465 INFO:tasks.workunit.client.0.smithi038.stdout:4/560: readlink d2/df/d22/l48 0 2024-09-13T18:30:35.466 INFO:tasks.workunit.client.0.smithi038.stdout:4/561: rename d2/df/c28 to d2/df/d1b/d10/d75/d82/cb7 0 2024-09-13T18:30:35.466 INFO:tasks.workunit.client.0.smithi038.stdout:4/562: chown d2/df/d1b/d10/d75/f9f 176915 1 2024-09-13T18:30:35.466 INFO:tasks.workunit.client.0.smithi038.stdout:4/563: write d2/df/d1b/d10/f88 [1558277,105759] 0 2024-09-13T18:30:35.466 INFO:tasks.workunit.client.0.smithi038.stdout:4/564: fsync d2/d49/d50/da0/f44 0 2024-09-13T18:30:35.467 INFO:tasks.workunit.client.0.smithi038.stdout:4/565: getdents d2/d49/d50/da0/d8 0 2024-09-13T18:30:35.468 INFO:tasks.workunit.client.0.smithi038.stdout:4/566: mknod d2/cb8 0 2024-09-13T18:30:35.469 INFO:tasks.workunit.client.0.smithi038.stdout:4/567: truncate d2/f58 513915 0 2024-09-13T18:30:35.469 INFO:tasks.workunit.client.0.smithi038.stdout:4/568: dread - d2/df/faf zero size 2024-09-13T18:30:35.471 INFO:tasks.workunit.client.0.smithi038.stdout:4/569: dread d2/df/d1b/d10/d71/f92 [0,4194304] 0 2024-09-13T18:30:35.477 INFO:tasks.workunit.client.0.smithi038.stdout:4/570: truncate d2/df/d1b/d10/f25 1309445 0 2024-09-13T18:30:35.480 INFO:tasks.workunit.client.0.smithi038.stdout:4/571: creat d2/d49/d50/da0/d8/d3b/fb9 x:0 0 0 2024-09-13T18:30:35.480 INFO:tasks.workunit.client.0.smithi038.stdout:4/572: truncate d2/df/fa6 322599 0 2024-09-13T18:30:35.483 INFO:tasks.workunit.client.0.smithi038.stdout:4/573: mknod d2/d49/d50/da0/d8/d3b/cba 0 2024-09-13T18:30:35.483 INFO:tasks.workunit.client.0.smithi038.stdout:3/295: sync 2024-09-13T18:30:35.483 INFO:tasks.workunit.client.0.smithi038.stdout:5/293: sync 2024-09-13T18:30:35.488 INFO:tasks.workunit.client.0.smithi038.stdout:5/294: rename f2 to df/d13/d3b/d3e/f5a 0 2024-09-13T18:30:35.489 INFO:tasks.workunit.client.0.smithi038.stdout:3/296: symlink d0/dd/d17/d50/d51/l5b 0 2024-09-13T18:30:35.490 INFO:tasks.workunit.client.0.smithi038.stdout:3/297: truncate d0/dd/d17/d50/d51/f58 425993 0 2024-09-13T18:30:35.492 INFO:tasks.workunit.client.0.smithi038.stdout:5/295: rmdir df/d13/d3b/d44 39 2024-09-13T18:30:35.493 INFO:tasks.workunit.client.0.smithi038.stdout:3/298: chown d0/dd/l1b 20893641 1 2024-09-13T18:30:35.493 INFO:tasks.workunit.client.0.smithi038.stdout:3/299: fdatasync d0/dd/d19/d1d/d29/d2b/f4d 0 2024-09-13T18:30:35.493 INFO:tasks.workunit.client.0.smithi038.stdout:3/300: readlink d0/dd/d17/d50/d51/l5b 0 2024-09-13T18:30:35.494 INFO:tasks.workunit.client.0.smithi038.stdout:5/296: truncate df/f2a 196723 0 2024-09-13T18:30:35.496 INFO:tasks.workunit.client.0.smithi038.stdout:3/301: truncate d0/dd/d19/d1d/d29/d32/f35 1064315 0 2024-09-13T18:30:35.496 INFO:tasks.workunit.client.0.smithi038.stdout:3/302: chown d0/dd/d17/d43/c4c 121 1 2024-09-13T18:30:35.497 INFO:tasks.workunit.client.0.smithi038.stdout:5/297: rename df/d13/f21 to df/d13/d3b/d44/d48/d56/f5b 0 2024-09-13T18:30:35.500 INFO:tasks.workunit.client.0.smithi038.stdout:5/298: mknod df/d13/d3b/d44/d48/d56/c5c 0 2024-09-13T18:30:35.503 INFO:tasks.workunit.client.0.smithi038.stdout:4/574: dwrite d2/df/d1b/d10/f7c [0,4194304] 0 2024-09-13T18:30:35.518 INFO:tasks.workunit.client.0.smithi038.stdout:4/575: rename d2/f19 to d2/d49/d4b/d8e/fbb 0 2024-09-13T18:30:35.520 INFO:tasks.workunit.client.0.smithi038.stdout:9/352: sync 2024-09-13T18:30:35.521 INFO:tasks.workunit.client.0.smithi038.stdout:2/311: sync 2024-09-13T18:30:35.521 INFO:tasks.workunit.client.0.smithi038.stdout:6/378: sync 2024-09-13T18:30:35.521 INFO:tasks.workunit.client.0.smithi038.stdout:8/408: sync 2024-09-13T18:30:35.521 INFO:tasks.workunit.client.0.smithi038.stdout:6/379: readlink dd/de/d2e/d30/l40 0 2024-09-13T18:30:35.521 INFO:tasks.workunit.client.0.smithi038.stdout:4/576: mkdir d2/d49/d4b/dbc 0 2024-09-13T18:30:35.524 INFO:tasks.workunit.client.0.smithi038.stdout:8/409: symlink d1/de/l8a 0 2024-09-13T18:30:35.524 INFO:tasks.workunit.client.0.smithi038.stdout:8/410: write d1/de/d21/d45/f81 [459486,129229] 0 2024-09-13T18:30:35.524 INFO:tasks.workunit.client.0.smithi038.stdout:8/411: stat d1/de/d15/f1c 0 2024-09-13T18:30:35.525 INFO:tasks.workunit.client.0.smithi038.stdout:6/380: mkdir dd/de/d2e/d30/d90 0 2024-09-13T18:30:35.527 INFO:tasks.workunit.client.0.smithi038.stdout:4/577: symlink d2/d49/d50/lbd 0 2024-09-13T18:30:35.527 INFO:tasks.workunit.client.0.smithi038.stdout:4/578: dread - d2/df/d22/f65 zero size 2024-09-13T18:30:35.530 INFO:tasks.workunit.client.0.smithi038.stdout:9/353: link d0/d7/d2c/d33/l51 d0/l7d 0 2024-09-13T18:30:35.530 INFO:tasks.workunit.client.0.smithi038.stdout:9/354: readlink d0/l7d 0 2024-09-13T18:30:35.532 INFO:tasks.workunit.client.0.smithi038.stdout:6/381: unlink dd/de/d31/f7a 0 2024-09-13T18:30:35.533 INFO:tasks.workunit.client.0.smithi038.stdout:4/579: creat d2/fbe x:0 0 0 2024-09-13T18:30:35.543 INFO:tasks.workunit.client.0.smithi038.stdout:5/299: dwrite df/f1e [4194304,4194304] 0 2024-09-13T18:30:35.544 INFO:tasks.workunit.client.0.smithi038.stdout:2/312: dwrite d2/f11 [0,4194304] 0 2024-09-13T18:30:35.544 INFO:tasks.workunit.client.0.smithi038.stdout:8/412: dwrite d1/de/d3a/f77 [0,4194304] 0 2024-09-13T18:30:35.544 INFO:tasks.workunit.client.0.smithi038.stdout:8/413: write d1/de/d21/d24/d41/f88 [334076,70295] 0 2024-09-13T18:30:35.544 INFO:tasks.workunit.client.0.smithi038.stdout:8/414: chown d1/d2a/d3f/f7e 300730631 1 2024-09-13T18:30:35.544 INFO:tasks.workunit.client.0.smithi038.stdout:3/303: dwrite d0/dd/d17/f1c [4194304,4194304] 0 2024-09-13T18:30:35.544 INFO:tasks.workunit.client.0.smithi038.stdout:3/304: truncate d0/dd/f2a 4550524 0 2024-09-13T18:30:35.545 INFO:tasks.workunit.client.0.smithi038.stdout:9/355: dread d0/d7/d13/d2d/d3c/f5b [0,4194304] 0 2024-09-13T18:30:35.545 INFO:tasks.workunit.client.0.smithi038.stdout:9/356: write d0/d7/d13/d2d/d3c/d50/f65 [609775,115869] 0 2024-09-13T18:30:35.545 INFO:tasks.workunit.client.0.smithi038.stdout:4/580: dread d2/d49/d50/da0/f1e [0,4194304] 0 2024-09-13T18:30:35.548 INFO:tasks.workunit.client.0.smithi038.stdout:6/382: dwrite dd/de/d2e/d30/d27/f2d [0,4194304] 0 2024-09-13T18:30:35.550 INFO:tasks.workunit.client.0.smithi038.stdout:8/415: symlink d1/de/d21/d24/d41/d7d/l8b 0 2024-09-13T18:30:35.550 INFO:tasks.workunit.client.0.smithi038.stdout:8/416: write d1/de/f33 [834134,78362] 0 2024-09-13T18:30:35.550 INFO:tasks.workunit.client.0.smithi038.stdout:8/417: read d1/d4/f12 [1703880,9558] 0 2024-09-13T18:30:35.553 INFO:tasks.workunit.client.0.smithi038.stdout:5/300: dread df/d15/f39 [0,4194304] 0 2024-09-13T18:30:35.554 INFO:tasks.workunit.client.0.smithi038.stdout:9/357: mknod d0/d7/d2c/d5a/d69/c7e 0 2024-09-13T18:30:35.555 INFO:tasks.workunit.client.0.smithi038.stdout:5/301: dread df/d13/f34 [0,4194304] 0 2024-09-13T18:30:35.558 INFO:tasks.workunit.client.0.smithi038.stdout:5/302: dread df/d15/f3d [0,4194304] 0 2024-09-13T18:30:35.559 INFO:tasks.workunit.client.0.smithi038.stdout:6/383: symlink dd/de/d2e/d2f/d4c/l91 0 2024-09-13T18:30:35.563 INFO:tasks.workunit.client.0.smithi038.stdout:3/305: rename d0/dd/d19 to d0/dd/d17/d50/d5c 0 2024-09-13T18:30:35.565 INFO:tasks.workunit.client.0.smithi038.stdout:2/313: dwrite d2/d1e/d44/d50/f31 [0,4194304] 0 2024-09-13T18:30:35.566 INFO:tasks.workunit.client.0.smithi038.stdout:4/581: rename d2/l9d to d2/d49/d50/lbf 0 2024-09-13T18:30:35.566 INFO:tasks.workunit.client.0.smithi038.stdout:4/582: dread - d2/d49/d50/da0/d8/d3b/fb9 zero size 2024-09-13T18:30:35.567 INFO:tasks.workunit.client.0.smithi038.stdout:5/303: dread df/d15/f39 [0,4194304] 0 2024-09-13T18:30:35.570 INFO:tasks.workunit.client.0.smithi038.stdout:3/306: dread d0/dd/d17/d50/d5c/d23/f2e [0,4194304] 0 2024-09-13T18:30:35.573 INFO:tasks.workunit.client.0.smithi038.stdout:2/314: symlink d2/d1e/d44/d50/d46/d58/d59/d62/l78 0 2024-09-13T18:30:35.573 INFO:tasks.workunit.client.0.smithi038.stdout:9/358: dwrite d0/d7/d13/f19 [0,4194304] 0 2024-09-13T18:30:35.574 INFO:tasks.workunit.client.0.smithi038.stdout:5/304: unlink df/d13/d3b/d3e/f31 0 2024-09-13T18:30:35.576 INFO:tasks.workunit.client.0.smithi038.stdout:3/307: link d0/dd/d17/d50/d5c/d1d/d29/d2b/f49 d0/dd/d17/d43/f5d 0 2024-09-13T18:30:35.578 INFO:tasks.workunit.client.0.smithi038.stdout:6/384: dwrite dd/de/d2e/d2f/d4c/d55/f5e [0,4194304] 0 2024-09-13T18:30:35.579 INFO:tasks.workunit.client.0.smithi038.stdout:9/359: mkdir d0/d2e/d7f 0 2024-09-13T18:30:35.579 INFO:tasks.workunit.client.0.smithi038.stdout:9/360: chown d0/d7/d2c/d33/f4c 7566 1 2024-09-13T18:30:35.579 INFO:tasks.workunit.client.0.smithi038.stdout:9/361: fsync d0/d7/f35 0 2024-09-13T18:30:35.580 INFO:tasks.workunit.client.0.smithi038.stdout:3/308: creat d0/dd/f5e x:0 0 0 2024-09-13T18:30:35.581 INFO:tasks.workunit.client.0.smithi038.stdout:8/418: write d1/d4/f3d [649046,95044] 0 2024-09-13T18:30:35.584 INFO:tasks.workunit.client.0.smithi038.stdout:6/385: dread dd/f11 [0,4194304] 0 2024-09-13T18:30:35.590 INFO:tasks.workunit.client.0.smithi038.stdout:9/362: rename d0/d7/d13/d2d/f61 to d0/d7/d2c/d5e/f80 0 2024-09-13T18:30:35.592 INFO:tasks.workunit.client.0.smithi038.stdout:8/419: mkdir d1/de/d21/d24/d41/d8c 0 2024-09-13T18:30:35.592 INFO:tasks.workunit.client.0.smithi038.stdout:8/420: readlink d1/d2a/d5b/l84 0 2024-09-13T18:30:35.593 INFO:tasks.workunit.client.0.smithi038.stdout:9/363: dread d0/d7/d13/f5d [0,4194304] 0 2024-09-13T18:30:35.594 INFO:tasks.workunit.client.0.smithi038.stdout:5/305: dwrite df/f1e [8388608,4194304] 0 2024-09-13T18:30:35.596 INFO:tasks.workunit.client.0.smithi038.stdout:8/421: truncate d1/de/d3a/f3e 108364 0 2024-09-13T18:30:35.596 INFO:tasks.workunit.client.0.smithi038.stdout:8/422: truncate d1/d8/f1f 5548901 0 2024-09-13T18:30:35.596 INFO:tasks.workunit.client.0.smithi038.stdout:3/309: dwrite d0/dd/fe [0,4194304] 0 2024-09-13T18:30:35.596 INFO:tasks.workunit.client.0.smithi038.stdout:9/364: mknod d0/d7/d13/c81 0 2024-09-13T18:30:35.598 INFO:tasks.workunit.client.0.smithi038.stdout:5/306: symlink df/d13/d3b/d44/d58/l5d 0 2024-09-13T18:30:35.598 INFO:tasks.workunit.client.0.smithi038.stdout:6/386: dread dd/de/f1a [0,4194304] 0 2024-09-13T18:30:35.600 INFO:tasks.workunit.client.0.smithi038.stdout:3/310: dread d0/dd/d17/d50/d5c/d23/f2e [0,4194304] 0 2024-09-13T18:30:35.600 INFO:tasks.workunit.client.0.smithi038.stdout:8/423: mknod d1/de/d21/d24/d41/d7d/c8d 0 2024-09-13T18:30:35.605 INFO:tasks.workunit.client.0.smithi038.stdout:5/307: rename df/d13/d3b/d41/c57 to df/d13/d3b/d41/c5e 0 2024-09-13T18:30:35.606 INFO:tasks.workunit.client.0.smithi038.stdout:6/387: creat dd/de/d61/f92 x:0 0 0 2024-09-13T18:30:35.609 INFO:tasks.workunit.client.0.smithi038.stdout:9/365: mknod d0/c82 0 2024-09-13T18:30:35.611 INFO:tasks.workunit.client.0.smithi038.stdout:5/308: creat df/d13/d3b/d44/d48/d56/f5f x:0 0 0 2024-09-13T18:30:35.614 INFO:tasks.workunit.client.0.smithi038.stdout:6/388: rename dd/de/d2e/d2f/d4c/d55/f77 to dd/de/d2e/d2f/d4c/d55/f93 0 2024-09-13T18:30:35.616 INFO:tasks.workunit.client.0.smithi038.stdout:9/366: mknod d0/d7/d2c/d33/c83 0 2024-09-13T18:30:35.616 INFO:tasks.workunit.client.0.smithi038.stdout:9/367: chown d0/d7/d2c/d5e/c6c 0 1 2024-09-13T18:30:35.616 INFO:tasks.workunit.client.0.smithi038.stdout:9/368: chown d0/d7/d2c/d5e/f80 30533 1 2024-09-13T18:30:35.617 INFO:tasks.workunit.client.0.smithi038.stdout:6/389: creat dd/de/d2e/d2f/f94 x:0 0 0 2024-09-13T18:30:35.618 INFO:tasks.workunit.client.0.smithi038.stdout:6/390: write dd/de/d31/d63/d72/f80 [324161,28193] 0 2024-09-13T18:30:35.618 INFO:tasks.workunit.client.0.smithi038.stdout:6/391: fsync f9 0 2024-09-13T18:30:35.619 INFO:tasks.workunit.client.0.smithi038.stdout:9/369: creat d0/d7/d13/d2d/d3e/d70/d7b/f84 x:0 0 0 2024-09-13T18:30:35.621 INFO:tasks.workunit.client.0.smithi038.stdout:9/370: creat d0/d7/d13/f85 x:0 0 0 2024-09-13T18:30:35.621 INFO:tasks.workunit.client.0.smithi038.stdout:9/371: read d0/d7/d2c/f49 [56786,90020] 0 2024-09-13T18:30:35.621 INFO:tasks.workunit.client.0.smithi038.stdout:9/372: write d0/d7/d2c/d5e/f80 [3986842,24984] 0 2024-09-13T18:30:35.621 INFO:tasks.workunit.client.0.smithi038.stdout:5/309: dread f3 [0,4194304] 0 2024-09-13T18:30:35.622 INFO:tasks.workunit.client.0.smithi038.stdout:9/373: mkdir d0/d7/d2c/d5e/d77/d86 0 2024-09-13T18:30:35.622 INFO:tasks.workunit.client.0.smithi038.stdout:5/310: rename df/d13/l42 to df/d13/d3b/d44/l60 0 2024-09-13T18:30:35.623 INFO:tasks.workunit.client.0.smithi038.stdout:9/374: creat d0/d7/d2c/d5a/d67/f87 x:0 0 0 2024-09-13T18:30:35.624 INFO:tasks.workunit.client.0.smithi038.stdout:9/375: truncate d0/d7/d13/d2d/d3c/d50/f54 924714 0 2024-09-13T18:30:35.624 INFO:tasks.workunit.client.0.smithi038.stdout:9/376: chown d0/d7/f45 1487283295 1 2024-09-13T18:30:35.624 INFO:tasks.workunit.client.0.smithi038.stdout:9/377: creat d0/d7/d13/d2d/d3e/f88 x:0 0 0 2024-09-13T18:30:35.624 INFO:tasks.workunit.client.0.smithi038.stdout:9/378: write d0/d7/d13/d2d/d3e/d70/d7b/f84 [480263,43936] 0 2024-09-13T18:30:35.624 INFO:tasks.workunit.client.0.smithi038.stdout:9/379: chown d0/d7/d13/d2d/d3e/d70/d7b/f84 10987 1 2024-09-13T18:30:35.625 INFO:tasks.workunit.client.0.smithi038.stdout:9/380: write d0/d7/d2c/d5a/d69/f6b [99522,47318] 0 2024-09-13T18:30:35.626 INFO:tasks.workunit.client.0.smithi038.stdout:3/311: dwrite d0/dd/d17/d50/d5c/d1d/d29/d2b/f4d [0,4194304] 0 2024-09-13T18:30:35.626 INFO:tasks.workunit.client.0.smithi038.stdout:3/312: chown d0/f2 47 1 2024-09-13T18:30:35.626 INFO:tasks.workunit.client.0.smithi038.stdout:8/424: dwrite d1/de/d21/f85 [4194304,4194304] 0 2024-09-13T18:30:35.626 INFO:tasks.workunit.client.0.smithi038.stdout:8/425: readlink d1/de/d15/d30/l57 0 2024-09-13T18:30:35.626 INFO:tasks.workunit.client.0.smithi038.stdout:8/426: chown d1/de/d15 207075750 1 2024-09-13T18:30:35.626 INFO:tasks.workunit.client.0.smithi038.stdout:8/427: write d1/de/d21/d24/f7a [387315,70564] 0 2024-09-13T18:30:35.626 INFO:tasks.workunit.client.0.smithi038.stdout:8/428: chown d1/d2a/d40/c4e 27856 1 2024-09-13T18:30:35.626 INFO:tasks.workunit.client.0.smithi038.stdout:9/381: unlink d0/d7/d2c/f47 0 2024-09-13T18:30:35.627 INFO:tasks.workunit.client.0.smithi038.stdout:8/429: write d1/de/d21/d24/f76 [1659335,40359] 0 2024-09-13T18:30:35.627 INFO:tasks.workunit.client.0.smithi038.stdout:3/313: creat d0/dd/d17/d50/d51/f5f x:0 0 0 2024-09-13T18:30:35.627 INFO:tasks.workunit.client.0.smithi038.stdout:8/430: fsync d1/de/d15/f1c 0 2024-09-13T18:30:35.627 INFO:tasks.workunit.client.0.smithi038.stdout:3/314: fsync d0/dd/d17/d50/d51/f58 0 2024-09-13T18:30:35.627 INFO:tasks.workunit.client.0.smithi038.stdout:3/315: chown d0/dd/d17/d50/d59 173363886 1 2024-09-13T18:30:35.629 INFO:tasks.workunit.client.0.smithi038.stdout:1/426: sync 2024-09-13T18:30:35.629 INFO:tasks.workunit.client.0.smithi038.stdout:7/351: sync 2024-09-13T18:30:35.629 INFO:tasks.workunit.client.0.smithi038.stdout:0/369: sync 2024-09-13T18:30:35.630 INFO:tasks.workunit.client.0.smithi038.stdout:9/382: creat d0/d7/f89 x:0 0 0 2024-09-13T18:30:35.630 INFO:tasks.workunit.client.0.smithi038.stdout:9/383: creat d0/d7/d2c/d5e/f8a x:0 0 0 2024-09-13T18:30:35.630 INFO:tasks.workunit.client.0.smithi038.stdout:5/311: dread df/d13/d3b/d44/d48/d56/f5b [0,4194304] 0 2024-09-13T18:30:35.630 INFO:tasks.workunit.client.0.smithi038.stdout:5/312: dread - df/d13/d3b/d44/f51 zero size 2024-09-13T18:30:35.631 INFO:tasks.workunit.client.0.smithi038.stdout:8/431: unlink d1/de/d15/d30/l78 0 2024-09-13T18:30:35.633 INFO:tasks.workunit.client.0.smithi038.stdout:1/427: mkdir d12/d2a/d32/d82 0 2024-09-13T18:30:35.633 INFO:tasks.workunit.client.0.smithi038.stdout:1/428: stat d12/d2a/d32/c53 0 2024-09-13T18:30:35.633 INFO:tasks.workunit.client.0.smithi038.stdout:8/432: dread d1/d2a/f2e [0,4194304] 0 2024-09-13T18:30:35.633 INFO:tasks.workunit.client.0.smithi038.stdout:8/433: fdatasync d1/de/d3a/f77 0 2024-09-13T18:30:35.634 INFO:tasks.workunit.client.0.smithi038.stdout:0/370: symlink d2/d2f/l75 0 2024-09-13T18:30:35.635 INFO:tasks.workunit.client.0.smithi038.stdout:0/371: read - d2/d2f/d66/d49/f65 zero size 2024-09-13T18:30:35.635 INFO:tasks.workunit.client.0.smithi038.stdout:0/372: write d2/d7/d24/d2b/f43 [716818,29425] 0 2024-09-13T18:30:35.635 INFO:tasks.workunit.client.0.smithi038.stdout:0/373: getdents d2/d2f/d40/d74 0 2024-09-13T18:30:35.635 INFO:tasks.workunit.client.0.smithi038.stdout:0/374: chown d2/l19 945175529 1 2024-09-13T18:30:35.635 INFO:tasks.workunit.client.0.smithi038.stdout:7/352: mknod db/d12/d1c/d3a/d26/d41/c84 0 2024-09-13T18:30:35.635 INFO:tasks.workunit.client.0.smithi038.stdout:7/353: stat db/d12/f7b 0 2024-09-13T18:30:35.636 INFO:tasks.workunit.client.0.smithi038.stdout:3/316: write d0/dd/d17/d50/d5c/f47 [2987185,10927] 0 2024-09-13T18:30:35.637 INFO:tasks.workunit.client.0.smithi038.stdout:9/384: mknod d0/d7/d2c/d5e/d77/c8b 0 2024-09-13T18:30:35.638 INFO:tasks.workunit.client.0.smithi038.stdout:5/313: mknod df/d13/c61 0 2024-09-13T18:30:35.638 INFO:tasks.workunit.client.0.smithi038.stdout:5/314: chown df/c2c 42 1 2024-09-13T18:30:35.639 INFO:tasks.workunit.client.0.smithi038.stdout:1/429: symlink d12/d2a/d72/l83 0 2024-09-13T18:30:35.640 INFO:tasks.workunit.client.0.smithi038.stdout:6/392: fsync dd/de/d2e/d2f/d4c/d55/f93 0 2024-09-13T18:30:35.642 INFO:tasks.workunit.client.0.smithi038.stdout:8/434: link d1/de/d21/d24/f7a d1/d2a/d40/f8e 0 2024-09-13T18:30:35.644 INFO:tasks.workunit.client.0.smithi038.stdout:0/375: creat d2/d7/f76 x:0 0 0 2024-09-13T18:30:35.644 INFO:tasks.workunit.client.0.smithi038.stdout:0/376: write d2/f5 [353292,88693] 0 2024-09-13T18:30:35.644 INFO:tasks.workunit.client.0.smithi038.stdout:0/377: stat d2/d7/d24/d3c/d3f 0 2024-09-13T18:30:35.645 INFO:tasks.workunit.client.0.smithi038.stdout:7/354: write db/d12/d1c/d3a/d26/f2b [1413901,300] 0 2024-09-13T18:30:35.645 INFO:tasks.workunit.client.0.smithi038.stdout:7/355: write db/fe [3178397,97448] 0 2024-09-13T18:30:35.646 INFO:tasks.workunit.client.0.smithi038.stdout:5/315: dread df/f10 [0,4194304] 0 2024-09-13T18:30:35.646 INFO:tasks.workunit.client.0.smithi038.stdout:5/316: write df/d13/d3b/d3e/f5a [2234051,58709] 0 2024-09-13T18:30:35.647 INFO:tasks.workunit.client.0.smithi038.stdout:3/317: unlink d0/dd/d17/d50/d5c/d1d/l28 0 2024-09-13T18:30:35.647 INFO:tasks.workunit.client.0.smithi038.stdout:3/318: fsync d0/f4 0 2024-09-13T18:30:35.650 INFO:tasks.workunit.client.0.smithi038.stdout:6/393: symlink dd/de/d2e/l95 0 2024-09-13T18:30:35.651 INFO:tasks.workunit.client.0.smithi038.stdout:8/435: rmdir d1/de/d21/d24/d4d/d50 39 2024-09-13T18:30:35.651 INFO:tasks.workunit.client.0.smithi038.stdout:8/436: stat d1/de/d21/d24/d4d/d50/d62/d71/f82 0 2024-09-13T18:30:35.651 INFO:tasks.workunit.client.0.smithi038.stdout:8/437: chown d1/de/f5a 111 1 2024-09-13T18:30:35.651 INFO:tasks.workunit.client.0.smithi038.stdout:8/438: readlink d1/l2 0 2024-09-13T18:30:35.651 INFO:tasks.workunit.client.0.smithi038.stdout:8/439: getdents d1/de/d21/d24/d56/d89 0 2024-09-13T18:30:35.652 INFO:tasks.workunit.client.0.smithi038.stdout:8/440: write d1/d2a/f38 [1321032,102301] 0 2024-09-13T18:30:35.653 INFO:tasks.workunit.client.0.smithi038.stdout:6/394: fdatasync dd/de/d31/d63/d72/f80 0 2024-09-13T18:30:35.653 INFO:tasks.workunit.client.0.smithi038.stdout:6/395: chown dd/de/d2e/d30/d27/f2d 1711 1 2024-09-13T18:30:35.654 INFO:tasks.workunit.client.0.smithi038.stdout:9/385: read d0/d7/d13/d2d/d3e/f6e [3812622,65706] 0 2024-09-13T18:30:35.654 INFO:tasks.workunit.client.0.smithi038.stdout:7/356: rmdir db/d12/d13/d43 39 2024-09-13T18:30:35.654 INFO:tasks.workunit.client.0.smithi038.stdout:0/378: dread d2/d2f/d66/f5e [0,4194304] 0 2024-09-13T18:30:35.657 INFO:tasks.workunit.client.0.smithi038.stdout:0/379: dread d2/d2f/d66/d49/f5f [0,4194304] 0 2024-09-13T18:30:35.657 INFO:tasks.workunit.client.0.smithi038.stdout:5/317: mknod df/c62 0 2024-09-13T18:30:35.659 INFO:tasks.workunit.client.0.smithi038.stdout:3/319: rename d0/fc to d0/dd/d17/f60 0 2024-09-13T18:30:35.659 INFO:tasks.workunit.client.0.smithi038.stdout:3/320: readlink d0/dd/d17/d50/d5c/d1d/d30/l3e 0 2024-09-13T18:30:35.659 INFO:tasks.workunit.client.0.smithi038.stdout:3/321: fsync d0/dd/d17/d50/d5c/d1d/d29/f3b 0 2024-09-13T18:30:35.662 INFO:tasks.workunit.client.0.smithi038.stdout:7/357: getdents db/d12/d1c/d3a/d22/d28 0 2024-09-13T18:30:35.662 INFO:tasks.workunit.client.0.smithi038.stdout:7/358: fdatasync db/d12/d1c/d3a/f1f 0 2024-09-13T18:30:35.662 INFO:tasks.workunit.client.0.smithi038.stdout:8/441: write d1/f60 [3046172,130282] 0 2024-09-13T18:30:35.665 INFO:tasks.workunit.client.0.smithi038.stdout:0/380: link d2/dc/f51 d2/d2f/d40/d74/f77 0 2024-09-13T18:30:35.665 INFO:tasks.workunit.client.0.smithi038.stdout:9/386: write d0/d7/d2c/d5a/f64 [404837,70256] 0 2024-09-13T18:30:35.665 INFO:tasks.workunit.client.0.smithi038.stdout:9/387: stat d0/d7/d13/d2d/d3c/d50 0 2024-09-13T18:30:35.666 INFO:tasks.workunit.client.0.smithi038.stdout:9/388: chown d0/d7/d13/d2d/d3e/f6e 0 1 2024-09-13T18:30:35.667 INFO:tasks.workunit.client.0.smithi038.stdout:5/318: symlink df/d13/d3b/d41/l63 0 2024-09-13T18:30:35.669 INFO:tasks.workunit.client.0.smithi038.stdout:6/396: rename f6 to dd/de/d2e/d30/d27/f96 0 2024-09-13T18:30:35.669 INFO:tasks.workunit.client.0.smithi038.stdout:6/397: write dd/de/d2e/d30/d27/f53 [502359,66980] 0 2024-09-13T18:30:35.671 INFO:tasks.workunit.client.0.smithi038.stdout:8/442: mkdir d1/de/d21/d24/d41/d80/d8f 0 2024-09-13T18:30:35.671 INFO:tasks.workunit.client.0.smithi038.stdout:8/443: fsync d1/de/d21/d45/f73 0 2024-09-13T18:30:35.672 INFO:tasks.workunit.client.0.smithi038.stdout:0/381: mknod d2/d7/d24/c78 0 2024-09-13T18:30:35.675 INFO:tasks.workunit.client.0.smithi038.stdout:1/430: dwrite d12/d3c/f50 [0,4194304] 0 2024-09-13T18:30:35.675 INFO:tasks.workunit.client.0.smithi038.stdout:5/319: getdents df/d13 0 2024-09-13T18:30:35.677 INFO:tasks.workunit.client.0.smithi038.stdout:9/389: rename d0/l1c to d0/d7/l8c 0 2024-09-13T18:30:35.688 INFO:tasks.workunit.client.0.smithi038.stdout:9/390: unlink d0/d7/f23 0 2024-09-13T18:30:35.690 INFO:tasks.workunit.client.0.smithi038.stdout:0/382: dread d2/d7/d24/d3c/d3f/f5a [0,4194304] 0 2024-09-13T18:30:35.690 INFO:tasks.workunit.client.0.smithi038.stdout:3/322: dwrite d0/dd/d17/d50/d5c/d23/f2c [0,4194304] 0 2024-09-13T18:30:35.696 INFO:tasks.workunit.client.0.smithi038.stdout:8/444: dwrite d1/d2a/d3f/f7e [0,4194304] 0 2024-09-13T18:30:35.700 INFO:tasks.workunit.client.0.smithi038.stdout:0/383: creat d2/d7/d24/d3c/f79 x:0 0 0 2024-09-13T18:30:35.702 INFO:tasks.workunit.client.0.smithi038.stdout:3/323: mknod d0/dd/d17/c61 0 2024-09-13T18:30:35.702 INFO:tasks.workunit.client.0.smithi038.stdout:3/324: fsync d0/dd/d17/d50/d5c/f55 0 2024-09-13T18:30:35.702 INFO:tasks.workunit.client.0.smithi038.stdout:3/325: readlink d0/dd/d17/d50/d5c/d1d/l38 0 2024-09-13T18:30:35.702 INFO:tasks.workunit.client.0.smithi038.stdout:3/326: fsync d0/dd/f5a 0 2024-09-13T18:30:35.702 INFO:tasks.workunit.client.0.smithi038.stdout:3/327: fdatasync d0/f2 0 2024-09-13T18:30:35.703 INFO:tasks.workunit.client.0.smithi038.stdout:9/391: getdents d0/d7/d2c/d6d 0 2024-09-13T18:30:35.703 INFO:tasks.workunit.client.0.smithi038.stdout:9/392: dread - d0/d7/f35 zero size 2024-09-13T18:30:35.706 INFO:tasks.workunit.client.0.smithi038.stdout:8/445: mknod d1/d8/c90 0 2024-09-13T18:30:35.708 INFO:tasks.workunit.client.0.smithi038.stdout:9/393: mkdir d0/d7/d13/d2d/d3e/d70/d8d 0 2024-09-13T18:30:35.710 INFO:tasks.workunit.client.0.smithi038.stdout:8/446: link d1/de/d21/d24/d56/c74 d1/de/d21/c91 0 2024-09-13T18:30:35.710 INFO:tasks.workunit.client.0.smithi038.stdout:5/320: dwrite df/d13/d3b/d3e/f5a [0,4194304] 0 2024-09-13T18:30:35.711 INFO:tasks.workunit.client.0.smithi038.stdout:3/328: rmdir d0/dd/d17/d43 39 2024-09-13T18:30:35.713 INFO:tasks.workunit.client.0.smithi038.stdout:9/394: creat d0/d2e/d7f/f8e x:0 0 0 2024-09-13T18:30:35.713 INFO:tasks.workunit.client.0.smithi038.stdout:8/447: creat d1/de/d21/d24/f92 x:0 0 0 2024-09-13T18:30:35.714 INFO:tasks.workunit.client.0.smithi038.stdout:5/321: rename df/c20 to df/c64 0 2024-09-13T18:30:35.714 INFO:tasks.workunit.client.0.smithi038.stdout:5/322: dread - df/d15/d36/f3c zero size 2024-09-13T18:30:35.715 INFO:tasks.workunit.client.0.smithi038.stdout:0/384: write d2/d2f/d40/d74/f77 [3496399,2458] 0 2024-09-13T18:30:35.715 INFO:tasks.workunit.client.0.smithi038.stdout:1/431: dwrite d12/d3c/d46/f7c [0,4194304] 0 2024-09-13T18:30:35.715 INFO:tasks.workunit.client.0.smithi038.stdout:1/432: write d12/d2a/d32/d59/d5b/f7e [638647,68678] 0 2024-09-13T18:30:35.716 INFO:tasks.workunit.client.0.smithi038.stdout:3/329: unlink d0/l3 0 2024-09-13T18:30:35.716 INFO:tasks.workunit.client.0.smithi038.stdout:3/330: fsync d0/dd/d17/d50/d5c/d1d/d29/f3b 0 2024-09-13T18:30:35.716 INFO:tasks.workunit.client.0.smithi038.stdout:3/331: truncate d0/dd/f5a 618587 0 2024-09-13T18:30:35.716 INFO:tasks.workunit.client.0.smithi038.stdout:3/332: chown d0/dd/d17/c4a 192535 1 2024-09-13T18:30:35.718 INFO:tasks.workunit.client.0.smithi038.stdout:5/323: mknod df/d13/d3b/d44/d48/d54/c65 0 2024-09-13T18:30:35.718 INFO:tasks.workunit.client.0.smithi038.stdout:5/324: truncate df/d13/d3b/d44/f51 193778 0 2024-09-13T18:30:35.721 INFO:tasks.workunit.client.0.smithi038.stdout:0/385: creat d2/d7/d24/d3c/d3f/f7a x:0 0 0 2024-09-13T18:30:35.723 INFO:tasks.workunit.client.0.smithi038.stdout:1/433: read fb [3620889,53886] 0 2024-09-13T18:30:35.724 INFO:tasks.workunit.client.0.smithi038.stdout:3/333: unlink d0/dd/d17/d50/d5c/d1d/d29/d2b/l44 0 2024-09-13T18:30:35.725 INFO:tasks.workunit.client.0.smithi038.stdout:9/395: mknod d0/c8f 0 2024-09-13T18:30:35.725 INFO:tasks.workunit.client.0.smithi038.stdout:9/396: chown d0/d7/d2c/d5a/f64 0 1 2024-09-13T18:30:35.726 INFO:tasks.workunit.client.0.smithi038.stdout:0/386: rmdir d2/d2f/d66/d49 39 2024-09-13T18:30:35.728 INFO:tasks.workunit.client.0.smithi038.stdout:1/434: mkdir d12/d2a/d32/d59/d5b/d47/d84 0 2024-09-13T18:30:35.729 INFO:tasks.workunit.client.0.smithi038.stdout:3/334: mknod d0/dd/d17/d50/d5c/c62 0 2024-09-13T18:30:35.732 INFO:tasks.workunit.client.0.smithi038.stdout:1/435: mknod d12/d3c/d46/d57/c85 0 2024-09-13T18:30:35.732 INFO:tasks.workunit.client.0.smithi038.stdout:1/436: creat d12/d3c/d46/f86 x:0 0 0 2024-09-13T18:30:35.734 INFO:tasks.workunit.client.0.smithi038.stdout:0/387: rename d2/d7/c2a to d2/d2f/d40/d74/c7b 0 2024-09-13T18:30:35.736 INFO:tasks.workunit.client.0.smithi038.stdout:5/325: dwrite df/d13/d3b/d44/d48/d56/f5f [0,4194304] 0 2024-09-13T18:30:35.739 INFO:tasks.workunit.client.0.smithi038.stdout:1/437: getdents d12/d2a 0 2024-09-13T18:30:35.739 INFO:tasks.workunit.client.0.smithi038.stdout:1/438: creat d12/d3c/d46/d57/f87 x:0 0 0 2024-09-13T18:30:35.739 INFO:tasks.workunit.client.0.smithi038.stdout:1/439: write d12/f2b [231000,91155] 0 2024-09-13T18:30:35.742 INFO:tasks.workunit.client.0.smithi038.stdout:5/326: creat df/f66 x:0 0 0 2024-09-13T18:30:35.744 INFO:tasks.workunit.client.0.smithi038.stdout:0/388: link d2/d2f/c5b d2/d7/c7c 0 2024-09-13T18:30:35.744 INFO:tasks.workunit.client.0.smithi038.stdout:0/389: chown d2/dc 37584970 1 2024-09-13T18:30:35.746 INFO:tasks.workunit.client.0.smithi038.stdout:1/440: symlink d12/d2a/d32/d59/l88 0 2024-09-13T18:30:35.747 INFO:tasks.workunit.client.0.smithi038.stdout:1/441: unlink d12/d2a/d32/d59/d5e/f6d 0 2024-09-13T18:30:35.749 INFO:tasks.workunit.client.0.smithi038.stdout:9/397: dwrite d0/d7/d2c/d5a/f64 [0,4194304] 0 2024-09-13T18:30:35.756 INFO:tasks.workunit.client.0.smithi038.stdout:5/327: dread df/d13/d3b/d3e/f2f [0,4194304] 0 2024-09-13T18:30:35.760 INFO:tasks.workunit.client.0.smithi038.stdout:0/390: dread d2/dc/f14 [0,4194304] 0 2024-09-13T18:30:35.760 INFO:tasks.workunit.client.0.smithi038.stdout:0/391: rename d2/d2f/d66 to d2/d2f/d66/d49/d7d 22 2024-09-13T18:30:35.761 INFO:tasks.workunit.client.0.smithi038.stdout:5/328: mkdir df/d15/d36/d67 0 2024-09-13T18:30:35.765 INFO:tasks.workunit.client.0.smithi038.stdout:1/442: dwrite d12/f7d [0,4194304] 0 2024-09-13T18:30:35.765 INFO:tasks.workunit.client.0.smithi038.stdout:1/443: creat d12/d2a/d32/d59/d5b/f89 x:0 0 0 2024-09-13T18:30:35.765 INFO:tasks.workunit.client.0.smithi038.stdout:0/392: rename l0 to d2/d7/d24/d3c/l7e 0 2024-09-13T18:30:35.765 INFO:tasks.workunit.client.0.smithi038.stdout:0/393: readlink d2/d7/l3a 0 2024-09-13T18:30:35.766 INFO:tasks.workunit.client.0.smithi038.stdout:5/329: mkdir df/d68 0 2024-09-13T18:30:35.768 INFO:tasks.workunit.client.0.smithi038.stdout:3/335: truncate d0/dd/d17/f1c 807452 0 2024-09-13T18:30:35.772 INFO:tasks.workunit.client.0.smithi038.stdout:1/444: creat d12/d2a/d32/d59/d5b/d47/f8a x:0 0 0 2024-09-13T18:30:35.775 INFO:tasks.workunit.client.0.smithi038.stdout:5/330: mknod df/d13/d3b/d44/d48/d56/c69 0 2024-09-13T18:30:35.777 INFO:tasks.workunit.client.0.smithi038.stdout:3/336: mknod d0/dd/d17/d50/d5c/d1d/d29/d32/c63 0 2024-09-13T18:30:35.778 INFO:tasks.workunit.client.0.smithi038.stdout:0/394: mkdir d2/dc/d7f 0 2024-09-13T18:30:35.781 INFO:tasks.workunit.client.0.smithi038.stdout:5/331: rmdir df/d13/d49 39 2024-09-13T18:30:35.785 INFO:tasks.workunit.client.0.smithi038.stdout:5/332: rename df/d13/f34 to df/d13/d3b/d41/f6a 0 2024-09-13T18:30:35.786 INFO:tasks.workunit.client.0.smithi038.stdout:5/333: mknod df/d13/c6b 0 2024-09-13T18:30:35.788 INFO:tasks.workunit.client.0.smithi038.stdout:5/334: mknod df/d15/c6c 0 2024-09-13T18:30:35.790 INFO:tasks.workunit.client.0.smithi038.stdout:5/335: mknod df/d13/d3b/d44/d48/d54/c6d 0 2024-09-13T18:30:35.792 INFO:tasks.workunit.client.0.smithi038.stdout:5/336: symlink df/d15/d50/l6e 0 2024-09-13T18:30:35.793 INFO:tasks.workunit.client.0.smithi038.stdout:5/337: creat df/d15/d36/f6f x:0 0 0 2024-09-13T18:30:35.793 INFO:tasks.workunit.client.0.smithi038.stdout:0/395: dwrite d2/d7/d24/d2b/f37 [4194304,4194304] 0 2024-09-13T18:30:35.795 INFO:tasks.workunit.client.0.smithi038.stdout:5/338: mkdir df/d13/d49/d70 0 2024-09-13T18:30:35.795 INFO:tasks.workunit.client.0.smithi038.stdout:5/339: dread - df/d15/d36/f6f zero size 2024-09-13T18:30:35.798 INFO:tasks.workunit.client.0.smithi038.stdout:5/340: creat df/d68/f71 x:0 0 0 2024-09-13T18:30:35.798 INFO:tasks.workunit.client.0.smithi038.stdout:5/341: dread - df/d15/d36/f6f zero size 2024-09-13T18:30:35.800 INFO:tasks.workunit.client.0.smithi038.stdout:5/342: symlink df/d15/d36/l72 0 2024-09-13T18:30:35.801 INFO:tasks.workunit.client.0.smithi038.stdout:0/396: link d2/d7/l2c d2/dc/l80 0 2024-09-13T18:30:35.802 INFO:tasks.workunit.client.0.smithi038.stdout:0/397: mkdir d2/d2f/d66/d81 0 2024-09-13T18:30:35.803 INFO:tasks.workunit.client.0.smithi038.stdout:0/398: symlink d2/d7/d24/l82 0 2024-09-13T18:30:35.805 INFO:tasks.workunit.client.0.smithi038.stdout:0/399: dread d2/d2f/d66/d49/f5f [0,4194304] 0 2024-09-13T18:30:35.805 INFO:tasks.workunit.client.0.smithi038.stdout:0/400: stat d2/d2f/d66 0 2024-09-13T18:30:35.805 INFO:tasks.workunit.client.0.smithi038.stdout:0/401: write d2/f1c [3442114,19606] 0 2024-09-13T18:30:35.809 INFO:tasks.workunit.client.0.smithi038.stdout:5/343: write df/d13/d3b/f4d [2105680,118216] 0 2024-09-13T18:30:35.812 INFO:tasks.workunit.client.0.smithi038.stdout:0/402: creat d2/d2f/d66/d81/f83 x:0 0 0 2024-09-13T18:30:35.814 INFO:tasks.workunit.client.0.smithi038.stdout:5/344: creat df/d13/d3b/f73 x:0 0 0 2024-09-13T18:30:35.815 INFO:tasks.workunit.client.0.smithi038.stdout:0/403: creat d2/d7/d24/f84 x:0 0 0 2024-09-13T18:30:35.817 INFO:tasks.workunit.client.0.smithi038.stdout:0/404: creat d2/d2f/d66/f85 x:0 0 0 2024-09-13T18:30:35.824 INFO:tasks.workunit.client.0.smithi038.stdout:5/345: dread df/d13/d3b/f4d [0,4194304] 0 2024-09-13T18:30:35.832 INFO:tasks.workunit.client.0.smithi038.stdout:0/405: dwrite d2/d7/fb [0,4194304] 0 2024-09-13T18:30:35.834 INFO:tasks.workunit.client.0.smithi038.stdout:0/406: chown d2/d7/c12 465 1 2024-09-13T18:30:35.840 INFO:tasks.workunit.client.0.smithi038.stdout:5/346: write df/f1e [4178846,75564] 0 2024-09-13T18:30:35.840 INFO:tasks.workunit.client.0.smithi038.stdout:5/347: mknod df/d13/d3b/d44/d52/c74 0 2024-09-13T18:30:35.840 INFO:tasks.workunit.client.0.smithi038.stdout:5/348: read - df/d68/f71 zero size 2024-09-13T18:30:35.841 INFO:tasks.workunit.client.0.smithi038.stdout:5/349: mkdir df/d13/d3b/d44/d48/d75 0 2024-09-13T18:30:35.842 INFO:tasks.workunit.client.0.smithi038.stdout:5/350: creat df/d13/d3b/d44/d48/d56/f76 x:0 0 0 2024-09-13T18:30:35.844 INFO:tasks.workunit.client.0.smithi038.stdout:5/351: creat df/d15/d36/d67/f77 x:0 0 0 2024-09-13T18:30:35.844 INFO:tasks.workunit.client.0.smithi038.stdout:5/352: dread - df/d15/d36/f6f zero size 2024-09-13T18:30:35.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/353: mknod df/c78 0 2024-09-13T18:30:35.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/354: read - df/f66 zero size 2024-09-13T18:30:35.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/355: chown df/d13/d3b/d44/d48/d54/c6d 7 1 2024-09-13T18:30:35.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/356: write df/d15/d36/f6f [253841,90989] 0 2024-09-13T18:30:35.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/357: truncate df/d15/d36/f3c 124178 0 2024-09-13T18:30:35.845 INFO:tasks.workunit.client.0.smithi038.stdout:5/358: stat df/f1e 0 2024-09-13T18:30:35.859 INFO:tasks.workunit.client.0.smithi038.stdout:5/359: dwrite df/d15/f3d [0,4194304] 0 2024-09-13T18:30:35.859 INFO:tasks.workunit.client.0.smithi038.stdout:5/360: write df/d15/f22 [3265771,75939] 0 2024-09-13T18:30:35.861 INFO:tasks.workunit.client.0.smithi038.stdout:5/361: truncate fd 283375 0 2024-09-13T18:30:35.866 INFO:tasks.workunit.client.0.smithi038.stdout:5/362: dread df/d13/d3b/f4d [0,4194304] 0 2024-09-13T18:30:35.868 INFO:tasks.workunit.client.0.smithi038.stdout:5/363: fdatasync df/d15/f22 0 2024-09-13T18:30:35.870 INFO:tasks.workunit.client.0.smithi038.stdout:5/364: symlink df/d13/l79 0 2024-09-13T18:30:35.871 INFO:tasks.workunit.client.0.smithi038.stdout:5/365: mknod df/d13/d3b/d44/d52/c7a 0 2024-09-13T18:30:35.876 INFO:tasks.workunit.client.0.smithi038.stdout:5/366: dread df/d13/d3b/f4d [0,4194304] 0 2024-09-13T18:30:35.883 INFO:tasks.workunit.client.0.smithi038.stdout:5/367: write df/d15/f3d [962794,122235] 0 2024-09-13T18:30:35.889 INFO:tasks.workunit.client.0.smithi038.stdout:5/368: dread df/d15/f39 [0,4194304] 0 2024-09-13T18:30:35.890 INFO:tasks.workunit.client.0.smithi038.stdout:5/369: getdents df/d13/d3b/d44/d58 0 2024-09-13T18:30:35.897 INFO:tasks.workunit.client.0.smithi038.stdout:5/370: dread df/d15/d36/f6f [0,4194304] 0 2024-09-13T18:30:35.898 INFO:tasks.workunit.client.0.smithi038.stdout:5/371: getdents df/d13 0 2024-09-13T18:30:35.900 INFO:tasks.workunit.client.0.smithi038.stdout:5/372: rename fd to df/d13/d3b/d44/d48/d75/f7b 0 2024-09-13T18:30:35.901 INFO:tasks.workunit.client.0.smithi038.stdout:5/373: write df/d15/d36/f6f [227386,125706] 0 2024-09-13T18:30:35.908 INFO:tasks.workunit.client.0.smithi038.stdout:5/374: write df/d13/d3b/d3e/f5a [112413,30510] 0 2024-09-13T18:30:35.926 INFO:tasks.workunit.client.0.smithi038.stdout:5/375: dwrite f3 [4194304,4194304] 0 2024-09-13T18:30:35.926 INFO:tasks.workunit.client.0.smithi038.stdout:5/376: write df/d13/d3b/f4d [1817631,67179] 0 2024-09-13T18:30:35.927 INFO:tasks.workunit.client.0.smithi038.stdout:5/377: dread - df/d68/f71 zero size 2024-09-13T18:30:35.927 INFO:tasks.workunit.client.0.smithi038.stdout:5/378: symlink df/d13/d49/d70/l7c 0 2024-09-13T18:30:35.928 INFO:tasks.workunit.client.0.smithi038.stdout:5/379: chown df/d15/d36/d67/f77 18 1 2024-09-13T18:30:35.928 INFO:tasks.workunit.client.0.smithi038.stdout:5/380: write df/d13/d3b/d44/d48/d75/f7b [289288,53026] 0 2024-09-13T18:30:35.928 INFO:tasks.workunit.client.0.smithi038.stdout:5/381: unlink f9 0 2024-09-13T18:30:35.929 INFO:tasks.workunit.client.0.smithi038.stdout:5/382: stat df/d15/d36/d67 0 2024-09-13T18:30:35.929 INFO:tasks.workunit.client.0.smithi038.stdout:5/383: symlink df/d13/d3b/d44/d52/l7d 0 2024-09-13T18:30:35.929 INFO:tasks.workunit.client.0.smithi038.stdout:5/384: creat df/d15/f7e x:0 0 0 2024-09-13T18:30:35.931 INFO:tasks.workunit.client.0.smithi038.stdout:5/385: rename df/d13/d3b/d3e/f2f to df/d13/d3b/d41/f7f 0 2024-09-13T18:30:35.948 INFO:tasks.workunit.client.0.smithi038.stdout:5/386: dwrite f8 [0,4194304] 0 2024-09-13T18:30:35.964 INFO:tasks.workunit.client.0.smithi038.stdout:5/387: dwrite df/d15/f39 [0,4194304] 0 2024-09-13T18:30:35.966 INFO:tasks.workunit.client.0.smithi038.stdout:5/388: symlink df/d13/d3b/d44/d48/l80 0 2024-09-13T18:30:35.975 INFO:tasks.workunit.client.0.smithi038.stdout:5/389: write f3 [6187183,88079] 0 2024-09-13T18:30:35.992 INFO:tasks.workunit.client.0.smithi038.stdout:5/390: dwrite df/d13/d3b/d44/d48/d75/f7b [0,4194304] 0 2024-09-13T18:30:35.993 INFO:tasks.workunit.client.0.smithi038.stdout:5/391: dread df/d15/f22 [4194304,4194304] 0 2024-09-13T18:30:35.993 INFO:tasks.workunit.client.0.smithi038.stdout:5/392: fsync df/d13/d3b/d44/d48/d75/f7b 0 2024-09-13T18:30:35.993 INFO:tasks.workunit.client.0.smithi038.stdout:5/393: creat df/d15/d36/d67/f81 x:0 0 0 2024-09-13T18:30:35.995 INFO:tasks.workunit.client.0.smithi038.stdout:5/394: mkdir df/d13/d3b/d44/d82 0 2024-09-13T18:30:35.997 INFO:tasks.workunit.client.0.smithi038.stdout:5/395: mknod df/d13/d3b/d44/d52/c83 0 2024-09-13T18:30:36.005 INFO:tasks.workunit.client.0.smithi038.stdout:5/396: truncate f3 6568475 0 2024-09-13T18:30:36.005 INFO:tasks.workunit.client.0.smithi038.stdout:5/397: fdatasync df/d13/d3b/d41/f6a 0 2024-09-13T18:30:36.006 INFO:tasks.workunit.client.0.smithi038.stdout:5/398: write df/d13/f4f [269029,104281] 0 2024-09-13T18:30:36.006 INFO:tasks.workunit.client.0.smithi038.stdout:5/399: readlink df/d13/d3b/d44/d52/l7d 0 2024-09-13T18:30:36.012 INFO:tasks.workunit.client.0.smithi038.stdout:5/400: dread df/d13/d3b/d44/d48/d56/f5b [0,4194304] 0 2024-09-13T18:30:36.021 INFO:tasks.workunit.client.0.smithi038.stdout:5/401: write df/d13/d3b/d44/d48/d56/f5f [3061180,96330] 0 2024-09-13T18:30:36.043 INFO:tasks.workunit.client.0.smithi038.stdout:5/402: dwrite df/d13/d3b/d44/d48/d56/f5f [0,4194304] 0 2024-09-13T18:30:36.043 INFO:tasks.workunit.client.0.smithi038.stdout:5/403: stat df/d13/l26 0 2024-09-13T18:30:36.064 INFO:tasks.workunit.client.0.smithi038.stdout:5/404: dwrite df/d13/d3b/f4a [0,4194304] 0 2024-09-13T18:30:36.065 INFO:tasks.workunit.client.0.smithi038.stdout:5/405: rename df/d13/d3b/d44/d58/l5d to df/d68/l84 0 2024-09-13T18:30:36.074 INFO:tasks.workunit.client.0.smithi038.stdout:5/406: dread f8 [0,4194304] 0 2024-09-13T18:30:36.102 INFO:tasks.workunit.client.0.smithi038.stdout:5/407: dwrite df/f1e [0,4194304] 0 2024-09-13T18:30:36.104 INFO:tasks.workunit.client.0.smithi038.stdout:5/408: mkdir df/d13/d85 0 2024-09-13T18:30:36.104 INFO:tasks.workunit.client.0.smithi038.stdout:5/409: chown df/d13/d3b/d44/d52/l7d 67169 1 2024-09-13T18:30:36.105 INFO:tasks.workunit.client.0.smithi038.stdout:5/410: getdents df/d13/d3b/d3e 0 2024-09-13T18:30:36.115 INFO:tasks.workunit.client.0.smithi038.stdout:5/411: dread f1 [4194304,4194304] 0 2024-09-13T18:30:36.115 INFO:tasks.workunit.client.0.smithi038.stdout:5/412: creat df/d15/d36/f86 x:0 0 0 2024-09-13T18:30:36.117 INFO:tasks.workunit.client.0.smithi038.stdout:5/413: dread df/d13/d3b/d41/f6a [0,4194304] 0 2024-09-13T18:30:36.118 INFO:tasks.workunit.client.0.smithi038.stdout:5/414: creat df/d13/d3b/d44/d58/f87 x:0 0 0 2024-09-13T18:30:36.118 INFO:tasks.workunit.client.0.smithi038.stdout:5/415: chown df/d13/d3b/d44/d52 316374 1 2024-09-13T18:30:36.119 INFO:tasks.workunit.client.0.smithi038.stdout:5/416: mknod df/d68/c88 0 2024-09-13T18:30:36.119 INFO:tasks.workunit.client.0.smithi038.stdout:5/417: write df/d13/d3b/f73 [467457,80843] 0 2024-09-13T18:30:36.119 INFO:tasks.workunit.client.0.smithi038.stdout:5/418: fsync df/d15/d36/f3a 0 2024-09-13T18:30:36.119 INFO:tasks.workunit.client.0.smithi038.stdout:5/419: chown df/f1b 30905 1 2024-09-13T18:30:36.120 INFO:tasks.workunit.client.0.smithi038.stdout:5/420: symlink df/d13/d3b/d44/d52/l89 0 2024-09-13T18:30:36.122 INFO:tasks.workunit.client.0.smithi038.stdout:5/421: symlink df/d13/d3b/d3e/l8a 0 2024-09-13T18:30:36.122 INFO:tasks.workunit.client.0.smithi038.stdout:5/422: chown df/d13/d3b/d41/f7f 1 1 2024-09-13T18:30:36.122 INFO:tasks.workunit.client.0.smithi038.stdout:5/423: dread - df/d15/d36/d67/f81 zero size 2024-09-13T18:30:36.122 INFO:tasks.workunit.client.0.smithi038.stdout:5/424: truncate df/d15/f7e 602819 0 2024-09-13T18:30:36.122 INFO:tasks.workunit.client.0.smithi038.stdout:5/425: creat df/d13/d3b/d44/d48/d56/f8b x:0 0 0 2024-09-13T18:30:36.134 INFO:tasks.workunit.client.0.smithi038.stdout:5/426: dwrite df/d13/d3b/d44/d48/d56/f76 [0,4194304] 0 2024-09-13T18:30:36.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/427: dwrite df/d15/d36/f86 [0,4194304] 0 2024-09-13T18:30:36.162 INFO:tasks.workunit.client.0.smithi038.stdout:5/428: dread df/f1e [8388608,4194304] 0 2024-09-13T18:30:36.182 INFO:tasks.workunit.client.0.smithi038.stdout:5/429: getdents df/d68 0 2024-09-13T18:30:36.183 INFO:tasks.workunit.client.0.smithi038.stdout:5/430: symlink df/d13/d3b/d44/d48/d54/l8c 0 2024-09-13T18:30:36.199 INFO:tasks.workunit.client.0.smithi038.stdout:5/431: dwrite df/d13/d3b/d44/d48/d56/f5b [0,4194304] 0 2024-09-13T18:30:36.199 INFO:tasks.workunit.client.0.smithi038.stdout:5/432: chown df/d15/d36/f86 3860 1 2024-09-13T18:30:36.205 INFO:tasks.workunit.client.0.smithi038.stdout:5/433: read df/f1e [11064497,104497] 0 2024-09-13T18:30:36.207 INFO:tasks.workunit.client.0.smithi038.stdout:5/434: link df/d13/d3b/d44/d48/d54/l8c df/d13/d3b/d44/d48/d56/l8d 0 2024-09-13T18:30:36.212 INFO:tasks.workunit.client.0.smithi038.stdout:5/435: mknod df/d13/d3b/d44/d48/d56/c8e 0 2024-09-13T18:30:36.212 INFO:tasks.workunit.client.0.smithi038.stdout:5/436: write df/d13/d3b/d44/f46 [1759067,113542] 0 2024-09-13T18:30:36.212 INFO:tasks.workunit.client.0.smithi038.stdout:5/437: write df/d13/d3b/f4d [4273735,20784] 0 2024-09-13T18:30:36.223 INFO:tasks.workunit.client.0.smithi038.stdout:5/438: write df/d13/d3b/f4a [724852,21783] 0 2024-09-13T18:30:36.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:35 smithi149 ceph-mon[35845]: pgmap v20: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 210 MiB/s rd, 261 MiB/s wr, 376 op/s 2024-09-13T18:30:36.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:35 smithi038 ceph-mon[27689]: pgmap v20: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 210 MiB/s rd, 261 MiB/s wr, 376 op/s 2024-09-13T18:30:36.382 INFO:tasks.workunit.client.0.smithi038.stdout:4/583: sync 2024-09-13T18:30:36.384 INFO:tasks.workunit.client.0.smithi038.stdout:4/584: mkdir d2/d49/d4b/dc0 0 2024-09-13T18:30:36.384 INFO:tasks.workunit.client.0.smithi038.stdout:4/585: creat d2/fc1 x:0 0 0 2024-09-13T18:30:36.387 INFO:tasks.workunit.client.0.smithi038.stdout:4/586: dread d2/df/d1b/d10/d55/f7f [0,4194304] 0 2024-09-13T18:30:36.416 INFO:tasks.workunit.client.0.smithi038.stdout:4/587: dwrite d2/df/d1b/d10/f5f [0,4194304] 0 2024-09-13T18:30:36.419 INFO:tasks.workunit.client.0.smithi038.stdout:4/588: symlink d2/d49/d50/da0/d8/d80/lc2 0 2024-09-13T18:30:36.419 INFO:tasks.workunit.client.0.smithi038.stdout:4/589: write d2/d49/d50/da0/d8/d3b/f9e [2091350,86599] 0 2024-09-13T18:30:36.420 INFO:tasks.workunit.client.0.smithi038.stdout:4/590: rmdir d2/df/d1b/d10/d55 39 2024-09-13T18:30:36.429 INFO:tasks.workunit.client.0.smithi038.stdout:4/591: dread d2/df/d1b/d10/d55/f99 [0,4194304] 0 2024-09-13T18:30:36.429 INFO:tasks.workunit.client.0.smithi038.stdout:4/592: readlink d2/d49/d50/da0/l60 0 2024-09-13T18:30:36.430 INFO:tasks.workunit.client.0.smithi038.stdout:4/593: rename d2/df/d1b/d10/f5f to d2/d49/d50/da0/fc3 0 2024-09-13T18:30:36.432 INFO:tasks.workunit.client.0.smithi038.stdout:4/594: truncate d2/d49/d4b/d8e/fbb 190517 0 2024-09-13T18:30:36.432 INFO:tasks.workunit.client.0.smithi038.stdout:4/595: creat d2/fc4 x:0 0 0 2024-09-13T18:30:36.432 INFO:tasks.workunit.client.0.smithi038.stdout:4/596: stat d2/df/d22/c6e 0 2024-09-13T18:30:36.432 INFO:tasks.workunit.client.0.smithi038.stdout:4/597: fdatasync d2/df/d1b/f8a 0 2024-09-13T18:30:36.432 INFO:tasks.workunit.client.0.smithi038.stdout:4/598: chown d2/l26 99 1 2024-09-13T18:30:36.433 INFO:tasks.workunit.client.0.smithi038.stdout:4/599: symlink d2/d49/d4b/dc0/lc5 0 2024-09-13T18:30:36.433 INFO:tasks.workunit.client.0.smithi038.stdout:4/600: dread - d2/d49/d50/da0/d8/d3b/fb9 zero size 2024-09-13T18:30:36.433 INFO:tasks.workunit.client.0.smithi038.stdout:4/601: write d2/df/d1b/d10/f3d [246389,123674] 0 2024-09-13T18:30:36.435 INFO:tasks.workunit.client.0.smithi038.stdout:4/602: creat d2/df/d1b/d10/da3/fc6 x:0 0 0 2024-09-13T18:30:36.436 INFO:tasks.workunit.client.0.smithi038.stdout:4/603: stat d2/d49/d50/fa8 0 2024-09-13T18:30:36.436 INFO:tasks.workunit.client.0.smithi038.stdout:4/604: write d2/fc1 [850593,85145] 0 2024-09-13T18:30:36.436 INFO:tasks.workunit.client.0.smithi038.stdout:4/605: fsync d2/d49/f90 0 2024-09-13T18:30:36.458 INFO:tasks.workunit.client.0.smithi038.stdout:4/606: dwrite d2/d49/d50/da0/fc3 [4194304,4194304] 0 2024-09-13T18:30:36.458 INFO:tasks.workunit.client.0.smithi038.stdout:4/607: fsync d2/d49/d50/da0/d8/f6c 0 2024-09-13T18:30:36.471 INFO:tasks.workunit.client.0.smithi038.stdout:4/608: dread d2/d49/d50/da0/d8/f27 [0,4194304] 0 2024-09-13T18:30:36.484 INFO:tasks.workunit.client.0.smithi038.stdout:4/609: dwrite d2/df/faf [0,4194304] 0 2024-09-13T18:30:36.490 INFO:tasks.workunit.client.0.smithi038.stdout:4/610: rmdir d2/df/d22 39 2024-09-13T18:30:36.513 INFO:tasks.workunit.client.0.smithi038.stdout:4/611: dwrite d2/df/f4c [0,4194304] 0 2024-09-13T18:30:36.522 INFO:tasks.workunit.client.0.smithi038.stdout:4/612: write d2/d49/d50/da0/d8/d3b/f53 [4065793,75059] 0 2024-09-13T18:30:36.522 INFO:tasks.workunit.client.0.smithi038.stdout:4/613: write d2/df/d1b/f2b [4592198,86934] 0 2024-09-13T18:30:36.522 INFO:tasks.workunit.client.0.smithi038.stdout:4/614: write d2/df/d1b/d10/d71/f92 [1151244,28543] 0 2024-09-13T18:30:36.522 INFO:tasks.workunit.client.0.smithi038.stdout:4/615: dread - d2/df/d1b/d10/da3/f97 zero size 2024-09-13T18:30:36.524 INFO:tasks.workunit.client.0.smithi038.stdout:7/359: sync 2024-09-13T18:30:36.524 INFO:tasks.workunit.client.0.smithi038.stdout:2/315: sync 2024-09-13T18:30:36.524 INFO:tasks.workunit.client.0.smithi038.stdout:4/616: unlink d2/l9c 0 2024-09-13T18:30:36.524 INFO:tasks.workunit.client.0.smithi038.stdout:4/617: write d2/df/d1b/f51 [2565003,61130] 0 2024-09-13T18:30:36.530 INFO:tasks.workunit.client.0.smithi038.stdout:5/439: sync 2024-09-13T18:30:36.530 INFO:tasks.workunit.client.0.smithi038.stdout:8/448: sync 2024-09-13T18:30:36.530 INFO:tasks.workunit.client.0.smithi038.stdout:5/440: readlink df/d15/d50/l59 0 2024-09-13T18:30:36.530 INFO:tasks.workunit.client.0.smithi038.stdout:1/445: sync 2024-09-13T18:30:36.531 INFO:tasks.workunit.client.0.smithi038.stdout:3/337: sync 2024-09-13T18:30:36.531 INFO:tasks.workunit.client.0.smithi038.stdout:9/398: sync 2024-09-13T18:30:36.531 INFO:tasks.workunit.client.0.smithi038.stdout:0/407: sync 2024-09-13T18:30:36.531 INFO:tasks.workunit.client.0.smithi038.stdout:3/338: chown d0/dd/l1b 0 1 2024-09-13T18:30:36.531 INFO:tasks.workunit.client.0.smithi038.stdout:6/398: sync 2024-09-13T18:30:36.536 INFO:tasks.workunit.client.0.smithi038.stdout:8/449: mknod d1/de/d15/d30/c93 0 2024-09-13T18:30:36.536 INFO:tasks.workunit.client.0.smithi038.stdout:8/450: fdatasync d1/de/d21/d24/d41/f79 0 2024-09-13T18:30:36.536 INFO:tasks.workunit.client.0.smithi038.stdout:8/451: readlink d1/l6 0 2024-09-13T18:30:36.536 INFO:tasks.workunit.client.0.smithi038.stdout:0/408: link d2/dc/l1f d2/d2f/l86 0 2024-09-13T18:30:36.537 INFO:tasks.workunit.client.0.smithi038.stdout:6/399: rmdir dd/de/d31/d63/d83 39 2024-09-13T18:30:36.538 INFO:tasks.workunit.client.0.smithi038.stdout:6/400: write dd/de/d2e/d2f/d4c/f84 [437561,23373] 0 2024-09-13T18:30:36.539 INFO:tasks.workunit.client.0.smithi038.stdout:8/452: creat d1/de/f94 x:0 0 0 2024-09-13T18:30:36.541 INFO:tasks.workunit.client.0.smithi038.stdout:0/409: unlink d2/d7/d24/f69 0 2024-09-13T18:30:36.544 INFO:tasks.workunit.client.0.smithi038.stdout:8/453: rename d1/c1a to d1/de/d21/c95 0 2024-09-13T18:30:36.545 INFO:tasks.workunit.client.0.smithi038.stdout:8/454: getdents d1/d2a/d5b 0 2024-09-13T18:30:36.556 INFO:tasks.workunit.client.0.smithi038.stdout:5/441: write df/d13/d3b/d44/d48/d56/f5f [4145987,37601] 0 2024-09-13T18:30:36.561 INFO:tasks.workunit.client.0.smithi038.stdout:5/442: creat df/d13/d3b/d44/d48/d75/f8f x:0 0 0 2024-09-13T18:30:36.561 INFO:tasks.workunit.client.0.smithi038.stdout:5/443: dread - df/d13/d3b/d44/d48/d75/f8f zero size 2024-09-13T18:30:36.561 INFO:tasks.workunit.client.0.smithi038.stdout:5/444: stat df/d13/d3b/d44/d52/c7a 0 2024-09-13T18:30:36.574 INFO:tasks.workunit.client.0.smithi038.stdout:1/446: dwrite d12/f16 [0,4194304] 0 2024-09-13T18:30:36.574 INFO:tasks.workunit.client.0.smithi038.stdout:1/447: read d12/f25 [3962567,25783] 0 2024-09-13T18:30:36.574 INFO:tasks.workunit.client.0.smithi038.stdout:4/618: dwrite d2/f58 [0,4194304] 0 2024-09-13T18:30:36.574 INFO:tasks.workunit.client.0.smithi038.stdout:4/619: readlink d2/l26 0 2024-09-13T18:30:36.574 INFO:tasks.workunit.client.0.smithi038.stdout:4/620: readlink d2/d49/d50/da0/d8/l3e 0 2024-09-13T18:30:36.574 INFO:tasks.workunit.client.0.smithi038.stdout:4/621: write d2/df/d1b/d10/da3/fc6 [932758,125261] 0 2024-09-13T18:30:36.581 INFO:tasks.workunit.client.0.smithi038.stdout:7/360: dwrite db/d12/d13/f32 [0,4194304] 0 2024-09-13T18:30:36.585 INFO:tasks.workunit.client.0.smithi038.stdout:4/622: read d2/d49/f5b [2641834,105310] 0 2024-09-13T18:30:36.587 INFO:tasks.workunit.client.0.smithi038.stdout:2/316: dwrite d2/d1e/d44/d50/f2e [4194304,4194304] 0 2024-09-13T18:30:36.587 INFO:tasks.workunit.client.0.smithi038.stdout:4/623: link d2/df/d1b/d10/da3/f7e d2/df/d22/d9a/fc7 0 2024-09-13T18:30:36.590 INFO:tasks.workunit.client.0.smithi038.stdout:4/624: link d2/df/d1b/d10/d55/l57 d2/df/lc8 0 2024-09-13T18:30:36.591 INFO:tasks.workunit.client.0.smithi038.stdout:4/625: fdatasync d2/fbe 0 2024-09-13T18:30:36.591 INFO:tasks.workunit.client.0.smithi038.stdout:4/626: write d2/df/d1b/d10/d71/f81 [940334,122916] 0 2024-09-13T18:30:36.591 INFO:tasks.workunit.client.0.smithi038.stdout:2/317: rmdir d2/d1e/d44/d50/d46 39 2024-09-13T18:30:36.591 INFO:tasks.workunit.client.0.smithi038.stdout:2/318: chown d2/d1e/d48/l4b 77326 1 2024-09-13T18:30:36.591 INFO:tasks.workunit.client.0.smithi038.stdout:2/319: write d2/f34 [4253569,45445] 0 2024-09-13T18:30:36.592 INFO:tasks.workunit.client.0.smithi038.stdout:1/448: write d12/d3c/d46/f7c [3622915,122165] 0 2024-09-13T18:30:36.593 INFO:tasks.workunit.client.0.smithi038.stdout:4/627: creat d2/df/d1b/d10/fc9 x:0 0 0 2024-09-13T18:30:36.594 INFO:tasks.workunit.client.0.smithi038.stdout:2/320: mknod d2/d1e/d44/d50/d46/d58/c79 0 2024-09-13T18:30:36.595 INFO:tasks.workunit.client.0.smithi038.stdout:2/321: mknod d2/d1e/d48/c7a 0 2024-09-13T18:30:36.596 INFO:tasks.workunit.client.0.smithi038.stdout:2/322: mknod d2/da/d74/c7b 0 2024-09-13T18:30:36.596 INFO:tasks.workunit.client.0.smithi038.stdout:7/361: dread db/d12/d13/f32 [0,4194304] 0 2024-09-13T18:30:36.596 INFO:tasks.workunit.client.0.smithi038.stdout:9/399: dwrite d0/d2e/f7c [0,4194304] 0 2024-09-13T18:30:36.597 INFO:tasks.workunit.client.0.smithi038.stdout:7/362: write db/d12/d1c/d3a/d22/d28/f6e [937733,120288] 0 2024-09-13T18:30:36.597 INFO:tasks.workunit.client.0.smithi038.stdout:2/323: rename d2/d1e/d44/d50/d39/l6d to d2/d1e/l7c 0 2024-09-13T18:30:36.598 INFO:tasks.workunit.client.0.smithi038.stdout:9/400: symlink d0/d7/d13/l90 0 2024-09-13T18:30:36.599 INFO:tasks.workunit.client.0.smithi038.stdout:7/363: mknod db/d12/d1c/d3a/d3c/c85 0 2024-09-13T18:30:36.602 INFO:tasks.workunit.client.0.smithi038.stdout:9/401: rename d0/d7/d2c/d5a/d69/c7e to d0/d7/d13/d2d/d3e/d70/c91 0 2024-09-13T18:30:36.602 INFO:tasks.workunit.client.0.smithi038.stdout:9/402: chown d0/d7/d2c/d5e 511742 1 2024-09-13T18:30:36.604 INFO:tasks.workunit.client.0.smithi038.stdout:9/403: rename d0/d7/d13/c3a to d0/d7/d2c/d5e/c92 0 2024-09-13T18:30:36.604 INFO:tasks.workunit.client.0.smithi038.stdout:9/404: dread - d0/d7/f89 zero size 2024-09-13T18:30:36.604 INFO:tasks.workunit.client.0.smithi038.stdout:8/455: dwrite d1/de/d21/d24/f7a [0,4194304] 0 2024-09-13T18:30:36.604 INFO:tasks.workunit.client.0.smithi038.stdout:8/456: write d1/d2a/d3f/f7e [4940065,84446] 0 2024-09-13T18:30:36.605 INFO:tasks.workunit.client.0.smithi038.stdout:0/410: dwrite d2/d2f/d66/d49/f65 [0,4194304] 0 2024-09-13T18:30:36.607 INFO:tasks.workunit.client.0.smithi038.stdout:5/445: dwrite df/f2a [0,4194304] 0 2024-09-13T18:30:36.615 INFO:tasks.workunit.client.0.smithi038.stdout:0/411: mkdir d2/d2f/d40/d87 0 2024-09-13T18:30:36.615 INFO:tasks.workunit.client.0.smithi038.stdout:0/412: write d2/d7/d24/f84 [584308,63701] 0 2024-09-13T18:30:36.615 INFO:tasks.workunit.client.0.smithi038.stdout:0/413: chown d2/d7/d24/d3c/d3f/f5a 0 1 2024-09-13T18:30:36.618 INFO:tasks.workunit.client.0.smithi038.stdout:5/446: creat df/d13/d3b/d44/d48/d54/f90 x:0 0 0 2024-09-13T18:30:36.621 INFO:tasks.workunit.client.0.smithi038.stdout:4/628: write d2/df/d1b/f73 [2464458,10837] 0 2024-09-13T18:30:36.621 INFO:tasks.workunit.client.0.smithi038.stdout:6/401: dwrite dd/de/d2e/d2f/d4c/d60/f73 [0,4194304] 0 2024-09-13T18:30:36.621 INFO:tasks.workunit.client.0.smithi038.stdout:4/629: stat d2/df/d1b/d10/fc9 0 2024-09-13T18:30:36.622 INFO:tasks.workunit.client.0.smithi038.stdout:0/414: rename d2/d7/d24/d3c/f3d to d2/d7/d24/d2b/f88 0 2024-09-13T18:30:36.622 INFO:tasks.workunit.client.0.smithi038.stdout:1/449: dwrite d12/d2a/d32/f36 [0,4194304] 0 2024-09-13T18:30:36.623 INFO:tasks.workunit.client.0.smithi038.stdout:2/324: dwrite d2/da/f1b [0,4194304] 0 2024-09-13T18:30:36.636 INFO:tasks.workunit.client.0.smithi038.stdout:5/447: dwrite df/d13/d3b/d41/f7f [0,4194304] 0 2024-09-13T18:30:36.636 INFO:tasks.workunit.client.0.smithi038.stdout:5/448: chown df/d13/d3b/d44/d52/l7d 129 1 2024-09-13T18:30:36.641 INFO:tasks.workunit.client.0.smithi038.stdout:6/402: rename dd/de/d31/d63/f7d to dd/de/d2e/d2f/d71/f97 0 2024-09-13T18:30:36.641 INFO:tasks.workunit.client.0.smithi038.stdout:6/403: chown dd/de/d2e/d2f/d71/c89 27256 1 2024-09-13T18:30:36.646 INFO:tasks.workunit.client.0.smithi038.stdout:9/405: rmdir d0/d7/d2c/d5a 39 2024-09-13T18:30:36.646 INFO:tasks.workunit.client.0.smithi038.stdout:9/406: read d0/d7/d2c/d5a/d69/f6b [111950,87554] 0 2024-09-13T18:30:36.647 INFO:tasks.workunit.client.0.smithi038.stdout:1/450: symlink d12/d3c/d46/d58/l8b 0 2024-09-13T18:30:36.647 INFO:tasks.workunit.client.0.smithi038.stdout:1/451: readlink d12/d2a/d32/d59/d5b/l5f 0 2024-09-13T18:30:36.648 INFO:tasks.workunit.client.0.smithi038.stdout:1/452: write d12/f7d [4566654,52233] 0 2024-09-13T18:30:36.656 INFO:tasks.workunit.client.0.smithi038.stdout:5/449: getdents df/d13/d3b/d3e 0 2024-09-13T18:30:36.656 INFO:tasks.workunit.client.0.smithi038.stdout:5/450: dread - df/d13/d3b/d44/d58/f87 zero size 2024-09-13T18:30:36.661 INFO:tasks.workunit.client.0.smithi038.stdout:6/404: stat l7 0 2024-09-13T18:30:36.665 INFO:tasks.workunit.client.0.smithi038.stdout:0/415: mkdir d2/d89 0 2024-09-13T18:30:36.667 INFO:tasks.workunit.client.0.smithi038.stdout:9/407: mkdir d0/d7/d93 0 2024-09-13T18:30:36.674 INFO:tasks.workunit.client.0.smithi038.stdout:6/405: mkdir dd/de/d2e/d2f/d4c/d55/d98 0 2024-09-13T18:30:36.677 INFO:tasks.workunit.client.0.smithi038.stdout:9/408: unlink d0/d7/d2c/d5e/c6c 0 2024-09-13T18:30:36.677 INFO:tasks.workunit.client.0.smithi038.stdout:1/453: dwrite d12/d3c/d46/f7c [0,4194304] 0 2024-09-13T18:30:36.677 INFO:tasks.workunit.client.0.smithi038.stdout:0/416: dread d2/f1c [0,4194304] 0 2024-09-13T18:30:36.677 INFO:tasks.workunit.client.0.smithi038.stdout:0/417: write d2/d2f/d40/d74/f77 [679533,69827] 0 2024-09-13T18:30:36.678 INFO:tasks.workunit.client.0.smithi038.stdout:5/451: dwrite df/d15/d36/f86 [0,4194304] 0 2024-09-13T18:30:36.680 INFO:tasks.workunit.client.0.smithi038.stdout:9/409: mkdir d0/d7/d13/d2d/d3c/d50/d94 0 2024-09-13T18:30:36.680 INFO:tasks.workunit.client.0.smithi038.stdout:9/410: chown d0/d7/d13 5799 1 2024-09-13T18:30:36.683 INFO:tasks.workunit.client.0.smithi038.stdout:1/454: link d12/f16 d12/f8c 0 2024-09-13T18:30:36.684 INFO:tasks.workunit.client.0.smithi038.stdout:4/630: truncate d2/d49/d50/da0/d8/d3b/f94 216900 0 2024-09-13T18:30:36.686 INFO:tasks.workunit.client.0.smithi038.stdout:0/418: unlink d2/dc/c6b 0 2024-09-13T18:30:36.690 INFO:tasks.workunit.client.0.smithi038.stdout:5/452: symlink df/d13/d3b/d41/l91 0 2024-09-13T18:30:36.690 INFO:tasks.workunit.client.0.smithi038.stdout:5/453: creat df/d13/d3b/d44/d58/f92 x:0 0 0 2024-09-13T18:30:36.698 INFO:tasks.workunit.client.0.smithi038.stdout:9/411: creat d0/d7/d2c/d5a/f95 x:0 0 0 2024-09-13T18:30:36.698 INFO:tasks.workunit.client.0.smithi038.stdout:9/412: creat d0/d7/d2c/d33/f96 x:0 0 0 2024-09-13T18:30:36.698 INFO:tasks.workunit.client.0.smithi038.stdout:9/413: creat d0/d7/d2c/d5e/f97 x:0 0 0 2024-09-13T18:30:36.698 INFO:tasks.workunit.client.0.smithi038.stdout:9/414: write d0/d7/d2c/d5e/f80 [4022060,100487] 0 2024-09-13T18:30:36.704 INFO:tasks.workunit.client.0.smithi038.stdout:4/631: unlink d2/df/d1b/d10/d55/f7f 0 2024-09-13T18:30:36.705 INFO:tasks.workunit.client.0.smithi038.stdout:4/632: dread - d2/d49/d50/da0/d8/d80/fae zero size 2024-09-13T18:30:36.706 INFO:tasks.workunit.client.0.smithi038.stdout:5/454: dwrite df/d15/f3d [0,4194304] 0 2024-09-13T18:30:36.706 INFO:tasks.workunit.client.0.smithi038.stdout:5/455: write df/d13/d3b/d44/f46 [2616003,48119] 0 2024-09-13T18:30:36.707 INFO:tasks.workunit.client.0.smithi038.stdout:9/415: dread d0/d7/d2c/d33/d4a/f57 [0,4194304] 0 2024-09-13T18:30:36.708 INFO:tasks.workunit.client.0.smithi038.stdout:9/416: creat d0/d7/d13/d2d/d3c/d50/f98 x:0 0 0 2024-09-13T18:30:36.708 INFO:tasks.workunit.client.0.smithi038.stdout:9/417: stat d0/d7/d93 0 2024-09-13T18:30:36.709 INFO:tasks.workunit.client.0.smithi038.stdout:6/406: rename dd/de/d31/d63/d72 to dd/de/d2e/d99 0 2024-09-13T18:30:36.709 INFO:tasks.workunit.client.0.smithi038.stdout:6/407: chown dd/de/d31/f52 212979449 1 2024-09-13T18:30:36.711 INFO:tasks.workunit.client.0.smithi038.stdout:1/455: getdents d12/d2a/d32/d59 0 2024-09-13T18:30:36.713 INFO:tasks.workunit.client.0.smithi038.stdout:4/633: rmdir d2/d49/d4b/dc0 39 2024-09-13T18:30:36.715 INFO:tasks.workunit.client.0.smithi038.stdout:4/634: write d2/fc1 [479017,50255] 0 2024-09-13T18:30:36.715 INFO:tasks.workunit.client.0.smithi038.stdout:4/635: chown d2/d49/d50/lbd 19 1 2024-09-13T18:30:36.715 INFO:tasks.workunit.client.0.smithi038.stdout:4/636: write d2/d49/d50/da0/d8/f23 [2288994,53057] 0 2024-09-13T18:30:36.716 INFO:tasks.workunit.client.0.smithi038.stdout:9/418: symlink d0/d7/d13/l99 0 2024-09-13T18:30:36.717 INFO:tasks.workunit.client.0.smithi038.stdout:6/408: mknod dd/de/d2e/d99/c9a 0 2024-09-13T18:30:36.718 INFO:tasks.workunit.client.0.smithi038.stdout:1/456: mkdir d12/d2a/d72/d8d 0 2024-09-13T18:30:36.718 INFO:tasks.workunit.client.0.smithi038.stdout:1/457: fdatasync d12/d2a/f4d 0 2024-09-13T18:30:36.718 INFO:tasks.workunit.client.0.smithi038.stdout:1/458: getdents d12/d7a 0 2024-09-13T18:30:36.718 INFO:tasks.workunit.client.0.smithi038.stdout:1/459: fdatasync d12/d2a/d32/f60 0 2024-09-13T18:30:36.719 INFO:tasks.workunit.client.0.smithi038.stdout:4/637: mkdir d2/df/d1b/d10/dca 0 2024-09-13T18:30:36.719 INFO:tasks.workunit.client.0.smithi038.stdout:4/638: write d2/df/d22/f70 [1937267,97276] 0 2024-09-13T18:30:36.719 INFO:tasks.workunit.client.0.smithi038.stdout:4/639: write d2/d49/d50/da0/d8/d80/fae [105748,122023] 0 2024-09-13T18:30:36.719 INFO:tasks.workunit.client.0.smithi038.stdout:4/640: readlink d2/df/d1b/d10/d71/la1 0 2024-09-13T18:30:36.720 INFO:tasks.workunit.client.0.smithi038.stdout:9/419: rename d0/l7d to d0/d7/d13/d2d/d3e/d70/l9a 0 2024-09-13T18:30:36.722 INFO:tasks.workunit.client.0.smithi038.stdout:1/460: mkdir d12/d2a/d8e 0 2024-09-13T18:30:36.722 INFO:tasks.workunit.client.0.smithi038.stdout:6/409: dread dd/de/f4f [0,4194304] 0 2024-09-13T18:30:36.722 INFO:tasks.workunit.client.0.smithi038.stdout:6/410: fsync dd/de/d2e/d2f/d4c/d55/f7e 0 2024-09-13T18:30:36.723 INFO:tasks.workunit.client.0.smithi038.stdout:5/456: dwrite df/f66 [0,4194304] 0 2024-09-13T18:30:36.723 INFO:tasks.workunit.client.0.smithi038.stdout:5/457: dread - df/d13/d3b/d44/d48/d54/f90 zero size 2024-09-13T18:30:36.724 INFO:tasks.workunit.client.0.smithi038.stdout:9/420: creat d0/d7/d2c/d5a/d69/f9b x:0 0 0 2024-09-13T18:30:36.727 INFO:tasks.workunit.client.0.smithi038.stdout:1/461: mknod d12/c8f 0 2024-09-13T18:30:36.727 INFO:tasks.workunit.client.0.smithi038.stdout:1/462: truncate d12/d2a/f4d 1936637 0 2024-09-13T18:30:36.727 INFO:tasks.workunit.client.0.smithi038.stdout:1/463: write d12/f3e [1059903,46268] 0 2024-09-13T18:30:36.727 INFO:tasks.workunit.client.0.smithi038.stdout:1/464: creat d12/d2a/d32/d59/d5e/f90 x:0 0 0 2024-09-13T18:30:36.730 INFO:tasks.workunit.client.0.smithi038.stdout:9/421: write d0/d7/d2c/d33/d4a/f57 [596090,69131] 0 2024-09-13T18:30:36.730 INFO:tasks.workunit.client.0.smithi038.stdout:9/422: readlink d0/d7/d13/l99 0 2024-09-13T18:30:36.731 INFO:tasks.workunit.client.0.smithi038.stdout:9/423: stat d0/d7/d2c/d5e/f8a 0 2024-09-13T18:30:36.731 INFO:tasks.workunit.client.0.smithi038.stdout:5/458: dread df/d13/d3b/f4d [0,4194304] 0 2024-09-13T18:30:36.739 INFO:tasks.workunit.client.0.smithi038.stdout:1/465: write d12/f13 [728430,13809] 0 2024-09-13T18:30:36.743 INFO:tasks.workunit.client.0.smithi038.stdout:4/641: getdents d2/df/d1b/d10 0 2024-09-13T18:30:36.744 INFO:tasks.workunit.client.0.smithi038.stdout:1/466: creat d12/d7a/f91 x:0 0 0 2024-09-13T18:30:36.746 INFO:tasks.workunit.client.0.smithi038.stdout:5/459: dread df/f2a [0,4194304] 0 2024-09-13T18:30:36.746 INFO:tasks.workunit.client.0.smithi038.stdout:5/460: fsync df/d13/d3b/d44/d58/f92 0 2024-09-13T18:30:36.746 INFO:tasks.workunit.client.0.smithi038.stdout:5/461: write df/d13/d3b/d3e/f33 [64505,115931] 0 2024-09-13T18:30:36.747 INFO:tasks.workunit.client.0.smithi038.stdout:4/642: mkdir d2/d49/d50/da0/dcb 0 2024-09-13T18:30:36.747 INFO:tasks.workunit.client.0.smithi038.stdout:4/643: write d2/d49/d50/fa8 [361903,80961] 0 2024-09-13T18:30:36.747 INFO:tasks.workunit.client.0.smithi038.stdout:1/467: symlink d12/d7a/l92 0 2024-09-13T18:30:36.748 INFO:tasks.workunit.client.0.smithi038.stdout:5/462: symlink df/d13/l93 0 2024-09-13T18:30:36.750 INFO:tasks.workunit.client.0.smithi038.stdout:6/411: dwrite dd/de/d2e/d30/f22 [0,4194304] 0 2024-09-13T18:30:36.751 INFO:tasks.workunit.client.0.smithi038.stdout:9/424: dwrite d0/d7/d13/f85 [0,4194304] 0 2024-09-13T18:30:36.751 INFO:tasks.workunit.client.0.smithi038.stdout:9/425: getdents d0/d7/d13/d2d/d3e/d70/d8d 0 2024-09-13T18:30:36.752 INFO:tasks.workunit.client.0.smithi038.stdout:4/644: dread d2/df/d1b/f51 [0,4194304] 0 2024-09-13T18:30:36.757 INFO:tasks.workunit.client.0.smithi038.stdout:6/412: truncate dd/de/f1a 369562 0 2024-09-13T18:30:36.763 INFO:tasks.workunit.client.0.smithi038.stdout:1/468: truncate d12/f13 7634378 0 2024-09-13T18:30:36.766 INFO:tasks.workunit.client.0.smithi038.stdout:6/413: dread dd/de/d31/f54 [0,4194304] 0 2024-09-13T18:30:36.766 INFO:tasks.workunit.client.0.smithi038.stdout:9/426: rename d0/d7/d13/d2d/d3e/d70/d8d to d0/d7/d2c/d6d/d9c 0 2024-09-13T18:30:36.766 INFO:tasks.workunit.client.0.smithi038.stdout:6/414: readlink dd/l1f 0 2024-09-13T18:30:36.766 INFO:tasks.workunit.client.0.smithi038.stdout:6/415: fdatasync dd/de/d2e/d30/f42 0 2024-09-13T18:30:36.769 INFO:tasks.workunit.client.0.smithi038.stdout:5/463: dwrite df/d13/d3b/d44/f51 [0,4194304] 0 2024-09-13T18:30:36.786 INFO:tasks.workunit.client.0.smithi038.stdout:4/645: symlink d2/d49/d50/lcc 0 2024-09-13T18:30:36.787 INFO:tasks.workunit.client.0.smithi038.stdout:4/646: dread d2/df/fa6 [0,4194304] 0 2024-09-13T18:30:36.790 INFO:tasks.workunit.client.0.smithi038.stdout:1/469: symlink d12/d2a/l93 0 2024-09-13T18:30:36.790 INFO:tasks.workunit.client.0.smithi038.stdout:1/470: creat d12/d3c/d46/f94 x:0 0 0 2024-09-13T18:30:36.793 INFO:tasks.workunit.client.0.smithi038.stdout:9/427: mknod d0/d7/d93/c9d 0 2024-09-13T18:30:36.797 INFO:tasks.workunit.client.0.smithi038.stdout:6/416: rmdir dd/de/d2e/d2f/d4c/d55/d98 0 2024-09-13T18:30:36.802 INFO:tasks.workunit.client.0.smithi038.stdout:4/647: dwrite d2/df/d1b/d10/f7c [0,4194304] 0 2024-09-13T18:30:36.803 INFO:tasks.workunit.client.0.smithi038.stdout:5/464: unlink df/d13/l93 0 2024-09-13T18:30:36.803 INFO:tasks.workunit.client.0.smithi038.stdout:5/465: fdatasync df/d13/d3b/d44/d48/d54/f90 0 2024-09-13T18:30:36.806 INFO:tasks.workunit.client.0.smithi038.stdout:6/417: write dd/de/d2e/d2f/d4c/d55/f5e [4073202,31938] 0 2024-09-13T18:30:36.808 INFO:tasks.workunit.client.0.smithi038.stdout:1/471: rename d12/d2a/d32/l3d to d12/d2a/d8e/l95 0 2024-09-13T18:30:36.814 INFO:tasks.workunit.client.0.smithi038.stdout:5/466: mkdir df/d13/d3b/d44/d58/d94 0 2024-09-13T18:30:36.816 INFO:tasks.workunit.client.0.smithi038.stdout:6/418: mkdir dd/de/d2e/d9b 0 2024-09-13T18:30:36.816 INFO:tasks.workunit.client.0.smithi038.stdout:6/419: chown dd/de/d2e/d2f 523902747 1 2024-09-13T18:30:36.816 INFO:tasks.workunit.client.0.smithi038.stdout:6/420: write dd/f44 [483442,83381] 0 2024-09-13T18:30:36.816 INFO:tasks.workunit.client.0.smithi038.stdout:1/472: dread d12/f1a [0,4194304] 0 2024-09-13T18:30:36.820 INFO:tasks.workunit.client.0.smithi038.stdout:4/648: getdents d2/d49/d50 0 2024-09-13T18:30:36.820 INFO:tasks.workunit.client.0.smithi038.stdout:4/649: creat d2/d49/d50/da0/d8/d80/fcd x:0 0 0 2024-09-13T18:30:36.822 INFO:tasks.workunit.client.0.smithi038.stdout:1/473: symlink d12/d3c/d46/d58/l96 0 2024-09-13T18:30:36.823 INFO:tasks.workunit.client.0.smithi038.stdout:5/467: write df/d13/d3b/d41/f7f [905101,106348] 0 2024-09-13T18:30:36.823 INFO:tasks.workunit.client.0.smithi038.stdout:5/468: write df/d13/d3b/d3e/f5a [1292952,101910] 0 2024-09-13T18:30:36.826 INFO:tasks.workunit.client.0.smithi038.stdout:4/650: mkdir d2/d49/dce 0 2024-09-13T18:30:36.828 INFO:tasks.workunit.client.0.smithi038.stdout:1/474: truncate d12/d2a/d32/d59/d5b/f1e 407579 0 2024-09-13T18:30:36.830 INFO:tasks.workunit.client.0.smithi038.stdout:9/428: rename d0/d7/d2c/d5a/d69 to d0/d7/d2c/d5a/d67/d9e 0 2024-09-13T18:30:36.830 INFO:tasks.workunit.client.0.smithi038.stdout:9/429: read - d0/d7/d2c/d5e/f8a zero size 2024-09-13T18:30:36.830 INFO:tasks.workunit.client.0.smithi038.stdout:9/430: read - d0/d7/d2c/d5a/f95 zero size 2024-09-13T18:30:36.833 INFO:tasks.workunit.client.0.smithi038.stdout:5/469: creat df/d13/d3b/d44/d48/f95 x:0 0 0 2024-09-13T18:30:36.836 INFO:tasks.workunit.client.0.smithi038.stdout:4/651: rmdir d2/df/d1b/d10/dca 0 2024-09-13T18:30:36.840 INFO:tasks.workunit.client.0.smithi038.stdout:1/475: dread d12/d2a/d32/f36 [0,4194304] 0 2024-09-13T18:30:36.840 INFO:tasks.workunit.client.0.smithi038.stdout:1/476: creat d12/d3c/d46/d57/f97 x:0 0 0 2024-09-13T18:30:36.841 INFO:tasks.workunit.client.0.smithi038.stdout:6/421: rename dd/l1f to dd/de/d2e/d9b/l9c 0 2024-09-13T18:30:36.841 INFO:tasks.workunit.client.0.smithi038.stdout:9/431: dread d0/d7/f31 [0,4194304] 0 2024-09-13T18:30:36.841 INFO:tasks.workunit.client.0.smithi038.stdout:6/422: creat dd/de/d2e/d2f/d4c/d55/f9d x:0 0 0 2024-09-13T18:30:36.841 INFO:tasks.workunit.client.0.smithi038.stdout:6/423: chown dd/de/d2e/d30/f29 17 1 2024-09-13T18:30:36.841 INFO:tasks.workunit.client.0.smithi038.stdout:9/432: chown d0/d7/d13/d2d/d3e 835897575 1 2024-09-13T18:30:36.842 INFO:tasks.workunit.client.0.smithi038.stdout:4/652: creat d2/d49/d50/fcf x:0 0 0 2024-09-13T18:30:36.843 INFO:tasks.workunit.client.0.smithi038.stdout:4/653: creat d2/fd0 x:0 0 0 2024-09-13T18:30:36.843 INFO:tasks.workunit.client.0.smithi038.stdout:4/654: write d2/d49/d50/fcf [269713,114704] 0 2024-09-13T18:30:36.844 INFO:tasks.workunit.client.0.smithi038.stdout:5/470: write df/d13/d3b/d44/d48/d75/f7b [1228174,43729] 0 2024-09-13T18:30:36.858 INFO:tasks.workunit.client.0.smithi038.stdout:1/477: dread d12/d2a/d32/d59/d5b/f20 [0,4194304] 0 2024-09-13T18:30:36.859 INFO:tasks.workunit.client.0.smithi038.stdout:1/478: chown d12/d3c/d46/d58/l96 3176585 1 2024-09-13T18:30:36.859 INFO:tasks.workunit.client.0.smithi038.stdout:1/479: write d12/d2a/d32/d59/d5b/f35 [74699,6813] 0 2024-09-13T18:30:36.863 INFO:tasks.workunit.client.0.smithi038.stdout:9/433: dwrite d0/d7/d13/f66 [0,4194304] 0 2024-09-13T18:30:36.863 INFO:tasks.workunit.client.0.smithi038.stdout:9/434: dread - d0/d7/f35 zero size 2024-09-13T18:30:36.863 INFO:tasks.workunit.client.0.smithi038.stdout:9/435: creat d0/d7/d13/d2d/d3e/d70/d7b/f9f x:0 0 0 2024-09-13T18:30:36.873 INFO:tasks.workunit.client.0.smithi038.stdout:1/480: dwrite d12/d2a/d32/d59/d5b/d47/f8a [0,4194304] 0 2024-09-13T18:30:36.874 INFO:tasks.workunit.client.0.smithi038.stdout:1/481: fdatasync d12/d2a/d32/d59/d5b/f7e 0 2024-09-13T18:30:36.874 INFO:tasks.workunit.client.0.smithi038.stdout:1/482: truncate d12/f39 970581 0 2024-09-13T18:30:36.881 INFO:tasks.workunit.client.0.smithi038.stdout:9/436: dwrite d0/d7/f35 [0,4194304] 0 2024-09-13T18:30:36.887 INFO:tasks.workunit.client.0.smithi038.stdout:1/483: dread d12/d3c/d46/f7c [0,4194304] 0 2024-09-13T18:30:36.888 INFO:tasks.workunit.client.0.smithi038.stdout:1/484: readlink d12/l3f 0 2024-09-13T18:30:36.897 INFO:tasks.workunit.client.0.smithi038.stdout:6/424: rename dd/de/d2e/d30/d27/f96 to dd/de/d2e/d2f/f9e 0 2024-09-13T18:30:36.902 INFO:tasks.workunit.client.0.smithi038.stdout:5/471: truncate f8 1366530 0 2024-09-13T18:30:36.908 INFO:tasks.workunit.client.0.smithi038.stdout:1/485: dwrite d12/f25 [0,4194304] 0 2024-09-13T18:30:36.908 INFO:tasks.workunit.client.0.smithi038.stdout:1/486: readlink d12/d2a/l49 0 2024-09-13T18:30:36.908 INFO:tasks.workunit.client.0.smithi038.stdout:1/487: stat d12/d2a/d32/d59/d5b/f42 0 2024-09-13T18:30:36.914 INFO:tasks.workunit.client.0.smithi038.stdout:5/472: dread df/d13/d3b/d44/d48/d75/f7b [0,4194304] 0 2024-09-13T18:30:36.917 INFO:tasks.workunit.client.0.smithi038.stdout:4/655: rename d2/d49/d50/da0/d8/d3b/l5e to d2/d49/d4b/ld1 0 2024-09-13T18:30:36.918 INFO:tasks.workunit.client.0.smithi038.stdout:1/488: unlink d12/d2a/d32/d59/d5b/f89 0 2024-09-13T18:30:36.918 INFO:tasks.workunit.client.0.smithi038.stdout:6/425: dwrite dd/de/d2e/d2f/f9e [0,4194304] 0 2024-09-13T18:30:36.919 INFO:tasks.workunit.client.0.smithi038.stdout:6/426: fdatasync dd/de/d2e/d99/f7f 0 2024-09-13T18:30:36.919 INFO:tasks.workunit.client.0.smithi038.stdout:5/473: link df/d15/l43 df/l96 0 2024-09-13T18:30:36.919 INFO:tasks.workunit.client.0.smithi038.stdout:6/427: read dd/de/d2e/d2f/d4c/f84 [319629,112070] 0 2024-09-13T18:30:36.920 INFO:tasks.workunit.client.0.smithi038.stdout:4/656: mknod d2/df/d1b/d10/d75/d82/cd2 0 2024-09-13T18:30:36.921 INFO:tasks.workunit.client.0.smithi038.stdout:1/489: creat d12/f98 x:0 0 0 2024-09-13T18:30:36.924 INFO:tasks.workunit.client.0.smithi038.stdout:5/474: rename df/d13/d3b/d44/d48/d75/f7b to df/d13/d3b/d44/d82/f97 0 2024-09-13T18:30:36.928 INFO:tasks.workunit.client.0.smithi038.stdout:4/657: read d2/d49/d50/da0/f16 [5933781,122744] 0 2024-09-13T18:30:36.928 INFO:tasks.workunit.client.0.smithi038.stdout:1/490: symlink d12/d2a/d32/d59/d5b/d47/l99 0 2024-09-13T18:30:36.928 INFO:tasks.workunit.client.0.smithi038.stdout:4/658: stat d2/df/d1b/d10/d71/f81 0 2024-09-13T18:30:36.929 INFO:tasks.workunit.client.0.smithi038.stdout:6/428: rmdir dd/de/d31/d63 39 2024-09-13T18:30:36.930 INFO:tasks.workunit.client.0.smithi038.stdout:4/659: link d2/df/d1b/d10/f46 d2/d49/fd3 0 2024-09-13T18:30:36.931 INFO:tasks.workunit.client.0.smithi038.stdout:9/437: write d0/d7/d13/d2d/d3c/d50/f54 [436051,94712] 0 2024-09-13T18:30:36.933 INFO:tasks.workunit.client.0.smithi038.stdout:6/429: link dd/de/d2e/d2f/d71/c89 dd/de/d61/d62/c9f 0 2024-09-13T18:30:36.933 INFO:tasks.workunit.client.0.smithi038.stdout:6/430: fsync dd/de/d31/f52 0 2024-09-13T18:30:36.934 INFO:tasks.workunit.client.0.smithi038.stdout:4/660: mkdir d2/d49/d50/da0/d8/d3b/dd4 0 2024-09-13T18:30:36.936 INFO:tasks.workunit.client.0.smithi038.stdout:5/475: dread df/d13/d3b/d41/f7f [0,4194304] 0 2024-09-13T18:30:36.936 INFO:tasks.workunit.client.0.smithi038.stdout:5/476: fdatasync df/d13/d3b/f4d 0 2024-09-13T18:30:36.938 INFO:tasks.workunit.client.0.smithi038.stdout:6/431: unlink dd/de/d2e/d30/l2b 0 2024-09-13T18:30:36.938 INFO:tasks.workunit.client.0.smithi038.stdout:6/432: chown dd/de/d31/d63/d8e 40 1 2024-09-13T18:30:36.938 INFO:tasks.workunit.client.0.smithi038.stdout:6/433: stat dd/de/d2e/d30/l36 0 2024-09-13T18:30:36.940 INFO:tasks.workunit.client.0.smithi038.stdout:4/661: mkdir d2/df/d1b/d10/d55/dd5 0 2024-09-13T18:30:36.941 INFO:tasks.workunit.client.0.smithi038.stdout:5/477: symlink df/d15/d36/d67/l98 0 2024-09-13T18:30:36.943 INFO:tasks.workunit.client.0.smithi038.stdout:9/438: rename d0/d2e/c59 to d0/ca0 0 2024-09-13T18:30:36.944 INFO:tasks.workunit.client.0.smithi038.stdout:6/434: mkdir dd/de/d2e/d2f/da0 0 2024-09-13T18:30:36.946 INFO:tasks.workunit.client.0.smithi038.stdout:9/439: mknod d0/d2e/ca1 0 2024-09-13T18:30:36.946 INFO:tasks.workunit.client.0.smithi038.stdout:4/662: dread d2/df/d1b/f51 [0,4194304] 0 2024-09-13T18:30:36.946 INFO:tasks.workunit.client.0.smithi038.stdout:4/663: chown d2/d49/d50 800052928 1 2024-09-13T18:30:36.946 INFO:tasks.workunit.client.0.smithi038.stdout:4/664: fdatasync d2/df/d22/d9a/fc7 0 2024-09-13T18:30:36.946 INFO:tasks.workunit.client.0.smithi038.stdout:6/435: mkdir dd/de/d61/da1 0 2024-09-13T18:30:36.947 INFO:tasks.workunit.client.0.smithi038.stdout:9/440: truncate d0/d7/f35 18571 0 2024-09-13T18:30:36.947 INFO:tasks.workunit.client.0.smithi038.stdout:4/665: symlink d2/df/d1b/d10/ld6 0 2024-09-13T18:30:36.949 INFO:tasks.workunit.client.0.smithi038.stdout:6/436: rename dd/de/d31/f78 to dd/de/d31/fa2 0 2024-09-13T18:30:36.949 INFO:tasks.workunit.client.0.smithi038.stdout:6/437: read - dd/de/d2e/d2f/d4c/d55/f7e zero size 2024-09-13T18:30:36.949 INFO:tasks.workunit.client.0.smithi038.stdout:6/438: write dd/de/d2e/f4b [638903,118020] 0 2024-09-13T18:30:36.950 INFO:tasks.workunit.client.0.smithi038.stdout:4/666: symlink d2/ld7 0 2024-09-13T18:30:36.950 INFO:tasks.workunit.client.0.smithi038.stdout:4/667: creat d2/df/d1b/d10/da3/fd8 x:0 0 0 2024-09-13T18:30:36.951 INFO:tasks.workunit.client.0.smithi038.stdout:5/478: dread df/d13/d3b/f4d [0,4194304] 0 2024-09-13T18:30:36.951 INFO:tasks.workunit.client.0.smithi038.stdout:5/479: read df/d13/d3b/f4a [1544322,31210] 0 2024-09-13T18:30:36.951 INFO:tasks.workunit.client.0.smithi038.stdout:5/480: write df/d13/d3b/f4d [3397354,99796] 0 2024-09-13T18:30:36.951 INFO:tasks.workunit.client.0.smithi038.stdout:5/481: creat df/d13/d3b/d44/d48/d75/f99 x:0 0 0 2024-09-13T18:30:36.951 INFO:tasks.workunit.client.0.smithi038.stdout:6/439: mknod dd/de/ca3 0 2024-09-13T18:30:36.952 INFO:tasks.workunit.client.0.smithi038.stdout:1/491: dwrite d12/f17 [0,4194304] 0 2024-09-13T18:30:36.954 INFO:tasks.workunit.client.0.smithi038.stdout:5/482: getdents df/d13/d3b/d44/d52 0 2024-09-13T18:30:36.958 INFO:tasks.workunit.client.0.smithi038.stdout:1/492: unlink d12/d2a/l52 0 2024-09-13T18:30:36.960 INFO:tasks.workunit.client.0.smithi038.stdout:4/668: write d2/d49/d50/da0/f18 [1553510,18257] 0 2024-09-13T18:30:36.960 INFO:tasks.workunit.client.0.smithi038.stdout:1/493: symlink d12/d2a/d32/d59/d5b/d47/d84/l9a 0 2024-09-13T18:30:36.960 INFO:tasks.workunit.client.0.smithi038.stdout:1/494: write d12/d3c/d46/d57/f97 [331795,103187] 0 2024-09-13T18:30:36.961 INFO:tasks.workunit.client.0.smithi038.stdout:4/669: creat d2/df/d1b/d10/d55/dd5/fd9 x:0 0 0 2024-09-13T18:30:36.961 INFO:tasks.workunit.client.0.smithi038.stdout:4/670: write d2/df/d1b/d10/d75/f7b [1656552,57259] 0 2024-09-13T18:30:36.962 INFO:tasks.workunit.client.0.smithi038.stdout:1/495: mknod d12/d2a/c9b 0 2024-09-13T18:30:36.963 INFO:tasks.workunit.client.0.smithi038.stdout:1/496: fsync d12/f17 0 2024-09-13T18:30:36.964 INFO:tasks.workunit.client.0.smithi038.stdout:1/497: symlink d12/d3c/l9c 0 2024-09-13T18:30:36.966 INFO:tasks.workunit.client.0.smithi038.stdout:6/440: dread dd/de/d2e/d30/d27/f43 [0,4194304] 0 2024-09-13T18:30:36.968 INFO:tasks.workunit.client.0.smithi038.stdout:6/441: rename dd/de/d2e/d30/d27/f33 to dd/de/d2e/d2f/d71/fa4 0 2024-09-13T18:30:36.978 INFO:tasks.workunit.client.0.smithi038.stdout:4/671: read d2/df/d1b/d10/da3/f7e [4754316,92959] 0 2024-09-13T18:30:36.978 INFO:tasks.workunit.client.0.smithi038.stdout:4/672: dread - d2/df/d1b/d10/d75/d82/f83 zero size 2024-09-13T18:30:36.978 INFO:tasks.workunit.client.0.smithi038.stdout:4/673: write d2/d49/d4b/f9b [4318044,49516] 0 2024-09-13T18:30:36.978 INFO:tasks.workunit.client.0.smithi038.stdout:4/674: write d2/d49/d50/da0/f16 [2470258,45436] 0 2024-09-13T18:30:36.979 INFO:tasks.workunit.client.0.smithi038.stdout:3/339: sync 2024-09-13T18:30:36.979 INFO:tasks.workunit.client.0.smithi038.stdout:9/441: dwrite d0/d7/d2c/d5a/d67/d9e/f9b [0,4194304] 0 2024-09-13T18:30:36.983 INFO:tasks.workunit.client.0.smithi038.stdout:5/483: dwrite df/f10 [0,4194304] 0 2024-09-13T18:30:36.983 INFO:tasks.workunit.client.0.smithi038.stdout:5/484: truncate df/d15/f22 5351921 0 2024-09-13T18:30:36.983 INFO:tasks.workunit.client.0.smithi038.stdout:1/498: dread d12/f8c [0,4194304] 0 2024-09-13T18:30:36.985 INFO:tasks.workunit.client.0.smithi038.stdout:3/340: dread d0/dd/d17/d50/d5c/f47 [0,4194304] 0 2024-09-13T18:30:36.987 INFO:tasks.workunit.client.0.smithi038.stdout:4/675: dread d2/d49/d50/fa8 [0,4194304] 0 2024-09-13T18:30:36.995 INFO:tasks.workunit.client.0.smithi038.stdout:1/499: dread d12/d2a/d32/d59/d5b/f41 [0,4194304] 0 2024-09-13T18:30:36.997 INFO:tasks.workunit.client.0.smithi038.stdout:3/341: dread d0/dd/d17/f60 [0,4194304] 0 2024-09-13T18:30:37.011 INFO:tasks.workunit.client.0.smithi038.stdout:6/442: rmdir dd/de/d31 39 2024-09-13T18:30:37.012 INFO:tasks.workunit.client.0.smithi038.stdout:9/442: rename d0/d7/d2c/d5e/d77 to d0/d7/d13/d2d/d3e/d70/da2 0 2024-09-13T18:30:37.013 INFO:tasks.workunit.client.0.smithi038.stdout:1/500: write f10 [974785,39734] 0 2024-09-13T18:30:37.022 INFO:tasks.workunit.client.0.smithi038.stdout:1/501: write d12/f7d [3789607,7388] 0 2024-09-13T18:30:37.047 INFO:tasks.workunit.client.0.smithi038.stdout:5/485: mkdir df/d13/d49/d9a 0 2024-09-13T18:30:37.047 INFO:tasks.workunit.client.0.smithi038.stdout:5/486: dread - df/d13/d3b/d44/d48/d54/f90 zero size 2024-09-13T18:30:37.048 INFO:tasks.workunit.client.0.smithi038.stdout:6/443: mkdir dd/de/d31/d63/d83/da5 0 2024-09-13T18:30:37.048 INFO:tasks.workunit.client.0.smithi038.stdout:6/444: truncate dd/de/d61/f92 498554 0 2024-09-13T18:30:37.048 INFO:tasks.workunit.client.0.smithi038.stdout:6/445: read dd/f44 [387105,49113] 0 2024-09-13T18:30:37.050 INFO:tasks.workunit.client.0.smithi038.stdout:4/676: rename d2/d49/d50/lbf to d2/d49/d50/da0/d8/d80/lda 0 2024-09-13T18:30:37.052 INFO:tasks.workunit.client.0.smithi038.stdout:9/443: mknod d0/d7/d13/d2d/d3c/ca3 0 2024-09-13T18:30:37.056 INFO:tasks.workunit.client.0.smithi038.stdout:1/502: rmdir d12/d2a/d32 39 2024-09-13T18:30:37.057 INFO:tasks.workunit.client.0.smithi038.stdout:5/487: link df/c28 df/d13/c9b 0 2024-09-13T18:30:37.059 INFO:tasks.workunit.client.0.smithi038.stdout:6/446: write dd/de/d2e/d30/f29 [396833,18694] 0 2024-09-13T18:30:37.061 INFO:tasks.workunit.client.0.smithi038.stdout:3/342: rename d0/dd/d17/d50/d5c/d1d/d29/f3b to d0/dd/d17/d50/d5c/f64 0 2024-09-13T18:30:37.062 INFO:tasks.workunit.client.0.smithi038.stdout:9/444: mkdir d0/d7/d2c/d5a/da4 0 2024-09-13T18:30:37.062 INFO:tasks.workunit.client.0.smithi038.stdout:9/445: write d0/f1 [818772,66318] 0 2024-09-13T18:30:37.065 INFO:tasks.workunit.client.0.smithi038.stdout:6/447: mkdir dd/de/d2e/d2f/da6 0 2024-09-13T18:30:37.065 INFO:tasks.workunit.client.0.smithi038.stdout:6/448: write dd/de/d31/f74 [704137,13867] 0 2024-09-13T18:30:37.065 INFO:tasks.workunit.client.0.smithi038.stdout:6/449: fsync dd/de/d61/d62/f82 0 2024-09-13T18:30:37.067 INFO:tasks.workunit.client.0.smithi038.stdout:2/325: sync 2024-09-13T18:30:37.067 INFO:tasks.workunit.client.0.smithi038.stdout:7/364: sync 2024-09-13T18:30:37.067 INFO:tasks.workunit.client.0.smithi038.stdout:8/457: sync 2024-09-13T18:30:37.067 INFO:tasks.workunit.client.0.smithi038.stdout:8/458: write d1/de/d3a/f77 [4633806,62293] 0 2024-09-13T18:30:37.070 INFO:tasks.workunit.client.0.smithi038.stdout:7/365: link db/d12/d1c/d3a/d4b/f77 db/d12/d1c/d3a/d3c/d52/d51/f86 0 2024-09-13T18:30:37.070 INFO:tasks.workunit.client.0.smithi038.stdout:7/366: truncate db/d12/d1c/d3a/d3c/f46 577314 0 2024-09-13T18:30:37.071 INFO:tasks.workunit.client.0.smithi038.stdout:3/343: dread d0/dd/d17/d50/d5c/d23/f2e [0,4194304] 0 2024-09-13T18:30:37.071 INFO:tasks.workunit.client.0.smithi038.stdout:3/344: chown d0/dd/d17/d50/d5c/d23/f2e 1009975 1 2024-09-13T18:30:37.071 INFO:tasks.workunit.client.0.smithi038.stdout:3/345: chown d0/dd/d17/d50/d5c/d1d/d29/d32 332382856 1 2024-09-13T18:30:37.071 INFO:tasks.workunit.client.0.smithi038.stdout:3/346: chown d0/dd/d17/d50/d5c/d1d/d29/d2b/f36 59165 1 2024-09-13T18:30:37.071 INFO:tasks.workunit.client.0.smithi038.stdout:8/459: rename d1/f54 to d1/de/f96 0 2024-09-13T18:30:37.071 INFO:tasks.workunit.client.0.smithi038.stdout:8/460: creat d1/de/d21/d45/f97 x:0 0 0 2024-09-13T18:30:37.073 INFO:tasks.workunit.client.0.smithi038.stdout:7/367: link db/d12/d13/l80 db/d12/d1c/d3a/d22/l87 0 2024-09-13T18:30:37.073 INFO:tasks.workunit.client.0.smithi038.stdout:7/368: write db/d12/d1c/d3a/f1d [2635443,6601] 0 2024-09-13T18:30:37.078 INFO:tasks.workunit.client.0.smithi038.stdout:2/326: write d2/d1e/d44/d50/d46/d58/d59/d62/f70 [3910164,21935] 0 2024-09-13T18:30:37.078 INFO:tasks.workunit.client.0.smithi038.stdout:8/461: unlink d1/d2a/f2e 0 2024-09-13T18:30:37.081 INFO:tasks.workunit.client.0.smithi038.stdout:7/369: creat db/d12/d1c/d3a/d3c/d52/d51/f88 x:0 0 0 2024-09-13T18:30:37.082 INFO:tasks.workunit.client.0.smithi038.stdout:2/327: link d2/da/fd d2/d1e/d44/d50/d39/f7d 0 2024-09-13T18:30:37.082 INFO:tasks.workunit.client.0.smithi038.stdout:2/328: chown d2/d1e/d44/d50/f73 12 1 2024-09-13T18:30:37.083 INFO:tasks.workunit.client.0.smithi038.stdout:2/329: chown d2/d1e/d44/d50/f2e 17196202 1 2024-09-13T18:30:37.083 INFO:tasks.workunit.client.0.smithi038.stdout:6/450: write dd/de/d2e/d2f/d4c/d60/f73 [1568000,58554] 0 2024-09-13T18:30:37.083 INFO:tasks.workunit.client.0.smithi038.stdout:8/462: mkdir d1/d4/d98 0 2024-09-13T18:30:37.083 INFO:tasks.workunit.client.0.smithi038.stdout:8/463: fdatasync d1/de/d21/d45/f97 0 2024-09-13T18:30:37.083 INFO:tasks.workunit.client.0.smithi038.stdout:7/370: dread db/d12/d1c/d3a/f59 [0,4194304] 0 2024-09-13T18:30:37.084 INFO:tasks.workunit.client.0.smithi038.stdout:6/451: dread f1 [0,4194304] 0 2024-09-13T18:30:37.086 INFO:tasks.workunit.client.0.smithi038.stdout:2/330: creat d2/d1e/d44/d50/d46/d58/f7e x:0 0 0 2024-09-13T18:30:37.086 INFO:tasks.workunit.client.0.smithi038.stdout:4/677: dwrite d2/df/d1b/d10/f25 [0,4194304] 0 2024-09-13T18:30:37.087 INFO:tasks.workunit.client.0.smithi038.stdout:8/464: symlink d1/de/d21/d45/l99 0 2024-09-13T18:30:37.087 INFO:tasks.workunit.client.0.smithi038.stdout:8/465: chown d1/de/d15/d30 7 1 2024-09-13T18:30:37.089 INFO:tasks.workunit.client.0.smithi038.stdout:7/371: rename db/d12/d1c/c55 to db/d12/d1c/d3a/d3c/c89 0 2024-09-13T18:30:37.089 INFO:tasks.workunit.client.0.smithi038.stdout:7/372: dread - db/d12/d1c/d3a/d22/f7d zero size 2024-09-13T18:30:37.089 INFO:tasks.workunit.client.0.smithi038.stdout:7/373: chown db/d12 22760 1 2024-09-13T18:30:37.092 INFO:tasks.workunit.client.0.smithi038.stdout:2/331: mknod d2/d1e/d48/c7f 0 2024-09-13T18:30:37.093 INFO:tasks.workunit.client.0.smithi038.stdout:4/678: unlink d2/df/d1b/d10/f88 0 2024-09-13T18:30:37.093 INFO:tasks.workunit.client.0.smithi038.stdout:4/679: chown d2/d49/d50/l79 33758378 1 2024-09-13T18:30:37.094 INFO:tasks.workunit.client.0.smithi038.stdout:8/466: symlink d1/de/d15/d30/l9a 0 2024-09-13T18:30:37.094 INFO:tasks.workunit.client.0.smithi038.stdout:8/467: chown d1/de/d21/d45/f72 99258490 1 2024-09-13T18:30:37.098 INFO:tasks.workunit.client.0.smithi038.stdout:2/332: creat d2/d1e/d44/d50/d46/d58/d59/d62/f80 x:0 0 0 2024-09-13T18:30:37.098 INFO:tasks.workunit.client.0.smithi038.stdout:2/333: readlink d2/d1e/d44/d50/l38 0 2024-09-13T18:30:37.100 INFO:tasks.workunit.client.0.smithi038.stdout:8/468: creat d1/de/d21/d24/d4d/f9b x:0 0 0 2024-09-13T18:30:37.102 INFO:tasks.workunit.client.0.smithi038.stdout:8/469: creat d1/de/d21/d24/d41/d7d/f9c x:0 0 0 2024-09-13T18:30:37.102 INFO:tasks.workunit.client.0.smithi038.stdout:8/470: truncate d1/de/d21/d24/f92 536830 0 2024-09-13T18:30:37.103 INFO:tasks.workunit.client.0.smithi038.stdout:8/471: write d1/de/d21/d24/d4d/f66 [1586090,80767] 0 2024-09-13T18:30:37.103 INFO:tasks.workunit.client.0.smithi038.stdout:8/472: chown d1/de/d21/d45/l99 5 1 2024-09-13T18:30:37.104 INFO:tasks.workunit.client.0.smithi038.stdout:8/473: mknod d1/d4/c9d 0 2024-09-13T18:30:37.122 INFO:tasks.workunit.client.0.smithi038.stdout:1/503: dwrite d12/f17 [0,4194304] 0 2024-09-13T18:30:37.122 INFO:tasks.workunit.client.0.smithi038.stdout:1/504: dread - d12/d2a/f6f zero size 2024-09-13T18:30:37.122 INFO:tasks.workunit.client.0.smithi038.stdout:1/505: write d12/d3c/d46/f94 [644852,98951] 0 2024-09-13T18:30:37.123 INFO:tasks.workunit.client.0.smithi038.stdout:1/506: symlink d12/d3c/l9d 0 2024-09-13T18:30:37.124 INFO:tasks.workunit.client.0.smithi038.stdout:1/507: mknod d12/d2a/d72/c9e 0 2024-09-13T18:30:37.125 INFO:tasks.workunit.client.0.smithi038.stdout:1/508: write d12/f98 [940542,20631] 0 2024-09-13T18:30:37.127 INFO:tasks.workunit.client.0.smithi038.stdout:8/474: write d1/d4/f12 [6375858,54388] 0 2024-09-13T18:30:37.140 INFO:tasks.workunit.client.0.smithi038.stdout:1/509: dread d12/d3c/f40 [0,4194304] 0 2024-09-13T18:30:37.142 INFO:tasks.workunit.client.0.smithi038.stdout:1/510: rename d12/d2a/d72/c9e to d12/d7a/c9f 0 2024-09-13T18:30:37.144 INFO:tasks.workunit.client.0.smithi038.stdout:1/511: link d12/f2b d12/d2a/fa0 0 2024-09-13T18:30:37.145 INFO:tasks.workunit.client.0.smithi038.stdout:5/488: dwrite df/d15/d36/f3a [4194304,4194304] 0 2024-09-13T18:30:37.145 INFO:tasks.workunit.client.0.smithi038.stdout:5/489: chown df/d13/d3b/d44/d48/d56/c8e 849 1 2024-09-13T18:30:37.147 INFO:tasks.workunit.client.0.smithi038.stdout:1/512: truncate d12/d2a/d32/d59/d5b/d47/f80 4143083 0 2024-09-13T18:30:37.148 INFO:tasks.workunit.client.0.smithi038.stdout:1/513: readlink d12/d2a/d32/d59/d5b/d47/d84/l9a 0 2024-09-13T18:30:37.148 INFO:tasks.workunit.client.0.smithi038.stdout:1/514: getdents d12/d2a/d32/d82 0 2024-09-13T18:30:37.148 INFO:tasks.workunit.client.0.smithi038.stdout:3/347: dwrite d0/dd/d17/d50/d5c/d1d/d29/d2b/f4d [0,4194304] 0 2024-09-13T18:30:37.148 INFO:tasks.workunit.client.0.smithi038.stdout:8/475: dwrite d1/d2a/f38 [4194304,4194304] 0 2024-09-13T18:30:37.149 INFO:tasks.workunit.client.0.smithi038.stdout:8/476: truncate d1/de/d21/d45/f73 175907 0 2024-09-13T18:30:37.149 INFO:tasks.workunit.client.0.smithi038.stdout:6/452: dwrite dd/de/d2e/d2f/d4c/d55/f5e [0,4194304] 0 2024-09-13T18:30:37.149 INFO:tasks.workunit.client.0.smithi038.stdout:2/334: dwrite d2/d1e/d44/f75 [0,4194304] 0 2024-09-13T18:30:37.149 INFO:tasks.workunit.client.0.smithi038.stdout:9/446: dwrite d0/d7/d13/f66 [0,4194304] 0 2024-09-13T18:30:37.149 INFO:tasks.workunit.client.0.smithi038.stdout:4/680: dwrite d2/d49/d50/da0/f44 [0,4194304] 0 2024-09-13T18:30:37.150 INFO:tasks.workunit.client.0.smithi038.stdout:1/515: link d12/d2a/d32/d59/c73 d12/d2a/d8e/ca1 0 2024-09-13T18:30:37.151 INFO:tasks.workunit.client.0.smithi038.stdout:3/348: mknod d0/dd/d17/d50/c65 0 2024-09-13T18:30:37.151 INFO:tasks.workunit.client.0.smithi038.stdout:3/349: fdatasync d0/dd/d17/d50/d5c/d1d/d29/d32/f35 0 2024-09-13T18:30:37.155 INFO:tasks.workunit.client.0.smithi038.stdout:9/447: dread d0/d7/d2c/d5a/f72 [4194304,4194304] 0 2024-09-13T18:30:37.158 INFO:tasks.workunit.client.0.smithi038.stdout:8/477: link d1/de/c14 d1/de/d21/d24/d56/d89/c9e 0 2024-09-13T18:30:37.158 INFO:tasks.workunit.client.0.smithi038.stdout:8/478: creat d1/de/d21/f9f x:0 0 0 2024-09-13T18:30:37.159 INFO:tasks.workunit.client.0.smithi038.stdout:3/350: write d0/dd/d17/d50/d5c/d1d/d29/d32/f35 [432828,130106] 0 2024-09-13T18:30:37.159 INFO:tasks.workunit.client.0.smithi038.stdout:3/351: fdatasync d0/dd/d17/d50/d5c/f47 0 2024-09-13T18:30:37.160 INFO:tasks.workunit.client.0.smithi038.stdout:3/352: creat d0/dd/d17/d50/d51/f66 x:0 0 0 2024-09-13T18:30:37.160 INFO:tasks.workunit.client.0.smithi038.stdout:3/353: readlink d0/dd/d17/d50/d51/l5b 0 2024-09-13T18:30:37.166 INFO:tasks.workunit.client.0.smithi038.stdout:7/374: rmdir db/d12/d1c/d3a/d3c/d52/d51 39 2024-09-13T18:30:37.183 INFO:tasks.workunit.client.0.smithi038.stdout:6/453: link dd/de/d2e/d2f/c3d dd/de/d31/ca7 0 2024-09-13T18:30:37.185 INFO:tasks.workunit.client.0.smithi038.stdout:2/335: mknod d2/d1e/d44/d50/d46/d58/d59/c81 0 2024-09-13T18:30:37.188 INFO:tasks.workunit.client.0.smithi038.stdout:4/681: mknod d2/d49/d50/da0/d8/d3b/dd4/cdb 0 2024-09-13T18:30:37.188 INFO:tasks.workunit.client.0.smithi038.stdout:4/682: fsync d2/df/d1b/d10/d75/f8f 0 2024-09-13T18:30:37.189 INFO:tasks.workunit.client.0.smithi038.stdout:4/683: fdatasync d2/df/d1b/d10/d75/f9f 0 2024-09-13T18:30:37.189 INFO:tasks.workunit.client.0.smithi038.stdout:4/684: readlink d2/df/d22/l9 0 2024-09-13T18:30:37.189 INFO:tasks.workunit.client.0.smithi038.stdout:4/685: read d2/df/d1b/d10/f3d [3868031,122500] 0 2024-09-13T18:30:37.190 INFO:tasks.workunit.client.0.smithi038.stdout:1/516: link d12/f37 d12/d3c/fa2 0 2024-09-13T18:30:37.193 INFO:tasks.workunit.client.0.smithi038.stdout:9/448: mkdir d0/d7/d13/d2d/d3c/d50/da5 0 2024-09-13T18:30:37.197 INFO:tasks.workunit.client.0.smithi038.stdout:8/479: creat d1/de/d21/d24/d4d/d50/fa0 x:0 0 0 2024-09-13T18:30:37.200 INFO:tasks.workunit.client.0.smithi038.stdout:3/354: rename d0/dd/d17/d50/d5c/d1d/d29/c2d to d0/dd/d17/d50/d5c/d1d/d29/d2b/c67 0 2024-09-13T18:30:37.201 INFO:tasks.workunit.client.0.smithi038.stdout:7/375: symlink db/d12/d1c/d3a/d26/l8a 0 2024-09-13T18:30:37.201 INFO:tasks.workunit.client.0.smithi038.stdout:7/376: write db/d12/d13/f1b [887632,126365] 0 2024-09-13T18:30:37.202 INFO:tasks.workunit.client.0.smithi038.stdout:9/449: dread d0/d7/d2c/d5e/f80 [0,4194304] 0 2024-09-13T18:30:37.202 INFO:tasks.workunit.client.0.smithi038.stdout:9/450: fsync d0/d2e/d7f/f8e 0 2024-09-13T18:30:37.202 INFO:tasks.workunit.client.0.smithi038.stdout:9/451: fsync d0/d7/d13/d2d/d3c/d50/f65 0 2024-09-13T18:30:37.202 INFO:tasks.workunit.client.0.smithi038.stdout:9/452: readlink d0/d7/d13/l14 0 2024-09-13T18:30:37.203 INFO:tasks.workunit.client.0.smithi038.stdout:1/517: write d12/f16 [2416022,23520] 0 2024-09-13T18:30:37.203 INFO:tasks.workunit.client.0.smithi038.stdout:6/454: link dd/de/d2e/d2f/d4c/d55/f9d dd/de/d2e/d2f/da6/fa8 0 2024-09-13T18:30:37.204 INFO:tasks.workunit.client.0.smithi038.stdout:8/480: truncate d1/de/d21/d24/d4d/d50/d62/d71/f82 7690209 0 2024-09-13T18:30:37.208 INFO:tasks.workunit.client.0.smithi038.stdout:2/336: rename d2/d1e/l6b to d2/d1e/d44/l82 0 2024-09-13T18:30:37.208 INFO:tasks.workunit.client.0.smithi038.stdout:2/337: write d2/d1e/f2f [4252329,95598] 0 2024-09-13T18:30:37.209 INFO:tasks.workunit.client.0.smithi038.stdout:4/686: dwrite d2/df/d1b/d10/d75/f9f [0,4194304] 0 2024-09-13T18:30:37.210 INFO:tasks.workunit.client.0.smithi038.stdout:4/687: dread - d2/fa7 zero size 2024-09-13T18:30:37.210 INFO:tasks.workunit.client.0.smithi038.stdout:7/377: dread db/d12/d1c/f79 [0,4194304] 0 2024-09-13T18:30:37.211 INFO:tasks.workunit.client.0.smithi038.stdout:9/453: mkdir d0/d7/d13/d2d/d3e/d70/da2/da6 0 2024-09-13T18:30:37.211 INFO:tasks.workunit.client.0.smithi038.stdout:9/454: write d0/d7/f45 [969234,106365] 0 2024-09-13T18:30:37.213 INFO:tasks.workunit.client.0.smithi038.stdout:1/518: creat d12/d2a/d72/d8d/fa3 x:0 0 0 2024-09-13T18:30:37.215 INFO:tasks.workunit.client.0.smithi038.stdout:6/455: rename dd/de/d2e/d2f/d71/c89 to dd/de/d2e/d2f/da0/ca9 0 2024-09-13T18:30:37.215 INFO:tasks.workunit.client.0.smithi038.stdout:6/456: readlink dd/de/lf 0 2024-09-13T18:30:37.215 INFO:tasks.workunit.client.0.smithi038.stdout:2/338: mknod d2/c83 0 2024-09-13T18:30:37.216 INFO:tasks.workunit.client.0.smithi038.stdout:2/339: stat d2/d1e/d44/d50/d39/d40 0 2024-09-13T18:30:37.220 INFO:tasks.workunit.client.0.smithi038.stdout:1/519: dread d12/f7d [0,4194304] 0 2024-09-13T18:30:37.220 INFO:tasks.workunit.client.0.smithi038.stdout:1/520: write d12/f13 [3368781,88743] 0 2024-09-13T18:30:37.220 INFO:tasks.workunit.client.0.smithi038.stdout:1/521: stat d12 0 2024-09-13T18:30:37.221 INFO:tasks.workunit.client.0.smithi038.stdout:1/522: write d12/d3c/d46/f94 [375132,7826] 0 2024-09-13T18:30:37.222 INFO:tasks.workunit.client.0.smithi038.stdout:4/688: truncate d2/f33 1116148 0 2024-09-13T18:30:37.223 INFO:tasks.workunit.client.0.smithi038.stdout:4/689: creat d2/d49/d50/fdc x:0 0 0 2024-09-13T18:30:37.225 INFO:tasks.workunit.client.0.smithi038.stdout:7/378: unlink db/d21/c35 0 2024-09-13T18:30:37.225 INFO:tasks.workunit.client.0.smithi038.stdout:7/379: chown db/d12/d1c/d3a/d3c/d52/d51/l70 42 1 2024-09-13T18:30:37.227 INFO:tasks.workunit.client.0.smithi038.stdout:9/455: unlink d0/d7/d13/f19 0 2024-09-13T18:30:37.231 INFO:tasks.workunit.client.0.smithi038.stdout:8/481: dwrite d1/d4/f39 [0,4194304] 0 2024-09-13T18:30:37.234 INFO:tasks.workunit.client.0.smithi038.stdout:2/340: truncate d2/f5 1304874 0 2024-09-13T18:30:37.234 INFO:tasks.workunit.client.0.smithi038.stdout:2/341: write d2/da/f1b [5139646,120424] 0 2024-09-13T18:30:37.234 INFO:tasks.workunit.client.0.smithi038.stdout:4/690: dread d2/df/faf [0,4194304] 0 2024-09-13T18:30:37.241 INFO:tasks.workunit.client.0.smithi038.stdout:1/523: mkdir d12/d3c/d46/d57/da4 0 2024-09-13T18:30:37.241 INFO:tasks.workunit.client.0.smithi038.stdout:1/524: fdatasync d12/d3c/d46/d58/f71 0 2024-09-13T18:30:37.244 INFO:tasks.workunit.client.0.smithi038.stdout:0/419: sync 2024-09-13T18:30:37.252 INFO:tasks.workunit.client.0.smithi038.stdout:1/525: dread d12/f16 [0,4194304] 0 2024-09-13T18:30:37.253 INFO:tasks.workunit.client.0.smithi038.stdout:2/342: dwrite d2/f47 [0,4194304] 0 2024-09-13T18:30:37.272 INFO:tasks.workunit.client.0.smithi038.stdout:4/691: mknod d2/df/d1b/d10/d55/dd5/cdd 0 2024-09-13T18:30:37.275 INFO:tasks.workunit.client.0.smithi038.stdout:0/420: mknod d2/d2f/d66/d49/c8a 0 2024-09-13T18:30:37.277 INFO:tasks.workunit.client.0.smithi038.stdout:7/380: rename db/d12/d1c/c31 to db/c8b 0 2024-09-13T18:30:37.277 INFO:tasks.workunit.client.0.smithi038.stdout:7/381: fdatasync db/d12/f7b 0 2024-09-13T18:30:37.278 INFO:tasks.workunit.client.0.smithi038.stdout:7/382: chown db/d12/f7b 938 1 2024-09-13T18:30:37.278 INFO:tasks.workunit.client.0.smithi038.stdout:1/526: symlink d12/d2a/d32/d59/d5b/d47/d84/la5 0 2024-09-13T18:30:37.280 INFO:tasks.workunit.client.0.smithi038.stdout:1/527: read d12/d2a/d32/f60 [323558,106243] 0 2024-09-13T18:30:37.282 INFO:tasks.workunit.client.0.smithi038.stdout:3/355: rmdir d0 39 2024-09-13T18:30:37.288 INFO:tasks.workunit.client.0.smithi038.stdout:2/343: mknod d2/c84 0 2024-09-13T18:30:37.288 INFO:tasks.workunit.client.0.smithi038.stdout:0/421: symlink d2/d89/l8b 0 2024-09-13T18:30:37.288 INFO:tasks.workunit.client.0.smithi038.stdout:2/344: fsync d2/d1e/d44/d50/d46/f5f 0 2024-09-13T18:30:37.291 INFO:tasks.workunit.client.0.smithi038.stdout:8/482: rename d1/f6b to d1/de/d21/d24/d41/d80/d8f/fa1 0 2024-09-13T18:30:37.291 INFO:tasks.workunit.client.0.smithi038.stdout:8/483: dread - d1/d4/f47 zero size 2024-09-13T18:30:37.294 INFO:tasks.workunit.client.0.smithi038.stdout:0/422: link d2/d7/d24/d3c/d3f/f7a d2/dc/d7f/f8c 0 2024-09-13T18:30:37.294 INFO:tasks.workunit.client.0.smithi038.stdout:0/423: dread - d2/dc/f3e zero size 2024-09-13T18:30:37.296 INFO:tasks.workunit.client.0.smithi038.stdout:7/383: rename db/d12/d1c/d3a/d4b/c78 to db/d12/d1c/d3a/d3c/d52/c8c 0 2024-09-13T18:30:37.298 INFO:tasks.workunit.client.0.smithi038.stdout:0/424: rename d2/d7/c7c to d2/d2f/d66/c8d 0 2024-09-13T18:30:37.299 INFO:tasks.workunit.client.0.smithi038.stdout:7/384: creat db/d12/d1c/d3a/d3c/d52/d51/f8d x:0 0 0 2024-09-13T18:30:37.299 INFO:tasks.workunit.client.0.smithi038.stdout:7/385: readlink db/d12/d1c/d3a/d3c/l56 0 2024-09-13T18:30:37.301 INFO:tasks.workunit.client.0.smithi038.stdout:6/457: rmdir dd/de/d2e/d2f 39 2024-09-13T18:30:37.330 INFO:tasks.workunit.client.0.smithi038.stdout:3/356: dwrite d0/dd/d17/d50/d5c/d1d/d29/d2b/f4d [0,4194304] 0 2024-09-13T18:30:37.332 INFO:tasks.workunit.client.0.smithi038.stdout:3/357: creat d0/dd/d17/d50/d5c/d1d/d29/d2b/f68 x:0 0 0 2024-09-13T18:30:37.334 INFO:tasks.workunit.client.0.smithi038.stdout:4/692: dwrite d2/d49/d50/da0/f44 [0,4194304] 0 2024-09-13T18:30:37.337 INFO:tasks.workunit.client.0.smithi038.stdout:4/693: rename d2/df/d1b/d10/ld6 to d2/df/d22/d9a/lde 0 2024-09-13T18:30:37.338 INFO:tasks.workunit.client.0.smithi038.stdout:4/694: rename d2/df/d1b/d10/d75/d82 to d2/d49/d50/da0/d8/d80/ddf 0 2024-09-13T18:30:37.338 INFO:tasks.workunit.client.0.smithi038.stdout:4/695: chown d2/d49/d50/da0/d8/d3b/l8c 1946970 1 2024-09-13T18:30:37.339 INFO:tasks.workunit.client.0.smithi038.stdout:3/358: dread d0/f4 [0,4194304] 0 2024-09-13T18:30:37.340 INFO:tasks.workunit.client.0.smithi038.stdout:3/359: mknod d0/dd/d17/d50/d51/c69 0 2024-09-13T18:30:37.340 INFO:tasks.workunit.client.0.smithi038.stdout:3/360: creat d0/dd/d17/d50/d5c/d1d/d29/d2b/f6a x:0 0 0 2024-09-13T18:30:37.340 INFO:tasks.workunit.client.0.smithi038.stdout:4/696: rmdir d2/df/d1b/d10/d55/dd5 39 2024-09-13T18:30:37.341 INFO:tasks.workunit.client.0.smithi038.stdout:3/361: mkdir d0/dd/d17/d50/d5c/d23/d6b 0 2024-09-13T18:30:37.342 INFO:tasks.workunit.client.0.smithi038.stdout:4/697: mknod d2/d49/d4b/dc0/ce0 0 2024-09-13T18:30:37.342 INFO:tasks.workunit.client.0.smithi038.stdout:3/362: symlink d0/dd/d17/d50/d5c/d1d/d29/d2b/l6c 0 2024-09-13T18:30:37.343 INFO:tasks.workunit.client.0.smithi038.stdout:3/363: creat d0/dd/d17/d50/d5c/d23/d6b/f6d x:0 0 0 2024-09-13T18:30:37.350 INFO:tasks.workunit.client.0.smithi038.stdout:3/364: write d0/dd/d17/d50/d5c/d1d/d29/d2b/f4d [4132453,116000] 0 2024-09-13T18:30:37.350 INFO:tasks.workunit.client.0.smithi038.stdout:0/425: dwrite d2/dc/f50 [0,4194304] 0 2024-09-13T18:30:37.351 INFO:tasks.workunit.client.0.smithi038.stdout:8/484: dwrite d1/f3 [0,4194304] 0 2024-09-13T18:30:37.352 INFO:tasks.workunit.client.0.smithi038.stdout:8/485: truncate d1/de/d3a/f53 4534875 0 2024-09-13T18:30:37.352 INFO:tasks.workunit.client.0.smithi038.stdout:8/486: write d1/de/f94 [970554,58009] 0 2024-09-13T18:30:37.352 INFO:tasks.workunit.client.0.smithi038.stdout:6/458: dwrite dd/f11 [0,4194304] 0 2024-09-13T18:30:37.352 INFO:tasks.workunit.client.0.smithi038.stdout:3/365: rename d0/dd/d17/d50/d5c/d1d/d29/d32 to d0/dd/d17/d50/d5c/d23/d52/d6e 0 2024-09-13T18:30:37.352 INFO:tasks.workunit.client.0.smithi038.stdout:3/366: chown d0/dd/d17/d50/d5c/f55 26416 1 2024-09-13T18:30:37.353 INFO:tasks.workunit.client.0.smithi038.stdout:0/426: truncate d2/d7/d24/d2b/f37 5444494 0 2024-09-13T18:30:37.353 INFO:tasks.workunit.client.0.smithi038.stdout:0/427: chown d2/f5 0 1 2024-09-13T18:30:37.353 INFO:tasks.workunit.client.0.smithi038.stdout:3/367: dread d0/dd/f5a [0,4194304] 0 2024-09-13T18:30:37.353 INFO:tasks.workunit.client.0.smithi038.stdout:7/386: dwrite db/d12/f18 [0,4194304] 0 2024-09-13T18:30:37.354 INFO:tasks.workunit.client.0.smithi038.stdout:2/345: getdents d2 0 2024-09-13T18:30:37.354 INFO:tasks.workunit.client.0.smithi038.stdout:2/346: chown d2/d1e/d48/l4b 6 1 2024-09-13T18:30:37.354 INFO:tasks.workunit.client.0.smithi038.stdout:2/347: stat d2/d1e/d44/d50/d46/d58/d59/d62/f70 0 2024-09-13T18:30:37.357 INFO:tasks.workunit.client.0.smithi038.stdout:4/698: write d2/d49/fd3 [2270750,69541] 0 2024-09-13T18:30:37.359 INFO:tasks.workunit.client.0.smithi038.stdout:6/459: unlink dd/de/c46 0 2024-09-13T18:30:37.359 INFO:tasks.workunit.client.0.smithi038.stdout:6/460: truncate dd/de/d2e/d2f/d4c/d55/f5b 559383 0 2024-09-13T18:30:37.359 INFO:tasks.workunit.client.0.smithi038.stdout:6/461: fsync dd/de/d2e/d2f/d4c/d55/f57 0 2024-09-13T18:30:37.360 INFO:tasks.workunit.client.0.smithi038.stdout:0/428: symlink d2/d89/l8e 0 2024-09-13T18:30:37.361 INFO:tasks.workunit.client.0.smithi038.stdout:3/368: creat d0/dd/d17/d50/d59/f6f x:0 0 0 2024-09-13T18:30:37.364 INFO:tasks.workunit.client.0.smithi038.stdout:2/348: creat d2/d1e/d44/d50/d46/f85 x:0 0 0 2024-09-13T18:30:37.365 INFO:tasks.workunit.client.0.smithi038.stdout:4/699: symlink d2/d49/d4b/d8e/le1 0 2024-09-13T18:30:37.367 INFO:tasks.workunit.client.0.smithi038.stdout:6/462: mkdir dd/daa 0 2024-09-13T18:30:37.367 INFO:tasks.workunit.client.0.smithi038.stdout:8/487: dread d1/f7 [4194304,4194304] 0 2024-09-13T18:30:37.369 INFO:tasks.workunit.client.0.smithi038.stdout:3/369: creat d0/dd/d17/f70 x:0 0 0 2024-09-13T18:30:37.369 INFO:tasks.workunit.client.0.smithi038.stdout:3/370: chown d0/dd/d17/d50/d5c/d23/d52/d6e/f4e 137788913 1 2024-09-13T18:30:37.372 INFO:tasks.workunit.client.0.smithi038.stdout:7/387: mkdir db/d8e 0 2024-09-13T18:30:37.374 INFO:tasks.workunit.client.0.smithi038.stdout:4/700: getdents d2/df/d1b 0 2024-09-13T18:30:37.378 INFO:tasks.workunit.client.0.smithi038.stdout:7/388: mkdir db/d12/d1c/d3a/d3c/d8f 0 2024-09-13T18:30:37.380 INFO:tasks.workunit.client.0.smithi038.stdout:7/389: truncate db/d12/d1c/d3a/d3c/d52/d51/f86 249350 0 2024-09-13T18:30:37.380 INFO:tasks.workunit.client.0.smithi038.stdout:7/390: chown db/d12/d13/c64 626 1 2024-09-13T18:30:37.382 INFO:tasks.workunit.client.0.smithi038.stdout:7/391: truncate db/f10 7371162 0 2024-09-13T18:30:37.385 INFO:tasks.workunit.client.0.smithi038.stdout:7/392: link db/d12/d1c/d3a/d22/c25 db/d12/d1c/d3a/d22/d28/c90 0 2024-09-13T18:30:37.385 INFO:tasks.workunit.client.0.smithi038.stdout:7/393: truncate db/d12/d1c/d3a/d3c/d52/f6c 899810 0 2024-09-13T18:30:37.386 INFO:tasks.workunit.client.0.smithi038.stdout:7/394: symlink db/d12/d1c/d3a/d3c/l91 0 2024-09-13T18:30:37.403 INFO:tasks.workunit.client.0.smithi038.stdout:0/429: dwrite d2/f1c [0,4194304] 0 2024-09-13T18:30:37.404 INFO:tasks.workunit.client.0.smithi038.stdout:0/430: mkdir d2/d2f/d40/d87/d8f 0 2024-09-13T18:30:37.405 INFO:tasks.workunit.client.0.smithi038.stdout:0/431: chown d2/f5 65582194 1 2024-09-13T18:30:37.406 INFO:tasks.workunit.client.0.smithi038.stdout:0/432: link d2/dc/f3e d2/d2f/d66/f90 0 2024-09-13T18:30:37.447 INFO:tasks.workunit.client.0.smithi038.stdout:2/349: dwrite d2/d2a/f3d [0,4194304] 0 2024-09-13T18:30:37.447 INFO:tasks.workunit.client.0.smithi038.stdout:2/350: write d2/d1e/f2f [2106267,108166] 0 2024-09-13T18:30:37.448 INFO:tasks.workunit.client.0.smithi038.stdout:2/351: link d2/d1e/d44/d50/d46/f71 d2/f86 0 2024-09-13T18:30:37.449 INFO:tasks.workunit.client.0.smithi038.stdout:6/463: dwrite dd/de/d61/d62/f82 [0,4194304] 0 2024-09-13T18:30:37.453 INFO:tasks.workunit.client.0.smithi038.stdout:8/488: dwrite d1/de/d21/d24/d4d/d50/fa0 [0,4194304] 0 2024-09-13T18:30:37.453 INFO:tasks.workunit.client.0.smithi038.stdout:6/464: getdents dd/de/d2e/d2f 0 2024-09-13T18:30:37.453 INFO:tasks.workunit.client.0.smithi038.stdout:0/433: dwrite d2/d2f/d66/d81/f83 [0,4194304] 0 2024-09-13T18:30:37.453 INFO:tasks.workunit.client.0.smithi038.stdout:0/434: creat d2/d7/d24/d2b/f91 x:0 0 0 2024-09-13T18:30:37.455 INFO:tasks.workunit.client.0.smithi038.stdout:8/489: rename d1/de/d21/d24/d41/d7d/l8b to d1/de/d15/d30/la2 0 2024-09-13T18:30:37.456 INFO:tasks.workunit.client.0.smithi038.stdout:6/465: getdents dd/de/d2e/d30 0 2024-09-13T18:30:37.456 INFO:tasks.workunit.client.0.smithi038.stdout:6/466: fdatasync dd/de/d2e/d30/f29 0 2024-09-13T18:30:37.461 INFO:tasks.workunit.client.0.smithi038.stdout:4/701: dwrite d2/d49/d50/da0/d8/f27 [4194304,4194304] 0 2024-09-13T18:30:37.461 INFO:tasks.workunit.client.0.smithi038.stdout:2/352: write d2/d1e/d44/d50/f2e [4849314,130765] 0 2024-09-13T18:30:37.461 INFO:tasks.workunit.client.0.smithi038.stdout:3/371: dwrite d0/dd/f5a [0,4194304] 0 2024-09-13T18:30:37.461 INFO:tasks.workunit.client.0.smithi038.stdout:4/702: truncate d2/df/d22/f65 340059 0 2024-09-13T18:30:37.461 INFO:tasks.workunit.client.0.smithi038.stdout:4/703: chown d2/cb8 26984555 1 2024-09-13T18:30:37.463 INFO:tasks.workunit.client.0.smithi038.stdout:8/490: unlink d1/de/d21/d24/f92 0 2024-09-13T18:30:37.478 INFO:tasks.workunit.client.0.smithi038.stdout:2/353: mkdir d2/d1e/d87 0 2024-09-13T18:30:37.483 INFO:tasks.workunit.client.0.smithi038.stdout:3/372: creat d0/dd/d17/d50/f71 x:0 0 0 2024-09-13T18:30:37.488 INFO:tasks.workunit.client.0.smithi038.stdout:0/435: rename d2/d2f to d2/d7/d24/d92 0 2024-09-13T18:30:37.491 INFO:tasks.workunit.client.0.smithi038.stdout:2/354: getdents d2/d2a 0 2024-09-13T18:30:37.494 INFO:tasks.workunit.client.0.smithi038.stdout:3/373: symlink d0/dd/d17/d50/d5c/d23/l72 0 2024-09-13T18:30:37.494 INFO:tasks.workunit.client.0.smithi038.stdout:3/374: write d0/dd/d17/d50/d5c/d1d/d29/d2b/f36 [1145777,30961] 0 2024-09-13T18:30:37.494 INFO:tasks.workunit.client.0.smithi038.stdout:3/375: creat d0/dd/d17/f73 x:0 0 0 2024-09-13T18:30:37.494 INFO:tasks.workunit.client.0.smithi038.stdout:0/436: getdents d2/d89 0 2024-09-13T18:30:37.495 INFO:tasks.workunit.client.0.smithi038.stdout:2/355: creat d2/da/d74/f88 x:0 0 0 2024-09-13T18:30:37.498 INFO:tasks.workunit.client.0.smithi038.stdout:3/376: creat d0/dd/d17/d50/d5c/d1d/d30/f74 x:0 0 0 2024-09-13T18:30:37.500 INFO:tasks.workunit.client.0.smithi038.stdout:2/356: unlink d2/d1e/f61 0 2024-09-13T18:30:37.500 INFO:tasks.workunit.client.0.smithi038.stdout:2/357: fsync d2/da/f1b 0 2024-09-13T18:30:37.500 INFO:tasks.workunit.client.0.smithi038.stdout:2/358: fdatasync d2/d1e/d44/d50/d39/d45/f54 0 2024-09-13T18:30:37.500 INFO:tasks.workunit.client.0.smithi038.stdout:2/359: chown d2/d1e/d44/f75 14088 1 2024-09-13T18:30:37.500 INFO:tasks.workunit.client.0.smithi038.stdout:2/360: write d2/da/d74/f88 [856502,104760] 0 2024-09-13T18:30:37.500 INFO:tasks.workunit.client.0.smithi038.stdout:2/361: chown d2/d1e/d44/d50/d46/d58/d59/f5a 1565354 1 2024-09-13T18:30:37.501 INFO:tasks.workunit.client.0.smithi038.stdout:3/377: mknod d0/dd/d17/d50/d5c/d23/d52/c75 0 2024-09-13T18:30:37.504 INFO:tasks.workunit.client.0.smithi038.stdout:2/362: creat d2/d1e/d87/f89 x:0 0 0 2024-09-13T18:30:37.504 INFO:tasks.workunit.client.0.smithi038.stdout:2/363: chown d2/d1e/d44/d50/d46/d58/d59/d62/f80 2366465 1 2024-09-13T18:30:37.504 INFO:tasks.workunit.client.0.smithi038.stdout:2/364: write d2/d1e/d44/d50/d39/d45/f54 [1129250,117679] 0 2024-09-13T18:30:37.504 INFO:tasks.workunit.client.0.smithi038.stdout:3/378: mknod d0/dd/d17/d43/c76 0 2024-09-13T18:30:37.504 INFO:tasks.workunit.client.0.smithi038.stdout:2/365: rmdir d2/d1e/d44/d50 39 2024-09-13T18:30:37.505 INFO:tasks.workunit.client.0.smithi038.stdout:2/366: dread d2/da/f36 [4194304,4194304] 0 2024-09-13T18:30:37.506 INFO:tasks.workunit.client.0.smithi038.stdout:3/379: rename d0/f4 to d0/dd/d17/d50/d5c/d1d/d30/f77 0 2024-09-13T18:30:37.506 INFO:tasks.workunit.client.0.smithi038.stdout:3/380: creat d0/dd/d17/d50/d5c/d23/d6b/f78 x:0 0 0 2024-09-13T18:30:37.507 INFO:tasks.workunit.client.0.smithi038.stdout:2/367: dread d2/d1e/d44/f6a [0,4194304] 0 2024-09-13T18:30:37.507 INFO:tasks.workunit.client.0.smithi038.stdout:2/368: truncate d2/d1e/d44/d50/d39/d52/f5b 852193 0 2024-09-13T18:30:37.507 INFO:tasks.workunit.client.0.smithi038.stdout:2/369: chown d2/da/f28 1561650060 1 2024-09-13T18:30:37.507 INFO:tasks.workunit.client.0.smithi038.stdout:2/370: fdatasync d2/da/f36 0 2024-09-13T18:30:37.508 INFO:tasks.workunit.client.0.smithi038.stdout:3/381: mkdir d0/dd/d17/d79 0 2024-09-13T18:30:37.510 INFO:tasks.workunit.client.0.smithi038.stdout:0/437: dread d2/f1c [0,4194304] 0 2024-09-13T18:30:37.510 INFO:tasks.workunit.client.0.smithi038.stdout:0/438: chown d2/d7/d24/d92/d66/f85 58346 1 2024-09-13T18:30:37.513 INFO:tasks.workunit.client.0.smithi038.stdout:0/439: unlink d2/d7/d24/d92/l86 0 2024-09-13T18:30:37.513 INFO:tasks.workunit.client.0.smithi038.stdout:0/440: read - d2/d7/d24/d92/f52 zero size 2024-09-13T18:30:37.513 INFO:tasks.workunit.client.0.smithi038.stdout:0/441: dread - d2/f1e zero size 2024-09-13T18:30:37.513 INFO:tasks.workunit.client.0.smithi038.stdout:0/442: readlink d2/l19 0 2024-09-13T18:30:37.513 INFO:tasks.workunit.client.0.smithi038.stdout:0/443: write d2/d7/d24/d3c/f4d [1195700,25129] 0 2024-09-13T18:30:37.516 INFO:tasks.workunit.client.0.smithi038.stdout:6/467: dwrite f1 [0,4194304] 0 2024-09-13T18:30:37.517 INFO:tasks.workunit.client.0.smithi038.stdout:4/704: dwrite d2/df/d1b/d10/da3/fc6 [0,4194304] 0 2024-09-13T18:30:37.522 INFO:tasks.workunit.client.0.smithi038.stdout:6/468: mknod dd/de/d61/cab 0 2024-09-13T18:30:37.526 INFO:tasks.workunit.client.0.smithi038.stdout:8/491: dwrite d1/de/d21/d45/f73 [0,4194304] 0 2024-09-13T18:30:37.527 INFO:tasks.workunit.client.0.smithi038.stdout:2/371: write d2/f37 [3390914,15125] 0 2024-09-13T18:30:37.527 INFO:tasks.workunit.client.0.smithi038.stdout:2/372: read - d2/f67 zero size 2024-09-13T18:30:37.533 INFO:tasks.workunit.client.0.smithi038.stdout:8/492: mknod d1/ca3 0 2024-09-13T18:30:37.533 INFO:tasks.workunit.client.0.smithi038.stdout:8/493: stat d1/de/c11 0 2024-09-13T18:30:37.533 INFO:tasks.workunit.client.0.smithi038.stdout:8/494: chown d1/de/d21/d24/d4d/d50/d62/d71 47 1 2024-09-13T18:30:37.537 INFO:tasks.workunit.client.0.smithi038.stdout:2/373: creat d2/d1e/f8a x:0 0 0 2024-09-13T18:30:37.539 INFO:tasks.workunit.client.0.smithi038.stdout:2/374: mkdir d2/d1e/d44/d50/d39/d52/d8b 0 2024-09-13T18:30:37.541 INFO:tasks.workunit.client.0.smithi038.stdout:2/375: dread d2/da/d16/f24 [0,4194304] 0 2024-09-13T18:30:37.541 INFO:tasks.workunit.client.0.smithi038.stdout:2/376: read - d2/d1e/d44/d50/d46/d58/d59/d62/f80 zero size 2024-09-13T18:30:37.542 INFO:tasks.workunit.client.0.smithi038.stdout:7/395: truncate db/d12/d1c/f79 3623402 0 2024-09-13T18:30:37.542 INFO:tasks.workunit.client.0.smithi038.stdout:7/396: readlink db/d12/d1c/d3a/d3c/d52/d51/l70 0 2024-09-13T18:30:37.544 INFO:tasks.workunit.client.0.smithi038.stdout:2/377: creat d2/da/f8c x:0 0 0 2024-09-13T18:30:37.548 INFO:tasks.workunit.client.0.smithi038.stdout:2/378: rename d2/d1e/d44/d50/d39/d45/f4a to d2/d1e/d44/d50/d46/d58/f8d 0 2024-09-13T18:30:37.550 INFO:tasks.workunit.client.0.smithi038.stdout:7/397: dread db/d12/d1c/d3a/d4b/f77 [0,4194304] 0 2024-09-13T18:30:37.550 INFO:tasks.workunit.client.0.smithi038.stdout:7/398: chown db/d12/f18 8701 1 2024-09-13T18:30:37.552 INFO:tasks.workunit.client.0.smithi038.stdout:2/379: creat d2/d1e/d44/d50/d46/d58/d59/f8e x:0 0 0 2024-09-13T18:30:37.552 INFO:tasks.workunit.client.0.smithi038.stdout:2/380: chown d2/d1e/d44/d50/d46/d58 1 1 2024-09-13T18:30:37.561 INFO:tasks.workunit.client.0.smithi038.stdout:0/444: dwrite d2/d7/f76 [0,4194304] 0 2024-09-13T18:30:37.563 INFO:tasks.workunit.client.0.smithi038.stdout:0/445: creat d2/d7/d24/d92/d66/d81/f93 x:0 0 0 2024-09-13T18:30:37.568 INFO:tasks.workunit.client.0.smithi038.stdout:2/381: dread d2/d1e/d44/d50/f2d [0,4194304] 0 2024-09-13T18:30:37.568 INFO:tasks.workunit.client.0.smithi038.stdout:2/382: chown d2/lf 1975 1 2024-09-13T18:30:37.569 INFO:tasks.workunit.client.0.smithi038.stdout:2/383: link d2/d1e/d44/d50/d39/f6e d2/d1e/d44/d50/d39/d52/f8f 0 2024-09-13T18:30:37.571 INFO:tasks.workunit.client.0.smithi038.stdout:4/705: dwrite d2/d49/d50/da0/f18 [0,4194304] 0 2024-09-13T18:30:37.571 INFO:tasks.workunit.client.0.smithi038.stdout:4/706: fsync d2/d49/f5b 0 2024-09-13T18:30:37.571 INFO:tasks.workunit.client.0.smithi038.stdout:6/469: dwrite dd/de/d2e/d2f/d4c/d55/f57 [0,4194304] 0 2024-09-13T18:30:37.572 INFO:tasks.workunit.client.0.smithi038.stdout:8/495: dwrite d1/fc [0,4194304] 0 2024-09-13T18:30:37.572 INFO:tasks.workunit.client.0.smithi038.stdout:7/399: dwrite db/fe [0,4194304] 0 2024-09-13T18:30:37.572 INFO:tasks.workunit.client.0.smithi038.stdout:7/400: write db/d12/d1c/d3a/d3c/d52/d51/f86 [289147,108022] 0 2024-09-13T18:30:37.573 INFO:tasks.workunit.client.0.smithi038.stdout:4/707: mknod d2/d49/d4b/dc0/ce2 0 2024-09-13T18:30:37.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/446: read d2/d7/d24/d3c/f46 [2381149,14110] 0 2024-09-13T18:30:37.574 INFO:tasks.workunit.client.0.smithi038.stdout:0/447: chown d2/d7/d24/d3c/d3f/l71 631 1 2024-09-13T18:30:37.578 INFO:tasks.workunit.client.0.smithi038.stdout:6/470: mkdir dd/de/d2e/d2f/d4c/d86/dac 0 2024-09-13T18:30:37.578 INFO:tasks.workunit.client.0.smithi038.stdout:6/471: write dd/de/d2e/d30/f29 [1559307,79989] 0 2024-09-13T18:30:37.578 INFO:tasks.workunit.client.0.smithi038.stdout:6/472: write dd/de/d2e/d2f/d71/fa4 [1204675,83135] 0 2024-09-13T18:30:37.585 INFO:tasks.workunit.client.0.smithi038.stdout:4/708: mkdir d2/d49/d50/da0/d8/d80/de3 0 2024-09-13T18:30:37.587 INFO:tasks.workunit.client.0.smithi038.stdout:0/448: link d2/d7/d24/d92/d66/c8d d2/d7/d24/d2b/c94 0 2024-09-13T18:30:37.587 INFO:tasks.workunit.client.0.smithi038.stdout:0/449: fdatasync d2/d7/d24/d2b/f37 0 2024-09-13T18:30:37.589 INFO:tasks.workunit.client.0.smithi038.stdout:6/473: mknod dd/de/d31/cad 0 2024-09-13T18:30:37.589 INFO:tasks.workunit.client.0.smithi038.stdout:6/474: readlink dd/de/l12 0 2024-09-13T18:30:37.590 INFO:tasks.workunit.client.0.smithi038.stdout:6/475: chown cc 141 1 2024-09-13T18:30:37.592 INFO:tasks.workunit.client.0.smithi038.stdout:8/496: dwrite d1/de/f23 [0,4194304] 0 2024-09-13T18:30:37.592 INFO:tasks.workunit.client.0.smithi038.stdout:0/450: mkdir d2/d7/d24/d2b/d95 0 2024-09-13T18:30:37.593 INFO:tasks.workunit.client.0.smithi038.stdout:6/476: stat cc 0 2024-09-13T18:30:37.593 INFO:tasks.workunit.client.0.smithi038.stdout:6/477: chown dd/de/d2e/l88 530 1 2024-09-13T18:30:37.594 INFO:tasks.workunit.client.0.smithi038.stdout:2/384: dwrite d2/d1e/d44/d50/d46/f5f [0,4194304] 0 2024-09-13T18:30:37.594 INFO:tasks.workunit.client.0.smithi038.stdout:2/385: truncate d2/d1e/d44/d50/d46/f71 627308 0 2024-09-13T18:30:37.594 INFO:tasks.workunit.client.0.smithi038.stdout:2/386: dread - d2/f72 zero size 2024-09-13T18:30:37.594 INFO:tasks.workunit.client.0.smithi038.stdout:2/387: dread - d2/d1e/d44/d50/d46/d58/d59/d62/f80 zero size 2024-09-13T18:30:37.594 INFO:tasks.workunit.client.0.smithi038.stdout:2/388: write d2/d1e/d44/d50/d39/f42 [2080823,29320] 0 2024-09-13T18:30:37.596 INFO:tasks.workunit.client.0.smithi038.stdout:8/497: mknod d1/de/d21/d24/d4d/ca4 0 2024-09-13T18:30:37.599 INFO:tasks.workunit.client.0.smithi038.stdout:6/478: rename dd/l23 to dd/de/d31/d63/d83/lae 0 2024-09-13T18:30:37.599 INFO:tasks.workunit.client.0.smithi038.stdout:6/479: read dd/de/f1a [61558,5995] 0 2024-09-13T18:30:37.599 INFO:tasks.workunit.client.0.smithi038.stdout:6/480: dread - dd/de/d2e/f6e zero size 2024-09-13T18:30:37.604 INFO:tasks.workunit.client.0.smithi038.stdout:2/389: unlink d2/d1e/d44/d50/d39/d40/l4c 0 2024-09-13T18:30:37.606 INFO:tasks.workunit.client.0.smithi038.stdout:0/451: write d2/d7/f9 [7978485,26422] 0 2024-09-13T18:30:37.606 INFO:tasks.workunit.client.0.smithi038.stdout:0/452: stat d2/d7/d24/d2b/f43 0 2024-09-13T18:30:37.607 INFO:tasks.workunit.client.0.smithi038.stdout:8/498: mknod d1/de/d21/d24/d41/ca5 0 2024-09-13T18:30:37.607 INFO:tasks.workunit.client.0.smithi038.stdout:8/499: fsync d1/de/d21/d24/d41/d7d/f9c 0 2024-09-13T18:30:37.608 INFO:tasks.workunit.client.0.smithi038.stdout:0/453: read d2/d7/d55/f68 [578929,18247] 0 2024-09-13T18:30:37.609 INFO:tasks.workunit.client.0.smithi038.stdout:7/401: dwrite db/d12/d1c/d3a/d26/f7a [0,4194304] 0 2024-09-13T18:30:37.609 INFO:tasks.workunit.client.0.smithi038.stdout:2/390: rename d2/d2a/c2c to d2/c90 0 2024-09-13T18:30:37.609 INFO:tasks.workunit.client.0.smithi038.stdout:2/391: creat d2/d1e/d44/d50/d46/d58/d59/d62/f91 x:0 0 0 2024-09-13T18:30:37.609 INFO:tasks.workunit.client.0.smithi038.stdout:4/709: dwrite d2/d49/d4b/f9b [0,4194304] 0 2024-09-13T18:30:37.609 INFO:tasks.workunit.client.0.smithi038.stdout:4/710: dread - d2/fbe zero size 2024-09-13T18:30:37.611 INFO:tasks.workunit.client.0.smithi038.stdout:0/454: creat d2/f96 x:0 0 0 2024-09-13T18:30:37.615 INFO:tasks.workunit.client.0.smithi038.stdout:7/402: mknod db/d12/d1c/c92 0 2024-09-13T18:30:37.620 INFO:tasks.workunit.client.0.smithi038.stdout:2/392: rename d2/d1e/d44/l82 to d2/d5c/d66/l92 0 2024-09-13T18:30:37.625 INFO:tasks.workunit.client.0.smithi038.stdout:4/711: truncate d2/df/d1b/d10/d75/f8f 545821 0 2024-09-13T18:30:37.629 INFO:tasks.workunit.client.0.smithi038.stdout:2/393: truncate d2/da/f36 782687 0 2024-09-13T18:30:37.629 INFO:tasks.workunit.client.0.smithi038.stdout:2/394: chown d2/d1e/d44/d50/d46/f5f 29756235 1 2024-09-13T18:30:37.630 INFO:tasks.workunit.client.0.smithi038.stdout:4/712: truncate d2/df/d1b/d10/da3/fc6 2787952 0 2024-09-13T18:30:37.630 INFO:tasks.workunit.client.0.smithi038.stdout:4/713: readlink d2/d49/d4b/l98 0 2024-09-13T18:30:37.631 INFO:tasks.workunit.client.0.smithi038.stdout:0/455: rmdir d2/d7/d24/d3c/d3f 39 2024-09-13T18:30:37.633 INFO:tasks.workunit.client.0.smithi038.stdout:7/403: dwrite db/fe [0,4194304] 0 2024-09-13T18:30:37.633 INFO:tasks.workunit.client.0.smithi038.stdout:7/404: write db/d12/d1c/d3a/d4b/f77 [1274178,2968] 0 2024-09-13T18:30:37.636 INFO:tasks.workunit.client.0.smithi038.stdout:2/395: write d2/da/f1b [1423330,29543] 0 2024-09-13T18:30:37.636 INFO:tasks.workunit.client.0.smithi038.stdout:2/396: chown d2/d1e/d44/d50/d46/d58/d59/d62/f70 17811 1 2024-09-13T18:30:37.637 INFO:tasks.workunit.client.0.smithi038.stdout:7/405: creat db/d12/d1c/d3a/d26/f93 x:0 0 0 2024-09-13T18:30:37.637 INFO:tasks.workunit.client.0.smithi038.stdout:7/406: chown db/f14 18109798 1 2024-09-13T18:30:37.639 INFO:tasks.workunit.client.0.smithi038.stdout:0/456: truncate d2/d7/d24/d2b/d6d/f6f 4341050 0 2024-09-13T18:30:37.639 INFO:tasks.workunit.client.0.smithi038.stdout:0/457: write d2/d7/d24/d92/f52 [192535,96573] 0 2024-09-13T18:30:37.639 INFO:tasks.workunit.client.0.smithi038.stdout:0/458: readlink d2/d7/d55/l63 0 2024-09-13T18:30:37.653 INFO:tasks.workunit.client.0.smithi038.stdout:2/397: rename d2/d1e/d44/d50/d46/d58/d59 to d2/d5c/d93 0 2024-09-13T18:30:37.653 INFO:tasks.workunit.client.0.smithi038.stdout:7/407: dread db/d12/d1c/d3a/f1d [0,4194304] 0 2024-09-13T18:30:37.653 INFO:tasks.workunit.client.0.smithi038.stdout:7/408: readlink db/d12/d1c/d3a/d3c/l56 0 2024-09-13T18:30:37.660 INFO:tasks.workunit.client.0.smithi038.stdout:2/398: rmdir d2/da 39 2024-09-13T18:30:37.662 INFO:tasks.workunit.client.0.smithi038.stdout:7/409: rename db/d12/d1c/d3a/l4a to db/d12/d1c/d3a/d3c/d52/l94 0 2024-09-13T18:30:37.664 INFO:tasks.workunit.client.0.smithi038.stdout:2/399: unlink d2/le 0 2024-09-13T18:30:37.664 INFO:tasks.workunit.client.0.smithi038.stdout:2/400: chown d2/d1e/d44/d50/d46/d58/f8d 7862317 1 2024-09-13T18:30:37.667 INFO:tasks.workunit.client.0.smithi038.stdout:2/401: dread d2/da/fd [0,4194304] 0 2024-09-13T18:30:37.667 INFO:tasks.workunit.client.0.smithi038.stdout:2/402: fdatasync d2/f47 0 2024-09-13T18:30:37.669 INFO:tasks.workunit.client.0.smithi038.stdout:7/410: link db/d12/d1c/d3a/l66 db/l95 0 2024-09-13T18:30:37.670 INFO:tasks.workunit.client.0.smithi038.stdout:2/403: creat d2/da/f94 x:0 0 0 2024-09-13T18:30:37.670 INFO:tasks.workunit.client.0.smithi038.stdout:2/404: creat d2/d1e/f95 x:0 0 0 2024-09-13T18:30:37.670 INFO:tasks.workunit.client.0.smithi038.stdout:2/405: getdents d2/d1e/d44/d50/d39/d52/d8b 0 2024-09-13T18:30:37.672 INFO:tasks.workunit.client.0.smithi038.stdout:7/411: symlink db/d12/d1c/d3a/d26/d41/l96 0 2024-09-13T18:30:37.672 INFO:tasks.workunit.client.0.smithi038.stdout:7/412: fdatasync db/d12/d1c/d3a/d22/f2c 0 2024-09-13T18:30:37.673 INFO:tasks.workunit.client.0.smithi038.stdout:7/413: creat db/d12/d1c/d3a/d3c/d52/d51/f97 x:0 0 0 2024-09-13T18:30:37.673 INFO:tasks.workunit.client.0.smithi038.stdout:4/714: truncate d2/df/d1b/d10/d75/f8f 221254 0 2024-09-13T18:30:37.674 INFO:tasks.workunit.client.0.smithi038.stdout:2/406: mknod d2/d2a/c96 0 2024-09-13T18:30:37.674 INFO:tasks.workunit.client.0.smithi038.stdout:2/407: dread - d2/d5c/d93/d62/f91 zero size 2024-09-13T18:30:37.674 INFO:tasks.workunit.client.0.smithi038.stdout:2/408: dread - d2/f72 zero size 2024-09-13T18:30:37.676 INFO:tasks.workunit.client.0.smithi038.stdout:7/414: symlink db/d12/d1c/d3a/d26/d41/l98 0 2024-09-13T18:30:37.678 INFO:tasks.workunit.client.0.smithi038.stdout:4/715: symlink d2/d49/d50/da0/d8/d3b/le4 0 2024-09-13T18:30:37.679 INFO:tasks.workunit.client.0.smithi038.stdout:2/409: unlink d2/d1e/d44/d50/d39/f6e 0 2024-09-13T18:30:37.682 INFO:tasks.workunit.client.0.smithi038.stdout:4/716: rename d2/d49/d50/da0/d8/d80/de3 to d2/de5 0 2024-09-13T18:30:37.682 INFO:tasks.workunit.client.0.smithi038.stdout:4/717: dread - d2/d49/d50/da0/fad zero size 2024-09-13T18:30:37.683 INFO:tasks.workunit.client.0.smithi038.stdout:2/410: mknod d2/d1e/d44/d50/d39/d52/d8b/c97 0 2024-09-13T18:30:37.685 INFO:tasks.workunit.client.0.smithi038.stdout:7/415: dread db/f11 [0,4194304] 0 2024-09-13T18:30:37.687 INFO:tasks.workunit.client.0.smithi038.stdout:4/718: truncate d2/d49/f90 60409 0 2024-09-13T18:30:37.687 INFO:tasks.workunit.client.0.smithi038.stdout:4/719: write d2/d49/d50/da0/d8/d3b/f9e [606813,28249] 0 2024-09-13T18:30:37.688 INFO:tasks.workunit.client.0.smithi038.stdout:7/416: mknod db/d12/d1c/d3a/d22/c99 0 2024-09-13T18:30:37.688 INFO:tasks.workunit.client.0.smithi038.stdout:7/417: fdatasync db/d12/d1c/f79 0 2024-09-13T18:30:37.688 INFO:tasks.workunit.client.0.smithi038.stdout:7/418: write db/d12/d1c/d3a/d4b/f77 [2230915,31785] 0 2024-09-13T18:30:37.693 INFO:tasks.workunit.client.0.smithi038.stdout:7/419: symlink db/d12/d13/l9a 0 2024-09-13T18:30:37.693 INFO:tasks.workunit.client.0.smithi038.stdout:7/420: stat db/d12/f34 0 2024-09-13T18:30:37.696 INFO:tasks.workunit.client.0.smithi038.stdout:7/421: mkdir db/d12/d1c/d3a/d3c/d52/d9b 0 2024-09-13T18:30:37.698 INFO:tasks.workunit.client.0.smithi038.stdout:4/720: write d2/d49/d50/da0/fc3 [2648862,4993] 0 2024-09-13T18:30:37.698 INFO:tasks.workunit.client.0.smithi038.stdout:4/721: chown d2/df/d1b/d10/l34 40433 1 2024-09-13T18:30:37.699 INFO:tasks.workunit.client.0.smithi038.stdout:7/422: mknod db/d12/d1c/d3a/d26/c9c 0 2024-09-13T18:30:37.699 INFO:tasks.workunit.client.0.smithi038.stdout:7/423: readlink db/d12/d1c/d3a/d3c/d52/l71 0 2024-09-13T18:30:37.703 INFO:tasks.workunit.client.0.smithi038.stdout:2/411: dwrite d2/d2a/f35 [0,4194304] 0 2024-09-13T18:30:37.703 INFO:tasks.workunit.client.0.smithi038.stdout:2/412: chown d2/f34 31866 1 2024-09-13T18:30:37.703 INFO:tasks.workunit.client.0.smithi038.stdout:2/413: chown d2/d1e/d48/c7a 10 1 2024-09-13T18:30:37.703 INFO:tasks.workunit.client.0.smithi038.stdout:2/414: write d2/da/f94 [431064,58388] 0 2024-09-13T18:30:37.703 INFO:tasks.workunit.client.0.smithi038.stdout:4/722: mkdir d2/df/d22/d9a/de6 0 2024-09-13T18:30:37.704 INFO:tasks.workunit.client.0.smithi038.stdout:4/723: creat d2/d49/d4b/fe7 x:0 0 0 2024-09-13T18:30:37.709 INFO:tasks.workunit.client.0.smithi038.stdout:2/415: dread d2/f11 [0,4194304] 0 2024-09-13T18:30:37.709 INFO:tasks.workunit.client.0.smithi038.stdout:2/416: stat d2/d1e/d48/l60 0 2024-09-13T18:30:37.711 INFO:tasks.workunit.client.0.smithi038.stdout:4/724: rename d2/d49/d50/da0/d8/d3b/dd4 to d2/d49/d50/da0/dcb/de8 0 2024-09-13T18:30:37.711 INFO:tasks.workunit.client.0.smithi038.stdout:4/725: write d2/d49/d50/da0/f16 [4811223,124432] 0 2024-09-13T18:30:37.711 INFO:tasks.workunit.client.0.smithi038.stdout:4/726: chown d2/d49/d50/da0/d8/d80/fae 2 1 2024-09-13T18:30:37.711 INFO:tasks.workunit.client.0.smithi038.stdout:2/417: dread d2/f34 [0,4194304] 0 2024-09-13T18:30:37.716 INFO:tasks.workunit.client.0.smithi038.stdout:7/424: dwrite db/d12/d1c/d3a/d22/f7d [0,4194304] 0 2024-09-13T18:30:37.723 INFO:tasks.workunit.client.0.smithi038.stdout:7/425: creat db/d12/d1c/d3a/d22/d28/f9d x:0 0 0 2024-09-13T18:30:37.724 INFO:tasks.workunit.client.0.smithi038.stdout:7/426: symlink db/d12/d13/d43/l9e 0 2024-09-13T18:30:37.725 INFO:tasks.workunit.client.0.smithi038.stdout:7/427: write db/d12/d1c/d3a/f1d [5315932,14563] 0 2024-09-13T18:30:37.725 INFO:tasks.workunit.client.0.smithi038.stdout:7/428: rmdir db/d12 39 2024-09-13T18:30:37.725 INFO:tasks.workunit.client.0.smithi038.stdout:7/429: chown db/d12/d1c/d3a/d3c/d52/d9b 1761 1 2024-09-13T18:30:37.726 INFO:tasks.workunit.client.0.smithi038.stdout:7/430: dread db/d12/d1c/d3a/d3c/d52/f6c [0,4194304] 0 2024-09-13T18:30:37.736 INFO:tasks.workunit.client.0.smithi038.stdout:2/418: dwrite d2/d1e/d48/f4f [4194304,4194304] 0 2024-09-13T18:30:37.736 INFO:tasks.workunit.client.0.smithi038.stdout:4/727: write d2/d49/d50/da0/f1e [3572174,77646] 0 2024-09-13T18:30:37.741 INFO:tasks.workunit.client.0.smithi038.stdout:7/431: dwrite db/d12/d1c/f79 [0,4194304] 0 2024-09-13T18:30:37.741 INFO:tasks.workunit.client.0.smithi038.stdout:7/432: truncate db/d12/f18 4808472 0 2024-09-13T18:30:37.742 INFO:tasks.workunit.client.0.smithi038.stdout:2/419: mkdir d2/da/d98 0 2024-09-13T18:30:37.742 INFO:tasks.workunit.client.0.smithi038.stdout:2/420: fdatasync d2/da/d16/f24 0 2024-09-13T18:30:37.743 INFO:tasks.workunit.client.0.smithi038.stdout:7/433: dread db/d12/d1c/d3a/d3c/d52/f6c [0,4194304] 0 2024-09-13T18:30:37.745 INFO:tasks.workunit.client.0.smithi038.stdout:2/421: creat d2/da/d98/f99 x:0 0 0 2024-09-13T18:30:37.750 INFO:tasks.workunit.client.0.smithi038.stdout:2/422: creat d2/d1e/d44/d50/f9a x:0 0 0 2024-09-13T18:30:37.755 INFO:tasks.workunit.client.0.smithi038.stdout:4/728: dwrite d2/fd0 [0,4194304] 0 2024-09-13T18:30:37.756 INFO:tasks.workunit.client.0.smithi038.stdout:7/434: dwrite db/d12/d1c/d3a/d22/d28/f6f [0,4194304] 0 2024-09-13T18:30:37.756 INFO:tasks.workunit.client.0.smithi038.stdout:7/435: chown db/d12/d1c/d3a/d22/l87 711721379 1 2024-09-13T18:30:37.756 INFO:tasks.workunit.client.0.smithi038.stdout:7/436: dread - db/d12/d1c/d3a/d3c/f74 zero size 2024-09-13T18:30:37.758 INFO:tasks.workunit.client.0.smithi038.stdout:2/423: dread d2/da/f1b [0,4194304] 0 2024-09-13T18:30:37.759 INFO:tasks.workunit.client.0.smithi038.stdout:4/729: truncate d2/df/d1b/f8a 1935240 0 2024-09-13T18:30:37.759 INFO:tasks.workunit.client.0.smithi038.stdout:9/456: sync 2024-09-13T18:30:37.759 INFO:tasks.workunit.client.0.smithi038.stdout:1/528: sync 2024-09-13T18:30:37.759 INFO:tasks.workunit.client.0.smithi038.stdout:5/490: sync 2024-09-13T18:30:37.759 INFO:tasks.workunit.client.0.smithi038.stdout:1/529: stat d12/d2a/d32/d59/d5b/d47/f80 0 2024-09-13T18:30:37.761 INFO:tasks.workunit.client.0.smithi038.stdout:9/457: dread d0/d7/d13/d2d/d3c/d50/f65 [0,4194304] 0 2024-09-13T18:30:37.762 INFO:tasks.workunit.client.0.smithi038.stdout:7/437: mknod db/d12/c9f 0 2024-09-13T18:30:37.763 INFO:tasks.workunit.client.0.smithi038.stdout:9/458: dread d0/d7/d2c/d5a/d67/d9e/f6b [0,4194304] 0 2024-09-13T18:30:37.763 INFO:tasks.workunit.client.0.smithi038.stdout:9/459: truncate d0/d7/d13/d2d/d3e/f88 798053 0 2024-09-13T18:30:37.765 INFO:tasks.workunit.client.0.smithi038.stdout:2/424: rename d2/d1e/d44/d50/f2d to d2/d1e/d44/d50/d39/d40/f9b 0 2024-09-13T18:30:37.767 INFO:tasks.workunit.client.0.smithi038.stdout:4/730: creat d2/df/d1b/d10/fe9 x:0 0 0 2024-09-13T18:30:37.770 INFO:tasks.workunit.client.0.smithi038.stdout:1/530: symlink d12/d2a/d32/d59/d5b/d47/la6 0 2024-09-13T18:30:37.771 INFO:tasks.workunit.client.0.smithi038.stdout:5/491: mkdir df/d13/d3b/d44/d58/d9c 0 2024-09-13T18:30:37.777 INFO:tasks.workunit.client.0.smithi038.stdout:7/438: symlink db/d12/d1c/d3a/d3c/d52/la0 0 2024-09-13T18:30:37.779 INFO:tasks.workunit.client.0.smithi038.stdout:9/460: creat d0/d7/d2c/fa7 x:0 0 0 2024-09-13T18:30:37.779 INFO:tasks.workunit.client.0.smithi038.stdout:9/461: chown d0/f2f 482 1 2024-09-13T18:30:37.779 INFO:tasks.workunit.client.0.smithi038.stdout:9/462: write d0/d7/d2c/fa7 [39213,28901] 0 2024-09-13T18:30:37.779 INFO:tasks.workunit.client.0.smithi038.stdout:9/463: readlink d0/d7/d13/d2d/d3e/d70/l9a 0 2024-09-13T18:30:37.780 INFO:tasks.workunit.client.0.smithi038.stdout:2/425: truncate d2/d1e/d48/f64 3613245 0 2024-09-13T18:30:37.783 INFO:tasks.workunit.client.0.smithi038.stdout:4/731: creat d2/df/d1b/d10/d55/dd5/fea x:0 0 0 2024-09-13T18:30:37.783 INFO:tasks.workunit.client.0.smithi038.stdout:4/732: chown d2/df/d1b/d10/d55/c78 1443 1 2024-09-13T18:30:37.783 INFO:tasks.workunit.client.0.smithi038.stdout:4/733: fsync d2/d49/d4b/f9b 0 2024-09-13T18:30:37.783 INFO:tasks.workunit.client.0.smithi038.stdout:4/734: chown d2/d49/d50/da0/d8/d80/fcd 134319907 1 2024-09-13T18:30:37.783 INFO:tasks.workunit.client.0.smithi038.stdout:4/735: truncate d2/df/d1b/d10/d75/f7b 2621450 0 2024-09-13T18:30:37.783 INFO:tasks.workunit.client.0.smithi038.stdout:1/531: mkdir d12/d2a/d32/d59/d5b/d47/d84/da7 0 2024-09-13T18:30:37.787 INFO:tasks.workunit.client.0.smithi038.stdout:7/439: rename db/d12/d13/l80 to db/d8e/la1 0 2024-09-13T18:30:37.787 INFO:tasks.workunit.client.0.smithi038.stdout:7/440: creat db/d12/d1c/d3a/d3c/d52/d51/fa2 x:0 0 0 2024-09-13T18:30:37.787 INFO:tasks.workunit.client.0.smithi038.stdout:7/441: dread - db/d12/f6d zero size 2024-09-13T18:30:37.790 INFO:tasks.workunit.client.0.smithi038.stdout:2/426: truncate d2/da/d16/f24 1686999 0 2024-09-13T18:30:37.793 INFO:tasks.workunit.client.0.smithi038.stdout:4/736: mkdir d2/de5/deb 0 2024-09-13T18:30:37.801 INFO:tasks.workunit.client.0.smithi038.stdout:9/464: getdents d0/d7/d13 0 2024-09-13T18:30:37.801 INFO:tasks.workunit.client.0.smithi038.stdout:9/465: write d0/d7/d13/d30/f6f [127391,93102] 0 2024-09-13T18:30:37.802 INFO:tasks.workunit.client.0.smithi038.stdout:2/427: truncate d2/f11 1214537 0 2024-09-13T18:30:37.803 INFO:tasks.workunit.client.0.smithi038.stdout:9/466: dread d0/d7/f35 [0,4194304] 0 2024-09-13T18:30:37.804 INFO:tasks.workunit.client.0.smithi038.stdout:4/737: truncate d2/d49/d50/da0/fc3 4483206 0 2024-09-13T18:30:37.805 INFO:tasks.workunit.client.0.smithi038.stdout:1/532: getdents d12 0 2024-09-13T18:30:37.805 INFO:tasks.workunit.client.0.smithi038.stdout:7/442: dwrite db/d21/f83 [0,4194304] 0 2024-09-13T18:30:37.807 INFO:tasks.workunit.client.0.smithi038.stdout:2/428: creat d2/d5c/d93/f9c x:0 0 0 2024-09-13T18:30:37.807 INFO:tasks.workunit.client.0.smithi038.stdout:2/429: fsync d2/d5c/d93/f8e 0 2024-09-13T18:30:37.807 INFO:tasks.workunit.client.0.smithi038.stdout:2/430: creat d2/d1e/f9d x:0 0 0 2024-09-13T18:30:37.808 INFO:tasks.workunit.client.0.smithi038.stdout:9/467: truncate d0/f2f 1624565 0 2024-09-13T18:30:37.810 INFO:tasks.workunit.client.0.smithi038.stdout:4/738: mkdir d2/df/dec 0 2024-09-13T18:30:37.812 INFO:tasks.workunit.client.0.smithi038.stdout:1/533: link d12/d3c/d46/d57/f6e d12/d2a/d72/fa8 0 2024-09-13T18:30:37.821 INFO:tasks.workunit.client.0.smithi038.stdout:2/431: rename d2/d5c/d93/d62/l78 to d2/d1e/l9e 0 2024-09-13T18:30:37.822 INFO:tasks.workunit.client.0.smithi038.stdout:4/739: write d2/df/f4c [978950,90742] 0 2024-09-13T18:30:37.822 INFO:tasks.workunit.client.0.smithi038.stdout:9/468: symlink d0/d7/d2c/d33/la8 0 2024-09-13T18:30:37.822 INFO:tasks.workunit.client.0.smithi038.stdout:9/469: write d0/d7/d13/d2d/d3c/d50/f54 [1937413,92626] 0 2024-09-13T18:30:37.823 INFO:tasks.workunit.client.0.smithi038.stdout:1/534: rmdir d12 39 2024-09-13T18:30:37.823 INFO:tasks.workunit.client.0.smithi038.stdout:1/535: stat f10 0 2024-09-13T18:30:37.825 INFO:tasks.workunit.client.0.smithi038.stdout:7/443: rmdir db/d12/d1c/d3a/d26 39 2024-09-13T18:30:37.827 INFO:tasks.workunit.client.0.smithi038.stdout:2/432: symlink d2/d2a/l9f 0 2024-09-13T18:30:37.830 INFO:tasks.workunit.client.0.smithi038.stdout:4/740: creat d2/d49/d4b/d8e/fed x:0 0 0 2024-09-13T18:30:37.836 INFO:tasks.workunit.client.0.smithi038.stdout:7/444: mknod db/d12/d1c/ca3 0 2024-09-13T18:30:37.837 INFO:tasks.workunit.client.0.smithi038.stdout:7/445: chown db/d12/d1c/d3a/d3c/d52/d51 2 1 2024-09-13T18:30:37.837 INFO:tasks.workunit.client.0.smithi038.stdout:7/446: write db/d12/d1c/d3a/d3c/f40 [2331684,100112] 0 2024-09-13T18:30:37.838 INFO:tasks.workunit.client.0.smithi038.stdout:1/536: dwrite fb [0,4194304] 0 2024-09-13T18:30:37.838 INFO:tasks.workunit.client.0.smithi038.stdout:1/537: readlink d12/d2a/l93 0 2024-09-13T18:30:37.839 INFO:tasks.workunit.client.0.smithi038.stdout:2/433: mkdir d2/d1e/d44/d50/d39/d52/da0 0 2024-09-13T18:30:37.840 INFO:tasks.workunit.client.0.smithi038.stdout:4/741: mknod d2/d49/d4b/dbc/cee 0 2024-09-13T18:30:37.841 INFO:tasks.workunit.client.0.smithi038.stdout:4/742: fsync d2/df/d22/f65 0 2024-09-13T18:30:37.847 INFO:tasks.workunit.client.0.smithi038.stdout:7/447: dread db/d12/d1c/d3a/d3c/f46 [0,4194304] 0 2024-09-13T18:30:37.847 INFO:tasks.workunit.client.0.smithi038.stdout:7/448: write db/d12/d1c/d3a/d22/d28/f9d [20821,111610] 0 2024-09-13T18:30:37.847 INFO:tasks.workunit.client.0.smithi038.stdout:7/449: truncate db/d12/d1c/d3a/d22/d28/f9d 1058427 0 2024-09-13T18:30:37.847 INFO:tasks.workunit.client.0.smithi038.stdout:7/450: creat db/d12/d13/fa4 x:0 0 0 2024-09-13T18:30:37.847 INFO:tasks.workunit.client.0.smithi038.stdout:2/434: creat d2/d1e/d44/d50/d39/fa1 x:0 0 0 2024-09-13T18:30:37.852 INFO:tasks.workunit.client.0.smithi038.stdout:9/470: write d0/f2f [2212006,87043] 0 2024-09-13T18:30:37.853 INFO:tasks.workunit.client.0.smithi038.stdout:1/538: dwrite fc [0,4194304] 0 2024-09-13T18:30:37.854 INFO:tasks.workunit.client.0.smithi038.stdout:2/435: mknod d2/d1e/d44/d50/d46/d58/ca2 0 2024-09-13T18:30:37.854 INFO:tasks.workunit.client.0.smithi038.stdout:2/436: chown d2/l3 397911 1 2024-09-13T18:30:37.858 INFO:tasks.workunit.client.0.smithi038.stdout:7/451: dread db/d12/d1c/d3a/d3c/f40 [0,4194304] 0 2024-09-13T18:30:37.859 INFO:tasks.workunit.client.0.smithi038.stdout:9/471: symlink d0/d7/d13/d2d/d3e/d70/da2/da6/la9 0 2024-09-13T18:30:37.859 INFO:tasks.workunit.client.0.smithi038.stdout:9/472: creat d0/d7/d2c/faa x:0 0 0 2024-09-13T18:30:37.859 INFO:tasks.workunit.client.0.smithi038.stdout:9/473: fdatasync d0/d7/d13/f85 0 2024-09-13T18:30:37.864 INFO:tasks.workunit.client.0.smithi038.stdout:2/437: rmdir d2 39 2024-09-13T18:30:37.865 INFO:tasks.workunit.client.0.smithi038.stdout:7/452: getdents db/d12 0 2024-09-13T18:30:37.867 INFO:tasks.workunit.client.0.smithi038.stdout:2/438: getdents d2/d2a 0 2024-09-13T18:30:37.869 INFO:tasks.workunit.client.0.smithi038.stdout:7/453: creat db/d12/d1c/d3a/d26/fa5 x:0 0 0 2024-09-13T18:30:37.869 INFO:tasks.workunit.client.0.smithi038.stdout:7/454: chown db/d12/d13/c64 3 1 2024-09-13T18:30:37.870 INFO:tasks.workunit.client.0.smithi038.stdout:2/439: mknod d2/d5c/d93/d62/ca3 0 2024-09-13T18:30:37.873 INFO:tasks.workunit.client.0.smithi038.stdout:7/455: mknod db/d12/d1c/d3a/d3c/d52/d51/ca6 0 2024-09-13T18:30:37.873 INFO:tasks.workunit.client.0.smithi038.stdout:2/440: mkdir d2/d1e/d87/da4 0 2024-09-13T18:30:37.884 INFO:tasks.workunit.client.0.smithi038.stdout:1/539: dwrite f3 [0,4194304] 0 2024-09-13T18:30:37.884 INFO:tasks.workunit.client.0.smithi038.stdout:1/540: creat d12/d3c/d46/fa9 x:0 0 0 2024-09-13T18:30:37.886 INFO:tasks.workunit.client.0.smithi038.stdout:1/541: getdents d12/d2a/d32 0 2024-09-13T18:30:37.887 INFO:tasks.workunit.client.0.smithi038.stdout:1/542: symlink d12/d2a/d32/d59/d5b/d47/d84/da7/laa 0 2024-09-13T18:30:37.887 INFO:tasks.workunit.client.0.smithi038.stdout:1/543: dread - d12/d3c/d46/d58/f79 zero size 2024-09-13T18:30:37.887 INFO:tasks.workunit.client.0.smithi038.stdout:1/544: fdatasync d12/f7d 0 2024-09-13T18:30:37.888 INFO:tasks.workunit.client.0.smithi038.stdout:3/382: sync 2024-09-13T18:30:37.888 INFO:tasks.workunit.client.0.smithi038.stdout:1/545: rmdir d12/d2a/d72/d8d 39 2024-09-13T18:30:37.888 INFO:tasks.workunit.client.0.smithi038.stdout:1/546: dread - d12/d3c/f63 zero size 2024-09-13T18:30:37.888 INFO:tasks.workunit.client.0.smithi038.stdout:6/481: sync 2024-09-13T18:30:37.888 INFO:tasks.workunit.client.0.smithi038.stdout:6/482: write dd/de/d2e/d30/f29 [119495,94681] 0 2024-09-13T18:30:37.888 INFO:tasks.workunit.client.0.smithi038.stdout:6/483: write dd/de/d2e/d99/f80 [908394,65248] 0 2024-09-13T18:30:37.889 INFO:tasks.workunit.client.0.smithi038.stdout:6/484: fsync dd/de/d2e/d2f/d4c/d55/f5e 0 2024-09-13T18:30:37.889 INFO:tasks.workunit.client.0.smithi038.stdout:3/383: write d0/dd/d17/d50/d51/f58 [68292,61010] 0 2024-09-13T18:30:37.890 INFO:tasks.workunit.client.0.smithi038.stdout:3/384: truncate d0/dd/f5e 454115 0 2024-09-13T18:30:37.890 INFO:tasks.workunit.client.0.smithi038.stdout:3/385: fdatasync d0/dd/d17/d50/d5c/f55 0 2024-09-13T18:30:37.890 INFO:tasks.workunit.client.0.smithi038.stdout:6/485: mkdir dd/de/d31/daf 0 2024-09-13T18:30:37.891 INFO:tasks.workunit.client.0.smithi038.stdout:6/486: truncate dd/de/d31/f3e 2472570 0 2024-09-13T18:30:37.891 INFO:tasks.workunit.client.0.smithi038.stdout:9/474: dwrite d0/d7/d13/d2d/d3c/f3f [0,4194304] 0 2024-09-13T18:30:37.892 INFO:tasks.workunit.client.0.smithi038.stdout:2/441: dwrite d2/d1e/f8a [0,4194304] 0 2024-09-13T18:30:37.892 INFO:tasks.workunit.client.0.smithi038.stdout:2/442: fsync d2/da/f1b 0 2024-09-13T18:30:37.892 INFO:tasks.workunit.client.0.smithi038.stdout:2/443: creat d2/d1e/d87/fa5 x:0 0 0 2024-09-13T18:30:37.899 INFO:tasks.workunit.client.0.smithi038.stdout:9/475: dread d0/f1 [0,4194304] 0 2024-09-13T18:30:37.900 INFO:tasks.workunit.client.0.smithi038.stdout:2/444: mkdir d2/d1e/d44/d50/d46/da6 0 2024-09-13T18:30:37.903 INFO:tasks.workunit.client.0.smithi038.stdout:2/445: dread d2/da/f94 [0,4194304] 0 2024-09-13T18:30:37.903 INFO:tasks.workunit.client.0.smithi038.stdout:2/446: fsync d2/d5c/d93/d62/f80 0 2024-09-13T18:30:37.903 INFO:tasks.workunit.client.0.smithi038.stdout:9/476: link d0/d7/d2c/d33/f96 d0/d7/d13/d2d/d3e/d70/fab 0 2024-09-13T18:30:37.911 INFO:tasks.workunit.client.0.smithi038.stdout:9/477: mkdir d0/dac 0 2024-09-13T18:30:37.911 INFO:tasks.workunit.client.0.smithi038.stdout:1/547: dwrite d12/d2a/d32/d59/d5b/f42 [8388608,4194304] 0 2024-09-13T18:30:37.911 INFO:tasks.workunit.client.0.smithi038.stdout:1/548: fsync d12/d2a/f6f 0 2024-09-13T18:30:37.911 INFO:tasks.workunit.client.0.smithi038.stdout:1/549: write d12/f2d [785211,30420] 0 2024-09-13T18:30:37.911 INFO:tasks.workunit.client.0.smithi038.stdout:1/550: fsync d12/f98 0 2024-09-13T18:30:37.914 INFO:tasks.workunit.client.0.smithi038.stdout:1/551: creat d12/d3c/d46/d57/da4/fab x:0 0 0 2024-09-13T18:30:37.914 INFO:tasks.workunit.client.0.smithi038.stdout:1/552: chown d12/f2d 991944882 1 2024-09-13T18:30:37.916 INFO:tasks.workunit.client.0.smithi038.stdout:1/553: getdents d12/d2a/d32/d59/d5b/d47/d84 0 2024-09-13T18:30:37.917 INFO:tasks.workunit.client.0.smithi038.stdout:2/447: rmdir d2/d1e/d87 39 2024-09-13T18:30:37.917 INFO:tasks.workunit.client.0.smithi038.stdout:2/448: read - d2/d5c/d93/d62/f91 zero size 2024-09-13T18:30:37.918 INFO:tasks.workunit.client.0.smithi038.stdout:1/554: link d12/d2a/d32/c44 d12/d2a/d32/d82/cac 0 2024-09-13T18:30:37.922 INFO:tasks.workunit.client.0.smithi038.stdout:9/478: dread d0/ff [0,4194304] 0 2024-09-13T18:30:37.922 INFO:tasks.workunit.client.0.smithi038.stdout:3/386: dwrite d0/dd/d17/d50/d5c/f55 [0,4194304] 0 2024-09-13T18:30:37.923 INFO:tasks.workunit.client.0.smithi038.stdout:1/555: mknod d12/d2a/d72/d8d/cad 0 2024-09-13T18:30:37.923 INFO:tasks.workunit.client.0.smithi038.stdout:6/487: dwrite dd/de/d2e/d2f/d4c/d55/f9d [0,4194304] 0 2024-09-13T18:30:37.923 INFO:tasks.workunit.client.0.smithi038.stdout:6/488: chown dd/de/d31/d63/d83/lae 0 1 2024-09-13T18:30:37.923 INFO:tasks.workunit.client.0.smithi038.stdout:6/489: write dd/de/d2e/f6e [777375,79582] 0 2024-09-13T18:30:37.933 INFO:tasks.workunit.client.0.smithi038.stdout:2/449: rmdir d2/d1e 39 2024-09-13T18:30:37.935 INFO:tasks.workunit.client.0.smithi038.stdout:9/479: mknod d0/d2e/cad 0 2024-09-13T18:30:37.935 INFO:tasks.workunit.client.0.smithi038.stdout:9/480: truncate d0/d7/d2c/f76 716871 0 2024-09-13T18:30:37.937 INFO:tasks.workunit.client.0.smithi038.stdout:1/556: dwrite d12/d3c/d46/f94 [0,4194304] 0 2024-09-13T18:30:37.940 INFO:tasks.workunit.client.0.smithi038.stdout:3/387: rename d0/dd/d17/d50/d5c/d1d/d30/l48 to d0/dd/d17/d50/d59/l7a 0 2024-09-13T18:30:37.948 INFO:tasks.workunit.client.0.smithi038.stdout:2/450: unlink d2/d1e/d44/f6a 0 2024-09-13T18:30:37.949 INFO:tasks.workunit.client.0.smithi038.stdout:2/451: write d2/f34 [712601,71197] 0 2024-09-13T18:30:37.952 INFO:tasks.workunit.client.0.smithi038.stdout:1/557: symlink d12/d7a/lae 0 2024-09-13T18:30:37.957 INFO:tasks.workunit.client.0.smithi038.stdout:3/388: creat d0/dd/d17/d50/d5c/d1d/d29/f7b x:0 0 0 2024-09-13T18:30:37.959 INFO:tasks.workunit.client.0.smithi038.stdout:6/490: rename dd/de/d31/f54 to dd/fb0 0 2024-09-13T18:30:37.959 INFO:tasks.workunit.client.0.smithi038.stdout:6/491: stat dd/de/d2e/d2f/d4c/d55/f5b 0 2024-09-13T18:30:37.974 INFO:tasks.workunit.client.0.smithi038.stdout:2/452: creat d2/d1e/d44/fa7 x:0 0 0 2024-09-13T18:30:37.977 INFO:tasks.workunit.client.0.smithi038.stdout:3/389: mkdir d0/dd/d17/d50/d5c/d23/d7c 0 2024-09-13T18:30:37.977 INFO:tasks.workunit.client.0.smithi038.stdout:3/390: chown d0/dd/d17/d50/d59 176543 1 2024-09-13T18:30:37.977 INFO:tasks.workunit.client.0.smithi038.stdout:3/391: dread - d0/dd/d17/d50/d51/f5f zero size 2024-09-13T18:30:37.978 INFO:tasks.workunit.client.0.smithi038.stdout:3/392: fsync d0/fa 0 2024-09-13T18:30:37.978 INFO:tasks.workunit.client.0.smithi038.stdout:3/393: chown d0/dd/d17/d50/d5c/f21 7576 1 2024-09-13T18:30:37.980 INFO:tasks.workunit.client.0.smithi038.stdout:9/481: rename d0 to d0/dae 22 2024-09-13T18:30:37.980 INFO:tasks.workunit.client.0.smithi038.stdout:9/482: chown d0/d7/d13/d30/f4d 250313929 1 2024-09-13T18:30:37.980 INFO:tasks.workunit.client.0.smithi038.stdout:9/483: creat d0/d7/d13/d2d/d3e/faf x:0 0 0 2024-09-13T18:30:37.983 INFO:tasks.workunit.client.0.smithi038.stdout:2/453: unlink d2/d1e/l27 0 2024-09-13T18:30:37.983 INFO:tasks.workunit.client.0.smithi038.stdout:9/484: dread d0/d7/d13/d2d/d3c/d50/f54 [0,4194304] 0 2024-09-13T18:30:37.985 INFO:tasks.workunit.client.0.smithi038.stdout:1/558: getdents d12/d3c/d46/d57/da4 0 2024-09-13T18:30:37.986 INFO:tasks.workunit.client.0.smithi038.stdout:9/485: dread d0/d7/d13/f42 [0,4194304] 0 2024-09-13T18:30:37.989 INFO:tasks.workunit.client.0.smithi038.stdout:3/394: unlink d0/dd/f1a 0 2024-09-13T18:30:37.993 INFO:tasks.workunit.client.0.smithi038.stdout:6/492: rename f1 to dd/de/d2e/d2f/fb1 0 2024-09-13T18:30:37.995 INFO:tasks.workunit.client.0.smithi038.stdout:2/454: mknod d2/d1e/d44/d50/d39/d45/ca8 0 2024-09-13T18:30:37.997 INFO:tasks.workunit.client.0.smithi038.stdout:1/559: mkdir d12/d2a/d32/d59/d5e/daf 0 2024-09-13T18:30:37.997 INFO:tasks.workunit.client.0.smithi038.stdout:1/560: fsync d12/d2a/f6f 0 2024-09-13T18:30:37.998 INFO:tasks.workunit.client.0.smithi038.stdout:9/486: mknod d0/d2e/d7f/cb0 0 2024-09-13T18:30:38.000 INFO:tasks.workunit.client.0.smithi038.stdout:3/395: link d0/dd/d17/d50/d5c/d23/d52/d6e/c40 d0/dd/d17/c7d 0 2024-09-13T18:30:38.001 INFO:tasks.workunit.client.0.smithi038.stdout:6/493: truncate dd/f11 451561 0 2024-09-13T18:30:38.001 INFO:tasks.workunit.client.0.smithi038.stdout:6/494: fdatasync dd/de/d2e/f58 0 2024-09-13T18:30:38.002 INFO:tasks.workunit.client.0.smithi038.stdout:2/455: creat d2/d5c/d93/d62/fa9 x:0 0 0 2024-09-13T18:30:38.003 INFO:tasks.workunit.client.0.smithi038.stdout:9/487: creat d0/d7/d13/d2d/d3e/d70/da2/da6/fb1 x:0 0 0 2024-09-13T18:30:38.007 INFO:tasks.workunit.client.0.smithi038.stdout:3/396: truncate d0/dd/f2a 2495039 0 2024-09-13T18:30:38.007 INFO:tasks.workunit.client.0.smithi038.stdout:3/397: truncate d0/dd/f5e 1489517 0 2024-09-13T18:30:38.010 INFO:tasks.workunit.client.0.smithi038.stdout:2/456: rename d2/da/f8c to d2/d1e/d44/d50/d39/faa 0 2024-09-13T18:30:38.011 INFO:tasks.workunit.client.0.smithi038.stdout:2/457: write d2/d1e/d44/d50/d46/f85 [727211,124221] 0 2024-09-13T18:30:38.015 INFO:tasks.workunit.client.0.smithi038.stdout:2/458: creat d2/da/d74/fab x:0 0 0 2024-09-13T18:30:38.016 INFO:tasks.workunit.client.0.smithi038.stdout:6/495: dwrite dd/de/d2e/d2f/d4c/d55/f7e [0,4194304] 0 2024-09-13T18:30:38.016 INFO:tasks.workunit.client.0.smithi038.stdout:3/398: dread d0/dd/d17/d50/d5c/d23/d52/d6e/f4e [0,4194304] 0 2024-09-13T18:30:38.021 INFO:tasks.workunit.client.0.smithi038.stdout:2/459: dread d2/f8 [0,4194304] 0 2024-09-13T18:30:38.025 INFO:tasks.workunit.client.0.smithi038.stdout:9/488: rmdir d0/d7/d2c 39 2024-09-13T18:30:38.031 INFO:tasks.workunit.client.0.smithi038.stdout:6/496: creat dd/de/d2e/d99/fb2 x:0 0 0 2024-09-13T18:30:38.033 INFO:tasks.workunit.client.0.smithi038.stdout:3/399: truncate d0/dd/d17/f1c 747040 0 2024-09-13T18:30:38.034 INFO:tasks.workunit.client.0.smithi038.stdout:3/400: chown d0/dd/fe 102 1 2024-09-13T18:30:38.034 INFO:tasks.workunit.client.0.smithi038.stdout:3/401: stat d0/dd/d17/d50/d5c/d23/d6b 0 2024-09-13T18:30:38.035 INFO:tasks.workunit.client.0.smithi038.stdout:2/460: unlink d2/f11 0 2024-09-13T18:30:38.037 INFO:tasks.workunit.client.0.smithi038.stdout:0/459: sync 2024-09-13T18:30:38.037 INFO:tasks.workunit.client.0.smithi038.stdout:8/500: sync 2024-09-13T18:30:38.039 INFO:tasks.workunit.client.0.smithi038.stdout:6/497: link dd/de/d2e/d99/c9a dd/de/d2e/d2f/d4c/d86/cb3 0 2024-09-13T18:30:38.039 INFO:tasks.workunit.client.0.smithi038.stdout:6/498: chown dd/de/d2e/d2f/d4c/d60/f73 3532 1 2024-09-13T18:30:38.040 INFO:tasks.workunit.client.0.smithi038.stdout:3/402: symlink d0/dd/d17/d50/d5c/l7e 0 2024-09-13T18:30:38.040 INFO:tasks.workunit.client.0.smithi038.stdout:3/403: readlink d0/dd/d17/d50/d5c/d1d/d29/d2b/l3c 0 2024-09-13T18:30:38.043 INFO:tasks.workunit.client.0.smithi038.stdout:2/461: unlink d2/d1e/d44/d50/d39/f42 0 2024-09-13T18:30:38.043 INFO:tasks.workunit.client.0.smithi038.stdout:0/460: rmdir d2/d7/d24/d92/d40/d74 39 2024-09-13T18:30:38.044 INFO:tasks.workunit.client.0.smithi038.stdout:9/489: dwrite d0/d7/d2c/d6d/f75 [0,4194304] 0 2024-09-13T18:30:38.046 INFO:tasks.workunit.client.0.smithi038.stdout:6/499: rename dd/de/d31/f52 to dd/de/d2e/d2f/da6/fb4 0 2024-09-13T18:30:38.046 INFO:tasks.workunit.client.0.smithi038.stdout:6/500: chown dd/de/d61/f92 433 1 2024-09-13T18:30:38.046 INFO:tasks.workunit.client.0.smithi038.stdout:6/501: stat dd/de/d2e/c3a 0 2024-09-13T18:30:38.051 INFO:tasks.workunit.client.0.smithi038.stdout:0/461: dread d2/dc/f51 [0,4194304] 0 2024-09-13T18:30:38.051 INFO:tasks.workunit.client.0.smithi038.stdout:0/462: read - d2/d7/d55/f73 zero size 2024-09-13T18:30:38.051 INFO:tasks.workunit.client.0.smithi038.stdout:0/463: write d2/d7/d24/d92/d66/f90 [366809,9144] 0 2024-09-13T18:30:38.052 INFO:tasks.workunit.client.0.smithi038.stdout:0/464: truncate d2/d7/d24/d92/d40/f70 934134 0 2024-09-13T18:30:38.052 INFO:tasks.workunit.client.0.smithi038.stdout:0/465: readlink d2/l4e 0 2024-09-13T18:30:38.052 INFO:tasks.workunit.client.0.smithi038.stdout:9/490: link d0/d7/d13/d2d/d3c/f73 d0/d2e/fb2 0 2024-09-13T18:30:38.054 INFO:tasks.workunit.client.0.smithi038.stdout:6/502: unlink dd/l1b 0 2024-09-13T18:30:38.058 INFO:tasks.workunit.client.0.smithi038.stdout:8/501: read d1/de/d21/f85 [8381005,39646] 0 2024-09-13T18:30:38.063 INFO:tasks.workunit.client.0.smithi038.stdout:0/466: mkdir d2/d7/d24/d92/d40/d97 0 2024-09-13T18:30:38.063 INFO:tasks.workunit.client.0.smithi038.stdout:0/467: truncate d2/d7/d24/d92/d66/f5e 969493 0 2024-09-13T18:30:38.063 INFO:tasks.workunit.client.0.smithi038.stdout:2/462: write d2/d1e/f8a [833169,52282] 0 2024-09-13T18:30:38.065 INFO:tasks.workunit.client.0.smithi038.stdout:6/503: unlink dd/de/d2e/d2f/d4c/d55/f57 0 2024-09-13T18:30:38.070 INFO:tasks.workunit.client.0.smithi038.stdout:8/502: truncate d1/de/f23 2251816 0 2024-09-13T18:30:38.071 INFO:tasks.workunit.client.0.smithi038.stdout:3/404: dwrite d0/dd/f2a [0,4194304] 0 2024-09-13T18:30:38.071 INFO:tasks.workunit.client.0.smithi038.stdout:9/491: dwrite d0/d7/d13/d2d/d3e/d70/d7b/f9f [0,4194304] 0 2024-09-13T18:30:38.073 INFO:tasks.workunit.client.0.smithi038.stdout:2/463: symlink d2/lac 0 2024-09-13T18:30:38.074 INFO:tasks.workunit.client.0.smithi038.stdout:0/468: dread d2/d7/d24/d92/d66/d81/f83 [0,4194304] 0 2024-09-13T18:30:38.075 INFO:tasks.workunit.client.0.smithi038.stdout:6/504: rename dd/de/d2e/d99/c9a to dd/de/d61/da1/cb5 0 2024-09-13T18:30:38.076 INFO:tasks.workunit.client.0.smithi038.stdout:8/503: dread d1/de/d21/f85 [4194304,4194304] 0 2024-09-13T18:30:38.083 INFO:tasks.workunit.client.0.smithi038.stdout:9/492: getdents d0/d7/d2c/d5a 0 2024-09-13T18:30:38.085 INFO:tasks.workunit.client.0.smithi038.stdout:2/464: chown d2/d1e/d44/d50/d39/faa 1622 1 2024-09-13T18:30:38.086 INFO:tasks.workunit.client.0.smithi038.stdout:2/465: creat d2/da/d98/fad x:0 0 0 2024-09-13T18:30:38.088 INFO:tasks.workunit.client.0.smithi038.stdout:0/469: getdents d2/d7/d24/d92 0 2024-09-13T18:30:38.090 INFO:tasks.workunit.client.0.smithi038.stdout:3/405: rename d0/dd/d17/d50/d5c/d23/f2e to d0/dd/d17/d79/f7f 0 2024-09-13T18:30:38.095 INFO:tasks.workunit.client.0.smithi038.stdout:8/504: dwrite d1/d8/f44 [0,4194304] 0 2024-09-13T18:30:38.095 INFO:tasks.workunit.client.0.smithi038.stdout:9/493: symlink d0/d7/d13/d2d/d3c/d50/lb3 0 2024-09-13T18:30:38.095 INFO:tasks.workunit.client.0.smithi038.stdout:9/494: fdatasync d0/d7/d13/d2d/d3c/d50/f54 0 2024-09-13T18:30:38.097 INFO:tasks.workunit.client.0.smithi038.stdout:3/406: dread d0/dd/d17/d50/d5c/f21 [0,4194304] 0 2024-09-13T18:30:38.098 INFO:tasks.workunit.client.0.smithi038.stdout:2/466: creat d2/d5c/d66/fae x:0 0 0 2024-09-13T18:30:38.099 INFO:tasks.workunit.client.0.smithi038.stdout:0/470: truncate d2/dc/f51 789318 0 2024-09-13T18:30:38.100 INFO:tasks.workunit.client.0.smithi038.stdout:8/505: mkdir d1/de/d21/d24/d4d/da6 0 2024-09-13T18:30:38.101 INFO:tasks.workunit.client.0.smithi038.stdout:9/495: creat d0/d7/d13/d2d/fb4 x:0 0 0 2024-09-13T18:30:38.102 INFO:tasks.workunit.client.0.smithi038.stdout:3/407: rename d0/dd/d17/c61 to d0/dd/d17/d50/d5c/d1d/d29/d2b/c80 0 2024-09-13T18:30:38.104 INFO:tasks.workunit.client.0.smithi038.stdout:3/408: dread d0/f2 [4194304,4194304] 0 2024-09-13T18:30:38.105 INFO:tasks.workunit.client.0.smithi038.stdout:3/409: creat d0/dd/d17/f81 x:0 0 0 2024-09-13T18:30:38.105 INFO:tasks.workunit.client.0.smithi038.stdout:9/496: stat d0/ca0 0 2024-09-13T18:30:38.105 INFO:tasks.workunit.client.0.smithi038.stdout:9/497: creat d0/d7/fb5 x:0 0 0 2024-09-13T18:30:38.112 INFO:tasks.workunit.client.0.smithi038.stdout:0/471: rename d2/d89 to d2/d7/d24/d92/d40/d97/d98 0 2024-09-13T18:30:38.112 INFO:tasks.workunit.client.0.smithi038.stdout:0/472: fdatasync d2/d7/d24/d3c/f79 0 2024-09-13T18:30:38.113 INFO:tasks.workunit.client.0.smithi038.stdout:3/410: write d0/dd/d17/f60 [562333,124969] 0 2024-09-13T18:30:38.115 INFO:tasks.workunit.client.0.smithi038.stdout:2/467: rmdir d2/da 39 2024-09-13T18:30:38.119 INFO:tasks.workunit.client.0.smithi038.stdout:8/506: getdents d1/de/d21/d24/d41/d7d 0 2024-09-13T18:30:38.123 INFO:tasks.workunit.client.0.smithi038.stdout:9/498: truncate d0/d7/d13/d2d/d3c/f3f 271514 0 2024-09-13T18:30:38.126 INFO:tasks.workunit.client.0.smithi038.stdout:3/411: creat d0/dd/d17/d50/d5c/d23/d7c/f82 x:0 0 0 2024-09-13T18:30:38.126 INFO:tasks.workunit.client.0.smithi038.stdout:3/412: readlink d0/dd/l41 0 2024-09-13T18:30:38.130 INFO:tasks.workunit.client.0.smithi038.stdout:9/499: truncate d0/d2e/f25 3904769 0 2024-09-13T18:30:38.133 INFO:tasks.workunit.client.0.smithi038.stdout:3/413: unlink d0/dd/d17/d50/d5c/d1d/d29/d2b/c80 0 2024-09-13T18:30:38.134 INFO:tasks.workunit.client.0.smithi038.stdout:9/500: mkdir d0/d7/d13/d2d/d3e/d70/da2/d86/db6 0 2024-09-13T18:30:38.136 INFO:tasks.workunit.client.0.smithi038.stdout:0/473: dwrite d2/d7/d24/d92/d66/d81/f93 [0,4194304] 0 2024-09-13T18:30:38.136 INFO:tasks.workunit.client.0.smithi038.stdout:0/474: creat d2/d7/d24/f99 x:0 0 0 2024-09-13T18:30:38.139 INFO:tasks.workunit.client.0.smithi038.stdout:8/507: dwrite d1/f7 [8388608,4194304] 0 2024-09-13T18:30:38.147 INFO:tasks.workunit.client.0.smithi038.stdout:3/414: getdents d0/dd 0 2024-09-13T18:30:38.153 INFO:tasks.workunit.client.0.smithi038.stdout:0/475: dwrite d2/d7/d24/d92/d66/d49/f65 [0,4194304] 0 2024-09-13T18:30:38.153 INFO:tasks.workunit.client.0.smithi038.stdout:0/476: dread - d2/d7/d24/d92/d66/f85 zero size 2024-09-13T18:30:38.153 INFO:tasks.workunit.client.0.smithi038.stdout:0/477: chown d2/d7/d55/f73 568950229 1 2024-09-13T18:30:38.156 INFO:tasks.workunit.client.0.smithi038.stdout:0/478: mkdir d2/d7/d24/d92/d40/d9a 0 2024-09-13T18:30:38.156 INFO:tasks.workunit.client.0.smithi038.stdout:0/479: dread - d2/d7/d24/d2b/f91 zero size 2024-09-13T18:30:38.172 INFO:tasks.workunit.client.0.smithi038.stdout:0/480: write d2/d7/f76 [1405378,88087] 0 2024-09-13T18:30:38.172 INFO:tasks.workunit.client.0.smithi038.stdout:0/481: readlink d2/d7/d24/l25 0 2024-09-13T18:30:38.172 INFO:tasks.workunit.client.0.smithi038.stdout:0/482: chown d2/d7/d24/d3c/d3f/l72 9203668 1 2024-09-13T18:30:38.174 INFO:tasks.workunit.client.0.smithi038.stdout:3/415: dwrite d0/dd/d17/d50/d5c/d1d/d30/f77 [4194304,4194304] 0 2024-09-13T18:30:38.174 INFO:tasks.workunit.client.0.smithi038.stdout:3/416: readlink d0/dd/d17/d50/d5c/d23/l72 0 2024-09-13T18:30:38.175 INFO:tasks.workunit.client.0.smithi038.stdout:8/508: dwrite d1/de/d15/d30/f3c [4194304,4194304] 0 2024-09-13T18:30:38.179 INFO:tasks.workunit.client.0.smithi038.stdout:3/417: dread d0/dd/d17/d50/d5c/d1d/d29/d2b/f36 [0,4194304] 0 2024-09-13T18:30:38.184 INFO:tasks.workunit.client.0.smithi038.stdout:8/509: symlink d1/de/d3a/la7 0 2024-09-13T18:30:38.185 INFO:tasks.workunit.client.0.smithi038.stdout:3/418: symlink d0/dd/d17/d50/l83 0 2024-09-13T18:30:38.188 INFO:tasks.workunit.client.0.smithi038.stdout:3/419: mkdir d0/dd/d17/d50/d5c/d1d/d29/d2b/d84 0 2024-09-13T18:30:38.189 INFO:tasks.workunit.client.0.smithi038.stdout:0/483: dwrite d2/f1c [0,4194304] 0 2024-09-13T18:30:38.191 INFO:tasks.workunit.client.0.smithi038.stdout:3/420: dread d0/dd/d17/f1c [0,4194304] 0 2024-09-13T18:30:38.194 INFO:tasks.workunit.client.0.smithi038.stdout:3/421: creat d0/dd/d17/d50/d51/f85 x:0 0 0 2024-09-13T18:30:38.196 INFO:tasks.workunit.client.0.smithi038.stdout:0/484: dread d2/d7/d24/d3c/f4d [0,4194304] 0 2024-09-13T18:30:38.196 INFO:tasks.workunit.client.0.smithi038.stdout:3/422: getdents d0/dd/d17/d50/d5c/d23/d52/d6e 0 2024-09-13T18:30:38.197 INFO:tasks.workunit.client.0.smithi038.stdout:3/423: truncate d0/dd/d17/d50/d5c/d23/d6b/f78 352944 0 2024-09-13T18:30:38.197 INFO:tasks.workunit.client.0.smithi038.stdout:3/424: truncate d0/dd/d17/d50/d5c/f21 1605130 0 2024-09-13T18:30:38.199 INFO:tasks.workunit.client.0.smithi038.stdout:3/425: symlink d0/dd/d17/d50/d5c/d23/l86 0 2024-09-13T18:30:38.203 INFO:tasks.workunit.client.0.smithi038.stdout:3/426: creat d0/dd/d17/d79/f87 x:0 0 0 2024-09-13T18:30:38.204 INFO:tasks.workunit.client.0.smithi038.stdout:3/427: dread - d0/dd/d17/f81 zero size 2024-09-13T18:30:38.205 INFO:tasks.workunit.client.0.smithi038.stdout:3/428: mknod d0/dd/d17/d50/d5c/d1d/c88 0 2024-09-13T18:30:38.206 INFO:tasks.workunit.client.0.smithi038.stdout:8/510: dwrite d1/de/d15/f1c [0,4194304] 0 2024-09-13T18:30:38.215 INFO:tasks.workunit.client.0.smithi038.stdout:0/485: dwrite d2/f1e [0,4194304] 0 2024-09-13T18:30:38.215 INFO:tasks.workunit.client.0.smithi038.stdout:0/486: readlink d2/d7/d24/l82 0 2024-09-13T18:30:38.219 INFO:tasks.workunit.client.0.smithi038.stdout:0/487: mknod d2/d7/d24/d92/d40/d87/d8f/c9b 0 2024-09-13T18:30:38.221 INFO:tasks.workunit.client.0.smithi038.stdout:0/488: rmdir d2/d7/d24/d3c/d3f 39 2024-09-13T18:30:38.225 INFO:tasks.workunit.client.0.smithi038.stdout:0/489: dread d2/d7/d24/d2b/f43 [0,4194304] 0 2024-09-13T18:30:38.225 INFO:tasks.workunit.client.0.smithi038.stdout:8/511: dwrite d1/d4/f47 [0,4194304] 0 2024-09-13T18:30:38.233 INFO:tasks.workunit.client.0.smithi038.stdout:8/512: creat d1/de/d21/d24/d41/d7d/fa8 x:0 0 0 2024-09-13T18:30:38.233 INFO:tasks.workunit.client.0.smithi038.stdout:8/513: creat d1/de/d15/d30/fa9 x:0 0 0 2024-09-13T18:30:38.241 INFO:tasks.workunit.client.0.smithi038.stdout:3/429: rename d0/dd/d17/d50/d51 to d0/dd/d17/d43/d89 0 2024-09-13T18:30:38.243 INFO:tasks.workunit.client.0.smithi038.stdout:8/514: rename d1/de/d15/f1c to d1/d8/faa 0 2024-09-13T18:30:38.244 INFO:tasks.workunit.client.0.smithi038.stdout:3/430: unlink d0/dd/d17/d50/d5c/d23/d52/d6e/f4e 0 2024-09-13T18:30:38.245 INFO:tasks.workunit.client.0.smithi038.stdout:3/431: mkdir d0/dd/d17/d43/d8a 0 2024-09-13T18:30:38.246 INFO:tasks.workunit.client.0.smithi038.stdout:5/492: sync 2024-09-13T18:30:38.255 INFO:tasks.workunit.client.0.smithi038.stdout:5/493: write f1 [4721046,117415] 0 2024-09-13T18:30:38.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:37 smithi149 ceph-mon[35845]: pgmap v21: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 210 MiB/s rd, 261 MiB/s wr, 376 op/s 2024-09-13T18:30:38.272 INFO:tasks.workunit.client.0.smithi038.stdout:5/494: dwrite df/d68/f71 [0,4194304] 0 2024-09-13T18:30:38.274 INFO:tasks.workunit.client.0.smithi038.stdout:5/495: mkdir df/d13/d3b/d44/d48/d9d 0 2024-09-13T18:30:38.275 INFO:tasks.workunit.client.0.smithi038.stdout:3/432: rmdir d0/dd/d17/d50 39 2024-09-13T18:30:38.276 INFO:tasks.workunit.client.0.smithi038.stdout:5/496: rename df/d13/d3b/d44/d58/f87 to df/d13/d3b/d41/f9e 0 2024-09-13T18:30:38.277 INFO:tasks.workunit.client.0.smithi038.stdout:3/433: getdents d0 0 2024-09-13T18:30:38.277 INFO:tasks.workunit.client.0.smithi038.stdout:3/434: chown d0/dd/d17/d50/d5c/d1d/d29/d2b/d84 185 1 2024-09-13T18:30:38.279 INFO:tasks.workunit.client.0.smithi038.stdout:3/435: write d0/f2 [4710138,123585] 0 2024-09-13T18:30:38.279 INFO:tasks.workunit.client.0.smithi038.stdout:3/436: dread - d0/dd/d17/d50/d5c/d23/d6b/f6d zero size 2024-09-13T18:30:38.280 INFO:tasks.workunit.client.0.smithi038.stdout:3/437: mknod d0/dd/d17/d50/d5c/d1d/d29/d2b/c8b 0 2024-09-13T18:30:38.304 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:37 smithi038 ceph-mon[27689]: pgmap v21: 65 pgs: 65 active+clean; 2.6 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 210 MiB/s rd, 261 MiB/s wr, 376 op/s 2024-09-13T18:30:38.311 INFO:tasks.workunit.client.0.smithi038.stdout:5/497: dwrite df/d15/d36/f3a [4194304,4194304] 0 2024-09-13T18:30:38.312 INFO:tasks.workunit.client.0.smithi038.stdout:3/438: dwrite d0/dd/d17/d43/f45 [0,4194304] 0 2024-09-13T18:30:38.314 INFO:tasks.workunit.client.0.smithi038.stdout:5/498: unlink df/c1a 0 2024-09-13T18:30:38.314 INFO:tasks.workunit.client.0.smithi038.stdout:5/499: chown df/d13/d3b/d44/d48/d54 27212 1 2024-09-13T18:30:38.314 INFO:tasks.workunit.client.0.smithi038.stdout:5/500: read - df/d13/d3b/d44/d48/f95 zero size 2024-09-13T18:30:38.318 INFO:tasks.workunit.client.0.smithi038.stdout:3/439: rename d0/dd/d17/d50/f71 to d0/dd/d17/d50/d5c/d23/d52/f8c 0 2024-09-13T18:30:38.327 INFO:tasks.workunit.client.0.smithi038.stdout:5/501: dread df/d68/f71 [0,4194304] 0 2024-09-13T18:30:38.345 INFO:tasks.workunit.client.0.smithi038.stdout:3/440: dwrite d0/dd/f5e [0,4194304] 0 2024-09-13T18:30:38.345 INFO:tasks.workunit.client.0.smithi038.stdout:5/502: dwrite df/d13/d3b/d44/d48/d54/f90 [0,4194304] 0 2024-09-13T18:30:38.345 INFO:tasks.workunit.client.0.smithi038.stdout:5/503: write df/d13/d3b/d3e/f5a [1264200,7482] 0 2024-09-13T18:30:38.347 INFO:tasks.workunit.client.0.smithi038.stdout:3/441: dread d0/dd/d17/f1c [0,4194304] 0 2024-09-13T18:30:38.347 INFO:tasks.workunit.client.0.smithi038.stdout:3/442: chown d0/dd/d17/d79/f7f 25 1 2024-09-13T18:30:38.358 INFO:tasks.workunit.client.0.smithi038.stdout:5/504: rename df/d15/l43 to df/d13/d3b/d44/d58/l9f 0 2024-09-13T18:30:38.358 INFO:tasks.workunit.client.0.smithi038.stdout:5/505: chown df/d15/c2e 2044303786 1 2024-09-13T18:30:38.363 INFO:tasks.workunit.client.0.smithi038.stdout:5/506: write df/f1e [4743667,86553] 0 2024-09-13T18:30:38.363 INFO:tasks.workunit.client.0.smithi038.stdout:3/443: mknod d0/dd/d17/d50/d5c/d1d/d29/d2b/c8d 0 2024-09-13T18:30:38.366 INFO:tasks.workunit.client.0.smithi038.stdout:3/444: rmdir d0/dd/d17/d50/d5c/d1d/d29/d2b 39 2024-09-13T18:30:38.366 INFO:tasks.workunit.client.0.smithi038.stdout:3/445: fdatasync d0/fa 0 2024-09-13T18:30:38.370 INFO:tasks.workunit.client.0.smithi038.stdout:3/446: unlink d0/dd/f5a 0 2024-09-13T18:30:38.370 INFO:tasks.workunit.client.0.smithi038.stdout:3/447: chown d0/dd/d17/d50/d5c/d1d/d29/d2b 457636965 1 2024-09-13T18:30:38.370 INFO:tasks.workunit.client.0.smithi038.stdout:3/448: fdatasync d0/dd/d17/d43/d89/f66 0 2024-09-13T18:30:38.423 INFO:tasks.workunit.client.0.smithi038.stdout:7/456: sync 2024-09-13T18:30:38.424 INFO:tasks.workunit.client.0.smithi038.stdout:4/743: sync 2024-09-13T18:30:38.424 INFO:tasks.workunit.client.0.smithi038.stdout:7/457: creat db/d8e/fa7 x:0 0 0 2024-09-13T18:30:38.426 INFO:tasks.workunit.client.0.smithi038.stdout:4/744: link d2/df/d22/f70 d2/df/fef 0 2024-09-13T18:30:38.426 INFO:tasks.workunit.client.0.smithi038.stdout:4/745: mknod d2/df/d1b/d10/da3/cf0 0 2024-09-13T18:30:38.427 INFO:tasks.workunit.client.0.smithi038.stdout:4/746: mkdir d2/df/d1b/df1 0 2024-09-13T18:30:38.455 INFO:tasks.workunit.client.0.smithi038.stdout:7/458: dwrite db/d12/d1c/d3a/d22/f30 [0,4194304] 0 2024-09-13T18:30:38.455 INFO:tasks.workunit.client.0.smithi038.stdout:4/747: dwrite d2/df/d1b/d10/da3/f7e [4194304,4194304] 0 2024-09-13T18:30:38.459 INFO:tasks.workunit.client.0.smithi038.stdout:4/748: symlink d2/df/lf2 0 2024-09-13T18:30:38.461 INFO:tasks.workunit.client.0.smithi038.stdout:7/459: mknod db/ca8 0 2024-09-13T18:30:38.464 INFO:tasks.workunit.client.0.smithi038.stdout:4/749: mknod d2/d49/d50/cf3 0 2024-09-13T18:30:38.467 INFO:tasks.workunit.client.0.smithi038.stdout:7/460: getdents db/d12/d1c/d3a/d3c 0 2024-09-13T18:30:38.469 INFO:tasks.workunit.client.0.smithi038.stdout:4/750: link d2/df/d1b/d10/ca2 d2/df/d1b/d10/d75/db1/cf4 0 2024-09-13T18:30:38.471 INFO:tasks.workunit.client.0.smithi038.stdout:4/751: symlink d2/df/d1b/df1/lf5 0 2024-09-13T18:30:38.474 INFO:tasks.workunit.client.0.smithi038.stdout:4/752: unlink d2/df/d1b/d10/d75/f8b 0 2024-09-13T18:30:38.474 INFO:tasks.workunit.client.0.smithi038.stdout:7/461: dread db/d12/d1c/d3a/d3c/f40 [0,4194304] 0 2024-09-13T18:30:38.477 INFO:tasks.workunit.client.0.smithi038.stdout:4/753: rename d2/d49/d50/da0/fc3 to d2/df/ff6 0 2024-09-13T18:30:38.480 INFO:tasks.workunit.client.0.smithi038.stdout:7/462: mknod db/d12/d1c/ca9 0 2024-09-13T18:30:38.480 INFO:tasks.workunit.client.0.smithi038.stdout:7/463: fdatasync db/d12/f6d 0 2024-09-13T18:30:38.480 INFO:tasks.workunit.client.0.smithi038.stdout:4/754: symlink d2/df/d22/d9a/de6/lf7 0 2024-09-13T18:30:38.483 INFO:tasks.workunit.client.0.smithi038.stdout:4/755: write d2/df/d22/f70 [1946717,76940] 0 2024-09-13T18:30:38.485 INFO:tasks.workunit.client.0.smithi038.stdout:7/464: read db/d12/d13/f32 [2554322,36398] 0 2024-09-13T18:30:38.498 INFO:tasks.workunit.client.0.smithi038.stdout:4/756: dread d2/df/d1b/d10/da3/f7e [4194304,4194304] 0 2024-09-13T18:30:38.501 INFO:tasks.workunit.client.0.smithi038.stdout:7/465: dwrite db/d12/d13/fa4 [0,4194304] 0 2024-09-13T18:30:38.501 INFO:tasks.workunit.client.0.smithi038.stdout:7/466: write db/d12/f34 [678004,55455] 0 2024-09-13T18:30:38.505 INFO:tasks.workunit.client.0.smithi038.stdout:7/467: rename db/d12/d13/d43/l9e to db/d12/d1c/d3a/d22/laa 0 2024-09-13T18:30:38.505 INFO:tasks.workunit.client.0.smithi038.stdout:7/468: write db/d12/d1c/d3a/d22/f7d [5138100,33928] 0 2024-09-13T18:30:38.505 INFO:tasks.workunit.client.0.smithi038.stdout:7/469: dread - db/d12/d1c/d3a/d3c/f74 zero size 2024-09-13T18:30:38.524 INFO:tasks.workunit.client.0.smithi038.stdout:7/470: dwrite db/d12/d13/f1b [0,4194304] 0 2024-09-13T18:30:38.524 INFO:tasks.workunit.client.0.smithi038.stdout:4/757: dwrite d2/d49/d50/da0/d8/d80/ddf/f83 [0,4194304] 0 2024-09-13T18:30:38.525 INFO:tasks.workunit.client.0.smithi038.stdout:7/471: rename db/d12/d1c/d3a/d3c/c85 to db/d21/cab 0 2024-09-13T18:30:38.532 INFO:tasks.workunit.client.0.smithi038.stdout:4/758: truncate d2/df/d1b/d10/d71/f81 67670 0 2024-09-13T18:30:38.533 INFO:tasks.workunit.client.0.smithi038.stdout:7/472: symlink db/d12/d1c/d3a/d22/lac 0 2024-09-13T18:30:38.536 INFO:tasks.workunit.client.0.smithi038.stdout:4/759: truncate d2/d49/d50/da0/d8/d80/ddf/f83 390846 0 2024-09-13T18:30:38.536 INFO:tasks.workunit.client.0.smithi038.stdout:4/760: write d2/d49/d50/da0/d8/f2e [3945249,7457] 0 2024-09-13T18:30:38.539 INFO:tasks.workunit.client.0.smithi038.stdout:4/761: creat d2/df/d1b/ff8 x:0 0 0 2024-09-13T18:30:38.539 INFO:tasks.workunit.client.0.smithi038.stdout:4/762: write d2/df/d1b/d10/d55/dd5/fd9 [965700,90625] 0 2024-09-13T18:30:38.540 INFO:tasks.workunit.client.0.smithi038.stdout:4/763: fsync d2/d49/d50/da0/fad 0 2024-09-13T18:30:38.541 INFO:tasks.workunit.client.0.smithi038.stdout:4/764: mknod d2/d49/d50/da0/d8/d80/ddf/cf9 0 2024-09-13T18:30:38.543 INFO:tasks.workunit.client.0.smithi038.stdout:4/765: creat d2/d49/d4b/dbc/ffa x:0 0 0 2024-09-13T18:30:38.546 INFO:tasks.workunit.client.0.smithi038.stdout:4/766: mkdir d2/df/d1b/d10/d55/dfb 0 2024-09-13T18:30:38.546 INFO:tasks.workunit.client.0.smithi038.stdout:4/767: chown d2/d49/d50/da0/f8d 18127392 1 2024-09-13T18:30:38.548 INFO:tasks.workunit.client.0.smithi038.stdout:4/768: creat d2/df/d22/d9a/de6/ffc x:0 0 0 2024-09-13T18:30:38.549 INFO:tasks.workunit.client.0.smithi038.stdout:4/769: rename d2/d49/d50/da0/d8/f6c to d2/d49/d50/da0/dcb/ffd 0 2024-09-13T18:30:38.551 INFO:tasks.workunit.client.0.smithi038.stdout:4/770: mknod d2/d49/d50/da0/dcb/cfe 0 2024-09-13T18:30:38.553 INFO:tasks.workunit.client.0.smithi038.stdout:4/771: symlink d2/d49/d50/da0/d8/d3b/lff 0 2024-09-13T18:30:38.555 INFO:tasks.workunit.client.0.smithi038.stdout:4/772: mkdir d2/d49/d50/da0/d8/d3b/d100 0 2024-09-13T18:30:38.573 INFO:tasks.workunit.client.0.smithi038.stdout:4/773: dwrite d2/f33 [0,4194304] 0 2024-09-13T18:30:38.573 INFO:tasks.workunit.client.0.smithi038.stdout:4/774: read - d2/d49/d50/da0/d8/d3b/fb9 zero size 2024-09-13T18:30:38.586 INFO:tasks.workunit.client.0.smithi038.stdout:1/561: sync 2024-09-13T18:30:38.587 INFO:tasks.workunit.client.0.smithi038.stdout:1/562: chown d12/d2a/d32/d59/d5b/d47/d84/da7 109337 1 2024-09-13T18:30:38.587 INFO:tasks.workunit.client.0.smithi038.stdout:1/563: fsync d12/d3c/d46/d57/f87 0 2024-09-13T18:30:38.587 INFO:tasks.workunit.client.0.smithi038.stdout:1/564: readlink d12/d2a/d72/l83 0 2024-09-13T18:30:38.587 INFO:tasks.workunit.client.0.smithi038.stdout:1/565: fdatasync d12/d2a/d32/d59/d5b/f26 0 2024-09-13T18:30:38.588 INFO:tasks.workunit.client.0.smithi038.stdout:1/566: rmdir d12 39 2024-09-13T18:30:38.588 INFO:tasks.workunit.client.0.smithi038.stdout:1/567: fdatasync d12/d2a/d32/d59/d5e/f90 0 2024-09-13T18:30:38.588 INFO:tasks.workunit.client.0.smithi038.stdout:1/568: creat d12/d2a/d32/d59/d5b/d47/fb0 x:0 0 0 2024-09-13T18:30:38.588 INFO:tasks.workunit.client.0.smithi038.stdout:1/569: fsync d12/d2a/f51 0 2024-09-13T18:30:38.589 INFO:tasks.workunit.client.0.smithi038.stdout:1/570: readlink d12/d2a/d32/d59/d5b/d47/l99 0 2024-09-13T18:30:38.590 INFO:tasks.workunit.client.0.smithi038.stdout:4/775: dwrite d2/fd0 [0,4194304] 0 2024-09-13T18:30:38.590 INFO:tasks.workunit.client.0.smithi038.stdout:1/571: mknod d12/d2a/d32/d59/d5b/d47/d84/cb1 0 2024-09-13T18:30:38.592 INFO:tasks.workunit.client.0.smithi038.stdout:4/776: read d2/df/d1b/d10/d55/dd5/fd9 [722224,124192] 0 2024-09-13T18:30:38.593 INFO:tasks.workunit.client.0.smithi038.stdout:1/572: creat d12/d2a/d32/d59/d5e/daf/fb2 x:0 0 0 2024-09-13T18:30:38.593 INFO:tasks.workunit.client.0.smithi038.stdout:1/573: fdatasync d12/f1c 0 2024-09-13T18:30:38.595 INFO:tasks.workunit.client.0.smithi038.stdout:4/777: symlink d2/d49/d4b/dbc/l101 0 2024-09-13T18:30:38.597 INFO:tasks.workunit.client.0.smithi038.stdout:1/574: creat d12/d2a/d8e/fb3 x:0 0 0 2024-09-13T18:30:38.597 INFO:tasks.workunit.client.0.smithi038.stdout:1/575: dread - d12/d3c/d46/d58/f79 zero size 2024-09-13T18:30:38.602 INFO:tasks.workunit.client.0.smithi038.stdout:4/778: getdents d2/df/d1b/d10/d55 0 2024-09-13T18:30:38.605 INFO:tasks.workunit.client.0.smithi038.stdout:1/576: write d12/d2a/d32/d59/d5b/d47/f80 [544391,51191] 0 2024-09-13T18:30:38.607 INFO:tasks.workunit.client.0.smithi038.stdout:1/577: creat d12/d2a/d32/d59/d5b/d47/d84/da7/fb4 x:0 0 0 2024-09-13T18:30:38.607 INFO:tasks.workunit.client.0.smithi038.stdout:1/578: symlink d12/d2a/d32/d59/d5b/d47/lb5 0 2024-09-13T18:30:38.608 INFO:tasks.workunit.client.0.smithi038.stdout:1/579: mkdir d12/d3c/db6 0 2024-09-13T18:30:38.614 INFO:tasks.workunit.client.0.smithi038.stdout:4/779: dread d2/d49/d50/f91 [0,4194304] 0 2024-09-13T18:30:38.618 INFO:tasks.workunit.client.0.smithi038.stdout:4/780: rename d2/d49/d4b/ld1 to d2/l102 0 2024-09-13T18:30:38.618 INFO:tasks.workunit.client.0.smithi038.stdout:4/781: read - d2/df/d1b/d10/da3/f97 zero size 2024-09-13T18:30:38.618 INFO:tasks.workunit.client.0.smithi038.stdout:4/782: fsync d2/fc1 0 2024-09-13T18:30:38.621 INFO:tasks.workunit.client.0.smithi038.stdout:4/783: creat d2/d49/dce/f103 x:0 0 0 2024-09-13T18:30:38.621 INFO:tasks.workunit.client.0.smithi038.stdout:4/784: fdatasync d2/fbe 0 2024-09-13T18:30:38.622 INFO:tasks.workunit.client.0.smithi038.stdout:1/580: dwrite d12/d2a/d32/d59/d5e/daf/fb2 [0,4194304] 0 2024-09-13T18:30:38.624 INFO:tasks.workunit.client.0.smithi038.stdout:4/785: rename d2/df/d1b/d10/d71/la1 to d2/df/d1b/d10/d55/dfb/l104 0 2024-09-13T18:30:38.626 INFO:tasks.workunit.client.0.smithi038.stdout:4/786: write d2/df/fef [706100,62466] 0 2024-09-13T18:30:38.629 INFO:tasks.workunit.client.0.smithi038.stdout:1/581: symlink d12/d2a/d72/lb7 0 2024-09-13T18:30:38.629 INFO:tasks.workunit.client.0.smithi038.stdout:1/582: readlink d12/d2a/d32/d59/d5b/d47/lb5 0 2024-09-13T18:30:38.630 INFO:tasks.workunit.client.0.smithi038.stdout:4/787: mkdir d2/d49/d4b/dbc/d105 0 2024-09-13T18:30:38.631 INFO:tasks.workunit.client.0.smithi038.stdout:4/788: chown d2/df 3105 1 2024-09-13T18:30:38.632 INFO:tasks.workunit.client.0.smithi038.stdout:1/583: rename fb to d12/d2a/fb8 0 2024-09-13T18:30:38.633 INFO:tasks.workunit.client.0.smithi038.stdout:1/584: symlink d12/d2a/d72/d8d/lb9 0 2024-09-13T18:30:38.640 INFO:tasks.workunit.client.0.smithi038.stdout:4/789: dread d2/df/d1b/d10/f46 [0,4194304] 0 2024-09-13T18:30:38.640 INFO:tasks.workunit.client.0.smithi038.stdout:4/790: creat d2/df/d22/d9a/de6/f106 x:0 0 0 2024-09-13T18:30:38.640 INFO:tasks.workunit.client.0.smithi038.stdout:4/791: write d2/df/d1b/d10/d55/dd5/fea [82194,119779] 0 2024-09-13T18:30:38.640 INFO:tasks.workunit.client.0.smithi038.stdout:4/792: write d2/d49/d50/da0/dcb/ffd [4416315,34679] 0 2024-09-13T18:30:38.642 INFO:tasks.workunit.client.0.smithi038.stdout:4/793: mknod d2/d49/d50/da0/d8/d3b/d100/c107 0 2024-09-13T18:30:38.642 INFO:tasks.workunit.client.0.smithi038.stdout:4/794: truncate d2/d49/d50/da0/d8/d80/ddf/f83 681173 0 2024-09-13T18:30:38.642 INFO:tasks.workunit.client.0.smithi038.stdout:4/795: chown d2/d49/f90 68028716 1 2024-09-13T18:30:38.652 INFO:tasks.workunit.client.0.smithi038.stdout:1/585: dwrite d12/f16 [0,4194304] 0 2024-09-13T18:30:38.660 INFO:tasks.workunit.client.0.smithi038.stdout:1/586: dread fc [0,4194304] 0 2024-09-13T18:30:38.660 INFO:tasks.workunit.client.0.smithi038.stdout:1/587: chown d12/d2a/fa0 207413675 1 2024-09-13T18:30:38.660 INFO:tasks.workunit.client.0.smithi038.stdout:1/588: chown d12/d2a/d32/d82/cac 8 1 2024-09-13T18:30:38.661 INFO:tasks.workunit.client.0.smithi038.stdout:1/589: truncate d12/d2a/d32/d59/d5b/f26 102914 0 2024-09-13T18:30:38.662 INFO:tasks.workunit.client.0.smithi038.stdout:1/590: mknod d12/d2a/d32/d59/d5b/d47/d84/da7/cba 0 2024-09-13T18:30:38.662 INFO:tasks.workunit.client.0.smithi038.stdout:1/591: write d12/d2a/d32/d59/d5b/f22 [5242505,17819] 0 2024-09-13T18:30:38.662 INFO:tasks.workunit.client.0.smithi038.stdout:4/796: dwrite d2/df/d1b/f2b [4194304,4194304] 0 2024-09-13T18:30:38.663 INFO:tasks.workunit.client.0.smithi038.stdout:1/592: read d12/f2d [773702,57114] 0 2024-09-13T18:30:38.663 INFO:tasks.workunit.client.0.smithi038.stdout:1/593: dread - d12/d3c/d46/d58/f71 zero size 2024-09-13T18:30:38.663 INFO:tasks.workunit.client.0.smithi038.stdout:1/594: chown d12/d7a/lae 73258789 1 2024-09-13T18:30:38.665 INFO:tasks.workunit.client.0.smithi038.stdout:4/797: dread d2/d49/d50/fa8 [0,4194304] 0 2024-09-13T18:30:38.666 INFO:tasks.workunit.client.0.smithi038.stdout:1/595: rmdir d12/d2a/d32/d59/d5e 39 2024-09-13T18:30:38.667 INFO:tasks.workunit.client.0.smithi038.stdout:4/798: symlink d2/df/d1b/d10/d75/db1/l108 0 2024-09-13T18:30:38.669 INFO:tasks.workunit.client.0.smithi038.stdout:1/596: symlink d12/d2a/d72/d8d/lbb 0 2024-09-13T18:30:38.672 INFO:tasks.workunit.client.0.smithi038.stdout:1/597: truncate d12/d2a/d32/f60 147932 0 2024-09-13T18:30:38.674 INFO:tasks.workunit.client.0.smithi038.stdout:1/598: rmdir d12/d2a/d32/d59/d5b/d47/d84/da7 39 2024-09-13T18:30:38.676 INFO:tasks.workunit.client.0.smithi038.stdout:1/599: dread d12/f2d [0,4194304] 0 2024-09-13T18:30:38.679 INFO:tasks.workunit.client.0.smithi038.stdout:4/799: truncate d2/df/d1b/f2b 3202222 0 2024-09-13T18:30:38.681 INFO:tasks.workunit.client.0.smithi038.stdout:4/800: truncate d2/d49/d4b/f9b 3147811 0 2024-09-13T18:30:38.682 INFO:tasks.workunit.client.0.smithi038.stdout:4/801: write d2/df/d1b/d10/da3/fd8 [873336,9674] 0 2024-09-13T18:30:38.682 INFO:tasks.workunit.client.0.smithi038.stdout:4/802: chown d2/df/d22/d9a/lde 118023 1 2024-09-13T18:30:38.685 INFO:tasks.workunit.client.0.smithi038.stdout:4/803: rmdir d2/d49/d50/da0/d8/d80 39 2024-09-13T18:30:38.686 INFO:tasks.workunit.client.0.smithi038.stdout:1/600: dread d12/d2a/d32/d59/d5b/f41 [0,4194304] 0 2024-09-13T18:30:38.688 INFO:tasks.workunit.client.0.smithi038.stdout:4/804: unlink d2/df/d1b/d10/d71/f92 0 2024-09-13T18:30:38.691 INFO:tasks.workunit.client.0.smithi038.stdout:4/805: mknod d2/de5/deb/c109 0 2024-09-13T18:30:38.706 INFO:tasks.workunit.client.0.smithi038.stdout:1/601: dwrite d12/f16 [0,4194304] 0 2024-09-13T18:30:38.706 INFO:tasks.workunit.client.0.smithi038.stdout:1/602: creat d12/d7a/fbc x:0 0 0 2024-09-13T18:30:38.708 INFO:tasks.workunit.client.0.smithi038.stdout:1/603: unlink d12/d2a/fb8 0 2024-09-13T18:30:38.713 INFO:tasks.workunit.client.0.smithi038.stdout:1/604: rename d12/d2a/d32/d59/d5e/l75 to d12/d2a/d32/lbd 0 2024-09-13T18:30:38.713 INFO:tasks.workunit.client.0.smithi038.stdout:1/605: fsync d12/d2a/d32/d59/d5b/d47/f80 0 2024-09-13T18:30:38.713 INFO:tasks.workunit.client.0.smithi038.stdout:1/606: readlink d12/d2a/d72/d8d/lb9 0 2024-09-13T18:30:38.713 INFO:tasks.workunit.client.0.smithi038.stdout:1/607: fdatasync d12/d2a/fa0 0 2024-09-13T18:30:38.720 INFO:tasks.workunit.client.0.smithi038.stdout:1/608: write d12/d2a/f4c [3778930,120908] 0 2024-09-13T18:30:38.720 INFO:tasks.workunit.client.0.smithi038.stdout:1/609: stat d12/f2d 0 2024-09-13T18:30:38.721 INFO:tasks.workunit.client.0.smithi038.stdout:1/610: truncate d12/d2a/d32/d59/d5b/f41 1227039 0 2024-09-13T18:30:38.722 INFO:tasks.workunit.client.0.smithi038.stdout:1/611: truncate d12/f17 3389454 0 2024-09-13T18:30:38.722 INFO:tasks.workunit.client.0.smithi038.stdout:1/612: dread - d12/d2a/d32/d59/d5b/d47/f55 zero size 2024-09-13T18:30:38.723 INFO:tasks.workunit.client.0.smithi038.stdout:1/613: creat d12/d2a/d32/fbe x:0 0 0 2024-09-13T18:30:38.724 INFO:tasks.workunit.client.0.smithi038.stdout:1/614: stat d12/d2a/d32/lbd 0 2024-09-13T18:30:38.724 INFO:tasks.workunit.client.0.smithi038.stdout:1/615: chown d12/d2a/d32/d59/d5b/f21 124395 1 2024-09-13T18:30:38.725 INFO:tasks.workunit.client.0.smithi038.stdout:1/616: mkdir d12/d2a/d72/dbf 0 2024-09-13T18:30:38.736 INFO:tasks.workunit.client.0.smithi038.stdout:1/617: dread d12/d2a/f51 [0,4194304] 0 2024-09-13T18:30:38.737 INFO:tasks.workunit.client.0.smithi038.stdout:1/618: dread d12/f39 [0,4194304] 0 2024-09-13T18:30:38.780 INFO:tasks.workunit.client.0.smithi038.stdout:6/505: sync 2024-09-13T18:30:38.853 INFO:tasks.workunit.client.0.smithi038.stdout:1/619: rename f9 to d12/d2a/d8e/fc0 0 2024-09-13T18:30:38.854 INFO:tasks.workunit.client.0.smithi038.stdout:6/506: mknod dd/de/d2e/d99/cb6 0 2024-09-13T18:30:38.858 INFO:tasks.workunit.client.0.smithi038.stdout:1/620: unlink d12/d2a/d32/d59/d5b/d47/f8a 0 2024-09-13T18:30:38.859 INFO:tasks.workunit.client.0.smithi038.stdout:1/621: mknod d12/cc1 0 2024-09-13T18:30:38.862 INFO:tasks.workunit.client.0.smithi038.stdout:1/622: getdents d12/d2a/d32/d59/d5e 0 2024-09-13T18:30:38.862 INFO:tasks.workunit.client.0.smithi038.stdout:1/623: truncate d12/d2a/d32/d59/d5b/f1e 1266005 0 2024-09-13T18:30:38.873 INFO:tasks.workunit.client.0.smithi038.stdout:6/507: dwrite dd/de/d2e/d30/d27/f2d [0,4194304] 0 2024-09-13T18:30:38.873 INFO:tasks.workunit.client.0.smithi038.stdout:6/508: stat dd/de/ca3 0 2024-09-13T18:30:38.873 INFO:tasks.workunit.client.0.smithi038.stdout:6/509: chown dd/de/f2c 2703 1 2024-09-13T18:30:38.873 INFO:tasks.workunit.client.0.smithi038.stdout:6/510: write dd/de/d2e/f6e [1024775,44413] 0 2024-09-13T18:30:38.875 INFO:tasks.workunit.client.0.smithi038.stdout:6/511: rename dd/de/d61/f5a to dd/de/d2e/d99/fb7 0 2024-09-13T18:30:38.876 INFO:tasks.workunit.client.0.smithi038.stdout:6/512: rmdir dd/de/d2e/d30/d90 0 2024-09-13T18:30:38.877 INFO:tasks.workunit.client.0.smithi038.stdout:6/513: mknod dd/de/d31/cb8 0 2024-09-13T18:30:38.880 INFO:tasks.workunit.client.0.smithi038.stdout:6/514: dread dd/de/d2e/d99/f80 [0,4194304] 0 2024-09-13T18:30:38.882 INFO:tasks.workunit.client.0.smithi038.stdout:1/624: dwrite d12/f1c [0,4194304] 0 2024-09-13T18:30:38.882 INFO:tasks.workunit.client.0.smithi038.stdout:1/625: chown d12/d2a/d32/d59/d5b/f7e 504609 1 2024-09-13T18:30:38.882 INFO:tasks.workunit.client.0.smithi038.stdout:1/626: truncate d12/d2a/d32/d59/d5b/f41 1747005 0 2024-09-13T18:30:38.882 INFO:tasks.workunit.client.0.smithi038.stdout:1/627: mknod d12/d2a/d32/d59/d5b/d47/d84/cc2 0 2024-09-13T18:30:38.886 INFO:tasks.workunit.client.0.smithi038.stdout:6/515: dread dd/de/d2e/d2f/d71/fa4 [0,4194304] 0 2024-09-13T18:30:38.905 INFO:tasks.workunit.client.0.smithi038.stdout:1/628: dwrite d12/f25 [0,4194304] 0 2024-09-13T18:30:38.905 INFO:tasks.workunit.client.0.smithi038.stdout:1/629: write d12/d2a/d8e/fb3 [980338,78324] 0 2024-09-13T18:30:38.908 INFO:tasks.workunit.client.0.smithi038.stdout:1/630: mkdir d12/d2a/d32/d59/d5e/dc3 0 2024-09-13T18:30:38.908 INFO:tasks.workunit.client.0.smithi038.stdout:1/631: chown d12/d2a/fa0 662 1 2024-09-13T18:30:38.909 INFO:tasks.workunit.client.0.smithi038.stdout:6/516: dwrite dd/f11 [0,4194304] 0 2024-09-13T18:30:38.912 INFO:tasks.workunit.client.0.smithi038.stdout:1/632: unlink d12/d2a/c9b 0 2024-09-13T18:30:38.912 INFO:tasks.workunit.client.0.smithi038.stdout:1/633: truncate d12/d3c/d46/d57/f97 1281116 0 2024-09-13T18:30:38.920 INFO:tasks.workunit.client.0.smithi038.stdout:1/634: rename d12/d2a/d32/lbd to d12/d2a/d32/d59/d5b/d47/d84/da7/lc4 0 2024-09-13T18:30:38.924 INFO:tasks.workunit.client.0.smithi038.stdout:1/635: link d12/c38 d12/d2a/d32/d59/d5e/cc5 0 2024-09-13T18:30:38.925 INFO:tasks.workunit.client.0.smithi038.stdout:6/517: dwrite dd/de/d2e/d2f/d4c/f84 [0,4194304] 0 2024-09-13T18:30:38.925 INFO:tasks.workunit.client.0.smithi038.stdout:6/518: dread - dd/de/d2e/d2f/d4c/d55/f93 zero size 2024-09-13T18:30:38.925 INFO:tasks.workunit.client.0.smithi038.stdout:6/519: chown dd/de/d2e/c45 462304 1 2024-09-13T18:30:38.927 INFO:tasks.workunit.client.0.smithi038.stdout:1/636: creat d12/d3c/db6/fc6 x:0 0 0 2024-09-13T18:30:38.927 INFO:tasks.workunit.client.0.smithi038.stdout:1/637: readlink d12/d2a/d32/d59/d5e/l62 0 2024-09-13T18:30:38.936 INFO:tasks.workunit.client.0.smithi038.stdout:1/638: mknod d12/d3c/cc7 0 2024-09-13T18:30:38.936 INFO:tasks.workunit.client.0.smithi038.stdout:1/639: creat d12/d2a/d8e/fc8 x:0 0 0 2024-09-13T18:30:38.936 INFO:tasks.workunit.client.0.smithi038.stdout:1/640: fsync d12/f13 0 2024-09-13T18:30:38.940 INFO:tasks.workunit.client.0.smithi038.stdout:1/641: mknod d12/d7a/cc9 0 2024-09-13T18:30:38.940 INFO:tasks.workunit.client.0.smithi038.stdout:1/642: dread - d12/d2a/f6f zero size 2024-09-13T18:30:38.955 INFO:tasks.workunit.client.0.smithi038.stdout:1/643: dwrite d12/d3c/fa2 [0,4194304] 0 2024-09-13T18:30:38.957 INFO:tasks.workunit.client.0.smithi038.stdout:2/468: sync 2024-09-13T18:30:38.957 INFO:tasks.workunit.client.0.smithi038.stdout:0/490: sync 2024-09-13T18:30:38.957 INFO:tasks.workunit.client.0.smithi038.stdout:0/491: creat d2/d7/d55/f9c x:0 0 0 2024-09-13T18:30:38.957 INFO:tasks.workunit.client.0.smithi038.stdout:9/501: sync 2024-09-13T18:30:38.958 INFO:tasks.workunit.client.0.smithi038.stdout:1/644: unlink d12/d3c/d46/c5c 0 2024-09-13T18:30:38.958 INFO:tasks.workunit.client.0.smithi038.stdout:1/645: write d12/f39 [1960970,7163] 0 2024-09-13T18:30:38.963 INFO:tasks.workunit.client.0.smithi038.stdout:2/469: rename d2/d5c/d66/fae to d2/d1e/d44/d50/d39/d45/faf 0 2024-09-13T18:30:38.966 INFO:tasks.workunit.client.0.smithi038.stdout:0/492: write d2/d7/d24/d3c/d3f/f5a [1652702,67127] 0 2024-09-13T18:30:38.966 INFO:tasks.workunit.client.0.smithi038.stdout:9/502: symlink d0/d7/d2c/d33/lb7 0 2024-09-13T18:30:38.966 INFO:tasks.workunit.client.0.smithi038.stdout:9/503: chown d0/d7/d13/d2d/d3c/d50/da5 199974 1 2024-09-13T18:30:38.968 INFO:tasks.workunit.client.0.smithi038.stdout:1/646: link d12/d2a/d32/d59/c73 d12/d2a/d32/d59/d5b/d47/d84/da7/cca 0 2024-09-13T18:30:38.968 INFO:tasks.workunit.client.0.smithi038.stdout:2/470: stat d2/d1e/c20 0 2024-09-13T18:30:38.969 INFO:tasks.workunit.client.0.smithi038.stdout:9/504: dread d0/d2e/fb2 [0,4194304] 0 2024-09-13T18:30:38.969 INFO:tasks.workunit.client.0.smithi038.stdout:9/505: fsync d0/d7/d13/d30/f6f 0 2024-09-13T18:30:38.971 INFO:tasks.workunit.client.0.smithi038.stdout:1/647: unlink d12/d2a/d8e/ca1 0 2024-09-13T18:30:38.973 INFO:tasks.workunit.client.0.smithi038.stdout:1/648: unlink d12/d2a/d32/d59/d5b/d47/l76 0 2024-09-13T18:30:38.979 INFO:tasks.workunit.client.0.smithi038.stdout:1/649: unlink d12/d3c/d46/fa9 0 2024-09-13T18:30:38.979 INFO:tasks.workunit.client.0.smithi038.stdout:1/650: creat d12/d2a/d32/d59/d5b/fcb x:0 0 0 2024-09-13T18:30:38.979 INFO:tasks.workunit.client.0.smithi038.stdout:1/651: write d12/d2a/d32/d59/d5b/d47/d84/da7/fb4 [681013,76319] 0 2024-09-13T18:30:38.979 INFO:tasks.workunit.client.0.smithi038.stdout:1/652: fdatasync d12/f17 0 2024-09-13T18:30:38.979 INFO:tasks.workunit.client.0.smithi038.stdout:1/653: rename d12/d7a/fbc to d12/d2a/d32/d59/d5b/d47/d84/fcc 0 2024-09-13T18:30:38.981 INFO:tasks.workunit.client.0.smithi038.stdout:9/506: dread d0/d7/d13/d2d/d3e/d70/da2/f79 [0,4194304] 0 2024-09-13T18:30:38.982 INFO:tasks.workunit.client.0.smithi038.stdout:9/507: mkdir d0/d7/d13/db8 0 2024-09-13T18:30:38.983 INFO:tasks.workunit.client.0.smithi038.stdout:9/508: truncate d0/d7/d13/d2d/d3e/f88 172281 0 2024-09-13T18:30:38.984 INFO:tasks.workunit.client.0.smithi038.stdout:9/509: mknod d0/d7/d2c/d5a/da4/cb9 0 2024-09-13T18:30:38.986 INFO:tasks.workunit.client.0.smithi038.stdout:9/510: creat d0/d7/d13/fba x:0 0 0 2024-09-13T18:30:38.986 INFO:tasks.workunit.client.0.smithi038.stdout:1/654: write d12/f1a [2215493,38497] 0 2024-09-13T18:30:38.993 INFO:tasks.workunit.client.0.smithi038.stdout:0/493: dwrite d2/d7/d24/d2b/f2d [0,4194304] 0 2024-09-13T18:30:39.005 INFO:tasks.workunit.client.0.smithi038.stdout:1/655: dread d12/f2b [0,4194304] 0 2024-09-13T18:30:39.021 INFO:tasks.workunit.client.0.smithi038.stdout:9/511: dwrite d0/d7/f89 [0,4194304] 0 2024-09-13T18:30:39.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/494: read d2/d7/d24/d92/d66/d81/f93 [3118535,117599] 0 2024-09-13T18:30:39.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/495: chown d2/d7/d24/d92/d40/d97/d98/l8b 28 1 2024-09-13T18:30:39.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/496: chown d2/d7/d24/d92/d66/c8d 123 1 2024-09-13T18:30:39.025 INFO:tasks.workunit.client.0.smithi038.stdout:2/471: dwrite d2/f5 [0,4194304] 0 2024-09-13T18:30:39.025 INFO:tasks.workunit.client.0.smithi038.stdout:1/656: write d12/d2a/fa0 [2947945,116070] 0 2024-09-13T18:30:39.026 INFO:tasks.workunit.client.0.smithi038.stdout:1/657: chown d12/f17 41 1 2024-09-13T18:30:39.026 INFO:tasks.workunit.client.0.smithi038.stdout:2/472: write d2/d2a/f35 [4531286,37637] 0 2024-09-13T18:30:39.026 INFO:tasks.workunit.client.0.smithi038.stdout:0/497: mknod d2/d7/d24/c9d 0 2024-09-13T18:30:39.029 INFO:tasks.workunit.client.0.smithi038.stdout:1/658: mknod d12/d2a/ccd 0 2024-09-13T18:30:39.029 INFO:tasks.workunit.client.0.smithi038.stdout:1/659: chown d12/d2a/fa0 583879706 1 2024-09-13T18:30:39.031 INFO:tasks.workunit.client.0.smithi038.stdout:0/498: symlink d2/d7/d24/d92/d66/d49/l9e 0 2024-09-13T18:30:39.031 INFO:tasks.workunit.client.0.smithi038.stdout:0/499: chown d2/d7/d24/d3c/d3f 252391762 1 2024-09-13T18:30:39.033 INFO:tasks.workunit.client.0.smithi038.stdout:2/473: dread d2/da/f1b [0,4194304] 0 2024-09-13T18:30:39.033 INFO:tasks.workunit.client.0.smithi038.stdout:2/474: fdatasync d2/d1e/d44/d50/d39/faa 0 2024-09-13T18:30:39.033 INFO:tasks.workunit.client.0.smithi038.stdout:2/475: chown d2/d1e/d44/d50/f2e 6374 1 2024-09-13T18:30:39.033 INFO:tasks.workunit.client.0.smithi038.stdout:1/660: creat d12/d2a/d72/fce x:0 0 0 2024-09-13T18:30:39.033 INFO:tasks.workunit.client.0.smithi038.stdout:1/661: write d12/d3c/d46/f7c [4827289,288] 0 2024-09-13T18:30:39.033 INFO:tasks.workunit.client.0.smithi038.stdout:1/662: readlink d12/d2a/d32/d59/d5b/l27 0 2024-09-13T18:30:39.033 INFO:tasks.workunit.client.0.smithi038.stdout:9/512: dread d0/d7/d13/d2d/d3e/f6e [0,4194304] 0 2024-09-13T18:30:39.035 INFO:tasks.workunit.client.0.smithi038.stdout:1/663: dread d12/d2a/d32/d59/d5b/f7e [0,4194304] 0 2024-09-13T18:30:39.035 INFO:tasks.workunit.client.0.smithi038.stdout:2/476: dread d2/f34 [0,4194304] 0 2024-09-13T18:30:39.038 INFO:tasks.workunit.client.0.smithi038.stdout:9/513: truncate d0/d7/d13/d2d/d3e/d70/da2/f79 4171080 0 2024-09-13T18:30:39.038 INFO:tasks.workunit.client.0.smithi038.stdout:9/514: chown d0/d7/d2c/d5a/d67/d9e/f6b 48948 1 2024-09-13T18:30:39.041 INFO:tasks.workunit.client.0.smithi038.stdout:0/500: mknod d2/c9f 0 2024-09-13T18:30:39.053 INFO:tasks.workunit.client.0.smithi038.stdout:9/515: creat d0/d7/d2c/d5e/fbb x:0 0 0 2024-09-13T18:30:39.055 INFO:tasks.workunit.client.0.smithi038.stdout:0/501: mkdir d2/d7/d24/d92/d40/d97/d98/da0 0 2024-09-13T18:30:39.055 INFO:tasks.workunit.client.0.smithi038.stdout:0/502: fsync d2/d7/d24/d2b/f43 0 2024-09-13T18:30:39.057 INFO:tasks.workunit.client.0.smithi038.stdout:0/503: mkdir d2/d7/d24/d92/da1 0 2024-09-13T18:30:39.059 INFO:tasks.workunit.client.0.smithi038.stdout:9/516: getdents d0/d7/d13/d2d/d3e 0 2024-09-13T18:30:39.061 INFO:tasks.workunit.client.0.smithi038.stdout:0/504: rename d2/d7/d24/d92/d66/d49/f5f to d2/d7/d24/d92/d40/d97/fa2 0 2024-09-13T18:30:39.061 INFO:tasks.workunit.client.0.smithi038.stdout:0/505: truncate d2/d7/f76 5071581 0 2024-09-13T18:30:39.064 INFO:tasks.workunit.client.0.smithi038.stdout:2/477: dwrite d2/d1e/d44/d50/f2e [4194304,4194304] 0 2024-09-13T18:30:39.064 INFO:tasks.workunit.client.0.smithi038.stdout:1/664: dwrite d12/d2a/d8e/fc8 [0,4194304] 0 2024-09-13T18:30:39.064 INFO:tasks.workunit.client.0.smithi038.stdout:1/665: write d12/d2a/d32/f60 [14433,92203] 0 2024-09-13T18:30:39.065 INFO:tasks.workunit.client.0.smithi038.stdout:1/666: chown d12/d2a/d32/d59/c73 1 1 2024-09-13T18:30:39.065 INFO:tasks.workunit.client.0.smithi038.stdout:9/517: rename d0/d7/f35 to d0/d7/d2c/d5e/fbc 0 2024-09-13T18:30:39.067 INFO:tasks.workunit.client.0.smithi038.stdout:0/506: rmdir d2/d7/d24/d2b/d6d 39 2024-09-13T18:30:39.067 INFO:tasks.workunit.client.0.smithi038.stdout:0/507: write d2/d7/d24/d3c/f46 [4393214,42930] 0 2024-09-13T18:30:39.067 INFO:tasks.workunit.client.0.smithi038.stdout:0/508: dread - d2/f96 zero size 2024-09-13T18:30:39.067 INFO:tasks.workunit.client.0.smithi038.stdout:0/509: creat d2/d7/d55/fa3 x:0 0 0 2024-09-13T18:30:39.073 INFO:tasks.workunit.client.0.smithi038.stdout:9/518: truncate d0/d7/d2c/d5a/f64 2940000 0 2024-09-13T18:30:39.073 INFO:tasks.workunit.client.0.smithi038.stdout:9/519: stat d0/d7/d2c/d33/lb7 0 2024-09-13T18:30:39.077 INFO:tasks.workunit.client.0.smithi038.stdout:1/667: write d12/f17 [851367,80945] 0 2024-09-13T18:30:39.077 INFO:tasks.workunit.client.0.smithi038.stdout:1/668: chown ff 413927 1 2024-09-13T18:30:39.079 INFO:tasks.workunit.client.0.smithi038.stdout:8/515: sync 2024-09-13T18:30:39.079 INFO:tasks.workunit.client.0.smithi038.stdout:5/507: sync 2024-09-13T18:30:39.079 INFO:tasks.workunit.client.0.smithi038.stdout:0/510: creat d2/d7/d24/d92/da1/fa4 x:0 0 0 2024-09-13T18:30:39.079 INFO:tasks.workunit.client.0.smithi038.stdout:5/508: write df/d13/d3b/d44/d48/d75/f99 [666477,24541] 0 2024-09-13T18:30:39.079 INFO:tasks.workunit.client.0.smithi038.stdout:1/669: dread d12/f2d [0,4194304] 0 2024-09-13T18:30:39.080 INFO:tasks.workunit.client.0.smithi038.stdout:9/520: rename d0/d7/d2c/d33/d4a/f57 to d0/d7/d13/d30/fbd 0 2024-09-13T18:30:39.082 INFO:tasks.workunit.client.0.smithi038.stdout:2/478: dwrite d2/f67 [0,4194304] 0 2024-09-13T18:30:39.085 INFO:tasks.workunit.client.0.smithi038.stdout:5/509: link f1 df/d13/d3b/d44/d48/d9d/fa0 0 2024-09-13T18:30:39.086 INFO:tasks.workunit.client.0.smithi038.stdout:1/670: link d12/d3c/l9d d12/d7a/lcf 0 2024-09-13T18:30:39.087 INFO:tasks.workunit.client.0.smithi038.stdout:8/516: rename d1/d4/c35 to d1/de/d21/d24/d41/d7d/cab 0 2024-09-13T18:30:39.088 INFO:tasks.workunit.client.0.smithi038.stdout:9/521: symlink d0/d7/d13/d2d/d3e/d70/lbe 0 2024-09-13T18:30:39.088 INFO:tasks.workunit.client.0.smithi038.stdout:9/522: chown d0/c82 138895 1 2024-09-13T18:30:39.099 INFO:tasks.workunit.client.0.smithi038.stdout:2/479: dwrite d2/d1e/d44/fa7 [0,4194304] 0 2024-09-13T18:30:39.104 INFO:tasks.workunit.client.0.smithi038.stdout:5/510: getdents df/d13/d49/d70 0 2024-09-13T18:30:39.107 INFO:tasks.workunit.client.0.smithi038.stdout:1/671: link d12/l31 d12/d2a/d72/d8d/ld0 0 2024-09-13T18:30:39.108 INFO:tasks.workunit.client.0.smithi038.stdout:1/672: readlink d12/d3c/l9c 0 2024-09-13T18:30:39.108 INFO:tasks.workunit.client.0.smithi038.stdout:2/480: write d2/d2a/f35 [1091232,112405] 0 2024-09-13T18:30:39.108 INFO:tasks.workunit.client.0.smithi038.stdout:2/481: write d2/d1e/d44/d50/d46/f71 [1230883,82098] 0 2024-09-13T18:30:39.109 INFO:tasks.workunit.client.0.smithi038.stdout:8/517: creat d1/d2a/fac x:0 0 0 2024-09-13T18:30:39.110 INFO:tasks.workunit.client.0.smithi038.stdout:9/523: mkdir d0/d7/d2c/dbf 0 2024-09-13T18:30:39.116 INFO:tasks.workunit.client.0.smithi038.stdout:5/511: mknod df/d13/d3b/d44/d58/ca1 0 2024-09-13T18:30:39.118 INFO:tasks.workunit.client.0.smithi038.stdout:1/673: link d12/d2a/d32/d59/d5b/fcb d12/d2a/fd1 0 2024-09-13T18:30:39.118 INFO:tasks.workunit.client.0.smithi038.stdout:1/674: truncate d12/d2a/f64 5101692 0 2024-09-13T18:30:39.118 INFO:tasks.workunit.client.0.smithi038.stdout:1/675: fdatasync d12/d3c/d46/f86 0 2024-09-13T18:30:39.121 INFO:tasks.workunit.client.0.smithi038.stdout:2/482: mkdir d2/d2a/db0 0 2024-09-13T18:30:39.122 INFO:tasks.workunit.client.0.smithi038.stdout:9/524: truncate d0/d7/d13/d2d/d3e/f6e 1266119 0 2024-09-13T18:30:39.124 INFO:tasks.workunit.client.0.smithi038.stdout:5/512: rename f8 to df/d13/d49/d70/fa2 0 2024-09-13T18:30:39.124 INFO:tasks.workunit.client.0.smithi038.stdout:5/513: truncate df/d13/d3b/d41/f9e 951826 0 2024-09-13T18:30:39.124 INFO:tasks.workunit.client.0.smithi038.stdout:5/514: write f3 [4415732,90323] 0 2024-09-13T18:30:39.124 INFO:tasks.workunit.client.0.smithi038.stdout:8/518: dwrite d1/de/d21/d24/d4d/f9b [0,4194304] 0 2024-09-13T18:30:39.128 INFO:tasks.workunit.client.0.smithi038.stdout:9/525: mknod d0/d7/d2c/d33/d4a/cc0 0 2024-09-13T18:30:39.129 INFO:tasks.workunit.client.0.smithi038.stdout:9/526: chown d0/d7/d2c/d33/f96 22937 1 2024-09-13T18:30:39.129 INFO:tasks.workunit.client.0.smithi038.stdout:9/527: stat d0/d7/d2c/d6d/d9c 0 2024-09-13T18:30:39.130 INFO:tasks.workunit.client.0.smithi038.stdout:5/515: mknod df/d13/d49/d70/ca3 0 2024-09-13T18:30:39.130 INFO:tasks.workunit.client.0.smithi038.stdout:5/516: chown df/d13/d3b/d41/l91 160349935 1 2024-09-13T18:30:39.135 INFO:tasks.workunit.client.0.smithi038.stdout:8/519: dread d1/d8/f44 [0,4194304] 0 2024-09-13T18:30:39.135 INFO:tasks.workunit.client.0.smithi038.stdout:8/520: chown d1/de/d3a/f3e 118678567 1 2024-09-13T18:30:39.141 INFO:tasks.workunit.client.0.smithi038.stdout:1/676: getdents d12/d3c/d46/d57 0 2024-09-13T18:30:39.141 INFO:tasks.workunit.client.0.smithi038.stdout:5/517: read df/f66 [1112062,58234] 0 2024-09-13T18:30:39.143 INFO:tasks.workunit.client.0.smithi038.stdout:2/483: rmdir d2/d1e/d48 39 2024-09-13T18:30:39.143 INFO:tasks.workunit.client.0.smithi038.stdout:5/518: dread df/d13/d3b/d44/d48/d75/f99 [0,4194304] 0 2024-09-13T18:30:39.143 INFO:tasks.workunit.client.0.smithi038.stdout:5/519: write f1 [8938736,81712] 0 2024-09-13T18:30:39.145 INFO:tasks.workunit.client.0.smithi038.stdout:9/528: rename d0/c82 to d0/d7/d13/d2d/d3e/cc1 0 2024-09-13T18:30:39.145 INFO:tasks.workunit.client.0.smithi038.stdout:9/529: chown d0/d7/d13/d2d/d3e/d70/lbe 144517948 1 2024-09-13T18:30:39.146 INFO:tasks.workunit.client.0.smithi038.stdout:8/521: creat d1/d4/fad x:0 0 0 2024-09-13T18:30:39.146 INFO:tasks.workunit.client.0.smithi038.stdout:8/522: truncate d1/d4/f2d 1428450 0 2024-09-13T18:30:39.147 INFO:tasks.workunit.client.0.smithi038.stdout:1/677: truncate d12/d2a/d32/d59/d5b/f1e 1319807 0 2024-09-13T18:30:39.150 INFO:tasks.workunit.client.0.smithi038.stdout:5/520: mkdir df/d15/d36/da4 0 2024-09-13T18:30:39.151 INFO:tasks.workunit.client.0.smithi038.stdout:9/530: mknod d0/d7/d2c/d5a/cc2 0 2024-09-13T18:30:39.151 INFO:tasks.workunit.client.0.smithi038.stdout:2/484: dread d2/d5c/d93/d62/f70 [0,4194304] 0 2024-09-13T18:30:39.152 INFO:tasks.workunit.client.0.smithi038.stdout:8/523: unlink d1/d4/f12 0 2024-09-13T18:30:39.153 INFO:tasks.workunit.client.0.smithi038.stdout:5/521: mkdir df/da5 0 2024-09-13T18:30:39.154 INFO:tasks.workunit.client.0.smithi038.stdout:1/678: write d12/d2a/d32/d59/d5e/daf/fb2 [2863581,123093] 0 2024-09-13T18:30:39.156 INFO:tasks.workunit.client.0.smithi038.stdout:9/531: mkdir d0/d2e/dc3 0 2024-09-13T18:30:39.156 INFO:tasks.workunit.client.0.smithi038.stdout:9/532: write d0/d2e/f25 [3695807,113318] 0 2024-09-13T18:30:39.156 INFO:tasks.workunit.client.0.smithi038.stdout:9/533: dread - d0/d7/d2c/d5a/f95 zero size 2024-09-13T18:30:39.156 INFO:tasks.workunit.client.0.smithi038.stdout:2/485: truncate d2/f67 1380637 0 2024-09-13T18:30:39.156 INFO:tasks.workunit.client.0.smithi038.stdout:2/486: write d2/da/d16/f24 [2392799,119727] 0 2024-09-13T18:30:39.157 INFO:tasks.workunit.client.0.smithi038.stdout:2/487: readlink d2/l43 0 2024-09-13T18:30:39.159 INFO:tasks.workunit.client.0.smithi038.stdout:8/524: mknod d1/de/d21/d24/d4d/d50/cae 0 2024-09-13T18:30:39.161 INFO:tasks.workunit.client.0.smithi038.stdout:9/534: truncate d0/d2e/f7c 735267 0 2024-09-13T18:30:39.161 INFO:tasks.workunit.client.0.smithi038.stdout:9/535: chown d0/ff 109274542 1 2024-09-13T18:30:39.161 INFO:tasks.workunit.client.0.smithi038.stdout:9/536: write d0/d7/d2c/d5a/d67/d9e/f6b [580254,120524] 0 2024-09-13T18:30:39.161 INFO:tasks.workunit.client.0.smithi038.stdout:9/537: truncate d0/d7/d2c/d5a/f95 799583 0 2024-09-13T18:30:39.165 INFO:tasks.workunit.client.0.smithi038.stdout:2/488: mkdir d2/d1e/d44/d50/d46/db1 0 2024-09-13T18:30:39.168 INFO:tasks.workunit.client.0.smithi038.stdout:1/679: dwrite d12/f1a [0,4194304] 0 2024-09-13T18:30:39.229 INFO:tasks.workunit.client.0.smithi038.stdout:1/680: read d12/d2a/f4d [1109512,25982] 0 2024-09-13T18:30:39.229 INFO:tasks.workunit.client.0.smithi038.stdout:1/681: chown d12/d2a/d32/c3a 6 1 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:8/525: mknod d1/de/d21/d24/d4d/caf 0 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:2/489: symlink d2/d2a/lb2 0 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:2/490: dread - d2/d1e/d44/d50/d39/faa zero size 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:1/682: unlink d12/d7a/lcf 0 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:9/538: read d0/f2a [2609985,71101] 0 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:9/539: truncate d0/f6 868969 0 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:9/540: stat d0/d7/d2c/d33 0 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:8/526: rename d1/de/d21/d24/d56/d5e to d1/de/d21/d24/db0 0 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:2/491: read d2/d1e/d44/f75 [3491894,19491] 0 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:3/449: sync 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:7/473: sync 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:1/683: symlink d12/d2a/d32/d59/ld2 0 2024-09-13T18:30:39.230 INFO:tasks.workunit.client.0.smithi038.stdout:9/541: getdents d0/d7/d2c/d5a/d67 0 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:8/527: symlink d1/de/d21/d24/d56/lb1 0 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:8/528: chown d1/d4/f47 101341695 1 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:8/529: creat d1/d2a/d3f/fb2 x:0 0 0 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:8/530: write d1/d4/f4f [1756174,91405] 0 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:2/492: mkdir d2/d5c/db3 0 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:2/493: write d2/da/f36 [1614950,4002] 0 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:3/450: truncate d0/dd/d17/d50/d5c/f47 65136 0 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:7/474: mkdir db/d12/d1c/d3a/d26/d41/dad 0 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:1/684: symlink d12/d2a/d32/d82/ld3 0 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:7/475: read db/d12/d1c/d3a/d22/f23 [640186,9281] 0 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:8/531: mknod d1/de/d21/d24/d56/d89/cb3 0 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:8/532: write d1/d2a/d3f/fb2 [970773,81087] 0 2024-09-13T18:30:39.231 INFO:tasks.workunit.client.0.smithi038.stdout:1/685: read d12/d2a/d32/d59/d5b/f22 [1251697,50813] 0 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:2/494: symlink d2/da/lb4 0 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:3/451: truncate d0/dd/d17/f1c 626803 0 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:7/476: dread db/d12/d1c/d3a/d22/f7d [0,4194304] 0 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:8/533: mkdir d1/de/d15/db4 0 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:1/686: creat d12/d2a/d72/dbf/fd4 x:0 0 0 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:2/495: link d2/d1e/d44/f76 d2/d5c/d93/fb5 0 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:3/452: creat d0/dd/d17/d50/d5c/d1d/d29/d2b/f8e x:0 0 0 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:7/477: symlink db/d12/lae 0 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:8/534: mknod d1/de/d4c/cb5 0 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:8/535: chown d1/de/d21/d24/d41/f42 14 1 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:8/536: truncate d1/de/d21/d45/f97 919952 0 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:7/478: write db/d12/d1c/d3a/f59 [322679,114014] 0 2024-09-13T18:30:39.232 INFO:tasks.workunit.client.0.smithi038.stdout:7/479: stat db/d12/d13/d43/c50 0 2024-09-13T18:30:39.233 INFO:tasks.workunit.client.0.smithi038.stdout:7/480: readlink db/d12/d1c/d3a/d4b/l6a 0 2024-09-13T18:30:39.233 INFO:tasks.workunit.client.0.smithi038.stdout:8/537: dread d1/de/d21/d24/d41/f88 [0,4194304] 0 2024-09-13T18:30:39.233 INFO:tasks.workunit.client.0.smithi038.stdout:7/481: unlink db/d12/d1c/d3a/d3c/d52/la0 0 2024-09-13T18:30:39.233 INFO:tasks.workunit.client.0.smithi038.stdout:1/687: dwrite fc [0,4194304] 0 2024-09-13T18:30:39.234 INFO:tasks.workunit.client.0.smithi038.stdout:8/538: dread d1/de/f33 [0,4194304] 0 2024-09-13T18:30:39.236 INFO:tasks.workunit.client.0.smithi038.stdout:7/482: unlink db/d12/d1c/ca3 0 2024-09-13T18:30:39.236 INFO:tasks.workunit.client.0.smithi038.stdout:7/483: dread - db/d12/d1c/d3a/d4b/f65 zero size 2024-09-13T18:30:39.236 INFO:tasks.workunit.client.0.smithi038.stdout:7/484: stat db/f11 0 2024-09-13T18:30:39.239 INFO:tasks.workunit.client.0.smithi038.stdout:1/688: creat d12/d2a/d32/d59/d5e/dc3/fd5 x:0 0 0 2024-09-13T18:30:39.239 INFO:tasks.workunit.client.0.smithi038.stdout:1/689: fsync d12/d2a/d32/d59/d5b/d47/f55 0 2024-09-13T18:30:39.240 INFO:tasks.workunit.client.0.smithi038.stdout:2/496: dwrite d2/da/f1b [0,4194304] 0 2024-09-13T18:30:39.240 INFO:tasks.workunit.client.0.smithi038.stdout:3/453: dwrite d0/dd/d17/d79/f87 [0,4194304] 0 2024-09-13T18:30:39.241 INFO:tasks.workunit.client.0.smithi038.stdout:7/485: mknod db/d12/d1c/d3a/d26/caf 0 2024-09-13T18:30:39.241 INFO:tasks.workunit.client.0.smithi038.stdout:7/486: truncate db/d12/d1c/d3a/d22/d28/f6e 1885767 0 2024-09-13T18:30:39.243 INFO:tasks.workunit.client.0.smithi038.stdout:1/690: creat d12/fd6 x:0 0 0 2024-09-13T18:30:39.243 INFO:tasks.workunit.client.0.smithi038.stdout:1/691: creat d12/d2a/d8e/fd7 x:0 0 0 2024-09-13T18:30:39.251 INFO:tasks.workunit.client.0.smithi038.stdout:3/454: symlink d0/dd/d17/d50/d5c/d1d/d29/l8f 0 2024-09-13T18:30:39.251 INFO:tasks.workunit.client.0.smithi038.stdout:8/539: dwrite d1/de/d21/f9f [0,4194304] 0 2024-09-13T18:30:39.253 INFO:tasks.workunit.client.0.smithi038.stdout:7/487: symlink db/d21/lb0 0 2024-09-13T18:30:39.258 INFO:tasks.workunit.client.0.smithi038.stdout:1/692: mkdir d12/d3c/d46/d58/dd8 0 2024-09-13T18:30:39.259 INFO:tasks.workunit.client.0.smithi038.stdout:2/497: link d2/d1e/l49 d2/da/d16/lb6 0 2024-09-13T18:30:39.259 INFO:tasks.workunit.client.0.smithi038.stdout:2/498: write d2/d5c/d93/f5a [944112,123344] 0 2024-09-13T18:30:39.264 INFO:tasks.workunit.client.0.smithi038.stdout:8/540: rename d1/de/d3a/f53 to d1/de/d21/d45/d5d/fb6 0 2024-09-13T18:30:39.266 INFO:tasks.workunit.client.0.smithi038.stdout:7/488: creat db/d12/d1c/d3a/d3c/d52/d9b/fb1 x:0 0 0 2024-09-13T18:30:39.269 INFO:tasks.workunit.client.0.smithi038.stdout:3/455: dwrite d0/dd/d17/d43/f5d [0,4194304] 0 2024-09-13T18:30:39.269 INFO:tasks.workunit.client.0.smithi038.stdout:3/456: fdatasync d0/dd/d17/d50/d5c/d1d/d29/d2b/f49 0 2024-09-13T18:30:39.269 INFO:tasks.workunit.client.0.smithi038.stdout:3/457: dread - d0/dd/d17/d50/d5c/d1d/d29/f7b zero size 2024-09-13T18:30:39.271 INFO:tasks.workunit.client.0.smithi038.stdout:2/499: dread - d2/d1e/d87/fa5 zero size 2024-09-13T18:30:39.273 INFO:tasks.workunit.client.0.smithi038.stdout:8/541: mkdir d1/de/d21/d24/d41/db7 0 2024-09-13T18:30:39.275 INFO:tasks.workunit.client.0.smithi038.stdout:3/458: getdents d0/dd/d17/d50/d5c/d23/d52 0 2024-09-13T18:30:39.276 INFO:tasks.workunit.client.0.smithi038.stdout:7/489: dread db/d12/d1c/d3a/d22/d28/f6f [0,4194304] 0 2024-09-13T18:30:39.282 INFO:tasks.workunit.client.0.smithi038.stdout:2/500: symlink d2/da/d74/lb7 0 2024-09-13T18:30:39.285 INFO:tasks.workunit.client.0.smithi038.stdout:8/542: dwrite d1/de/d21/d45/d5d/f83 [0,4194304] 0 2024-09-13T18:30:39.287 INFO:tasks.workunit.client.0.smithi038.stdout:7/490: link db/d12/d1c/d3a/f7f db/d12/d1c/d3a/d26/d41/dad/fb2 0 2024-09-13T18:30:39.289 INFO:tasks.workunit.client.0.smithi038.stdout:7/491: dread db/d12/d1c/d3a/d3c/d52/f6c [0,4194304] 0 2024-09-13T18:30:39.296 INFO:tasks.workunit.client.0.smithi038.stdout:8/543: creat d1/de/d21/d45/d5d/d6d/fb8 x:0 0 0 2024-09-13T18:30:39.298 INFO:tasks.workunit.client.0.smithi038.stdout:1/693: getdents d12/d2a/d32/d59/d5e/dc3 0 2024-09-13T18:30:39.300 INFO:tasks.workunit.client.0.smithi038.stdout:7/492: truncate db/d12/d1c/d3a/d3c/d52/d51/f86 1833101 0 2024-09-13T18:30:39.300 INFO:tasks.workunit.client.0.smithi038.stdout:7/493: write db/d12/d1c/f5e [791468,88548] 0 2024-09-13T18:30:39.300 INFO:tasks.workunit.client.0.smithi038.stdout:7/494: creat db/d12/d13/fb3 x:0 0 0 2024-09-13T18:30:39.302 INFO:tasks.workunit.client.0.smithi038.stdout:8/544: symlink d1/de/d21/d24/d4d/d50/d62/lb9 0 2024-09-13T18:30:39.302 INFO:tasks.workunit.client.0.smithi038.stdout:8/545: creat d1/de/d21/d45/d5d/d6d/fba x:0 0 0 2024-09-13T18:30:39.304 INFO:tasks.workunit.client.0.smithi038.stdout:1/694: link d12/f1c d12/d2a/d72/fd9 0 2024-09-13T18:30:39.304 INFO:tasks.workunit.client.0.smithi038.stdout:1/695: readlink d12/d3c/l9c 0 2024-09-13T18:30:39.305 INFO:tasks.workunit.client.0.smithi038.stdout:3/459: dwrite d0/dd/d17/d50/d5c/d23/f2c [4194304,4194304] 0 2024-09-13T18:30:39.305 INFO:tasks.workunit.client.0.smithi038.stdout:3/460: chown d0/dd/d17/d50/d5c/d1d/d29/d2b/d84 61310 1 2024-09-13T18:30:39.305 INFO:tasks.workunit.client.0.smithi038.stdout:3/461: chown d0/dd/d17/d43 132903 1 2024-09-13T18:30:39.306 INFO:tasks.workunit.client.0.smithi038.stdout:2/501: dwrite d2/f37 [0,4194304] 0 2024-09-13T18:30:39.306 INFO:tasks.workunit.client.0.smithi038.stdout:2/502: chown d2/l3 395 1 2024-09-13T18:30:39.306 INFO:tasks.workunit.client.0.smithi038.stdout:2/503: chown d2/d1e/d44/d50/d46/d58/c79 1 1 2024-09-13T18:30:39.306 INFO:tasks.workunit.client.0.smithi038.stdout:2/504: fdatasync d2/d5c/d93/d62/f70 0 2024-09-13T18:30:39.311 INFO:tasks.workunit.client.0.smithi038.stdout:3/462: creat d0/dd/d17/d50/d5c/d1d/d29/d2b/d84/f90 x:0 0 0 2024-09-13T18:30:39.313 INFO:tasks.workunit.client.0.smithi038.stdout:2/505: symlink d2/d1e/d44/d50/d39/d52/da0/lb8 0 2024-09-13T18:30:39.318 INFO:tasks.workunit.client.0.smithi038.stdout:8/546: truncate d1/de/d21/d45/d5d/fb6 2536878 0 2024-09-13T18:30:39.320 INFO:tasks.workunit.client.0.smithi038.stdout:3/463: link d0/dd/l41 d0/dd/d17/d50/d59/l91 0 2024-09-13T18:30:39.320 INFO:tasks.workunit.client.0.smithi038.stdout:3/464: write d0/dd/d17/d50/d5c/d23/d6b/f6d [96182,26325] 0 2024-09-13T18:30:39.322 INFO:tasks.workunit.client.0.smithi038.stdout:2/506: dread d2/f5 [0,4194304] 0 2024-09-13T18:30:39.323 INFO:tasks.workunit.client.0.smithi038.stdout:2/507: symlink d2/d1e/d44/lb9 0 2024-09-13T18:30:39.324 INFO:tasks.workunit.client.0.smithi038.stdout:2/508: chown d2/d1e/d44/d50/d46/d58/f7e 448722 1 2024-09-13T18:30:39.325 INFO:tasks.workunit.client.0.smithi038.stdout:2/509: symlink d2/d1e/d44/d50/d39/d45/lba 0 2024-09-13T18:30:39.325 INFO:tasks.workunit.client.0.smithi038.stdout:2/510: chown d2/d1e/d48/l60 30787000 1 2024-09-13T18:30:39.325 INFO:tasks.workunit.client.0.smithi038.stdout:2/511: getdents d2/d1e/d87/da4 0 2024-09-13T18:30:39.326 INFO:tasks.workunit.client.0.smithi038.stdout:2/512: mkdir d2/d5c/dbb 0 2024-09-13T18:30:39.340 INFO:tasks.workunit.client.0.smithi038.stdout:7/495: write db/d12/d1c/d3a/d4b/f77 [1978514,20852] 0 2024-09-13T18:30:39.344 INFO:tasks.workunit.client.0.smithi038.stdout:8/547: dwrite d1/f7 [12582912,4194304] 0 2024-09-13T18:30:39.344 INFO:tasks.workunit.client.0.smithi038.stdout:7/496: rename db/d21/c3d to db/d8e/cb4 0 2024-09-13T18:30:39.346 INFO:tasks.workunit.client.0.smithi038.stdout:8/548: write d1/d4/f4f [1018103,73644] 0 2024-09-13T18:30:39.347 INFO:tasks.workunit.client.0.smithi038.stdout:3/465: dwrite d0/dd/d17/d50/d5c/d1d/d29/d2b/d84/f90 [0,4194304] 0 2024-09-13T18:30:39.361 INFO:tasks.workunit.client.0.smithi038.stdout:8/549: mkdir d1/d2a/d3f/dbb 0 2024-09-13T18:30:39.361 INFO:tasks.workunit.client.0.smithi038.stdout:8/550: stat d1/de/d21/d24/d41/d80/d8f/fa1 0 2024-09-13T18:30:39.365 INFO:tasks.workunit.client.0.smithi038.stdout:3/466: rmdir d0/dd/d17/d43/d8a 0 2024-09-13T18:30:39.365 INFO:tasks.workunit.client.0.smithi038.stdout:3/467: chown d0/dd/d17/d79/f7f 7976 1 2024-09-13T18:30:39.368 INFO:tasks.workunit.client.0.smithi038.stdout:7/497: unlink db/d12/d1c/d3a/f1f 0 2024-09-13T18:30:39.369 INFO:tasks.workunit.client.0.smithi038.stdout:8/551: rmdir d1/de/d21/d24/d56 39 2024-09-13T18:30:39.369 INFO:tasks.workunit.client.0.smithi038.stdout:7/498: dread db/d12/d1c/d3a/d3c/d52/d51/f82 [0,4194304] 0 2024-09-13T18:30:39.369 INFO:tasks.workunit.client.0.smithi038.stdout:7/499: chown db/l15 44251847 1 2024-09-13T18:30:39.369 INFO:tasks.workunit.client.0.smithi038.stdout:7/500: write db/d12/d1c/d3a/d3c/d52/d9b/fb1 [257625,85354] 0 2024-09-13T18:30:39.372 INFO:tasks.workunit.client.0.smithi038.stdout:3/468: unlink d0/dd/d17/d50/d5c/d1d/d29/d2b/c8d 0 2024-09-13T18:30:39.372 INFO:tasks.workunit.client.0.smithi038.stdout:3/469: chown d0/dd/d17/d50/d59/f6f 446 1 2024-09-13T18:30:39.372 INFO:tasks.workunit.client.0.smithi038.stdout:3/470: readlink d0/dd/l16 0 2024-09-13T18:30:39.373 INFO:tasks.workunit.client.0.smithi038.stdout:8/552: mkdir d1/de/d15/dbc 0 2024-09-13T18:30:39.375 INFO:tasks.workunit.client.0.smithi038.stdout:3/471: link d0/dd/d17/d50/c54 d0/dd/d17/d50/d59/c92 0 2024-09-13T18:30:39.377 INFO:tasks.workunit.client.0.smithi038.stdout:8/553: creat d1/de/d21/d24/d4d/da6/fbd x:0 0 0 2024-09-13T18:30:39.377 INFO:tasks.workunit.client.0.smithi038.stdout:8/554: getdents d1/d2a/d5b 0 2024-09-13T18:30:39.380 INFO:tasks.workunit.client.0.smithi038.stdout:7/501: write db/f14 [1038275,80226] 0 2024-09-13T18:30:39.380 INFO:tasks.workunit.client.0.smithi038.stdout:7/502: read - db/d12/d1c/d3a/d26/fa5 zero size 2024-09-13T18:30:39.382 INFO:tasks.workunit.client.0.smithi038.stdout:7/503: creat db/fb5 x:0 0 0 2024-09-13T18:30:39.382 INFO:tasks.workunit.client.0.smithi038.stdout:7/504: fsync db/d12/d1c/d3a/d26/fa5 0 2024-09-13T18:30:39.383 INFO:tasks.workunit.client.0.smithi038.stdout:7/505: getdents db/d12 0 2024-09-13T18:30:39.384 INFO:tasks.workunit.client.0.smithi038.stdout:7/506: symlink db/d12/d1c/d3a/d4b/lb6 0 2024-09-13T18:30:39.384 INFO:tasks.workunit.client.0.smithi038.stdout:7/507: fsync db/d12/d1c/d3a/d22/d28/f9d 0 2024-09-13T18:30:39.385 INFO:tasks.workunit.client.0.smithi038.stdout:3/472: dread d0/dd/fe [0,4194304] 0 2024-09-13T18:30:39.390 INFO:tasks.workunit.client.0.smithi038.stdout:8/555: write d1/f3 [3591834,43316] 0 2024-09-13T18:30:39.390 INFO:tasks.workunit.client.0.smithi038.stdout:8/556: fdatasync d1/de/d21/d45/d5d/f83 0 2024-09-13T18:30:39.393 INFO:tasks.workunit.client.0.smithi038.stdout:8/557: mkdir d1/d2a/d40/dbe 0 2024-09-13T18:30:39.395 INFO:tasks.workunit.client.0.smithi038.stdout:7/508: dread db/f10 [0,4194304] 0 2024-09-13T18:30:39.407 INFO:tasks.workunit.client.0.smithi038.stdout:6/520: sync 2024-09-13T18:30:39.407 INFO:tasks.workunit.client.0.smithi038.stdout:4/806: sync 2024-09-13T18:30:39.407 INFO:tasks.workunit.client.0.smithi038.stdout:4/807: dread - d2/df/d1b/d10/fc9 zero size 2024-09-13T18:30:39.409 INFO:tasks.workunit.client.0.smithi038.stdout:7/509: dread db/f11 [0,4194304] 0 2024-09-13T18:30:39.411 INFO:tasks.workunit.client.0.smithi038.stdout:6/521: mknod dd/de/d31/d63/d83/da5/cb9 0 2024-09-13T18:30:39.412 INFO:tasks.workunit.client.0.smithi038.stdout:4/808: symlink d2/d49/d4b/l10a 0 2024-09-13T18:30:39.416 INFO:tasks.workunit.client.0.smithi038.stdout:4/809: link d2/df/d1b/f73 d2/df/d1b/d10/da3/f10b 0 2024-09-13T18:30:39.417 INFO:tasks.workunit.client.0.smithi038.stdout:3/473: dwrite d0/dd/f5e [0,4194304] 0 2024-09-13T18:30:39.417 INFO:tasks.workunit.client.0.smithi038.stdout:8/558: dwrite d1/de/d15/f6f [0,4194304] 0 2024-09-13T18:30:39.420 INFO:tasks.workunit.client.0.smithi038.stdout:4/810: rename d2/d49/fd3 to d2/de5/f10c 0 2024-09-13T18:30:39.420 INFO:tasks.workunit.client.0.smithi038.stdout:4/811: chown d2/df/d1b/d10/da3/f10b 224988 1 2024-09-13T18:30:39.420 INFO:tasks.workunit.client.0.smithi038.stdout:4/812: write d2/df/d1b/d10/fe9 [358755,96023] 0 2024-09-13T18:30:39.420 INFO:tasks.workunit.client.0.smithi038.stdout:7/510: dread db/d12/d1c/d3a/d3c/f40 [0,4194304] 0 2024-09-13T18:30:39.426 INFO:tasks.workunit.client.0.smithi038.stdout:3/474: mkdir d0/dd/d17/d50/d5c/d23/d93 0 2024-09-13T18:30:39.429 INFO:tasks.workunit.client.0.smithi038.stdout:8/559: creat d1/de/d21/d24/d41/d8c/fbf x:0 0 0 2024-09-13T18:30:39.429 INFO:tasks.workunit.client.0.smithi038.stdout:8/560: write d1/de/d21/d45/f97 [1381850,125954] 0 2024-09-13T18:30:39.430 INFO:tasks.workunit.client.0.smithi038.stdout:8/561: symlink d1/de/d21/d24/d56/lc0 0 2024-09-13T18:30:39.433 INFO:tasks.workunit.client.0.smithi038.stdout:8/562: mkdir d1/de/d21/d24/d41/d80/d8f/dc1 0 2024-09-13T18:30:39.433 INFO:tasks.workunit.client.0.smithi038.stdout:8/563: getdents d1/de/d21/d24/d41/d80/d8f/dc1 0 2024-09-13T18:30:39.433 INFO:tasks.workunit.client.0.smithi038.stdout:6/522: dwrite dd/fb0 [0,4194304] 0 2024-09-13T18:30:39.433 INFO:tasks.workunit.client.0.smithi038.stdout:6/523: chown dd/de/d2e/d2f/c3d 30176907 1 2024-09-13T18:30:39.435 INFO:tasks.workunit.client.0.smithi038.stdout:6/524: creat dd/de/d2e/d9b/fba x:0 0 0 2024-09-13T18:30:39.438 INFO:tasks.workunit.client.0.smithi038.stdout:6/525: symlink dd/de/d2e/d2f/d4c/d86/lbb 0 2024-09-13T18:30:39.442 INFO:tasks.workunit.client.0.smithi038.stdout:6/526: mkdir dd/de/d2e/d2f/da6/dbc 0 2024-09-13T18:30:39.446 INFO:tasks.workunit.client.0.smithi038.stdout:7/511: dwrite db/d12/d1c/d3a/d3c/d52/d51/f8d [0,4194304] 0 2024-09-13T18:30:39.446 INFO:tasks.workunit.client.0.smithi038.stdout:6/527: dread dd/de/d2e/d2f/d71/f97 [0,4194304] 0 2024-09-13T18:30:39.446 INFO:tasks.workunit.client.0.smithi038.stdout:6/528: chown dd/de/d61/l68 78847 1 2024-09-13T18:30:39.446 INFO:tasks.workunit.client.0.smithi038.stdout:6/529: fsync f9 0 2024-09-13T18:30:39.446 INFO:tasks.workunit.client.0.smithi038.stdout:4/813: dwrite d2/df/faf [4194304,4194304] 0 2024-09-13T18:30:39.451 INFO:tasks.workunit.client.0.smithi038.stdout:6/530: link dd/de/d2e/d99/fb2 dd/de/d2e/d2f/d4c/d55/fbd 0 2024-09-13T18:30:39.451 INFO:tasks.workunit.client.0.smithi038.stdout:4/814: dread d2/df/d1b/d10/d75/f8f [0,4194304] 0 2024-09-13T18:30:39.451 INFO:tasks.workunit.client.0.smithi038.stdout:4/815: truncate d2/fc1 1898654 0 2024-09-13T18:30:39.452 INFO:tasks.workunit.client.0.smithi038.stdout:4/816: chown d2/fc1 57746 1 2024-09-13T18:30:39.456 INFO:tasks.workunit.client.0.smithi038.stdout:4/817: write d2/df/d1b/f8a [1080869,93898] 0 2024-09-13T18:30:39.457 INFO:tasks.workunit.client.0.smithi038.stdout:6/531: mknod dd/de/d2e/d2f/d4c/d55/cbe 0 2024-09-13T18:30:39.461 INFO:tasks.workunit.client.0.smithi038.stdout:7/512: dread db/d12/d13/f1b [0,4194304] 0 2024-09-13T18:30:39.461 INFO:tasks.workunit.client.0.smithi038.stdout:7/513: creat db/d12/d1c/d3a/d26/fb7 x:0 0 0 2024-09-13T18:30:39.461 INFO:tasks.workunit.client.0.smithi038.stdout:7/514: dread - db/d12/d13/fb3 zero size 2024-09-13T18:30:39.461 INFO:tasks.workunit.client.0.smithi038.stdout:7/515: readlink l9 0 2024-09-13T18:30:39.461 INFO:tasks.workunit.client.0.smithi038.stdout:4/818: creat d2/df/d1b/d10/d75/f10d x:0 0 0 2024-09-13T18:30:39.462 INFO:tasks.workunit.client.0.smithi038.stdout:6/532: mkdir dd/de/d2e/d9b/dbf 0 2024-09-13T18:30:39.462 INFO:tasks.workunit.client.0.smithi038.stdout:6/533: readlink l2 0 2024-09-13T18:30:39.465 INFO:tasks.workunit.client.0.smithi038.stdout:3/475: dwrite d0/dd/d17/d50/d5c/f47 [0,4194304] 0 2024-09-13T18:30:39.465 INFO:tasks.workunit.client.0.smithi038.stdout:3/476: dread - d0/dd/d17/d43/d89/f85 zero size 2024-09-13T18:30:39.465 INFO:tasks.workunit.client.0.smithi038.stdout:8/564: dwrite d1/de/d21/d24/d4d/d50/d62/d71/f82 [8388608,4194304] 0 2024-09-13T18:30:39.465 INFO:tasks.workunit.client.0.smithi038.stdout:8/565: readlink d1/de/d21/d24/d56/lc0 0 2024-09-13T18:30:39.466 INFO:tasks.workunit.client.0.smithi038.stdout:8/566: chown d1/de/d21/d24/d41/d8c 1348215 1 2024-09-13T18:30:39.468 INFO:tasks.workunit.client.0.smithi038.stdout:7/516: link db/d8e/cb4 db/d12/d1c/d3a/d3c/cb8 0 2024-09-13T18:30:39.471 INFO:tasks.workunit.client.0.smithi038.stdout:8/567: creat d1/de/d21/d24/d41/d80/d8f/dc1/fc2 x:0 0 0 2024-09-13T18:30:39.471 INFO:tasks.workunit.client.0.smithi038.stdout:8/568: chown d1/d4/c9d 527859458 1 2024-09-13T18:30:39.471 INFO:tasks.workunit.client.0.smithi038.stdout:8/569: fdatasync d1/de/d21/d24/d4d/d50/fa0 0 2024-09-13T18:30:39.474 INFO:tasks.workunit.client.0.smithi038.stdout:7/517: creat db/d12/d1c/d3a/d22/fb9 x:0 0 0 2024-09-13T18:30:39.476 INFO:tasks.workunit.client.0.smithi038.stdout:3/477: dread d0/fa [0,4194304] 0 2024-09-13T18:30:39.476 INFO:tasks.workunit.client.0.smithi038.stdout:7/518: creat db/d12/d1c/d3a/d4b/fba x:0 0 0 2024-09-13T18:30:39.477 INFO:tasks.workunit.client.0.smithi038.stdout:7/519: stat db/d12/d1c/d3a/d22/d28/f6f 0 2024-09-13T18:30:39.484 INFO:tasks.workunit.client.0.smithi038.stdout:8/570: read d1/de/f5a [57718,112837] 0 2024-09-13T18:30:39.487 INFO:tasks.workunit.client.0.smithi038.stdout:8/571: mknod d1/de/d21/d24/d41/d80/d8f/dc1/cc3 0 2024-09-13T18:30:39.487 INFO:tasks.workunit.client.0.smithi038.stdout:6/534: dwrite dd/f44 [0,4194304] 0 2024-09-13T18:30:39.488 INFO:tasks.workunit.client.0.smithi038.stdout:4/819: dwrite d2/df/d22/f65 [0,4194304] 0 2024-09-13T18:30:39.492 INFO:tasks.workunit.client.0.smithi038.stdout:8/572: mkdir d1/d2a/d40/dbe/dc4 0 2024-09-13T18:30:39.494 INFO:tasks.workunit.client.0.smithi038.stdout:6/535: getdents dd/de/d2e/d2f/d4c/d6f 0 2024-09-13T18:30:39.494 INFO:tasks.workunit.client.0.smithi038.stdout:6/536: fdatasync dd/de/d31/f74 0 2024-09-13T18:30:39.497 INFO:tasks.workunit.client.0.smithi038.stdout:8/573: truncate d1/de/d3a/f77 500472 0 2024-09-13T18:30:39.498 INFO:tasks.workunit.client.0.smithi038.stdout:6/537: getdents dd/de/d2e/d2f 0 2024-09-13T18:30:39.499 INFO:tasks.workunit.client.0.smithi038.stdout:8/574: mknod d1/de/d21/d45/d61/cc5 0 2024-09-13T18:30:39.499 INFO:tasks.workunit.client.0.smithi038.stdout:8/575: chown d1/d8 26647 1 2024-09-13T18:30:39.499 INFO:tasks.workunit.client.0.smithi038.stdout:8/576: fdatasync d1/de/d21/d24/d4d/d50/d62/d71/f82 0 2024-09-13T18:30:39.500 INFO:tasks.workunit.client.0.smithi038.stdout:8/577: mkdir d1/d2a/d40/dbe/dc6 0 2024-09-13T18:30:39.501 INFO:tasks.workunit.client.0.smithi038.stdout:8/578: mkdir d1/de/dc7 0 2024-09-13T18:30:39.501 INFO:tasks.workunit.client.0.smithi038.stdout:8/579: rmdir d1/de/d21/d24/d56 39 2024-09-13T18:30:39.506 INFO:tasks.workunit.client.0.smithi038.stdout:6/538: dread dd/fb0 [0,4194304] 0 2024-09-13T18:30:39.506 INFO:tasks.workunit.client.0.smithi038.stdout:6/539: truncate dd/de/d2e/d9b/fba 252651 0 2024-09-13T18:30:39.508 INFO:tasks.workunit.client.0.smithi038.stdout:4/820: write d2/f33 [833776,111505] 0 2024-09-13T18:30:39.509 INFO:tasks.workunit.client.0.smithi038.stdout:3/478: dwrite d0/dd/d17/f81 [0,4194304] 0 2024-09-13T18:30:39.509 INFO:tasks.workunit.client.0.smithi038.stdout:3/479: chown d0/dd/d17/d50/d5c/d1d/d29/d2b/f68 235701580 1 2024-09-13T18:30:39.509 INFO:tasks.workunit.client.0.smithi038.stdout:8/580: dread d1/de/f5a [0,4194304] 0 2024-09-13T18:30:39.510 INFO:tasks.workunit.client.0.smithi038.stdout:8/581: creat d1/de/d21/d24/fc8 x:0 0 0 2024-09-13T18:30:39.517 INFO:tasks.workunit.client.0.smithi038.stdout:3/480: mknod d0/dd/d17/c94 0 2024-09-13T18:30:39.529 INFO:tasks.workunit.client.0.smithi038.stdout:3/481: rename d0/dd/d17/d50/d5c/d1d/d29/d2b to d0/dd/d17/d50/d5c/d1d/d30/d95 0 2024-09-13T18:30:39.531 INFO:tasks.workunit.client.0.smithi038.stdout:3/482: dread d0/dd/d17/d50/d5c/d23/d6b/f6d [0,4194304] 0 2024-09-13T18:30:39.539 INFO:tasks.workunit.client.0.smithi038.stdout:8/582: write d1/de/d21/d45/d5d/fb6 [2594333,96157] 0 2024-09-13T18:30:39.543 INFO:tasks.workunit.client.0.smithi038.stdout:4/821: dwrite d2/df/d1b/fd [0,4194304] 0 2024-09-13T18:30:39.543 INFO:tasks.workunit.client.0.smithi038.stdout:4/822: chown d2/df/d1b/c5c 13 1 2024-09-13T18:30:39.545 INFO:tasks.workunit.client.0.smithi038.stdout:3/483: dread d0/dd/d17/d43/f5d [0,4194304] 0 2024-09-13T18:30:39.545 INFO:tasks.workunit.client.0.smithi038.stdout:4/823: truncate d2/df/d1b/d10/d75/f9f 3961553 0 2024-09-13T18:30:39.545 INFO:tasks.workunit.client.0.smithi038.stdout:6/540: dwrite dd/de/d2e/f6e [0,4194304] 0 2024-09-13T18:30:39.545 INFO:tasks.workunit.client.0.smithi038.stdout:3/484: stat d0/dd/d17/d43/d89/f58 0 2024-09-13T18:30:39.545 INFO:tasks.workunit.client.0.smithi038.stdout:6/541: readlink dd/de/d2e/d30/l36 0 2024-09-13T18:30:39.545 INFO:tasks.workunit.client.0.smithi038.stdout:3/485: write d0/dd/d17/d43/d89/f58 [1190670,126343] 0 2024-09-13T18:30:39.561 INFO:tasks.workunit.client.0.smithi038.stdout:8/583: dwrite d1/de/f94 [0,4194304] 0 2024-09-13T18:30:39.561 INFO:tasks.workunit.client.0.smithi038.stdout:8/584: write d1/d8/f7b [1032252,46517] 0 2024-09-13T18:30:39.562 INFO:tasks.workunit.client.0.smithi038.stdout:4/824: mknod d2/df/d22/d9a/c10e 0 2024-09-13T18:30:39.564 INFO:tasks.workunit.client.0.smithi038.stdout:6/542: link dd/de/d2e/d2f/da6/fb4 dd/de/d2e/d2f/d4c/d55/fc0 0 2024-09-13T18:30:39.566 INFO:tasks.workunit.client.0.smithi038.stdout:3/486: mknod d0/c96 0 2024-09-13T18:30:39.567 INFO:tasks.workunit.client.0.smithi038.stdout:3/487: write d0/dd/d17/d50/d5c/d1d/d30/f74 [942778,127942] 0 2024-09-13T18:30:39.573 INFO:tasks.workunit.client.0.smithi038.stdout:6/543: write dd/de/d2e/f67 [3375290,65166] 0 2024-09-13T18:30:39.577 INFO:tasks.workunit.client.0.smithi038.stdout:6/544: link dd/de/d2e/d2f/d71/fa4 dd/de/d2e/d2f/d4c/d86/fc1 0 2024-09-13T18:30:39.577 INFO:tasks.workunit.client.0.smithi038.stdout:8/585: write d1/de/d21/d45/f73 [221415,121132] 0 2024-09-13T18:30:39.578 INFO:tasks.workunit.client.0.smithi038.stdout:4/825: dread d2/df/d1b/d10/f25 [0,4194304] 0 2024-09-13T18:30:39.579 INFO:tasks.workunit.client.0.smithi038.stdout:6/545: mknod dd/de/cc2 0 2024-09-13T18:30:39.581 INFO:tasks.workunit.client.0.smithi038.stdout:8/586: mknod d1/d2a/d40/dbe/cc9 0 2024-09-13T18:30:39.581 INFO:tasks.workunit.client.0.smithi038.stdout:8/587: chown d1/d2a/d40/dbe/dc4 800879 1 2024-09-13T18:30:39.582 INFO:tasks.workunit.client.0.smithi038.stdout:4/826: creat d2/d49/d4b/dc0/f10f x:0 0 0 2024-09-13T18:30:39.583 INFO:tasks.workunit.client.0.smithi038.stdout:8/588: dread d1/de/d21/d24/d41/f88 [0,4194304] 0 2024-09-13T18:30:39.585 INFO:tasks.workunit.client.0.smithi038.stdout:4/827: truncate d2/df/f4c 1526644 0 2024-09-13T18:30:39.585 INFO:tasks.workunit.client.0.smithi038.stdout:8/589: mkdir d1/de/d21/d24/d41/d80/dca 0 2024-09-13T18:30:39.587 INFO:tasks.workunit.client.0.smithi038.stdout:4/828: link d2/df/d1b/d10/l31 d2/df/d1b/d10/d71/l110 0 2024-09-13T18:30:39.589 INFO:tasks.workunit.client.0.smithi038.stdout:8/590: truncate d1/f60 4785437 0 2024-09-13T18:30:39.593 INFO:tasks.workunit.client.0.smithi038.stdout:4/829: symlink d2/d49/d50/da0/d8/d3b/l111 0 2024-09-13T18:30:39.593 INFO:tasks.workunit.client.0.smithi038.stdout:4/830: write d2/df/d1b/d10/fc9 [213773,112562] 0 2024-09-13T18:30:39.597 INFO:tasks.workunit.client.0.smithi038.stdout:4/831: getdents d2/df/d1b/d10/d55/dd5 0 2024-09-13T18:30:39.597 INFO:tasks.workunit.client.0.smithi038.stdout:4/832: truncate d2/df/d1b/d10/d71/f81 291499 0 2024-09-13T18:30:39.597 INFO:tasks.workunit.client.0.smithi038.stdout:4/833: chown d2/d49/d4b/l6d 12305 1 2024-09-13T18:30:39.598 INFO:tasks.workunit.client.0.smithi038.stdout:4/834: symlink d2/de5/deb/l112 0 2024-09-13T18:30:39.599 INFO:tasks.workunit.client.0.smithi038.stdout:6/546: dwrite dd/de/d61/f92 [0,4194304] 0 2024-09-13T18:30:39.602 INFO:tasks.workunit.client.0.smithi038.stdout:8/591: dread d1/d4/f3d [0,4194304] 0 2024-09-13T18:30:39.607 INFO:tasks.workunit.client.0.smithi038.stdout:6/547: link dd/de/d31/f74 dd/de/d2e/fc3 0 2024-09-13T18:30:39.607 INFO:tasks.workunit.client.0.smithi038.stdout:6/548: fsync dd/de/d2e/d2f/f94 0 2024-09-13T18:30:39.611 INFO:tasks.workunit.client.0.smithi038.stdout:8/592: unlink d1/d2a/fac 0 2024-09-13T18:30:39.611 INFO:tasks.workunit.client.0.smithi038.stdout:8/593: write d1/d2a/d3f/fb2 [1727875,58962] 0 2024-09-13T18:30:39.612 INFO:tasks.workunit.client.0.smithi038.stdout:6/549: mknod dd/de/d2e/d2f/d4c/d86/cc4 0 2024-09-13T18:30:39.614 INFO:tasks.workunit.client.0.smithi038.stdout:8/594: read d1/de/d21/d24/d41/d80/d8f/fa1 [966645,14308] 0 2024-09-13T18:30:39.615 INFO:tasks.workunit.client.0.smithi038.stdout:8/595: chown d1/ff 23 1 2024-09-13T18:30:39.615 INFO:tasks.workunit.client.0.smithi038.stdout:8/596: write d1/de/d3a/f3e [394600,126308] 0 2024-09-13T18:30:39.624 INFO:tasks.workunit.client.0.smithi038.stdout:6/550: write dd/de/d2e/f58 [1953525,8111] 0 2024-09-13T18:30:39.624 INFO:tasks.workunit.client.0.smithi038.stdout:6/551: write dd/de/d2e/d2f/d4c/d55/fc0 [2988783,43645] 0 2024-09-13T18:30:39.624 INFO:tasks.workunit.client.0.smithi038.stdout:6/552: write dd/de/d2e/d2f/d4c/d55/f93 [16583,91466] 0 2024-09-13T18:30:39.624 INFO:tasks.workunit.client.0.smithi038.stdout:6/553: chown dd/de/d2e/d2f/d4c/d55/f5b 772264 1 2024-09-13T18:30:39.627 INFO:tasks.workunit.client.0.smithi038.stdout:8/597: dwrite d1/de/d21/f52 [0,4194304] 0 2024-09-13T18:30:39.632 INFO:tasks.workunit.client.0.smithi038.stdout:8/598: mkdir d1/d2a/d3f/dbb/dcb 0 2024-09-13T18:30:39.632 INFO:tasks.workunit.client.0.smithi038.stdout:8/599: truncate d1/de/d15/d30/fa9 704929 0 2024-09-13T18:30:39.632 INFO:tasks.workunit.client.0.smithi038.stdout:8/600: readlink d1/de/d21/d24/d56/lb1 0 2024-09-13T18:30:39.634 INFO:tasks.workunit.client.0.smithi038.stdout:6/554: truncate dd/de/d2e/f58 3731745 0 2024-09-13T18:30:39.638 INFO:tasks.workunit.client.0.smithi038.stdout:6/555: mkdir dd/de/d2e/d2f/d71/dc5 0 2024-09-13T18:30:39.639 INFO:tasks.workunit.client.0.smithi038.stdout:6/556: mkdir dd/de/dc6 0 2024-09-13T18:30:39.641 INFO:tasks.workunit.client.0.smithi038.stdout:6/557: creat dd/de/d31/d63/d83/da5/fc7 x:0 0 0 2024-09-13T18:30:39.642 INFO:tasks.workunit.client.0.smithi038.stdout:6/558: getdents dd/de/d2e/d2f/d4c/d86 0 2024-09-13T18:30:39.643 INFO:tasks.workunit.client.0.smithi038.stdout:6/559: write dd/de/d2e/d99/f80 [871380,62236] 0 2024-09-13T18:30:39.643 INFO:tasks.workunit.client.0.smithi038.stdout:6/560: fdatasync dd/de/d31/fa2 0 2024-09-13T18:30:39.649 INFO:tasks.workunit.client.0.smithi038.stdout:6/561: creat dd/daa/fc8 x:0 0 0 2024-09-13T18:30:39.649 INFO:tasks.workunit.client.0.smithi038.stdout:6/562: chown dd/de/d2e/d2f/f51 260698 1 2024-09-13T18:30:39.650 INFO:tasks.workunit.client.0.smithi038.stdout:6/563: read dd/de/d2e/f64 [5556,75852] 0 2024-09-13T18:30:39.651 INFO:tasks.workunit.client.0.smithi038.stdout:6/564: creat dd/de/d2e/d2f/d4c/fc9 x:0 0 0 2024-09-13T18:30:39.653 INFO:tasks.workunit.client.0.smithi038.stdout:6/565: read dd/de/d2e/d2f/f39 [392432,31442] 0 2024-09-13T18:30:39.654 INFO:tasks.workunit.client.0.smithi038.stdout:6/566: mkdir dd/de/d31/dca 0 2024-09-13T18:30:39.654 INFO:tasks.workunit.client.0.smithi038.stdout:6/567: truncate dd/de/d2e/d2f/f94 1014324 0 2024-09-13T18:30:39.655 INFO:tasks.workunit.client.0.smithi038.stdout:6/568: symlink dd/de/d2e/d9b/lcb 0 2024-09-13T18:30:39.655 INFO:tasks.workunit.client.0.smithi038.stdout:6/569: fsync dd/de/d2e/d2f/d4c/d55/f7e 0 2024-09-13T18:30:39.655 INFO:tasks.workunit.client.0.smithi038.stdout:6/570: chown dd/de/d2e/d30/d27/f43 130394 1 2024-09-13T18:30:39.656 INFO:tasks.workunit.client.0.smithi038.stdout:6/571: stat dd/de/l70 0 2024-09-13T18:30:39.658 INFO:tasks.workunit.client.0.smithi038.stdout:6/572: rename dd/de/d2e/d2f/da6/fb4 to dd/de/d61/d62/fcc 0 2024-09-13T18:30:39.659 INFO:tasks.workunit.client.0.smithi038.stdout:6/573: creat dd/de/d31/dca/fcd x:0 0 0 2024-09-13T18:30:39.662 INFO:tasks.workunit.client.0.smithi038.stdout:6/574: dread dd/de/d2e/d2f/d71/fa4 [0,4194304] 0 2024-09-13T18:30:39.662 INFO:tasks.workunit.client.0.smithi038.stdout:6/575: mkdir dd/de/dce 0 2024-09-13T18:30:39.664 INFO:tasks.workunit.client.0.smithi038.stdout:6/576: creat dd/de/d2e/d2f/da0/fcf x:0 0 0 2024-09-13T18:30:39.664 INFO:tasks.workunit.client.0.smithi038.stdout:6/577: write dd/de/d2e/d99/fb7 [39311,44521] 0 2024-09-13T18:30:39.665 INFO:tasks.workunit.client.0.smithi038.stdout:6/578: mknod dd/de/d31/dca/cd0 0 2024-09-13T18:30:39.668 INFO:tasks.workunit.client.0.smithi038.stdout:6/579: rmdir dd/de/d31/daf 0 2024-09-13T18:30:39.668 INFO:tasks.workunit.client.0.smithi038.stdout:6/580: fdatasync dd/daa/fc8 0 2024-09-13T18:30:39.668 INFO:tasks.workunit.client.0.smithi038.stdout:6/581: dread dd/de/d2e/d2f/d4c/d55/f5b [0,4194304] 0 2024-09-13T18:30:39.670 INFO:tasks.workunit.client.0.smithi038.stdout:6/582: symlink dd/de/d31/ld1 0 2024-09-13T18:30:39.670 INFO:tasks.workunit.client.0.smithi038.stdout:6/583: fsync dd/de/d2e/d30/f22 0 2024-09-13T18:30:39.670 INFO:tasks.workunit.client.0.smithi038.stdout:6/584: chown dd/de/d2e/d99/c8b 52018 1 2024-09-13T18:30:39.673 INFO:tasks.workunit.client.0.smithi038.stdout:6/585: unlink dd/de/d2e/d30/d27/f2d 0 2024-09-13T18:30:39.673 INFO:tasks.workunit.client.0.smithi038.stdout:6/586: creat dd/de/d61/fd2 x:0 0 0 2024-09-13T18:30:39.677 INFO:tasks.workunit.client.0.smithi038.stdout:6/587: link dd/de/d2e/d2f/d4c/d60/c76 dd/de/cd3 0 2024-09-13T18:30:39.678 INFO:tasks.workunit.client.0.smithi038.stdout:6/588: chown dd/de/d2e/d99/f7f 1958759472 1 2024-09-13T18:30:39.678 INFO:tasks.workunit.client.0.smithi038.stdout:6/589: chown dd/de/d2e/d30/f22 240881339 1 2024-09-13T18:30:39.678 INFO:tasks.workunit.client.0.smithi038.stdout:6/590: dread - dd/de/d2e/d2f/d4c/d55/fbd zero size 2024-09-13T18:30:39.679 INFO:tasks.workunit.client.0.smithi038.stdout:6/591: getdents dd/de/d61/da1 0 2024-09-13T18:30:39.679 INFO:tasks.workunit.client.0.smithi038.stdout:6/592: write dd/f32 [865588,110307] 0 2024-09-13T18:30:39.680 INFO:tasks.workunit.client.0.smithi038.stdout:6/593: creat dd/de/d2e/d30/fd4 x:0 0 0 2024-09-13T18:30:39.702 INFO:tasks.workunit.client.0.smithi038.stdout:6/594: dwrite dd/f32 [0,4194304] 0 2024-09-13T18:30:39.705 INFO:tasks.workunit.client.0.smithi038.stdout:6/595: rmdir dd/de/d2e/d2f/da6/dbc 0 2024-09-13T18:30:39.723 INFO:tasks.workunit.client.0.smithi038.stdout:6/596: dwrite dd/de/d2e/d99/fb7 [0,4194304] 0 2024-09-13T18:30:39.724 INFO:tasks.workunit.client.0.smithi038.stdout:6/597: symlink dd/de/d2e/d30/ld5 0 2024-09-13T18:30:39.738 INFO:tasks.workunit.client.0.smithi038.stdout:6/598: dwrite dd/de/d2e/d2f/d4c/f4d [0,4194304] 0 2024-09-13T18:30:39.742 INFO:tasks.workunit.client.0.smithi038.stdout:6/599: link dd/de/d2e/d2f/d4c/d86/cb3 dd/de/dc6/cd6 0 2024-09-13T18:30:39.745 INFO:tasks.workunit.client.0.smithi038.stdout:6/600: link dd/de/d31/d63/d83/l85 dd/de/d2e/d30/d27/ld7 0 2024-09-13T18:30:39.745 INFO:tasks.workunit.client.0.smithi038.stdout:6/601: write dd/de/d2e/d2f/d4c/d55/f5e [5004151,97649] 0 2024-09-13T18:30:39.785 INFO:tasks.workunit.client.0.smithi038.stdout:6/602: dwrite dd/de/d2e/f4b [0,4194304] 0 2024-09-13T18:30:39.787 INFO:tasks.workunit.client.0.smithi038.stdout:6/603: mknod dd/de/d2e/d2f/d71/dc5/cd8 0 2024-09-13T18:30:40.035 INFO:tasks.workunit.client.0.smithi038.stdout:0/511: sync 2024-09-13T18:30:40.036 INFO:tasks.workunit.client.0.smithi038.stdout:0/512: read d2/d7/d24/f84 [277252,41164] 0 2024-09-13T18:30:40.043 INFO:tasks.workunit.client.0.smithi038.stdout:0/513: write d2/d7/d24/d92/d66/d81/f83 [2104879,76038] 0 2024-09-13T18:30:40.060 INFO:tasks.workunit.client.0.smithi038.stdout:0/514: dwrite d2/d7/f1d [4194304,4194304] 0 2024-09-13T18:30:40.218 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:39 smithi038 ceph-mon[27689]: pgmap v22: 65 pgs: 65 active+clean; 3.0 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 292 MiB/s rd, 362 MiB/s wr, 543 op/s 2024-09-13T18:30:40.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:39 smithi149 ceph-mon[35845]: pgmap v22: 65 pgs: 65 active+clean; 3.0 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 292 MiB/s rd, 362 MiB/s wr, 543 op/s 2024-09-13T18:30:40.276 INFO:tasks.workunit.client.0.smithi038.stdout:0/515: rename d2/d7/l1a to d2/d7/d24/d92/d40/d9a/la5 0 2024-09-13T18:30:40.286 INFO:tasks.workunit.client.0.smithi038.stdout:9/542: sync 2024-09-13T18:30:40.287 INFO:tasks.workunit.client.0.smithi038.stdout:5/522: sync 2024-09-13T18:30:40.287 INFO:tasks.workunit.client.0.smithi038.stdout:1/696: sync 2024-09-13T18:30:40.287 INFO:tasks.workunit.client.0.smithi038.stdout:1/697: chown d12/d2a/d72/fd9 5512136 1 2024-09-13T18:30:40.292 INFO:tasks.workunit.client.0.smithi038.stdout:9/543: symlink d0/d7/d13/d2d/d3c/lc4 0 2024-09-13T18:30:40.293 INFO:tasks.workunit.client.0.smithi038.stdout:9/544: truncate d0/d7/d13/d2d/d3e/f6e 2238207 0 2024-09-13T18:30:40.301 INFO:tasks.workunit.client.0.smithi038.stdout:9/545: write d0/d7/d2c/d6d/f75 [1492799,61975] 0 2024-09-13T18:30:40.325 INFO:tasks.workunit.client.0.smithi038.stdout:0/516: mknod d2/d7/d24/d2b/ca6 0 2024-09-13T18:30:40.326 INFO:tasks.workunit.client.0.smithi038.stdout:0/517: mkdir d2/d7/d24/d2b/d6d/da7 0 2024-09-13T18:30:40.327 INFO:tasks.workunit.client.0.smithi038.stdout:0/518: mkdir d2/d7/d24/d92/d40/d74/da8 0 2024-09-13T18:30:40.328 INFO:tasks.workunit.client.0.smithi038.stdout:7/520: sync 2024-09-13T18:30:40.328 INFO:tasks.workunit.client.0.smithi038.stdout:2/513: sync 2024-09-13T18:30:40.328 INFO:tasks.workunit.client.0.smithi038.stdout:3/488: sync 2024-09-13T18:30:40.329 INFO:tasks.workunit.client.0.smithi038.stdout:8/601: sync 2024-09-13T18:30:40.329 INFO:tasks.workunit.client.0.smithi038.stdout:2/514: chown d2/d1e/c22 111752 1 2024-09-13T18:30:40.329 INFO:tasks.workunit.client.0.smithi038.stdout:2/515: dread - d2/da/f1d zero size 2024-09-13T18:30:40.329 INFO:tasks.workunit.client.0.smithi038.stdout:4/835: sync 2024-09-13T18:30:40.329 INFO:tasks.workunit.client.0.smithi038.stdout:4/836: write d2/d49/d50/da0/d8/f2e [5116427,78523] 0 2024-09-13T18:30:40.329 INFO:tasks.workunit.client.0.smithi038.stdout:6/604: sync 2024-09-13T18:30:40.330 INFO:tasks.workunit.client.0.smithi038.stdout:3/489: mknod d0/dd/d17/d50/d5c/d23/d7c/c97 0 2024-09-13T18:30:40.330 INFO:tasks.workunit.client.0.smithi038.stdout:2/516: symlink d2/d1e/d44/d50/d46/d58/lbc 0 2024-09-13T18:30:40.331 INFO:tasks.workunit.client.0.smithi038.stdout:2/517: fdatasync d2/d1e/d44/d50/d46/f71 0 2024-09-13T18:30:40.332 INFO:tasks.workunit.client.0.smithi038.stdout:4/837: link d2/df/d22/c6e d2/d49/d50/da0/d8/d3b/d100/c113 0 2024-09-13T18:30:40.332 INFO:tasks.workunit.client.0.smithi038.stdout:4/838: write d2/df/f4c [2415219,14029] 0 2024-09-13T18:30:40.334 INFO:tasks.workunit.client.0.smithi038.stdout:6/605: unlink dd/l24 0 2024-09-13T18:30:40.336 INFO:tasks.workunit.client.0.smithi038.stdout:1/698: rename d12/d2a/d32/d59/ld2 to d12/d3c/d46/d57/lda 0 2024-09-13T18:30:40.338 INFO:tasks.workunit.client.0.smithi038.stdout:4/839: creat d2/df/d1b/d10/d55/dd5/f114 x:0 0 0 2024-09-13T18:30:40.338 INFO:tasks.workunit.client.0.smithi038.stdout:3/490: dread d0/dd/fe [0,4194304] 0 2024-09-13T18:30:40.338 INFO:tasks.workunit.client.0.smithi038.stdout:3/491: chown d0/dd/d17/d50/d5c/d23/d6b 15 1 2024-09-13T18:30:40.338 INFO:tasks.workunit.client.0.smithi038.stdout:4/840: truncate d2/d49/d50/f77 618529 0 2024-09-13T18:30:40.340 INFO:tasks.workunit.client.0.smithi038.stdout:6/606: mkdir dd/de/d2e/d2f/da6/dd9 0 2024-09-13T18:30:40.341 INFO:tasks.workunit.client.0.smithi038.stdout:6/607: dread - dd/de/d2e/d2f/d71/f75 zero size 2024-09-13T18:30:40.342 INFO:tasks.workunit.client.0.smithi038.stdout:8/602: write d1/de/d21/d24/d4d/d50/d62/d71/f82 [7118974,34961] 0 2024-09-13T18:30:40.342 INFO:tasks.workunit.client.0.smithi038.stdout:7/521: write db/d12/d1c/d3a/d26/f7a [2535053,92802] 0 2024-09-13T18:30:40.342 INFO:tasks.workunit.client.0.smithi038.stdout:7/522: chown db/d12/d1c/d3a/d26/c29 49 1 2024-09-13T18:30:40.343 INFO:tasks.workunit.client.0.smithi038.stdout:7/523: stat db/d12/d1c/d3a/d4b/f65 0 2024-09-13T18:30:40.343 INFO:tasks.workunit.client.0.smithi038.stdout:9/546: rename d0/d7/d93 to d0/d7/d2c/d5e/dc5 0 2024-09-13T18:30:40.343 INFO:tasks.workunit.client.0.smithi038.stdout:9/547: write d0/d7/d13/d2d/f6a [293751,127515] 0 2024-09-13T18:30:40.343 INFO:tasks.workunit.client.0.smithi038.stdout:9/548: write d0/f2a [2544554,126121] 0 2024-09-13T18:30:40.344 INFO:tasks.workunit.client.0.smithi038.stdout:6/608: rmdir dd/de/d31/d63/d8e 0 2024-09-13T18:30:40.345 INFO:tasks.workunit.client.0.smithi038.stdout:1/699: write d12/d3c/fa2 [1367072,117423] 0 2024-09-13T18:30:40.346 INFO:tasks.workunit.client.0.smithi038.stdout:8/603: link d1/d2a/d3f/f7e d1/d2a/d40/dbe/fcc 0 2024-09-13T18:30:40.347 INFO:tasks.workunit.client.0.smithi038.stdout:9/549: mknod d0/d7/d13/d2d/d3e/d70/da2/d86/cc6 0 2024-09-13T18:30:40.347 INFO:tasks.workunit.client.0.smithi038.stdout:9/550: creat d0/d7/d13/d30/fc7 x:0 0 0 2024-09-13T18:30:40.349 INFO:tasks.workunit.client.0.smithi038.stdout:1/700: mkdir d12/d7a/ddb 0 2024-09-13T18:30:40.349 INFO:tasks.workunit.client.0.smithi038.stdout:1/701: chown d12/f16 1089 1 2024-09-13T18:30:40.349 INFO:tasks.workunit.client.0.smithi038.stdout:4/841: dread d2/df/d1b/f2b [0,4194304] 0 2024-09-13T18:30:40.350 INFO:tasks.workunit.client.0.smithi038.stdout:2/518: dwrite d2/d2a/f35 [4194304,4194304] 0 2024-09-13T18:30:40.352 INFO:tasks.workunit.client.0.smithi038.stdout:1/702: mkdir d12/d2a/d72/ddc 0 2024-09-13T18:30:40.354 INFO:tasks.workunit.client.0.smithi038.stdout:4/842: creat d2/d49/d50/da0/dcb/f115 x:0 0 0 2024-09-13T18:30:40.354 INFO:tasks.workunit.client.0.smithi038.stdout:4/843: dread - d2/df/d1b/d10/d75/f10d zero size 2024-09-13T18:30:40.354 INFO:tasks.workunit.client.0.smithi038.stdout:4/844: write d2/fc1 [1963266,34818] 0 2024-09-13T18:30:40.354 INFO:tasks.workunit.client.0.smithi038.stdout:3/492: dread d0/dd/d17/f81 [0,4194304] 0 2024-09-13T18:30:40.354 INFO:tasks.workunit.client.0.smithi038.stdout:3/493: fsync d0/dd/d17/d50/d5c/d23/d52/f8c 0 2024-09-13T18:30:40.355 INFO:tasks.workunit.client.0.smithi038.stdout:3/494: truncate d0/dd/d17/d50/d5c/d1d/d30/d95/f68 160302 0 2024-09-13T18:30:40.355 INFO:tasks.workunit.client.0.smithi038.stdout:2/519: creat d2/d5c/db3/fbd x:0 0 0 2024-09-13T18:30:40.357 INFO:tasks.workunit.client.0.smithi038.stdout:1/703: mkdir d12/d2a/d32/d59/d5e/ddd 0 2024-09-13T18:30:40.357 INFO:tasks.workunit.client.0.smithi038.stdout:6/609: dread dd/de/d2e/d99/f7f [0,4194304] 0 2024-09-13T18:30:40.357 INFO:tasks.workunit.client.0.smithi038.stdout:6/610: fsync dd/f13 0 2024-09-13T18:30:40.358 INFO:tasks.workunit.client.0.smithi038.stdout:9/551: write d0/d7/d13/d2d/d3e/f6e [1877370,57978] 0 2024-09-13T18:30:40.358 INFO:tasks.workunit.client.0.smithi038.stdout:7/524: write db/d12/d1c/d3a/d26/d41/f5d [3063530,27233] 0 2024-09-13T18:30:40.359 INFO:tasks.workunit.client.0.smithi038.stdout:2/520: creat d2/d5c/dbb/fbe x:0 0 0 2024-09-13T18:30:40.360 INFO:tasks.workunit.client.0.smithi038.stdout:6/611: creat dd/de/d2e/d2f/d4c/d60/fda x:0 0 0 2024-09-13T18:30:40.360 INFO:tasks.workunit.client.0.smithi038.stdout:6/612: chown dd/de/d2e/d2f/d4c/d55/fbd 28 1 2024-09-13T18:30:40.364 INFO:tasks.workunit.client.0.smithi038.stdout:9/552: mknod d0/d7/d2c/d5e/cc8 0 2024-09-13T18:30:40.364 INFO:tasks.workunit.client.0.smithi038.stdout:3/495: dread d0/dd/d17/d50/d5c/f21 [0,4194304] 0 2024-09-13T18:30:40.365 INFO:tasks.workunit.client.0.smithi038.stdout:8/604: creat d1/de/fcd x:0 0 0 2024-09-13T18:30:40.368 INFO:tasks.workunit.client.0.smithi038.stdout:9/553: mkdir d0/d7/d13/d2d/d3c/dc9 0 2024-09-13T18:30:40.369 INFO:tasks.workunit.client.0.smithi038.stdout:8/605: mknod d1/d2a/d40/dbe/cce 0 2024-09-13T18:30:40.370 INFO:tasks.workunit.client.0.smithi038.stdout:9/554: getdents d0/d7/d2c/d33 0 2024-09-13T18:30:40.370 INFO:tasks.workunit.client.0.smithi038.stdout:9/555: stat d0/d7/d2c/d5a/d67/f87 0 2024-09-13T18:30:40.372 INFO:tasks.workunit.client.0.smithi038.stdout:5/523: unlink df/d13/l26 0 2024-09-13T18:30:40.373 INFO:tasks.workunit.client.0.smithi038.stdout:5/524: fsync df/d13/d3b/d41/f6a 0 2024-09-13T18:30:40.373 INFO:tasks.workunit.client.0.smithi038.stdout:5/525: write df/d15/d36/d67/f77 [296485,29862] 0 2024-09-13T18:30:40.375 INFO:tasks.workunit.client.0.smithi038.stdout:9/556: truncate d0/d7/d2c/f49 38766 0 2024-09-13T18:30:40.375 INFO:tasks.workunit.client.0.smithi038.stdout:9/557: chown d0/f8 0 1 2024-09-13T18:30:40.376 INFO:tasks.workunit.client.0.smithi038.stdout:9/558: truncate d0/d7/d2c/d5e/f71 208401 0 2024-09-13T18:30:40.377 INFO:tasks.workunit.client.0.smithi038.stdout:9/559: creat d0/d7/d2c/d33/fca x:0 0 0 2024-09-13T18:30:40.377 INFO:tasks.workunit.client.0.smithi038.stdout:9/560: write d0/d7/d13/d2d/d3e/d70/da2/f79 [4592382,51575] 0 2024-09-13T18:30:40.377 INFO:tasks.workunit.client.0.smithi038.stdout:9/561: fdatasync d0/d7/d2c/d5e/f97 0 2024-09-13T18:30:40.377 INFO:tasks.workunit.client.0.smithi038.stdout:3/496: dread d0/f2 [0,4194304] 0 2024-09-13T18:30:40.379 INFO:tasks.workunit.client.0.smithi038.stdout:9/562: symlink d0/d7/d2c/d5e/lcb 0 2024-09-13T18:30:40.380 INFO:tasks.workunit.client.0.smithi038.stdout:8/606: dread d1/de/d21/d24/f76 [0,4194304] 0 2024-09-13T18:30:40.380 INFO:tasks.workunit.client.0.smithi038.stdout:3/497: symlink d0/dd/d17/d50/d5c/d1d/d30/d95/l98 0 2024-09-13T18:30:40.380 INFO:tasks.workunit.client.0.smithi038.stdout:8/607: truncate d1/de/d21/d45/f81 1581465 0 2024-09-13T18:30:40.380 INFO:tasks.workunit.client.0.smithi038.stdout:3/498: write d0/dd/d17/d43/d89/f66 [235789,76141] 0 2024-09-13T18:30:40.383 INFO:tasks.workunit.client.0.smithi038.stdout:8/608: link d1/de/f5a d1/de/d21/d24/d4d/d50/d62/d71/fcf 0 2024-09-13T18:30:40.383 INFO:tasks.workunit.client.0.smithi038.stdout:8/609: readlink d1/de/d21/l27 0 2024-09-13T18:30:40.384 INFO:tasks.workunit.client.0.smithi038.stdout:3/499: getdents d0/dd/d17/d50/d5c/d1d/d30/d95/d84 0 2024-09-13T18:30:40.387 INFO:tasks.workunit.client.0.smithi038.stdout:3/500: creat d0/dd/d17/d50/d5c/f99 x:0 0 0 2024-09-13T18:30:40.388 INFO:tasks.workunit.client.0.smithi038.stdout:3/501: rmdir d0/dd/d17/d50/d5c/d1d/d30/d95/d84 39 2024-09-13T18:30:40.388 INFO:tasks.workunit.client.0.smithi038.stdout:3/502: fdatasync d0/dd/d17/d43/f45 0 2024-09-13T18:30:40.392 INFO:tasks.workunit.client.0.smithi038.stdout:8/610: dread d1/f7 [0,4194304] 0 2024-09-13T18:30:40.401 INFO:tasks.workunit.client.0.smithi038.stdout:8/611: write d1/de/d21/d24/f7a [2326643,17669] 0 2024-09-13T18:30:40.403 INFO:tasks.workunit.client.0.smithi038.stdout:8/612: dread d1/d8/f1f [4194304,4194304] 0 2024-09-13T18:30:40.403 INFO:tasks.workunit.client.0.smithi038.stdout:8/613: stat d1/de/f33 0 2024-09-13T18:30:40.405 INFO:tasks.workunit.client.0.smithi038.stdout:8/614: getdents d1/de/d21/d45/d5d 0 2024-09-13T18:30:40.405 INFO:tasks.workunit.client.0.smithi038.stdout:8/615: stat d1/d4/f59 0 2024-09-13T18:30:40.405 INFO:tasks.workunit.client.0.smithi038.stdout:4/845: dwrite d2/df/fef [0,4194304] 0 2024-09-13T18:30:40.411 INFO:tasks.workunit.client.0.smithi038.stdout:4/846: dread d2/d49/d50/da0/f1e [0,4194304] 0 2024-09-13T18:30:40.412 INFO:tasks.workunit.client.0.smithi038.stdout:4/847: rename d2/df/d1b/d10/d75/db1/cf4 to d2/d49/d50/c116 0 2024-09-13T18:30:40.412 INFO:tasks.workunit.client.0.smithi038.stdout:4/848: dread - d2/d49/d50/da0/d8/d80/fcd zero size 2024-09-13T18:30:40.416 INFO:tasks.workunit.client.0.smithi038.stdout:6/613: dwrite dd/de/d2e/d2f/d71/f97 [0,4194304] 0 2024-09-13T18:30:40.416 INFO:tasks.workunit.client.0.smithi038.stdout:2/521: dwrite d2/da/f53 [0,4194304] 0 2024-09-13T18:30:40.416 INFO:tasks.workunit.client.0.smithi038.stdout:5/526: dwrite df/d68/f71 [0,4194304] 0 2024-09-13T18:30:40.417 INFO:tasks.workunit.client.0.smithi038.stdout:8/616: dread d1/d4/f47 [0,4194304] 0 2024-09-13T18:30:40.417 INFO:tasks.workunit.client.0.smithi038.stdout:3/503: dwrite d0/dd/f5e [0,4194304] 0 2024-09-13T18:30:40.419 INFO:tasks.workunit.client.0.smithi038.stdout:6/614: creat dd/de/d2e/d2f/d71/dc5/fdb x:0 0 0 2024-09-13T18:30:40.419 INFO:tasks.workunit.client.0.smithi038.stdout:6/615: write dd/de/d31/f74 [1362723,116854] 0 2024-09-13T18:30:40.424 INFO:tasks.workunit.client.0.smithi038.stdout:2/522: unlink d2/l17 0 2024-09-13T18:30:40.425 INFO:tasks.workunit.client.0.smithi038.stdout:5/527: creat df/d13/d49/d9a/fa6 x:0 0 0 2024-09-13T18:30:40.427 INFO:tasks.workunit.client.0.smithi038.stdout:8/617: unlink d1/de/d15/l65 0 2024-09-13T18:30:40.427 INFO:tasks.workunit.client.0.smithi038.stdout:8/618: chown d1/de/d3a/la7 499 1 2024-09-13T18:30:40.428 INFO:tasks.workunit.client.0.smithi038.stdout:3/504: link d0/dd/d17/d50/d5c/d1d/d30/d95/f4d d0/dd/d17/d50/d5c/f9a 0 2024-09-13T18:30:40.428 INFO:tasks.workunit.client.0.smithi038.stdout:4/849: getdents d2/df/d1b/d10/d55/dd5 0 2024-09-13T18:30:40.429 INFO:tasks.workunit.client.0.smithi038.stdout:2/523: symlink d2/da/d98/lbf 0 2024-09-13T18:30:40.433 INFO:tasks.workunit.client.0.smithi038.stdout:6/616: write dd/de/d2e/d2f/d71/f97 [214567,49712] 0 2024-09-13T18:30:40.442 INFO:tasks.workunit.client.0.smithi038.stdout:6/617: write dd/de/d2e/f4b [3687338,42904] 0 2024-09-13T18:30:40.451 INFO:tasks.workunit.client.0.smithi038.stdout:6/618: dread dd/de/d61/d62/f82 [0,4194304] 0 2024-09-13T18:30:40.466 INFO:tasks.workunit.client.0.smithi038.stdout:6/619: dwrite dd/de/d2e/d2f/d71/dc5/fdb [0,4194304] 0 2024-09-13T18:30:40.467 INFO:tasks.workunit.client.0.smithi038.stdout:6/620: write dd/de/d2e/d2f/d4c/d86/fc1 [469630,47362] 0 2024-09-13T18:30:40.467 INFO:tasks.workunit.client.0.smithi038.stdout:6/621: truncate dd/de/d2e/d2f/fb1 5128918 0 2024-09-13T18:30:40.473 INFO:tasks.workunit.client.0.smithi038.stdout:5/528: mkdir df/d13/d3b/d44/d48/d75/da7 0 2024-09-13T18:30:40.475 INFO:tasks.workunit.client.0.smithi038.stdout:8/619: link d1/de/f5a d1/d2a/fd0 0 2024-09-13T18:30:40.475 INFO:tasks.workunit.client.0.smithi038.stdout:6/622: dread dd/f44 [0,4194304] 0 2024-09-13T18:30:40.475 INFO:tasks.workunit.client.0.smithi038.stdout:6/623: chown dd/de/c5f 4926722 1 2024-09-13T18:30:40.476 INFO:tasks.workunit.client.0.smithi038.stdout:3/505: link d0/dd/d17/d43/d89/f85 d0/dd/d17/d50/d5c/d23/d6b/f9b 0 2024-09-13T18:30:40.478 INFO:tasks.workunit.client.0.smithi038.stdout:4/850: rename d2/d49/d50/da0/d8/d3b/cba to d2/d49/c117 0 2024-09-13T18:30:40.478 INFO:tasks.workunit.client.0.smithi038.stdout:4/851: readlink d2/df/d22/d9a/de6/lf7 0 2024-09-13T18:30:40.480 INFO:tasks.workunit.client.0.smithi038.stdout:2/524: unlink d2/d1e/d44/d50/d46/d58/c68 0 2024-09-13T18:30:40.480 INFO:tasks.workunit.client.0.smithi038.stdout:2/525: write d2/d1e/d44/d50/f73 [238571,70783] 0 2024-09-13T18:30:40.481 INFO:tasks.workunit.client.0.smithi038.stdout:3/506: dread d0/dd/d17/d50/d5c/d1d/d30/f74 [0,4194304] 0 2024-09-13T18:30:40.481 INFO:tasks.workunit.client.0.smithi038.stdout:3/507: truncate d0/dd/d17/d50/d5c/d23/d6b/f78 783390 0 2024-09-13T18:30:40.481 INFO:tasks.workunit.client.0.smithi038.stdout:3/508: fsync d0/dd/d17/d50/d5c/d1d/d30/d95/d84/f90 0 2024-09-13T18:30:40.483 INFO:tasks.workunit.client.0.smithi038.stdout:5/529: getdents df/d13/d49/d70 0 2024-09-13T18:30:40.485 INFO:tasks.workunit.client.0.smithi038.stdout:8/620: unlink d1/d8/f19 0 2024-09-13T18:30:40.486 INFO:tasks.workunit.client.0.smithi038.stdout:6/624: mkdir dd/de/d2e/d2f/d4c/d60/ddc 0 2024-09-13T18:30:40.486 INFO:tasks.workunit.client.0.smithi038.stdout:6/625: dread - dd/de/d31/dca/fcd zero size 2024-09-13T18:30:40.487 INFO:tasks.workunit.client.0.smithi038.stdout:2/526: truncate d2/f8 4529210 0 2024-09-13T18:30:40.490 INFO:tasks.workunit.client.0.smithi038.stdout:3/509: mkdir d0/dd/d17/d50/d5c/d23/d7c/d9c 0 2024-09-13T18:30:40.492 INFO:tasks.workunit.client.0.smithi038.stdout:8/621: creat d1/de/d21/d45/d5d/fd1 x:0 0 0 2024-09-13T18:30:40.494 INFO:tasks.workunit.client.0.smithi038.stdout:3/510: rename d0/dd/d17/d50/d5c/d1d/d29 to d0/dd/d17/d50/d5c/d23/d52/d6e/d9d 0 2024-09-13T18:30:40.496 INFO:tasks.workunit.client.0.smithi038.stdout:8/622: unlink d1/de/d21/d24/d4d/f66 0 2024-09-13T18:30:40.496 INFO:tasks.workunit.client.0.smithi038.stdout:5/530: write df/d15/d36/f3a [4931449,4367] 0 2024-09-13T18:30:40.498 INFO:tasks.workunit.client.0.smithi038.stdout:8/623: mknod d1/de/cd2 0 2024-09-13T18:30:40.498 INFO:tasks.workunit.client.0.smithi038.stdout:4/852: dwrite d2/df/d1b/d10/d75/f8f [0,4194304] 0 2024-09-13T18:30:40.509 INFO:tasks.workunit.client.0.smithi038.stdout:4/853: link d2/d49/d50/da0/d8/d80/lda d2/de5/deb/l118 0 2024-09-13T18:30:40.511 INFO:tasks.workunit.client.0.smithi038.stdout:8/624: getdents d1/de/d21/d24/d41/d7d 0 2024-09-13T18:30:40.513 INFO:tasks.workunit.client.0.smithi038.stdout:5/531: read df/d13/d3b/d44/d48/d56/f76 [777545,95196] 0 2024-09-13T18:30:40.514 INFO:tasks.workunit.client.0.smithi038.stdout:4/854: mknod d2/d49/d4b/d8e/c119 0 2024-09-13T18:30:40.514 INFO:tasks.workunit.client.0.smithi038.stdout:8/625: truncate d1/de/d21/f85 5551174 0 2024-09-13T18:30:40.515 INFO:tasks.workunit.client.0.smithi038.stdout:8/626: readlink d1/de/l8a 0 2024-09-13T18:30:40.516 INFO:tasks.workunit.client.0.smithi038.stdout:5/532: symlink df/d13/d3b/d44/d48/d56/la8 0 2024-09-13T18:30:40.517 INFO:tasks.workunit.client.0.smithi038.stdout:4/855: rename d2/d49/d50/da0/dcb/de8/cdb to d2/df/d1b/d10/da3/c11a 0 2024-09-13T18:30:40.517 INFO:tasks.workunit.client.0.smithi038.stdout:8/627: rename d1/de to d1/de/d15/d30/dd3 22 2024-09-13T18:30:40.518 INFO:tasks.workunit.client.0.smithi038.stdout:8/628: chown d1/de/d21/d45/d61 507 1 2024-09-13T18:30:40.520 INFO:tasks.workunit.client.0.smithi038.stdout:8/629: mkdir d1/de/d21/d24/d41/d8c/dd4 0 2024-09-13T18:30:40.520 INFO:tasks.workunit.client.0.smithi038.stdout:2/527: dwrite d2/d1e/d44/fa7 [0,4194304] 0 2024-09-13T18:30:40.522 INFO:tasks.workunit.client.0.smithi038.stdout:6/626: dwrite dd/de/d2e/f6e [0,4194304] 0 2024-09-13T18:30:40.522 INFO:tasks.workunit.client.0.smithi038.stdout:8/630: unlink d1/de/d15/f6f 0 2024-09-13T18:30:40.522 INFO:tasks.workunit.client.0.smithi038.stdout:8/631: creat d1/de/d21/d24/d41/fd5 x:0 0 0 2024-09-13T18:30:40.523 INFO:tasks.workunit.client.0.smithi038.stdout:8/632: chown d1/d2a/d40/dbe 2 1 2024-09-13T18:30:40.523 INFO:tasks.workunit.client.0.smithi038.stdout:3/511: dwrite d0/dd/d17/d43/f45 [0,4194304] 0 2024-09-13T18:30:40.525 INFO:tasks.workunit.client.0.smithi038.stdout:2/528: rename d2/da/fd to d2/fc0 0 2024-09-13T18:30:40.531 INFO:tasks.workunit.client.0.smithi038.stdout:6/627: creat dd/de/d2e/d2f/fdd x:0 0 0 2024-09-13T18:30:40.531 INFO:tasks.workunit.client.0.smithi038.stdout:6/628: truncate dd/de/d2e/f4b 4194628 0 2024-09-13T18:30:40.533 INFO:tasks.workunit.client.0.smithi038.stdout:5/533: dread f1 [0,4194304] 0 2024-09-13T18:30:40.534 INFO:tasks.workunit.client.0.smithi038.stdout:8/633: symlink d1/de/d3a/ld6 0 2024-09-13T18:30:40.534 INFO:tasks.workunit.client.0.smithi038.stdout:8/634: chown d1/de/d15/d30/la2 5148518 1 2024-09-13T18:30:40.535 INFO:tasks.workunit.client.0.smithi038.stdout:8/635: write d1/de/d21/d24/db0/f7c [4908837,14612] 0 2024-09-13T18:30:40.538 INFO:tasks.workunit.client.0.smithi038.stdout:4/856: dwrite d2/f33 [0,4194304] 0 2024-09-13T18:30:40.548 INFO:tasks.workunit.client.0.smithi038.stdout:9/563: dwrite d0/d7/d2c/f49 [0,4194304] 0 2024-09-13T18:30:40.554 INFO:tasks.workunit.client.0.smithi038.stdout:3/512: dwrite d0/dd/d17/d79/f87 [4194304,4194304] 0 2024-09-13T18:30:40.561 INFO:tasks.workunit.client.0.smithi038.stdout:4/857: dwrite d2/df/d1b/d10/d75/f10d [0,4194304] 0 2024-09-13T18:30:40.561 INFO:tasks.workunit.client.0.smithi038.stdout:4/858: chown d2/f33 238555441 1 2024-09-13T18:30:40.568 INFO:tasks.workunit.client.0.smithi038.stdout:3/513: dwrite d0/dd/d17/d43/d89/f66 [0,4194304] 0 2024-09-13T18:30:40.569 INFO:tasks.workunit.client.0.smithi038.stdout:5/534: rename df/d13/d3b/d41/f6a to df/d13/d3b/d44/d48/d75/da7/fa9 0 2024-09-13T18:30:40.569 INFO:tasks.workunit.client.0.smithi038.stdout:5/535: dread - df/d15/d36/d67/f81 zero size 2024-09-13T18:30:40.570 INFO:tasks.workunit.client.0.smithi038.stdout:3/514: write d0/dd/d17/d50/d5c/f21 [1429093,42151] 0 2024-09-13T18:30:40.570 INFO:tasks.workunit.client.0.smithi038.stdout:3/515: chown d0/dd/d17/d50/d5c/d1d/c88 0 1 2024-09-13T18:30:40.571 INFO:tasks.workunit.client.0.smithi038.stdout:8/636: rmdir d1/de/d21/d24/d41/d8c/dd4 0 2024-09-13T18:30:40.578 INFO:tasks.workunit.client.0.smithi038.stdout:4/859: getdents d2/d49/d4b 0 2024-09-13T18:30:40.578 INFO:tasks.workunit.client.0.smithi038.stdout:4/860: chown d2/d49/d50/f77 688843 1 2024-09-13T18:30:40.578 INFO:tasks.workunit.client.0.smithi038.stdout:3/516: dread d0/dd/d17/d79/f7f [0,4194304] 0 2024-09-13T18:30:40.580 INFO:tasks.workunit.client.0.smithi038.stdout:2/529: link d2/d1e/f8a d2/d5c/d66/fc1 0 2024-09-13T18:30:40.582 INFO:tasks.workunit.client.0.smithi038.stdout:6/629: getdents dd/de/d2e/d30 0 2024-09-13T18:30:40.584 INFO:tasks.workunit.client.0.smithi038.stdout:5/536: creat df/d13/d49/d70/faa x:0 0 0 2024-09-13T18:30:40.585 INFO:tasks.workunit.client.0.smithi038.stdout:5/537: write df/d13/d3b/d3e/f5a [966288,3773] 0 2024-09-13T18:30:40.586 INFO:tasks.workunit.client.0.smithi038.stdout:8/637: truncate d1/de/d21/d24/f7a 727339 0 2024-09-13T18:30:40.587 INFO:tasks.workunit.client.0.smithi038.stdout:4/861: mkdir d2/d49/d4b/dc0/d11b 0 2024-09-13T18:30:40.589 INFO:tasks.workunit.client.0.smithi038.stdout:3/517: unlink d0/dd/d17/d43/c4c 0 2024-09-13T18:30:40.589 INFO:tasks.workunit.client.0.smithi038.stdout:4/862: dread d2/d49/d50/f72 [0,4194304] 0 2024-09-13T18:30:40.592 INFO:tasks.workunit.client.0.smithi038.stdout:6/630: creat dd/de/d31/d63/d83/fde x:0 0 0 2024-09-13T18:30:40.594 INFO:tasks.workunit.client.0.smithi038.stdout:8/638: symlink d1/de/d3a/ld7 0 2024-09-13T18:30:40.595 INFO:tasks.workunit.client.0.smithi038.stdout:8/639: dread - d1/d4/fad zero size 2024-09-13T18:30:40.595 INFO:tasks.workunit.client.0.smithi038.stdout:8/640: truncate d1/de/d21/d24/d41/d7d/f9c 785885 0 2024-09-13T18:30:40.595 INFO:tasks.workunit.client.0.smithi038.stdout:8/641: readlink d1/de/d15/d30/l57 0 2024-09-13T18:30:40.595 INFO:tasks.workunit.client.0.smithi038.stdout:3/518: unlink d0/dd/d17/d50/d59/c92 0 2024-09-13T18:30:40.598 INFO:tasks.workunit.client.0.smithi038.stdout:6/631: symlink dd/de/d61/da1/ldf 0 2024-09-13T18:30:40.598 INFO:tasks.workunit.client.0.smithi038.stdout:6/632: stat dd/de/d31/c41 0 2024-09-13T18:30:40.598 INFO:tasks.workunit.client.0.smithi038.stdout:8/642: mknod d1/de/cd8 0 2024-09-13T18:30:40.599 INFO:tasks.workunit.client.0.smithi038.stdout:3/519: symlink d0/dd/d17/d50/d5c/d1d/d30/l9e 0 2024-09-13T18:30:40.601 INFO:tasks.workunit.client.0.smithi038.stdout:6/633: symlink dd/de/d31/le0 0 2024-09-13T18:30:40.601 INFO:tasks.workunit.client.0.smithi038.stdout:6/634: truncate dd/daa/fc8 242260 0 2024-09-13T18:30:40.601 INFO:tasks.workunit.client.0.smithi038.stdout:6/635: read - dd/de/d2e/d2f/d4c/fc9 zero size 2024-09-13T18:30:40.604 INFO:tasks.workunit.client.0.smithi038.stdout:8/643: link d1/de/d21/d24/d41/d80/d8f/dc1/fc2 d1/fd9 0 2024-09-13T18:30:40.605 INFO:tasks.workunit.client.0.smithi038.stdout:4/863: dread d2/df/d1b/f73 [0,4194304] 0 2024-09-13T18:30:40.605 INFO:tasks.workunit.client.0.smithi038.stdout:8/644: mkdir d1/de/d21/d24/d41/d8c/dda 0 2024-09-13T18:30:40.605 INFO:tasks.workunit.client.0.smithi038.stdout:8/645: chown d1/d2a/d3f/dbb 58910310 1 2024-09-13T18:30:40.605 INFO:tasks.workunit.client.0.smithi038.stdout:8/646: truncate d1/fd9 33985 0 2024-09-13T18:30:40.606 INFO:tasks.workunit.client.0.smithi038.stdout:5/538: dwrite df/d13/d3b/d44/d48/f95 [0,4194304] 0 2024-09-13T18:30:40.610 INFO:tasks.workunit.client.0.smithi038.stdout:5/539: symlink df/d13/d85/lab 0 2024-09-13T18:30:40.610 INFO:tasks.workunit.client.0.smithi038.stdout:5/540: readlink df/d15/l40 0 2024-09-13T18:30:40.611 INFO:tasks.workunit.client.0.smithi038.stdout:2/530: write d2/d1e/f4e [3005848,63373] 0 2024-09-13T18:30:40.619 INFO:tasks.workunit.client.0.smithi038.stdout:8/647: write d1/d2a/d40/dbe/fcc [3685710,67625] 0 2024-09-13T18:30:40.619 INFO:tasks.workunit.client.0.smithi038.stdout:8/648: write d1/d4/f3d [5803512,120696] 0 2024-09-13T18:30:40.627 INFO:tasks.workunit.client.0.smithi038.stdout:8/649: link d1/de/d15/d30/l57 d1/de/d21/d24/d41/d7d/ldb 0 2024-09-13T18:30:40.627 INFO:tasks.workunit.client.0.smithi038.stdout:8/650: creat d1/de/d21/d24/d41/fdc x:0 0 0 2024-09-13T18:30:40.628 INFO:tasks.workunit.client.0.smithi038.stdout:2/531: write d2/f37 [4710148,44869] 0 2024-09-13T18:30:40.631 INFO:tasks.workunit.client.0.smithi038.stdout:8/651: symlink d1/de/d3a/ldd 0 2024-09-13T18:30:40.632 INFO:tasks.workunit.client.0.smithi038.stdout:4/864: dwrite d2/d49/d50/fcf [0,4194304] 0 2024-09-13T18:30:40.634 INFO:tasks.workunit.client.0.smithi038.stdout:5/541: dwrite df/d13/d3b/f73 [0,4194304] 0 2024-09-13T18:30:40.637 INFO:tasks.workunit.client.0.smithi038.stdout:4/865: symlink d2/df/dec/l11c 0 2024-09-13T18:30:40.638 INFO:tasks.workunit.client.0.smithi038.stdout:2/532: rmdir d2/d5c/d93 39 2024-09-13T18:30:40.641 INFO:tasks.workunit.client.0.smithi038.stdout:5/542: symlink df/d13/d3b/d44/d48/d75/lac 0 2024-09-13T18:30:40.641 INFO:tasks.workunit.client.0.smithi038.stdout:5/543: fdatasync df/d13/d3b/d44/d48/d9d/fa0 0 2024-09-13T18:30:40.641 INFO:tasks.workunit.client.0.smithi038.stdout:5/544: creat df/d13/d3b/d44/d58/fad x:0 0 0 2024-09-13T18:30:40.642 INFO:tasks.workunit.client.0.smithi038.stdout:5/545: fdatasync df/f10 0 2024-09-13T18:30:40.642 INFO:tasks.workunit.client.0.smithi038.stdout:5/546: dread - df/d13/d49/d70/faa zero size 2024-09-13T18:30:40.642 INFO:tasks.workunit.client.0.smithi038.stdout:8/652: dread d1/d4/f3d [4194304,4194304] 0 2024-09-13T18:30:40.642 INFO:tasks.workunit.client.0.smithi038.stdout:4/866: creat d2/d49/d50/da0/dcb/de8/f11d x:0 0 0 2024-09-13T18:30:40.645 INFO:tasks.workunit.client.0.smithi038.stdout:5/547: rmdir df/d15/d36/da4 0 2024-09-13T18:30:40.647 INFO:tasks.workunit.client.0.smithi038.stdout:8/653: symlink d1/de/d21/d24/d41/d7d/lde 0 2024-09-13T18:30:40.647 INFO:tasks.workunit.client.0.smithi038.stdout:8/654: fdatasync d1/d4/f59 0 2024-09-13T18:30:40.647 INFO:tasks.workunit.client.0.smithi038.stdout:2/533: dread d2/d1e/d44/d50/d46/f5f [0,4194304] 0 2024-09-13T18:30:40.647 INFO:tasks.workunit.client.0.smithi038.stdout:2/534: stat d2/c83 0 2024-09-13T18:30:40.649 INFO:tasks.workunit.client.0.smithi038.stdout:4/867: symlink d2/d49/d50/da0/dcb/l11e 0 2024-09-13T18:30:40.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/655: mknod d1/de/cdf 0 2024-09-13T18:30:40.651 INFO:tasks.workunit.client.0.smithi038.stdout:8/656: write d1/d2a/d40/dbe/fcc [186081,115748] 0 2024-09-13T18:30:40.651 INFO:tasks.workunit.client.0.smithi038.stdout:2/535: truncate d2/da/d74/f88 46729 0 2024-09-13T18:30:40.653 INFO:tasks.workunit.client.0.smithi038.stdout:8/657: truncate d1/d4/f2d 717908 0 2024-09-13T18:30:40.654 INFO:tasks.workunit.client.0.smithi038.stdout:2/536: chown d2/d1e/l7c 2136311877 1 2024-09-13T18:30:40.654 INFO:tasks.workunit.client.0.smithi038.stdout:2/537: rename d2/d1e/d44/d50/d39/d45 to d2/d1e/d44/d50/d39/d45/dc2 22 2024-09-13T18:30:40.654 INFO:tasks.workunit.client.0.smithi038.stdout:2/538: fdatasync d2/d1e/d44/d50/f32 0 2024-09-13T18:30:40.656 INFO:tasks.workunit.client.0.smithi038.stdout:4/868: dread d2/df/f4c [0,4194304] 0 2024-09-13T18:30:40.656 INFO:tasks.workunit.client.0.smithi038.stdout:8/658: symlink d1/de/d21/d24/d56/d89/le0 0 2024-09-13T18:30:40.657 INFO:tasks.workunit.client.0.smithi038.stdout:2/539: rmdir d2/d1e/d87 39 2024-09-13T18:30:40.658 INFO:tasks.workunit.client.0.smithi038.stdout:4/869: creat d2/de5/deb/f11f x:0 0 0 2024-09-13T18:30:40.658 INFO:tasks.workunit.client.0.smithi038.stdout:4/870: chown d2/d49/d4b/dc0/lc5 38 1 2024-09-13T18:30:40.659 INFO:tasks.workunit.client.0.smithi038.stdout:2/540: symlink d2/da/lc3 0 2024-09-13T18:30:40.662 INFO:tasks.workunit.client.0.smithi038.stdout:4/871: mknod d2/df/d1b/d10/d55/dfb/c120 0 2024-09-13T18:30:40.664 INFO:tasks.workunit.client.0.smithi038.stdout:2/541: mknod d2/da/d74/cc4 0 2024-09-13T18:30:40.667 INFO:tasks.workunit.client.0.smithi038.stdout:4/872: symlink d2/d49/d50/da0/d8/d3b/l121 0 2024-09-13T18:30:40.667 INFO:tasks.workunit.client.0.smithi038.stdout:4/873: truncate d2/df/d1b/f8a 2421497 0 2024-09-13T18:30:40.667 INFO:tasks.workunit.client.0.smithi038.stdout:4/874: chown d2/d49/d50/da0/l60 295856582 1 2024-09-13T18:30:40.673 INFO:tasks.workunit.client.0.smithi038.stdout:8/659: dwrite d1/de/f23 [0,4194304] 0 2024-09-13T18:30:40.673 INFO:tasks.workunit.client.0.smithi038.stdout:8/660: chown d1/fc 65120 1 2024-09-13T18:30:40.696 INFO:tasks.workunit.client.0.smithi038.stdout:4/875: dwrite d2/d49/d50/fa8 [0,4194304] 0 2024-09-13T18:30:40.696 INFO:tasks.workunit.client.0.smithi038.stdout:2/542: dwrite d2/f72 [0,4194304] 0 2024-09-13T18:30:40.701 INFO:tasks.workunit.client.0.smithi038.stdout:8/661: dwrite d1/de/d15/d30/f55 [0,4194304] 0 2024-09-13T18:30:40.702 INFO:tasks.workunit.client.0.smithi038.stdout:8/662: creat d1/d8/fe1 x:0 0 0 2024-09-13T18:30:40.702 INFO:tasks.workunit.client.0.smithi038.stdout:8/663: getdents d1/de/d21/d24/d41/d80/dca 0 2024-09-13T18:30:40.702 INFO:tasks.workunit.client.0.smithi038.stdout:8/664: chown d1/de/d21/c46 11404 1 2024-09-13T18:30:40.720 INFO:tasks.workunit.client.0.smithi038.stdout:4/876: dwrite d2/d49/d50/da0/dcb/de8/f11d [0,4194304] 0 2024-09-13T18:30:40.720 INFO:tasks.workunit.client.0.smithi038.stdout:8/665: dwrite d1/de/d21/d24/d41/f42 [0,4194304] 0 2024-09-13T18:30:40.720 INFO:tasks.workunit.client.0.smithi038.stdout:8/666: chown d1/de/d21/d45/l99 9450583 1 2024-09-13T18:30:40.762 INFO:tasks.workunit.client.0.smithi038.stdout:2/543: rename d2/l4 to d2/d5c/d93/d62/lc5 0 2024-09-13T18:30:40.762 INFO:tasks.workunit.client.0.smithi038.stdout:2/544: dread - d2/d1e/d44/d50/d39/fa1 zero size 2024-09-13T18:30:40.768 INFO:tasks.workunit.client.0.smithi038.stdout:8/667: dread d1/ff [0,4194304] 0 2024-09-13T18:30:40.770 INFO:tasks.workunit.client.0.smithi038.stdout:4/877: mknod d2/d49/d50/da0/d8/d3b/d100/c122 0 2024-09-13T18:30:40.770 INFO:tasks.workunit.client.0.smithi038.stdout:4/878: creat d2/f123 x:0 0 0 2024-09-13T18:30:40.779 INFO:tasks.workunit.client.0.smithi038.stdout:4/879: dread d2/d49/d50/f91 [0,4194304] 0 2024-09-13T18:30:40.783 INFO:tasks.workunit.client.0.smithi038.stdout:2/545: truncate d2/d1e/d44/f75 687923 0 2024-09-13T18:30:40.784 INFO:tasks.workunit.client.0.smithi038.stdout:8/668: mknod d1/d4/ce2 0 2024-09-13T18:30:40.788 INFO:tasks.workunit.client.0.smithi038.stdout:2/546: symlink d2/d1e/d44/d50/d39/d45/lc6 0 2024-09-13T18:30:40.789 INFO:tasks.workunit.client.0.smithi038.stdout:8/669: rename d1/de/d15/d30/la2 to d1/d4/le3 0 2024-09-13T18:30:40.791 INFO:tasks.workunit.client.0.smithi038.stdout:2/547: creat d2/d1e/fc7 x:0 0 0 2024-09-13T18:30:40.793 INFO:tasks.workunit.client.0.smithi038.stdout:8/670: link d1/de/d21/d24/d41/d7d/fa8 d1/d2a/d40/dbe/dc4/fe4 0 2024-09-13T18:30:40.793 INFO:tasks.workunit.client.0.smithi038.stdout:2/548: write d2/d1e/d44/d50/d46/f71 [1041155,75465] 0 2024-09-13T18:30:40.794 INFO:tasks.workunit.client.0.smithi038.stdout:4/880: dwrite d2/d49/d50/da0/d8/d3b/f53 [0,4194304] 0 2024-09-13T18:30:40.795 INFO:tasks.workunit.client.0.smithi038.stdout:8/671: link d1/de/d21/d24/d41/d7d/lde d1/de/d21/d24/d41/d80/dca/le5 0 2024-09-13T18:30:40.797 INFO:tasks.workunit.client.0.smithi038.stdout:2/549: rmdir d2/d5c 39 2024-09-13T18:30:40.797 INFO:tasks.workunit.client.0.smithi038.stdout:2/550: write d2/da/f94 [965953,116403] 0 2024-09-13T18:30:40.799 INFO:tasks.workunit.client.0.smithi038.stdout:8/672: rename d1/de/f94 to d1/de/d21/d24/d41/d7d/fe6 0 2024-09-13T18:30:40.800 INFO:tasks.workunit.client.0.smithi038.stdout:4/881: dread d2/d49/d50/f91 [0,4194304] 0 2024-09-13T18:30:40.800 INFO:tasks.workunit.client.0.smithi038.stdout:4/882: readlink d2/df/d22/l9 0 2024-09-13T18:30:40.802 INFO:tasks.workunit.client.0.smithi038.stdout:2/551: rename d2/d5c/d93/d62/lc5 to d2/d1e/d87/lc8 0 2024-09-13T18:30:40.805 INFO:tasks.workunit.client.0.smithi038.stdout:8/673: symlink d1/de/d21/d24/d41/d80/d8f/le7 0 2024-09-13T18:30:40.807 INFO:tasks.workunit.client.0.smithi038.stdout:8/674: creat d1/de/d15/db4/fe8 x:0 0 0 2024-09-13T18:30:40.807 INFO:tasks.workunit.client.0.smithi038.stdout:8/675: write d1/de/d21/d45/d5d/f83 [4252123,59379] 0 2024-09-13T18:30:40.813 INFO:tasks.workunit.client.0.smithi038.stdout:8/676: rmdir d1/de/d21/d45/d5d 39 2024-09-13T18:30:40.813 INFO:tasks.workunit.client.0.smithi038.stdout:4/883: write d2/df/fef [2263706,11808] 0 2024-09-13T18:30:40.813 INFO:tasks.workunit.client.0.smithi038.stdout:4/884: creat d2/df/d1b/d10/f124 x:0 0 0 2024-09-13T18:30:40.814 INFO:tasks.workunit.client.0.smithi038.stdout:4/885: read - d2/d49/d4b/dc0/f10f zero size 2024-09-13T18:30:40.815 INFO:tasks.workunit.client.0.smithi038.stdout:8/677: mkdir d1/d2a/d3f/dbb/de9 0 2024-09-13T18:30:40.818 INFO:tasks.workunit.client.0.smithi038.stdout:0/519: sync 2024-09-13T18:30:40.818 INFO:tasks.workunit.client.0.smithi038.stdout:1/704: sync 2024-09-13T18:30:40.818 INFO:tasks.workunit.client.0.smithi038.stdout:7/525: sync 2024-09-13T18:30:40.818 INFO:tasks.workunit.client.0.smithi038.stdout:1/705: creat d12/d2a/d32/d59/d5b/d47/fde x:0 0 0 2024-09-13T18:30:40.818 INFO:tasks.workunit.client.0.smithi038.stdout:0/520: write d2/d7/d24/d2b/d6d/f6f [4697889,123662] 0 2024-09-13T18:30:40.821 INFO:tasks.workunit.client.0.smithi038.stdout:4/886: rename d2/df/f4c to d2/d49/d4b/d8e/f125 0 2024-09-13T18:30:40.822 INFO:tasks.workunit.client.0.smithi038.stdout:2/552: dwrite d2/da/f36 [0,4194304] 0 2024-09-13T18:30:40.824 INFO:tasks.workunit.client.0.smithi038.stdout:8/678: mknod d1/de/d21/d45/d61/cea 0 2024-09-13T18:30:40.825 INFO:tasks.workunit.client.0.smithi038.stdout:2/553: dread d2/d5c/d93/f5a [0,4194304] 0 2024-09-13T18:30:40.827 INFO:tasks.workunit.client.0.smithi038.stdout:1/706: unlink d12/d2a/l49 0 2024-09-13T18:30:40.828 INFO:tasks.workunit.client.0.smithi038.stdout:0/521: mknod d2/d7/d24/d2b/d95/ca9 0 2024-09-13T18:30:40.830 INFO:tasks.workunit.client.0.smithi038.stdout:4/887: mkdir d2/d49/d126 0 2024-09-13T18:30:40.830 INFO:tasks.workunit.client.0.smithi038.stdout:4/888: truncate d2/d49/d50/da0/d8/d80/fae 571590 0 2024-09-13T18:30:40.830 INFO:tasks.workunit.client.0.smithi038.stdout:4/889: fsync d2/df/d1b/d10/da3/f7e 0 2024-09-13T18:30:40.830 INFO:tasks.workunit.client.0.smithi038.stdout:4/890: chown d2/df/d22 0 1 2024-09-13T18:30:40.831 INFO:tasks.workunit.client.0.smithi038.stdout:4/891: dread d2/df/fa6 [0,4194304] 0 2024-09-13T18:30:40.831 INFO:tasks.workunit.client.0.smithi038.stdout:4/892: dread - d2/df/d1b/ff8 zero size 2024-09-13T18:30:40.832 INFO:tasks.workunit.client.0.smithi038.stdout:4/893: fsync d2/df/d1b/f73 0 2024-09-13T18:30:40.835 INFO:tasks.workunit.client.0.smithi038.stdout:1/707: getdents d12/d3c/db6 0 2024-09-13T18:30:40.836 INFO:tasks.workunit.client.0.smithi038.stdout:1/708: dread - d12/fd6 zero size 2024-09-13T18:30:40.837 INFO:tasks.workunit.client.0.smithi038.stdout:4/894: mkdir d2/de5/deb/d127 0 2024-09-13T18:30:40.838 INFO:tasks.workunit.client.0.smithi038.stdout:8/679: write d1/de/d21/d24/d41/d7d/fe6 [3088394,49146] 0 2024-09-13T18:30:40.840 INFO:tasks.workunit.client.0.smithi038.stdout:1/709: write d12/d2a/d32/d59/d5b/f41 [969244,71879] 0 2024-09-13T18:30:40.840 INFO:tasks.workunit.client.0.smithi038.stdout:1/710: creat d12/d3c/d46/d58/fdf x:0 0 0 2024-09-13T18:30:40.840 INFO:tasks.workunit.client.0.smithi038.stdout:1/711: fdatasync d12/f13 0 2024-09-13T18:30:40.840 INFO:tasks.workunit.client.0.smithi038.stdout:1/712: truncate d12/d2a/d8e/fb3 1139273 0 2024-09-13T18:30:40.840 INFO:tasks.workunit.client.0.smithi038.stdout:0/522: mknod d2/dc/caa 0 2024-09-13T18:30:40.840 INFO:tasks.workunit.client.0.smithi038.stdout:4/895: mkdir d2/d49/d50/da0/d8/d80/d128 0 2024-09-13T18:30:40.841 INFO:tasks.workunit.client.0.smithi038.stdout:7/526: dwrite db/d21/f83 [0,4194304] 0 2024-09-13T18:30:40.847 INFO:tasks.workunit.client.0.smithi038.stdout:1/713: symlink d12/d3c/d46/le0 0 2024-09-13T18:30:40.848 INFO:tasks.workunit.client.0.smithi038.stdout:2/554: dwrite d2/d1e/d87/f89 [0,4194304] 0 2024-09-13T18:30:40.849 INFO:tasks.workunit.client.0.smithi038.stdout:0/523: unlink d2/d7/fb 0 2024-09-13T18:30:40.851 INFO:tasks.workunit.client.0.smithi038.stdout:7/527: mknod db/d21/cbb 0 2024-09-13T18:30:40.852 INFO:tasks.workunit.client.0.smithi038.stdout:1/714: symlink d12/d2a/d32/d59/d5b/d47/d84/le1 0 2024-09-13T18:30:40.852 INFO:tasks.workunit.client.0.smithi038.stdout:1/715: chown d12/d2a/d32/d59/d5b/d47/d84/da7/cca 719 1 2024-09-13T18:30:40.852 INFO:tasks.workunit.client.0.smithi038.stdout:1/716: write d12/d2a/d32/d59/d5b/d47/d84/da7/fb4 [795486,63447] 0 2024-09-13T18:30:40.853 INFO:tasks.workunit.client.0.smithi038.stdout:1/717: write f3 [4761272,18082] 0 2024-09-13T18:30:40.854 INFO:tasks.workunit.client.0.smithi038.stdout:2/555: fdatasync d2/d1e/f9d 0 2024-09-13T18:30:40.854 INFO:tasks.workunit.client.0.smithi038.stdout:2/556: stat d2/da/d16/c1f 0 2024-09-13T18:30:40.854 INFO:tasks.workunit.client.0.smithi038.stdout:2/557: stat d2/d1e/f9d 0 2024-09-13T18:30:40.855 INFO:tasks.workunit.client.0.smithi038.stdout:0/524: mkdir d2/d7/d24/d92/d40/d87/dab 0 2024-09-13T18:30:40.855 INFO:tasks.workunit.client.0.smithi038.stdout:0/525: truncate d2/d7/d24/d92/d40/d97/fa2 1088351 0 2024-09-13T18:30:40.855 INFO:tasks.workunit.client.0.smithi038.stdout:0/526: chown d2/d7/d24/c29 0 1 2024-09-13T18:30:40.858 INFO:tasks.workunit.client.0.smithi038.stdout:1/718: rename d12/d3c/d46/d58/dd8 to d12/d3c/d46/d57/da4/de2 0 2024-09-13T18:30:40.860 INFO:tasks.workunit.client.0.smithi038.stdout:0/527: rmdir d2/d7/d24/d92/d40/d74/da8 0 2024-09-13T18:30:40.861 INFO:tasks.workunit.client.0.smithi038.stdout:0/528: write d2/d7/d55/fa3 [559147,34795] 0 2024-09-13T18:30:40.863 INFO:tasks.workunit.client.0.smithi038.stdout:1/719: symlink d12/d2a/d32/d59/d5b/d47/d84/le3 0 2024-09-13T18:30:40.869 INFO:tasks.workunit.client.0.smithi038.stdout:4/896: dwrite d2/d49/d50/da0/dcb/de8/f11d [0,4194304] 0 2024-09-13T18:30:40.869 INFO:tasks.workunit.client.0.smithi038.stdout:8/680: dwrite d1/d2a/d3f/fb2 [0,4194304] 0 2024-09-13T18:30:40.869 INFO:tasks.workunit.client.0.smithi038.stdout:8/681: write d1/d2a/d40/dbe/dc4/fe4 [580841,12553] 0 2024-09-13T18:30:40.869 INFO:tasks.workunit.client.0.smithi038.stdout:8/682: fdatasync d1/de/d21/d24/d41/fd5 0 2024-09-13T18:30:40.869 INFO:tasks.workunit.client.0.smithi038.stdout:8/683: readlink d1/de/d21/d24/d41/d7d/ldb 0 2024-09-13T18:30:40.871 INFO:tasks.workunit.client.0.smithi038.stdout:4/897: symlink d2/df/d22/d9a/l129 0 2024-09-13T18:30:40.874 INFO:tasks.workunit.client.0.smithi038.stdout:1/720: dread d12/d2a/d8e/fc8 [0,4194304] 0 2024-09-13T18:30:40.874 INFO:tasks.workunit.client.0.smithi038.stdout:1/721: dread - d12/d3c/d46/d58/f79 zero size 2024-09-13T18:30:40.874 INFO:tasks.workunit.client.0.smithi038.stdout:1/722: fdatasync d12/d2a/d32/d59/f7b 0 2024-09-13T18:30:40.874 INFO:tasks.workunit.client.0.smithi038.stdout:1/723: write d12/d3c/d46/d57/da4/fab [913861,33073] 0 2024-09-13T18:30:40.878 INFO:tasks.workunit.client.0.smithi038.stdout:0/529: dwrite d2/d7/d24/d92/d66/d49/f65 [0,4194304] 0 2024-09-13T18:30:40.878 INFO:tasks.workunit.client.0.smithi038.stdout:0/530: fdatasync d2/f5c 0 2024-09-13T18:30:40.878 INFO:tasks.workunit.client.0.smithi038.stdout:0/531: chown d2/dc 5789 1 2024-09-13T18:30:40.879 INFO:tasks.workunit.client.0.smithi038.stdout:8/684: rename d1/fc to d1/de/d15/d30/feb 0 2024-09-13T18:30:40.882 INFO:tasks.workunit.client.0.smithi038.stdout:8/685: mknod d1/d2a/d3f/dbb/de9/cec 0 2024-09-13T18:30:40.882 INFO:tasks.workunit.client.0.smithi038.stdout:8/686: stat d1/de/f5a 0 2024-09-13T18:30:40.882 INFO:tasks.workunit.client.0.smithi038.stdout:8/687: fsync d1/de/d21/d24/f7a 0 2024-09-13T18:30:40.883 INFO:tasks.workunit.client.0.smithi038.stdout:8/688: truncate d1/de/d21/d24/d4d/f9b 4224537 0 2024-09-13T18:30:40.908 INFO:tasks.workunit.client.0.smithi038.stdout:4/898: dwrite d2/d49/d4b/d8e/fbb [0,4194304] 0 2024-09-13T18:30:40.908 INFO:tasks.workunit.client.0.smithi038.stdout:0/532: dwrite d2/d7/d24/d92/d40/f70 [0,4194304] 0 2024-09-13T18:30:40.910 INFO:tasks.workunit.client.0.smithi038.stdout:1/724: dwrite d12/d2a/d8e/fd7 [0,4194304] 0 2024-09-13T18:30:40.910 INFO:tasks.workunit.client.0.smithi038.stdout:0/533: link d2/d7/d24/d92/d40/d97/d98/l8b d2/d7/d24/d92/lac 0 2024-09-13T18:30:40.911 INFO:tasks.workunit.client.0.smithi038.stdout:4/899: unlink d2/d49/d50/cb3 0 2024-09-13T18:30:40.912 INFO:tasks.workunit.client.0.smithi038.stdout:4/900: creat d2/d49/d50/da0/dcb/f12a x:0 0 0 2024-09-13T18:30:40.924 INFO:tasks.workunit.client.0.smithi038.stdout:0/534: symlink d2/d7/d24/d92/da1/lad 0 2024-09-13T18:30:40.925 INFO:tasks.workunit.client.0.smithi038.stdout:0/535: write d2/dc/f50 [4602699,58962] 0 2024-09-13T18:30:40.927 INFO:tasks.workunit.client.0.smithi038.stdout:0/536: creat d2/d7/d24/d3c/fae x:0 0 0 2024-09-13T18:30:40.928 INFO:tasks.workunit.client.0.smithi038.stdout:0/537: symlink d2/d7/d24/d2b/laf 0 2024-09-13T18:30:40.929 INFO:tasks.workunit.client.0.smithi038.stdout:0/538: creat d2/d7/d24/d92/d40/d97/d98/da0/fb0 x:0 0 0 2024-09-13T18:30:40.930 INFO:tasks.workunit.client.0.smithi038.stdout:4/901: dwrite d2/d49/d50/da0/d8/d3b/f9e [0,4194304] 0 2024-09-13T18:30:40.933 INFO:tasks.workunit.client.0.smithi038.stdout:4/902: mknod d2/df/d1b/d10/c12b 0 2024-09-13T18:30:40.937 INFO:tasks.workunit.client.0.smithi038.stdout:0/539: dread d2/d7/d24/d92/d40/f70 [0,4194304] 0 2024-09-13T18:30:40.937 INFO:tasks.workunit.client.0.smithi038.stdout:0/540: readlink d2/d7/d24/d2b/laf 0 2024-09-13T18:30:40.937 INFO:tasks.workunit.client.0.smithi038.stdout:0/541: read d2/f5 [1765186,128249] 0 2024-09-13T18:30:41.019 INFO:tasks.workunit.client.0.smithi038.stdout:0/542: mknod d2/dc/cb1 0 2024-09-13T18:30:41.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/543: mknod d2/d7/cb2 0 2024-09-13T18:30:41.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/544: creat d2/d7/d24/d3c/fb3 x:0 0 0 2024-09-13T18:30:41.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/545: write d2/dc/f39 [2478560,119136] 0 2024-09-13T18:30:41.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/546: chown d2/d7/d24/d92/d40/d97/d98 7 1 2024-09-13T18:30:41.021 INFO:tasks.workunit.client.0.smithi038.stdout:9/564: sync 2024-09-13T18:30:41.022 INFO:tasks.workunit.client.0.smithi038.stdout:4/903: rmdir d2/d49/d50/da0 39 2024-09-13T18:30:41.024 INFO:tasks.workunit.client.0.smithi038.stdout:4/904: link d2/d49/d50/f77 d2/df/d1b/d10/d55/dfb/f12c 0 2024-09-13T18:30:41.024 INFO:tasks.workunit.client.0.smithi038.stdout:4/905: write d2/df/d1b/d10/da3/f97 [87080,85664] 0 2024-09-13T18:30:41.026 INFO:tasks.workunit.client.0.smithi038.stdout:4/906: write d2/f58 [112312,67762] 0 2024-09-13T18:30:41.026 INFO:tasks.workunit.client.0.smithi038.stdout:4/907: chown d2/d49/d4b/dc0/ce0 11225 1 2024-09-13T18:30:41.026 INFO:tasks.workunit.client.0.smithi038.stdout:4/908: stat d2/d49/d50/lcc 0 2024-09-13T18:30:41.027 INFO:tasks.workunit.client.0.smithi038.stdout:4/909: mknod d2/d49/d50/c12d 0 2024-09-13T18:30:41.037 INFO:tasks.workunit.client.0.smithi038.stdout:4/910: dread d2/f33 [0,4194304] 0 2024-09-13T18:30:41.039 INFO:tasks.workunit.client.0.smithi038.stdout:4/911: dread d2/df/d1b/d10/d71/f81 [0,4194304] 0 2024-09-13T18:30:41.039 INFO:tasks.workunit.client.0.smithi038.stdout:4/912: write d2/d49/d50/da0/d8/f2e [2262202,8479] 0 2024-09-13T18:30:41.039 INFO:tasks.workunit.client.0.smithi038.stdout:4/913: chown d2/df/d1b/d10/d55/dd5/cdd 188837821 1 2024-09-13T18:30:41.039 INFO:tasks.workunit.client.0.smithi038.stdout:4/914: chown d2/d49/d50/da0/d8/d80/ddf/cf9 58986728 1 2024-09-13T18:30:41.039 INFO:tasks.workunit.client.0.smithi038.stdout:9/565: dwrite d0/d7/d2c/d5e/f8a [0,4194304] 0 2024-09-13T18:30:41.040 INFO:tasks.workunit.client.0.smithi038.stdout:4/915: link d2/f33 d2/df/d1b/d10/f12e 0 2024-09-13T18:30:41.044 INFO:tasks.workunit.client.0.smithi038.stdout:9/566: symlink d0/d7/d2c/dbf/lcc 0 2024-09-13T18:30:41.046 INFO:tasks.workunit.client.0.smithi038.stdout:4/916: link d2/d49/d50/da0/f8d d2/f12f 0 2024-09-13T18:30:41.051 INFO:tasks.workunit.client.0.smithi038.stdout:4/917: stat d2/d49/d50/da0/d8/d80/ddf/cb7 0 2024-09-13T18:30:41.051 INFO:tasks.workunit.client.0.smithi038.stdout:4/918: fsync d2/d49/d50/fcf 0 2024-09-13T18:30:41.055 INFO:tasks.workunit.client.0.smithi038.stdout:4/919: rename d2/df/dec/l11c to d2/df/d1b/d10/d71/l130 0 2024-09-13T18:30:41.055 INFO:tasks.workunit.client.0.smithi038.stdout:4/920: truncate d2/df/d1b/d10/f124 551559 0 2024-09-13T18:30:41.055 INFO:tasks.workunit.client.0.smithi038.stdout:4/921: write d2/df/d1b/d10/d55/dd5/fd9 [1619826,35907] 0 2024-09-13T18:30:41.056 INFO:tasks.workunit.client.0.smithi038.stdout:4/922: truncate d2/d49/d50/f91 3525043 0 2024-09-13T18:30:41.064 INFO:tasks.workunit.client.0.smithi038.stdout:9/567: dwrite d0/d7/d13/f85 [0,4194304] 0 2024-09-13T18:30:41.068 INFO:tasks.workunit.client.0.smithi038.stdout:4/923: dread d2/d49/d50/da0/d8/d3b/f53 [0,4194304] 0 2024-09-13T18:30:41.070 INFO:tasks.workunit.client.0.smithi038.stdout:4/924: mknod d2/de5/c131 0 2024-09-13T18:30:41.072 INFO:tasks.workunit.client.0.smithi038.stdout:4/925: creat d2/df/d22/d9a/f132 x:0 0 0 2024-09-13T18:30:41.074 INFO:tasks.workunit.client.0.smithi038.stdout:4/926: mkdir d2/df/d1b/d10/d55/d133 0 2024-09-13T18:30:41.078 INFO:tasks.workunit.client.0.smithi038.stdout:4/927: getdents d2/d49/d50/da0 0 2024-09-13T18:30:41.079 INFO:tasks.workunit.client.0.smithi038.stdout:4/928: getdents d2/df/dec 0 2024-09-13T18:30:41.080 INFO:tasks.workunit.client.0.smithi038.stdout:4/929: write d2/df/d1b/d10/da3/fd8 [1258985,1417] 0 2024-09-13T18:30:41.085 INFO:tasks.workunit.client.0.smithi038.stdout:9/568: dwrite d0/d7/d13/fba [0,4194304] 0 2024-09-13T18:30:41.086 INFO:tasks.workunit.client.0.smithi038.stdout:9/569: link d0/d7/d13/d2d/d3e/d70/c91 d0/d7/d2c/d6d/d9c/ccd 0 2024-09-13T18:30:41.108 INFO:tasks.workunit.client.0.smithi038.stdout:9/570: dread d0/f6 [0,4194304] 0 2024-09-13T18:30:41.109 INFO:tasks.workunit.client.0.smithi038.stdout:4/930: dwrite d2/df/d1b/d10/f25 [0,4194304] 0 2024-09-13T18:30:41.110 INFO:tasks.workunit.client.0.smithi038.stdout:9/571: getdents d0/d7/d2c/d5e/dc5 0 2024-09-13T18:30:41.117 INFO:tasks.workunit.client.0.smithi038.stdout:4/931: mknod d2/df/d1b/d10/d55/c134 0 2024-09-13T18:30:41.119 INFO:tasks.workunit.client.0.smithi038.stdout:4/932: link d2/caa d2/df/d1b/d10/d55/dd5/c135 0 2024-09-13T18:30:41.121 INFO:tasks.workunit.client.0.smithi038.stdout:4/933: creat d2/d49/d50/da0/d8/d80/d128/f136 x:0 0 0 2024-09-13T18:30:41.121 INFO:tasks.workunit.client.0.smithi038.stdout:4/934: read d2/df/d1b/d10/da3/f10b [4101269,73244] 0 2024-09-13T18:30:41.129 INFO:tasks.workunit.client.0.smithi038.stdout:4/935: dread d2/d49/d50/da0/d8/f27 [4194304,4194304] 0 2024-09-13T18:30:41.150 INFO:tasks.workunit.client.0.smithi038.stdout:4/936: dwrite d2/d49/d50/da0/d8/d80/ddf/f83 [0,4194304] 0 2024-09-13T18:30:41.152 INFO:tasks.workunit.client.0.smithi038.stdout:4/937: mkdir d2/d49/d50/da0/d8/d137 0 2024-09-13T18:30:41.152 INFO:tasks.workunit.client.0.smithi038.stdout:4/938: chown d2/cb8 0 1 2024-09-13T18:30:41.252 INFO:tasks.workunit.client.0.smithi038.stdout:3/520: sync 2024-09-13T18:30:41.255 INFO:tasks.workunit.client.0.smithi038.stdout:3/521: dread d0/dd/d17/f1c [0,4194304] 0 2024-09-13T18:30:41.267 INFO:tasks.workunit.client.0.smithi038.stdout:3/522: read d0/dd/d17/d50/d5c/d23/f2c [4560245,63876] 0 2024-09-13T18:30:41.269 INFO:tasks.workunit.client.0.smithi038.stdout:3/523: creat d0/dd/d17/d50/d5c/d23/d52/d6e/f9f x:0 0 0 2024-09-13T18:30:41.270 INFO:tasks.workunit.client.0.smithi038.stdout:3/524: readlink d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/l8f 0 2024-09-13T18:30:41.270 INFO:tasks.workunit.client.0.smithi038.stdout:3/525: write d0/dd/d17/d50/d5c/d1d/d30/d95/d84/f90 [4219666,35495] 0 2024-09-13T18:30:41.289 INFO:tasks.workunit.client.0.smithi038.stdout:3/526: dwrite d0/dd/d17/d50/d59/f6f [0,4194304] 0 2024-09-13T18:30:41.289 INFO:tasks.workunit.client.0.smithi038.stdout:3/527: dread - d0/dd/d17/d50/d5c/d1d/d30/d95/f8e zero size 2024-09-13T18:30:41.292 INFO:tasks.workunit.client.0.smithi038.stdout:3/528: mknod d0/dd/d17/d50/d5c/d1d/ca0 0 2024-09-13T18:30:41.320 INFO:tasks.workunit.client.0.smithi038.stdout:3/529: dwrite d0/dd/f2a [0,4194304] 0 2024-09-13T18:30:41.335 INFO:tasks.workunit.client.0.smithi038.stdout:3/530: dwrite d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/f7b [0,4194304] 0 2024-09-13T18:30:41.340 INFO:tasks.workunit.client.0.smithi038.stdout:3/531: truncate d0/dd/d17/d50/d5c/f21 79489 0 2024-09-13T18:30:41.342 INFO:tasks.workunit.client.0.smithi038.stdout:3/532: mknod d0/dd/d17/d50/d5c/d23/d7c/d9c/ca1 0 2024-09-13T18:30:41.344 INFO:tasks.workunit.client.0.smithi038.stdout:3/533: symlink d0/dd/la2 0 2024-09-13T18:30:41.344 INFO:tasks.workunit.client.0.smithi038.stdout:3/534: rename d0/dd/d17/d50 to d0/dd/d17/d50/d5c/d23/d52/d6e/da3 22 2024-09-13T18:30:41.344 INFO:tasks.workunit.client.0.smithi038.stdout:3/535: chown d0/dd/d17/d50/l83 0 1 2024-09-13T18:30:41.344 INFO:tasks.workunit.client.0.smithi038.stdout:3/536: fdatasync d0/dd/d17/d50/d5c/d1d/d30/d95/f4d 0 2024-09-13T18:30:41.346 INFO:tasks.workunit.client.0.smithi038.stdout:3/537: rmdir d0/dd/d17/d50/d5c/d1d 39 2024-09-13T18:30:41.346 INFO:tasks.workunit.client.0.smithi038.stdout:6/636: sync 2024-09-13T18:30:41.346 INFO:tasks.workunit.client.0.smithi038.stdout:5/548: sync 2024-09-13T18:30:41.346 INFO:tasks.workunit.client.0.smithi038.stdout:5/549: write df/d13/f4f [440120,87802] 0 2024-09-13T18:30:41.346 INFO:tasks.workunit.client.0.smithi038.stdout:5/550: getdents df/d13/d3b/d44/d58/d9c 0 2024-09-13T18:30:41.347 INFO:tasks.workunit.client.0.smithi038.stdout:5/551: dread df/d15/d36/f3c [0,4194304] 0 2024-09-13T18:30:41.349 INFO:tasks.workunit.client.0.smithi038.stdout:3/538: creat d0/dd/d17/d50/d5c/d23/d52/fa4 x:0 0 0 2024-09-13T18:30:41.349 INFO:tasks.workunit.client.0.smithi038.stdout:3/539: chown d0/dd/c25 72450694 1 2024-09-13T18:30:41.349 INFO:tasks.workunit.client.0.smithi038.stdout:3/540: readlink d0/dd/d17/d50/d5c/d1d/d30/l9e 0 2024-09-13T18:30:41.354 INFO:tasks.workunit.client.0.smithi038.stdout:6/637: link dd/de/d2e/fc3 dd/de/d2e/d2f/d71/fe1 0 2024-09-13T18:30:41.355 INFO:tasks.workunit.client.0.smithi038.stdout:3/541: rename d0/dd/d17/d50/d5c/d1d/d30/d95/l3c to d0/dd/d17/d50/d5c/d23/d6b/la5 0 2024-09-13T18:30:41.365 INFO:tasks.workunit.client.0.smithi038.stdout:3/542: dread d0/dd/d17/d50/d5c/f9a [0,4194304] 0 2024-09-13T18:30:41.366 INFO:tasks.workunit.client.0.smithi038.stdout:6/638: dread dd/de/d2e/d2f/da6/fa8 [0,4194304] 0 2024-09-13T18:30:41.380 INFO:tasks.workunit.client.0.smithi038.stdout:5/552: dwrite df/d13/d3b/d44/d48/d75/f99 [0,4194304] 0 2024-09-13T18:30:41.385 INFO:tasks.workunit.client.0.smithi038.stdout:3/543: write d0/dd/d17/d50/d59/f6f [768537,14014] 0 2024-09-13T18:30:41.385 INFO:tasks.workunit.client.0.smithi038.stdout:3/544: read d0/dd/d17/d79/f7f [665454,102233] 0 2024-09-13T18:30:41.385 INFO:tasks.workunit.client.0.smithi038.stdout:3/545: write d0/dd/d17/f60 [306070,62003] 0 2024-09-13T18:30:41.386 INFO:tasks.workunit.client.0.smithi038.stdout:5/553: unlink df/d13/d3b/d3e/f5a 0 2024-09-13T18:30:41.386 INFO:tasks.workunit.client.0.smithi038.stdout:5/554: truncate df/d13/d3b/d44/d58/fad 382402 0 2024-09-13T18:30:41.386 INFO:tasks.workunit.client.0.smithi038.stdout:5/555: creat df/d13/d3b/d44/d48/fae x:0 0 0 2024-09-13T18:30:41.387 INFO:tasks.workunit.client.0.smithi038.stdout:3/546: mkdir d0/dd/d17/d50/d5c/d1d/d30/d95/da6 0 2024-09-13T18:30:41.390 INFO:tasks.workunit.client.0.smithi038.stdout:5/556: mknod df/d13/caf 0 2024-09-13T18:30:41.390 INFO:tasks.workunit.client.0.smithi038.stdout:5/557: write df/d13/d3b/d44/d48/d56/f5f [2514884,51167] 0 2024-09-13T18:30:41.390 INFO:tasks.workunit.client.0.smithi038.stdout:5/558: write df/f1e [13387982,46869] 0 2024-09-13T18:30:41.390 INFO:tasks.workunit.client.0.smithi038.stdout:3/547: symlink d0/dd/d17/d50/d5c/la7 0 2024-09-13T18:30:41.391 INFO:tasks.workunit.client.0.smithi038.stdout:5/559: rmdir df/d15/d50 39 2024-09-13T18:30:41.391 INFO:tasks.workunit.client.0.smithi038.stdout:5/560: dread - df/f1b zero size 2024-09-13T18:30:41.391 INFO:tasks.workunit.client.0.smithi038.stdout:6/639: dwrite dd/de/d31/f74 [0,4194304] 0 2024-09-13T18:30:41.392 INFO:tasks.workunit.client.0.smithi038.stdout:5/561: rmdir df/d15/d50 39 2024-09-13T18:30:41.394 INFO:tasks.workunit.client.0.smithi038.stdout:5/562: symlink df/d68/lb0 0 2024-09-13T18:30:41.403 INFO:tasks.workunit.client.0.smithi038.stdout:3/548: dread d0/dd/f2a [0,4194304] 0 2024-09-13T18:30:41.407 INFO:tasks.workunit.client.0.smithi038.stdout:6/640: rmdir dd/de 39 2024-09-13T18:30:41.409 INFO:tasks.workunit.client.0.smithi038.stdout:5/563: creat df/d13/d3b/d44/d48/d75/da7/fb1 x:0 0 0 2024-09-13T18:30:41.420 INFO:tasks.workunit.client.0.smithi038.stdout:5/564: truncate df/d68/f71 886725 0 2024-09-13T18:30:41.425 INFO:tasks.workunit.client.0.smithi038.stdout:3/549: dwrite d0/dd/d17/f70 [0,4194304] 0 2024-09-13T18:30:41.425 INFO:tasks.workunit.client.0.smithi038.stdout:3/550: dread - d0/dd/d17/d50/d5c/d1d/d30/d95/f6a zero size 2024-09-13T18:30:41.425 INFO:tasks.workunit.client.0.smithi038.stdout:6/641: dwrite dd/de/f1a [0,4194304] 0 2024-09-13T18:30:41.426 INFO:tasks.workunit.client.0.smithi038.stdout:6/642: chown dd/de/d2e/c3a 275552524 1 2024-09-13T18:30:41.427 INFO:tasks.workunit.client.0.smithi038.stdout:3/551: creat d0/dd/d17/d43/fa8 x:0 0 0 2024-09-13T18:30:41.429 INFO:tasks.workunit.client.0.smithi038.stdout:3/552: dread d0/dd/d17/f1c [0,4194304] 0 2024-09-13T18:30:41.429 INFO:tasks.workunit.client.0.smithi038.stdout:3/553: chown d0/dd/d17/d50/d5c/d23/d52/fa4 3570 1 2024-09-13T18:30:41.429 INFO:tasks.workunit.client.0.smithi038.stdout:3/554: readlink d0/dd/l41 0 2024-09-13T18:30:41.432 INFO:tasks.workunit.client.0.smithi038.stdout:3/555: mkdir d0/dd/d17/d50/d5c/d23/d52/da9 0 2024-09-13T18:30:41.433 INFO:tasks.workunit.client.0.smithi038.stdout:3/556: rename d0 to d0/daa 22 2024-09-13T18:30:41.434 INFO:tasks.workunit.client.0.smithi038.stdout:3/557: creat d0/dd/d17/d50/d5c/d23/d93/fab x:0 0 0 2024-09-13T18:30:41.435 INFO:tasks.workunit.client.0.smithi038.stdout:6/643: dread dd/de/d2e/d30/d27/f43 [0,4194304] 0 2024-09-13T18:30:41.437 INFO:tasks.workunit.client.0.smithi038.stdout:3/558: symlink d0/dd/d17/d50/d5c/d1d/d30/d95/lac 0 2024-09-13T18:30:41.437 INFO:tasks.workunit.client.0.smithi038.stdout:5/565: dwrite df/d13/d3b/d44/d48/d56/f76 [0,4194304] 0 2024-09-13T18:30:41.438 INFO:tasks.workunit.client.0.smithi038.stdout:6/644: symlink dd/de/d2e/d9b/dbf/le2 0 2024-09-13T18:30:41.439 INFO:tasks.workunit.client.0.smithi038.stdout:3/559: creat d0/dd/d17/d50/d5c/d23/d6b/fad x:0 0 0 2024-09-13T18:30:41.439 INFO:tasks.workunit.client.0.smithi038.stdout:3/560: fsync d0/dd/fe 0 2024-09-13T18:30:41.439 INFO:tasks.workunit.client.0.smithi038.stdout:3/561: stat d0/dd/d17/d50/d5c/la7 0 2024-09-13T18:30:41.444 INFO:tasks.workunit.client.0.smithi038.stdout:5/566: symlink df/d15/d36/d67/lb2 0 2024-09-13T18:30:41.444 INFO:tasks.workunit.client.0.smithi038.stdout:5/567: readlink df/d15/d36/d67/lb2 0 2024-09-13T18:30:41.444 INFO:tasks.workunit.client.0.smithi038.stdout:5/568: read df/d13/d3b/f4a [2393271,67040] 0 2024-09-13T18:30:41.445 INFO:tasks.workunit.client.0.smithi038.stdout:6/645: rmdir dd/de/d61/d62 39 2024-09-13T18:30:41.446 INFO:tasks.workunit.client.0.smithi038.stdout:3/562: mknod d0/dd/d17/d50/d5c/d23/d52/cae 0 2024-09-13T18:30:41.448 INFO:tasks.workunit.client.0.smithi038.stdout:5/569: getdents df/d13/d3b/d44/d48/d75/da7 0 2024-09-13T18:30:41.449 INFO:tasks.workunit.client.0.smithi038.stdout:5/570: symlink df/d13/d85/lb3 0 2024-09-13T18:30:41.457 INFO:tasks.workunit.client.0.smithi038.stdout:6/646: write dd/de/d2e/f6e [2129029,28517] 0 2024-09-13T18:30:41.458 INFO:tasks.workunit.client.0.smithi038.stdout:6/647: stat dd/de/d2e/d2f/d71/f97 0 2024-09-13T18:30:41.461 INFO:tasks.workunit.client.0.smithi038.stdout:3/563: write d0/dd/d17/d50/d5c/d1d/d30/d95/d84/f90 [850846,83269] 0 2024-09-13T18:30:41.461 INFO:tasks.workunit.client.0.smithi038.stdout:3/564: chown d0/dd/d17/d43/d89/f5f 112833 1 2024-09-13T18:30:41.462 INFO:tasks.workunit.client.0.smithi038.stdout:5/571: dread df/d13/d3b/d41/f7f [0,4194304] 0 2024-09-13T18:30:41.462 INFO:tasks.workunit.client.0.smithi038.stdout:5/572: chown df/d13/d3b/d3e/c38 105 1 2024-09-13T18:30:41.462 INFO:tasks.workunit.client.0.smithi038.stdout:5/573: chown df/d13/d3b 14979785 1 2024-09-13T18:30:41.466 INFO:tasks.workunit.client.0.smithi038.stdout:6/648: rename dd/de/d2e/d99/fb2 to dd/de/d61/da1/fe3 0 2024-09-13T18:30:41.466 INFO:tasks.workunit.client.0.smithi038.stdout:6/649: chown dd/de/d31/d63/d83/da5/fc7 1534541 1 2024-09-13T18:30:41.466 INFO:tasks.workunit.client.0.smithi038.stdout:6/650: dread - dd/de/d61/da1/fe3 zero size 2024-09-13T18:30:41.466 INFO:tasks.workunit.client.0.smithi038.stdout:6/651: write dd/de/d61/d62/f82 [4562617,126840] 0 2024-09-13T18:30:41.467 INFO:tasks.workunit.client.0.smithi038.stdout:5/574: unlink df/d13/d3b/d44/d48/d56/la8 0 2024-09-13T18:30:41.469 INFO:tasks.workunit.client.0.smithi038.stdout:6/652: mkdir dd/de/d2e/d2f/d4c/d60/ddc/de4 0 2024-09-13T18:30:41.471 INFO:tasks.workunit.client.0.smithi038.stdout:5/575: rename df/d13/d3b/d44/d48/d56/c69 to df/d13/d85/cb4 0 2024-09-13T18:30:41.493 INFO:tasks.workunit.client.0.smithi038.stdout:5/576: dwrite fb [0,4194304] 0 2024-09-13T18:30:41.493 INFO:tasks.workunit.client.0.smithi038.stdout:5/577: readlink df/d13/d3b/d44/d52/l53 0 2024-09-13T18:30:41.493 INFO:tasks.workunit.client.0.smithi038.stdout:5/578: chown df/d13/d3b/d44/d48/d75 3 1 2024-09-13T18:30:41.493 INFO:tasks.workunit.client.0.smithi038.stdout:5/579: truncate df/d68/f71 1024227 0 2024-09-13T18:30:41.494 INFO:tasks.workunit.client.0.smithi038.stdout:3/565: dwrite d0/dd/d17/d50/d5c/d1d/d30/f74 [0,4194304] 0 2024-09-13T18:30:41.494 INFO:tasks.workunit.client.0.smithi038.stdout:3/566: fdatasync d0/dd/d17/f60 0 2024-09-13T18:30:41.494 INFO:tasks.workunit.client.0.smithi038.stdout:5/580: creat df/d13/d3b/d44/fb5 x:0 0 0 2024-09-13T18:30:41.499 INFO:tasks.workunit.client.0.smithi038.stdout:3/567: creat d0/dd/d17/faf x:0 0 0 2024-09-13T18:30:41.501 INFO:tasks.workunit.client.0.smithi038.stdout:3/568: rename d0/dd/d17/d43/d89/f66 to d0/dd/d17/d50/d59/fb0 0 2024-09-13T18:30:41.504 INFO:tasks.workunit.client.0.smithi038.stdout:8/689: sync 2024-09-13T18:30:41.504 INFO:tasks.workunit.client.0.smithi038.stdout:2/558: sync 2024-09-13T18:30:41.505 INFO:tasks.workunit.client.0.smithi038.stdout:7/528: sync 2024-09-13T18:30:41.505 INFO:tasks.workunit.client.0.smithi038.stdout:8/690: chown d1/de/d21/d24/d4d/d50 1 1 2024-09-13T18:30:41.505 INFO:tasks.workunit.client.0.smithi038.stdout:7/529: chown db/d12/d1c/d3a/d26/d41/dad/fb2 7277148 1 2024-09-13T18:30:41.505 INFO:tasks.workunit.client.0.smithi038.stdout:2/559: dread - d2/da/d74/fab zero size 2024-09-13T18:30:41.506 INFO:tasks.workunit.client.0.smithi038.stdout:8/691: getdents d1/d2a/d40 0 2024-09-13T18:30:41.507 INFO:tasks.workunit.client.0.smithi038.stdout:2/560: rename d2/d1e/d44/d50/d39/d52/da0 to d2/da/d98/dc9 0 2024-09-13T18:30:41.508 INFO:tasks.workunit.client.0.smithi038.stdout:8/692: truncate d1/de/d21/f52 2719864 0 2024-09-13T18:30:41.523 INFO:tasks.workunit.client.0.smithi038.stdout:8/693: read d1/d4/f47 [2795875,61874] 0 2024-09-13T18:30:41.523 INFO:tasks.workunit.client.0.smithi038.stdout:5/581: dwrite df/d13/f4f [0,4194304] 0 2024-09-13T18:30:41.527 INFO:tasks.workunit.client.0.smithi038.stdout:8/694: link d1/de/d21/d24/d41/d7d/fa8 d1/de/d21/d24/d41/d80/dca/fed 0 2024-09-13T18:30:41.527 INFO:tasks.workunit.client.0.smithi038.stdout:8/695: readlink d1/de/d21/d24/d56/d89/le0 0 2024-09-13T18:30:41.527 INFO:tasks.workunit.client.0.smithi038.stdout:8/696: fsync d1/de/fcd 0 2024-09-13T18:30:41.527 INFO:tasks.workunit.client.0.smithi038.stdout:8/697: truncate d1/de/f33 1404221 0 2024-09-13T18:30:41.531 INFO:tasks.workunit.client.0.smithi038.stdout:5/582: mkdir df/d13/d3b/d44/d52/db6 0 2024-09-13T18:30:41.532 INFO:tasks.workunit.client.0.smithi038.stdout:8/698: mkdir d1/de/d21/d24/d4d/dee 0 2024-09-13T18:30:41.533 INFO:tasks.workunit.client.0.smithi038.stdout:3/569: dwrite d0/dd/d17/d43/f5d [0,4194304] 0 2024-09-13T18:30:41.533 INFO:tasks.workunit.client.0.smithi038.stdout:2/561: dwrite d2/da/f1d [0,4194304] 0 2024-09-13T18:30:41.534 INFO:tasks.workunit.client.0.smithi038.stdout:5/583: link df/d13/d3b/d3e/f33 df/d68/fb7 0 2024-09-13T18:30:41.534 INFO:tasks.workunit.client.0.smithi038.stdout:5/584: fdatasync df/d15/d36/f86 0 2024-09-13T18:30:41.536 INFO:tasks.workunit.client.0.smithi038.stdout:8/699: creat d1/de/d21/d24/d41/db7/fef x:0 0 0 2024-09-13T18:30:41.537 INFO:tasks.workunit.client.0.smithi038.stdout:2/562: dread d2/d1e/d44/d50/d46/f71 [0,4194304] 0 2024-09-13T18:30:41.541 INFO:tasks.workunit.client.0.smithi038.stdout:8/700: truncate d1/d4/f59 4163372 0 2024-09-13T18:30:41.543 INFO:tasks.workunit.client.0.smithi038.stdout:2/563: mknod d2/d1e/d44/d50/cca 0 2024-09-13T18:30:41.545 INFO:tasks.workunit.client.0.smithi038.stdout:3/570: write d0/dd/d17/d50/d5c/f47 [4155818,100830] 0 2024-09-13T18:30:41.547 INFO:tasks.workunit.client.0.smithi038.stdout:8/701: mkdir d1/d2a/d40/dbe/dc6/df0 0 2024-09-13T18:30:41.549 INFO:tasks.workunit.client.0.smithi038.stdout:2/564: mkdir d2/d1e/d44/d50/d39/d52/d8b/dcb 0 2024-09-13T18:30:41.549 INFO:tasks.workunit.client.0.smithi038.stdout:5/585: dwrite df/d13/d3b/d44/f46 [0,4194304] 0 2024-09-13T18:30:41.552 INFO:tasks.workunit.client.0.smithi038.stdout:8/702: mkdir d1/de/d21/d24/d41/d8c/dda/df1 0 2024-09-13T18:30:41.552 INFO:tasks.workunit.client.0.smithi038.stdout:8/703: chown d1/de/d21/d24/d41/db7 10 1 2024-09-13T18:30:41.554 INFO:tasks.workunit.client.0.smithi038.stdout:5/586: mknod df/d13/d3b/d44/d58/cb8 0 2024-09-13T18:30:41.556 INFO:tasks.workunit.client.0.smithi038.stdout:2/565: rename d2/c83 to d2/d1e/ccc 0 2024-09-13T18:30:41.560 INFO:tasks.workunit.client.0.smithi038.stdout:2/566: symlink d2/da/d16/lcd 0 2024-09-13T18:30:41.560 INFO:tasks.workunit.client.0.smithi038.stdout:2/567: dread - d2/d1e/d44/d50/d39/fa1 zero size 2024-09-13T18:30:41.562 INFO:tasks.workunit.client.0.smithi038.stdout:8/704: dread d1/d4/f3d [0,4194304] 0 2024-09-13T18:30:41.565 INFO:tasks.workunit.client.0.smithi038.stdout:2/568: creat d2/d1e/d44/d50/d39/d45/fce x:0 0 0 2024-09-13T18:30:41.565 INFO:tasks.workunit.client.0.smithi038.stdout:2/569: chown d2/da/d16/lcd 156123 1 2024-09-13T18:30:41.568 INFO:tasks.workunit.client.0.smithi038.stdout:5/587: dwrite df/d13/d3b/d44/d48/d56/f76 [0,4194304] 0 2024-09-13T18:30:41.569 INFO:tasks.workunit.client.0.smithi038.stdout:5/588: truncate df/d13/d3b/d44/d48/d54/f90 1869908 0 2024-09-13T18:30:41.569 INFO:tasks.workunit.client.0.smithi038.stdout:5/589: truncate df/d68/f71 1519917 0 2024-09-13T18:30:41.569 INFO:tasks.workunit.client.0.smithi038.stdout:5/590: chown df/d13/d3b/d44/d52/c83 2534951 1 2024-09-13T18:30:41.571 INFO:tasks.workunit.client.0.smithi038.stdout:5/591: creat df/d13/d3b/d44/d58/d9c/fb9 x:0 0 0 2024-09-13T18:30:41.571 INFO:tasks.workunit.client.0.smithi038.stdout:5/592: chown df/d13/d3b/d44/d48/d75/da7 1281494939 1 2024-09-13T18:30:41.571 INFO:tasks.workunit.client.0.smithi038.stdout:5/593: chown df/d13/d3b/d44/d48/d75/f99 17275636 1 2024-09-13T18:30:41.572 INFO:tasks.workunit.client.0.smithi038.stdout:5/594: unlink df/d15/d50/l59 0 2024-09-13T18:30:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:41 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:41 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:41 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:30:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:41 smithi038 ceph-mon[27689]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:30:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:41 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:30:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:41 smithi038 ceph-mon[27689]: Upgrade: Need to upgrade myself (mgr.smithi149.eabzne) 2024-09-13T18:30:41.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:41 smithi038 ceph-mon[27689]: Upgrade: Need to upgrade myself (mgr.smithi149.eabzne) 2024-09-13T18:30:41.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:41 smithi038 ceph-mon[27689]: pgmap v23: 65 pgs: 65 active+clean; 3.0 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 189 MiB/s rd, 236 MiB/s wr, 366 op/s 2024-09-13T18:30:41.586 INFO:tasks.workunit.client.0.smithi038.stdout:8/705: dwrite d1/de/d15/d30/f55 [0,4194304] 0 2024-09-13T18:30:41.591 INFO:tasks.workunit.client.0.smithi038.stdout:5/595: dwrite df/d13/d3b/d44/d48/d75/da7/fb1 [0,4194304] 0 2024-09-13T18:30:41.596 INFO:tasks.workunit.client.0.smithi038.stdout:5/596: write df/d68/f71 [103808,111541] 0 2024-09-13T18:30:41.615 INFO:tasks.workunit.client.0.smithi038.stdout:5/597: dwrite df/f2a [0,4194304] 0 2024-09-13T18:30:41.615 INFO:tasks.workunit.client.0.smithi038.stdout:8/706: dwrite d1/de/d15/d30/f55 [0,4194304] 0 2024-09-13T18:30:41.617 INFO:tasks.workunit.client.0.smithi038.stdout:5/598: getdents df/d13/d3b/d44/d82 0 2024-09-13T18:30:41.621 INFO:tasks.workunit.client.0.smithi038.stdout:5/599: rename df/d13/d3b/d44/d48/d75/da7/fa9 to df/d68/fba 0 2024-09-13T18:30:41.623 INFO:tasks.workunit.client.0.smithi038.stdout:5/600: creat df/d13/d85/fbb x:0 0 0 2024-09-13T18:30:41.628 INFO:tasks.workunit.client.0.smithi038.stdout:5/601: rmdir df/d15/d36/d67 39 2024-09-13T18:30:41.628 INFO:tasks.workunit.client.0.smithi038.stdout:5/602: write f3 [1674459,41557] 0 2024-09-13T18:30:41.630 INFO:tasks.workunit.client.0.smithi038.stdout:8/707: dwrite d1/de/d21/d24/d4d/f9b [0,4194304] 0 2024-09-13T18:30:41.630 INFO:tasks.workunit.client.0.smithi038.stdout:8/708: write d1/de/d21/d24/d41/d8c/fbf [343665,115914] 0 2024-09-13T18:30:41.630 INFO:tasks.workunit.client.0.smithi038.stdout:8/709: write d1/d8/f7b [1705525,118798] 0 2024-09-13T18:30:41.630 INFO:tasks.workunit.client.0.smithi038.stdout:8/710: read d1/f3 [2859089,116363] 0 2024-09-13T18:30:41.630 INFO:tasks.workunit.client.0.smithi038.stdout:8/711: chown d1/d4/f2d 39460115 1 2024-09-13T18:30:41.630 INFO:tasks.workunit.client.0.smithi038.stdout:8/712: write d1/de/d21/d45/d5d/d6d/fba [723620,124701] 0 2024-09-13T18:30:41.630 INFO:tasks.workunit.client.0.smithi038.stdout:5/603: unlink df/d13/d3b/d44/d48/d54/c6d 0 2024-09-13T18:30:41.633 INFO:tasks.workunit.client.0.smithi038.stdout:8/713: link d1/l2 d1/de/d21/d24/d41/d8c/dda/df1/lf2 0 2024-09-13T18:30:41.635 INFO:tasks.workunit.client.0.smithi038.stdout:5/604: symlink df/d13/d49/d9a/lbc 0 2024-09-13T18:30:41.635 INFO:tasks.workunit.client.0.smithi038.stdout:5/605: readlink df/d15/l2b 0 2024-09-13T18:30:41.635 INFO:tasks.workunit.client.0.smithi038.stdout:5/606: write df/d13/d3b/d44/d58/fad [1070619,22690] 0 2024-09-13T18:30:41.636 INFO:tasks.workunit.client.0.smithi038.stdout:8/714: mkdir d1/de/d21/d24/d41/d7d/df3 0 2024-09-13T18:30:41.636 INFO:tasks.workunit.client.0.smithi038.stdout:8/715: fdatasync d1/de/d21/d24/f76 0 2024-09-13T18:30:41.640 INFO:tasks.workunit.client.0.smithi038.stdout:5/607: getdents df 0 2024-09-13T18:30:41.645 INFO:tasks.workunit.client.0.smithi038.stdout:5/608: getdents df/d13/d3b/d44/d48/d54 0 2024-09-13T18:30:41.645 INFO:tasks.workunit.client.0.smithi038.stdout:5/609: truncate df/d13/d3b/d44/d58/fad 1118485 0 2024-09-13T18:30:41.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/716: dwrite d1/de/d21/d24/d4d/f9b [0,4194304] 0 2024-09-13T18:30:41.652 INFO:tasks.workunit.client.0.smithi038.stdout:8/717: mkdir d1/de/d15/dbc/df4 0 2024-09-13T18:30:41.653 INFO:tasks.workunit.client.0.smithi038.stdout:8/718: mknod d1/d2a/d40/dbe/dc6/cf5 0 2024-09-13T18:30:41.655 INFO:tasks.workunit.client.0.smithi038.stdout:8/719: rename d1/de/d21/d24/d41/d7d/lde to d1/de/d21/d24/d41/d80/d8f/lf6 0 2024-09-13T18:30:41.657 INFO:tasks.workunit.client.0.smithi038.stdout:8/720: link d1/d8/f1f d1/de/d21/d45/d61/ff7 0 2024-09-13T18:30:41.660 INFO:tasks.workunit.client.0.smithi038.stdout:5/610: dwrite df/d68/fb7 [0,4194304] 0 2024-09-13T18:30:41.662 INFO:tasks.workunit.client.0.smithi038.stdout:5/611: rename df/d13/d85/lb3 to df/d13/d49/d9a/lbd 0 2024-09-13T18:30:41.662 INFO:tasks.workunit.client.0.smithi038.stdout:5/612: write df/f1b [588499,57804] 0 2024-09-13T18:30:41.662 INFO:tasks.workunit.client.0.smithi038.stdout:8/721: dread d1/d4/f4f [0,4194304] 0 2024-09-13T18:30:41.662 INFO:tasks.workunit.client.0.smithi038.stdout:8/722: stat d1/d2a/d40/dbe/cce 0 2024-09-13T18:30:41.663 INFO:tasks.workunit.client.0.smithi038.stdout:5/613: creat df/d13/d3b/d44/d48/d75/da7/fbe x:0 0 0 2024-09-13T18:30:41.663 INFO:tasks.workunit.client.0.smithi038.stdout:5/614: dread - df/d13/d3b/d44/fb5 zero size 2024-09-13T18:30:41.664 INFO:tasks.workunit.client.0.smithi038.stdout:8/723: mknod d1/de/d21/d24/d41/cf8 0 2024-09-13T18:30:41.664 INFO:tasks.workunit.client.0.smithi038.stdout:8/724: chown d1/d4/c2c 27 1 2024-09-13T18:30:41.665 INFO:tasks.workunit.client.0.smithi038.stdout:5/615: rmdir df/d13 39 2024-09-13T18:30:41.665 INFO:tasks.workunit.client.0.smithi038.stdout:5/616: chown df/d13/d85/fbb 3759 1 2024-09-13T18:30:41.679 INFO:tasks.workunit.client.0.smithi038.stdout:5/617: rename df/d13/d3b to df/d15/d36/d67/dbf 0 2024-09-13T18:30:41.679 INFO:tasks.workunit.client.0.smithi038.stdout:5/618: stat df/c64 0 2024-09-13T18:30:41.680 INFO:tasks.workunit.client.0.smithi038.stdout:5/619: mknod df/d15/cc0 0 2024-09-13T18:30:41.680 INFO:tasks.workunit.client.0.smithi038.stdout:8/725: dwrite d1/de/d21/d24/d4d/da6/fbd [0,4194304] 0 2024-09-13T18:30:41.681 INFO:tasks.workunit.client.0.smithi038.stdout:5/620: creat df/d15/d36/d67/dbf/d44/d58/d9c/fc1 x:0 0 0 2024-09-13T18:30:41.691 INFO:tasks.workunit.client.0.smithi038.stdout:8/726: read d1/d8/faa [414031,85964] 0 2024-09-13T18:30:41.694 INFO:tasks.workunit.client.0.smithi038.stdout:8/727: dread d1/de/d21/d45/f97 [0,4194304] 0 2024-09-13T18:30:41.702 INFO:tasks.workunit.client.0.smithi038.stdout:8/728: dread d1/d2a/d3f/f7e [0,4194304] 0 2024-09-13T18:30:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:41 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:41 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:41 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:30:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:41 smithi149 ceph-mon[35845]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:30:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:41 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:30:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:41 smithi149 ceph-mon[35845]: Upgrade: Need to upgrade myself (mgr.smithi149.eabzne) 2024-09-13T18:30:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:41 smithi149 ceph-mon[35845]: Upgrade: Need to upgrade myself (mgr.smithi149.eabzne) 2024-09-13T18:30:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:41 smithi149 ceph-mon[35845]: pgmap v23: 65 pgs: 65 active+clean; 3.0 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 189 MiB/s rd, 236 MiB/s wr, 366 op/s 2024-09-13T18:30:41.786 INFO:tasks.workunit.client.0.smithi038.stdout:5/621: mknod df/d15/d36/d67/dbf/cc2 0 2024-09-13T18:30:41.801 INFO:tasks.workunit.client.0.smithi038.stdout:5/622: symlink df/da5/lc3 0 2024-09-13T18:30:41.802 INFO:tasks.workunit.client.0.smithi038.stdout:8/729: getdents d1/d2a/d3f 0 2024-09-13T18:30:41.802 INFO:tasks.workunit.client.0.smithi038.stdout:8/730: readlink d1/d4/le3 0 2024-09-13T18:30:41.805 INFO:tasks.workunit.client.0.smithi038.stdout:9/572: sync 2024-09-13T18:30:41.805 INFO:tasks.workunit.client.0.smithi038.stdout:0/547: sync 2024-09-13T18:30:41.805 INFO:tasks.workunit.client.0.smithi038.stdout:1/725: sync 2024-09-13T18:30:41.805 INFO:tasks.workunit.client.0.smithi038.stdout:4/939: sync 2024-09-13T18:30:41.805 INFO:tasks.workunit.client.0.smithi038.stdout:8/731: dread d1/de/d21/d45/f97 [0,4194304] 0 2024-09-13T18:30:41.809 INFO:tasks.workunit.client.0.smithi038.stdout:0/548: rename d2/d7/d24/d3c/d3f/f7a to d2/d7/d24/d92/d66/d81/fb4 0 2024-09-13T18:30:41.809 INFO:tasks.workunit.client.0.smithi038.stdout:0/549: truncate d2/f5c 803350 0 2024-09-13T18:30:41.810 INFO:tasks.workunit.client.0.smithi038.stdout:0/550: stat d2/dc/f50 0 2024-09-13T18:30:41.810 INFO:tasks.workunit.client.0.smithi038.stdout:8/732: creat d1/d2a/d3f/dbb/ff9 x:0 0 0 2024-09-13T18:30:41.810 INFO:tasks.workunit.client.0.smithi038.stdout:8/733: truncate d1/de/d21/d24/d41/d7d/fa8 812650 0 2024-09-13T18:30:41.813 INFO:tasks.workunit.client.0.smithi038.stdout:0/551: rmdir d2/d7/d24/d2b/d95 39 2024-09-13T18:30:41.822 INFO:tasks.workunit.client.0.smithi038.stdout:1/726: write d12/d3c/f50 [2512447,127546] 0 2024-09-13T18:30:41.823 INFO:tasks.workunit.client.0.smithi038.stdout:9/573: write d0/d7/d13/fba [50803,49704] 0 2024-09-13T18:30:41.823 INFO:tasks.workunit.client.0.smithi038.stdout:9/574: dread - d0/d7/d13/d30/fc7 zero size 2024-09-13T18:30:41.823 INFO:tasks.workunit.client.0.smithi038.stdout:9/575: fsync d0/d7/d13/d2d/f39 0 2024-09-13T18:30:41.825 INFO:tasks.workunit.client.0.smithi038.stdout:1/727: creat d12/d3c/d46/d57/da4/de2/fe4 x:0 0 0 2024-09-13T18:30:41.825 INFO:tasks.workunit.client.0.smithi038.stdout:1/728: dread - d12/d3c/d46/f67 zero size 2024-09-13T18:30:41.825 INFO:tasks.workunit.client.0.smithi038.stdout:1/729: fdatasync d12/f23 0 2024-09-13T18:30:41.825 INFO:tasks.workunit.client.0.smithi038.stdout:1/730: chown d12/d3c/d46/d57/f87 24165 1 2024-09-13T18:30:41.852 INFO:tasks.workunit.client.0.smithi038.stdout:1/731: write d12/d3c/d46/f7c [387616,73542] 0 2024-09-13T18:30:41.863 INFO:tasks.workunit.client.0.smithi038.stdout:1/732: dread d12/d2a/d8e/fc0 [0,4194304] 0 2024-09-13T18:30:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:8/734: dwrite d1/d8/f7b [0,4194304] 0 2024-09-13T18:30:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:1/733: rename d12/d3c/d46/d58/l96 to d12/d2a/d32/d59/d5e/dc3/le5 0 2024-09-13T18:30:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:1/734: chown ff 6777664 1 2024-09-13T18:30:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:0/552: dwrite d2/d7/d24/d3c/f4d [0,4194304] 0 2024-09-13T18:30:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:9/576: dwrite d0/d7/d13/d2d/d3c/d50/f65 [0,4194304] 0 2024-09-13T18:30:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:9/577: fdatasync d0/d7/d2c/f49 0 2024-09-13T18:30:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:5/623: dwrite df/d13/f4f [4194304,4194304] 0 2024-09-13T18:30:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:5/624: chown df/d15/f7e 979734 1 2024-09-13T18:30:41.865 INFO:tasks.workunit.client.0.smithi038.stdout:4/940: dwrite d2/d49/d50/f91 [4194304,4194304] 0 2024-09-13T18:30:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:8/735: symlink d1/de/d21/d24/d4d/d50/d62/d71/lfa 0 2024-09-13T18:30:41.868 INFO:tasks.workunit.client.0.smithi038.stdout:4/941: dread d2/df/d1b/d10/d55/dd5/fd9 [0,4194304] 0 2024-09-13T18:30:41.869 INFO:tasks.workunit.client.0.smithi038.stdout:4/942: stat d2/d49/d50/lcc 0 2024-09-13T18:30:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:8/736: dread d1/de/d21/f52 [0,4194304] 0 2024-09-13T18:30:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:8/737: fsync d1/de/d21/d24/d4d/f9b 0 2024-09-13T18:30:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:1/735: rename d12/d2a/d8e/fc8 to d12/d2a/d32/d59/d5b/d47/d84/fe6 0 2024-09-13T18:30:41.874 INFO:tasks.workunit.client.0.smithi038.stdout:5/625: rename df/d15/d36/d67/dbf/d41 to df/d15/d36/d67/dbf/d41/dc4 22 2024-09-13T18:30:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:0/553: symlink d2/d7/d24/d2b/d6d/lb5 0 2024-09-13T18:30:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:0/554: readlink d2/d7/d24/d2b/l38 0 2024-09-13T18:30:41.875 INFO:tasks.workunit.client.0.smithi038.stdout:0/555: fdatasync d2/d7/d24/d2b/d6d/f6f 0 2024-09-13T18:30:41.876 INFO:tasks.workunit.client.0.smithi038.stdout:8/738: dread d1/de/d21/d45/d5d/d6d/fba [0,4194304] 0 2024-09-13T18:30:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:8/739: chown d1/de/d21/c91 1854 1 2024-09-13T18:30:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:8/740: chown d1/de/d21/d24/d41/d80/dca/le5 435 1 2024-09-13T18:30:41.877 INFO:tasks.workunit.client.0.smithi038.stdout:8/741: write d1/de/d21/d24/d41/d7d/f9c [1047509,50801] 0 2024-09-13T18:30:41.880 INFO:tasks.workunit.client.0.smithi038.stdout:9/578: truncate d0/f2f 1930568 0 2024-09-13T18:30:41.883 INFO:tasks.workunit.client.0.smithi038.stdout:1/736: fsync d12/d2a/d32/d59/d5b/d47/d84/fe6 0 2024-09-13T18:30:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:1/737: stat d12/c18 0 2024-09-13T18:30:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:1/738: write d12/d3c/d46/d58/f79 [205461,70792] 0 2024-09-13T18:30:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:1/739: creat d12/fe7 x:0 0 0 2024-09-13T18:30:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:1/740: read - d12/d7a/f91 zero size 2024-09-13T18:30:41.884 INFO:tasks.workunit.client.0.smithi038.stdout:1/741: readlink d12/d2a/d32/d59/d5b/d47/la6 0 2024-09-13T18:30:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:4/943: rename d2/df/d1b/d10/d55/dfb/f12c to d2/d49/d4b/dc0/d11b/f138 0 2024-09-13T18:30:41.886 INFO:tasks.workunit.client.0.smithi038.stdout:4/944: dread - d2/df/d1b/ff8 zero size 2024-09-13T18:30:41.889 INFO:tasks.workunit.client.0.smithi038.stdout:5/626: symlink df/lc5 0 2024-09-13T18:30:41.889 INFO:tasks.workunit.client.0.smithi038.stdout:5/627: write df/d15/d36/d67/dbf/d44/d48/d56/f5f [3023220,106861] 0 2024-09-13T18:30:41.889 INFO:tasks.workunit.client.0.smithi038.stdout:0/556: mkdir d2/d7/d24/d2b/db6 0 2024-09-13T18:30:41.892 INFO:tasks.workunit.client.0.smithi038.stdout:1/742: creat d12/d3c/fe8 x:0 0 0 2024-09-13T18:30:41.893 INFO:tasks.workunit.client.0.smithi038.stdout:1/743: write d12/d2a/d32/d59/d5b/d47/d84/fcc [281137,64753] 0 2024-09-13T18:30:41.893 INFO:tasks.workunit.client.0.smithi038.stdout:1/744: chown d12/d2a/d32/d59/d5b/d47/d84/da7/lc4 5833 1 2024-09-13T18:30:41.893 INFO:tasks.workunit.client.0.smithi038.stdout:1/745: chown d12/f39 945 1 2024-09-13T18:30:41.893 INFO:tasks.workunit.client.0.smithi038.stdout:1/746: readlink d12/d2a/d32/d59/d5e/dc3/le5 0 2024-09-13T18:30:41.896 INFO:tasks.workunit.client.0.smithi038.stdout:8/742: rename d1/de/d21/d24/d41/f88 to d1/de/d21/d45/ffb 0 2024-09-13T18:30:41.898 INFO:tasks.workunit.client.0.smithi038.stdout:4/945: link d2/df/d22/l48 d2/df/d1b/d10/d55/l139 0 2024-09-13T18:30:41.898 INFO:tasks.workunit.client.0.smithi038.stdout:4/946: chown d2/df/d1b/d10/d71/l110 16214 1 2024-09-13T18:30:41.898 INFO:tasks.workunit.client.0.smithi038.stdout:5/628: creat df/d15/d36/d67/dbf/d3e/fc6 x:0 0 0 2024-09-13T18:30:41.900 INFO:tasks.workunit.client.0.smithi038.stdout:0/557: mkdir d2/d7/d24/d92/d40/d74/db7 0 2024-09-13T18:30:41.901 INFO:tasks.workunit.client.0.smithi038.stdout:1/747: symlink d12/d3c/d46/d57/le9 0 2024-09-13T18:30:41.903 INFO:tasks.workunit.client.0.smithi038.stdout:9/579: rename d0/f2a to d0/d7/d13/d2d/d3c/d50/fce 0 2024-09-13T18:30:41.903 INFO:tasks.workunit.client.0.smithi038.stdout:9/580: fsync d0/d7/d2c/d5a/d67/d9e/f9b 0 2024-09-13T18:30:41.904 INFO:tasks.workunit.client.0.smithi038.stdout:8/743: creat d1/de/d15/dbc/df4/ffc x:0 0 0 2024-09-13T18:30:41.905 INFO:tasks.workunit.client.0.smithi038.stdout:8/744: dread d1/fd9 [0,4194304] 0 2024-09-13T18:30:41.905 INFO:tasks.workunit.client.0.smithi038.stdout:4/947: creat d2/d49/d50/da0/d8/d80/ddf/f13a x:0 0 0 2024-09-13T18:30:41.906 INFO:tasks.workunit.client.0.smithi038.stdout:5/629: mkdir df/d13/dc7 0 2024-09-13T18:30:41.907 INFO:tasks.workunit.client.0.smithi038.stdout:5/630: dread - df/d15/d36/d67/dbf/d44/d58/d9c/fc1 zero size 2024-09-13T18:30:41.907 INFO:tasks.workunit.client.0.smithi038.stdout:0/558: creat d2/d7/d24/d92/d40/d87/dab/fb8 x:0 0 0 2024-09-13T18:30:41.911 INFO:tasks.workunit.client.0.smithi038.stdout:9/581: mkdir d0/d7/d2c/d33/d4a/dcf 0 2024-09-13T18:30:41.912 INFO:tasks.workunit.client.0.smithi038.stdout:8/745: rmdir d1/de/d21/d24/d41/d7d 39 2024-09-13T18:30:41.912 INFO:tasks.workunit.client.0.smithi038.stdout:8/746: chown d1/d4/le3 1534649 1 2024-09-13T18:30:41.912 INFO:tasks.workunit.client.0.smithi038.stdout:8/747: dread - d1/d4/fad zero size 2024-09-13T18:30:41.913 INFO:tasks.workunit.client.0.smithi038.stdout:0/559: rmdir d2/d7/d24/d2b/d6d 39 2024-09-13T18:30:41.915 INFO:tasks.workunit.client.0.smithi038.stdout:4/948: dread d2/fd0 [0,4194304] 0 2024-09-13T18:30:41.916 INFO:tasks.workunit.client.0.smithi038.stdout:8/748: truncate d1/de/d15/d30/f3c 5087882 0 2024-09-13T18:30:41.919 INFO:tasks.workunit.client.0.smithi038.stdout:0/560: creat d2/d7/d24/d2b/d95/fb9 x:0 0 0 2024-09-13T18:30:41.922 INFO:tasks.workunit.client.0.smithi038.stdout:1/748: rename d12/d2a/d32/d59/d5b/d47 to d12/d2a/d72/dea 0 2024-09-13T18:30:41.922 INFO:tasks.workunit.client.0.smithi038.stdout:4/949: dread d2/d49/d50/da0/d8/f27 [4194304,4194304] 0 2024-09-13T18:30:41.922 INFO:tasks.workunit.client.0.smithi038.stdout:4/950: readlink d2/d49/d4b/dbc/l101 0 2024-09-13T18:30:41.923 INFO:tasks.workunit.client.0.smithi038.stdout:5/631: dwrite df/d15/d36/d67/dbf/d44/f46 [0,4194304] 0 2024-09-13T18:30:41.925 INFO:tasks.workunit.client.0.smithi038.stdout:5/632: write df/d15/d36/d67/f77 [1038368,80460] 0 2024-09-13T18:30:41.925 INFO:tasks.workunit.client.0.smithi038.stdout:8/749: rmdir d1/de/d21/d24/d41/d8c/dda/df1 39 2024-09-13T18:30:41.929 INFO:tasks.workunit.client.0.smithi038.stdout:9/582: dread d0/d7/d13/f85 [0,4194304] 0 2024-09-13T18:30:41.929 INFO:tasks.workunit.client.0.smithi038.stdout:9/583: truncate d0/d7/d2c/d5e/fbc 872374 0 2024-09-13T18:30:41.937 INFO:tasks.workunit.client.0.smithi038.stdout:8/750: unlink d1/l16 0 2024-09-13T18:30:41.940 INFO:tasks.workunit.client.0.smithi038.stdout:8/751: truncate d1/de/d21/d24/d41/d7d/fe6 3018362 0 2024-09-13T18:30:41.940 INFO:tasks.workunit.client.0.smithi038.stdout:9/584: write d0/d7/d2c/d5a/f72 [3136985,99821] 0 2024-09-13T18:30:41.941 INFO:tasks.workunit.client.0.smithi038.stdout:9/585: getdents d0/d7/d13/d2d/d3c/d50/d94 0 2024-09-13T18:30:41.941 INFO:tasks.workunit.client.0.smithi038.stdout:9/586: chown d0/d7/d13/d2d/d3e/d70/da2/da6 0 1 2024-09-13T18:30:41.943 INFO:tasks.workunit.client.0.smithi038.stdout:8/752: unlink d1/de/d21/d24/d41/ca5 0 2024-09-13T18:30:41.943 INFO:tasks.workunit.client.0.smithi038.stdout:8/753: stat d1/de/d3a/f77 0 2024-09-13T18:30:41.943 INFO:tasks.workunit.client.0.smithi038.stdout:9/587: mknod d0/d7/d13/d2d/d3e/d70/cd0 0 2024-09-13T18:30:41.946 INFO:tasks.workunit.client.0.smithi038.stdout:0/561: dwrite d2/d7/d24/d92/f52 [0,4194304] 0 2024-09-13T18:30:41.947 INFO:tasks.workunit.client.0.smithi038.stdout:9/588: rename d0/d2e/f29 to d0/d7/d2c/d6d/fd1 0 2024-09-13T18:30:41.947 INFO:tasks.workunit.client.0.smithi038.stdout:9/589: chown d0/d7/d13/d2d/d3e 213404 1 2024-09-13T18:30:41.950 INFO:tasks.workunit.client.0.smithi038.stdout:4/951: dwrite d2/df/fa6 [0,4194304] 0 2024-09-13T18:30:41.950 INFO:tasks.workunit.client.0.smithi038.stdout:4/952: write d2/df/d22/f70 [990476,43727] 0 2024-09-13T18:30:41.953 INFO:tasks.workunit.client.0.smithi038.stdout:9/590: rename d0/d7/d13/d30/f4d to d0/d7/d2c/fd2 0 2024-09-13T18:30:41.958 INFO:tasks.workunit.client.0.smithi038.stdout:5/633: dwrite df/d68/f71 [0,4194304] 0 2024-09-13T18:30:41.959 INFO:tasks.workunit.client.0.smithi038.stdout:1/749: dwrite d12/d2a/d32/d59/d5e/f61 [0,4194304] 0 2024-09-13T18:30:41.959 INFO:tasks.workunit.client.0.smithi038.stdout:4/953: mkdir d2/d49/d4b/d8e/d13b 0 2024-09-13T18:30:41.960 INFO:tasks.workunit.client.0.smithi038.stdout:4/954: dread - d2/d49/d50/da0/d8/d80/d128/f136 zero size 2024-09-13T18:30:41.961 INFO:tasks.workunit.client.0.smithi038.stdout:8/754: truncate d1/de/d21/d24/d41/d7d/fe6 3291575 0 2024-09-13T18:30:41.961 INFO:tasks.workunit.client.0.smithi038.stdout:8/755: write d1/de/d21/d24/fc8 [446768,52864] 0 2024-09-13T18:30:41.961 INFO:tasks.workunit.client.0.smithi038.stdout:8/756: write d1/d2a/fd0 [3410185,88732] 0 2024-09-13T18:30:41.963 INFO:tasks.workunit.client.0.smithi038.stdout:9/591: unlink d0/d7/d2c/d5e/f71 0 2024-09-13T18:30:41.964 INFO:tasks.workunit.client.0.smithi038.stdout:6/653: sync 2024-09-13T18:30:41.964 INFO:tasks.workunit.client.0.smithi038.stdout:7/530: sync 2024-09-13T18:30:41.965 INFO:tasks.workunit.client.0.smithi038.stdout:5/634: link df/d15/d36/d67/lb2 df/lc8 0 2024-09-13T18:30:41.965 INFO:tasks.workunit.client.0.smithi038.stdout:5/635: chown df/d15/d36/d67/dbf/d44/d52 7 1 2024-09-13T18:30:41.968 INFO:tasks.workunit.client.0.smithi038.stdout:0/562: dwrite d2/f1e [0,4194304] 0 2024-09-13T18:30:41.970 INFO:tasks.workunit.client.0.smithi038.stdout:1/750: symlink d12/d3c/leb 0 2024-09-13T18:30:41.972 INFO:tasks.workunit.client.0.smithi038.stdout:4/955: symlink d2/d49/d50/da0/l13c 0 2024-09-13T18:30:41.972 INFO:tasks.workunit.client.0.smithi038.stdout:4/956: readlink d2/df/d22/l9 0 2024-09-13T18:30:41.974 INFO:tasks.workunit.client.0.smithi038.stdout:8/757: rename d1/d4/f2d to d1/d2a/ffd 0 2024-09-13T18:30:41.975 INFO:tasks.workunit.client.0.smithi038.stdout:9/592: truncate d0/d7/d13/d30/fbd 1778012 0 2024-09-13T18:30:41.977 INFO:tasks.workunit.client.0.smithi038.stdout:6/654: unlink dd/l19 0 2024-09-13T18:30:41.982 INFO:tasks.workunit.client.0.smithi038.stdout:5/636: symlink df/d15/d36/d67/dbf/d44/d58/d94/lc9 0 2024-09-13T18:30:41.986 INFO:tasks.workunit.client.0.smithi038.stdout:4/957: write d2/df/d1b/d10/da3/f7e [4716108,1065] 0 2024-09-13T18:30:41.987 INFO:tasks.workunit.client.0.smithi038.stdout:0/563: creat d2/d7/d24/d92/d40/d97/d98/fba x:0 0 0 2024-09-13T18:30:41.987 INFO:tasks.workunit.client.0.smithi038.stdout:0/564: read - d2/d7/d55/f73 zero size 2024-09-13T18:30:41.987 INFO:tasks.workunit.client.0.smithi038.stdout:0/565: creat d2/d7/d24/d92/da1/fbb x:0 0 0 2024-09-13T18:30:41.989 INFO:tasks.workunit.client.0.smithi038.stdout:1/751: unlink d12/d2a/d72/fce 0 2024-09-13T18:30:41.989 INFO:tasks.workunit.client.0.smithi038.stdout:1/752: write d12/d2a/d72/dbf/fd4 [770808,101004] 0 2024-09-13T18:30:41.991 INFO:tasks.workunit.client.0.smithi038.stdout:1/753: read d12/f98 [583812,79367] 0 2024-09-13T18:30:41.991 INFO:tasks.workunit.client.0.smithi038.stdout:1/754: chown d12/f16 10417 1 2024-09-13T18:30:41.994 INFO:tasks.workunit.client.0.smithi038.stdout:7/531: symlink db/d12/d1c/d3a/lbc 0 2024-09-13T18:30:41.997 INFO:tasks.workunit.client.0.smithi038.stdout:5/637: unlink df/d15/d36/d67/dbf/d44/d48/f95 0 2024-09-13T18:30:41.998 INFO:tasks.workunit.client.0.smithi038.stdout:4/958: mkdir d2/df/d1b/d13d 0 2024-09-13T18:30:41.999 INFO:tasks.workunit.client.0.smithi038.stdout:1/755: dread d12/d3c/d46/f94 [0,4194304] 0 2024-09-13T18:30:41.999 INFO:tasks.workunit.client.0.smithi038.stdout:1/756: truncate d12/d3c/d46/d57/f87 553067 0 2024-09-13T18:30:41.999 INFO:tasks.workunit.client.0.smithi038.stdout:6/655: dwrite dd/de/d2e/d2f/d4c/d60/f73 [0,4194304] 0 2024-09-13T18:30:41.999 INFO:tasks.workunit.client.0.smithi038.stdout:6/656: read dd/de/d61/d62/fcc [999765,71627] 0 2024-09-13T18:30:42.000 INFO:tasks.workunit.client.0.smithi038.stdout:6/657: stat dd/de/d2e/d2f/d4c/d60/f73 0 2024-09-13T18:30:42.003 INFO:tasks.workunit.client.0.smithi038.stdout:0/566: link d2/d7/d24/d3c/f56 d2/d7/d55/fbc 0 2024-09-13T18:30:42.006 INFO:tasks.workunit.client.0.smithi038.stdout:8/758: rmdir d1/d4 39 2024-09-13T18:30:42.008 INFO:tasks.workunit.client.0.smithi038.stdout:9/593: getdents d0/d7/d13 0 2024-09-13T18:30:42.012 INFO:tasks.workunit.client.0.smithi038.stdout:0/567: read d2/d7/d24/d92/f52 [2274105,48747] 0 2024-09-13T18:30:42.013 INFO:tasks.workunit.client.0.smithi038.stdout:7/532: link db/fb5 db/d12/d1c/d3a/d3c/d52/d9b/fbd 0 2024-09-13T18:30:42.014 INFO:tasks.workunit.client.0.smithi038.stdout:5/638: mkdir df/dca 0 2024-09-13T18:30:42.015 INFO:tasks.workunit.client.0.smithi038.stdout:9/594: dread d0/d7/d13/d2d/d3c/d50/fce [0,4194304] 0 2024-09-13T18:30:42.015 INFO:tasks.workunit.client.0.smithi038.stdout:9/595: chown d0/d7 395111 1 2024-09-13T18:30:42.018 INFO:tasks.workunit.client.0.smithi038.stdout:4/959: link d2/d49/d50/da0/lab d2/d49/d126/l13e 0 2024-09-13T18:30:42.020 INFO:tasks.workunit.client.0.smithi038.stdout:1/757: creat d12/d3c/d46/fec x:0 0 0 2024-09-13T18:30:42.021 INFO:tasks.workunit.client.0.smithi038.stdout:2/570: sync 2024-09-13T18:30:42.021 INFO:tasks.workunit.client.0.smithi038.stdout:3/571: sync 2024-09-13T18:30:42.024 INFO:tasks.workunit.client.0.smithi038.stdout:8/759: dwrite d1/de/d21/d24/d41/fd5 [0,4194304] 0 2024-09-13T18:30:42.027 INFO:tasks.workunit.client.0.smithi038.stdout:6/658: rename dd/de/d2e/d30/f42 to dd/de/d2e/d2f/d4c/fe5 0 2024-09-13T18:30:42.028 INFO:tasks.workunit.client.0.smithi038.stdout:7/533: creat db/d12/d1c/d3a/d26/fbe x:0 0 0 2024-09-13T18:30:42.028 INFO:tasks.workunit.client.0.smithi038.stdout:7/534: chown db/d12/d1c/d3a 789863 1 2024-09-13T18:30:42.028 INFO:tasks.workunit.client.0.smithi038.stdout:7/535: stat db/fc 0 2024-09-13T18:30:42.029 INFO:tasks.workunit.client.0.smithi038.stdout:5/639: truncate df/d15/d36/d67/dbf/d44/f51 2960016 0 2024-09-13T18:30:42.029 INFO:tasks.workunit.client.0.smithi038.stdout:5/640: write f3 [1584085,38921] 0 2024-09-13T18:30:42.030 INFO:tasks.workunit.client.0.smithi038.stdout:9/596: mkdir d0/d2e/d7f/dd3 0 2024-09-13T18:30:42.031 INFO:tasks.workunit.client.0.smithi038.stdout:0/568: dwrite d2/d7/d24/d3c/fb3 [0,4194304] 0 2024-09-13T18:30:42.031 INFO:tasks.workunit.client.0.smithi038.stdout:0/569: chown d2/d7/d24/d3c/c64 18039 1 2024-09-13T18:30:42.031 INFO:tasks.workunit.client.0.smithi038.stdout:8/760: mknod d1/d4/d98/cfe 0 2024-09-13T18:30:42.032 INFO:tasks.workunit.client.0.smithi038.stdout:8/761: creat d1/de/d15/dbc/df4/fff x:0 0 0 2024-09-13T18:30:42.033 INFO:tasks.workunit.client.0.smithi038.stdout:1/758: rename d12/d2a/d32/d59/d5b/f35 to d12/d2a/d72/dea/fed 0 2024-09-13T18:30:42.033 INFO:tasks.workunit.client.0.smithi038.stdout:1/759: chown d12/d2a/d32/d59/d5b/l33 11 1 2024-09-13T18:30:42.035 INFO:tasks.workunit.client.0.smithi038.stdout:6/659: mknod dd/de/d2e/d2f/d4c/d86/dac/ce6 0 2024-09-13T18:30:42.035 INFO:tasks.workunit.client.0.smithi038.stdout:6/660: getdents dd/de/dce 0 2024-09-13T18:30:42.038 INFO:tasks.workunit.client.0.smithi038.stdout:7/536: creat db/d12/d1c/d3a/d3c/d52/fbf x:0 0 0 2024-09-13T18:30:42.040 INFO:tasks.workunit.client.0.smithi038.stdout:5/641: write df/f2a [1783712,9078] 0 2024-09-13T18:30:42.040 INFO:tasks.workunit.client.0.smithi038.stdout:9/597: creat d0/d7/d2c/dbf/fd4 x:0 0 0 2024-09-13T18:30:42.040 INFO:tasks.workunit.client.0.smithi038.stdout:9/598: write d0/d7/d13/fba [1626408,107443] 0 2024-09-13T18:30:42.042 INFO:tasks.workunit.client.0.smithi038.stdout:8/762: dread d1/f60 [0,4194304] 0 2024-09-13T18:30:42.044 INFO:tasks.workunit.client.0.smithi038.stdout:2/571: dwrite d2/d2a/f3d [4194304,4194304] 0 2024-09-13T18:30:42.044 INFO:tasks.workunit.client.0.smithi038.stdout:2/572: dread - d2/d5c/d93/d62/f80 zero size 2024-09-13T18:30:42.044 INFO:tasks.workunit.client.0.smithi038.stdout:9/599: dread d0/d7/d2c/d5a/d67/d9e/f6b [0,4194304] 0 2024-09-13T18:30:42.045 INFO:tasks.workunit.client.0.smithi038.stdout:0/570: link d2/d7/d24/d92/d66/f5e d2/d7/d24/d92/d40/d9a/fbd 0 2024-09-13T18:30:42.051 INFO:tasks.workunit.client.0.smithi038.stdout:3/572: rename d0/dd/d17/d50/d5c/d1d/c88 to d0/dd/d17/d50/cb1 0 2024-09-13T18:30:42.053 INFO:tasks.workunit.client.0.smithi038.stdout:1/760: mknod d12/d2a/d32/d59/d5e/dc3/cee 0 2024-09-13T18:30:42.053 INFO:tasks.workunit.client.0.smithi038.stdout:1/761: dread - d12/d3c/db6/fc6 zero size 2024-09-13T18:30:42.053 INFO:tasks.workunit.client.0.smithi038.stdout:1/762: chown d12/f2d 11 1 2024-09-13T18:30:42.054 INFO:tasks.workunit.client.0.smithi038.stdout:8/763: read d1/de/f96 [3271145,10194] 0 2024-09-13T18:30:42.055 INFO:tasks.workunit.client.0.smithi038.stdout:6/661: creat dd/de/d2e/d2f/da6/dd9/fe7 x:0 0 0 2024-09-13T18:30:42.056 INFO:tasks.workunit.client.0.smithi038.stdout:7/537: creat db/d12/d13/fc0 x:0 0 0 2024-09-13T18:30:42.058 INFO:tasks.workunit.client.0.smithi038.stdout:5/642: truncate df/d15/d36/d67/dbf/d44/d48/d56/f76 2587691 0 2024-09-13T18:30:42.058 INFO:tasks.workunit.client.0.smithi038.stdout:5/643: fsync df/d13/d49/d9a/fa6 0 2024-09-13T18:30:42.061 INFO:tasks.workunit.client.0.smithi038.stdout:2/573: link d2/d1e/d48/l60 d2/d1e/d44/d50/d39/d52/d8b/dcb/lcf 0 2024-09-13T18:30:42.062 INFO:tasks.workunit.client.0.smithi038.stdout:9/600: symlink d0/d7/d13/d30/ld5 0 2024-09-13T18:30:42.064 INFO:tasks.workunit.client.0.smithi038.stdout:0/571: symlink d2/d7/d24/d92/d66/d81/lbe 0 2024-09-13T18:30:42.064 INFO:tasks.workunit.client.0.smithi038.stdout:0/572: write d2/f5 [2048826,16299] 0 2024-09-13T18:30:42.064 INFO:tasks.workunit.client.0.smithi038.stdout:0/573: stat d2/d7/d55/fbc 0 2024-09-13T18:30:42.065 INFO:tasks.workunit.client.0.smithi038.stdout:3/573: rename d0/dd/d17/d50/c54 to d0/dd/d17/d50/d59/cb2 0 2024-09-13T18:30:42.065 INFO:tasks.workunit.client.0.smithi038.stdout:3/574: read - d0/dd/d17/d50/d5c/d1d/d30/d95/f6a zero size 2024-09-13T18:30:42.065 INFO:tasks.workunit.client.0.smithi038.stdout:3/575: read d0/dd/d17/f60 [3676838,59123] 0 2024-09-13T18:30:42.066 INFO:tasks.workunit.client.0.smithi038.stdout:1/763: rmdir d12/d2a/d32/d59/d5e/dc3 39 2024-09-13T18:30:42.066 INFO:tasks.workunit.client.0.smithi038.stdout:1/764: chown d12/fe7 2623 1 2024-09-13T18:30:42.067 INFO:tasks.workunit.client.0.smithi038.stdout:8/764: mkdir d1/d4/d98/d100 0 2024-09-13T18:30:42.070 INFO:tasks.workunit.client.0.smithi038.stdout:6/662: mkdir dd/de/d31/d63/de8 0 2024-09-13T18:30:42.070 INFO:tasks.workunit.client.0.smithi038.stdout:6/663: fsync dd/de/d2e/d2f/d4c/d55/f5b 0 2024-09-13T18:30:42.070 INFO:tasks.workunit.client.0.smithi038.stdout:6/664: write dd/de/d61/f92 [5237603,82173] 0 2024-09-13T18:30:42.071 INFO:tasks.workunit.client.0.smithi038.stdout:2/574: creat d2/fd0 x:0 0 0 2024-09-13T18:30:42.071 INFO:tasks.workunit.client.0.smithi038.stdout:8/765: write d1/de/f33 [607823,61080] 0 2024-09-13T18:30:42.072 INFO:tasks.workunit.client.0.smithi038.stdout:0/574: mknod d2/d7/d24/d92/d40/d87/cbf 0 2024-09-13T18:30:42.073 INFO:tasks.workunit.client.0.smithi038.stdout:0/575: chown d2/d7/d24/d3c/f56 11 1 2024-09-13T18:30:42.074 INFO:tasks.workunit.client.0.smithi038.stdout:3/576: mkdir d0/dd/d17/d43/d89/db3 0 2024-09-13T18:30:42.074 INFO:tasks.workunit.client.0.smithi038.stdout:3/577: dread - d0/dd/d17/f73 zero size 2024-09-13T18:30:42.074 INFO:tasks.workunit.client.0.smithi038.stdout:3/578: write d0/dd/d17/d50/d5c/f47 [3051185,66848] 0 2024-09-13T18:30:42.075 INFO:tasks.workunit.client.0.smithi038.stdout:3/579: dread d0/dd/d17/d50/d5c/d1d/d30/d95/f68 [0,4194304] 0 2024-09-13T18:30:42.075 INFO:tasks.workunit.client.0.smithi038.stdout:3/580: truncate d0/dd/d17/d50/d5c/d1d/d30/d95/f8e 936144 0 2024-09-13T18:30:42.079 INFO:tasks.workunit.client.0.smithi038.stdout:6/665: unlink dd/de/d2e/d2f/d71/dc5/fdb 0 2024-09-13T18:30:42.079 INFO:tasks.workunit.client.0.smithi038.stdout:6/666: dread - dd/de/d2e/d2f/da6/dd9/fe7 zero size 2024-09-13T18:30:42.080 INFO:tasks.workunit.client.0.smithi038.stdout:8/766: mkdir d1/de/d21/d45/d5d/d6d/d101 0 2024-09-13T18:30:42.080 INFO:tasks.workunit.client.0.smithi038.stdout:8/767: chown d1/de/d21/d24/d41/fdc 72 1 2024-09-13T18:30:42.083 INFO:tasks.workunit.client.0.smithi038.stdout:3/581: write d0/dd/fe [80724,3516] 0 2024-09-13T18:30:42.083 INFO:tasks.workunit.client.0.smithi038.stdout:3/582: creat d0/dd/d17/d43/fb4 x:0 0 0 2024-09-13T18:30:42.084 INFO:tasks.workunit.client.0.smithi038.stdout:6/667: truncate dd/de/d2e/d2f/fb1 4549362 0 2024-09-13T18:30:42.084 INFO:tasks.workunit.client.0.smithi038.stdout:6/668: dread - dd/de/d2e/d2f/da6/dd9/fe7 zero size 2024-09-13T18:30:42.084 INFO:tasks.workunit.client.0.smithi038.stdout:6/669: fdatasync dd/de/d2e/d2f/d71/f75 0 2024-09-13T18:30:42.084 INFO:tasks.workunit.client.0.smithi038.stdout:6/670: truncate dd/daa/fc8 997824 0 2024-09-13T18:30:42.087 INFO:tasks.workunit.client.0.smithi038.stdout:8/768: mkdir d1/de/d21/d102 0 2024-09-13T18:30:42.090 INFO:tasks.workunit.client.0.smithi038.stdout:7/538: dwrite db/d12/d13/d43/f5b [0,4194304] 0 2024-09-13T18:30:42.093 INFO:tasks.workunit.client.0.smithi038.stdout:7/539: rename db/d12/d1c/d3a/d22/lac to db/d12/d1c/d3a/d26/d41/dad/lc1 0 2024-09-13T18:30:42.096 INFO:tasks.workunit.client.0.smithi038.stdout:7/540: link db/d12/d1c/d3a/d26/f2b db/d12/d1c/fc2 0 2024-09-13T18:30:42.105 INFO:tasks.workunit.client.0.smithi038.stdout:8/769: dread d1/d4/f39 [0,4194304] 0 2024-09-13T18:30:42.105 INFO:tasks.workunit.client.0.smithi038.stdout:8/770: write d1/de/d21/d24/d41/f79 [839259,33736] 0 2024-09-13T18:30:42.105 INFO:tasks.workunit.client.0.smithi038.stdout:8/771: readlink d1/de/d15/d30/l57 0 2024-09-13T18:30:42.106 INFO:tasks.workunit.client.0.smithi038.stdout:8/772: unlink d1/de/d21/d24/db0/f7c 0 2024-09-13T18:30:42.106 INFO:tasks.workunit.client.0.smithi038.stdout:8/773: fdatasync d1/de/d21/d24/d4d/d50/d62/d71/fcf 0 2024-09-13T18:30:42.106 INFO:tasks.workunit.client.0.smithi038.stdout:8/774: chown d1/d2a/ffd 0 1 2024-09-13T18:30:42.106 INFO:tasks.workunit.client.0.smithi038.stdout:8/775: fdatasync d1/de/fcd 0 2024-09-13T18:30:42.108 INFO:tasks.workunit.client.0.smithi038.stdout:8/776: rmdir d1/de/d21/d45/d5d/d6d/d101 0 2024-09-13T18:30:42.110 INFO:tasks.workunit.client.0.smithi038.stdout:7/541: dread db/d12/d1c/d3a/d22/f30 [0,4194304] 0 2024-09-13T18:30:42.111 INFO:tasks.workunit.client.0.smithi038.stdout:8/777: rename d1/de/d3a/ld6 to d1/de/d21/d45/l103 0 2024-09-13T18:30:42.111 INFO:tasks.workunit.client.0.smithi038.stdout:8/778: stat d1/de/d21/d45/d61/cea 0 2024-09-13T18:30:42.111 INFO:tasks.workunit.client.0.smithi038.stdout:8/779: stat d1/de/d21/d24/d4d/d50/d62 0 2024-09-13T18:30:42.111 INFO:tasks.workunit.client.0.smithi038.stdout:8/780: stat d1/de/c14 0 2024-09-13T18:30:42.119 INFO:tasks.workunit.client.0.smithi038.stdout:5/644: dwrite df/d15/d36/d67/dbf/d44/d58/d9c/fb9 [0,4194304] 0 2024-09-13T18:30:42.119 INFO:tasks.workunit.client.0.smithi038.stdout:5/645: read - df/d15/d36/d67/dbf/d44/d58/d9c/fc1 zero size 2024-09-13T18:30:42.122 INFO:tasks.workunit.client.0.smithi038.stdout:1/765: dwrite d12/d2a/d32/fbe [0,4194304] 0 2024-09-13T18:30:42.122 INFO:tasks.workunit.client.0.smithi038.stdout:1/766: dread - d12/d2a/d72/dea/f56 zero size 2024-09-13T18:30:42.122 INFO:tasks.workunit.client.0.smithi038.stdout:3/583: dwrite d0/dd/d17/d50/d5c/d1d/d30/d95/f4d [0,4194304] 0 2024-09-13T18:30:42.126 INFO:tasks.workunit.client.0.smithi038.stdout:8/781: write d1/d4/f59 [1116847,40604] 0 2024-09-13T18:30:42.127 INFO:tasks.workunit.client.0.smithi038.stdout:0/576: dwrite d2/d7/d24/d2b/f43 [0,4194304] 0 2024-09-13T18:30:42.127 INFO:tasks.workunit.client.0.smithi038.stdout:6/671: dwrite dd/de/d31/f74 [0,4194304] 0 2024-09-13T18:30:42.127 INFO:tasks.workunit.client.0.smithi038.stdout:0/577: chown d2/d7/d55/c6e 1 1 2024-09-13T18:30:42.127 INFO:tasks.workunit.client.0.smithi038.stdout:0/578: chown d2/d7/d24/d2b/d6d/lb5 272 1 2024-09-13T18:30:42.127 INFO:tasks.workunit.client.0.smithi038.stdout:6/672: dread - dd/de/d2e/d2f/da6/dd9/fe7 zero size 2024-09-13T18:30:42.131 INFO:tasks.workunit.client.0.smithi038.stdout:8/782: unlink d1/de/d21/d24/f76 0 2024-09-13T18:30:42.131 INFO:tasks.workunit.client.0.smithi038.stdout:7/542: dwrite db/d12/d1c/d3a/f1d [0,4194304] 0 2024-09-13T18:30:42.132 INFO:tasks.workunit.client.0.smithi038.stdout:0/579: getdents d2/d7/d24/d92/d66/d49 0 2024-09-13T18:30:42.132 INFO:tasks.workunit.client.0.smithi038.stdout:0/580: write d2/d7/d24/d2b/f91 [653496,97387] 0 2024-09-13T18:30:42.133 INFO:tasks.workunit.client.0.smithi038.stdout:8/783: truncate d1/d8/f1f 1465838 0 2024-09-13T18:30:42.135 INFO:tasks.workunit.client.0.smithi038.stdout:6/673: dread dd/de/d2e/d2f/d71/f97 [0,4194304] 0 2024-09-13T18:30:42.135 INFO:tasks.workunit.client.0.smithi038.stdout:6/674: getdents dd/de/dce 0 2024-09-13T18:30:42.135 INFO:tasks.workunit.client.0.smithi038.stdout:7/543: creat db/d12/d1c/d3a/d3c/fc3 x:0 0 0 2024-09-13T18:30:42.136 INFO:tasks.workunit.client.0.smithi038.stdout:0/581: mkdir d2/d7/d24/d92/d66/d49/dc0 0 2024-09-13T18:30:42.138 INFO:tasks.workunit.client.0.smithi038.stdout:6/675: write dd/de/f4f [105880,130948] 0 2024-09-13T18:30:42.138 INFO:tasks.workunit.client.0.smithi038.stdout:6/676: read dd/de/d2e/f6e [1212329,15172] 0 2024-09-13T18:30:42.138 INFO:tasks.workunit.client.0.smithi038.stdout:8/784: symlink d1/de/d21/d102/l104 0 2024-09-13T18:30:42.139 INFO:tasks.workunit.client.0.smithi038.stdout:7/544: creat db/d12/d1c/fc4 x:0 0 0 2024-09-13T18:30:42.143 INFO:tasks.workunit.client.0.smithi038.stdout:3/584: write d0/dd/d17/d50/d5c/f55 [1414791,11320] 0 2024-09-13T18:30:42.143 INFO:tasks.workunit.client.0.smithi038.stdout:8/785: mkdir d1/d2a/d3f/dbb/d105 0 2024-09-13T18:30:42.145 INFO:tasks.workunit.client.0.smithi038.stdout:3/585: symlink d0/dd/d17/d43/d89/db3/lb5 0 2024-09-13T18:30:42.146 INFO:tasks.workunit.client.0.smithi038.stdout:3/586: chown d0/dd/d17/d50/d5c/d1d/l38 7 1 2024-09-13T18:30:42.146 INFO:tasks.workunit.client.0.smithi038.stdout:8/786: getdents d1/de/d15/dbc 0 2024-09-13T18:30:42.147 INFO:tasks.workunit.client.0.smithi038.stdout:8/787: write d1/de/d21/d24/d41/db7/fef [466357,12139] 0 2024-09-13T18:30:42.147 INFO:tasks.workunit.client.0.smithi038.stdout:8/788: fdatasync d1/d8/faa 0 2024-09-13T18:30:42.150 INFO:tasks.workunit.client.0.smithi038.stdout:3/587: rename d0/dd/d17/d50/c65 to d0/dd/d17/d50/d5c/d23/d7c/d9c/cb6 0 2024-09-13T18:30:42.152 INFO:tasks.workunit.client.0.smithi038.stdout:8/789: creat d1/d2a/d5b/f106 x:0 0 0 2024-09-13T18:30:42.152 INFO:tasks.workunit.client.0.smithi038.stdout:8/790: truncate d1/de/d21/d24/d41/d80/d8f/fa1 1304350 0 2024-09-13T18:30:42.158 INFO:tasks.workunit.client.0.smithi038.stdout:1/767: dwrite d12/d2a/d32/d59/d5e/dc3/fd5 [0,4194304] 0 2024-09-13T18:30:42.158 INFO:tasks.workunit.client.0.smithi038.stdout:1/768: readlink d12/d2a/d32/d59/d5b/l27 0 2024-09-13T18:30:42.169 INFO:tasks.workunit.client.0.smithi038.stdout:8/791: rename d1/d8 to d1/de/d107 0 2024-09-13T18:30:42.169 INFO:tasks.workunit.client.0.smithi038.stdout:3/588: dread d0/dd/d17/d43/f5d [0,4194304] 0 2024-09-13T18:30:42.169 INFO:tasks.workunit.client.0.smithi038.stdout:8/792: write d1/de/d21/d24/d41/d7d/fe6 [3015837,52033] 0 2024-09-13T18:30:42.174 INFO:tasks.workunit.client.0.smithi038.stdout:8/793: mkdir d1/de/d4c/d108 0 2024-09-13T18:30:42.175 INFO:tasks.workunit.client.0.smithi038.stdout:3/589: getdents d0/dd/d17/d50/d5c/d23/d93 0 2024-09-13T18:30:42.177 INFO:tasks.workunit.client.0.smithi038.stdout:8/794: mknod d1/de/d21/d24/d41/d7d/c109 0 2024-09-13T18:30:42.178 INFO:tasks.workunit.client.0.smithi038.stdout:8/795: chown d1/de/d21/d24/d4d/ca4 0 1 2024-09-13T18:30:42.178 INFO:tasks.workunit.client.0.smithi038.stdout:8/796: stat d1/de/d21/d24/f7a 0 2024-09-13T18:30:42.178 INFO:tasks.workunit.client.0.smithi038.stdout:0/582: dwrite d2/dc/f28 [0,4194304] 0 2024-09-13T18:30:42.178 INFO:tasks.workunit.client.0.smithi038.stdout:0/583: write d2/d7/d24/d2b/f91 [1191337,7952] 0 2024-09-13T18:30:42.178 INFO:tasks.workunit.client.0.smithi038.stdout:6/677: dwrite dd/de/d2e/d2f/d4c/d86/fc1 [0,4194304] 0 2024-09-13T18:30:42.178 INFO:tasks.workunit.client.0.smithi038.stdout:1/769: dwrite d12/d2a/d72/dea/f56 [0,4194304] 0 2024-09-13T18:30:42.178 INFO:tasks.workunit.client.0.smithi038.stdout:8/797: read d1/de/d3a/f3e [372363,88456] 0 2024-09-13T18:30:42.179 INFO:tasks.workunit.client.0.smithi038.stdout:3/590: creat d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/fb7 x:0 0 0 2024-09-13T18:30:42.179 INFO:tasks.workunit.client.0.smithi038.stdout:3/591: chown d0/dd/d17/d50/d5c/d23/d52/d6e/f9f 461070650 1 2024-09-13T18:30:42.180 INFO:tasks.workunit.client.0.smithi038.stdout:3/592: dread d0/dd/d17/d50/d5c/d1d/d30/d95/f68 [0,4194304] 0 2024-09-13T18:30:42.180 INFO:tasks.workunit.client.0.smithi038.stdout:3/593: read - d0/dd/d17/d50/d5c/d23/d93/fab zero size 2024-09-13T18:30:42.182 INFO:tasks.workunit.client.0.smithi038.stdout:6/678: write dd/de/d2e/d2f/d4c/d55/f9d [244088,76662] 0 2024-09-13T18:30:42.185 INFO:tasks.workunit.client.0.smithi038.stdout:0/584: rename d2/d7/d24/d92/d40/d74 to d2/d7/d24/d2b/dc1 0 2024-09-13T18:30:42.189 INFO:tasks.workunit.client.0.smithi038.stdout:1/770: mkdir d12/d3c/d46/d57/def 0 2024-09-13T18:30:42.189 INFO:tasks.workunit.client.0.smithi038.stdout:1/771: chown d12/d2a/d32/d59/d5b/c74 113358083 1 2024-09-13T18:30:42.196 INFO:tasks.workunit.client.0.smithi038.stdout:8/798: dwrite d1/de/d21/d24/d41/d8c/fbf [0,4194304] 0 2024-09-13T18:30:42.208 INFO:tasks.workunit.client.0.smithi038.stdout:3/594: rmdir d0/dd/d17/d50/d5c/d23/d52/da9 0 2024-09-13T18:30:42.208 INFO:tasks.workunit.client.0.smithi038.stdout:3/595: truncate d0/dd/d17/d50/d5c/d1d/d30/d95/f36 2025102 0 2024-09-13T18:30:42.208 INFO:tasks.workunit.client.0.smithi038.stdout:3/596: chown d0/dd/d17/d50/d5c/d23/d52/d6e/c63 4077 1 2024-09-13T18:30:42.208 INFO:tasks.workunit.client.0.smithi038.stdout:3/597: fdatasync d0/dd/d17/d50/d59/f6f 0 2024-09-13T18:30:42.209 INFO:tasks.workunit.client.0.smithi038.stdout:6/679: mknod dd/de/dce/ce9 0 2024-09-13T18:30:42.210 INFO:tasks.workunit.client.0.smithi038.stdout:0/585: symlink d2/d7/d24/d2b/d6d/lc2 0 2024-09-13T18:30:42.215 INFO:tasks.workunit.client.0.smithi038.stdout:1/772: unlink d12/f16 0 2024-09-13T18:30:42.220 INFO:tasks.workunit.client.0.smithi038.stdout:8/799: link d1/de/d4c/cb5 d1/de/d21/d24/d41/d8c/dda/c10a 0 2024-09-13T18:30:42.223 INFO:tasks.workunit.client.0.smithi038.stdout:1/773: symlink d12/d2a/d32/d82/lf0 0 2024-09-13T18:30:42.225 INFO:tasks.workunit.client.0.smithi038.stdout:8/800: truncate d1/de/f33 460710 0 2024-09-13T18:30:42.226 INFO:tasks.workunit.client.0.smithi038.stdout:0/586: rename d2/d7/d24/d92/d40/f70 to d2/d7/d24/d92/d66/d49/fc3 0 2024-09-13T18:30:42.230 INFO:tasks.workunit.client.0.smithi038.stdout:6/680: dwrite dd/de/d2e/d30/d27/f53 [0,4194304] 0 2024-09-13T18:30:42.231 INFO:tasks.workunit.client.0.smithi038.stdout:1/774: rmdir d12/d2a/d32/d59/d5e/ddd 0 2024-09-13T18:30:42.232 INFO:tasks.workunit.client.0.smithi038.stdout:0/587: symlink d2/d7/d24/d92/da1/lc4 0 2024-09-13T18:30:42.232 INFO:tasks.workunit.client.0.smithi038.stdout:0/588: dread - d2/d7/d24/d3c/fae zero size 2024-09-13T18:30:42.234 INFO:tasks.workunit.client.0.smithi038.stdout:8/801: write d1/de/d107/f7b [337526,58492] 0 2024-09-13T18:30:42.235 INFO:tasks.workunit.client.0.smithi038.stdout:3/598: dwrite d0/dd/d17/f60 [0,4194304] 0 2024-09-13T18:30:42.237 INFO:tasks.workunit.client.0.smithi038.stdout:6/681: dread dd/de/d61/f92 [4194304,4194304] 0 2024-09-13T18:30:42.237 INFO:tasks.workunit.client.0.smithi038.stdout:6/682: fdatasync dd/de/d2e/f58 0 2024-09-13T18:30:42.241 INFO:tasks.workunit.client.0.smithi038.stdout:6/683: symlink dd/de/d2e/d2f/d4c/d6f/lea 0 2024-09-13T18:30:42.242 INFO:tasks.workunit.client.0.smithi038.stdout:6/684: creat dd/de/d2e/d2f/d4c/d6f/feb x:0 0 0 2024-09-13T18:30:42.243 INFO:tasks.workunit.client.0.smithi038.stdout:6/685: write dd/de/d2e/d2f/da6/fa8 [1574547,60141] 0 2024-09-13T18:30:42.243 INFO:tasks.workunit.client.0.smithi038.stdout:0/589: rename d2/d7/d24/d3c to d2/d7/d24/d92/d40/d97/d98/dc5 0 2024-09-13T18:30:42.244 INFO:tasks.workunit.client.0.smithi038.stdout:0/590: dread - d2/dc/d7f/f8c zero size 2024-09-13T18:30:42.245 INFO:tasks.workunit.client.0.smithi038.stdout:6/686: creat dd/de/d2e/d2f/d4c/d86/fec x:0 0 0 2024-09-13T18:30:42.245 INFO:tasks.workunit.client.0.smithi038.stdout:6/687: dread - dd/de/d2e/d2f/d4c/d60/fda zero size 2024-09-13T18:30:42.246 INFO:tasks.workunit.client.0.smithi038.stdout:0/591: creat d2/d7/d24/d92/d40/d9a/fc6 x:0 0 0 2024-09-13T18:30:42.247 INFO:tasks.workunit.client.0.smithi038.stdout:8/802: dread d1/de/d15/d30/f3c [0,4194304] 0 2024-09-13T18:30:42.248 INFO:tasks.workunit.client.0.smithi038.stdout:0/592: mkdir d2/d7/d24/dc7 0 2024-09-13T18:30:42.248 INFO:tasks.workunit.client.0.smithi038.stdout:0/593: chown d2/d7/c12 250 1 2024-09-13T18:30:42.248 INFO:tasks.workunit.client.0.smithi038.stdout:0/594: chown d2 691897 1 2024-09-13T18:30:42.249 INFO:tasks.workunit.client.0.smithi038.stdout:8/803: creat d1/de/d21/d24/db0/f10b x:0 0 0 2024-09-13T18:30:42.251 INFO:tasks.workunit.client.0.smithi038.stdout:0/595: rename d2/d7/d24/d92/l75 to d2/d7/d24/d92/da1/lc8 0 2024-09-13T18:30:42.253 INFO:tasks.workunit.client.0.smithi038.stdout:8/804: creat d1/de/dc7/f10c x:0 0 0 2024-09-13T18:30:42.255 INFO:tasks.workunit.client.0.smithi038.stdout:0/596: creat d2/d7/d24/d2b/dc1/db7/fc9 x:0 0 0 2024-09-13T18:30:42.256 INFO:tasks.workunit.client.0.smithi038.stdout:0/597: fdatasync d2/f96 0 2024-09-13T18:30:42.257 INFO:tasks.workunit.client.0.smithi038.stdout:8/805: creat d1/d4/d98/d100/f10d x:0 0 0 2024-09-13T18:30:42.260 INFO:tasks.workunit.client.0.smithi038.stdout:6/688: write dd/de/d2e/d2f/d4c/d55/f5e [2677713,4983] 0 2024-09-13T18:30:42.261 INFO:tasks.workunit.client.0.smithi038.stdout:1/775: dwrite d12/d2a/d32/d59/d5b/f22 [0,4194304] 0 2024-09-13T18:30:42.261 INFO:tasks.workunit.client.0.smithi038.stdout:6/689: truncate dd/de/d2e/d2f/d71/fa4 1241636 0 2024-09-13T18:30:42.263 INFO:tasks.workunit.client.0.smithi038.stdout:8/806: write d1/de/d21/d45/d61/ff7 [427935,41167] 0 2024-09-13T18:30:42.263 INFO:tasks.workunit.client.0.smithi038.stdout:3/599: dwrite d0/dd/d17/f60 [0,4194304] 0 2024-09-13T18:30:42.263 INFO:tasks.workunit.client.0.smithi038.stdout:1/776: creat d12/d2a/d32/ff1 x:0 0 0 2024-09-13T18:30:42.265 INFO:tasks.workunit.client.0.smithi038.stdout:6/690: link dd/f44 dd/de/dc6/fed 0 2024-09-13T18:30:42.266 INFO:tasks.workunit.client.0.smithi038.stdout:3/600: mknod d0/dd/d17/d50/d5c/d23/d93/cb8 0 2024-09-13T18:30:42.266 INFO:tasks.workunit.client.0.smithi038.stdout:3/601: chown d0/dd/la2 65715 1 2024-09-13T18:30:42.267 INFO:tasks.workunit.client.0.smithi038.stdout:0/598: dread d2/dc/f51 [0,4194304] 0 2024-09-13T18:30:42.267 INFO:tasks.workunit.client.0.smithi038.stdout:0/599: dread - d2/d7/d55/f73 zero size 2024-09-13T18:30:42.269 INFO:tasks.workunit.client.0.smithi038.stdout:1/777: rename d12/d3c/d46/f94 to d12/d7a/ff2 0 2024-09-13T18:30:42.271 INFO:tasks.workunit.client.0.smithi038.stdout:3/602: truncate d0/dd/d17/d50/d5c/f47 2337601 0 2024-09-13T18:30:42.272 INFO:tasks.workunit.client.0.smithi038.stdout:0/600: rmdir d2/d7/d24/d92/d66 39 2024-09-13T18:30:42.273 INFO:tasks.workunit.client.0.smithi038.stdout:1/778: mkdir d12/d3c/d46/d57/df3 0 2024-09-13T18:30:42.278 INFO:tasks.workunit.client.0.smithi038.stdout:8/807: dwrite d1/de/d21/d24/db0/f10b [0,4194304] 0 2024-09-13T18:30:42.278 INFO:tasks.workunit.client.0.smithi038.stdout:8/808: dread - d1/de/d21/d45/d5d/d6d/fb8 zero size 2024-09-13T18:30:42.280 INFO:tasks.workunit.client.0.smithi038.stdout:0/601: rename d2/d7/d24/d2b/d95/ca9 to d2/d7/d24/dc7/cca 0 2024-09-13T18:30:42.281 INFO:tasks.workunit.client.0.smithi038.stdout:3/603: getdents d0/dd/d17/d50/d5c/d23/d6b 0 2024-09-13T18:30:42.282 INFO:tasks.workunit.client.0.smithi038.stdout:3/604: chown d0/dd/d17/d43/d89/f5f 1962166 1 2024-09-13T18:30:42.283 INFO:tasks.workunit.client.0.smithi038.stdout:1/779: dread d12/d2a/d72/dea/d84/fe6 [0,4194304] 0 2024-09-13T18:30:42.283 INFO:tasks.workunit.client.0.smithi038.stdout:1/780: chown d12/d2a/d72/dea/fb0 46 1 2024-09-13T18:30:42.286 INFO:tasks.workunit.client.0.smithi038.stdout:8/809: mknod d1/de/d4c/c10e 0 2024-09-13T18:30:42.288 INFO:tasks.workunit.client.0.smithi038.stdout:0/602: mkdir d2/d7/d24/d92/d40/d97/d98/da0/dcb 0 2024-09-13T18:30:42.288 INFO:tasks.workunit.client.0.smithi038.stdout:0/603: chown d2/d7/d24/d92/f30 2101548690 1 2024-09-13T18:30:42.288 INFO:tasks.workunit.client.0.smithi038.stdout:0/604: dread - d2/d7/d55/f9c zero size 2024-09-13T18:30:42.289 INFO:tasks.workunit.client.0.smithi038.stdout:3/605: rename d0/dd/d17/d50/d5c/d1d/d30/d95/c67 to d0/dd/d17/d43/d89/cb9 0 2024-09-13T18:30:42.289 INFO:tasks.workunit.client.0.smithi038.stdout:3/606: chown d0/dd/d17/d50/d5c/d1d/d30/d95/l98 38695017 1 2024-09-13T18:30:42.290 INFO:tasks.workunit.client.0.smithi038.stdout:3/607: stat d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/fb7 0 2024-09-13T18:30:42.290 INFO:tasks.workunit.client.0.smithi038.stdout:1/781: dread fc [0,4194304] 0 2024-09-13T18:30:42.290 INFO:tasks.workunit.client.0.smithi038.stdout:1/782: write f3 [1677213,57817] 0 2024-09-13T18:30:42.291 INFO:tasks.workunit.client.0.smithi038.stdout:8/810: truncate d1/fd9 30172 0 2024-09-13T18:30:42.294 INFO:tasks.workunit.client.0.smithi038.stdout:0/605: rename d2/d7/d55/fa3 to d2/d7/d24/d92/fcc 0 2024-09-13T18:30:42.294 INFO:tasks.workunit.client.0.smithi038.stdout:0/606: write d2/d7/d24/f84 [1319013,94325] 0 2024-09-13T18:30:42.294 INFO:tasks.workunit.client.0.smithi038.stdout:0/607: write d2/d7/d24/d92/f52 [1651814,112118] 0 2024-09-13T18:30:42.296 INFO:tasks.workunit.client.0.smithi038.stdout:3/608: mknod d0/dd/d17/d50/d5c/d23/d7c/cba 0 2024-09-13T18:30:42.296 INFO:tasks.workunit.client.0.smithi038.stdout:3/609: write d0/dd/d17/d50/d5c/d1d/d30/d95/f6a [875652,705] 0 2024-09-13T18:30:42.297 INFO:tasks.workunit.client.0.smithi038.stdout:1/783: creat d12/d2a/d32/d59/d5e/dc3/ff4 x:0 0 0 2024-09-13T18:30:42.300 INFO:tasks.workunit.client.0.smithi038.stdout:1/784: link d12/d2a/d72/dea/l99 d12/d3c/d46/d58/lf5 0 2024-09-13T18:30:42.305 INFO:tasks.workunit.client.0.smithi038.stdout:0/608: dread d2/d7/d24/d2b/f43 [0,4194304] 0 2024-09-13T18:30:42.305 INFO:tasks.workunit.client.0.smithi038.stdout:0/609: chown d2/d7/d24/l25 15 1 2024-09-13T18:30:42.306 INFO:tasks.workunit.client.0.smithi038.stdout:0/610: mknod d2/d7/d24/d92/d40/d9a/ccd 0 2024-09-13T18:30:42.309 INFO:tasks.workunit.client.0.smithi038.stdout:0/611: mkdir d2/d7/d24/d92/d66/d49/dce 0 2024-09-13T18:30:42.310 INFO:tasks.workunit.client.0.smithi038.stdout:0/612: creat d2/d7/d55/fcf x:0 0 0 2024-09-13T18:30:42.312 INFO:tasks.workunit.client.0.smithi038.stdout:0/613: creat d2/d7/d24/d92/d66/fd0 x:0 0 0 2024-09-13T18:30:42.314 INFO:tasks.workunit.client.0.smithi038.stdout:8/811: dwrite d1/de/d107/fe1 [0,4194304] 0 2024-09-13T18:30:42.318 INFO:tasks.workunit.client.0.smithi038.stdout:8/812: mkdir d1/de/d21/d24/d41/d8c/dda/df1/d10f 0 2024-09-13T18:30:42.318 INFO:tasks.workunit.client.0.smithi038.stdout:8/813: readlink d1/de/d21/d24/d4d/d50/d62/lb9 0 2024-09-13T18:30:42.318 INFO:tasks.workunit.client.0.smithi038.stdout:8/814: chown d1/de/d21/d45/l99 0 1 2024-09-13T18:30:42.318 INFO:tasks.workunit.client.0.smithi038.stdout:8/815: fsync d1/de/d21/d24/d41/f79 0 2024-09-13T18:30:42.319 INFO:tasks.workunit.client.0.smithi038.stdout:8/816: mkdir d1/de/d21/d24/d41/d80/dca/d110 0 2024-09-13T18:30:42.321 INFO:tasks.workunit.client.0.smithi038.stdout:8/817: link d1/de/d21/d24/d41/d8c/dda/c10a d1/de/d21/d45/d61/c111 0 2024-09-13T18:30:42.323 INFO:tasks.workunit.client.0.smithi038.stdout:8/818: rename d1/de/d21/d24/d41/d80/d8f/lf6 to d1/de/d21/d24/d41/db7/l112 0 2024-09-13T18:30:42.323 INFO:tasks.workunit.client.0.smithi038.stdout:8/819: truncate d1/de/d21/d24/d41/d7d/fa8 1852385 0 2024-09-13T18:30:42.323 INFO:tasks.workunit.client.0.smithi038.stdout:8/820: chown d1/de/d21/d24/d41/fdc 15233 1 2024-09-13T18:30:42.324 INFO:tasks.workunit.client.0.smithi038.stdout:1/785: dwrite d12/d2a/d32/d59/d5b/f20 [0,4194304] 0 2024-09-13T18:30:42.324 INFO:tasks.workunit.client.0.smithi038.stdout:8/821: mknod d1/de/d4c/c113 0 2024-09-13T18:30:42.325 INFO:tasks.workunit.client.0.smithi038.stdout:1/786: mkdir d12/d3c/df6 0 2024-09-13T18:30:42.332 INFO:tasks.workunit.client.0.smithi038.stdout:0/614: dwrite d2/d7/f4a [0,4194304] 0 2024-09-13T18:30:42.333 INFO:tasks.workunit.client.0.smithi038.stdout:1/787: dread d12/d2a/f51 [4194304,4194304] 0 2024-09-13T18:30:42.335 INFO:tasks.workunit.client.0.smithi038.stdout:0/615: dread d2/d7/d24/d92/fcc [0,4194304] 0 2024-09-13T18:30:42.335 INFO:tasks.workunit.client.0.smithi038.stdout:1/788: link d12/d3c/l9d d12/d3c/lf7 0 2024-09-13T18:30:42.335 INFO:tasks.workunit.client.0.smithi038.stdout:1/789: write d12/d2a/d72/fd9 [3883989,78234] 0 2024-09-13T18:30:42.336 INFO:tasks.workunit.client.0.smithi038.stdout:0/616: link d2/d7/d24/d2b/dc1/c7b d2/d7/d24/d92/d66/d49/dce/cd1 0 2024-09-13T18:30:42.339 INFO:tasks.workunit.client.0.smithi038.stdout:0/617: link d2/c6 d2/d7/d24/d2b/db6/cd2 0 2024-09-13T18:30:42.340 INFO:tasks.workunit.client.0.smithi038.stdout:1/790: getdents d12/d2a 0 2024-09-13T18:30:42.340 INFO:tasks.workunit.client.0.smithi038.stdout:1/791: dread - d12/d2a/f6f zero size 2024-09-13T18:30:42.342 INFO:tasks.workunit.client.0.smithi038.stdout:0/618: symlink d2/d7/d24/d92/d40/ld3 0 2024-09-13T18:30:42.343 INFO:tasks.workunit.client.0.smithi038.stdout:1/792: dread d12/d3c/d46/d57/da4/fab [0,4194304] 0 2024-09-13T18:30:42.344 INFO:tasks.workunit.client.0.smithi038.stdout:0/619: symlink d2/d7/d24/d92/da1/ld4 0 2024-09-13T18:30:42.345 INFO:tasks.workunit.client.0.smithi038.stdout:1/793: creat d12/d2a/d32/d82/ff8 x:0 0 0 2024-09-13T18:30:42.345 INFO:tasks.workunit.client.0.smithi038.stdout:1/794: creat d12/d3c/ff9 x:0 0 0 2024-09-13T18:30:42.345 INFO:tasks.workunit.client.0.smithi038.stdout:1/795: chown d12/d2a/d32/d59/f6a 4437 1 2024-09-13T18:30:42.345 INFO:tasks.workunit.client.0.smithi038.stdout:1/796: chown d12/d3c/db6 63 1 2024-09-13T18:30:42.347 INFO:tasks.workunit.client.0.smithi038.stdout:0/620: link d2/d7/d24/d2b/d6d/lb5 d2/d7/d24/d92/d66/d81/ld5 0 2024-09-13T18:30:42.350 INFO:tasks.workunit.client.0.smithi038.stdout:1/797: truncate d12/d3c/d46/f7c 1832931 0 2024-09-13T18:30:42.354 INFO:tasks.workunit.client.0.smithi038.stdout:1/798: link d12/d2a/d32/d82/ff8 d12/d2a/d32/d59/d5e/ffa 0 2024-09-13T18:30:42.368 INFO:tasks.workunit.client.0.smithi038.stdout:1/799: dread d12/d2a/d32/d59/d5e/dc3/fd5 [0,4194304] 0 2024-09-13T18:30:42.371 INFO:tasks.workunit.client.0.smithi038.stdout:0/621: rename d2/d7/d24/d92/d40/d97 to d2/d7/d24/d92/d40/d87/dd6 0 2024-09-13T18:30:42.371 INFO:tasks.workunit.client.0.smithi038.stdout:0/622: stat d2/d7/d24/d2b/c6a 0 2024-09-13T18:30:42.373 INFO:tasks.workunit.client.0.smithi038.stdout:1/800: creat d12/d2a/d32/d59/ffb x:0 0 0 2024-09-13T18:30:42.375 INFO:tasks.workunit.client.0.smithi038.stdout:3/610: link d0/dd/d17/d43/d89/cb9 d0/dd/d17/d79/cbb 0 2024-09-13T18:30:42.377 INFO:tasks.workunit.client.0.smithi038.stdout:1/801: mkdir d12/d2a/d72/ddc/dfc 0 2024-09-13T18:30:42.377 INFO:tasks.workunit.client.0.smithi038.stdout:3/611: dread d0/dd/d17/d50/d5c/d23/d6b/f6d [0,4194304] 0 2024-09-13T18:30:42.378 INFO:tasks.workunit.client.0.smithi038.stdout:1/802: stat d12/d3c/d46/d58/lf5 0 2024-09-13T18:30:42.383 INFO:tasks.workunit.client.0.smithi038.stdout:3/612: creat d0/dd/d17/d50/d5c/d23/d93/fbc x:0 0 0 2024-09-13T18:30:42.386 INFO:tasks.workunit.client.0.smithi038.stdout:1/803: creat d12/d2a/d72/dea/ffd x:0 0 0 2024-09-13T18:30:42.388 INFO:tasks.workunit.client.0.smithi038.stdout:1/804: mkdir d12/d7a/ddb/dfe 0 2024-09-13T18:30:42.389 INFO:tasks.workunit.client.0.smithi038.stdout:0/623: read d2/dc/f14 [2568017,13268] 0 2024-09-13T18:30:42.391 INFO:tasks.workunit.client.0.smithi038.stdout:1/805: write d12/d2a/d72/fa8 [572478,30480] 0 2024-09-13T18:30:42.393 INFO:tasks.workunit.client.0.smithi038.stdout:0/624: creat d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fd7 x:0 0 0 2024-09-13T18:30:42.395 INFO:tasks.workunit.client.0.smithi038.stdout:1/806: rename d12/d3c/f50 to d12/d2a/d72/dea/d84/da7/fff 0 2024-09-13T18:30:42.399 INFO:tasks.workunit.client.0.smithi038.stdout:1/807: creat d12/d7a/ddb/f100 x:0 0 0 2024-09-13T18:30:42.399 INFO:tasks.workunit.client.0.smithi038.stdout:1/808: truncate d12/d2a/fd1 458341 0 2024-09-13T18:30:42.401 INFO:tasks.workunit.client.0.smithi038.stdout:1/809: dread d12/d2a/d32/d59/d5b/fcb [0,4194304] 0 2024-09-13T18:30:42.410 INFO:tasks.workunit.client.0.smithi038.stdout:3/613: dwrite d0/dd/d17/d50/d5c/d1d/d30/d95/f68 [0,4194304] 0 2024-09-13T18:30:42.410 INFO:tasks.workunit.client.0.smithi038.stdout:3/614: write d0/dd/d17/d50/d5c/d23/d52/d6e/f9f [760350,43791] 0 2024-09-13T18:30:42.411 INFO:tasks.workunit.client.0.smithi038.stdout:1/810: rmdir d12/d2a/d32/d59/d5e/dc3 39 2024-09-13T18:30:42.413 INFO:tasks.workunit.client.0.smithi038.stdout:8/822: rmdir d1/de/d21/d24 39 2024-09-13T18:30:42.415 INFO:tasks.workunit.client.0.smithi038.stdout:0/625: dwrite d2/d7/d24/d92/d66/d81/fb4 [0,4194304] 0 2024-09-13T18:30:42.416 INFO:tasks.workunit.client.0.smithi038.stdout:3/615: creat d0/dd/d17/d50/d5c/d1d/d30/fbd x:0 0 0 2024-09-13T18:30:42.416 INFO:tasks.workunit.client.0.smithi038.stdout:3/616: fsync d0/dd/d17/d50/d5c/d1d/d30/f74 0 2024-09-13T18:30:42.420 INFO:tasks.workunit.client.0.smithi038.stdout:1/811: truncate d12/d2a/d72/dea/f80 3605515 0 2024-09-13T18:30:42.420 INFO:tasks.workunit.client.0.smithi038.stdout:8/823: mkdir d1/de/d21/d24/d41/d80/dca/d114 0 2024-09-13T18:30:42.426 INFO:tasks.workunit.client.0.smithi038.stdout:0/626: rename d2/d7/l3a to d2/d7/d24/d92/d40/d87/dd6/d98/dc5/ld8 0 2024-09-13T18:30:42.431 INFO:tasks.workunit.client.0.smithi038.stdout:3/617: symlink d0/dd/d17/d79/lbe 0 2024-09-13T18:30:42.432 INFO:tasks.workunit.client.0.smithi038.stdout:1/812: symlink d12/d2a/d8e/l101 0 2024-09-13T18:30:42.432 INFO:tasks.workunit.client.0.smithi038.stdout:1/813: read d12/d2a/f4c [189106,223] 0 2024-09-13T18:30:42.433 INFO:tasks.workunit.client.0.smithi038.stdout:8/824: rename d1/de/d21/d24/fc8 to d1/de/d21/d24/d4d/da6/f115 0 2024-09-13T18:30:42.434 INFO:tasks.workunit.client.0.smithi038.stdout:0/627: chown d2/dc/c18 173755476 1 2024-09-13T18:30:42.436 INFO:tasks.workunit.client.0.smithi038.stdout:1/814: mkdir d12/d3c/d46/d57/da4/de2/d102 0 2024-09-13T18:30:42.436 INFO:tasks.workunit.client.0.smithi038.stdout:1/815: write d12/d3c/d46/d57/f6e [252659,108911] 0 2024-09-13T18:30:42.436 INFO:tasks.workunit.client.0.smithi038.stdout:8/825: rmdir d1/de/d21/d24/d41/d8c/dda 39 2024-09-13T18:30:42.439 INFO:tasks.workunit.client.0.smithi038.stdout:8/826: mknod d1/de/d21/d24/d41/d8c/dda/c116 0 2024-09-13T18:30:42.440 INFO:tasks.workunit.client.0.smithi038.stdout:3/618: read d0/dd/d17/d50/d5c/d1d/d30/d95/f49 [3398200,61107] 0 2024-09-13T18:30:42.440 INFO:tasks.workunit.client.0.smithi038.stdout:3/619: chown d0/dd/d17/d79/cbb 2 1 2024-09-13T18:30:42.440 INFO:tasks.workunit.client.0.smithi038.stdout:0/628: mknod d2/d7/cd9 0 2024-09-13T18:30:42.443 INFO:tasks.workunit.client.0.smithi038.stdout:8/827: mkdir d1/de/d21/d24/d41/d117 0 2024-09-13T18:30:42.444 INFO:tasks.workunit.client.0.smithi038.stdout:3/620: truncate d0/dd/d17/d50/d5c/d1d/d30/d95/d84/f90 1648521 0 2024-09-13T18:30:42.446 INFO:tasks.workunit.client.0.smithi038.stdout:0/629: mkdir d2/d7/d24/d92/d66/dda 0 2024-09-13T18:30:42.446 INFO:tasks.workunit.client.0.smithi038.stdout:0/630: chown d2/c9f 21446235 1 2024-09-13T18:30:42.446 INFO:tasks.workunit.client.0.smithi038.stdout:0/631: chown d2/d7/d24/dc7/cca 142 1 2024-09-13T18:30:42.446 INFO:tasks.workunit.client.0.smithi038.stdout:0/632: read - d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f79 zero size 2024-09-13T18:30:42.446 INFO:tasks.workunit.client.0.smithi038.stdout:0/633: fsync d2/d7/d24/d92/da1/fbb 0 2024-09-13T18:30:42.446 INFO:tasks.workunit.client.0.smithi038.stdout:0/634: truncate d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fae 364340 0 2024-09-13T18:30:42.448 INFO:tasks.workunit.client.0.smithi038.stdout:8/828: mknod d1/de/d21/d45/c118 0 2024-09-13T18:30:42.450 INFO:tasks.workunit.client.0.smithi038.stdout:1/816: dread d12/d3c/f40 [0,4194304] 0 2024-09-13T18:30:42.452 INFO:tasks.workunit.client.0.smithi038.stdout:0/635: unlink d2/dc/f3e 0 2024-09-13T18:30:42.452 INFO:tasks.workunit.client.0.smithi038.stdout:0/636: chown d2/d7/d24/d92/d40/d9a/fc6 266991811 1 2024-09-13T18:30:42.452 INFO:tasks.workunit.client.0.smithi038.stdout:1/817: read d12/d2a/d72/dea/d84/da7/fb4 [265891,123558] 0 2024-09-13T18:30:42.452 INFO:tasks.workunit.client.0.smithi038.stdout:0/637: write d2/d7/d24/d2b/f37 [3828023,57206] 0 2024-09-13T18:30:42.453 INFO:tasks.workunit.client.0.smithi038.stdout:1/818: creat d12/d2a/d32/d59/d5e/f103 x:0 0 0 2024-09-13T18:30:42.455 INFO:tasks.workunit.client.0.smithi038.stdout:0/638: rename d2/d7/c12 to d2/d7/d24/dc7/cdb 0 2024-09-13T18:30:42.458 INFO:tasks.workunit.client.0.smithi038.stdout:0/639: unlink d2/d7/d24/d2b/c94 0 2024-09-13T18:30:42.462 INFO:tasks.workunit.client.0.smithi038.stdout:8/829: write d1/de/d21/d24/d41/d8c/fbf [2881865,39243] 0 2024-09-13T18:30:42.466 INFO:tasks.workunit.client.0.smithi038.stdout:3/621: dwrite d0/dd/d17/d50/d59/fb0 [4194304,4194304] 0 2024-09-13T18:30:42.466 INFO:tasks.workunit.client.0.smithi038.stdout:3/622: write d0/dd/d17/d50/d59/f6f [2892912,86876] 0 2024-09-13T18:30:42.468 INFO:tasks.workunit.client.0.smithi038.stdout:8/830: rename d1/de/cd2 to d1/de/d21/d24/d41/db7/c119 0 2024-09-13T18:30:42.469 INFO:tasks.workunit.client.0.smithi038.stdout:8/831: read d1/ff [198716,79832] 0 2024-09-13T18:30:42.481 INFO:tasks.workunit.client.0.smithi038.stdout:8/832: dread d1/de/d21/d24/d4d/d50/fa0 [0,4194304] 0 2024-09-13T18:30:42.490 INFO:tasks.workunit.client.0.smithi038.stdout:1/819: dwrite d12/d2a/f4c [0,4194304] 0 2024-09-13T18:30:42.491 INFO:tasks.workunit.client.0.smithi038.stdout:0/640: dwrite d2/d7/d24/d92/d66/d49/f65 [0,4194304] 0 2024-09-13T18:30:42.491 INFO:tasks.workunit.client.0.smithi038.stdout:0/641: fdatasync d2/d7/d24/d92/fcc 0 2024-09-13T18:30:42.493 INFO:tasks.workunit.client.0.smithi038.stdout:3/623: dwrite d0/dd/d17/d50/d5c/d23/d6b/f78 [0,4194304] 0 2024-09-13T18:30:42.500 INFO:tasks.workunit.client.0.smithi038.stdout:8/833: dwrite d1/de/d21/d45/f97 [0,4194304] 0 2024-09-13T18:30:42.503 INFO:tasks.workunit.client.0.smithi038.stdout:0/642: truncate d2/d7/d24/d92/d40/d9a/fbd 550303 0 2024-09-13T18:30:42.503 INFO:tasks.workunit.client.0.smithi038.stdout:0/643: truncate d2/d7/d24/d2b/f43 4276072 0 2024-09-13T18:30:42.504 INFO:tasks.workunit.client.0.smithi038.stdout:0/644: fsync d2/dc/f62 0 2024-09-13T18:30:42.510 INFO:tasks.workunit.client.0.smithi038.stdout:8/834: mkdir d1/de/d21/d24/d4d/dee/d11a 0 2024-09-13T18:30:42.514 INFO:tasks.workunit.client.0.smithi038.stdout:3/624: dread d0/f2 [0,4194304] 0 2024-09-13T18:30:42.514 INFO:tasks.workunit.client.0.smithi038.stdout:3/625: creat d0/dd/d17/d50/d5c/fbf x:0 0 0 2024-09-13T18:30:42.514 INFO:tasks.workunit.client.0.smithi038.stdout:0/645: symlink d2/d7/d24/d92/d40/d87/dd6/d98/dc5/d3f/ldc 0 2024-09-13T18:30:42.520 INFO:tasks.workunit.client.0.smithi038.stdout:3/626: mknod d0/dd/d17/d50/d5c/d23/d7c/d9c/cc0 0 2024-09-13T18:30:42.521 INFO:tasks.workunit.client.0.smithi038.stdout:1/820: dwrite d12/d2a/d8e/fd7 [0,4194304] 0 2024-09-13T18:30:42.524 INFO:tasks.workunit.client.0.smithi038.stdout:3/627: link d0/dd/d17/d50/d5c/d23/d52/f8c d0/dd/d17/d50/d5c/d23/fc1 0 2024-09-13T18:30:42.529 INFO:tasks.workunit.client.0.smithi038.stdout:1/821: getdents d12/d2a/d8e 0 2024-09-13T18:30:42.533 INFO:tasks.workunit.client.0.smithi038.stdout:1/822: creat d12/d3c/df6/f104 x:0 0 0 2024-09-13T18:30:42.533 INFO:tasks.workunit.client.0.smithi038.stdout:1/823: dread - d12/d3c/d46/d58/fdf zero size 2024-09-13T18:30:42.533 INFO:tasks.workunit.client.0.smithi038.stdout:0/646: dwrite d2/dc/f50 [4194304,4194304] 0 2024-09-13T18:30:42.533 INFO:tasks.workunit.client.0.smithi038.stdout:0/647: fsync d2/f96 0 2024-09-13T18:30:42.534 INFO:tasks.workunit.client.0.smithi038.stdout:0/648: fdatasync d2/d7/d24/d92/f52 0 2024-09-13T18:30:42.534 INFO:tasks.workunit.client.0.smithi038.stdout:0/649: fdatasync d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fae 0 2024-09-13T18:30:42.536 INFO:tasks.workunit.client.0.smithi038.stdout:1/824: getdents d12/d7a/ddb 0 2024-09-13T18:30:42.537 INFO:tasks.workunit.client.0.smithi038.stdout:1/825: rmdir d12/d2a/d32/d59/d5e/daf 39 2024-09-13T18:30:42.539 INFO:tasks.workunit.client.0.smithi038.stdout:1/826: unlink d12/d2a/d72/dea/d84/l9a 0 2024-09-13T18:30:42.541 INFO:tasks.workunit.client.0.smithi038.stdout:1/827: rename d12/d2a/d72/dea/ffd to d12/d2a/d8e/f105 0 2024-09-13T18:30:42.546 INFO:tasks.workunit.client.0.smithi038.stdout:3/628: dwrite d0/dd/d17/d50/d5c/d1d/d30/d95/f49 [4194304,4194304] 0 2024-09-13T18:30:42.550 INFO:tasks.workunit.client.0.smithi038.stdout:3/629: symlink d0/lc2 0 2024-09-13T18:30:42.555 INFO:tasks.workunit.client.0.smithi038.stdout:0/650: dwrite d2/d7/d24/d92/d66/f85 [0,4194304] 0 2024-09-13T18:30:42.558 INFO:tasks.workunit.client.0.smithi038.stdout:1/828: link d12/d2a/d8e/f105 d12/d3c/d46/d57/def/f106 0 2024-09-13T18:30:42.558 INFO:tasks.workunit.client.0.smithi038.stdout:1/829: chown d12/d2a/d32/d82/cac 226017 1 2024-09-13T18:30:42.560 INFO:tasks.workunit.client.0.smithi038.stdout:0/651: unlink d2/d7/d24/dc7/cca 0 2024-09-13T18:30:42.561 INFO:tasks.workunit.client.0.smithi038.stdout:1/830: rename d12/d2a/f4c to d12/d3c/d46/d57/f107 0 2024-09-13T18:30:42.562 INFO:tasks.workunit.client.0.smithi038.stdout:1/831: mknod d12/d2a/d8e/c108 0 2024-09-13T18:30:42.567 INFO:tasks.workunit.client.0.smithi038.stdout:4/960: sync 2024-09-13T18:30:42.567 INFO:tasks.workunit.client.0.smithi038.stdout:4/961: creat d2/df/d22/d9a/f13f x:0 0 0 2024-09-13T18:30:42.569 INFO:tasks.workunit.client.0.smithi038.stdout:0/652: dread d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f46 [0,4194304] 0 2024-09-13T18:30:42.569 INFO:tasks.workunit.client.0.smithi038.stdout:4/962: rename d2/fc4 to d2/d49/d4b/dc0/d11b/f140 0 2024-09-13T18:30:42.571 INFO:tasks.workunit.client.0.smithi038.stdout:0/653: rename d2/dc/f62 to d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fdd 0 2024-09-13T18:30:42.572 INFO:tasks.workunit.client.0.smithi038.stdout:1/832: dread d12/f7d [0,4194304] 0 2024-09-13T18:30:42.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/654: creat d2/d7/d24/d92/d40/d87/d8f/fde x:0 0 0 2024-09-13T18:30:42.573 INFO:tasks.workunit.client.0.smithi038.stdout:3/630: dwrite d0/dd/d17/d50/d5c/f21 [0,4194304] 0 2024-09-13T18:30:42.573 INFO:tasks.workunit.client.0.smithi038.stdout:1/833: creat d12/d2a/d72/d8d/f109 x:0 0 0 2024-09-13T18:30:42.574 INFO:tasks.workunit.client.0.smithi038.stdout:1/834: creat d12/d2a/d72/d8d/f10a x:0 0 0 2024-09-13T18:30:42.575 INFO:tasks.workunit.client.0.smithi038.stdout:3/631: truncate d0/dd/d17/d50/d5c/d1d/d30/f74 2401593 0 2024-09-13T18:30:42.575 INFO:tasks.workunit.client.0.smithi038.stdout:3/632: stat d0/dd/d17/d43 0 2024-09-13T18:30:42.575 INFO:tasks.workunit.client.0.smithi038.stdout:3/633: truncate d0/dd/d17/d50/d5c/d23/d6b/f9b 173899 0 2024-09-13T18:30:42.577 INFO:tasks.workunit.client.0.smithi038.stdout:3/634: symlink d0/dd/d17/d50/lc3 0 2024-09-13T18:30:42.579 INFO:tasks.workunit.client.0.smithi038.stdout:1/835: rename d12/d2a/d32/d59 to d12/d3c/d46/d58/d10b 0 2024-09-13T18:30:42.580 INFO:tasks.workunit.client.0.smithi038.stdout:1/836: creat d12/d3c/d46/d58/d10b/f10c x:0 0 0 2024-09-13T18:30:42.580 INFO:tasks.workunit.client.0.smithi038.stdout:1/837: fsync d12/d3c/d46/d57/da4/fab 0 2024-09-13T18:30:42.591 INFO:tasks.workunit.client.0.smithi038.stdout:0/655: write d2/dc/f28 [991530,70829] 0 2024-09-13T18:30:42.595 INFO:tasks.workunit.client.0.smithi038.stdout:0/656: creat d2/d7/d24/d92/d66/dda/fdf x:0 0 0 2024-09-13T18:30:42.596 INFO:tasks.workunit.client.0.smithi038.stdout:0/657: chown d2/d7/d24/d92/d40/d87/d8f 2481 1 2024-09-13T18:30:42.596 INFO:tasks.workunit.client.0.smithi038.stdout:0/658: dread - d2/f96 zero size 2024-09-13T18:30:42.600 INFO:tasks.workunit.client.0.smithi038.stdout:3/635: dwrite d0/dd/d17/d50/d59/f6f [0,4194304] 0 2024-09-13T18:30:42.600 INFO:tasks.workunit.client.0.smithi038.stdout:3/636: chown d0/dd/d17/d43/d89/f85 8275 1 2024-09-13T18:30:42.601 INFO:tasks.workunit.client.0.smithi038.stdout:3/637: creat d0/dd/d17/fc4 x:0 0 0 2024-09-13T18:30:42.601 INFO:tasks.workunit.client.0.smithi038.stdout:3/638: chown d0/dd/d17/f81 969548080 1 2024-09-13T18:30:42.601 INFO:tasks.workunit.client.0.smithi038.stdout:4/963: dwrite d2/de5/f10c [0,4194304] 0 2024-09-13T18:30:42.601 INFO:tasks.workunit.client.0.smithi038.stdout:4/964: write d2/d49/f5b [2617309,64245] 0 2024-09-13T18:30:42.605 INFO:tasks.workunit.client.0.smithi038.stdout:4/965: dread d2/d49/f90 [0,4194304] 0 2024-09-13T18:30:42.605 INFO:tasks.workunit.client.0.smithi038.stdout:4/966: creat d2/d49/d4b/dbc/f141 x:0 0 0 2024-09-13T18:30:42.605 INFO:tasks.workunit.client.0.smithi038.stdout:3/639: rename d0/dd/d17/d43/l4b to d0/dd/d17/d50/lc5 0 2024-09-13T18:30:42.609 INFO:tasks.workunit.client.0.smithi038.stdout:3/640: mkdir d0/dd/d17/d43/dc6 0 2024-09-13T18:30:42.612 INFO:tasks.workunit.client.0.smithi038.stdout:3/641: truncate d0/dd/d17/faf 182966 0 2024-09-13T18:30:42.613 INFO:tasks.workunit.client.0.smithi038.stdout:3/642: rename d0/dd/d17/d50/d5c/d1d/d30/d95/f68 to d0/dd/d17/d50/d5c/d23/d93/fc7 0 2024-09-13T18:30:42.613 INFO:tasks.workunit.client.0.smithi038.stdout:3/643: chown d0/dd/d17/d43/d89/f5f 22519933 1 2024-09-13T18:30:42.615 INFO:tasks.workunit.client.0.smithi038.stdout:3/644: rename d0/dd/d17/d50/d5c/d1d/d30/l9e to d0/dd/d17/d50/d5c/d1d/d30/lc8 0 2024-09-13T18:30:42.615 INFO:tasks.workunit.client.0.smithi038.stdout:3/645: fdatasync d0/dd/d17/d50/d5c/f99 0 2024-09-13T18:30:42.615 INFO:tasks.workunit.client.0.smithi038.stdout:3/646: fsync d0/dd/d17/d50/d5c/d1d/d30/d95/f6a 0 2024-09-13T18:30:42.615 INFO:tasks.workunit.client.0.smithi038.stdout:1/838: dwrite d12/d3c/d46/d58/d10b/d5e/f61 [0,4194304] 0 2024-09-13T18:30:42.615 INFO:tasks.workunit.client.0.smithi038.stdout:1/839: readlink d12/l3f 0 2024-09-13T18:30:42.615 INFO:tasks.workunit.client.0.smithi038.stdout:1/840: fdatasync d12/d3c/d46/d58/d10b/d5b/f1e 0 2024-09-13T18:30:42.615 INFO:tasks.workunit.client.0.smithi038.stdout:0/659: dwrite d2/d7/d24/d92/d66/d49/fc3 [0,4194304] 0 2024-09-13T18:30:42.615 INFO:tasks.workunit.client.0.smithi038.stdout:0/660: write d2/dc/f28 [2024953,109380] 0 2024-09-13T18:30:42.617 INFO:tasks.workunit.client.0.smithi038.stdout:3/647: rename d0/dd/d17/d50/d5c/d1d/d30/d95/f36 to d0/dd/d17/d50/d5c/d1d/d30/d95/da6/fc9 0 2024-09-13T18:30:42.617 INFO:tasks.workunit.client.0.smithi038.stdout:1/841: truncate d12/d3c/d46/d57/f97 929271 0 2024-09-13T18:30:42.621 INFO:tasks.workunit.client.0.smithi038.stdout:3/648: mknod d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/cca 0 2024-09-13T18:30:42.625 INFO:tasks.workunit.client.0.smithi038.stdout:4/967: read d2/df/d1b/d10/f25 [1431216,79576] 0 2024-09-13T18:30:42.625 INFO:tasks.workunit.client.0.smithi038.stdout:4/968: write d2/df/d22/f70 [4449696,61189] 0 2024-09-13T18:30:42.625 INFO:tasks.workunit.client.0.smithi038.stdout:4/969: readlink d2/df/d1b/d10/d75/lac 0 2024-09-13T18:30:42.625 INFO:tasks.workunit.client.0.smithi038.stdout:4/970: readlink d2/d49/d4b/dbc/l101 0 2024-09-13T18:30:42.625 INFO:tasks.workunit.client.0.smithi038.stdout:0/661: dread d2/d7/d24/d2b/dc1/f77 [0,4194304] 0 2024-09-13T18:30:42.628 INFO:tasks.workunit.client.0.smithi038.stdout:4/971: rename d2/df/d1b/d10/d75/f10d to d2/df/d1b/d10/d55/dfb/f142 0 2024-09-13T18:30:42.628 INFO:tasks.workunit.client.0.smithi038.stdout:4/972: truncate d2/d49/d50/da0/f8d 747035 0 2024-09-13T18:30:42.628 INFO:tasks.workunit.client.0.smithi038.stdout:4/973: write d2/df/d1b/d10/f3d [9134192,92646] 0 2024-09-13T18:30:42.629 INFO:tasks.workunit.client.0.smithi038.stdout:0/662: mkdir d2/d7/d24/d92/d40/d87/dd6/d98/da0/de0 0 2024-09-13T18:30:42.632 INFO:tasks.workunit.client.0.smithi038.stdout:4/974: unlink d2/d49/d50/da0/d8/f2e 0 2024-09-13T18:30:42.634 INFO:tasks.workunit.client.0.smithi038.stdout:4/975: dread d2/df/f7a [0,4194304] 0 2024-09-13T18:30:42.634 INFO:tasks.workunit.client.0.smithi038.stdout:0/663: truncate d2/dc/f14 377288 0 2024-09-13T18:30:42.636 INFO:tasks.workunit.client.0.smithi038.stdout:1/842: dwrite d12/d3c/db6/fc6 [0,4194304] 0 2024-09-13T18:30:42.636 INFO:tasks.workunit.client.0.smithi038.stdout:1/843: creat d12/d7a/f10d x:0 0 0 2024-09-13T18:30:42.645 INFO:tasks.workunit.client.0.smithi038.stdout:1/844: creat d12/d7a/ddb/f10e x:0 0 0 2024-09-13T18:30:42.645 INFO:tasks.workunit.client.0.smithi038.stdout:1/845: truncate d12/d7a/f10d 208052 0 2024-09-13T18:30:42.646 INFO:tasks.workunit.client.0.smithi038.stdout:1/846: fsync d12/d2a/f64 0 2024-09-13T18:30:42.646 INFO:tasks.workunit.client.0.smithi038.stdout:1/847: chown d12/c2e 1610 1 2024-09-13T18:30:42.646 INFO:tasks.workunit.client.0.smithi038.stdout:3/649: dwrite d0/fa [0,4194304] 0 2024-09-13T18:30:42.646 INFO:tasks.workunit.client.0.smithi038.stdout:3/650: write d0/dd/d17/d50/d5c/d23/fc1 [885015,57247] 0 2024-09-13T18:30:42.650 INFO:tasks.workunit.client.0.smithi038.stdout:3/651: getdents d0/dd/d17/d50/d5c 0 2024-09-13T18:30:42.650 INFO:tasks.workunit.client.0.smithi038.stdout:3/652: readlink d0/dd/d17/d50/d5c/d1d/d30/l3e 0 2024-09-13T18:30:42.650 INFO:tasks.workunit.client.0.smithi038.stdout:3/653: chown d0/dd/d17/d50/c53 5694254 1 2024-09-13T18:30:42.653 INFO:tasks.workunit.client.0.smithi038.stdout:0/664: dwrite d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fb3 [0,4194304] 0 2024-09-13T18:30:42.653 INFO:tasks.workunit.client.0.smithi038.stdout:0/665: chown d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f53 1931864 1 2024-09-13T18:30:42.653 INFO:tasks.workunit.client.0.smithi038.stdout:0/666: chown d2/dc/l80 3 1 2024-09-13T18:30:42.656 INFO:tasks.workunit.client.0.smithi038.stdout:1/848: write d12/d3c/d46/d58/d10b/d5b/f22 [471209,10079] 0 2024-09-13T18:30:42.658 INFO:tasks.workunit.client.0.smithi038.stdout:3/654: rmdir d0/dd/d17/d50/d59 39 2024-09-13T18:30:42.666 INFO:tasks.workunit.client.0.smithi038.stdout:3/655: write d0/dd/d17/d50/d5c/d1d/d30/d95/f4d [3222399,118519] 0 2024-09-13T18:30:42.673 INFO:tasks.workunit.client.0.smithi038.stdout:3/656: dread d0/dd/fe [0,4194304] 0 2024-09-13T18:30:42.673 INFO:tasks.workunit.client.0.smithi038.stdout:3/657: dread - d0/dd/d17/d43/fb4 zero size 2024-09-13T18:30:42.677 INFO:tasks.workunit.client.0.smithi038.stdout:0/667: dwrite d2/d7/d24/d2b/dc1/db7/fc9 [0,4194304] 0 2024-09-13T18:30:42.679 INFO:tasks.workunit.client.0.smithi038.stdout:0/668: mkdir d2/d7/de1 0 2024-09-13T18:30:42.679 INFO:tasks.workunit.client.0.smithi038.stdout:0/669: fdatasync d2/dc/f14 0 2024-09-13T18:30:42.683 INFO:tasks.workunit.client.0.smithi038.stdout:1/849: dwrite d12/d3c/d46/d57/def/f106 [0,4194304] 0 2024-09-13T18:30:42.697 INFO:tasks.workunit.client.0.smithi038.stdout:3/658: dwrite d0/dd/d17/f70 [0,4194304] 0 2024-09-13T18:30:42.714 INFO:tasks.workunit.client.0.smithi038.stdout:1/850: dwrite d12/d3c/db6/fc6 [0,4194304] 0 2024-09-13T18:30:42.742 INFO:tasks.workunit.client.0.smithi038.stdout:0/670: dwrite d2/d7/d24/d92/f30 [0,4194304] 0 2024-09-13T18:30:42.744 INFO:tasks.workunit.client.0.smithi038.stdout:1/851: unlink d12/d3c/d46/d57/f6e 0 2024-09-13T18:30:42.745 INFO:tasks.workunit.client.0.smithi038.stdout:1/852: write d12/d3c/d46/d58/f79 [1301005,88610] 0 2024-09-13T18:30:42.748 INFO:tasks.workunit.client.0.smithi038.stdout:3/659: dwrite d0/dd/d17/d43/d89/f5f [0,4194304] 0 2024-09-13T18:30:42.760 INFO:tasks.workunit.client.0.smithi038.stdout:0/671: truncate d2/d7/f9 3179255 0 2024-09-13T18:30:42.764 INFO:tasks.workunit.client.0.smithi038.stdout:3/660: mkdir d0/dd/d17/d50/d5c/d1d/dcb 0 2024-09-13T18:30:42.765 INFO:tasks.workunit.client.0.smithi038.stdout:3/661: fsync d0/dd/d17/d43/d89/f5f 0 2024-09-13T18:30:42.765 INFO:tasks.workunit.client.0.smithi038.stdout:3/662: chown d0/dd/d17/d50/d5c/f55 1001925780 1 2024-09-13T18:30:42.765 INFO:tasks.workunit.client.0.smithi038.stdout:1/853: dwrite d12/d2a/fa0 [0,4194304] 0 2024-09-13T18:30:42.765 INFO:tasks.workunit.client.0.smithi038.stdout:1/854: write ff [3006071,39380] 0 2024-09-13T18:30:42.765 INFO:tasks.workunit.client.0.smithi038.stdout:1/855: write d12/f17 [2155528,27] 0 2024-09-13T18:30:42.766 INFO:tasks.workunit.client.0.smithi038.stdout:3/663: mkdir d0/dd/d17/d50/d5c/d1d/dcc 0 2024-09-13T18:30:42.771 INFO:tasks.workunit.client.0.smithi038.stdout:1/856: rename d12/d3c/d46/d57/da4/de2/d102 to d12/d2a/d32/d10f 0 2024-09-13T18:30:42.772 INFO:tasks.workunit.client.0.smithi038.stdout:1/857: creat d12/d7a/f110 x:0 0 0 2024-09-13T18:30:42.772 INFO:tasks.workunit.client.0.smithi038.stdout:1/858: chown d12/d3c/d46 115053606 1 2024-09-13T18:30:42.772 INFO:tasks.workunit.client.0.smithi038.stdout:1/859: stat d12/f25 0 2024-09-13T18:30:42.772 INFO:tasks.workunit.client.0.smithi038.stdout:3/664: link d0/dd/d17/d50/d5c/d23/d93/fab d0/dd/d17/d50/d5c/d1d/d30/fcd 0 2024-09-13T18:30:42.778 INFO:tasks.workunit.client.0.smithi038.stdout:1/860: mkdir d12/d3c/d46/d58/d10b/d5b/d111 0 2024-09-13T18:30:42.779 INFO:tasks.workunit.client.0.smithi038.stdout:1/861: getdents d12/d3c/d46/d57 0 2024-09-13T18:30:42.779 INFO:tasks.workunit.client.0.smithi038.stdout:1/862: fdatasync d12/d3c/d46/f7c 0 2024-09-13T18:30:42.782 INFO:tasks.workunit.client.0.smithi038.stdout:1/863: mkdir d12/d2a/d72/dea/d112 0 2024-09-13T18:30:42.782 INFO:tasks.workunit.client.0.smithi038.stdout:1/864: readlink d12/l31 0 2024-09-13T18:30:42.782 INFO:tasks.workunit.client.0.smithi038.stdout:1/865: write d12/d3c/d46/d58/d10b/d5e/f103 [709536,43013] 0 2024-09-13T18:30:42.782 INFO:tasks.workunit.client.0.smithi038.stdout:1/866: stat d12/d3c/d46/d58/d10b/f10c 0 2024-09-13T18:30:42.782 INFO:tasks.workunit.client.0.smithi038.stdout:0/672: dwrite d2/d7/d55/fbc [0,4194304] 0 2024-09-13T18:30:42.784 INFO:tasks.workunit.client.0.smithi038.stdout:0/673: readlink d2/d7/d24/d92/d66/d81/ld5 0 2024-09-13T18:30:42.784 INFO:tasks.workunit.client.0.smithi038.stdout:0/674: fsync d2/f96 0 2024-09-13T18:30:42.784 INFO:tasks.workunit.client.0.smithi038.stdout:0/675: truncate d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f79 603211 0 2024-09-13T18:30:42.784 INFO:tasks.workunit.client.0.smithi038.stdout:0/676: write d2/d7/d55/fcf [511194,71640] 0 2024-09-13T18:30:42.784 INFO:tasks.workunit.client.0.smithi038.stdout:0/677: chown d2/dc/cb1 0 1 2024-09-13T18:30:42.784 INFO:tasks.workunit.client.0.smithi038.stdout:0/678: stat d2/d7/d24/d92/d40/d87/dd6/d98/da0/de0 0 2024-09-13T18:30:42.785 INFO:tasks.workunit.client.0.smithi038.stdout:0/679: mkdir d2/d7/d24/d92/d40/d87/dd6/d98/dc5/d3f/de2 0 2024-09-13T18:30:42.788 INFO:tasks.workunit.client.0.smithi038.stdout:0/680: rmdir d2/d7/d24/d92/d40/d87/d8f 39 2024-09-13T18:30:42.792 INFO:tasks.workunit.client.0.smithi038.stdout:3/665: dwrite d0/dd/d17/f73 [0,4194304] 0 2024-09-13T18:30:42.792 INFO:tasks.workunit.client.0.smithi038.stdout:3/666: chown d0/dd/d17/f81 4673260 1 2024-09-13T18:30:42.792 INFO:tasks.workunit.client.0.smithi038.stdout:3/667: chown d0/dd/d17/d50/d5c/d23/d7c 0 1 2024-09-13T18:30:42.793 INFO:tasks.workunit.client.0.smithi038.stdout:3/668: dread d0/dd/d17/d43/d89/f85 [0,4194304] 0 2024-09-13T18:30:42.794 INFO:tasks.workunit.client.0.smithi038.stdout:3/669: getdents d0/dd/d17/d50/d5c/d23/d6b 0 2024-09-13T18:30:42.800 INFO:tasks.workunit.client.0.smithi038.stdout:3/670: mknod d0/dd/d17/d50/d59/cce 0 2024-09-13T18:30:42.800 INFO:tasks.workunit.client.0.smithi038.stdout:3/671: readlink d0/dd/d17/d50/d59/l7a 0 2024-09-13T18:30:42.800 INFO:tasks.workunit.client.0.smithi038.stdout:3/672: chown d0/dd/d17/d50 909349 1 2024-09-13T18:30:42.800 INFO:tasks.workunit.client.0.smithi038.stdout:3/673: dread - d0/dd/d17/d43/fb4 zero size 2024-09-13T18:30:42.801 INFO:tasks.workunit.client.0.smithi038.stdout:3/674: readlink d0/dd/d17/d50/d5c/d1d/l38 0 2024-09-13T18:30:42.802 INFO:tasks.workunit.client.0.smithi038.stdout:3/675: getdents d0/dd/d17/d43/d89 0 2024-09-13T18:30:42.802 INFO:tasks.workunit.client.0.smithi038.stdout:3/676: chown d0/dd/d17/d50/cb1 24556399 1 2024-09-13T18:30:42.802 INFO:tasks.workunit.client.0.smithi038.stdout:3/677: stat d0/dd/d17/f1c 0 2024-09-13T18:30:42.803 INFO:tasks.workunit.client.0.smithi038.stdout:3/678: fdatasync d0/dd/d17/d50/d5c/d23/d6b/f78 0 2024-09-13T18:30:42.803 INFO:tasks.workunit.client.0.smithi038.stdout:3/679: chown d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/fb7 9 1 2024-09-13T18:30:42.803 INFO:tasks.workunit.client.0.smithi038.stdout:3/680: rename d0/dd/d17 to d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/dcf 22 2024-09-13T18:30:42.803 INFO:tasks.workunit.client.0.smithi038.stdout:0/681: dwrite d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fd7 [0,4194304] 0 2024-09-13T18:30:42.804 INFO:tasks.workunit.client.0.smithi038.stdout:1/867: getdents d12/d3c/d46/d58/d10b/d5b 0 2024-09-13T18:30:42.804 INFO:tasks.workunit.client.0.smithi038.stdout:1/868: creat d12/d7a/ddb/f113 x:0 0 0 2024-09-13T18:30:42.806 INFO:tasks.workunit.client.0.smithi038.stdout:3/681: truncate d0/fa 3530061 0 2024-09-13T18:30:42.806 INFO:tasks.workunit.client.0.smithi038.stdout:3/682: fdatasync d0/dd/d17/d50/d5c/d23/d6b/f6d 0 2024-09-13T18:30:42.806 INFO:tasks.workunit.client.0.smithi038.stdout:3/683: chown d0/dd/d17/d50/d5c/d23/d6b 1183431041 1 2024-09-13T18:30:42.806 INFO:tasks.workunit.client.0.smithi038.stdout:3/684: fdatasync d0/dd/d17/d50/d5c/d23/d6b/f9b 0 2024-09-13T18:30:42.806 INFO:tasks.workunit.client.0.smithi038.stdout:9/601: sync 2024-09-13T18:30:42.806 INFO:tasks.workunit.client.0.smithi038.stdout:2/575: sync 2024-09-13T18:30:42.806 INFO:tasks.workunit.client.0.smithi038.stdout:2/576: creat d2/d5c/dbb/fd1 x:0 0 0 2024-09-13T18:30:42.806 INFO:tasks.workunit.client.0.smithi038.stdout:2/577: fsync d2/d1e/d87/f89 0 2024-09-13T18:30:42.809 INFO:tasks.workunit.client.0.smithi038.stdout:0/682: mknod d2/d7/d24/d2b/ce3 0 2024-09-13T18:30:42.811 INFO:tasks.workunit.client.0.smithi038.stdout:0/683: dread d2/d7/d24/d92/fcc [0,4194304] 0 2024-09-13T18:30:42.813 INFO:tasks.workunit.client.0.smithi038.stdout:3/685: rmdir d0 39 2024-09-13T18:30:42.813 INFO:tasks.workunit.client.0.smithi038.stdout:3/686: fdatasync d0/dd/d17/d50/d5c/d1d/d30/fcd 0 2024-09-13T18:30:42.815 INFO:tasks.workunit.client.0.smithi038.stdout:9/602: link d0/d7/d2c/l43 d0/d7/d2c/d5a/d67/d9e/ld6 0 2024-09-13T18:30:42.815 INFO:tasks.workunit.client.0.smithi038.stdout:9/603: fdatasync d0/f1 0 2024-09-13T18:30:42.816 INFO:tasks.workunit.client.0.smithi038.stdout:9/604: fsync d0/d7/d13/d2d/d3e/d70/da2/f79 0 2024-09-13T18:30:42.816 INFO:tasks.workunit.client.0.smithi038.stdout:9/605: creat d0/d7/d13/d30/fd7 x:0 0 0 2024-09-13T18:30:42.818 INFO:tasks.workunit.client.0.smithi038.stdout:2/578: rename d2/da/d74/cc4 to d2/d5c/d66/cd2 0 2024-09-13T18:30:42.820 INFO:tasks.workunit.client.0.smithi038.stdout:1/869: rmdir d12/d3c/d46 39 2024-09-13T18:30:42.821 INFO:tasks.workunit.client.0.smithi038.stdout:3/687: symlink d0/dd/d17/d50/d5c/d1d/d30/d95/d84/ld0 0 2024-09-13T18:30:42.822 INFO:tasks.workunit.client.0.smithi038.stdout:0/684: dread d2/d7/d24/d92/d66/d81/fb4 [0,4194304] 0 2024-09-13T18:30:42.827 INFO:tasks.workunit.client.0.smithi038.stdout:2/579: truncate d2/d1e/f4e 760798 0 2024-09-13T18:30:42.829 INFO:tasks.workunit.client.0.smithi038.stdout:1/870: unlink d12/d3c/d46/d57/lda 0 2024-09-13T18:30:42.830 INFO:tasks.workunit.client.0.smithi038.stdout:1/871: write d12/d7a/ddb/f113 [577397,80905] 0 2024-09-13T18:30:42.830 INFO:tasks.workunit.client.0.smithi038.stdout:1/872: dread - d12/d7a/f110 zero size 2024-09-13T18:30:42.830 INFO:tasks.workunit.client.0.smithi038.stdout:1/873: chown d12/d3c/d46/d57/da4/de2/fe4 232202965 1 2024-09-13T18:30:42.832 INFO:tasks.workunit.client.0.smithi038.stdout:3/688: creat d0/dd/d17/d50/d5c/d1d/fd1 x:0 0 0 2024-09-13T18:30:42.832 INFO:tasks.workunit.client.0.smithi038.stdout:3/689: creat d0/dd/d17/d50/d5c/d23/d52/fd2 x:0 0 0 2024-09-13T18:30:42.832 INFO:tasks.workunit.client.0.smithi038.stdout:3/690: fsync d0/dd/d17/f1c 0 2024-09-13T18:30:42.833 INFO:tasks.workunit.client.0.smithi038.stdout:3/691: chown d0/dd/d17/d50/d5c/f99 1797627335 1 2024-09-13T18:30:42.835 INFO:tasks.workunit.client.0.smithi038.stdout:1/874: unlink d12/d2a/d32/d82/cac 0 2024-09-13T18:30:42.835 INFO:tasks.workunit.client.0.smithi038.stdout:1/875: dread - d12/d2a/d72/dea/fde zero size 2024-09-13T18:30:42.837 INFO:tasks.workunit.client.0.smithi038.stdout:3/692: unlink d0/c96 0 2024-09-13T18:30:42.839 INFO:tasks.workunit.client.0.smithi038.stdout:3/693: dread d0/dd/d17/d43/d89/f85 [0,4194304] 0 2024-09-13T18:30:42.839 INFO:tasks.workunit.client.0.smithi038.stdout:9/606: rename d0/d7/d13/d2d/d3e/d70/d7b to d0/d7/d2c/d5a/dd8 0 2024-09-13T18:30:42.842 INFO:tasks.workunit.client.0.smithi038.stdout:3/694: symlink d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/ld3 0 2024-09-13T18:30:42.842 INFO:tasks.workunit.client.0.smithi038.stdout:3/695: fsync d0/dd/d17/f81 0 2024-09-13T18:30:42.844 INFO:tasks.workunit.client.0.smithi038.stdout:9/607: unlink d0/d7/d13/d2d/d3e/cc1 0 2024-09-13T18:30:42.846 INFO:tasks.workunit.client.0.smithi038.stdout:0/685: rename d2/dc/caa to d2/d7/d24/d92/d40/d87/dd6/d98/ce4 0 2024-09-13T18:30:42.847 INFO:tasks.workunit.client.0.smithi038.stdout:0/686: stat d2/d7/d24/d92/d66/d49/fc3 0 2024-09-13T18:30:42.847 INFO:tasks.workunit.client.0.smithi038.stdout:3/696: mknod d0/dd/cd4 0 2024-09-13T18:30:42.849 INFO:tasks.workunit.client.0.smithi038.stdout:9/608: truncate d0/d7/d13/d2d/d3c/f5b 295608 0 2024-09-13T18:30:42.850 INFO:tasks.workunit.client.0.smithi038.stdout:2/580: dwrite d2/d1e/d44/d50/d39/f5d [0,4194304] 0 2024-09-13T18:30:42.850 INFO:tasks.workunit.client.0.smithi038.stdout:0/687: truncate d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f4d 1050981 0 2024-09-13T18:30:42.851 INFO:tasks.workunit.client.0.smithi038.stdout:3/697: rename d0/dd/d17/d50/d59 to d0/dd/d17/d79/dd5 0 2024-09-13T18:30:42.853 INFO:tasks.workunit.client.0.smithi038.stdout:9/609: mknod d0/d7/d2c/d33/d4a/dcf/cd9 0 2024-09-13T18:30:42.853 INFO:tasks.workunit.client.0.smithi038.stdout:9/610: creat d0/d7/d2c/dbf/fda x:0 0 0 2024-09-13T18:30:42.853 INFO:tasks.workunit.client.0.smithi038.stdout:9/611: fdatasync d0/d7/d13/d2d/d3e/d70/fab 0 2024-09-13T18:30:42.853 INFO:tasks.workunit.client.0.smithi038.stdout:9/612: creat d0/d7/d13/d2d/d3c/d50/fdb x:0 0 0 2024-09-13T18:30:42.854 INFO:tasks.workunit.client.0.smithi038.stdout:1/876: dwrite d12/d3c/d46/d58/d10b/d5b/f21 [0,4194304] 0 2024-09-13T18:30:42.854 INFO:tasks.workunit.client.0.smithi038.stdout:1/877: stat d12/d3c/d46/d58/d10b/d5b/f20 0 2024-09-13T18:30:42.854 INFO:tasks.workunit.client.0.smithi038.stdout:1/878: stat d12/d2a/d72/dea/f80 0 2024-09-13T18:30:42.854 INFO:tasks.workunit.client.0.smithi038.stdout:1/879: creat d12/d2a/d32/d82/f114 x:0 0 0 2024-09-13T18:30:42.854 INFO:tasks.workunit.client.0.smithi038.stdout:1/880: write d12/d3c/d46/f7c [887880,83039] 0 2024-09-13T18:30:42.854 INFO:tasks.workunit.client.0.smithi038.stdout:1/881: fsync d12/d3c/d46/d57/def/f106 0 2024-09-13T18:30:42.856 INFO:tasks.workunit.client.0.smithi038.stdout:2/581: symlink d2/d5c/d66/ld3 0 2024-09-13T18:30:42.857 INFO:tasks.workunit.client.0.smithi038.stdout:0/688: creat d2/d7/d24/d92/d40/d87/fe5 x:0 0 0 2024-09-13T18:30:42.861 INFO:tasks.workunit.client.0.smithi038.stdout:3/698: mknod d0/dd/d17/d50/d5c/d23/d52/d6e/cd6 0 2024-09-13T18:30:42.872 INFO:tasks.workunit.client.0.smithi038.stdout:1/882: dwrite d12/f3e [0,4194304] 0 2024-09-13T18:30:42.875 INFO:tasks.workunit.client.0.smithi038.stdout:2/582: symlink d2/d5c/dbb/ld4 0 2024-09-13T18:30:42.879 INFO:tasks.workunit.client.0.smithi038.stdout:1/883: mkdir d12/d3c/d46/d57/da4/de2/d115 0 2024-09-13T18:30:42.884 INFO:tasks.workunit.client.0.smithi038.stdout:0/689: truncate d2/d7/d55/fcf 310078 0 2024-09-13T18:30:42.884 INFO:tasks.workunit.client.0.smithi038.stdout:2/583: write d2/da/f53 [488798,19313] 0 2024-09-13T18:30:42.884 INFO:tasks.workunit.client.0.smithi038.stdout:2/584: stat d2/d5c/d93/d62/fa9 0 2024-09-13T18:30:42.888 INFO:tasks.workunit.client.0.smithi038.stdout:2/585: rename d2/da/d98/fad to d2/d1e/d44/d50/d46/da6/fd5 0 2024-09-13T18:30:42.888 INFO:tasks.workunit.client.0.smithi038.stdout:2/586: truncate d2/d5c/d93/fb5 691350 0 2024-09-13T18:30:42.891 INFO:tasks.workunit.client.0.smithi038.stdout:2/587: mkdir d2/da/d98/dc9/dd6 0 2024-09-13T18:30:42.900 INFO:tasks.workunit.client.0.smithi038.stdout:1/884: dwrite d12/f2b [4194304,4194304] 0 2024-09-13T18:30:42.903 INFO:tasks.workunit.client.0.smithi038.stdout:1/885: symlink d12/d3c/d46/d58/d10b/d5b/d111/l116 0 2024-09-13T18:30:42.903 INFO:tasks.workunit.client.0.smithi038.stdout:1/886: chown d12/d2a/d72/dea/f56 86521 1 2024-09-13T18:30:42.903 INFO:tasks.workunit.client.0.smithi038.stdout:1/887: write d12/d2a/d32/fbe [4872690,36882] 0 2024-09-13T18:30:42.907 INFO:tasks.workunit.client.0.smithi038.stdout:0/690: dwrite d2/d7/d24/d92/d66/dda/fdf [0,4194304] 0 2024-09-13T18:30:42.907 INFO:tasks.workunit.client.0.smithi038.stdout:0/691: write d2/d7/d24/d92/d40/d87/fe5 [827080,19196] 0 2024-09-13T18:30:42.919 INFO:tasks.workunit.client.0.smithi038.stdout:2/588: dwrite d2/d1e/d44/d50/f31 [0,4194304] 0 2024-09-13T18:30:42.925 INFO:tasks.workunit.client.0.smithi038.stdout:0/692: write d2/d7/d24/d2b/dc1/db7/fc9 [1935725,50227] 0 2024-09-13T18:30:42.930 INFO:tasks.workunit.client.0.smithi038.stdout:1/888: dwrite d12/d2a/d8e/fb3 [0,4194304] 0 2024-09-13T18:30:42.938 INFO:tasks.workunit.client.0.smithi038.stdout:1/889: rename d12/d3c/d46/d58/d10b/l66 to d12/d2a/d72/dbf/l117 0 2024-09-13T18:30:42.938 INFO:tasks.workunit.client.0.smithi038.stdout:2/589: dwrite d2/d5c/d93/f5a [0,4194304] 0 2024-09-13T18:30:42.938 INFO:tasks.workunit.client.0.smithi038.stdout:2/590: write d2/d1e/d44/d50/d39/d45/faf [359496,16751] 0 2024-09-13T18:30:42.942 INFO:tasks.workunit.client.0.smithi038.stdout:1/890: chown d12/d2a/d72/ddc 1 1 2024-09-13T18:30:42.944 INFO:tasks.workunit.client.0.smithi038.stdout:2/591: creat d2/d1e/d44/d50/d39/d52/d8b/dcb/fd7 x:0 0 0 2024-09-13T18:30:42.944 INFO:tasks.workunit.client.0.smithi038.stdout:2/592: chown d2/d1e/d44/d50/d46/d58/f8d 35 1 2024-09-13T18:30:42.944 INFO:tasks.workunit.client.0.smithi038.stdout:1/891: symlink d12/d3c/d46/d58/d10b/d5e/daf/l118 0 2024-09-13T18:30:42.945 INFO:tasks.workunit.client.0.smithi038.stdout:2/593: mknod d2/d5c/cd8 0 2024-09-13T18:30:42.945 INFO:tasks.workunit.client.0.smithi038.stdout:2/594: truncate d2/da/d98/f99 950926 0 2024-09-13T18:30:42.945 INFO:tasks.workunit.client.0.smithi038.stdout:1/892: creat d12/d2a/f119 x:0 0 0 2024-09-13T18:30:42.946 INFO:tasks.workunit.client.0.smithi038.stdout:1/893: symlink d12/d3c/d46/d58/d10b/d5e/l11a 0 2024-09-13T18:30:42.946 INFO:tasks.workunit.client.0.smithi038.stdout:1/894: creat d12/d3c/f11b x:0 0 0 2024-09-13T18:30:42.947 INFO:tasks.workunit.client.0.smithi038.stdout:1/895: symlink d12/d2a/d72/ddc/dfc/l11c 0 2024-09-13T18:30:42.949 INFO:tasks.workunit.client.0.smithi038.stdout:1/896: mkdir d12/d2a/d72/ddc/d11d 0 2024-09-13T18:30:42.949 INFO:tasks.workunit.client.0.smithi038.stdout:1/897: write d12/d3c/d46/f7c [975789,39545] 0 2024-09-13T18:30:42.949 INFO:tasks.workunit.client.0.smithi038.stdout:1/898: stat d12/cc1 0 2024-09-13T18:30:42.949 INFO:tasks.workunit.client.0.smithi038.stdout:1/899: creat d12/d7a/f11e x:0 0 0 2024-09-13T18:30:42.950 INFO:tasks.workunit.client.0.smithi038.stdout:1/900: creat d12/d3c/d46/f11f x:0 0 0 2024-09-13T18:30:42.950 INFO:tasks.workunit.client.0.smithi038.stdout:1/901: truncate d12/d2a/d72/dea/fde 943670 0 2024-09-13T18:30:42.951 INFO:tasks.workunit.client.0.smithi038.stdout:2/595: dread d2/f72 [0,4194304] 0 2024-09-13T18:30:42.955 INFO:tasks.workunit.client.0.smithi038.stdout:0/693: dwrite d2/d7/f9 [0,4194304] 0 2024-09-13T18:30:42.957 INFO:tasks.workunit.client.0.smithi038.stdout:0/694: rmdir d2/d7/d24/d2b/db6 39 2024-09-13T18:30:42.958 INFO:tasks.workunit.client.0.smithi038.stdout:2/596: dread d2/f47 [0,4194304] 0 2024-09-13T18:30:42.961 INFO:tasks.workunit.client.0.smithi038.stdout:0/695: rename d2/d7/d55/l63 to d2/d7/d24/le6 0 2024-09-13T18:30:42.962 INFO:tasks.workunit.client.0.smithi038.stdout:1/902: dread ff [0,4194304] 0 2024-09-13T18:30:42.962 INFO:tasks.workunit.client.0.smithi038.stdout:1/903: creat d12/d7a/ddb/f120 x:0 0 0 2024-09-13T18:30:42.965 INFO:tasks.workunit.client.0.smithi038.stdout:0/696: link d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f53 d2/d7/d24/d2b/dc1/fe7 0 2024-09-13T18:30:42.966 INFO:tasks.workunit.client.0.smithi038.stdout:0/697: write d2/d7/d24/d2b/f5d [1485977,107924] 0 2024-09-13T18:30:42.967 INFO:tasks.workunit.client.0.smithi038.stdout:1/904: truncate d12/d3c/d46/d58/d10b/f6a 2808133 0 2024-09-13T18:30:42.967 INFO:tasks.workunit.client.0.smithi038.stdout:1/905: read d12/d2a/d72/dea/d84/da7/fff [2305516,86898] 0 2024-09-13T18:30:42.974 INFO:tasks.workunit.client.0.smithi038.stdout:1/906: dread d12/d3c/d46/d58/d10b/d5e/dc3/fd5 [0,4194304] 0 2024-09-13T18:30:42.974 INFO:tasks.workunit.client.0.smithi038.stdout:1/907: chown d12/d2a/d72/ddc 112027 1 2024-09-13T18:30:42.974 INFO:tasks.workunit.client.0.smithi038.stdout:1/908: fdatasync d12/d7a/ddb/f100 0 2024-09-13T18:30:42.975 INFO:tasks.workunit.client.0.smithi038.stdout:1/909: mknod d12/d3c/db6/c121 0 2024-09-13T18:30:42.977 INFO:tasks.workunit.client.0.smithi038.stdout:2/597: dwrite d2/da/f77 [0,4194304] 0 2024-09-13T18:30:42.977 INFO:tasks.workunit.client.0.smithi038.stdout:2/598: truncate d2/d1e/fc7 1005772 0 2024-09-13T18:30:42.977 INFO:tasks.workunit.client.0.smithi038.stdout:1/910: stat d12/l28 0 2024-09-13T18:30:42.978 INFO:tasks.workunit.client.0.smithi038.stdout:1/911: fsync d12/d3c/d46/d58/d10b/d5b/f26 0 2024-09-13T18:30:42.983 INFO:tasks.workunit.client.0.smithi038.stdout:1/912: chown d12/d2a/d72/d8d/lbb 188936015 1 2024-09-13T18:30:42.983 INFO:tasks.workunit.client.0.smithi038.stdout:1/913: fdatasync d12/d3c/d46/f11f 0 2024-09-13T18:30:42.983 INFO:tasks.workunit.client.0.smithi038.stdout:1/914: write d12/d2a/f4d [605316,11529] 0 2024-09-13T18:30:42.983 INFO:tasks.workunit.client.0.smithi038.stdout:1/915: write d12/d2a/f6f [962198,12673] 0 2024-09-13T18:30:42.983 INFO:tasks.workunit.client.0.smithi038.stdout:2/599: dread d2/f47 [0,4194304] 0 2024-09-13T18:30:42.986 INFO:tasks.workunit.client.0.smithi038.stdout:1/916: mknod d12/d2a/d72/dbf/c122 0 2024-09-13T18:30:42.986 INFO:tasks.workunit.client.0.smithi038.stdout:0/698: dwrite d2/d7/d24/d92/fcc [0,4194304] 0 2024-09-13T18:30:42.987 INFO:tasks.workunit.client.0.smithi038.stdout:2/600: symlink d2/d1e/d48/ld9 0 2024-09-13T18:30:42.987 INFO:tasks.workunit.client.0.smithi038.stdout:2/601: read d2/d1e/d44/d50/f32 [3463856,76308] 0 2024-09-13T18:30:42.989 INFO:tasks.workunit.client.0.smithi038.stdout:1/917: mkdir d12/d3c/d46/d58/d10b/d5b/d111/d123 0 2024-09-13T18:30:42.993 INFO:tasks.workunit.client.0.smithi038.stdout:2/602: mkdir d2/d5c/d66/dda 0 2024-09-13T18:30:42.994 INFO:tasks.workunit.client.0.smithi038.stdout:2/603: write d2/d1e/d44/d50/f9a [158397,65818] 0 2024-09-13T18:30:42.998 INFO:tasks.workunit.client.0.smithi038.stdout:0/699: rename d2/d7/d24/d92/d66/fd0 to d2/d7/d55/fe8 0 2024-09-13T18:30:43.011 INFO:tasks.workunit.client.0.smithi038.stdout:1/918: truncate d12/d3c/d46/d58/d10b/f6a 804020 0 2024-09-13T18:30:43.011 INFO:tasks.workunit.client.0.smithi038.stdout:1/919: chown d12/d3c/d46/d58/d10b/l88 116663558 1 2024-09-13T18:30:43.011 INFO:tasks.workunit.client.0.smithi038.stdout:1/920: write ff [1237367,110964] 0 2024-09-13T18:30:43.011 INFO:tasks.workunit.client.0.smithi038.stdout:1/921: stat d12/d3c/d46/d58/d10b/d5e/daf 0 2024-09-13T18:30:43.013 INFO:tasks.workunit.client.0.smithi038.stdout:1/922: dread d12/f2d [0,4194304] 0 2024-09-13T18:30:43.015 INFO:tasks.workunit.client.0.smithi038.stdout:1/923: mknod d12/d2a/d72/c124 0 2024-09-13T18:30:43.017 INFO:tasks.workunit.client.0.smithi038.stdout:1/924: mkdir d12/d3c/d46/d58/d10b/d5b/d111/d123/d125 0 2024-09-13T18:30:43.019 INFO:tasks.workunit.client.0.smithi038.stdout:1/925: getdents d12/d3c/d46 0 2024-09-13T18:30:43.020 INFO:tasks.workunit.client.0.smithi038.stdout:5/646: sync 2024-09-13T18:30:43.020 INFO:tasks.workunit.client.0.smithi038.stdout:6/691: sync 2024-09-13T18:30:43.020 INFO:tasks.workunit.client.0.smithi038.stdout:7/545: sync 2024-09-13T18:30:43.020 INFO:tasks.workunit.client.0.smithi038.stdout:8/835: sync 2024-09-13T18:30:43.020 INFO:tasks.workunit.client.0.smithi038.stdout:1/926: write d12/d3c/d46/d58/d10b/d5b/f22 [4018551,81685] 0 2024-09-13T18:30:43.020 INFO:tasks.workunit.client.0.smithi038.stdout:4/976: sync 2024-09-13T18:30:43.020 INFO:tasks.workunit.client.0.smithi038.stdout:4/977: write d2/f123 [167562,51007] 0 2024-09-13T18:30:43.020 INFO:tasks.workunit.client.0.smithi038.stdout:4/978: write d2/df/d1b/d10/d55/dd5/f114 [92561,70720] 0 2024-09-13T18:30:43.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/700: dwrite d2/d7/f76 [0,4194304] 0 2024-09-13T18:30:43.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/701: creat d2/d7/d24/d92/d66/dda/fe9 x:0 0 0 2024-09-13T18:30:43.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/702: fsync d2/d7/d24/d92/fcc 0 2024-09-13T18:30:43.021 INFO:tasks.workunit.client.0.smithi038.stdout:5/647: mknod df/d15/d36/d67/dbf/d44/d82/ccb 0 2024-09-13T18:30:43.022 INFO:tasks.workunit.client.0.smithi038.stdout:6/692: creat dd/de/d2e/d2f/d4c/d60/ddc/fee x:0 0 0 2024-09-13T18:30:43.025 INFO:tasks.workunit.client.0.smithi038.stdout:7/546: link db/d12/d13/f1b db/d12/d1c/d3a/d22/fc5 0 2024-09-13T18:30:43.025 INFO:tasks.workunit.client.0.smithi038.stdout:7/547: write db/d12/d1c/d3a/d4b/fba [554058,86099] 0 2024-09-13T18:30:43.025 INFO:tasks.workunit.client.0.smithi038.stdout:1/927: mknod d12/d3c/d46/d58/d10b/d5e/c126 0 2024-09-13T18:30:43.028 INFO:tasks.workunit.client.0.smithi038.stdout:4/979: rename d2/df/d1b/d10/d75 to d2/df/d1b/d143 0 2024-09-13T18:30:43.028 INFO:tasks.workunit.client.0.smithi038.stdout:4/980: dread - d2/d49/d50/da0/d8/d80/ddf/f13a zero size 2024-09-13T18:30:43.032 INFO:tasks.workunit.client.0.smithi038.stdout:0/703: creat d2/d7/d24/d92/d66/d49/fea x:0 0 0 2024-09-13T18:30:43.033 INFO:tasks.workunit.client.0.smithi038.stdout:5/648: mknod df/dca/ccc 0 2024-09-13T18:30:43.033 INFO:tasks.workunit.client.0.smithi038.stdout:5/649: readlink df/d15/d36/d67/dbf/d44/d52/l89 0 2024-09-13T18:30:43.034 INFO:tasks.workunit.client.0.smithi038.stdout:6/693: mknod dd/de/d31/dca/cef 0 2024-09-13T18:30:43.036 INFO:tasks.workunit.client.0.smithi038.stdout:1/928: mknod d12/d2a/d72/dea/c127 0 2024-09-13T18:30:43.036 INFO:tasks.workunit.client.0.smithi038.stdout:1/929: chown d12/d3c/d46/f86 1650796 1 2024-09-13T18:30:43.038 INFO:tasks.workunit.client.0.smithi038.stdout:5/650: unlink df/d15/d36/f86 0 2024-09-13T18:30:43.038 INFO:tasks.workunit.client.0.smithi038.stdout:5/651: chown df/d15/d36/d67 956260 1 2024-09-13T18:30:43.040 INFO:tasks.workunit.client.0.smithi038.stdout:6/694: creat dd/de/d2e/d2f/ff0 x:0 0 0 2024-09-13T18:30:43.041 INFO:tasks.workunit.client.0.smithi038.stdout:5/652: symlink df/d15/d36/d67/dbf/d44/d58/lcd 0 2024-09-13T18:30:43.042 INFO:tasks.workunit.client.0.smithi038.stdout:8/836: dwrite d1/de/d107/f7b [4194304,4194304] 0 2024-09-13T18:30:43.042 INFO:tasks.workunit.client.0.smithi038.stdout:8/837: read - d1/d4/fad zero size 2024-09-13T18:30:43.043 INFO:tasks.workunit.client.0.smithi038.stdout:7/548: dwrite db/d12/d1c/d3a/d3c/d52/d9b/fbd [0,4194304] 0 2024-09-13T18:30:43.044 INFO:tasks.workunit.client.0.smithi038.stdout:6/695: rename dd/de/d2e/d2f/d4c/d86/dac/ce6 to dd/de/d2e/d2f/da6/dd9/cf1 0 2024-09-13T18:30:43.047 INFO:tasks.workunit.client.0.smithi038.stdout:8/838: creat d1/de/d21/d102/f11b x:0 0 0 2024-09-13T18:30:43.049 INFO:tasks.workunit.client.0.smithi038.stdout:4/981: dread d2/d49/d50/da0/f8d [0,4194304] 0 2024-09-13T18:30:43.051 INFO:tasks.workunit.client.0.smithi038.stdout:5/653: dread df/d15/d36/d67/dbf/d44/d82/f97 [0,4194304] 0 2024-09-13T18:30:43.054 INFO:tasks.workunit.client.0.smithi038.stdout:0/704: write d2/d7/d24/d92/fcc [3157141,82079] 0 2024-09-13T18:30:43.056 INFO:tasks.workunit.client.0.smithi038.stdout:7/549: mkdir db/d12/d1c/d3a/d3c/d52/dc6 0 2024-09-13T18:30:43.056 INFO:tasks.workunit.client.0.smithi038.stdout:7/550: write db/d12/d1c/d3a/d3c/d52/d51/f88 [536529,78425] 0 2024-09-13T18:30:43.057 INFO:tasks.workunit.client.0.smithi038.stdout:6/696: creat dd/de/d2e/d30/ff2 x:0 0 0 2024-09-13T18:30:43.059 INFO:tasks.workunit.client.0.smithi038.stdout:1/930: dwrite d12/d2a/f4d [0,4194304] 0 2024-09-13T18:30:43.060 INFO:tasks.workunit.client.0.smithi038.stdout:8/839: truncate d1/de/d21/d24/d41/fd5 2931238 0 2024-09-13T18:30:43.060 INFO:tasks.workunit.client.0.smithi038.stdout:5/654: dread df/d13/f4f [4194304,4194304] 0 2024-09-13T18:30:43.066 INFO:tasks.workunit.client.0.smithi038.stdout:4/982: rename d2/de5/deb/f11f to d2/df/d1b/d10/d55/dd5/f144 0 2024-09-13T18:30:43.066 INFO:tasks.workunit.client.0.smithi038.stdout:4/983: chown d2/cb8 1562 1 2024-09-13T18:30:43.073 INFO:tasks.workunit.client.0.smithi038.stdout:7/551: mknod db/d12/d13/cc7 0 2024-09-13T18:30:43.073 INFO:tasks.workunit.client.0.smithi038.stdout:7/552: creat db/d12/d1c/fc8 x:0 0 0 2024-09-13T18:30:43.073 INFO:tasks.workunit.client.0.smithi038.stdout:7/553: stat db/d12/d1c/d3a/d22 0 2024-09-13T18:30:43.079 INFO:tasks.workunit.client.0.smithi038.stdout:1/931: creat d12/d3c/d46/d58/d10b/d5b/d111/f128 x:0 0 0 2024-09-13T18:30:43.080 INFO:tasks.workunit.client.0.smithi038.stdout:0/705: dwrite d2/dc/f28 [4194304,4194304] 0 2024-09-13T18:30:43.080 INFO:tasks.workunit.client.0.smithi038.stdout:0/706: chown d2/d7/d24/d2b/d6d/lb5 254745 1 2024-09-13T18:30:43.080 INFO:tasks.workunit.client.0.smithi038.stdout:0/707: readlink d2/d7/d24/d92/d40/ld3 0 2024-09-13T18:30:43.082 INFO:tasks.workunit.client.0.smithi038.stdout:5/655: mkdir df/d15/d36/d67/dbf/d44/d48/d9d/dce 0 2024-09-13T18:30:43.082 INFO:tasks.workunit.client.0.smithi038.stdout:5/656: dread - df/d15/d36/d67/f81 zero size 2024-09-13T18:30:43.084 INFO:tasks.workunit.client.0.smithi038.stdout:7/554: symlink db/d12/d1c/d3a/d3c/d52/d9b/lc9 0 2024-09-13T18:30:43.086 INFO:tasks.workunit.client.0.smithi038.stdout:1/932: unlink d12/c2e 0 2024-09-13T18:30:43.086 INFO:tasks.workunit.client.0.smithi038.stdout:1/933: chown d12/d3c/d46/d58/d10b/d5e/daf/l118 9 1 2024-09-13T18:30:43.089 INFO:tasks.workunit.client.0.smithi038.stdout:0/708: creat d2/d7/d24/d92/d66/feb x:0 0 0 2024-09-13T18:30:43.090 INFO:tasks.workunit.client.0.smithi038.stdout:5/657: symlink df/d15/d36/d67/dbf/d44/d52/lcf 0 2024-09-13T18:30:43.091 INFO:tasks.workunit.client.0.smithi038.stdout:0/709: mkdir d2/d7/d24/d92/d40/d87/dd6/d98/dec 0 2024-09-13T18:30:43.091 INFO:tasks.workunit.client.0.smithi038.stdout:8/840: dwrite d1/de/f96 [0,4194304] 0 2024-09-13T18:30:43.092 INFO:tasks.workunit.client.0.smithi038.stdout:6/697: dwrite dd/de/d2e/d2f/da6/dd9/fe7 [0,4194304] 0 2024-09-13T18:30:43.093 INFO:tasks.workunit.client.0.smithi038.stdout:5/658: rename df/d15/cc0 to df/d68/cd0 0 2024-09-13T18:30:43.093 INFO:tasks.workunit.client.0.smithi038.stdout:5/659: write df/d15/d36/d67/dbf/d3e/fc6 [2545,51615] 0 2024-09-13T18:30:43.100 INFO:tasks.workunit.client.0.smithi038.stdout:6/698: creat dd/de/d2e/d2f/d4c/d60/ff3 x:0 0 0 2024-09-13T18:30:43.100 INFO:tasks.workunit.client.0.smithi038.stdout:6/699: chown dd/de/d61/d62 15317619 1 2024-09-13T18:30:43.114 INFO:tasks.workunit.client.0.smithi038.stdout:6/700: dread dd/de/d2e/d99/f7f [0,4194304] 0 2024-09-13T18:30:43.114 INFO:tasks.workunit.client.0.smithi038.stdout:6/701: write dd/de/d2e/f6e [1563344,70183] 0 2024-09-13T18:30:43.116 INFO:tasks.workunit.client.0.smithi038.stdout:7/555: dwrite db/d12/d1c/d3a/d26/f93 [0,4194304] 0 2024-09-13T18:30:43.116 INFO:tasks.workunit.client.0.smithi038.stdout:6/702: symlink dd/de/d2e/d2f/d4c/d6f/lf4 0 2024-09-13T18:30:43.118 INFO:tasks.workunit.client.0.smithi038.stdout:1/934: dwrite d12/d3c/d46/d58/d10b/d5e/ffa [0,4194304] 0 2024-09-13T18:30:43.119 INFO:tasks.workunit.client.0.smithi038.stdout:7/556: getdents db/d12/d1c/d3a/d26/d41/dad 0 2024-09-13T18:30:43.119 INFO:tasks.workunit.client.0.smithi038.stdout:7/557: read - db/d12/d1c/fc8 zero size 2024-09-13T18:30:43.119 INFO:tasks.workunit.client.0.smithi038.stdout:7/558: creat db/d12/d1c/fca x:0 0 0 2024-09-13T18:30:43.121 INFO:tasks.workunit.client.0.smithi038.stdout:6/703: rename dd/de/d2e/d2f/da6/fa8 to dd/de/d2e/d2f/ff5 0 2024-09-13T18:30:43.124 INFO:tasks.workunit.client.0.smithi038.stdout:1/935: creat d12/d2a/d72/dea/d84/da7/f129 x:0 0 0 2024-09-13T18:30:43.127 INFO:tasks.workunit.client.0.smithi038.stdout:7/559: getdents db/d12/d1c/d3a/d26/d41 0 2024-09-13T18:30:43.129 INFO:tasks.workunit.client.0.smithi038.stdout:6/704: mkdir dd/df6 0 2024-09-13T18:30:43.131 INFO:tasks.workunit.client.0.smithi038.stdout:1/936: symlink d12/d2a/d72/dea/d84/l12a 0 2024-09-13T18:30:43.131 INFO:tasks.workunit.client.0.smithi038.stdout:1/937: chown d12/d3c/d46/f86 54376530 1 2024-09-13T18:30:43.131 INFO:tasks.workunit.client.0.smithi038.stdout:1/938: chown d12/d3c/d46/d58/d10b/d5b/l27 58535 1 2024-09-13T18:30:43.131 INFO:tasks.workunit.client.0.smithi038.stdout:6/705: creat dd/df6/ff7 x:0 0 0 2024-09-13T18:30:43.131 INFO:tasks.workunit.client.0.smithi038.stdout:6/706: chown dd/de/d2e/d30 0 1 2024-09-13T18:30:43.133 INFO:tasks.workunit.client.0.smithi038.stdout:1/939: rename d12/d3c/d46/d57/f87 to d12/d2a/d72/dea/d84/da7/f12b 0 2024-09-13T18:30:43.133 INFO:tasks.workunit.client.0.smithi038.stdout:1/940: read d12/f17 [1501277,85458] 0 2024-09-13T18:30:43.134 INFO:tasks.workunit.client.0.smithi038.stdout:6/707: rmdir dd/de/d2e/d2f/d4c/d55 39 2024-09-13T18:30:43.137 INFO:tasks.workunit.client.0.smithi038.stdout:8/841: dwrite d1/de/d107/f44 [4194304,4194304] 0 2024-09-13T18:30:43.137 INFO:tasks.workunit.client.0.smithi038.stdout:6/708: rename dd/de/dc6/fed to dd/de/d2e/d2f/d4c/d86/ff8 0 2024-09-13T18:30:43.137 INFO:tasks.workunit.client.0.smithi038.stdout:8/842: rename d1 to d1/de/d21/d24/d56/d89/d11c 22 2024-09-13T18:30:43.138 INFO:tasks.workunit.client.0.smithi038.stdout:6/709: dread - dd/de/d2e/d2f/d4c/d60/fda zero size 2024-09-13T18:30:43.138 INFO:tasks.workunit.client.0.smithi038.stdout:0/710: dwrite d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fdd [0,4194304] 0 2024-09-13T18:30:43.139 INFO:tasks.workunit.client.0.smithi038.stdout:5/660: dwrite df/d15/d36/d67/dbf/d44/d48/d56/f5f [0,4194304] 0 2024-09-13T18:30:43.141 INFO:tasks.workunit.client.0.smithi038.stdout:8/843: unlink d1/de/d21/d24/f7a 0 2024-09-13T18:30:43.143 INFO:tasks.workunit.client.0.smithi038.stdout:1/941: dread d12/f1a [0,4194304] 0 2024-09-13T18:30:43.143 INFO:tasks.workunit.client.0.smithi038.stdout:6/710: creat dd/de/d61/d62/ff9 x:0 0 0 2024-09-13T18:30:43.144 INFO:tasks.workunit.client.0.smithi038.stdout:8/844: dread d1/de/d21/d45/d5d/d6d/fba [0,4194304] 0 2024-09-13T18:30:43.144 INFO:tasks.workunit.client.0.smithi038.stdout:8/845: write d1/de/d21/d45/d5d/d6d/fb8 [213096,79364] 0 2024-09-13T18:30:43.144 INFO:tasks.workunit.client.0.smithi038.stdout:8/846: write d1/de/d21/d24/d4d/d50/d62/d71/fcf [4801966,122821] 0 2024-09-13T18:30:43.154 INFO:tasks.workunit.client.0.smithi038.stdout:1/942: read d12/f1c [7653387,92676] 0 2024-09-13T18:30:43.154 INFO:tasks.workunit.client.0.smithi038.stdout:1/943: dread - d12/d3c/d46/f11f zero size 2024-09-13T18:30:43.155 INFO:tasks.workunit.client.0.smithi038.stdout:7/560: dwrite db/d12/d1c/d3a/f1d [4194304,4194304] 0 2024-09-13T18:30:43.169 INFO:tasks.workunit.client.0.smithi038.stdout:7/561: rmdir db/d12/d1c/d3a/d3c 39 2024-09-13T18:30:43.174 INFO:tasks.workunit.client.0.smithi038.stdout:1/944: dread d12/f17 [0,4194304] 0 2024-09-13T18:30:43.177 INFO:tasks.workunit.client.0.smithi038.stdout:7/562: write db/d12/d1c/d3a/d3c/d52/d9b/fbd [2516134,109007] 0 2024-09-13T18:30:43.179 INFO:tasks.workunit.client.0.smithi038.stdout:1/945: dread d12/f2d [0,4194304] 0 2024-09-13T18:30:43.179 INFO:tasks.workunit.client.0.smithi038.stdout:1/946: creat d12/d2a/d72/dea/f12c x:0 0 0 2024-09-13T18:30:43.179 INFO:tasks.workunit.client.0.smithi038.stdout:1/947: dread - d12/d2a/d72/dea/f55 zero size 2024-09-13T18:30:43.179 INFO:tasks.workunit.client.0.smithi038.stdout:7/563: rename db/d12/d1c/d3a/d22/c69 to db/d12/d1c/d3a/d3c/d52/d9b/ccb 0 2024-09-13T18:30:43.180 INFO:tasks.workunit.client.0.smithi038.stdout:1/948: unlink d12/f6b 0 2024-09-13T18:30:43.182 INFO:tasks.workunit.client.0.smithi038.stdout:1/949: rename d12/d7a/l92 to d12/d2a/d32/d82/l12d 0 2024-09-13T18:30:43.182 INFO:tasks.workunit.client.0.smithi038.stdout:1/950: write d12/d3c/d46/f11f [991683,7626] 0 2024-09-13T18:30:43.182 INFO:tasks.workunit.client.0.smithi038.stdout:7/564: getdents db/d8e 0 2024-09-13T18:30:43.184 INFO:tasks.workunit.client.0.smithi038.stdout:7/565: write db/d12/d1c/d3a/d4b/f77 [895255,48258] 0 2024-09-13T18:30:43.184 INFO:tasks.workunit.client.0.smithi038.stdout:7/566: chown db/d12/d1c/f79 371 1 2024-09-13T18:30:43.185 INFO:tasks.workunit.client.0.smithi038.stdout:7/567: symlink db/d12/d1c/d3a/d3c/d52/d51/lcc 0 2024-09-13T18:30:43.188 INFO:tasks.workunit.client.0.smithi038.stdout:6/711: dwrite dd/de/d2e/d2f/da0/fcf [0,4194304] 0 2024-09-13T18:30:43.188 INFO:tasks.workunit.client.0.smithi038.stdout:6/712: dread - dd/df6/ff7 zero size 2024-09-13T18:30:43.189 INFO:tasks.workunit.client.0.smithi038.stdout:8/847: dwrite d1/d2a/ffd [0,4194304] 0 2024-09-13T18:30:43.189 INFO:tasks.workunit.client.0.smithi038.stdout:8/848: write d1/d2a/d5b/f106 [39128,79539] 0 2024-09-13T18:30:43.189 INFO:tasks.workunit.client.0.smithi038.stdout:5/661: dwrite df/d15/f3d [4194304,4194304] 0 2024-09-13T18:30:43.189 INFO:tasks.workunit.client.0.smithi038.stdout:0/711: dwrite d2/d7/d24/d92/d40/d87/fe5 [0,4194304] 0 2024-09-13T18:30:43.189 INFO:tasks.workunit.client.0.smithi038.stdout:0/712: write d2/d7/d24/d92/d40/d87/dd6/d98/da0/fb0 [960182,110603] 0 2024-09-13T18:30:43.194 INFO:tasks.workunit.client.0.smithi038.stdout:6/713: unlink dd/de/d2e/d30/l40 0 2024-09-13T18:30:43.195 INFO:tasks.workunit.client.0.smithi038.stdout:7/568: write db/f10 [230383,107046] 0 2024-09-13T18:30:43.201 INFO:tasks.workunit.client.0.smithi038.stdout:8/849: unlink d1/de/d21/d24/d4d/caf 0 2024-09-13T18:30:43.207 INFO:tasks.workunit.client.0.smithi038.stdout:1/951: dwrite d12/fd6 [0,4194304] 0 2024-09-13T18:30:43.209 INFO:tasks.workunit.client.0.smithi038.stdout:0/713: creat d2/d7/de1/fed x:0 0 0 2024-09-13T18:30:43.215 INFO:tasks.workunit.client.0.smithi038.stdout:6/714: dwrite dd/de/d2e/d2f/d71/f75 [0,4194304] 0 2024-09-13T18:30:43.219 INFO:tasks.workunit.client.0.smithi038.stdout:8/850: mknod d1/de/d21/d24/d4d/da6/c11d 0 2024-09-13T18:30:43.222 INFO:tasks.workunit.client.0.smithi038.stdout:1/952: symlink d12/d7a/l12e 0 2024-09-13T18:30:43.222 INFO:tasks.workunit.client.0.smithi038.stdout:1/953: write d12/f98 [387305,120504] 0 2024-09-13T18:30:43.222 INFO:tasks.workunit.client.0.smithi038.stdout:1/954: fsync d12/d7a/ddb/f10e 0 2024-09-13T18:30:43.223 INFO:tasks.workunit.client.0.smithi038.stdout:7/569: mknod db/d12/d1c/d3a/ccd 0 2024-09-13T18:30:43.223 INFO:tasks.workunit.client.0.smithi038.stdout:7/570: truncate db/d12/d1c/d3a/d3c/d52/fbf 706326 0 2024-09-13T18:30:43.223 INFO:tasks.workunit.client.0.smithi038.stdout:7/571: chown db/d12/d1c/d3a/d3c/d52/d9b/lc9 100 1 2024-09-13T18:30:43.226 INFO:tasks.workunit.client.0.smithi038.stdout:6/715: creat dd/de/ffa x:0 0 0 2024-09-13T18:30:43.228 INFO:tasks.workunit.client.0.smithi038.stdout:8/851: mknod d1/de/d21/d24/d4d/c11e 0 2024-09-13T18:30:43.229 INFO:tasks.workunit.client.0.smithi038.stdout:1/955: rename d12/d2a/d72/d8d/ld0 to d12/d3c/d46/d58/d10b/d5e/l12f 0 2024-09-13T18:30:43.229 INFO:tasks.workunit.client.0.smithi038.stdout:1/956: readlink d12/d2a/l2f 0 2024-09-13T18:30:43.231 INFO:tasks.workunit.client.0.smithi038.stdout:7/572: mkdir db/d21/dce 0 2024-09-13T18:30:43.231 INFO:tasks.workunit.client.0.smithi038.stdout:7/573: truncate db/d12/d1c/d3a/d3c/d52/d51/fa2 180266 0 2024-09-13T18:30:43.231 INFO:tasks.workunit.client.0.smithi038.stdout:7/574: write db/d12/d1c/d3a/f59 [1682295,87442] 0 2024-09-13T18:30:43.232 INFO:tasks.workunit.client.0.smithi038.stdout:6/716: chown dd/de/d2e/d2f/d71/dc5/cd8 14 1 2024-09-13T18:30:43.236 INFO:tasks.workunit.client.0.smithi038.stdout:7/575: unlink db/d12/d1c/d3a/d3c/f74 0 2024-09-13T18:30:43.237 INFO:tasks.workunit.client.0.smithi038.stdout:6/717: rmdir dd/de/d2e/d2f/da0 39 2024-09-13T18:30:43.238 INFO:tasks.workunit.client.0.smithi038.stdout:7/576: symlink db/d12/d1c/d3a/d22/lcf 0 2024-09-13T18:30:43.240 INFO:tasks.workunit.client.0.smithi038.stdout:6/718: link dd/de/d2e/d2f/f94 dd/de/d2e/d2f/d71/ffb 0 2024-09-13T18:30:43.241 INFO:tasks.workunit.client.0.smithi038.stdout:7/577: getdents db/d12/d1c/d3a/d3c/d52/d9b 0 2024-09-13T18:30:43.241 INFO:tasks.workunit.client.0.smithi038.stdout:7/578: chown db/d12/d1c/d3a/d26/d41 148204717 1 2024-09-13T18:30:43.244 INFO:tasks.workunit.client.0.smithi038.stdout:7/579: rename db/d12/d1c/d3a/d22/fb9 to db/d12/d1c/d3a/d3c/d52/dc6/fd0 0 2024-09-13T18:30:43.244 INFO:tasks.workunit.client.0.smithi038.stdout:8/852: dread d1/de/d15/d30/feb [0,4194304] 0 2024-09-13T18:30:43.244 INFO:tasks.workunit.client.0.smithi038.stdout:8/853: write d1/fd9 [548847,88327] 0 2024-09-13T18:30:43.246 INFO:tasks.workunit.client.0.smithi038.stdout:7/580: symlink db/d12/d1c/d3a/d3c/d8f/ld1 0 2024-09-13T18:30:43.247 INFO:tasks.workunit.client.0.smithi038.stdout:1/957: dwrite d12/d7a/ff2 [0,4194304] 0 2024-09-13T18:30:43.248 INFO:tasks.workunit.client.0.smithi038.stdout:8/854: rename d1/de/d21/d24/d4d/d50/d62/lb9 to d1/de/d21/d24/d41/l11f 0 2024-09-13T18:30:43.249 INFO:tasks.workunit.client.0.smithi038.stdout:7/581: unlink db/d12/d13/fa4 0 2024-09-13T18:30:43.250 INFO:tasks.workunit.client.0.smithi038.stdout:1/958: mkdir d12/d3c/d46/d58/d10b/d5e/dc3/d130 0 2024-09-13T18:30:43.252 INFO:tasks.workunit.client.0.smithi038.stdout:7/582: rename db/d12/d1c/d3a/d4b/fba to db/d12/d1c/d3a/d3c/d52/d9b/fd2 0 2024-09-13T18:30:43.253 INFO:tasks.workunit.client.0.smithi038.stdout:1/959: mkdir d12/d3c/d46/d58/d131 0 2024-09-13T18:30:43.253 INFO:tasks.workunit.client.0.smithi038.stdout:6/719: write dd/de/d2e/d2f/d71/fe1 [1876535,121046] 0 2024-09-13T18:30:43.254 INFO:tasks.workunit.client.0.smithi038.stdout:7/583: mkdir db/d12/d1c/d3a/d22/d28/dd3 0 2024-09-13T18:30:43.255 INFO:tasks.workunit.client.0.smithi038.stdout:1/960: creat d12/d3c/d46/d58/d10b/d5e/dc3/d130/f132 x:0 0 0 2024-09-13T18:30:43.257 INFO:tasks.workunit.client.0.smithi038.stdout:6/720: write dd/de/d31/d63/d83/fde [678853,63669] 0 2024-09-13T18:30:43.261 INFO:tasks.workunit.client.0.smithi038.stdout:1/961: mkdir d12/d7a/ddb/dfe/d133 0 2024-09-13T18:30:43.263 INFO:tasks.workunit.client.0.smithi038.stdout:6/721: link dd/de/d31/l34 dd/de/d2e/d99/lfc 0 2024-09-13T18:30:43.263 INFO:tasks.workunit.client.0.smithi038.stdout:6/722: chown dd/de/d2e/d2f/d4c/d86 168700480 1 2024-09-13T18:30:43.272 INFO:tasks.workunit.client.0.smithi038.stdout:1/962: mknod d12/d3c/d46/d58/d10b/d5e/dc3/d130/c134 0 2024-09-13T18:30:43.273 INFO:tasks.workunit.client.0.smithi038.stdout:1/963: fdatasync d12/d2a/d72/dea/fed 0 2024-09-13T18:30:43.276 INFO:tasks.workunit.client.0.smithi038.stdout:8/855: dwrite d1/d2a/d40/dbe/dc4/fe4 [0,4194304] 0 2024-09-13T18:30:43.283 INFO:tasks.workunit.client.0.smithi038.stdout:1/964: dread d12/d3c/d46/d57/def/f106 [0,4194304] 0 2024-09-13T18:30:43.284 INFO:tasks.workunit.client.0.smithi038.stdout:6/723: stat dd/de/d61/d62/c9f 0 2024-09-13T18:30:43.284 INFO:tasks.workunit.client.0.smithi038.stdout:6/724: dread - dd/de/d2e/d2f/d4c/d60/fda zero size 2024-09-13T18:30:43.295 INFO:tasks.workunit.client.0.smithi038.stdout:7/584: rename db/d12/d1c/d3a/d22 to db/d21/dce/dd4 0 2024-09-13T18:30:43.295 INFO:tasks.workunit.client.0.smithi038.stdout:7/585: truncate db/d12/d1c/fc4 997897 0 2024-09-13T18:30:43.296 INFO:tasks.workunit.client.0.smithi038.stdout:1/965: creat d12/d2a/d72/ddc/dfc/f135 x:0 0 0 2024-09-13T18:30:43.297 INFO:tasks.workunit.client.0.smithi038.stdout:1/966: creat d12/d3c/d46/d58/d10b/d5b/d111/d123/d125/f136 x:0 0 0 2024-09-13T18:30:43.298 INFO:tasks.workunit.client.0.smithi038.stdout:6/725: getdents dd/de/d2e/d2f/d71/dc5 0 2024-09-13T18:30:43.298 INFO:tasks.workunit.client.0.smithi038.stdout:6/726: write dd/de/d2e/d2f/ff0 [260908,31420] 0 2024-09-13T18:30:43.326 INFO:tasks.workunit.client.0.smithi038.stdout:6/727: dwrite dd/de/d31/fa2 [0,4194304] 0 2024-09-13T18:30:43.326 INFO:tasks.workunit.client.0.smithi038.stdout:1/967: dwrite d12/d2a/d32/ff1 [0,4194304] 0 2024-09-13T18:30:43.326 INFO:tasks.workunit.client.0.smithi038.stdout:1/968: write d12/d7a/ddb/f100 [170563,111698] 0 2024-09-13T18:30:43.328 INFO:tasks.workunit.client.0.smithi038.stdout:6/728: link dd/f32 dd/de/d2e/d2f/d4c/d55/ffd 0 2024-09-13T18:30:43.329 INFO:tasks.workunit.client.0.smithi038.stdout:6/729: creat dd/de/dc6/ffe x:0 0 0 2024-09-13T18:30:43.330 INFO:tasks.workunit.client.0.smithi038.stdout:6/730: rename l2 to dd/daa/lff 0 2024-09-13T18:30:43.330 INFO:tasks.workunit.client.0.smithi038.stdout:6/731: creat dd/de/d2e/d30/f100 x:0 0 0 2024-09-13T18:30:43.331 INFO:tasks.workunit.client.0.smithi038.stdout:1/969: dread d12/d2a/d32/f60 [0,4194304] 0 2024-09-13T18:30:43.333 INFO:tasks.workunit.client.0.smithi038.stdout:1/970: rename d12/d2a/d72/dea/fde to d12/d2a/d72/dea/f137 0 2024-09-13T18:30:43.333 INFO:tasks.workunit.client.0.smithi038.stdout:1/971: dread - d12/d3c/df6/f104 zero size 2024-09-13T18:30:43.335 INFO:tasks.workunit.client.0.smithi038.stdout:8/856: dwrite d1/de/d21/d24/d4d/da6/fbd [0,4194304] 0 2024-09-13T18:30:43.336 INFO:tasks.workunit.client.0.smithi038.stdout:8/857: truncate d1/de/d15/dbc/df4/fff 1023707 0 2024-09-13T18:30:43.336 INFO:tasks.workunit.client.0.smithi038.stdout:7/586: dread db/d12/d1c/f79 [0,4194304] 0 2024-09-13T18:30:43.336 INFO:tasks.workunit.client.0.smithi038.stdout:1/972: symlink d12/d7a/ddb/l138 0 2024-09-13T18:30:43.337 INFO:tasks.workunit.client.0.smithi038.stdout:1/973: fdatasync f10 0 2024-09-13T18:30:43.337 INFO:tasks.workunit.client.0.smithi038.stdout:1/974: read - d12/d7a/ddb/f10e zero size 2024-09-13T18:30:43.339 INFO:tasks.workunit.client.0.smithi038.stdout:8/858: creat d1/de/d21/d45/d5d/d6d/f120 x:0 0 0 2024-09-13T18:30:43.339 INFO:tasks.workunit.client.0.smithi038.stdout:8/859: creat d1/d2a/f121 x:0 0 0 2024-09-13T18:30:43.341 INFO:tasks.workunit.client.0.smithi038.stdout:7/587: symlink db/d12/d1c/d3a/d4b/ld5 0 2024-09-13T18:30:43.341 INFO:tasks.workunit.client.0.smithi038.stdout:7/588: write db/d12/d1c/d3a/d26/fbe [978795,32246] 0 2024-09-13T18:30:43.343 INFO:tasks.workunit.client.0.smithi038.stdout:7/589: rmdir db/d12/d13/d43 39 2024-09-13T18:30:43.356 INFO:tasks.workunit.client.0.smithi038.stdout:7/590: write db/f14 [1609026,103177] 0 2024-09-13T18:30:43.356 INFO:tasks.workunit.client.0.smithi038.stdout:7/591: truncate db/d12/f6d 248464 0 2024-09-13T18:30:43.357 INFO:tasks.workunit.client.0.smithi038.stdout:7/592: creat db/fd6 x:0 0 0 2024-09-13T18:30:43.359 INFO:tasks.workunit.client.0.smithi038.stdout:7/593: stat db/ld 0 2024-09-13T18:30:43.359 INFO:tasks.workunit.client.0.smithi038.stdout:7/594: chown db/d12/d1c/d3a/d3c/d52/f6c 212769617 1 2024-09-13T18:30:43.361 INFO:tasks.workunit.client.0.smithi038.stdout:1/975: dwrite d12/d2a/d72/dea/f56 [0,4194304] 0 2024-09-13T18:30:43.364 INFO:tasks.workunit.client.0.smithi038.stdout:8/860: dwrite d1/de/d21/d24/d4d/d50/d62/d71/f82 [0,4194304] 0 2024-09-13T18:30:43.364 INFO:tasks.workunit.client.0.smithi038.stdout:8/861: write d1/d4/f4f [1174779,72729] 0 2024-09-13T18:30:43.364 INFO:tasks.workunit.client.0.smithi038.stdout:8/862: chown d1/de/d21/d24/d4d/da6/c11d 32625218 1 2024-09-13T18:30:43.366 INFO:tasks.workunit.client.0.smithi038.stdout:8/863: getdents d1/de/d21/d24 0 2024-09-13T18:30:43.368 INFO:tasks.workunit.client.0.smithi038.stdout:8/864: creat d1/de/d21/d24/d41/d8c/f122 x:0 0 0 2024-09-13T18:30:43.368 INFO:tasks.workunit.client.0.smithi038.stdout:8/865: write d1/de/d21/d24/d41/f42 [5239501,87873] 0 2024-09-13T18:30:43.369 INFO:tasks.workunit.client.0.smithi038.stdout:8/866: symlink d1/de/d21/d24/d4d/dee/l123 0 2024-09-13T18:30:43.375 INFO:tasks.workunit.client.0.smithi038.stdout:7/595: dwrite db/d21/dce/dd4/d28/f6e [0,4194304] 0 2024-09-13T18:30:43.377 INFO:tasks.workunit.client.0.smithi038.stdout:1/976: dread d12/d2a/d32/fbe [0,4194304] 0 2024-09-13T18:30:43.378 INFO:tasks.workunit.client.0.smithi038.stdout:7/596: rmdir db/d21/dce/dd4 39 2024-09-13T18:30:43.384 INFO:tasks.workunit.client.0.smithi038.stdout:7/597: symlink db/d12/d1c/d3a/d3c/d52/d51/ld7 0 2024-09-13T18:30:43.385 INFO:tasks.workunit.client.0.smithi038.stdout:8/867: dwrite d1/de/d21/d24/d41/d7d/f9c [0,4194304] 0 2024-09-13T18:30:43.385 INFO:tasks.workunit.client.0.smithi038.stdout:8/868: readlink d1/de/d21/l27 0 2024-09-13T18:30:43.387 INFO:tasks.workunit.client.0.smithi038.stdout:7/598: creat db/d21/dce/dd4/d28/fd8 x:0 0 0 2024-09-13T18:30:43.387 INFO:tasks.workunit.client.0.smithi038.stdout:7/599: read db/d12/d1c/f79 [1955162,112870] 0 2024-09-13T18:30:43.392 INFO:tasks.workunit.client.0.smithi038.stdout:8/869: rename d1/de/d21/d24/d4d/da6/c11d to d1/de/d21/d45/d61/c124 0 2024-09-13T18:30:43.393 INFO:tasks.workunit.client.0.smithi038.stdout:7/600: link db/d8e/fa7 db/d21/dce/fd9 0 2024-09-13T18:30:43.393 INFO:tasks.workunit.client.0.smithi038.stdout:7/601: write db/d12/d13/d43/f4e [331765,105254] 0 2024-09-13T18:30:43.393 INFO:tasks.workunit.client.0.smithi038.stdout:7/602: readlink db/l95 0 2024-09-13T18:30:43.400 INFO:tasks.workunit.client.0.smithi038.stdout:7/603: dread db/d21/dce/dd4/d28/f6e [0,4194304] 0 2024-09-13T18:30:43.400 INFO:tasks.workunit.client.0.smithi038.stdout:7/604: truncate db/d12/d1c/d3a/d26/fa5 269757 0 2024-09-13T18:30:43.401 INFO:tasks.workunit.client.0.smithi038.stdout:7/605: creat db/d12/d1c/d3a/d3c/d52/dc6/fda x:0 0 0 2024-09-13T18:30:43.403 INFO:tasks.workunit.client.0.smithi038.stdout:7/606: rename db/d21/dce/fd9 to db/d12/d1c/d3a/d3c/d8f/fdb 0 2024-09-13T18:30:43.405 INFO:tasks.workunit.client.0.smithi038.stdout:7/607: link db/d12/d1c/d3a/d3c/d52/d51/f82 db/d12/d1c/d3a/d3c/d52/d9b/fdc 0 2024-09-13T18:30:43.407 INFO:tasks.workunit.client.0.smithi038.stdout:7/608: rename db/d12/d1c/d3a/d26/d41/l98 to db/d8e/ldd 0 2024-09-13T18:30:43.415 INFO:tasks.workunit.client.0.smithi038.stdout:8/870: dwrite d1/ff [4194304,4194304] 0 2024-09-13T18:30:43.417 INFO:tasks.workunit.client.0.smithi038.stdout:8/871: mknod d1/de/d3a/c125 0 2024-09-13T18:30:43.428 INFO:tasks.workunit.client.0.smithi038.stdout:7/609: dwrite db/d12/d1c/d3a/d3c/fc3 [0,4194304] 0 2024-09-13T18:30:43.431 INFO:tasks.workunit.client.0.smithi038.stdout:7/610: creat db/d21/dce/dd4/d28/dd3/fde x:0 0 0 2024-09-13T18:30:43.440 INFO:tasks.workunit.client.0.smithi038.stdout:8/872: dwrite d1/de/d107/fe1 [0,4194304] 0 2024-09-13T18:30:43.440 INFO:tasks.workunit.client.0.smithi038.stdout:8/873: fdatasync d1/de/d21/d24/d4d/f9b 0 2024-09-13T18:30:43.440 INFO:tasks.workunit.client.0.smithi038.stdout:7/611: dread db/d12/d1c/d3a/d3c/d52/d51/f86 [0,4194304] 0 2024-09-13T18:30:43.442 INFO:tasks.workunit.client.0.smithi038.stdout:7/612: mknod db/d12/d1c/d3a/d26/d41/dad/cdf 0 2024-09-13T18:30:43.444 INFO:tasks.workunit.client.0.smithi038.stdout:7/613: symlink db/d12/d13/le0 0 2024-09-13T18:30:43.444 INFO:tasks.workunit.client.0.smithi038.stdout:8/874: dread d1/d2a/fd0 [4194304,4194304] 0 2024-09-13T18:30:43.444 INFO:tasks.workunit.client.0.smithi038.stdout:8/875: getdents d1/de/d21/d24/d41/d80/dca/d110 0 2024-09-13T18:30:43.444 INFO:tasks.workunit.client.0.smithi038.stdout:8/876: fsync d1/de/d21/d45/d5d/f83 0 2024-09-13T18:30:43.445 INFO:tasks.workunit.client.0.smithi038.stdout:7/614: creat db/d12/fe1 x:0 0 0 2024-09-13T18:30:43.446 INFO:tasks.workunit.client.0.smithi038.stdout:8/877: mknod d1/d2a/d5b/c126 0 2024-09-13T18:30:43.448 INFO:tasks.workunit.client.0.smithi038.stdout:8/878: mknod d1/de/d21/d24/d56/c127 0 2024-09-13T18:30:43.448 INFO:tasks.workunit.client.0.smithi038.stdout:8/879: chown d1/de/d21/f85 5854 1 2024-09-13T18:30:43.448 INFO:tasks.workunit.client.0.smithi038.stdout:8/880: dread - d1/de/d21/d24/d41/fdc zero size 2024-09-13T18:30:43.450 INFO:tasks.workunit.client.0.smithi038.stdout:8/881: getdents d1/de/d21/d102 0 2024-09-13T18:30:43.451 INFO:tasks.workunit.client.0.smithi038.stdout:8/882: mknod d1/de/d21/d24/d41/d8c/dda/df1/c128 0 2024-09-13T18:30:43.463 INFO:tasks.workunit.client.0.smithi038.stdout:7/615: dwrite db/d12/d1c/d3a/d4b/f77 [0,4194304] 0 2024-09-13T18:30:43.465 INFO:tasks.workunit.client.0.smithi038.stdout:7/616: rename db/d12/d1c/d3a/d3c/d52/d51/f88 to db/d21/fe2 0 2024-09-13T18:30:43.475 INFO:tasks.workunit.client.0.smithi038.stdout:8/883: dwrite d1/de/d21/f85 [4194304,4194304] 0 2024-09-13T18:30:43.477 INFO:tasks.workunit.client.0.smithi038.stdout:8/884: mknod d1/d2a/d40/dbe/dc6/df0/c129 0 2024-09-13T18:30:43.478 INFO:tasks.workunit.client.0.smithi038.stdout:8/885: creat d1/d2a/d40/f12a x:0 0 0 2024-09-13T18:30:43.479 INFO:tasks.workunit.client.0.smithi038.stdout:8/886: mkdir d1/de/d21/d24/d4d/dee/d11a/d12b 0 2024-09-13T18:30:43.480 INFO:tasks.workunit.client.0.smithi038.stdout:7/617: dwrite db/d12/d1c/f79 [0,4194304] 0 2024-09-13T18:30:43.481 INFO:tasks.workunit.client.0.smithi038.stdout:7/618: write db/d12/d1c/fc4 [598066,35328] 0 2024-09-13T18:30:43.481 INFO:tasks.workunit.client.0.smithi038.stdout:7/619: fdatasync db/d21/dce/dd4/f30 0 2024-09-13T18:30:43.481 INFO:tasks.workunit.client.0.smithi038.stdout:7/620: dread - db/d12/d1c/fca zero size 2024-09-13T18:30:43.481 INFO:tasks.workunit.client.0.smithi038.stdout:8/887: creat d1/d2a/d40/dbe/f12c x:0 0 0 2024-09-13T18:30:43.486 INFO:tasks.workunit.client.0.smithi038.stdout:8/888: unlink d1/de/d21/d24/d41/d7d/f9c 0 2024-09-13T18:30:43.488 INFO:tasks.workunit.client.0.smithi038.stdout:8/889: link d1/de/d21/f85 d1/d4/f12d 0 2024-09-13T18:30:43.488 INFO:tasks.workunit.client.0.smithi038.stdout:8/890: chown d1/d4/ce2 2446096 1 2024-09-13T18:30:43.495 INFO:tasks.workunit.client.0.smithi038.stdout:7/621: dwrite db/d12/d1c/d3a/d3c/d52/d9b/fd2 [0,4194304] 0 2024-09-13T18:30:43.497 INFO:tasks.workunit.client.0.smithi038.stdout:8/891: dread d1/de/d21/d24/d4d/d50/d62/d71/f82 [4194304,4194304] 0 2024-09-13T18:30:43.512 INFO:tasks.workunit.client.0.smithi038.stdout:7/622: creat db/d12/d1c/d3a/d26/d41/fe3 x:0 0 0 2024-09-13T18:30:43.513 INFO:tasks.workunit.client.0.smithi038.stdout:8/892: creat d1/d2a/d3f/f12e x:0 0 0 2024-09-13T18:30:43.523 INFO:tasks.workunit.client.0.smithi038.stdout:8/893: dread d1/de/d107/f51 [0,4194304] 0 2024-09-13T18:30:43.523 INFO:tasks.workunit.client.0.smithi038.stdout:8/894: creat d1/de/d15/db4/f12f x:0 0 0 2024-09-13T18:30:43.524 INFO:tasks.workunit.client.0.smithi038.stdout:7/623: dwrite db/d12/f34 [4194304,4194304] 0 2024-09-13T18:30:43.527 INFO:tasks.workunit.client.0.smithi038.stdout:7/624: symlink db/d12/d1c/d3a/d26/le4 0 2024-09-13T18:30:43.528 INFO:tasks.workunit.client.0.smithi038.stdout:7/625: rename db/d12/d1c/d3a/d3c/d52/c7c to db/d21/ce5 0 2024-09-13T18:30:43.529 INFO:tasks.workunit.client.0.smithi038.stdout:7/626: dread - db/d12/d1c/d3a/f7f zero size 2024-09-13T18:30:43.529 INFO:tasks.workunit.client.0.smithi038.stdout:7/627: chown db/d12/d13/cc7 20 1 2024-09-13T18:30:43.529 INFO:tasks.workunit.client.0.smithi038.stdout:7/628: mknod db/d12/ce6 0 2024-09-13T18:30:43.530 INFO:tasks.workunit.client.0.smithi038.stdout:8/895: dread d1/de/d21/d24/d41/fd5 [0,4194304] 0 2024-09-13T18:30:43.530 INFO:tasks.workunit.client.0.smithi038.stdout:8/896: fdatasync d1/de/d107/f51 0 2024-09-13T18:30:43.532 INFO:tasks.workunit.client.0.smithi038.stdout:8/897: creat d1/de/d15/f130 x:0 0 0 2024-09-13T18:30:43.534 INFO:tasks.workunit.client.0.smithi038.stdout:8/898: dread d1/de/d21/d24/d4d/da6/f115 [0,4194304] 0 2024-09-13T18:30:43.535 INFO:tasks.workunit.client.0.smithi038.stdout:8/899: fsync d1/de/d21/d24/d41/d80/d8f/dc1/fc2 0 2024-09-13T18:30:43.536 INFO:tasks.workunit.client.0.smithi038.stdout:8/900: creat d1/d2a/d3f/dbb/d105/f131 x:0 0 0 2024-09-13T18:30:43.538 INFO:tasks.workunit.client.0.smithi038.stdout:8/901: truncate d1/de/d21/d24/d41/f42 632331 0 2024-09-13T18:30:43.540 INFO:tasks.workunit.client.0.smithi038.stdout:8/902: rename d1/de/d21/d24/d41/d7d/c109 to d1/de/d21/d24/d4d/dee/d11a/d12b/c132 0 2024-09-13T18:30:43.541 INFO:tasks.workunit.client.0.smithi038.stdout:8/903: dread - d1/de/d15/db4/f12f zero size 2024-09-13T18:30:43.541 INFO:tasks.workunit.client.0.smithi038.stdout:8/904: truncate d1/de/d15/d30/feb 5971531 0 2024-09-13T18:30:43.541 INFO:tasks.workunit.client.0.smithi038.stdout:8/905: chown d1/de/d21/d24/d41/d7d/df3 11437874 1 2024-09-13T18:30:43.543 INFO:tasks.workunit.client.0.smithi038.stdout:8/906: rmdir d1/de/d21/d24/d41/d80 39 2024-09-13T18:30:43.544 INFO:tasks.workunit.client.0.smithi038.stdout:8/907: read d1/de/d21/d45/d5d/d6d/fba [201611,64263] 0 2024-09-13T18:30:43.544 INFO:tasks.workunit.client.0.smithi038.stdout:8/908: stat d1/de/d107 0 2024-09-13T18:30:43.545 INFO:tasks.workunit.client.0.smithi038.stdout:7/629: dwrite db/d12/f34 [4194304,4194304] 0 2024-09-13T18:30:43.547 INFO:tasks.workunit.client.0.smithi038.stdout:7/630: symlink db/d21/dce/dd4/le7 0 2024-09-13T18:30:43.560 INFO:tasks.workunit.client.0.smithi038.stdout:7/631: rmdir db/d12 39 2024-09-13T18:30:43.561 INFO:tasks.workunit.client.0.smithi038.stdout:7/632: rename db/d12/d1c/f5e to db/d12/d1c/d3a/d3c/d52/dc6/fe8 0 2024-09-13T18:30:43.563 INFO:tasks.workunit.client.0.smithi038.stdout:7/633: rename db/d12/d1c/d3a/d26/fbe to db/d12/d1c/d3a/d26/d41/fe9 0 2024-09-13T18:30:43.566 INFO:tasks.workunit.client.0.smithi038.stdout:8/909: dwrite d1/d2a/d40/dbe/dc4/fe4 [0,4194304] 0 2024-09-13T18:30:43.581 INFO:tasks.workunit.client.0.smithi038.stdout:8/910: dread d1/d4/f59 [0,4194304] 0 2024-09-13T18:30:43.581 INFO:tasks.workunit.client.0.smithi038.stdout:8/911: chown d1/de/d3a/f3e 236314 1 2024-09-13T18:30:43.581 INFO:tasks.workunit.client.0.smithi038.stdout:9/613: sync 2024-09-13T18:30:43.583 INFO:tasks.workunit.client.0.smithi038.stdout:9/614: getdents d0/d7/d13/d2d 0 2024-09-13T18:30:43.586 INFO:tasks.workunit.client.0.smithi038.stdout:9/615: link d0/d7/d13/fba d0/d7/d2c/fdc 0 2024-09-13T18:30:43.589 INFO:tasks.workunit.client.0.smithi038.stdout:7/634: dwrite db/d8e/fa7 [0,4194304] 0 2024-09-13T18:30:43.589 INFO:tasks.workunit.client.0.smithi038.stdout:9/616: dread d0/d7/d2c/d6d/fd1 [0,4194304] 0 2024-09-13T18:30:43.592 INFO:tasks.workunit.client.0.smithi038.stdout:7/635: rmdir db/d12/d13/d43 39 2024-09-13T18:30:43.593 INFO:tasks.workunit.client.0.smithi038.stdout:9/617: symlink d0/d2e/dc3/ldd 0 2024-09-13T18:30:43.593 INFO:tasks.workunit.client.0.smithi038.stdout:7/636: creat db/d12/d1c/d3a/d26/fea x:0 0 0 2024-09-13T18:30:43.597 INFO:tasks.workunit.client.0.smithi038.stdout:9/618: link d0/d7/d13/l14 d0/d7/d13/d2d/d3e/d70/da2/d86/db6/lde 0 2024-09-13T18:30:43.600 INFO:tasks.workunit.client.0.smithi038.stdout:9/619: unlink d0/d7/d13/d2d/d3e/d70/lbe 0 2024-09-13T18:30:43.600 INFO:tasks.workunit.client.0.smithi038.stdout:9/620: chown d0/d7/d13/d30/fd7 471441572 1 2024-09-13T18:30:43.602 INFO:tasks.workunit.client.0.smithi038.stdout:9/621: unlink d0/d7/d2c/d5a/dd8/f84 0 2024-09-13T18:30:43.608 INFO:tasks.workunit.client.0.smithi038.stdout:8/912: dwrite d1/de/d21/d24/d41/d7d/fe6 [0,4194304] 0 2024-09-13T18:30:43.609 INFO:tasks.workunit.client.0.smithi038.stdout:8/913: symlink d1/de/d21/d102/l133 0 2024-09-13T18:30:43.610 INFO:tasks.workunit.client.0.smithi038.stdout:8/914: creat d1/de/d21/d24/d56/f134 x:0 0 0 2024-09-13T18:30:43.622 INFO:tasks.workunit.client.0.smithi038.stdout:7/637: dwrite db/d12/d1c/fca [0,4194304] 0 2024-09-13T18:30:43.645 INFO:tasks.workunit.client.0.smithi038.stdout:7/638: dwrite db/d12/d13/f1b [0,4194304] 0 2024-09-13T18:30:43.646 INFO:tasks.workunit.client.0.smithi038.stdout:7/639: link db/d12/d1c/d3a/f7f db/d12/d1c/d3a/d3c/d52/dc6/feb 0 2024-09-13T18:30:43.646 INFO:tasks.workunit.client.0.smithi038.stdout:7/640: chown db/d12/d1c/d3a/d3c/d52/c72 397736 1 2024-09-13T18:30:43.647 INFO:tasks.workunit.client.0.smithi038.stdout:7/641: symlink db/d8e/lec 0 2024-09-13T18:30:43.649 INFO:tasks.workunit.client.0.smithi038.stdout:7/642: mkdir db/d12/d13/ded 0 2024-09-13T18:30:43.649 INFO:tasks.workunit.client.0.smithi038.stdout:7/643: fsync db/d12/d1c/d3a/d3c/d52/f6c 0 2024-09-13T18:30:43.650 INFO:tasks.workunit.client.0.smithi038.stdout:7/644: unlink db/d12/d1c/d3a/d26/d41/dad/lc1 0 2024-09-13T18:30:43.650 INFO:tasks.workunit.client.0.smithi038.stdout:7/645: write db/d12/d1c/d3a/d26/fa5 [779193,37604] 0 2024-09-13T18:30:43.651 INFO:tasks.workunit.client.0.smithi038.stdout:7/646: creat db/d12/d1c/d3a/d26/d41/fee x:0 0 0 2024-09-13T18:30:43.810 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:43 smithi038 ceph-mon[27689]: pgmap v24: 65 pgs: 65 active+clean; 2.9 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 252 MiB/s rd, 307 MiB/s wr, 511 op/s 2024-09-13T18:30:43.955 INFO:tasks.workunit.client.0.smithi038.stdout:3/699: sync 2024-09-13T18:30:43.955 INFO:tasks.workunit.client.0.smithi038.stdout:2/604: sync 2024-09-13T18:30:43.964 INFO:tasks.workunit.client.0.smithi038.stdout:3/700: write d0/dd/d17/d79/f87 [4937878,103804] 0 2024-09-13T18:30:43.976 INFO:tasks.workunit.client.0.smithi038.stdout:2/605: dwrite d2/f34 [0,4194304] 0 2024-09-13T18:30:43.983 INFO:tasks.workunit.client.0.smithi038.stdout:2/606: write d2/da/f1d [3233699,19331] 0 2024-09-13T18:30:43.983 INFO:tasks.workunit.client.0.smithi038.stdout:2/607: getdents d2/d5c/d66/dda 0 2024-09-13T18:30:43.985 INFO:tasks.workunit.client.0.smithi038.stdout:2/608: mkdir d2/d1e/d44/d50/d39/d40/ddb 0 2024-09-13T18:30:43.988 INFO:tasks.workunit.client.0.smithi038.stdout:2/609: link d2/d1e/l49 d2/d1e/d87/ldc 0 2024-09-13T18:30:43.988 INFO:tasks.workunit.client.0.smithi038.stdout:2/610: chown d2/da/d98 149619 1 2024-09-13T18:30:43.988 INFO:tasks.workunit.client.0.smithi038.stdout:2/611: chown d2/da/d74/lb7 5 1 2024-09-13T18:30:43.988 INFO:tasks.workunit.client.0.smithi038.stdout:2/612: chown d2/d1e/d48/c7a 965 1 2024-09-13T18:30:44.001 INFO:tasks.workunit.client.0.smithi038.stdout:2/613: dwrite d2/d1e/f2f [0,4194304] 0 2024-09-13T18:30:44.016 INFO:tasks.workunit.client.0.smithi038.stdout:2/614: dwrite d2/d1e/d44/d50/d46/d58/f7e [0,4194304] 0 2024-09-13T18:30:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:43 smithi149 ceph-mon[35845]: pgmap v24: 65 pgs: 65 active+clean; 2.9 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 252 MiB/s rd, 307 MiB/s wr, 511 op/s 2024-09-13T18:30:44.021 INFO:tasks.workunit.client.0.smithi038.stdout:2/615: creat d2/da/d98/dc9/dd6/fdd x:0 0 0 2024-09-13T18:30:44.021 INFO:tasks.workunit.client.0.smithi038.stdout:2/616: dread - d2/d5c/d93/f8e zero size 2024-09-13T18:30:44.023 INFO:tasks.workunit.client.0.smithi038.stdout:2/617: mkdir d2/d2a/db0/dde 0 2024-09-13T18:30:44.023 INFO:tasks.workunit.client.0.smithi038.stdout:2/618: dread - d2/d5c/dbb/fbe zero size 2024-09-13T18:30:44.025 INFO:tasks.workunit.client.0.smithi038.stdout:2/619: dread d2/d1e/d44/d50/d39/d45/faf [0,4194304] 0 2024-09-13T18:30:44.025 INFO:tasks.workunit.client.0.smithi038.stdout:2/620: write d2/d5c/dbb/fd1 [464923,89140] 0 2024-09-13T18:30:44.026 INFO:tasks.workunit.client.0.smithi038.stdout:2/621: rename d2/c84 to d2/d1e/d44/d50/d39/d40/cdf 0 2024-09-13T18:30:44.027 INFO:tasks.workunit.client.0.smithi038.stdout:2/622: chown d2/d5c/d93/d62 1 1 2024-09-13T18:30:44.028 INFO:tasks.workunit.client.0.smithi038.stdout:2/623: mkdir d2/d1e/d44/d50/de0 0 2024-09-13T18:30:44.028 INFO:tasks.workunit.client.0.smithi038.stdout:2/624: write d2/d1e/d44/d50/d39/d45/f54 [1899375,98494] 0 2024-09-13T18:30:44.028 INFO:tasks.workunit.client.0.smithi038.stdout:2/625: write d2/da/d98/dc9/dd6/fdd [18095,61530] 0 2024-09-13T18:30:44.028 INFO:tasks.workunit.client.0.smithi038.stdout:2/626: write d2/d5c/d93/d62/f91 [107606,93511] 0 2024-09-13T18:30:44.029 INFO:tasks.workunit.client.0.smithi038.stdout:2/627: getdents d2/d5c 0 2024-09-13T18:30:44.029 INFO:tasks.workunit.client.0.smithi038.stdout:2/628: creat d2/d5c/dbb/fe1 x:0 0 0 2024-09-13T18:30:44.030 INFO:tasks.workunit.client.0.smithi038.stdout:2/629: rmdir d2/d1e/d44/d50/d46 39 2024-09-13T18:30:44.051 INFO:tasks.workunit.client.0.smithi038.stdout:2/630: dwrite d2/f86 [0,4194304] 0 2024-09-13T18:30:44.055 INFO:tasks.workunit.client.0.smithi038.stdout:2/631: creat d2/d1e/d44/d50/d39/d40/ddb/fe2 x:0 0 0 2024-09-13T18:30:44.055 INFO:tasks.workunit.client.0.smithi038.stdout:2/632: stat d2/d2a/db0/dde 0 2024-09-13T18:30:44.056 INFO:tasks.workunit.client.0.smithi038.stdout:2/633: mkdir d2/d5c/d93/d62/de3 0 2024-09-13T18:30:44.056 INFO:tasks.workunit.client.0.smithi038.stdout:2/634: stat d2/d5c/d93/f5a 0 2024-09-13T18:30:44.076 INFO:tasks.workunit.client.0.smithi038.stdout:2/635: dwrite d2/d1e/d44/d50/f2e [0,4194304] 0 2024-09-13T18:30:44.079 INFO:tasks.workunit.client.0.smithi038.stdout:2/636: creat d2/d1e/d44/fe4 x:0 0 0 2024-09-13T18:30:44.092 INFO:tasks.workunit.client.0.smithi038.stdout:2/637: dwrite d2/d1e/d48/f64 [0,4194304] 0 2024-09-13T18:30:44.092 INFO:tasks.workunit.client.0.smithi038.stdout:2/638: stat d2/d1e/d44/d50/d39/d52 0 2024-09-13T18:30:44.109 INFO:tasks.workunit.client.0.smithi038.stdout:2/639: dwrite d2/d1e/f9d [0,4194304] 0 2024-09-13T18:30:44.109 INFO:tasks.workunit.client.0.smithi038.stdout:2/640: readlink d2/da/d16/l55 0 2024-09-13T18:30:44.111 INFO:tasks.workunit.client.0.smithi038.stdout:2/641: rmdir d2/d5c/d93/d62 39 2024-09-13T18:30:44.111 INFO:tasks.workunit.client.0.smithi038.stdout:2/642: truncate d2/d5c/db3/fbd 550786 0 2024-09-13T18:30:44.111 INFO:tasks.workunit.client.0.smithi038.stdout:2/643: write d2/d1e/d44/f75 [927678,57515] 0 2024-09-13T18:30:44.118 INFO:tasks.workunit.client.0.smithi038.stdout:2/644: dread d2/d1e/d44/d50/d46/d58/f7e [0,4194304] 0 2024-09-13T18:30:44.119 INFO:tasks.workunit.client.0.smithi038.stdout:2/645: mknod d2/d1e/d44/d50/d39/d52/d8b/dcb/ce5 0 2024-09-13T18:30:44.142 INFO:tasks.workunit.client.0.smithi038.stdout:2/646: dwrite d2/d1e/d87/f89 [0,4194304] 0 2024-09-13T18:30:44.144 INFO:tasks.workunit.client.0.smithi038.stdout:2/647: symlink d2/d1e/le6 0 2024-09-13T18:30:44.144 INFO:tasks.workunit.client.0.smithi038.stdout:2/648: chown d2/d1e/d44/d50/d39/d45/ca8 129 1 2024-09-13T18:30:44.151 INFO:tasks.workunit.client.0.smithi038.stdout:2/649: dread d2/d1e/d48/f64 [0,4194304] 0 2024-09-13T18:30:44.151 INFO:tasks.workunit.client.0.smithi038.stdout:2/650: read - d2/f6f zero size 2024-09-13T18:30:44.151 INFO:tasks.workunit.client.0.smithi038.stdout:2/651: chown d2/d1e/d44/d50/d46/db1 74 1 2024-09-13T18:30:44.152 INFO:tasks.workunit.client.0.smithi038.stdout:2/652: stat d2/d1e/d87/ldc 0 2024-09-13T18:30:44.153 INFO:tasks.workunit.client.0.smithi038.stdout:2/653: creat d2/d1e/d44/d50/d46/d58/fe7 x:0 0 0 2024-09-13T18:30:44.155 INFO:tasks.workunit.client.0.smithi038.stdout:2/654: rename d2/da/f53 to d2/d5c/db3/fe8 0 2024-09-13T18:30:44.182 INFO:tasks.workunit.client.0.smithi038.stdout:2/655: dwrite d2/f37 [4194304,4194304] 0 2024-09-13T18:30:44.182 INFO:tasks.workunit.client.0.smithi038.stdout:2/656: write d2/d5c/dbb/fe1 [429110,121656] 0 2024-09-13T18:30:44.182 INFO:tasks.workunit.client.0.smithi038.stdout:2/657: creat d2/fe9 x:0 0 0 2024-09-13T18:30:44.188 INFO:tasks.workunit.client.0.smithi038.stdout:2/658: dread d2/f8 [0,4194304] 0 2024-09-13T18:30:44.190 INFO:tasks.workunit.client.0.smithi038.stdout:2/659: mkdir d2/d5c/dea 0 2024-09-13T18:30:44.192 INFO:tasks.workunit.client.0.smithi038.stdout:2/660: mknod d2/d1e/d44/d50/d46/d58/ceb 0 2024-09-13T18:30:44.193 INFO:tasks.workunit.client.0.smithi038.stdout:2/661: mknod d2/d1e/d44/d50/d46/da6/cec 0 2024-09-13T18:30:44.193 INFO:tasks.workunit.client.0.smithi038.stdout:2/662: creat d2/d1e/d44/d50/d39/d52/d8b/dcb/fed x:0 0 0 2024-09-13T18:30:44.193 INFO:tasks.workunit.client.0.smithi038.stdout:2/663: fdatasync d2/d1e/d44/fa7 0 2024-09-13T18:30:44.194 INFO:tasks.workunit.client.0.smithi038.stdout:2/664: symlink d2/d5c/d66/lee 0 2024-09-13T18:30:44.195 INFO:tasks.workunit.client.0.smithi038.stdout:2/665: truncate d2/d1e/d44/d50/f9a 212856 0 2024-09-13T18:30:44.196 INFO:tasks.workunit.client.0.smithi038.stdout:2/666: dread d2/da/d74/f88 [0,4194304] 0 2024-09-13T18:30:44.197 INFO:tasks.workunit.client.0.smithi038.stdout:2/667: creat d2/d5c/d93/fef x:0 0 0 2024-09-13T18:30:44.197 INFO:tasks.workunit.client.0.smithi038.stdout:2/668: chown d2/da/d16/f24 0 1 2024-09-13T18:30:44.198 INFO:tasks.workunit.client.0.smithi038.stdout:2/669: dread d2/d1e/d44/d50/d39/d52/f5b [0,4194304] 0 2024-09-13T18:30:44.200 INFO:tasks.workunit.client.0.smithi038.stdout:2/670: creat d2/d1e/d87/da4/ff0 x:0 0 0 2024-09-13T18:30:44.201 INFO:tasks.workunit.client.0.smithi038.stdout:2/671: mkdir d2/d2a/db0/dde/df1 0 2024-09-13T18:30:44.203 INFO:tasks.workunit.client.0.smithi038.stdout:4/984: sync 2024-09-13T18:30:44.203 INFO:tasks.workunit.client.0.smithi038.stdout:5/662: sync 2024-09-13T18:30:44.203 INFO:tasks.workunit.client.0.smithi038.stdout:4/985: fdatasync d2/d49/f90 0 2024-09-13T18:30:44.343 INFO:tasks.workunit.client.0.smithi038.stdout:5/663: creat df/d15/d36/d67/dbf/d41/fd1 x:0 0 0 2024-09-13T18:30:44.343 INFO:tasks.workunit.client.0.smithi038.stdout:5/664: truncate df/d15/d36/d67/dbf/d41/f9e 1914241 0 2024-09-13T18:30:44.346 INFO:tasks.workunit.client.0.smithi038.stdout:4/986: rename d2/df/d22/d9a/de6/ffc to d2/d49/d50/da0/d8/d137/f145 0 2024-09-13T18:30:44.355 INFO:tasks.workunit.client.0.smithi038.stdout:4/987: mkdir d2/df/d1b/d10/d55/d146 0 2024-09-13T18:30:44.355 INFO:tasks.workunit.client.0.smithi038.stdout:5/665: write df/d15/d36/d67/dbf/f73 [268283,31155] 0 2024-09-13T18:30:44.355 INFO:tasks.workunit.client.0.smithi038.stdout:5/666: read df/d15/d36/d67/dbf/f4d [1850098,19033] 0 2024-09-13T18:30:44.355 INFO:tasks.workunit.client.0.smithi038.stdout:5/667: fsync df/f2a 0 2024-09-13T18:30:44.385 INFO:tasks.workunit.client.0.smithi038.stdout:6/732: sync 2024-09-13T18:30:44.385 INFO:tasks.workunit.client.0.smithi038.stdout:0/714: sync 2024-09-13T18:30:44.385 INFO:tasks.workunit.client.0.smithi038.stdout:1/977: sync 2024-09-13T18:30:44.385 INFO:tasks.workunit.client.0.smithi038.stdout:1/978: write d12/d7a/f110 [708860,39782] 0 2024-09-13T18:30:44.385 INFO:tasks.workunit.client.0.smithi038.stdout:1/979: write d12/d3c/d46/d58/d10b/f7b [420515,127484] 0 2024-09-13T18:30:44.389 INFO:tasks.workunit.client.0.smithi038.stdout:6/733: rename dd/de/d31/d63 to dd/de/d2e/d2f/da6/dd9/d101 0 2024-09-13T18:30:44.390 INFO:tasks.workunit.client.0.smithi038.stdout:6/734: creat dd/de/d2e/d2f/d4c/f102 x:0 0 0 2024-09-13T18:30:44.391 INFO:tasks.workunit.client.0.smithi038.stdout:0/715: dread d2/d7/d24/d2b/f5d [0,4194304] 0 2024-09-13T18:30:44.392 INFO:tasks.workunit.client.0.smithi038.stdout:6/735: creat dd/de/d2e/d2f/d71/dc5/f103 x:0 0 0 2024-09-13T18:30:44.394 INFO:tasks.workunit.client.0.smithi038.stdout:1/980: dread d12/d3c/d46/f7c [0,4194304] 0 2024-09-13T18:30:44.394 INFO:tasks.workunit.client.0.smithi038.stdout:6/736: mkdir dd/de/d2e/d104 0 2024-09-13T18:30:44.394 INFO:tasks.workunit.client.0.smithi038.stdout:6/737: readlink dd/de/d2e/l95 0 2024-09-13T18:30:44.395 INFO:tasks.workunit.client.0.smithi038.stdout:5/668: dwrite df/d15/d36/d67/dbf/d44/d58/d9c/fc1 [0,4194304] 0 2024-09-13T18:30:44.395 INFO:tasks.workunit.client.0.smithi038.stdout:6/738: chown dd/de/ca3 178248229 1 2024-09-13T18:30:44.396 INFO:tasks.workunit.client.0.smithi038.stdout:4/988: dwrite d2/d49/d50/da0/f44 [0,4194304] 0 2024-09-13T18:30:44.396 INFO:tasks.workunit.client.0.smithi038.stdout:4/989: write d2/d49/d50/da0/f16 [3319627,28020] 0 2024-09-13T18:30:44.398 INFO:tasks.workunit.client.0.smithi038.stdout:1/981: link d12/d2a/d8e/l101 d12/d3c/d46/l139 0 2024-09-13T18:30:44.402 INFO:tasks.workunit.client.0.smithi038.stdout:5/669: mknod df/d13/d49/d9a/cd2 0 2024-09-13T18:30:44.404 INFO:tasks.workunit.client.0.smithi038.stdout:6/739: mknod dd/de/d2e/d2f/d71/dc5/c105 0 2024-09-13T18:30:44.407 INFO:tasks.workunit.client.0.smithi038.stdout:0/716: dwrite d2/d7/d55/f73 [0,4194304] 0 2024-09-13T18:30:44.408 INFO:tasks.workunit.client.0.smithi038.stdout:0/717: chown d2/d7/d55/fe8 412695 1 2024-09-13T18:30:44.410 INFO:tasks.workunit.client.0.smithi038.stdout:4/990: dread d2/df/faf [4194304,4194304] 0 2024-09-13T18:30:44.413 INFO:tasks.workunit.client.0.smithi038.stdout:6/740: dread dd/de/d2e/fc3 [0,4194304] 0 2024-09-13T18:30:44.413 INFO:tasks.workunit.client.0.smithi038.stdout:6/741: fsync dd/de/d2e/d2f/f9e 0 2024-09-13T18:30:44.415 INFO:tasks.workunit.client.0.smithi038.stdout:0/718: unlink d2/d7/d24/d92/f52 0 2024-09-13T18:30:44.415 INFO:tasks.workunit.client.0.smithi038.stdout:0/719: chown d2/d7/d24/d92/d66/d49/f65 110 1 2024-09-13T18:30:44.415 INFO:tasks.workunit.client.0.smithi038.stdout:0/720: write d2/f5 [1524213,125397] 0 2024-09-13T18:30:44.416 INFO:tasks.workunit.client.0.smithi038.stdout:5/670: dread df/d68/fb7 [0,4194304] 0 2024-09-13T18:30:44.419 INFO:tasks.workunit.client.0.smithi038.stdout:4/991: mknod d2/df/d1b/d10/d55/d133/c147 0 2024-09-13T18:30:44.421 INFO:tasks.workunit.client.0.smithi038.stdout:6/742: rename dd/de/d31/dca/cd0 to dd/de/d2e/d2f/d4c/d55/c106 0 2024-09-13T18:30:44.422 INFO:tasks.workunit.client.0.smithi038.stdout:5/671: getdents df/d15/d36/d67/dbf/d44 0 2024-09-13T18:30:44.423 INFO:tasks.workunit.client.0.smithi038.stdout:4/992: mknod d2/df/d22/d9a/c148 0 2024-09-13T18:30:44.424 INFO:tasks.workunit.client.0.smithi038.stdout:6/743: symlink dd/de/d2e/d2f/da6/dd9/d101/l107 0 2024-09-13T18:30:44.425 INFO:tasks.workunit.client.0.smithi038.stdout:5/672: rmdir df/d68 39 2024-09-13T18:30:44.426 INFO:tasks.workunit.client.0.smithi038.stdout:5/673: dread - df/d15/d36/d67/dbf/d44/d48/d56/f8b zero size 2024-09-13T18:30:44.426 INFO:tasks.workunit.client.0.smithi038.stdout:4/993: creat d2/d49/d50/da0/d8/d137/f149 x:0 0 0 2024-09-13T18:30:44.426 INFO:tasks.workunit.client.0.smithi038.stdout:4/994: write d2/d49/d4b/dc0/d11b/f140 [218631,77463] 0 2024-09-13T18:30:44.427 INFO:tasks.workunit.client.0.smithi038.stdout:4/995: fdatasync d2/d49/d50/da0/f1e 0 2024-09-13T18:30:44.427 INFO:tasks.workunit.client.0.smithi038.stdout:0/721: dread d2/d7/d24/d2b/dc1/f77 [0,4194304] 0 2024-09-13T18:30:44.427 INFO:tasks.workunit.client.0.smithi038.stdout:0/722: readlink d2/d7/d24/d92/d66/d81/lbe 0 2024-09-13T18:30:44.428 INFO:tasks.workunit.client.0.smithi038.stdout:6/744: rename dd/de/d2e/d2f/d4c/d6f/feb to dd/de/d2e/d2f/d4c/d86/f108 0 2024-09-13T18:30:44.429 INFO:tasks.workunit.client.0.smithi038.stdout:5/674: link df/d15/d36/d67/dbf/d44/d48/d75/da7/fb1 df/d13/dc7/fd3 0 2024-09-13T18:30:44.430 INFO:tasks.workunit.client.0.smithi038.stdout:0/723: mknod d2/d7/d24/d92/d40/d87/cee 0 2024-09-13T18:30:44.431 INFO:tasks.workunit.client.0.smithi038.stdout:6/745: mknod dd/de/d2e/d2f/d71/dc5/c109 0 2024-09-13T18:30:44.433 INFO:tasks.workunit.client.0.smithi038.stdout:5/675: creat df/d13/d49/fd4 x:0 0 0 2024-09-13T18:30:44.434 INFO:tasks.workunit.client.0.smithi038.stdout:4/996: dread d2/df/d1b/f2b [0,4194304] 0 2024-09-13T18:30:44.435 INFO:tasks.workunit.client.0.smithi038.stdout:6/746: truncate dd/de/d2e/d2f/d4c/f84 2146152 0 2024-09-13T18:30:44.436 INFO:tasks.workunit.client.0.smithi038.stdout:0/724: mknod d2/d7/d24/d92/d66/d49/cef 0 2024-09-13T18:30:44.436 INFO:tasks.workunit.client.0.smithi038.stdout:1/982: dwrite d12/d2a/d8e/fc0 [4194304,4194304] 0 2024-09-13T18:30:44.439 INFO:tasks.workunit.client.0.smithi038.stdout:0/725: mkdir d2/d7/d24/d92/d40/d87/dd6/d98/da0/df0 0 2024-09-13T18:30:44.446 INFO:tasks.workunit.client.0.smithi038.stdout:5/676: dread df/d13/dc7/fd3 [0,4194304] 0 2024-09-13T18:30:44.449 INFO:tasks.workunit.client.0.smithi038.stdout:6/747: read dd/de/d31/fa2 [3294778,100188] 0 2024-09-13T18:30:44.450 INFO:tasks.workunit.client.0.smithi038.stdout:4/997: dwrite d2/d49/d50/da0/d8/d80/d128/f136 [0,4194304] 0 2024-09-13T18:30:44.453 INFO:tasks.workunit.client.0.smithi038.stdout:6/748: symlink dd/de/d2e/d2f/da6/dd9/l10a 0 2024-09-13T18:30:44.456 INFO:tasks.workunit.client.0.smithi038.stdout:6/749: truncate dd/de/d2e/d2f/fb1 748465 0 2024-09-13T18:30:44.457 INFO:tasks.workunit.client.0.smithi038.stdout:6/750: rename dd/f44 to dd/de/d2e/d2f/da6/dd9/d101/f10b 0 2024-09-13T18:30:44.460 INFO:tasks.workunit.client.0.smithi038.stdout:0/726: dread d2/d7/f9 [0,4194304] 0 2024-09-13T18:30:44.461 INFO:tasks.workunit.client.0.smithi038.stdout:0/727: creat d2/d7/ff1 x:0 0 0 2024-09-13T18:30:44.462 INFO:tasks.workunit.client.0.smithi038.stdout:0/728: read d2/d7/d24/d92/fcc [2326564,95630] 0 2024-09-13T18:30:44.465 INFO:tasks.workunit.client.0.smithi038.stdout:1/983: dwrite d12/d3c/d46/d58/d10b/d5b/d111/d123/d125/f136 [0,4194304] 0 2024-09-13T18:30:44.468 INFO:tasks.workunit.client.0.smithi038.stdout:1/984: creat d12/d3c/d46/d57/def/f13a x:0 0 0 2024-09-13T18:30:44.469 INFO:tasks.workunit.client.0.smithi038.stdout:1/985: symlink d12/d2a/d72/ddc/l13b 0 2024-09-13T18:30:44.471 INFO:tasks.workunit.client.0.smithi038.stdout:1/986: mknod d12/d3c/d46/d58/d10b/d5e/c13c 0 2024-09-13T18:30:44.474 INFO:tasks.workunit.client.0.smithi038.stdout:6/751: dread dd/de/d2e/d2f/da0/fcf [0,4194304] 0 2024-09-13T18:30:44.476 INFO:tasks.workunit.client.0.smithi038.stdout:6/752: truncate dd/de/d2e/d2f/ff5 914572 0 2024-09-13T18:30:44.476 INFO:tasks.workunit.client.0.smithi038.stdout:6/753: dread - dd/de/d61/da1/fe3 zero size 2024-09-13T18:30:44.476 INFO:tasks.workunit.client.0.smithi038.stdout:6/754: readlink dd/de/d2e/d9b/dbf/le2 0 2024-09-13T18:30:44.486 INFO:tasks.workunit.client.0.smithi038.stdout:1/987: dwrite d12/d3c/db6/fc6 [0,4194304] 0 2024-09-13T18:30:44.501 INFO:tasks.workunit.client.0.smithi038.stdout:1/988: dwrite d12/d2a/d72/dea/f55 [0,4194304] 0 2024-09-13T18:30:44.504 INFO:tasks.workunit.client.0.smithi038.stdout:9/622: sync 2024-09-13T18:30:44.504 INFO:tasks.workunit.client.0.smithi038.stdout:8/915: sync 2024-09-13T18:30:44.510 INFO:tasks.workunit.client.0.smithi038.stdout:1/989: read d12/d2a/d8e/fd7 [652983,44731] 0 2024-09-13T18:30:44.514 INFO:tasks.workunit.client.0.smithi038.stdout:1/990: rmdir d12/d2a/d72/ddc 39 2024-09-13T18:30:44.514 INFO:tasks.workunit.client.0.smithi038.stdout:8/916: dread d1/de/d107/fe1 [0,4194304] 0 2024-09-13T18:30:44.514 INFO:tasks.workunit.client.0.smithi038.stdout:5/677: rmdir df/d15/d36 39 2024-09-13T18:30:44.514 INFO:tasks.workunit.client.0.smithi038.stdout:5/678: stat df/c62 0 2024-09-13T18:30:44.514 INFO:tasks.workunit.client.0.smithi038.stdout:5/679: stat df/d13/d49/d70/ca3 0 2024-09-13T18:30:44.519 INFO:tasks.workunit.client.0.smithi038.stdout:9/623: dread d0/d7/d2c/fdc [0,4194304] 0 2024-09-13T18:30:44.519 INFO:tasks.workunit.client.0.smithi038.stdout:9/624: fdatasync d0/d7/d2c/d5a/f95 0 2024-09-13T18:30:44.519 INFO:tasks.workunit.client.0.smithi038.stdout:9/625: dread - d0/d7/d13/d2d/fb4 zero size 2024-09-13T18:30:44.519 INFO:tasks.workunit.client.0.smithi038.stdout:9/626: fdatasync d0/d7/d2c/d5a/d67/f87 0 2024-09-13T18:30:44.519 INFO:tasks.workunit.client.0.smithi038.stdout:9/627: chown d0/d7/d13/d2d/d3c/d50/l7a 949 1 2024-09-13T18:30:44.519 INFO:tasks.workunit.client.0.smithi038.stdout:8/917: link d1/de/d21/d24/d4d/da6/f115 d1/de/d21/d24/d41/db7/f135 0 2024-09-13T18:30:44.520 INFO:tasks.workunit.client.0.smithi038.stdout:5/680: getdents df/da5 0 2024-09-13T18:30:44.522 INFO:tasks.workunit.client.0.smithi038.stdout:9/628: symlink d0/d7/d2c/d5a/ldf 0 2024-09-13T18:30:44.522 INFO:tasks.workunit.client.0.smithi038.stdout:9/629: write d0/d7/d2c/fa7 [449557,109732] 0 2024-09-13T18:30:44.522 INFO:tasks.workunit.client.0.smithi038.stdout:1/991: read d12/d2a/f51 [5028505,93545] 0 2024-09-13T18:30:44.525 INFO:tasks.workunit.client.0.smithi038.stdout:8/918: mknod d1/d2a/d40/dbe/dc4/c136 0 2024-09-13T18:30:44.525 INFO:tasks.workunit.client.0.smithi038.stdout:8/919: stat d1/de/d21/d45/d5d/f87 0 2024-09-13T18:30:44.525 INFO:tasks.workunit.client.0.smithi038.stdout:8/920: truncate d1/de/f33 1389094 0 2024-09-13T18:30:44.525 INFO:tasks.workunit.client.0.smithi038.stdout:8/921: readlink d1/de/d15/d30/l57 0 2024-09-13T18:30:44.525 INFO:tasks.workunit.client.0.smithi038.stdout:8/922: chown d1/de/d21/d102/f11b 175567 1 2024-09-13T18:30:44.526 INFO:tasks.workunit.client.0.smithi038.stdout:5/681: mkdir df/d15/d36/d67/dbf/d44/d52/db6/dd5 0 2024-09-13T18:30:44.527 INFO:tasks.workunit.client.0.smithi038.stdout:5/682: write df/d15/d36/f3c [1114830,51234] 0 2024-09-13T18:30:44.527 INFO:tasks.workunit.client.0.smithi038.stdout:5/683: write df/d15/d36/d67/dbf/d44/d48/d75/f8f [1019778,91977] 0 2024-09-13T18:30:44.529 INFO:tasks.workunit.client.0.smithi038.stdout:9/630: read d0/d7/d13/d30/fbd [546307,34280] 0 2024-09-13T18:30:44.529 INFO:tasks.workunit.client.0.smithi038.stdout:9/631: chown d0/f8 3 1 2024-09-13T18:30:44.532 INFO:tasks.workunit.client.0.smithi038.stdout:1/992: rename d12/d2a/d72/dea/d84/l12a to d12/d3c/d46/d58/l13d 0 2024-09-13T18:30:44.532 INFO:tasks.workunit.client.0.smithi038.stdout:1/993: creat d12/d7a/ddb/f13e x:0 0 0 2024-09-13T18:30:44.532 INFO:tasks.workunit.client.0.smithi038.stdout:1/994: dread - d12/d7a/ddb/f13e zero size 2024-09-13T18:30:44.534 INFO:tasks.workunit.client.0.smithi038.stdout:5/684: mkdir df/d15/d36/d67/dbf/d44/d58/dd6 0 2024-09-13T18:30:44.534 INFO:tasks.workunit.client.0.smithi038.stdout:5/685: truncate df/d15/d36/d67/f81 822651 0 2024-09-13T18:30:44.534 INFO:tasks.workunit.client.0.smithi038.stdout:8/923: dread d1/d4/f47 [0,4194304] 0 2024-09-13T18:30:44.536 INFO:tasks.workunit.client.0.smithi038.stdout:9/632: rename d0/d7/d13/d2d/d3c/d50/f54 to d0/d7/d2c/d5a/dd8/fe0 0 2024-09-13T18:30:44.537 INFO:tasks.workunit.client.0.smithi038.stdout:3/701: sync 2024-09-13T18:30:44.537 INFO:tasks.workunit.client.0.smithi038.stdout:7/647: sync 2024-09-13T18:30:44.537 INFO:tasks.workunit.client.0.smithi038.stdout:2/672: sync 2024-09-13T18:30:44.538 INFO:tasks.workunit.client.0.smithi038.stdout:2/673: write d2/d5c/dbb/fd1 [616296,9376] 0 2024-09-13T18:30:44.538 INFO:tasks.workunit.client.0.smithi038.stdout:2/674: truncate d2/d1e/d44/d50/d39/d45/f54 2580095 0 2024-09-13T18:30:44.538 INFO:tasks.workunit.client.0.smithi038.stdout:2/675: write d2/d1e/d44/d50/f31 [4717736,9558] 0 2024-09-13T18:30:44.539 INFO:tasks.workunit.client.0.smithi038.stdout:1/995: symlink d12/d3c/l13f 0 2024-09-13T18:30:44.539 INFO:tasks.workunit.client.0.smithi038.stdout:1/996: write d12/d2a/f6f [1413491,78956] 0 2024-09-13T18:30:44.540 INFO:tasks.workunit.client.0.smithi038.stdout:1/997: chown d12/d2a/d8e/l95 11 1 2024-09-13T18:30:44.540 INFO:tasks.workunit.client.0.smithi038.stdout:1/998: fdatasync d12/d3c/d46/d58/fdf 0 2024-09-13T18:30:44.540 INFO:tasks.workunit.client.0.smithi038.stdout:1/999: write d12/d2a/d72/dea/f80 [1197889,32657] 0 2024-09-13T18:30:44.541 INFO:tasks.workunit.client.0.smithi038.stdout:5/686: creat df/d15/d36/d67/dbf/d44/d48/d75/fd7 x:0 0 0 2024-09-13T18:30:44.541 INFO:tasks.workunit.client.0.smithi038.stdout:5/687: fdatasync df/f1b 0 2024-09-13T18:30:44.541 INFO:tasks.workunit.client.0.smithi038.stdout:5/688: fsync f1 0 2024-09-13T18:30:44.541 INFO:tasks.workunit.client.0.smithi038.stdout:5/689: creat df/d15/d36/d67/dbf/d44/d48/d75/fd8 x:0 0 0 2024-09-13T18:30:44.542 INFO:tasks.workunit.client.0.smithi038.stdout:8/924: rmdir d1/de/d21/d24/db0 39 2024-09-13T18:30:44.544 INFO:tasks.workunit.client.0.smithi038.stdout:9/633: rename d0/d7/d2c/d5a/ldf to d0/d7/d2c/d5a/d67/d9e/le1 0 2024-09-13T18:30:44.544 INFO:tasks.workunit.client.0.smithi038.stdout:9/634: truncate d0/d7/d2c/d5e/f97 481589 0 2024-09-13T18:30:44.547 INFO:tasks.workunit.client.0.smithi038.stdout:3/702: symlink d0/dd/d17/d50/d5c/d1d/dcc/ld7 0 2024-09-13T18:30:44.550 INFO:tasks.workunit.client.0.smithi038.stdout:5/690: truncate df/d13/dc7/fd3 3779921 0 2024-09-13T18:30:44.550 INFO:tasks.workunit.client.0.smithi038.stdout:5/691: readlink df/d15/d36/d67/dbf/d44/d48/d56/l8d 0 2024-09-13T18:30:44.551 INFO:tasks.workunit.client.0.smithi038.stdout:5/692: read df/d68/fba [83521,42365] 0 2024-09-13T18:30:44.552 INFO:tasks.workunit.client.0.smithi038.stdout:8/925: creat d1/d2a/d3f/dbb/dcb/f137 x:0 0 0 2024-09-13T18:30:44.558 INFO:tasks.workunit.client.0.smithi038.stdout:2/676: rename d2/d1e/c20 to d2/da/d98/cf2 0 2024-09-13T18:30:44.558 INFO:tasks.workunit.client.0.smithi038.stdout:2/677: stat d2/da/d16/c3f 0 2024-09-13T18:30:44.561 INFO:tasks.workunit.client.0.smithi038.stdout:9/635: creat d0/d7/d2c/d33/d4a/dcf/fe2 x:0 0 0 2024-09-13T18:30:44.562 INFO:tasks.workunit.client.0.smithi038.stdout:9/636: read d0/d7/d13/d2d/d3e/f88 [163177,59696] 0 2024-09-13T18:30:44.563 INFO:tasks.workunit.client.0.smithi038.stdout:9/637: chown d0/d7/d2c/d5e 32 1 2024-09-13T18:30:44.563 INFO:tasks.workunit.client.0.smithi038.stdout:8/926: symlink d1/d2a/d3f/dbb/d105/l138 0 2024-09-13T18:30:44.569 INFO:tasks.workunit.client.0.smithi038.stdout:3/703: rename d0/dd/d17/d50/d5c/d23/d93/fab to d0/dd/d17/d43/dc6/fd8 0 2024-09-13T18:30:44.572 INFO:tasks.workunit.client.0.smithi038.stdout:2/678: creat d2/d5c/d66/dda/ff3 x:0 0 0 2024-09-13T18:30:44.573 INFO:tasks.workunit.client.0.smithi038.stdout:8/927: symlink d1/d2a/d3f/dbb/dcb/l139 0 2024-09-13T18:30:44.573 INFO:tasks.workunit.client.0.smithi038.stdout:8/928: readlink d1/de/d107/l32 0 2024-09-13T18:30:44.574 INFO:tasks.workunit.client.0.smithi038.stdout:2/679: dread d2/d1e/f4e [0,4194304] 0 2024-09-13T18:30:44.575 INFO:tasks.workunit.client.0.smithi038.stdout:5/693: rename df/d13/d49/d9a/fa6 to df/d15/d36/d67/dbf/d3e/fd9 0 2024-09-13T18:30:44.575 INFO:tasks.workunit.client.0.smithi038.stdout:5/694: dread - df/d13/d49/d70/faa zero size 2024-09-13T18:30:44.580 INFO:tasks.workunit.client.0.smithi038.stdout:2/680: symlink d2/d1e/d44/d50/d46/lf4 0 2024-09-13T18:30:44.580 INFO:tasks.workunit.client.0.smithi038.stdout:2/681: dread - d2/d1e/d44/d50/d39/d40/ddb/fe2 zero size 2024-09-13T18:30:44.582 INFO:tasks.workunit.client.0.smithi038.stdout:5/695: mknod df/d15/d36/d67/dbf/d44/d48/d54/cda 0 2024-09-13T18:30:44.584 INFO:tasks.workunit.client.0.smithi038.stdout:8/929: dread d1/de/d21/d24/d41/fd5 [0,4194304] 0 2024-09-13T18:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout:5/696: creat df/d15/d36/d67/dbf/d44/d52/db6/dd5/fdb x:0 0 0 2024-09-13T18:30:44.586 INFO:tasks.workunit.client.0.smithi038.stdout:5/697: fdatasync df/f10 0 2024-09-13T18:30:44.593 INFO:tasks.workunit.client.0.smithi038.stdout:3/704: dwrite d0/dd/d17/d50/d5c/d23/f2c [4194304,4194304] 0 2024-09-13T18:30:44.593 INFO:tasks.workunit.client.0.smithi038.stdout:3/705: chown d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/f7b 3 1 2024-09-13T18:30:44.608 INFO:tasks.workunit.client.0.smithi038.stdout:3/706: dread d0/dd/d17/d50/d5c/f21 [0,4194304] 0 2024-09-13T18:30:44.609 INFO:tasks.workunit.client.0.smithi038.stdout:8/930: dwrite d1/d2a/d3f/dbb/ff9 [0,4194304] 0 2024-09-13T18:30:44.618 INFO:tasks.workunit.client.0.smithi038.stdout:5/698: dwrite df/d15/d36/d67/dbf/d44/d58/fad [0,4194304] 0 2024-09-13T18:30:44.618 INFO:tasks.workunit.client.0.smithi038.stdout:5/699: write df/d15/d36/d67/dbf/d44/f46 [4682908,110914] 0 2024-09-13T18:30:44.619 INFO:tasks.workunit.client.0.smithi038.stdout:8/931: link d1/d4/c9d d1/de/d21/d24/d41/d80/d8f/c13a 0 2024-09-13T18:30:44.622 INFO:tasks.workunit.client.0.smithi038.stdout:3/707: dread d0/dd/d17/d79/dd5/fb0 [4194304,4194304] 0 2024-09-13T18:30:44.623 INFO:tasks.workunit.client.0.smithi038.stdout:3/708: write d0/dd/fe [4107655,128974] 0 2024-09-13T18:30:44.626 INFO:tasks.workunit.client.0.smithi038.stdout:3/709: link d0/dd/d17/f1c d0/dd/d17/d50/d5c/d1d/fd9 0 2024-09-13T18:30:44.631 INFO:tasks.workunit.client.0.smithi038.stdout:8/932: dread d1/de/d21/d24/d4d/d50/fa0 [0,4194304] 0 2024-09-13T18:30:44.631 INFO:tasks.workunit.client.0.smithi038.stdout:8/933: truncate d1/de/d15/f130 625754 0 2024-09-13T18:30:44.631 INFO:tasks.workunit.client.0.smithi038.stdout:8/934: chown d1/de/d15/d30/l57 0 1 2024-09-13T18:30:44.631 INFO:tasks.workunit.client.0.smithi038.stdout:8/935: truncate d1/de/d21/d24/d41/fd5 3068764 0 2024-09-13T18:30:44.633 INFO:tasks.workunit.client.0.smithi038.stdout:8/936: mkdir d1/d2a/d40/dbe/d13b 0 2024-09-13T18:30:44.639 INFO:tasks.workunit.client.0.smithi038.stdout:3/710: dread d0/dd/d17/d50/d5c/d1d/d30/f77 [4194304,4194304] 0 2024-09-13T18:30:44.648 INFO:tasks.workunit.client.0.smithi038.stdout:8/937: dread d1/de/d15/d30/f55 [0,4194304] 0 2024-09-13T18:30:44.650 INFO:tasks.workunit.client.0.smithi038.stdout:8/938: mknod d1/de/d4c/d108/c13c 0 2024-09-13T18:30:44.663 INFO:tasks.workunit.client.0.smithi038.stdout:8/939: write d1/de/d21/f9f [3295320,11825] 0 2024-09-13T18:30:44.664 INFO:tasks.workunit.client.0.smithi038.stdout:3/711: dwrite d0/dd/d17/d43/f5d [8388608,4194304] 0 2024-09-13T18:30:44.669 INFO:tasks.workunit.client.0.smithi038.stdout:3/712: symlink d0/dd/d17/d50/d5c/d1d/d30/d95/da6/lda 0 2024-09-13T18:30:44.669 INFO:tasks.workunit.client.0.smithi038.stdout:3/713: chown d0/dd/d17/d50/d5c/d1d/d30/d95/c8b 5929 1 2024-09-13T18:30:44.670 INFO:tasks.workunit.client.0.smithi038.stdout:8/940: getdents d1/de/d4c 0 2024-09-13T18:30:44.673 INFO:tasks.workunit.client.0.smithi038.stdout:3/714: rename d0/dd/d17/d50/d5c/d1d/d30/d95/da6/fc9 to d0/dd/d17/d50/d5c/d23/d52/fdb 0 2024-09-13T18:30:44.673 INFO:tasks.workunit.client.0.smithi038.stdout:3/715: chown d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/ld3 489 1 2024-09-13T18:30:44.673 INFO:tasks.workunit.client.0.smithi038.stdout:3/716: chown d0/dd/d17/d50/d5c/f21 6193 1 2024-09-13T18:30:44.673 INFO:tasks.workunit.client.0.smithi038.stdout:3/717: write d0/dd/d17/d50/d5c/d1d/d30/f74 [3169329,108019] 0 2024-09-13T18:30:44.673 INFO:tasks.workunit.client.0.smithi038.stdout:3/718: stat d0/dd/d17/d50/d5c/d23/f2c 0 2024-09-13T18:30:44.674 INFO:tasks.workunit.client.0.smithi038.stdout:8/941: mkdir d1/de/d21/d24/d41/d80/dca/d110/d13d 0 2024-09-13T18:30:44.685 INFO:tasks.workunit.client.0.smithi038.stdout:9/638: dwrite d0/f6 [0,4194304] 0 2024-09-13T18:30:44.685 INFO:tasks.workunit.client.0.smithi038.stdout:3/719: write d0/dd/d17/d50/d5c/d1d/d30/d95/f49 [5662762,18618] 0 2024-09-13T18:30:44.685 INFO:tasks.workunit.client.0.smithi038.stdout:3/720: chown d0/dd/f2a 199 1 2024-09-13T18:30:44.687 INFO:tasks.workunit.client.0.smithi038.stdout:8/942: write d1/de/d21/f85 [1077726,42258] 0 2024-09-13T18:30:44.693 INFO:tasks.workunit.client.0.smithi038.stdout:9/639: creat d0/d7/d2c/d5a/fe3 x:0 0 0 2024-09-13T18:30:44.694 INFO:tasks.workunit.client.0.smithi038.stdout:3/721: rmdir d0/dd/d17/d50/d5c/d23/d7c/d9c 39 2024-09-13T18:30:44.700 INFO:tasks.workunit.client.0.smithi038.stdout:3/722: symlink d0/dd/d17/d43/dc6/ldc 0 2024-09-13T18:30:44.701 INFO:tasks.workunit.client.0.smithi038.stdout:3/723: dread d0/dd/d17/faf [0,4194304] 0 2024-09-13T18:30:44.701 INFO:tasks.workunit.client.0.smithi038.stdout:3/724: chown d0/dd/d17/d50/c53 6 1 2024-09-13T18:30:44.701 INFO:tasks.workunit.client.0.smithi038.stdout:3/725: fdatasync d0/dd/d17/d50/d5c/d23/d52/d6e/f35 0 2024-09-13T18:30:44.702 INFO:tasks.workunit.client.0.smithi038.stdout:8/943: rename d1/d4/fad to d1/d2a/d40/f13e 0 2024-09-13T18:30:44.702 INFO:tasks.workunit.client.0.smithi038.stdout:8/944: write d1/d2a/d3f/f12e [321430,18916] 0 2024-09-13T18:30:44.707 INFO:tasks.workunit.client.0.smithi038.stdout:3/726: creat d0/dd/d17/d50/d5c/fdd x:0 0 0 2024-09-13T18:30:44.710 INFO:tasks.workunit.client.0.smithi038.stdout:3/727: link d0/dd/d17/c4a d0/dd/d17/d50/d5c/d1d/dcc/cde 0 2024-09-13T18:30:44.710 INFO:tasks.workunit.client.0.smithi038.stdout:9/640: dwrite d0/d7/d13/f58 [4194304,4194304] 0 2024-09-13T18:30:44.712 INFO:tasks.workunit.client.0.smithi038.stdout:3/728: unlink d0/dd/d17/faf 0 2024-09-13T18:30:44.713 INFO:tasks.workunit.client.0.smithi038.stdout:3/729: write d0/dd/d17/d50/d5c/d23/d93/fc7 [5155524,119974] 0 2024-09-13T18:30:44.714 INFO:tasks.workunit.client.0.smithi038.stdout:9/641: creat d0/d7/d13/d2d/d3e/d70/da2/d86/fe4 x:0 0 0 2024-09-13T18:30:44.714 INFO:tasks.workunit.client.0.smithi038.stdout:3/730: stat d0/dd/d17/d79/dd5/cb2 0 2024-09-13T18:30:44.716 INFO:tasks.workunit.client.0.smithi038.stdout:3/731: rmdir d0/dd/d17/d79 39 2024-09-13T18:30:44.717 INFO:tasks.workunit.client.0.smithi038.stdout:3/732: symlink d0/dd/d17/d50/d5c/d1d/ldf 0 2024-09-13T18:30:44.717 INFO:tasks.workunit.client.0.smithi038.stdout:3/733: write d0/dd/d17/d50/d5c/f47 [2852763,114958] 0 2024-09-13T18:30:44.717 INFO:tasks.workunit.client.0.smithi038.stdout:3/734: creat d0/dd/d17/d50/d5c/d23/d52/fe0 x:0 0 0 2024-09-13T18:30:44.720 INFO:tasks.workunit.client.0.smithi038.stdout:9/642: dread d0/d7/f45 [0,4194304] 0 2024-09-13T18:30:44.721 INFO:tasks.workunit.client.0.smithi038.stdout:9/643: write d0/d7/d2c/d6d/f75 [2604512,57549] 0 2024-09-13T18:30:44.722 INFO:tasks.workunit.client.0.smithi038.stdout:9/644: rename d0/d7/d13/d2d/d3c/f5b to d0/d7/d2c/d6d/d9c/fe5 0 2024-09-13T18:30:44.722 INFO:tasks.workunit.client.0.smithi038.stdout:9/645: fsync d0/d7/d13/f1e 0 2024-09-13T18:30:44.722 INFO:tasks.workunit.client.0.smithi038.stdout:9/646: dread - d0/d7/d13/d30/fc7 zero size 2024-09-13T18:30:44.723 INFO:tasks.workunit.client.0.smithi038.stdout:9/647: mkdir d0/d7/d2c/d6d/de6 0 2024-09-13T18:30:44.723 INFO:tasks.workunit.client.0.smithi038.stdout:9/648: symlink d0/d7/d13/d2d/d3c/d50/le7 0 2024-09-13T18:30:44.724 INFO:tasks.workunit.client.0.smithi038.stdout:9/649: unlink d0/d7/d13/c2b 0 2024-09-13T18:30:44.725 INFO:tasks.workunit.client.0.smithi038.stdout:9/650: link d0/d7/d13/d30/l40 d0/d7/d2c/d33/d4a/le8 0 2024-09-13T18:30:44.726 INFO:tasks.workunit.client.0.smithi038.stdout:9/651: creat d0/d7/d2c/d5e/fe9 x:0 0 0 2024-09-13T18:30:44.727 INFO:tasks.workunit.client.0.smithi038.stdout:9/652: creat d0/d7/d13/d2d/d3e/fea x:0 0 0 2024-09-13T18:30:44.728 INFO:tasks.workunit.client.0.smithi038.stdout:9/653: symlink d0/d7/d2c/d5e/dc5/leb 0 2024-09-13T18:30:44.731 INFO:tasks.workunit.client.0.smithi038.stdout:8/945: dwrite d1/de/d21/f9f [4194304,4194304] 0 2024-09-13T18:30:44.731 INFO:tasks.workunit.client.0.smithi038.stdout:3/735: dread d0/dd/d17/d50/d5c/f55 [0,4194304] 0 2024-09-13T18:30:44.733 INFO:tasks.workunit.client.0.smithi038.stdout:8/946: creat d1/de/d21/d24/d4d/d50/f13f x:0 0 0 2024-09-13T18:30:44.735 INFO:tasks.workunit.client.0.smithi038.stdout:8/947: creat d1/d2a/d40/dbe/dc6/f140 x:0 0 0 2024-09-13T18:30:44.735 INFO:tasks.workunit.client.0.smithi038.stdout:8/948: write d1/de/d21/d24/d41/f79 [1708912,47882] 0 2024-09-13T18:30:44.735 INFO:tasks.workunit.client.0.smithi038.stdout:8/949: getdents d1/d2a/d3f/dbb/dcb 0 2024-09-13T18:30:44.737 INFO:tasks.workunit.client.0.smithi038.stdout:8/950: mkdir d1/de/d21/d24/d41/d80/dca/d114/d141 0 2024-09-13T18:30:44.738 INFO:tasks.workunit.client.0.smithi038.stdout:8/951: getdents d1/de/d21/d45/d5d 0 2024-09-13T18:30:44.738 INFO:tasks.workunit.client.0.smithi038.stdout:8/952: symlink d1/de/d4c/l142 0 2024-09-13T18:30:44.739 INFO:tasks.workunit.client.0.smithi038.stdout:8/953: fsync d1/d2a/d40/f8e 0 2024-09-13T18:30:44.807 INFO:tasks.workunit.client.0.smithi038.stdout:3/736: dwrite d0/dd/d17/d50/d5c/d23/fc1 [0,4194304] 0 2024-09-13T18:30:44.807 INFO:tasks.workunit.client.0.smithi038.stdout:3/737: truncate d0/dd/d17/d43/d89/f85 863042 0 2024-09-13T18:30:44.807 INFO:tasks.workunit.client.0.smithi038.stdout:3/738: chown d0/dd/d17/d50/d5c/d1d/d30/d95 2 1 2024-09-13T18:30:44.808 INFO:tasks.workunit.client.0.smithi038.stdout:9/654: dwrite d0/d7/d2c/d5a/f95 [0,4194304] 0 2024-09-13T18:30:44.815 INFO:tasks.workunit.client.0.smithi038.stdout:3/739: mknod d0/dd/d17/d50/d5c/d23/d7c/d9c/ce1 0 2024-09-13T18:30:44.815 INFO:tasks.workunit.client.0.smithi038.stdout:3/740: truncate d0/dd/d17/d50/d5c/d23/d6b/f6d 936161 0 2024-09-13T18:30:44.825 INFO:tasks.workunit.client.0.smithi038.stdout:9/655: truncate d0/d7/d2c/fd2 1175090 0 2024-09-13T18:30:44.832 INFO:tasks.workunit.client.0.smithi038.stdout:8/954: fsync d1/d2a/d40/dbe/dc6/f140 0 2024-09-13T18:30:44.832 INFO:tasks.workunit.client.0.smithi038.stdout:8/955: fdatasync d1/de/d21/d45/f81 0 2024-09-13T18:30:44.837 INFO:tasks.workunit.client.0.smithi038.stdout:3/741: dwrite d0/dd/d17/d50/d5c/d1d/fd1 [0,4194304] 0 2024-09-13T18:30:44.844 INFO:tasks.workunit.client.0.smithi038.stdout:3/742: symlink d0/dd/d17/d50/d5c/d23/d52/le2 0 2024-09-13T18:30:44.844 INFO:tasks.workunit.client.0.smithi038.stdout:3/743: dread - d0/dd/d17/d50/d5c/fdd zero size 2024-09-13T18:30:44.844 INFO:tasks.workunit.client.0.smithi038.stdout:8/956: dread d1/de/d21/d24/d41/d8c/fbf [0,4194304] 0 2024-09-13T18:30:44.845 INFO:tasks.workunit.client.0.smithi038.stdout:8/957: mknod d1/c143 0 2024-09-13T18:30:44.851 INFO:tasks.workunit.client.0.smithi038.stdout:9/656: dwrite d0/d7/d13/d30/fd7 [0,4194304] 0 2024-09-13T18:30:44.851 INFO:tasks.workunit.client.0.smithi038.stdout:9/657: dread - d0/d7/d2c/dbf/fda zero size 2024-09-13T18:30:44.853 INFO:tasks.workunit.client.0.smithi038.stdout:9/658: mknod d0/d7/d2c/dbf/cec 0 2024-09-13T18:30:44.854 INFO:tasks.workunit.client.0.smithi038.stdout:3/744: read d0/dd/d17/d50/d5c/d23/d93/fc7 [3804722,71709] 0 2024-09-13T18:30:44.860 INFO:tasks.workunit.client.0.smithi038.stdout:3/745: symlink d0/dd/d17/d50/d5c/d23/d7c/le3 0 2024-09-13T18:30:44.860 INFO:tasks.workunit.client.0.smithi038.stdout:3/746: stat d0/dd/d17/d50/d5c/d1d/dcb 0 2024-09-13T18:30:44.860 INFO:tasks.workunit.client.0.smithi038.stdout:3/747: fsync d0/dd/d17/f81 0 2024-09-13T18:30:44.860 INFO:tasks.workunit.client.0.smithi038.stdout:3/748: truncate d0/dd/d17/d43/fa8 669450 0 2024-09-13T18:30:44.861 INFO:tasks.workunit.client.0.smithi038.stdout:9/659: rmdir d0/d7/d13/d2d/d3c/d50 39 2024-09-13T18:30:44.861 INFO:tasks.workunit.client.0.smithi038.stdout:9/660: truncate d0/d7/d13/d2d/d3e/d70/da2/d86/fe4 124080 0 2024-09-13T18:30:44.861 INFO:tasks.workunit.client.0.smithi038.stdout:9/661: chown d0/d7/d2c/dbf/fd4 297424 1 2024-09-13T18:30:44.861 INFO:tasks.workunit.client.0.smithi038.stdout:9/662: dread - d0/d7/d2c/d33/d4a/dcf/fe2 zero size 2024-09-13T18:30:44.863 INFO:tasks.workunit.client.0.smithi038.stdout:9/663: creat d0/d7/d13/d2d/d3e/d70/fed x:0 0 0 2024-09-13T18:30:44.863 INFO:tasks.workunit.client.0.smithi038.stdout:9/664: dread - d0/d2e/d7f/f8e zero size 2024-09-13T18:30:44.867 INFO:tasks.workunit.client.0.smithi038.stdout:3/749: rmdir d0/dd/d17/d50/d5c/d23/d52/d6e 39 2024-09-13T18:30:44.867 INFO:tasks.workunit.client.0.smithi038.stdout:3/750: stat d0/dd/d17/d79/dd5/f6f 0 2024-09-13T18:30:44.870 INFO:tasks.workunit.client.0.smithi038.stdout:9/665: creat d0/d7/d13/d2d/d3c/dc9/fee x:0 0 0 2024-09-13T18:30:44.872 INFO:tasks.workunit.client.0.smithi038.stdout:3/751: rename d0/dd/d17/d79/dd5/cb2 to d0/dd/d17/ce4 0 2024-09-13T18:30:44.875 INFO:tasks.workunit.client.0.smithi038.stdout:9/666: mknod d0/d7/d13/d2d/d3c/d50/cef 0 2024-09-13T18:30:44.875 INFO:tasks.workunit.client.0.smithi038.stdout:9/667: chown d0/d7/c22 3466 1 2024-09-13T18:30:44.878 INFO:tasks.workunit.client.0.smithi038.stdout:3/752: mknod d0/dd/d17/ce5 0 2024-09-13T18:30:44.878 INFO:tasks.workunit.client.0.smithi038.stdout:3/753: fsync d0/dd/d17/d79/dd5/f6f 0 2024-09-13T18:30:44.882 INFO:tasks.workunit.client.0.smithi038.stdout:9/668: dread d0/d7/d2c/d5a/dd8/fe0 [0,4194304] 0 2024-09-13T18:30:44.884 INFO:tasks.workunit.client.0.smithi038.stdout:9/669: stat d0/d7/d13/d2d/d3c/d50/l5f 0 2024-09-13T18:30:44.885 INFO:tasks.workunit.client.0.smithi038.stdout:9/670: mkdir d0/d7/d2c/d33/d4a/df0 0 2024-09-13T18:30:44.887 INFO:tasks.workunit.client.0.smithi038.stdout:9/671: mkdir d0/d7/d2c/d6d/de6/df1 0 2024-09-13T18:30:44.901 INFO:tasks.workunit.client.0.smithi038.stdout:3/754: dwrite d0/dd/d17/d50/d5c/d23/d52/f8c [4194304,4194304] 0 2024-09-13T18:30:44.913 INFO:tasks.workunit.client.0.smithi038.stdout:3/755: dread d0/dd/f5e [0,4194304] 0 2024-09-13T18:30:44.913 INFO:tasks.workunit.client.0.smithi038.stdout:3/756: creat d0/dd/d17/fe6 x:0 0 0 2024-09-13T18:30:44.913 INFO:tasks.workunit.client.0.smithi038.stdout:3/757: stat d0/dd/d17/d50/d5c/d23/d7c/f82 0 2024-09-13T18:30:44.918 INFO:tasks.workunit.client.0.smithi038.stdout:3/758: dread d0/dd/d17/d50/d5c/d1d/d30/d95/d84/f90 [0,4194304] 0 2024-09-13T18:30:44.918 INFO:tasks.workunit.client.0.smithi038.stdout:3/759: read - d0/dd/d17/d50/d5c/d1d/d30/fcd zero size 2024-09-13T18:30:44.919 INFO:tasks.workunit.client.0.smithi038.stdout:3/760: symlink d0/dd/d17/le7 0 2024-09-13T18:30:44.919 INFO:tasks.workunit.client.0.smithi038.stdout:3/761: fsync d0/dd/d17/d50/d5c/d23/d52/d6e/f35 0 2024-09-13T18:30:44.922 INFO:tasks.workunit.client.0.smithi038.stdout:3/762: dread d0/dd/d17/d50/d5c/d1d/d30/d95/f6a [0,4194304] 0 2024-09-13T18:30:44.922 INFO:tasks.workunit.client.0.smithi038.stdout:3/763: dread - d0/dd/d17/d50/d5c/d23/d7c/f82 zero size 2024-09-13T18:30:44.923 INFO:tasks.workunit.client.0.smithi038.stdout:3/764: link d0/dd/l41 d0/dd/d17/d50/d5c/d23/le8 0 2024-09-13T18:30:44.925 INFO:tasks.workunit.client.0.smithi038.stdout:3/765: link d0/dd/d17/d43/c76 d0/dd/d17/d43/d89/ce9 0 2024-09-13T18:30:44.925 INFO:tasks.workunit.client.0.smithi038.stdout:3/766: write d0/dd/fe [2354563,130212] 0 2024-09-13T18:30:44.927 INFO:tasks.workunit.client.0.smithi038.stdout:3/767: rename d0/dd/d17/d50/d5c/d23/d52/fa4 to d0/dd/d17/d43/d89/fea 0 2024-09-13T18:30:44.929 INFO:tasks.workunit.client.0.smithi038.stdout:3/768: unlink d0/dd/d17/d50/d5c/d1d/d30/d95/c2f 0 2024-09-13T18:30:44.931 INFO:tasks.workunit.client.0.smithi038.stdout:3/769: mkdir d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/deb 0 2024-09-13T18:30:44.934 INFO:tasks.workunit.client.0.smithi038.stdout:3/770: link d0/dd/d17/d50/d5c/d1d/c3d d0/dd/d17/d50/d5c/d1d/d30/d95/da6/cec 0 2024-09-13T18:30:44.934 INFO:tasks.workunit.client.0.smithi038.stdout:3/771: chown d0/dd/d17/d43/fa8 28 1 2024-09-13T18:30:44.935 INFO:tasks.workunit.client.0.smithi038.stdout:3/772: truncate d0/dd/d17/d79/dd5/fb0 5043230 0 2024-09-13T18:30:44.937 INFO:tasks.workunit.client.0.smithi038.stdout:3/773: truncate d0/dd/d17/d50/d5c/d23/d52/d6e/f35 2442720 0 2024-09-13T18:30:44.963 INFO:tasks.workunit.client.0.smithi038.stdout:3/774: dwrite d0/dd/d17/d50/d5c/d23/d52/d6e/f35 [0,4194304] 0 2024-09-13T18:30:44.964 INFO:tasks.workunit.client.0.smithi038.stdout:3/775: symlink d0/dd/d17/d50/d5c/d1d/d30/d95/da6/led 0 2024-09-13T18:30:44.964 INFO:tasks.workunit.client.0.smithi038.stdout:3/776: chown d0/dd/d17/d50/d5c/d23/d52/d6e/f35 6 1 2024-09-13T18:30:44.984 INFO:tasks.workunit.client.0.smithi038.stdout:3/777: dwrite d0/dd/fe [0,4194304] 0 2024-09-13T18:30:44.985 INFO:tasks.workunit.client.0.smithi038.stdout:3/778: symlink d0/dd/d17/d50/d5c/d23/lee 0 2024-09-13T18:30:44.992 INFO:tasks.workunit.client.0.smithi038.stdout:3/779: write d0/dd/d17/d50/d5c/f9a [3765436,114506] 0 2024-09-13T18:30:44.992 INFO:tasks.workunit.client.0.smithi038.stdout:3/780: readlink d0/dd/d17/d79/dd5/l91 0 2024-09-13T18:30:44.993 INFO:tasks.workunit.client.0.smithi038.stdout:3/781: mkdir d0/dd/d17/d50/def 0 2024-09-13T18:30:44.993 INFO:tasks.workunit.client.0.smithi038.stdout:3/782: write d0/dd/d17/d50/d5c/d1d/d30/d95/f4d [155026,106164] 0 2024-09-13T18:30:44.993 INFO:tasks.workunit.client.0.smithi038.stdout:3/783: write d0/dd/d17/d43/dc6/fd8 [389950,96927] 0 2024-09-13T18:30:44.993 INFO:tasks.workunit.client.0.smithi038.stdout:3/784: creat d0/dd/d17/d50/d5c/ff0 x:0 0 0 2024-09-13T18:30:45.002 INFO:tasks.workunit.client.0.smithi038.stdout:3/785: dread d0/dd/d17/f73 [0,4194304] 0 2024-09-13T18:30:45.010 INFO:tasks.workunit.client.0.smithi038.stdout:3/786: read d0/dd/f2a [1861354,83172] 0 2024-09-13T18:30:45.012 INFO:tasks.workunit.client.0.smithi038.stdout:3/787: mknod d0/dd/d17/d43/dc6/cf1 0 2024-09-13T18:30:45.018 INFO:tasks.workunit.client.0.smithi038.stdout:3/788: symlink d0/dd/d17/d50/d5c/d23/d6b/lf2 0 2024-09-13T18:30:45.018 INFO:tasks.workunit.client.0.smithi038.stdout:3/789: creat d0/dd/d17/d50/d5c/d23/d93/ff3 x:0 0 0 2024-09-13T18:30:45.026 INFO:tasks.workunit.client.0.smithi038.stdout:3/790: write d0/dd/d17/d50/d5c/d23/d52/f8c [2847288,80682] 0 2024-09-13T18:30:45.027 INFO:tasks.workunit.client.0.smithi038.stdout:3/791: mknod d0/dd/d17/d50/def/cf4 0 2024-09-13T18:30:45.028 INFO:tasks.workunit.client.0.smithi038.stdout:3/792: symlink d0/dd/d17/lf5 0 2024-09-13T18:30:45.029 INFO:tasks.workunit.client.0.smithi038.stdout:3/793: mknod d0/dd/d17/d50/d5c/d1d/cf6 0 2024-09-13T18:30:45.031 INFO:tasks.workunit.client.0.smithi038.stdout:3/794: unlink d0/dd/d17/d50/d5c/d23/f2c 0 2024-09-13T18:30:45.032 INFO:tasks.workunit.client.0.smithi038.stdout:3/795: mkdir d0/dd/d17/d50/d5c/d23/d93/df7 0 2024-09-13T18:30:45.033 INFO:tasks.workunit.client.0.smithi038.stdout:3/796: creat d0/dd/d17/d50/d5c/d1d/d30/d95/ff8 x:0 0 0 2024-09-13T18:30:45.033 INFO:tasks.workunit.client.0.smithi038.stdout:3/797: fdatasync d0/dd/d17/d50/d5c/fbf 0 2024-09-13T18:30:45.033 INFO:tasks.workunit.client.0.smithi038.stdout:3/798: write d0/dd/d17/d50/d5c/d23/d52/f8c [38207,34857] 0 2024-09-13T18:30:45.033 INFO:tasks.workunit.client.0.smithi038.stdout:3/799: chown d0/dd/d17/d43/d89/fea 42457 1 2024-09-13T18:30:45.034 INFO:tasks.workunit.client.0.smithi038.stdout:3/800: chown d0/dd/d17/d50/d5c/d1d/d30/d95 623597 1 2024-09-13T18:30:45.034 INFO:tasks.workunit.client.0.smithi038.stdout:3/801: symlink d0/dd/d17/d50/d5c/d23/d93/df7/lf9 0 2024-09-13T18:30:45.055 INFO:tasks.workunit.client.0.smithi038.stdout:3/802: dwrite d0/dd/d17/f81 [4194304,4194304] 0 2024-09-13T18:30:45.070 INFO:tasks.workunit.client.0.smithi038.stdout:3/803: dwrite d0/dd/d17/d50/d5c/d23/d7c/f82 [0,4194304] 0 2024-09-13T18:30:45.092 INFO:tasks.workunit.client.0.smithi038.stdout:3/804: dwrite d0/dd/d17/d50/d5c/d1d/d30/f74 [0,4194304] 0 2024-09-13T18:30:45.092 INFO:tasks.workunit.client.0.smithi038.stdout:3/805: fsync d0/dd/d17/d50/d5c/d23/d6b/f6d 0 2024-09-13T18:30:45.093 INFO:tasks.workunit.client.0.smithi038.stdout:3/806: link d0/dd/d17/d50/d5c/d23/d52/fdb d0/dd/d17/d50/d5c/d1d/dcb/ffa 0 2024-09-13T18:30:45.099 INFO:tasks.workunit.client.0.smithi038.stdout:4/998: sync 2024-09-13T18:30:45.100 INFO:tasks.workunit.client.0.smithi038.stdout:3/807: dread d0/dd/d17/d79/dd5/fb0 [0,4194304] 0 2024-09-13T18:30:45.100 INFO:tasks.workunit.client.0.smithi038.stdout:3/808: write d0/dd/d17/d50/d5c/f47 [3648716,32823] 0 2024-09-13T18:30:45.103 INFO:tasks.workunit.client.0.smithi038.stdout:3/809: truncate d0/dd/d17/d50/d5c/d23/d52/fdb 484933 0 2024-09-13T18:30:45.103 INFO:tasks.workunit.client.0.smithi038.stdout:3/810: chown d0/dd/d17/d50/d5c/d23/d6b/la5 2350 1 2024-09-13T18:30:45.111 INFO:tasks.workunit.client.0.smithi038.stdout:3/811: write d0/dd/d17/f73 [3510367,33306] 0 2024-09-13T18:30:45.118 INFO:tasks.workunit.client.0.smithi038.stdout:4/999: dwrite d2/df/f7a [0,4194304] 0 2024-09-13T18:30:45.125 INFO:tasks.workunit.client.0.smithi038.stdout:3/812: dwrite d0/dd/d17/fc4 [0,4194304] 0 2024-09-13T18:30:45.160 INFO:tasks.workunit.client.0.smithi038.stdout:3/813: symlink d0/dd/d17/d50/d5c/d1d/dcc/lfb 0 2024-09-13T18:30:45.160 INFO:tasks.workunit.client.0.smithi038.stdout:3/814: chown d0/dd/d17/le7 7699 1 2024-09-13T18:30:45.222 INFO:tasks.workunit.client.0.smithi038.stdout:3/815: unlink d0/dd/d17/d50/def/cf4 0 2024-09-13T18:30:45.222 INFO:tasks.workunit.client.0.smithi038.stdout:3/816: write d0/dd/d17/d50/d5c/d23/d52/d6e/f9f [970253,62145] 0 2024-09-13T18:30:45.247 INFO:tasks.workunit.client.0.smithi038.stdout:5/700: sync 2024-09-13T18:30:45.248 INFO:tasks.workunit.client.0.smithi038.stdout:2/682: sync 2024-09-13T18:30:45.248 INFO:tasks.workunit.client.0.smithi038.stdout:5/701: stat df 0 2024-09-13T18:30:45.248 INFO:tasks.workunit.client.0.smithi038.stdout:6/755: sync 2024-09-13T18:30:45.249 INFO:tasks.workunit.client.0.smithi038.stdout:3/817: dwrite d0/dd/d17/d43/d89/fea [0,4194304] 0 2024-09-13T18:30:45.254 INFO:tasks.workunit.client.0.smithi038.stdout:6/756: dread dd/de/f4f [0,4194304] 0 2024-09-13T18:30:45.254 INFO:tasks.workunit.client.0.smithi038.stdout:6/757: creat dd/de/d2e/d2f/d4c/d86/f10c x:0 0 0 2024-09-13T18:30:45.258 INFO:tasks.workunit.client.0.smithi038.stdout:2/683: dread d2/da/f77 [0,4194304] 0 2024-09-13T18:30:45.258 INFO:tasks.workunit.client.0.smithi038.stdout:6/758: symlink dd/de/d2e/d104/l10d 0 2024-09-13T18:30:45.260 INFO:tasks.workunit.client.0.smithi038.stdout:2/684: truncate d2/d1e/d44/f76 1115254 0 2024-09-13T18:30:45.260 INFO:tasks.workunit.client.0.smithi038.stdout:2/685: creat d2/d5c/d66/dda/ff5 x:0 0 0 2024-09-13T18:30:45.264 INFO:tasks.workunit.client.0.smithi038.stdout:5/702: dwrite df/d15/d36/d67/dbf/d3e/f33 [4194304,4194304] 0 2024-09-13T18:30:45.265 INFO:tasks.workunit.client.0.smithi038.stdout:2/686: link d2/d1e/d44/d50/d39/faa d2/d5c/dea/ff6 0 2024-09-13T18:30:45.266 INFO:tasks.workunit.client.0.smithi038.stdout:3/818: rmdir d0/dd/d17/d50/def 0 2024-09-13T18:30:45.267 INFO:tasks.workunit.client.0.smithi038.stdout:5/703: getdents df/d15/d36/d67/dbf/d44/d52 0 2024-09-13T18:30:45.272 INFO:tasks.workunit.client.0.smithi038.stdout:6/759: dread dd/de/d2e/d2f/d4c/f4d [0,4194304] 0 2024-09-13T18:30:45.272 INFO:tasks.workunit.client.0.smithi038.stdout:2/687: mknod d2/d1e/d44/d50/de0/cf7 0 2024-09-13T18:30:45.274 INFO:tasks.workunit.client.0.smithi038.stdout:3/819: mknod d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/deb/cfc 0 2024-09-13T18:30:45.274 INFO:tasks.workunit.client.0.smithi038.stdout:3/820: chown d0/dd/d17/f73 97089243 1 2024-09-13T18:30:45.277 INFO:tasks.workunit.client.0.smithi038.stdout:5/704: mknod df/d15/d36/d67/dbf/d44/d58/d9c/cdc 0 2024-09-13T18:30:45.278 INFO:tasks.workunit.client.0.smithi038.stdout:2/688: creat d2/d1e/d44/d50/d39/ff8 x:0 0 0 2024-09-13T18:30:45.278 INFO:tasks.workunit.client.0.smithi038.stdout:2/689: read - d2/d5c/dea/ff6 zero size 2024-09-13T18:30:45.283 INFO:tasks.workunit.client.0.smithi038.stdout:5/705: link df/d15/d36/l72 df/d15/d36/d67/dbf/d44/d48/d54/ldd 0 2024-09-13T18:30:45.283 INFO:tasks.workunit.client.0.smithi038.stdout:5/706: write df/d13/dc7/fd3 [4415799,678] 0 2024-09-13T18:30:45.285 INFO:tasks.workunit.client.0.smithi038.stdout:2/690: mkdir d2/d5c/d66/dda/df9 0 2024-09-13T18:30:45.285 INFO:tasks.workunit.client.0.smithi038.stdout:2/691: chown d2/d5c/d93/f9c 710 1 2024-09-13T18:30:45.287 INFO:tasks.workunit.client.0.smithi038.stdout:5/707: rename df/f1e to df/d13/d49/d70/fde 0 2024-09-13T18:30:45.295 INFO:tasks.workunit.client.0.smithi038.stdout:3/821: dwrite d0/dd/d17/d50/d5c/d23/d7c/f82 [0,4194304] 0 2024-09-13T18:30:45.295 INFO:tasks.workunit.client.0.smithi038.stdout:6/760: dwrite dd/de/d61/d62/fcc [0,4194304] 0 2024-09-13T18:30:45.296 INFO:tasks.workunit.client.0.smithi038.stdout:3/822: dread - d0/dd/d17/d50/d5c/d23/d93/fbc zero size 2024-09-13T18:30:45.296 INFO:tasks.workunit.client.0.smithi038.stdout:6/761: write dd/de/f2c [1279187,2633] 0 2024-09-13T18:30:45.300 INFO:tasks.workunit.client.0.smithi038.stdout:3/823: getdents d0/dd/d17 0 2024-09-13T18:30:45.300 INFO:tasks.workunit.client.0.smithi038.stdout:3/824: write d0/dd/d17/d50/d5c/d23/d93/fbc [476336,107569] 0 2024-09-13T18:30:45.302 INFO:tasks.workunit.client.0.smithi038.stdout:7/648: sync 2024-09-13T18:30:45.303 INFO:tasks.workunit.client.0.smithi038.stdout:9/672: sync 2024-09-13T18:30:45.303 INFO:tasks.workunit.client.0.smithi038.stdout:8/958: sync 2024-09-13T18:30:45.303 INFO:tasks.workunit.client.0.smithi038.stdout:0/729: sync 2024-09-13T18:30:45.303 INFO:tasks.workunit.client.0.smithi038.stdout:9/673: fsync d0/d7/d2c/d5e/f8a 0 2024-09-13T18:30:45.303 INFO:tasks.workunit.client.0.smithi038.stdout:8/959: chown d1/de/d21/d24/d4d/d50/d62 337832572 1 2024-09-13T18:30:45.303 INFO:tasks.workunit.client.0.smithi038.stdout:9/674: write d0/d7/d2c/faa [580890,124933] 0 2024-09-13T18:30:45.304 INFO:tasks.workunit.client.0.smithi038.stdout:7/649: unlink db/d12/d1c/d3a/d26/le4 0 2024-09-13T18:30:45.304 INFO:tasks.workunit.client.0.smithi038.stdout:7/650: read db/d21/f83 [3068353,24714] 0 2024-09-13T18:30:45.304 INFO:tasks.workunit.client.0.smithi038.stdout:7/651: stat db/l47 0 2024-09-13T18:30:45.304 INFO:tasks.workunit.client.0.smithi038.stdout:7/652: chown db/d12/d13/c64 167273044 1 2024-09-13T18:30:45.306 INFO:tasks.workunit.client.0.smithi038.stdout:8/960: rename d1/de/d21/d24/d4d/dee/d11a/d12b/c132 to d1/d4/c144 0 2024-09-13T18:30:45.308 INFO:tasks.workunit.client.0.smithi038.stdout:0/730: symlink d2/d7/d24/d2b/d6d/da7/lf2 0 2024-09-13T18:30:45.309 INFO:tasks.workunit.client.0.smithi038.stdout:9/675: unlink d0/d7/d13/d2d/d3e/d70/da2/da6/la9 0 2024-09-13T18:30:45.310 INFO:tasks.workunit.client.0.smithi038.stdout:8/961: creat d1/d4/d98/f145 x:0 0 0 2024-09-13T18:30:45.311 INFO:tasks.workunit.client.0.smithi038.stdout:0/731: creat d2/d7/d24/d2b/ff3 x:0 0 0 2024-09-13T18:30:45.312 INFO:tasks.workunit.client.0.smithi038.stdout:9/676: link d0/d7/d2c/d33/fca d0/d7/d13/d2d/ff2 0 2024-09-13T18:30:45.315 INFO:tasks.workunit.client.0.smithi038.stdout:0/732: mknod d2/d7/d24/d2b/dc1/db7/cf4 0 2024-09-13T18:30:45.316 INFO:tasks.workunit.client.0.smithi038.stdout:0/733: dread - d2/d7/d24/d2b/ff3 zero size 2024-09-13T18:30:45.316 INFO:tasks.workunit.client.0.smithi038.stdout:0/734: chown d2/c34 10963376 1 2024-09-13T18:30:45.316 INFO:tasks.workunit.client.0.smithi038.stdout:0/735: write d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f79 [1416260,29304] 0 2024-09-13T18:30:45.316 INFO:tasks.workunit.client.0.smithi038.stdout:9/677: stat d0/d7/d13/l14 0 2024-09-13T18:30:45.317 INFO:tasks.workunit.client.0.smithi038.stdout:6/762: dread dd/de/d2e/f4b [0,4194304] 0 2024-09-13T18:30:45.318 INFO:tasks.workunit.client.0.smithi038.stdout:6/763: chown dd/de/d2e/d2f/d4c/d55/f9d 9694718 1 2024-09-13T18:30:45.318 INFO:tasks.workunit.client.0.smithi038.stdout:6/764: chown dd/de/d2e/d30/ff2 157 1 2024-09-13T18:30:45.318 INFO:tasks.workunit.client.0.smithi038.stdout:8/962: getdents d1/d2a/d40/dbe/dc6 0 2024-09-13T18:30:45.318 INFO:tasks.workunit.client.0.smithi038.stdout:3/825: read d0/dd/d17/d50/d5c/f64 [3053156,65403] 0 2024-09-13T18:30:45.318 INFO:tasks.workunit.client.0.smithi038.stdout:2/692: dwrite d2/d1e/f9d [0,4194304] 0 2024-09-13T18:30:45.318 INFO:tasks.workunit.client.0.smithi038.stdout:5/708: dwrite df/d15/d36/d67/dbf/d44/d48/d75/f99 [0,4194304] 0 2024-09-13T18:30:45.319 INFO:tasks.workunit.client.0.smithi038.stdout:5/709: write df/d15/d36/f3c [1224374,116299] 0 2024-09-13T18:30:45.320 INFO:tasks.workunit.client.0.smithi038.stdout:0/736: creat d2/d7/d24/d92/d40/d87/dd6/d98/da0/ff5 x:0 0 0 2024-09-13T18:30:45.321 INFO:tasks.workunit.client.0.smithi038.stdout:9/678: creat d0/d7/d2c/d33/d4a/ff3 x:0 0 0 2024-09-13T18:30:45.321 INFO:tasks.workunit.client.0.smithi038.stdout:9/679: chown d0/d7/d13/d2d/d3e/d70/cd0 0 1 2024-09-13T18:30:45.323 INFO:tasks.workunit.client.0.smithi038.stdout:6/765: creat dd/de/d2e/d2f/d4c/d60/ddc/de4/f10e x:0 0 0 2024-09-13T18:30:45.323 INFO:tasks.workunit.client.0.smithi038.stdout:8/963: dread d1/d4/f3d [0,4194304] 0 2024-09-13T18:30:45.324 INFO:tasks.workunit.client.0.smithi038.stdout:8/964: creat d1/d2a/d3f/dbb/d105/f146 x:0 0 0 2024-09-13T18:30:45.324 INFO:tasks.workunit.client.0.smithi038.stdout:8/965: dread - d1/d2a/d40/f13e zero size 2024-09-13T18:30:45.328 INFO:tasks.workunit.client.0.smithi038.stdout:3/826: creat d0/dd/d17/d79/ffd x:0 0 0 2024-09-13T18:30:45.328 INFO:tasks.workunit.client.0.smithi038.stdout:3/827: write d0/dd/d17/d50/d5c/d23/d6b/f6d [149596,23404] 0 2024-09-13T18:30:45.330 INFO:tasks.workunit.client.0.smithi038.stdout:2/693: rename d2/d1e/d44/d50/d39/d45/lc6 to d2/d5c/d93/lfa 0 2024-09-13T18:30:45.333 INFO:tasks.workunit.client.0.smithi038.stdout:0/737: creat d2/d7/d24/ff6 x:0 0 0 2024-09-13T18:30:45.333 INFO:tasks.workunit.client.0.smithi038.stdout:9/680: creat d0/d2e/dc3/ff4 x:0 0 0 2024-09-13T18:30:45.336 INFO:tasks.workunit.client.0.smithi038.stdout:3/828: mknod d0/dd/d17/d79/dd5/cfe 0 2024-09-13T18:30:45.337 INFO:tasks.workunit.client.0.smithi038.stdout:2/694: creat d2/ffb x:0 0 0 2024-09-13T18:30:45.338 INFO:tasks.workunit.client.0.smithi038.stdout:0/738: truncate d2/d7/d24/d92/d66/dda/fdf 3060911 0 2024-09-13T18:30:45.338 INFO:tasks.workunit.client.0.smithi038.stdout:0/739: truncate d2/f1c 4994632 0 2024-09-13T18:30:45.338 INFO:tasks.workunit.client.0.smithi038.stdout:8/966: dread d1/ff [0,4194304] 0 2024-09-13T18:30:45.338 INFO:tasks.workunit.client.0.smithi038.stdout:2/695: creat d2/d1e/d44/d50/d46/db1/ffc x:0 0 0 2024-09-13T18:30:45.339 INFO:tasks.workunit.client.0.smithi038.stdout:0/740: creat d2/ff7 x:0 0 0 2024-09-13T18:30:45.340 INFO:tasks.workunit.client.0.smithi038.stdout:8/967: creat d1/de/d21/d24/d41/d80/dca/f147 x:0 0 0 2024-09-13T18:30:45.340 INFO:tasks.workunit.client.0.smithi038.stdout:8/968: chown d1/de/d21/d24/d41/d117 175882 1 2024-09-13T18:30:45.340 INFO:tasks.workunit.client.0.smithi038.stdout:8/969: truncate d1/d2a/d3f/dbb/d105/f146 160963 0 2024-09-13T18:30:45.341 INFO:tasks.workunit.client.0.smithi038.stdout:2/696: rename d2/d1e/d44/d50/d39/d52/d8b/c97 to d2/d5c/d93/cfd 0 2024-09-13T18:30:45.342 INFO:tasks.workunit.client.0.smithi038.stdout:0/741: getdents d2/d7/d24/d2b/dc1 0 2024-09-13T18:30:45.345 INFO:tasks.workunit.client.0.smithi038.stdout:2/697: unlink d2/d5c/d66/l92 0 2024-09-13T18:30:45.345 INFO:tasks.workunit.client.0.smithi038.stdout:2/698: chown d2/d5c/db3/fbd 982584239 1 2024-09-13T18:30:45.346 INFO:tasks.workunit.client.0.smithi038.stdout:2/699: mkdir d2/d2a/dfe 0 2024-09-13T18:30:45.346 INFO:tasks.workunit.client.0.smithi038.stdout:5/710: dwrite df/d15/d36/d67/dbf/f73 [4194304,4194304] 0 2024-09-13T18:30:45.347 INFO:tasks.workunit.client.0.smithi038.stdout:7/653: dwrite db/d12/d1c/d3a/d26/fb7 [0,4194304] 0 2024-09-13T18:30:45.347 INFO:tasks.workunit.client.0.smithi038.stdout:3/829: read d0/dd/d17/d50/d5c/d23/d6b/f78 [804765,103229] 0 2024-09-13T18:30:45.348 INFO:tasks.workunit.client.0.smithi038.stdout:6/766: dwrite dd/de/d2e/d2f/d4c/d60/ddc/de4/f10e [0,4194304] 0 2024-09-13T18:30:45.351 INFO:tasks.workunit.client.0.smithi038.stdout:9/681: dread d0/d7/d2c/faa [0,4194304] 0 2024-09-13T18:30:45.353 INFO:tasks.workunit.client.0.smithi038.stdout:5/711: creat df/d15/d36/d67/dbf/d44/d48/d56/fdf x:0 0 0 2024-09-13T18:30:45.353 INFO:tasks.workunit.client.0.smithi038.stdout:5/712: truncate df/d15/d36/d67/dbf/d44/d48/d54/f90 2186296 0 2024-09-13T18:30:45.353 INFO:tasks.workunit.client.0.smithi038.stdout:5/713: write df/f1b [1305581,25174] 0 2024-09-13T18:30:45.353 INFO:tasks.workunit.client.0.smithi038.stdout:0/742: dread d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fb3 [0,4194304] 0 2024-09-13T18:30:45.353 INFO:tasks.workunit.client.0.smithi038.stdout:0/743: creat d2/d7/d24/d2b/d95/ff8 x:0 0 0 2024-09-13T18:30:45.353 INFO:tasks.workunit.client.0.smithi038.stdout:0/744: chown d2/d7/d24/d92/d40/d87/fe5 0 1 2024-09-13T18:30:45.357 INFO:tasks.workunit.client.0.smithi038.stdout:7/654: mkdir db/d12/d1c/d3a/d3c/d52/dc6/def 0 2024-09-13T18:30:45.358 INFO:tasks.workunit.client.0.smithi038.stdout:2/700: read d2/d2a/f3d [853012,29389] 0 2024-09-13T18:30:45.360 INFO:tasks.workunit.client.0.smithi038.stdout:8/970: dwrite d1/de/d21/d45/d5d/d6d/fb8 [0,4194304] 0 2024-09-13T18:30:45.360 INFO:tasks.workunit.client.0.smithi038.stdout:6/767: dread dd/de/d2e/d2f/d4c/d60/ddc/de4/f10e [0,4194304] 0 2024-09-13T18:30:45.361 INFO:tasks.workunit.client.0.smithi038.stdout:9/682: getdents d0/d7/d2c/d5e/dc5 0 2024-09-13T18:30:45.364 INFO:tasks.workunit.client.0.smithi038.stdout:5/714: stat df/d15/l40 0 2024-09-13T18:30:45.371 INFO:tasks.workunit.client.0.smithi038.stdout:2/701: mkdir d2/d1e/d44/d50/de0/dff 0 2024-09-13T18:30:45.377 INFO:tasks.workunit.client.0.smithi038.stdout:7/655: rename db/d21/dce to db/d12/df0 0 2024-09-13T18:30:45.377 INFO:tasks.workunit.client.0.smithi038.stdout:6/768: dread dd/de/d2e/d99/fb7 [0,4194304] 0 2024-09-13T18:30:45.377 INFO:tasks.workunit.client.0.smithi038.stdout:6/769: write dd/de/d2e/d2f/da6/dd9/d101/d83/fde [1074142,40896] 0 2024-09-13T18:30:45.378 INFO:tasks.workunit.client.0.smithi038.stdout:2/702: creat d2/d2a/db0/dde/df1/f100 x:0 0 0 2024-09-13T18:30:45.381 INFO:tasks.workunit.client.0.smithi038.stdout:8/971: rename d1/de/d3a/c125 to d1/d2a/d40/dbe/dc4/c148 0 2024-09-13T18:30:45.381 INFO:tasks.workunit.client.0.smithi038.stdout:8/972: fsync d1/d2a/f121 0 2024-09-13T18:30:45.381 INFO:tasks.workunit.client.0.smithi038.stdout:8/973: chown d1/d2a/d40/dbe/dc6/cf5 5179 1 2024-09-13T18:30:45.382 INFO:tasks.workunit.client.0.smithi038.stdout:7/656: mkdir db/d12/df0/dd4/df1 0 2024-09-13T18:30:45.383 INFO:tasks.workunit.client.0.smithi038.stdout:6/770: symlink dd/de/d2e/d2f/da0/l10f 0 2024-09-13T18:30:45.384 INFO:tasks.workunit.client.0.smithi038.stdout:2/703: mknod d2/d1e/d44/d50/d46/da6/c101 0 2024-09-13T18:30:45.384 INFO:tasks.workunit.client.0.smithi038.stdout:5/715: write df/d15/d36/d67/dbf/f73 [7014501,55939] 0 2024-09-13T18:30:45.385 INFO:tasks.workunit.client.0.smithi038.stdout:8/974: symlink d1/de/d21/d24/d41/d80/l149 0 2024-09-13T18:30:45.385 INFO:tasks.workunit.client.0.smithi038.stdout:8/975: write d1/de/d15/f130 [1578867,6516] 0 2024-09-13T18:30:45.386 INFO:tasks.workunit.client.0.smithi038.stdout:7/657: link db/d12/d13/f54 db/d12/df0/dd4/d28/dd3/ff2 0 2024-09-13T18:30:45.386 INFO:tasks.workunit.client.0.smithi038.stdout:6/771: getdents dd/de/d61 0 2024-09-13T18:30:45.388 INFO:tasks.workunit.client.0.smithi038.stdout:8/976: getdents d1/de/d21/d24/d41/d8c/dda 0 2024-09-13T18:30:45.389 INFO:tasks.workunit.client.0.smithi038.stdout:7/658: creat db/d12/df0/dd4/d28/dd3/ff3 x:0 0 0 2024-09-13T18:30:45.391 INFO:tasks.workunit.client.0.smithi038.stdout:6/772: unlink dd/de/d2e/d2f/c3d 0 2024-09-13T18:30:45.391 INFO:tasks.workunit.client.0.smithi038.stdout:2/704: getdents d2/da/d98/dc9/dd6 0 2024-09-13T18:30:45.393 INFO:tasks.workunit.client.0.smithi038.stdout:8/977: truncate d1/de/d21/d24/d41/d7d/fe6 1703641 0 2024-09-13T18:30:45.393 INFO:tasks.workunit.client.0.smithi038.stdout:8/978: chown d1/de/d21/d24/d41/d7d/ldb 5021 1 2024-09-13T18:30:45.393 INFO:tasks.workunit.client.0.smithi038.stdout:8/979: readlink d1/de/d21/d45/l103 0 2024-09-13T18:30:45.395 INFO:tasks.workunit.client.0.smithi038.stdout:3/830: dwrite d0/dd/d17/d50/d5c/f64 [0,4194304] 0 2024-09-13T18:30:45.395 INFO:tasks.workunit.client.0.smithi038.stdout:8/980: creat d1/de/d21/d24/d41/d117/f14a x:0 0 0 2024-09-13T18:30:45.395 INFO:tasks.workunit.client.0.smithi038.stdout:8/981: truncate d1/de/d21/d24/d41/db7/f135 1497644 0 2024-09-13T18:30:45.395 INFO:tasks.workunit.client.0.smithi038.stdout:8/982: chown d1/de/d21/d24/d4d/d50/d62/c86 106477 1 2024-09-13T18:30:45.395 INFO:tasks.workunit.client.0.smithi038.stdout:0/745: dwrite d2/d7/ff1 [0,4194304] 0 2024-09-13T18:30:45.397 INFO:tasks.workunit.client.0.smithi038.stdout:6/773: write f9 [149482,31597] 0 2024-09-13T18:30:45.397 INFO:tasks.workunit.client.0.smithi038.stdout:6/774: truncate dd/f16 4790260 0 2024-09-13T18:30:45.397 INFO:tasks.workunit.client.0.smithi038.stdout:9/683: dwrite d0/d7/d2c/d6d/f75 [0,4194304] 0 2024-09-13T18:30:45.397 INFO:tasks.workunit.client.0.smithi038.stdout:3/831: write d0/dd/d17/d50/d5c/d23/d93/fc7 [4413239,29864] 0 2024-09-13T18:30:45.398 INFO:tasks.workunit.client.0.smithi038.stdout:2/705: dread d2/f26 [0,4194304] 0 2024-09-13T18:30:45.398 INFO:tasks.workunit.client.0.smithi038.stdout:2/706: chown d2/d1e/d44/d50/d46/f71 30390 1 2024-09-13T18:30:45.400 INFO:tasks.workunit.client.0.smithi038.stdout:0/746: rename d2/d7/d24/d92/d40/d87/dd6/d98/dc5/d3f/f5a to d2/d7/d24/d92/d40/ff9 0 2024-09-13T18:30:45.401 INFO:tasks.workunit.client.0.smithi038.stdout:8/983: symlink d1/d2a/d40/l14b 0 2024-09-13T18:30:45.401 INFO:tasks.workunit.client.0.smithi038.stdout:7/659: dread db/f10 [0,4194304] 0 2024-09-13T18:30:45.402 INFO:tasks.workunit.client.0.smithi038.stdout:7/660: fsync db/d12/d1c/d3a/d26/d41/fe9 0 2024-09-13T18:30:45.402 INFO:tasks.workunit.client.0.smithi038.stdout:6/775: link dd/f11 dd/de/d2e/d9b/dbf/f110 0 2024-09-13T18:30:45.403 INFO:tasks.workunit.client.0.smithi038.stdout:9/684: mknod d0/d7/d13/d2d/d3c/dc9/cf5 0 2024-09-13T18:30:45.404 INFO:tasks.workunit.client.0.smithi038.stdout:9/685: dread - d0/d7/d2c/d33/d4a/ff3 zero size 2024-09-13T18:30:45.404 INFO:tasks.workunit.client.0.smithi038.stdout:9/686: stat d0/d7/d13/d2d/d3e/d70 0 2024-09-13T18:30:45.407 INFO:tasks.workunit.client.0.smithi038.stdout:3/832: fsync d0/dd/d17/d50/d5c/d23/d93/fbc 0 2024-09-13T18:30:45.408 INFO:tasks.workunit.client.0.smithi038.stdout:0/747: mkdir d2/d7/d24/d92/d40/dfa 0 2024-09-13T18:30:45.408 INFO:tasks.workunit.client.0.smithi038.stdout:0/748: readlink d2/l19 0 2024-09-13T18:30:45.408 INFO:tasks.workunit.client.0.smithi038.stdout:3/833: truncate d0/dd/d17/d50/d5c/d1d/fd9 1237569 0 2024-09-13T18:30:45.408 INFO:tasks.workunit.client.0.smithi038.stdout:3/834: chown d0/dd/d17/d50/d5c/d23/d6b/f9b 95494472 1 2024-09-13T18:30:45.408 INFO:tasks.workunit.client.0.smithi038.stdout:0/749: chown d2/d7/d24/d92/d40/d87/dab/fb8 26420 1 2024-09-13T18:30:45.408 INFO:tasks.workunit.client.0.smithi038.stdout:3/835: fdatasync d0/dd/d17/d79/f87 0 2024-09-13T18:30:45.408 INFO:tasks.workunit.client.0.smithi038.stdout:3/836: truncate d0/dd/d17/d50/d5c/d23/d6b/f9b 1609370 0 2024-09-13T18:30:45.408 INFO:tasks.workunit.client.0.smithi038.stdout:5/716: dwrite df/d15/d36/d67/dbf/d44/d48/d56/f76 [0,4194304] 0 2024-09-13T18:30:45.409 INFO:tasks.workunit.client.0.smithi038.stdout:8/984: mknod d1/de/d21/d24/d4d/d50/d62/c14c 0 2024-09-13T18:30:45.409 INFO:tasks.workunit.client.0.smithi038.stdout:8/985: chown d1/de/d21/d24/d41/d7d/fe6 206488 1 2024-09-13T18:30:45.410 INFO:tasks.workunit.client.0.smithi038.stdout:8/986: chown d1/de/d15/d30/f3c 21126 1 2024-09-13T18:30:45.411 INFO:tasks.workunit.client.0.smithi038.stdout:7/661: link db/d12/df0/dd4/d28/dd3/ff3 db/d12/d13/ded/ff4 0 2024-09-13T18:30:45.413 INFO:tasks.workunit.client.0.smithi038.stdout:6/776: creat dd/de/d2e/d99/f111 x:0 0 0 2024-09-13T18:30:45.415 INFO:tasks.workunit.client.0.smithi038.stdout:0/750: link d2/d7/d55/f9c d2/d7/d24/d92/d40/d87/dd6/d98/ffb 0 2024-09-13T18:30:45.416 INFO:tasks.workunit.client.0.smithi038.stdout:0/751: creat d2/d7/d24/d92/d66/d81/ffc x:0 0 0 2024-09-13T18:30:45.416 INFO:tasks.workunit.client.0.smithi038.stdout:0/752: chown d2/d7/d24/d92/d40/d87/fe5 9 1 2024-09-13T18:30:45.417 INFO:tasks.workunit.client.0.smithi038.stdout:3/837: rmdir d0/dd/d17/d50/d5c/d1d/d30/d95 39 2024-09-13T18:30:45.417 INFO:tasks.workunit.client.0.smithi038.stdout:2/707: dread d2/d2a/f3d [4194304,4194304] 0 2024-09-13T18:30:45.423 INFO:tasks.workunit.client.0.smithi038.stdout:8/987: link d1/de/d21/d24/db0/f10b d1/de/d21/d24/d4d/dee/f14d 0 2024-09-13T18:30:45.429 INFO:tasks.workunit.client.0.smithi038.stdout:7/662: mknod db/d12/d1c/d3a/d26/cf5 0 2024-09-13T18:30:45.432 INFO:tasks.workunit.client.0.smithi038.stdout:3/838: getdents d0/dd/d17/d50/d5c/d23 0 2024-09-13T18:30:45.436 INFO:tasks.workunit.client.0.smithi038.stdout:8/988: getdents d1/de/d21/d24/d41/d80/d8f 0 2024-09-13T18:30:45.436 INFO:tasks.workunit.client.0.smithi038.stdout:8/989: write d1/de/d21/d45/d5d/d6d/fba [837907,17425] 0 2024-09-13T18:30:45.436 INFO:tasks.workunit.client.0.smithi038.stdout:8/990: stat d1/de/d21/d45/f81 0 2024-09-13T18:30:45.436 INFO:tasks.workunit.client.0.smithi038.stdout:8/991: write d1/de/d21/d24/d41/d80/dca/fed [5239201,76766] 0 2024-09-13T18:30:45.438 INFO:tasks.workunit.client.0.smithi038.stdout:3/839: symlink d0/dd/d17/d50/d5c/d23/d7c/d9c/lff 0 2024-09-13T18:30:45.438 INFO:tasks.workunit.client.0.smithi038.stdout:3/840: chown d0/dd/d17/d50/l83 47 1 2024-09-13T18:30:45.440 INFO:tasks.workunit.client.0.smithi038.stdout:7/663: write db/f11 [3748575,1537] 0 2024-09-13T18:30:45.442 INFO:tasks.workunit.client.0.smithi038.stdout:8/992: rename d1/de/d3a/ld7 to d1/de/d21/d24/d41/l14e 0 2024-09-13T18:30:45.443 INFO:tasks.workunit.client.0.smithi038.stdout:3/841: symlink d0/dd/d17/d43/d89/l100 0 2024-09-13T18:30:45.446 INFO:tasks.workunit.client.0.smithi038.stdout:8/993: symlink d1/de/d21/d24/d56/d89/l14f 0 2024-09-13T18:30:45.447 INFO:tasks.workunit.client.0.smithi038.stdout:8/994: symlink d1/d2a/d40/dbe/dc4/l150 0 2024-09-13T18:30:45.448 INFO:tasks.workunit.client.0.smithi038.stdout:5/717: dwrite df/d15/d36/d67/dbf/d44/d58/d9c/fb9 [0,4194304] 0 2024-09-13T18:30:45.448 INFO:tasks.workunit.client.0.smithi038.stdout:5/718: readlink df/l4e 0 2024-09-13T18:30:45.449 INFO:tasks.workunit.client.0.smithi038.stdout:6/777: dwrite dd/f32 [0,4194304] 0 2024-09-13T18:30:45.449 INFO:tasks.workunit.client.0.smithi038.stdout:8/995: mknod d1/de/d21/d24/d41/d80/d8f/c151 0 2024-09-13T18:30:45.453 INFO:tasks.workunit.client.0.smithi038.stdout:3/842: write d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/f7b [1202088,72668] 0 2024-09-13T18:30:45.458 INFO:tasks.workunit.client.0.smithi038.stdout:7/664: dread db/d8e/fa7 [0,4194304] 0 2024-09-13T18:30:45.459 INFO:tasks.workunit.client.0.smithi038.stdout:6/778: rename dd/de/l25 to dd/de/d61/d62/l112 0 2024-09-13T18:30:45.461 INFO:tasks.workunit.client.0.smithi038.stdout:3/843: creat d0/dd/d17/d50/d5c/d1d/f101 x:0 0 0 2024-09-13T18:30:45.461 INFO:tasks.workunit.client.0.smithi038.stdout:3/844: readlink d0/dd/d17/d79/lbe 0 2024-09-13T18:30:45.461 INFO:tasks.workunit.client.0.smithi038.stdout:3/845: write d0/dd/d17/d50/d5c/d23/d6b/f78 [3907810,11347] 0 2024-09-13T18:30:45.461 INFO:tasks.workunit.client.0.smithi038.stdout:8/996: write d1/de/d15/d30/f55 [191906,109269] 0 2024-09-13T18:30:45.463 INFO:tasks.workunit.client.0.smithi038.stdout:6/779: mknod dd/de/d2e/d2f/d71/dc5/c113 0 2024-09-13T18:30:45.466 INFO:tasks.workunit.client.0.smithi038.stdout:5/719: dwrite df/d15/d36/d67/f77 [0,4194304] 0 2024-09-13T18:30:45.470 INFO:tasks.workunit.client.0.smithi038.stdout:8/997: creat d1/de/d21/d24/d41/d80/d8f/f152 x:0 0 0 2024-09-13T18:30:45.471 INFO:tasks.workunit.client.0.smithi038.stdout:6/780: getdents dd/de/d2e/d2f/da0 0 2024-09-13T18:30:45.477 INFO:tasks.workunit.client.0.smithi038.stdout:5/720: creat df/d15/d36/d67/dbf/d44/d58/d9c/fe0 x:0 0 0 2024-09-13T18:30:45.477 INFO:tasks.workunit.client.0.smithi038.stdout:5/721: fsync df/f66 0 2024-09-13T18:30:45.479 INFO:tasks.workunit.client.0.smithi038.stdout:8/998: link d1/d2a/d5b/c126 d1/d2a/c153 0 2024-09-13T18:30:45.479 INFO:tasks.workunit.client.0.smithi038.stdout:8/999: readlink d1/de/d21/d24/d4d/dee/l123 0 2024-09-13T18:30:45.479 INFO:tasks.workunit.client.0.smithi038.stdout:6/781: getdents dd/de/d2e/d2f/d4c/d86/dac 0 2024-09-13T18:30:45.482 INFO:tasks.workunit.client.0.smithi038.stdout:0/753: write d2/d7/d24/d92/d40/d87/dd6/fa2 [2112408,78159] 0 2024-09-13T18:30:45.482 INFO:tasks.workunit.client.0.smithi038.stdout:0/754: creat d2/d7/d24/d2b/d95/ffd x:0 0 0 2024-09-13T18:30:45.482 INFO:tasks.workunit.client.0.smithi038.stdout:0/755: stat d2/d7/d24/d2b/d6d/lc2 0 2024-09-13T18:30:45.482 INFO:tasks.workunit.client.0.smithi038.stdout:0/756: write d2/d7/d24/d92/d40/d87/d8f/fde [11547,5878] 0 2024-09-13T18:30:45.482 INFO:tasks.workunit.client.0.smithi038.stdout:0/757: stat d2/d7/d24/d2b/l3b 0 2024-09-13T18:30:45.484 INFO:tasks.workunit.client.0.smithi038.stdout:3/846: dwrite d0/dd/d17/f1c [0,4194304] 0 2024-09-13T18:30:45.484 INFO:tasks.workunit.client.0.smithi038.stdout:3/847: stat d0/dd/d17/fc4 0 2024-09-13T18:30:45.485 INFO:tasks.workunit.client.0.smithi038.stdout:7/665: dwrite db/d12/d1c/d3a/d3c/d52/d51/f86 [4194304,4194304] 0 2024-09-13T18:30:45.485 INFO:tasks.workunit.client.0.smithi038.stdout:5/722: dread df/f66 [0,4194304] 0 2024-09-13T18:30:45.493 INFO:tasks.workunit.client.0.smithi038.stdout:5/723: stat df/l96 0 2024-09-13T18:30:45.494 INFO:tasks.workunit.client.0.smithi038.stdout:5/724: mkdir df/d68/de1 0 2024-09-13T18:30:45.494 INFO:tasks.workunit.client.0.smithi038.stdout:5/725: fsync df/d15/d36/d67/dbf/d41/fd1 0 2024-09-13T18:30:45.520 INFO:tasks.workunit.client.0.smithi038.stdout:7/666: dwrite db/d12/d1c/d3a/d3c/d52/dc6/fda [0,4194304] 0 2024-09-13T18:30:45.520 INFO:tasks.workunit.client.0.smithi038.stdout:3/848: dwrite d0/dd/d17/d50/d5c/d1d/fd9 [4194304,4194304] 0 2024-09-13T18:30:45.520 INFO:tasks.workunit.client.0.smithi038.stdout:3/849: fsync d0/dd/d17/d50/d5c/d23/d52/f8c 0 2024-09-13T18:30:45.520 INFO:tasks.workunit.client.0.smithi038.stdout:5/726: dwrite df/f10 [0,4194304] 0 2024-09-13T18:30:45.520 INFO:tasks.workunit.client.0.smithi038.stdout:5/727: getdents df/d15/d36/d67/dbf/d44/d52 0 2024-09-13T18:30:45.522 INFO:tasks.workunit.client.0.smithi038.stdout:7/667: truncate db/d12/d13/f54 815661 0 2024-09-13T18:30:45.523 INFO:tasks.workunit.client.0.smithi038.stdout:3/850: symlink d0/dd/d17/d79/l102 0 2024-09-13T18:30:45.525 INFO:tasks.workunit.client.0.smithi038.stdout:5/728: rename df/d15/d36/d67/dbf/d44/d48/c4b to df/d15/d36/d67/dbf/d44/d52/db6/ce2 0 2024-09-13T18:30:45.526 INFO:tasks.workunit.client.0.smithi038.stdout:7/668: rmdir db/d12/df0/dd4/d28/dd3 39 2024-09-13T18:30:45.528 INFO:tasks.workunit.client.0.smithi038.stdout:3/851: mkdir d0/dd/d17/d50/d5c/d23/d6b/d103 0 2024-09-13T18:30:45.528 INFO:tasks.workunit.client.0.smithi038.stdout:5/729: truncate df/d15/d36/f3c 1286021 0 2024-09-13T18:30:45.530 INFO:tasks.workunit.client.0.smithi038.stdout:7/669: truncate db/fc 445140 0 2024-09-13T18:30:45.532 INFO:tasks.workunit.client.0.smithi038.stdout:3/852: creat d0/dd/d17/d50/d5c/d1d/d30/d95/d84/f104 x:0 0 0 2024-09-13T18:30:45.532 INFO:tasks.workunit.client.0.smithi038.stdout:3/853: stat d0/dd/d17/d50/d5c/d1d/fd1 0 2024-09-13T18:30:45.533 INFO:tasks.workunit.client.0.smithi038.stdout:5/730: truncate df/d15/d36/f3a 7040915 0 2024-09-13T18:30:45.537 INFO:tasks.workunit.client.0.smithi038.stdout:5/731: symlink df/d15/d50/le3 0 2024-09-13T18:30:45.537 INFO:tasks.workunit.client.0.smithi038.stdout:5/732: chown df/d15/d36/d67/dbf/d44/d52 1204 1 2024-09-13T18:30:45.537 INFO:tasks.workunit.client.0.smithi038.stdout:5/733: write df/d15/d36/f6f [471796,99622] 0 2024-09-13T18:30:45.541 INFO:tasks.workunit.client.0.smithi038.stdout:5/734: creat df/d15/d36/d67/dbf/d44/d58/d94/fe4 x:0 0 0 2024-09-13T18:30:45.543 INFO:tasks.workunit.client.0.smithi038.stdout:3/854: write d0/dd/d17/d43/d89/f5f [2902647,86736] 0 2024-09-13T18:30:45.545 INFO:tasks.workunit.client.0.smithi038.stdout:5/735: link df/d13/c61 df/d13/d49/ce5 0 2024-09-13T18:30:45.545 INFO:tasks.workunit.client.0.smithi038.stdout:5/736: stat df/d15/d36/d67/dbf/d44/d58/ca1 0 2024-09-13T18:30:45.545 INFO:tasks.workunit.client.0.smithi038.stdout:5/737: write f3 [252289,33734] 0 2024-09-13T18:30:45.545 INFO:tasks.workunit.client.0.smithi038.stdout:5/738: truncate df/d15/d36/d67/dbf/d3e/fd9 75995 0 2024-09-13T18:30:45.545 INFO:tasks.workunit.client.0.smithi038.stdout:5/739: fdatasync df/f66 0 2024-09-13T18:30:45.547 INFO:tasks.workunit.client.0.smithi038.stdout:3/855: mkdir d0/dd/d17/d79/dd5/d105 0 2024-09-13T18:30:45.548 INFO:tasks.workunit.client.0.smithi038.stdout:7/670: dwrite db/d12/d1c/d3a/d3c/d52/d9b/fdc [0,4194304] 0 2024-09-13T18:30:45.549 INFO:tasks.workunit.client.0.smithi038.stdout:5/740: truncate df/d15/f7e 222615 0 2024-09-13T18:30:45.549 INFO:tasks.workunit.client.0.smithi038.stdout:5/741: write df/d15/d36/d67/dbf/d41/fd1 [212978,120975] 0 2024-09-13T18:30:45.549 INFO:tasks.workunit.client.0.smithi038.stdout:5/742: dread - df/d15/d36/d67/dbf/d44/d58/d94/fe4 zero size 2024-09-13T18:30:45.551 INFO:tasks.workunit.client.0.smithi038.stdout:3/856: rename d0/dd/d17/d50/d5c/d1d/d30/l3e to d0/dd/d17/d79/dd5/d105/l106 0 2024-09-13T18:30:45.557 INFO:tasks.workunit.client.0.smithi038.stdout:5/743: unlink df/d15/d36/d67/dbf/d44/d48/d56/f76 0 2024-09-13T18:30:45.560 INFO:tasks.workunit.client.0.smithi038.stdout:3/857: rename d0/dd/d17/d50/cb1 to d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/c107 0 2024-09-13T18:30:45.560 INFO:tasks.workunit.client.0.smithi038.stdout:3/858: fdatasync d0/dd/d17/d50/d5c/d23/d7c/f82 0 2024-09-13T18:30:45.561 INFO:tasks.workunit.client.0.smithi038.stdout:7/671: mknod db/cf6 0 2024-09-13T18:30:45.564 INFO:tasks.workunit.client.0.smithi038.stdout:7/672: rename db/fd6 to db/d21/ff7 0 2024-09-13T18:30:45.570 INFO:tasks.workunit.client.0.smithi038.stdout:7/673: rename db/d12/d1c/d3a/d26/d41/c84 to db/d12/df0/cf8 0 2024-09-13T18:30:45.571 INFO:tasks.workunit.client.0.smithi038.stdout:7/674: dread db/d12/d1c/d3a/d3c/d52/f6c [0,4194304] 0 2024-09-13T18:30:45.573 INFO:tasks.workunit.client.0.smithi038.stdout:7/675: creat db/d12/d1c/ff9 x:0 0 0 2024-09-13T18:30:45.577 INFO:tasks.workunit.client.0.smithi038.stdout:3/859: dwrite d0/dd/d17/d50/d5c/ff0 [0,4194304] 0 2024-09-13T18:30:45.579 INFO:tasks.workunit.client.0.smithi038.stdout:7/676: creat db/d12/d1c/d3a/d26/d41/dad/ffa x:0 0 0 2024-09-13T18:30:45.592 INFO:tasks.workunit.client.0.smithi038.stdout:5/744: write df/d15/d36/d67/dbf/d44/f51 [772996,108111] 0 2024-09-13T18:30:45.594 INFO:tasks.workunit.client.0.smithi038.stdout:5/745: rename df/l96 to df/d15/d36/d67/dbf/le6 0 2024-09-13T18:30:45.595 INFO:tasks.workunit.client.0.smithi038.stdout:5/746: symlink df/d15/d36/d67/dbf/d44/d48/d75/le7 0 2024-09-13T18:30:45.596 INFO:tasks.workunit.client.0.smithi038.stdout:5/747: rmdir df/d15/d36/d67/dbf/d44/d52 39 2024-09-13T18:30:45.598 INFO:tasks.workunit.client.0.smithi038.stdout:3/860: dwrite d0/dd/d17/d50/d5c/d23/fc1 [0,4194304] 0 2024-09-13T18:30:45.598 INFO:tasks.workunit.client.0.smithi038.stdout:3/861: chown d0/dd/d17/d50/d5c/f55 3442 1 2024-09-13T18:30:45.598 INFO:tasks.workunit.client.0.smithi038.stdout:7/677: dwrite db/d12/df0/dd4/d28/f6e [0,4194304] 0 2024-09-13T18:30:45.601 INFO:tasks.workunit.client.0.smithi038.stdout:5/748: dread df/d15/f7e [0,4194304] 0 2024-09-13T18:30:45.601 INFO:tasks.workunit.client.0.smithi038.stdout:3/862: creat d0/dd/d17/d43/dc6/f108 x:0 0 0 2024-09-13T18:30:45.603 INFO:tasks.workunit.client.0.smithi038.stdout:3/863: link d0/dd/d17/d50/d5c/d1d/l39 d0/dd/d17/d50/d5c/d1d/dcb/l109 0 2024-09-13T18:30:45.613 INFO:tasks.workunit.client.0.smithi038.stdout:3/864: symlink d0/dd/d17/d50/d5c/d23/d6b/d103/l10a 0 2024-09-13T18:30:45.615 INFO:tasks.workunit.client.0.smithi038.stdout:5/749: dwrite df/d13/d49/d70/fde [8388608,4194304] 0 2024-09-13T18:30:45.616 INFO:tasks.workunit.client.0.smithi038.stdout:3/865: getdents d0/dd/d17/d50/d5c/d1d 0 2024-09-13T18:30:45.619 INFO:tasks.workunit.client.0.smithi038.stdout:3/866: creat d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/f10b x:0 0 0 2024-09-13T18:30:45.622 INFO:tasks.workunit.client.0.smithi038.stdout:3/867: symlink d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/l10c 0 2024-09-13T18:30:45.623 INFO:tasks.workunit.client.0.smithi038.stdout:5/750: write df/d13/dc7/fd3 [2163051,66006] 0 2024-09-13T18:30:45.624 INFO:tasks.workunit.client.0.smithi038.stdout:3/868: unlink d0/dd/d17/d50/d5c/d23/l72 0 2024-09-13T18:30:45.630 INFO:tasks.workunit.client.0.smithi038.stdout:5/751: write df/d15/d36/d67/dbf/d44/d48/d75/f99 [3390523,84084] 0 2024-09-13T18:30:45.630 INFO:tasks.workunit.client.0.smithi038.stdout:5/752: chown df/d68/fb7 194 1 2024-09-13T18:30:45.630 INFO:tasks.workunit.client.0.smithi038.stdout:5/753: fsync f3 0 2024-09-13T18:30:45.630 INFO:tasks.workunit.client.0.smithi038.stdout:5/754: dread - df/d13/d49/fd4 zero size 2024-09-13T18:30:45.637 INFO:tasks.workunit.client.0.smithi038.stdout:5/755: dread df/f66 [0,4194304] 0 2024-09-13T18:30:45.644 INFO:tasks.workunit.client.0.smithi038.stdout:5/756: read df/d15/d36/d67/f77 [813215,126310] 0 2024-09-13T18:30:45.645 INFO:tasks.workunit.client.0.smithi038.stdout:5/757: symlink df/d68/de1/le8 0 2024-09-13T18:30:45.645 INFO:tasks.workunit.client.0.smithi038.stdout:5/758: fsync df/d13/d49/d70/fa2 0 2024-09-13T18:30:45.647 INFO:tasks.workunit.client.0.smithi038.stdout:5/759: rename df/d15/d36/d67/f81 to df/d15/d36/d67/dbf/d44/d52/db6/fe9 0 2024-09-13T18:30:45.668 INFO:tasks.workunit.client.0.smithi038.stdout:5/760: dwrite df/d15/f22 [0,4194304] 0 2024-09-13T18:30:45.683 INFO:tasks.workunit.client.0.smithi038.stdout:5/761: dwrite fb [0,4194304] 0 2024-09-13T18:30:45.685 INFO:tasks.workunit.client.0.smithi038.stdout:5/762: link df/d15/d36/d67/dbf/d44/d48/d9d/fa0 df/d15/d36/d67/dbf/d44/d48/d56/fea 0 2024-09-13T18:30:45.708 INFO:tasks.workunit.client.0.smithi038.stdout:5/763: dwrite df/d13/f4f [4194304,4194304] 0 2024-09-13T18:30:45.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:45 smithi038 ceph-mon[27689]: pgmap v25: 65 pgs: 65 active+clean; 2.9 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 145 MiB/s rd, 172 MiB/s wr, 311 op/s 2024-09-13T18:30:46.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:45 smithi149 ceph-mon[35845]: pgmap v25: 65 pgs: 65 active+clean; 2.9 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 145 MiB/s rd, 172 MiB/s wr, 311 op/s 2024-09-13T18:30:46.324 INFO:tasks.workunit.client.0.smithi038.stdout:9/687: sync 2024-09-13T18:30:46.330 INFO:tasks.workunit.client.0.smithi038.stdout:9/688: rmdir d0/d7/d2c/d33/d4a 39 2024-09-13T18:30:46.332 INFO:tasks.workunit.client.0.smithi038.stdout:9/689: creat d0/d7/d13/d2d/d3c/d50/d94/ff6 x:0 0 0 2024-09-13T18:30:46.334 INFO:tasks.workunit.client.0.smithi038.stdout:9/690: mkdir d0/d7/d13/d2d/d3e/df7 0 2024-09-13T18:30:46.335 INFO:tasks.workunit.client.0.smithi038.stdout:9/691: mkdir d0/d7/d2c/d33/df8 0 2024-09-13T18:30:46.355 INFO:tasks.workunit.client.0.smithi038.stdout:9/692: dwrite d0/d7/d2c/d33/f4c [0,4194304] 0 2024-09-13T18:30:46.358 INFO:tasks.workunit.client.0.smithi038.stdout:9/693: mknod d0/d7/d2c/cf9 0 2024-09-13T18:30:46.358 INFO:tasks.workunit.client.0.smithi038.stdout:9/694: fsync d0/d7/d13/d30/f6f 0 2024-09-13T18:30:46.359 INFO:tasks.workunit.client.0.smithi038.stdout:9/695: mkdir d0/d7/d13/d2d/d3c/dfa 0 2024-09-13T18:30:46.361 INFO:tasks.workunit.client.0.smithi038.stdout:9/696: link d0/d7/d13/d2d/d3c/f73 d0/d7/d2c/d33/ffb 0 2024-09-13T18:30:46.361 INFO:tasks.workunit.client.0.smithi038.stdout:9/697: write d0/d7/d13/d2d/d3e/fea [671878,10150] 0 2024-09-13T18:30:46.381 INFO:tasks.workunit.client.0.smithi038.stdout:9/698: dwrite d0/d7/d13/d2d/d3c/d50/fce [0,4194304] 0 2024-09-13T18:30:46.382 INFO:tasks.workunit.client.0.smithi038.stdout:9/699: mknod d0/d7/d13/d2d/d3e/d70/da2/d86/db6/cfc 0 2024-09-13T18:30:46.384 INFO:tasks.workunit.client.0.smithi038.stdout:9/700: symlink d0/d2e/d7f/dd3/lfd 0 2024-09-13T18:30:46.403 INFO:tasks.workunit.client.0.smithi038.stdout:9/701: dwrite d0/d7/d13/f66 [0,4194304] 0 2024-09-13T18:30:46.405 INFO:tasks.workunit.client.0.smithi038.stdout:9/702: creat d0/d7/d13/d2d/d3c/ffe x:0 0 0 2024-09-13T18:30:46.423 INFO:tasks.workunit.client.0.smithi038.stdout:9/703: dwrite d0/d7/d2c/d6d/f75 [0,4194304] 0 2024-09-13T18:30:46.433 INFO:tasks.workunit.client.0.smithi038.stdout:9/704: link d0/d7/d13/f1e d0/d7/d13/d2d/d3c/d50/fff 0 2024-09-13T18:30:46.433 INFO:tasks.workunit.client.0.smithi038.stdout:9/705: dread - d0/d7/fb5 zero size 2024-09-13T18:30:46.451 INFO:tasks.workunit.client.0.smithi038.stdout:9/706: dwrite d0/d7/d13/d2d/d3e/d70/fed [0,4194304] 0 2024-09-13T18:30:46.460 INFO:tasks.workunit.client.0.smithi038.stdout:9/707: fsync d0/d7/d13/d2d/d3c/ffe 0 2024-09-13T18:30:46.468 INFO:tasks.workunit.client.0.smithi038.stdout:9/708: dread d0/d7/d2c/d5a/dd8/fe0 [0,4194304] 0 2024-09-13T18:30:46.468 INFO:tasks.workunit.client.0.smithi038.stdout:9/709: dread - d0/d7/d2c/d5a/d67/f87 zero size 2024-09-13T18:30:46.468 INFO:tasks.workunit.client.0.smithi038.stdout:9/710: fdatasync d0/d7/d13/d2d/d3e/f6e 0 2024-09-13T18:30:46.468 INFO:tasks.workunit.client.0.smithi038.stdout:9/711: write d0/d7/d2c/d6d/fd1 [1101494,466] 0 2024-09-13T18:30:46.470 INFO:tasks.workunit.client.0.smithi038.stdout:9/712: unlink d0/d7/d13/fba 0 2024-09-13T18:30:46.470 INFO:tasks.workunit.client.0.smithi038.stdout:9/713: getdents d0/d7/d13/d2d/d3c/d50/da5 0 2024-09-13T18:30:46.484 INFO:tasks.workunit.client.0.smithi038.stdout:6/782: sync 2024-09-13T18:30:46.484 INFO:tasks.workunit.client.0.smithi038.stdout:0/758: sync 2024-09-13T18:30:46.484 INFO:tasks.workunit.client.0.smithi038.stdout:0/759: creat d2/d7/d24/d2b/ffe x:0 0 0 2024-09-13T18:30:46.484 INFO:tasks.workunit.client.0.smithi038.stdout:3/869: sync 2024-09-13T18:30:46.485 INFO:tasks.workunit.client.0.smithi038.stdout:5/764: sync 2024-09-13T18:30:46.485 INFO:tasks.workunit.client.0.smithi038.stdout:7/678: sync 2024-09-13T18:30:46.485 INFO:tasks.workunit.client.0.smithi038.stdout:2/708: sync 2024-09-13T18:30:46.485 INFO:tasks.workunit.client.0.smithi038.stdout:6/783: getdents dd/de/d2e/d30/d27 0 2024-09-13T18:30:46.485 INFO:tasks.workunit.client.0.smithi038.stdout:6/784: read dd/de/d2e/d2f/ff5 [485079,100620] 0 2024-09-13T18:30:46.492 INFO:tasks.workunit.client.0.smithi038.stdout:0/760: symlink d2/d7/d24/d92/d40/d87/dd6/d98/dc5/d3f/lff 0 2024-09-13T18:30:46.496 INFO:tasks.workunit.client.0.smithi038.stdout:3/870: rename d0/dd/d17/d50/d5c/d1d/d30/d95/l98 to d0/dd/d17/d50/d5c/d23/l10d 0 2024-09-13T18:30:46.496 INFO:tasks.workunit.client.0.smithi038.stdout:3/871: chown d0/dd/d17/d50/d5c/d23/d52/d6e/d9d 490391 1 2024-09-13T18:30:46.496 INFO:tasks.workunit.client.0.smithi038.stdout:6/785: truncate dd/de/d2e/d2f/d71/fa4 48140 0 2024-09-13T18:30:46.496 INFO:tasks.workunit.client.0.smithi038.stdout:6/786: read dd/de/d2e/d2f/d4c/d55/f9d [627614,72869] 0 2024-09-13T18:30:46.497 INFO:tasks.workunit.client.0.smithi038.stdout:7/679: read db/d12/d1c/d3a/d3c/d52/dc6/fda [1492112,13871] 0 2024-09-13T18:30:46.497 INFO:tasks.workunit.client.0.smithi038.stdout:9/714: dwrite d0/d2e/d7f/f8e [0,4194304] 0 2024-09-13T18:30:46.498 INFO:tasks.workunit.client.0.smithi038.stdout:6/787: rename dd/de/d2e/d2f/c69 to dd/de/d2e/d2f/da6/dd9/c114 0 2024-09-13T18:30:46.499 INFO:tasks.workunit.client.0.smithi038.stdout:6/788: fsync dd/de/f4f 0 2024-09-13T18:30:46.501 INFO:tasks.workunit.client.0.smithi038.stdout:9/715: mkdir d0/d7/d2c/d5e/d100 0 2024-09-13T18:30:46.502 INFO:tasks.workunit.client.0.smithi038.stdout:7/680: symlink db/d12/d1c/d3a/d26/lfb 0 2024-09-13T18:30:46.503 INFO:tasks.workunit.client.0.smithi038.stdout:7/681: getdents db/d12/df0/dd4/df1 0 2024-09-13T18:30:46.505 INFO:tasks.workunit.client.0.smithi038.stdout:7/682: mknod db/d12/d1c/cfc 0 2024-09-13T18:30:46.507 INFO:tasks.workunit.client.0.smithi038.stdout:7/683: link db/d12/d1c/d3a/d3c/d52/d9b/fd2 db/d12/d13/ffd 0 2024-09-13T18:30:46.508 INFO:tasks.workunit.client.0.smithi038.stdout:0/761: dread d2/d7/d24/f84 [0,4194304] 0 2024-09-13T18:30:46.515 INFO:tasks.workunit.client.0.smithi038.stdout:3/872: write d0/dd/d17/f70 [2109992,125620] 0 2024-09-13T18:30:46.518 INFO:tasks.workunit.client.0.smithi038.stdout:6/789: dread dd/de/d31/f3e [0,4194304] 0 2024-09-13T18:30:46.524 INFO:tasks.workunit.client.0.smithi038.stdout:9/716: dread d0/d7/d2c/d5a/f64 [0,4194304] 0 2024-09-13T18:30:46.527 INFO:tasks.workunit.client.0.smithi038.stdout:2/709: dwrite d2/d1e/d44/fe4 [0,4194304] 0 2024-09-13T18:30:46.530 INFO:tasks.workunit.client.0.smithi038.stdout:3/873: dread d0/dd/d17/d50/d5c/d1d/d30/d95/f4d [0,4194304] 0 2024-09-13T18:30:46.530 INFO:tasks.workunit.client.0.smithi038.stdout:3/874: fsync d0/dd/d17/d50/d5c/d23/d93/ff3 0 2024-09-13T18:30:46.530 INFO:tasks.workunit.client.0.smithi038.stdout:3/875: write d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/fb7 [861374,38304] 0 2024-09-13T18:30:46.530 INFO:tasks.workunit.client.0.smithi038.stdout:9/717: creat d0/d7/d13/f101 x:0 0 0 2024-09-13T18:30:46.530 INFO:tasks.workunit.client.0.smithi038.stdout:9/718: truncate d0/d7/d13/f5d 2555429 0 2024-09-13T18:30:46.534 INFO:tasks.workunit.client.0.smithi038.stdout:2/710: unlink d2/d1e/d44/d50/d39/ff8 0 2024-09-13T18:30:46.534 INFO:tasks.workunit.client.0.smithi038.stdout:2/711: stat d2/d1e/d44/d50 0 2024-09-13T18:30:46.534 INFO:tasks.workunit.client.0.smithi038.stdout:2/712: truncate d2/d1e/d44/d50/d39/d40/ddb/fe2 792102 0 2024-09-13T18:30:46.534 INFO:tasks.workunit.client.0.smithi038.stdout:5/765: dwrite df/d15/d36/d67/dbf/f4a [0,4194304] 0 2024-09-13T18:30:46.535 INFO:tasks.workunit.client.0.smithi038.stdout:3/876: symlink d0/dd/d17/d50/d5c/l10e 0 2024-09-13T18:30:46.535 INFO:tasks.workunit.client.0.smithi038.stdout:3/877: fdatasync d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/f7b 0 2024-09-13T18:30:46.536 INFO:tasks.workunit.client.0.smithi038.stdout:9/719: getdents d0/d7/d13/d2d/d3c/d50 0 2024-09-13T18:30:46.538 INFO:tasks.workunit.client.0.smithi038.stdout:2/713: link d2/d1e/ccc d2/da/d74/c102 0 2024-09-13T18:30:46.538 INFO:tasks.workunit.client.0.smithi038.stdout:2/714: write d2/da/f1d [4214713,76120] 0 2024-09-13T18:30:46.538 INFO:tasks.workunit.client.0.smithi038.stdout:2/715: creat d2/d1e/d44/d50/d46/d58/f103 x:0 0 0 2024-09-13T18:30:46.538 INFO:tasks.workunit.client.0.smithi038.stdout:2/716: chown d2/d1e/d44/d50/de0/cf7 802566 1 2024-09-13T18:30:46.538 INFO:tasks.workunit.client.0.smithi038.stdout:2/717: fdatasync d2/d5c/d93/d62/fa9 0 2024-09-13T18:30:46.538 INFO:tasks.workunit.client.0.smithi038.stdout:2/718: fsync d2/d1e/d44/d50/d46/f5f 0 2024-09-13T18:30:46.539 INFO:tasks.workunit.client.0.smithi038.stdout:5/766: symlink df/d68/de1/leb 0 2024-09-13T18:30:46.540 INFO:tasks.workunit.client.0.smithi038.stdout:9/720: creat d0/dac/f102 x:0 0 0 2024-09-13T18:30:46.543 INFO:tasks.workunit.client.0.smithi038.stdout:3/878: dread d0/dd/d17/d79/dd5/fb0 [4194304,4194304] 0 2024-09-13T18:30:46.544 INFO:tasks.workunit.client.0.smithi038.stdout:6/790: dwrite dd/de/d2e/d99/f80 [0,4194304] 0 2024-09-13T18:30:46.546 INFO:tasks.workunit.client.0.smithi038.stdout:2/719: mknod d2/d1e/d44/d50/d39/d40/ddb/c104 0 2024-09-13T18:30:46.548 INFO:tasks.workunit.client.0.smithi038.stdout:5/767: creat df/d15/d36/d67/dbf/d44/d58/dd6/fec x:0 0 0 2024-09-13T18:30:46.549 INFO:tasks.workunit.client.0.smithi038.stdout:0/762: dwrite d2/d7/d24/d2b/dc1/db7/fc9 [0,4194304] 0 2024-09-13T18:30:46.549 INFO:tasks.workunit.client.0.smithi038.stdout:0/763: chown d2/d7/d24/d92/d40/d87/dd6/d98/dc5 504477 1 2024-09-13T18:30:46.550 INFO:tasks.workunit.client.0.smithi038.stdout:3/879: creat d0/dd/d17/d50/d5c/d23/d52/f10f x:0 0 0 2024-09-13T18:30:46.560 INFO:tasks.workunit.client.0.smithi038.stdout:5/768: link df/d15/c2e df/d15/d36/d67/dbf/d44/d48/ced 0 2024-09-13T18:30:46.562 INFO:tasks.workunit.client.0.smithi038.stdout:3/880: mkdir d0/dd/d17/d50/d5c/d110 0 2024-09-13T18:30:46.562 INFO:tasks.workunit.client.0.smithi038.stdout:3/881: fsync d0/dd/d17/d50/d5c/d23/d52/d6e/f9f 0 2024-09-13T18:30:46.563 INFO:tasks.workunit.client.0.smithi038.stdout:5/769: symlink df/d15/d36/d67/dbf/d44/d58/lee 0 2024-09-13T18:30:46.564 INFO:tasks.workunit.client.0.smithi038.stdout:3/882: mkdir d0/dd/d17/d50/d5c/d1d/d30/d95/da6/d111 0 2024-09-13T18:30:46.565 INFO:tasks.workunit.client.0.smithi038.stdout:5/770: creat df/d15/d36/d67/dbf/d44/d82/fef x:0 0 0 2024-09-13T18:30:46.566 INFO:tasks.workunit.client.0.smithi038.stdout:5/771: creat df/d15/d36/d67/dbf/d44/d58/dd6/ff0 x:0 0 0 2024-09-13T18:30:46.567 INFO:tasks.workunit.client.0.smithi038.stdout:5/772: mkdir df/d15/d36/d67/dbf/d44/d58/d94/df1 0 2024-09-13T18:30:46.568 INFO:tasks.workunit.client.0.smithi038.stdout:5/773: mkdir df/d15/d36/d67/dbf/d44/d58/d9c/df2 0 2024-09-13T18:30:46.570 INFO:tasks.workunit.client.0.smithi038.stdout:5/774: rename df/d15/d36/d67/l98 to df/d13/d49/lf3 0 2024-09-13T18:30:46.571 INFO:tasks.workunit.client.0.smithi038.stdout:5/775: unlink df/d15/d36/d67/dbf/d41/c5e 0 2024-09-13T18:30:46.572 INFO:tasks.workunit.client.0.smithi038.stdout:5/776: rmdir df/d13/d49 39 2024-09-13T18:30:46.572 INFO:tasks.workunit.client.0.smithi038.stdout:5/777: readlink df/d15/d36/d67/lb2 0 2024-09-13T18:30:46.573 INFO:tasks.workunit.client.0.smithi038.stdout:5/778: mkdir df/d13/d49/d70/df4 0 2024-09-13T18:30:46.573 INFO:tasks.workunit.client.0.smithi038.stdout:0/764: read d2/d7/d24/d2b/dc1/db7/fc9 [3108848,57612] 0 2024-09-13T18:30:46.574 INFO:tasks.workunit.client.0.smithi038.stdout:0/765: write d2/d7/d24/d92/fcc [3331693,11376] 0 2024-09-13T18:30:46.574 INFO:tasks.workunit.client.0.smithi038.stdout:0/766: write d2/d7/d24/d2b/dc1/fe7 [901436,113575] 0 2024-09-13T18:30:46.574 INFO:tasks.workunit.client.0.smithi038.stdout:5/779: symlink df/d13/lf5 0 2024-09-13T18:30:46.575 INFO:tasks.workunit.client.0.smithi038.stdout:0/767: mknod d2/d7/d24/d92/d40/d87/dab/c100 0 2024-09-13T18:30:46.575 INFO:tasks.workunit.client.0.smithi038.stdout:5/780: getdents df/d15/d36/d67/dbf/d44/d48/d9d 0 2024-09-13T18:30:46.586 INFO:tasks.workunit.client.0.smithi038.stdout:6/791: dwrite dd/daa/fc8 [0,4194304] 0 2024-09-13T18:30:46.587 INFO:tasks.workunit.client.0.smithi038.stdout:6/792: mknod dd/de/d2e/d2f/d71/c115 0 2024-09-13T18:30:46.608 INFO:tasks.workunit.client.0.smithi038.stdout:6/793: dwrite dd/de/d2e/d30/f100 [0,4194304] 0 2024-09-13T18:30:46.608 INFO:tasks.workunit.client.0.smithi038.stdout:6/794: chown dd/de/d31/ld1 40552 1 2024-09-13T18:30:46.609 INFO:tasks.workunit.client.0.smithi038.stdout:6/795: write dd/de/d2e/d2f/d4c/d86/f10c [510877,45713] 0 2024-09-13T18:30:46.628 INFO:tasks.workunit.client.0.smithi038.stdout:6/796: dwrite dd/de/d2e/d2f/f94 [0,4194304] 0 2024-09-13T18:30:46.628 INFO:tasks.workunit.client.0.smithi038.stdout:6/797: read - dd/df6/ff7 zero size 2024-09-13T18:30:46.648 INFO:tasks.workunit.client.0.smithi038.stdout:6/798: dwrite dd/de/d2e/d2f/ff0 [0,4194304] 0 2024-09-13T18:30:46.648 INFO:tasks.workunit.client.0.smithi038.stdout:6/799: fsync dd/de/d2e/d2f/da6/dd9/fe7 0 2024-09-13T18:30:46.649 INFO:tasks.workunit.client.0.smithi038.stdout:6/800: symlink dd/de/d2e/d104/l116 0 2024-09-13T18:30:46.650 INFO:tasks.workunit.client.0.smithi038.stdout:6/801: truncate dd/de/d2e/fc3 460667 0 2024-09-13T18:30:46.652 INFO:tasks.workunit.client.0.smithi038.stdout:6/802: rename dd/de/d2e/d9b/dbf/le2 to dd/l117 0 2024-09-13T18:30:46.720 INFO:tasks.workunit.client.0.smithi038.stdout:2/720: dwrite d2/d5c/dbb/fe1 [0,4194304] 0 2024-09-13T18:30:46.721 INFO:tasks.workunit.client.0.smithi038.stdout:7/684: dwrite db/d12/d1c/d3a/d3c/d52/d51/fa2 [0,4194304] 0 2024-09-13T18:30:46.724 INFO:tasks.workunit.client.0.smithi038.stdout:2/721: rename d2/da/d98 to d2/d1e/d44/d50/d39/d40/ddb/d105 0 2024-09-13T18:30:46.728 INFO:tasks.workunit.client.0.smithi038.stdout:3/883: dwrite d0/dd/d17/d50/d5c/ff0 [0,4194304] 0 2024-09-13T18:30:46.728 INFO:tasks.workunit.client.0.smithi038.stdout:5/781: dwrite df/d15/d36/f6f [0,4194304] 0 2024-09-13T18:30:46.738 INFO:tasks.workunit.client.0.smithi038.stdout:3/884: symlink d0/dd/d17/d43/l112 0 2024-09-13T18:30:46.741 INFO:tasks.workunit.client.0.smithi038.stdout:7/685: link db/d12/d1c/d3a/d3c/d52/d51/lcc db/d12/d1c/d3a/lfe 0 2024-09-13T18:30:46.745 INFO:tasks.workunit.client.0.smithi038.stdout:3/885: link d0/dd/d17/d50/d5c/f47 d0/dd/d17/d50/d5c/d1d/d30/d95/da6/d111/f113 0 2024-09-13T18:30:46.747 INFO:tasks.workunit.client.0.smithi038.stdout:7/686: creat db/d12/df0/fff x:0 0 0 2024-09-13T18:30:46.747 INFO:tasks.workunit.client.0.smithi038.stdout:7/687: write db/d12/d1c/fc8 [433645,108302] 0 2024-09-13T18:30:46.748 INFO:tasks.workunit.client.0.smithi038.stdout:7/688: readlink db/d12/df0/dd4/lcf 0 2024-09-13T18:30:46.748 INFO:tasks.workunit.client.0.smithi038.stdout:7/689: dread - db/d12/fe1 zero size 2024-09-13T18:30:46.748 INFO:tasks.workunit.client.0.smithi038.stdout:7/690: truncate db/d12/df0/fff 269948 0 2024-09-13T18:30:46.749 INFO:tasks.workunit.client.0.smithi038.stdout:3/886: dread d0/dd/d17/d50/d5c/d23/d52/d6e/f9f [0,4194304] 0 2024-09-13T18:30:46.749 INFO:tasks.workunit.client.0.smithi038.stdout:3/887: creat d0/dd/d17/d43/dc6/f114 x:0 0 0 2024-09-13T18:30:46.752 INFO:tasks.workunit.client.0.smithi038.stdout:7/691: rename db/d12/df0/dd4/d28/dd3/ff2 to db/d12/d1c/d3a/d26/d41/dad/f100 0 2024-09-13T18:30:46.752 INFO:tasks.workunit.client.0.smithi038.stdout:7/692: dread - db/d12/d1c/d3a/f7f zero size 2024-09-13T18:30:46.757 INFO:tasks.workunit.client.0.smithi038.stdout:7/693: mknod db/d12/d1c/d3a/d26/d41/dad/c101 0 2024-09-13T18:30:46.761 INFO:tasks.workunit.client.0.smithi038.stdout:3/888: write d0/dd/d17/f81 [1999761,70312] 0 2024-09-13T18:30:46.761 INFO:tasks.workunit.client.0.smithi038.stdout:3/889: write d0/dd/d17/d50/d5c/d1d/d30/fcd [1226214,126580] 0 2024-09-13T18:30:46.763 INFO:tasks.workunit.client.0.smithi038.stdout:3/890: creat d0/dd/d17/d50/d5c/d1d/dcb/f115 x:0 0 0 2024-09-13T18:30:46.765 INFO:tasks.workunit.client.0.smithi038.stdout:3/891: unlink d0/dd/d17/d50/d5c/d1d/d30/d95/f8e 0 2024-09-13T18:30:46.768 INFO:tasks.workunit.client.0.smithi038.stdout:3/892: creat d0/dd/d17/d50/d5c/d23/d6b/d103/f116 x:0 0 0 2024-09-13T18:30:46.771 INFO:tasks.workunit.client.0.smithi038.stdout:3/893: creat d0/dd/d17/d43/f117 x:0 0 0 2024-09-13T18:30:46.774 INFO:tasks.workunit.client.0.smithi038.stdout:3/894: mknod d0/dd/d17/d50/d5c/c118 0 2024-09-13T18:30:46.776 INFO:tasks.workunit.client.0.smithi038.stdout:2/722: rmdir d2/d1e/d44/d50/d39/d40/ddb/d105 39 2024-09-13T18:30:46.779 INFO:tasks.workunit.client.0.smithi038.stdout:0/768: dwrite d2/d7/d24/d92/d40/d9a/fbd [0,4194304] 0 2024-09-13T18:30:46.786 INFO:tasks.workunit.client.0.smithi038.stdout:0/769: creat d2/d7/d24/d92/d40/dfa/f101 x:0 0 0 2024-09-13T18:30:46.786 INFO:tasks.workunit.client.0.smithi038.stdout:0/770: fdatasync d2/d7/d24/d92/d66/d49/f65 0 2024-09-13T18:30:46.789 INFO:tasks.workunit.client.0.smithi038.stdout:3/895: write d0/dd/d17/d50/d5c/f64 [266122,4337] 0 2024-09-13T18:30:46.789 INFO:tasks.workunit.client.0.smithi038.stdout:3/896: truncate d0/dd/d17/d79/ffd 707291 0 2024-09-13T18:30:46.790 INFO:tasks.workunit.client.0.smithi038.stdout:7/694: dwrite db/d12/d1c/d3a/d26/f93 [0,4194304] 0 2024-09-13T18:30:46.792 INFO:tasks.workunit.client.0.smithi038.stdout:3/897: symlink d0/dd/d17/d50/l119 0 2024-09-13T18:30:46.792 INFO:tasks.workunit.client.0.smithi038.stdout:3/898: write d0/dd/d17/d50/d5c/fbf [224030,113405] 0 2024-09-13T18:30:46.794 INFO:tasks.workunit.client.0.smithi038.stdout:7/695: mknod db/d12/d1c/d3a/d3c/d52/d9b/c102 0 2024-09-13T18:30:46.795 INFO:tasks.workunit.client.0.smithi038.stdout:7/696: chown db/d12/d1c/d3a/d3c/d8f/ld1 497118 1 2024-09-13T18:30:46.797 INFO:tasks.workunit.client.0.smithi038.stdout:6/803: dread dd/de/d31/f74 [0,4194304] 0 2024-09-13T18:30:46.798 INFO:tasks.workunit.client.0.smithi038.stdout:3/899: rename d0/dd/d17/ce4 to d0/dd/d17/d50/d5c/d23/d6b/d103/c11a 0 2024-09-13T18:30:46.798 INFO:tasks.workunit.client.0.smithi038.stdout:3/900: chown d0/dd/d17/f81 1006964 1 2024-09-13T18:30:46.799 INFO:tasks.workunit.client.0.smithi038.stdout:3/901: write d0/dd/d17/d50/d5c/d23/d93/fbc [634589,50927] 0 2024-09-13T18:30:46.801 INFO:tasks.workunit.client.0.smithi038.stdout:6/804: creat dd/de/f118 x:0 0 0 2024-09-13T18:30:46.804 INFO:tasks.workunit.client.0.smithi038.stdout:3/902: symlink d0/dd/d17/d50/d5c/d23/d93/df7/l11b 0 2024-09-13T18:30:46.804 INFO:tasks.workunit.client.0.smithi038.stdout:0/771: dread d2/f1c [0,4194304] 0 2024-09-13T18:30:46.806 INFO:tasks.workunit.client.0.smithi038.stdout:7/697: dread db/d12/d13/ffd [0,4194304] 0 2024-09-13T18:30:46.806 INFO:tasks.workunit.client.0.smithi038.stdout:2/723: dwrite d2/d1e/f95 [0,4194304] 0 2024-09-13T18:30:46.807 INFO:tasks.workunit.client.0.smithi038.stdout:5/782: dwrite df/d15/d36/f6f [4194304,4194304] 0 2024-09-13T18:30:46.811 INFO:tasks.workunit.client.0.smithi038.stdout:3/903: mkdir d0/dd/d17/d11c 0 2024-09-13T18:30:46.811 INFO:tasks.workunit.client.0.smithi038.stdout:0/772: creat d2/d7/f102 x:0 0 0 2024-09-13T18:30:46.811 INFO:tasks.workunit.client.0.smithi038.stdout:0/773: fsync d2/d7/d55/f68 0 2024-09-13T18:30:46.811 INFO:tasks.workunit.client.0.smithi038.stdout:0/774: stat d2/d7/f4a 0 2024-09-13T18:30:46.811 INFO:tasks.workunit.client.0.smithi038.stdout:0/775: chown d2/d7/d24/d92/d66/d81 1230957 1 2024-09-13T18:30:46.811 INFO:tasks.workunit.client.0.smithi038.stdout:0/776: read - d2/ff7 zero size 2024-09-13T18:30:46.819 INFO:tasks.workunit.client.0.smithi038.stdout:2/724: creat d2/d5c/d66/dda/df9/f106 x:0 0 0 2024-09-13T18:30:46.820 INFO:tasks.workunit.client.0.smithi038.stdout:3/904: dread d0/dd/d17/d50/d5c/d23/d93/fc7 [0,4194304] 0 2024-09-13T18:30:46.820 INFO:tasks.workunit.client.0.smithi038.stdout:3/905: stat d0/dd/d17/d50/d5c/d1d/dcb/f115 0 2024-09-13T18:30:46.823 INFO:tasks.workunit.client.0.smithi038.stdout:3/906: dread d0/dd/d17/d50/d5c/d1d/d30/d95/d84/f90 [0,4194304] 0 2024-09-13T18:30:46.823 INFO:tasks.workunit.client.0.smithi038.stdout:3/907: chown d0/dd/d17/d50/d5c/d23/d6b/f6d 1139 1 2024-09-13T18:30:46.823 INFO:tasks.workunit.client.0.smithi038.stdout:3/908: chown d0/dd/d17/d50/d5c/d1d/fd9 416721352 1 2024-09-13T18:30:46.825 INFO:tasks.workunit.client.0.smithi038.stdout:5/783: symlink df/d68/de1/lf6 0 2024-09-13T18:30:46.826 INFO:tasks.workunit.client.0.smithi038.stdout:0/777: rmdir d2/d7/d24/d2b/db6 39 2024-09-13T18:30:46.826 INFO:tasks.workunit.client.0.smithi038.stdout:0/778: truncate d2/d7/f9 4277407 0 2024-09-13T18:30:46.827 INFO:tasks.workunit.client.0.smithi038.stdout:6/805: dwrite dd/de/d61/fd2 [0,4194304] 0 2024-09-13T18:30:46.827 INFO:tasks.workunit.client.0.smithi038.stdout:7/698: dwrite db/d12/d1c/d3a/d26/fa5 [0,4194304] 0 2024-09-13T18:30:46.829 INFO:tasks.workunit.client.0.smithi038.stdout:2/725: mkdir d2/d1e/d44/d50/d39/d45/d107 0 2024-09-13T18:30:46.829 INFO:tasks.workunit.client.0.smithi038.stdout:6/806: dread dd/de/f4f [0,4194304] 0 2024-09-13T18:30:46.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:46 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:30:46.831 INFO:tasks.workunit.client.0.smithi038.stdout:3/909: link d0/dd/d17/c4a d0/dd/d17/d50/c11d 0 2024-09-13T18:30:46.831 INFO:tasks.workunit.client.0.smithi038.stdout:3/910: readlink d0/dd/d17/d50/d5c/d1d/d30/d95/da6/lda 0 2024-09-13T18:30:46.831 INFO:tasks.workunit.client.0.smithi038.stdout:3/911: readlink d0/dd/d17/d79/dd5/d105/l106 0 2024-09-13T18:30:46.835 INFO:tasks.workunit.client.0.smithi038.stdout:7/699: rmdir db/d12/d13/d43 39 2024-09-13T18:30:46.839 INFO:tasks.workunit.client.0.smithi038.stdout:5/784: dread df/f10 [0,4194304] 0 2024-09-13T18:30:46.840 INFO:tasks.workunit.client.0.smithi038.stdout:0/779: write d2/d7/d24/d92/d66/f85 [3288675,70100] 0 2024-09-13T18:30:46.863 INFO:tasks.workunit.client.0.smithi038.stdout:7/700: dread db/d21/fe2 [0,4194304] 0 2024-09-13T18:30:46.863 INFO:tasks.workunit.client.0.smithi038.stdout:7/701: dread - db/d12/d1c/d3a/f7f zero size 2024-09-13T18:30:46.864 INFO:tasks.workunit.client.0.smithi038.stdout:6/807: creat dd/de/d2e/d104/f119 x:0 0 0 2024-09-13T18:30:46.864 INFO:tasks.workunit.client.0.smithi038.stdout:3/912: mknod d0/dd/d17/d50/d5c/d1d/dcb/c11e 0 2024-09-13T18:30:46.866 INFO:tasks.workunit.client.0.smithi038.stdout:5/785: mkdir df/d15/d36/d67/dbf/d44/df7 0 2024-09-13T18:30:46.866 INFO:tasks.workunit.client.0.smithi038.stdout:5/786: truncate df/d15/d36/d67/dbf/d44/fb5 108030 0 2024-09-13T18:30:46.866 INFO:tasks.workunit.client.0.smithi038.stdout:5/787: fdatasync df/d15/d36/d67/dbf/d3e/fc6 0 2024-09-13T18:30:46.866 INFO:tasks.workunit.client.0.smithi038.stdout:0/780: unlink d2/d7/d24/d2b/l38 0 2024-09-13T18:30:46.869 INFO:tasks.workunit.client.0.smithi038.stdout:6/808: mknod dd/de/d2e/d2f/da6/c11a 0 2024-09-13T18:30:46.869 INFO:tasks.workunit.client.0.smithi038.stdout:6/809: write dd/f13 [462519,77276] 0 2024-09-13T18:30:46.871 INFO:tasks.workunit.client.0.smithi038.stdout:5/788: unlink df/d15/l45 0 2024-09-13T18:30:46.874 INFO:tasks.workunit.client.0.smithi038.stdout:0/781: creat d2/d7/d24/d92/d40/d87/dd6/f103 x:0 0 0 2024-09-13T18:30:46.874 INFO:tasks.workunit.client.0.smithi038.stdout:0/782: write d2/ff7 [452691,125009] 0 2024-09-13T18:30:46.878 INFO:tasks.workunit.client.0.smithi038.stdout:3/913: read d0/dd/d17/f60 [481238,30045] 0 2024-09-13T18:30:46.884 INFO:tasks.workunit.client.0.smithi038.stdout:3/914: dread d0/dd/d17/d43/d89/f58 [0,4194304] 0 2024-09-13T18:30:46.884 INFO:tasks.workunit.client.0.smithi038.stdout:3/915: write d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/f7b [1028430,33079] 0 2024-09-13T18:30:46.885 INFO:tasks.workunit.client.0.smithi038.stdout:7/702: dwrite db/d12/d1c/d3a/d26/fea [0,4194304] 0 2024-09-13T18:30:46.888 INFO:tasks.workunit.client.0.smithi038.stdout:2/726: write d2/d1e/d44/d50/d39/d40/ddb/d105/f99 [1181102,10258] 0 2024-09-13T18:30:46.888 INFO:tasks.workunit.client.0.smithi038.stdout:2/727: write d2/d5c/d93/d62/f70 [4638324,5698] 0 2024-09-13T18:30:46.888 INFO:tasks.workunit.client.0.smithi038.stdout:2/728: write d2/d5c/d93/f9c [728828,85618] 0 2024-09-13T18:30:46.893 INFO:tasks.workunit.client.0.smithi038.stdout:0/783: symlink d2/d7/d24/d92/d66/dda/l104 0 2024-09-13T18:30:46.893 INFO:tasks.workunit.client.0.smithi038.stdout:0/784: dread - d2/d7/d24/d2b/ff3 zero size 2024-09-13T18:30:46.893 INFO:tasks.workunit.client.0.smithi038.stdout:0/785: stat d2/c9f 0 2024-09-13T18:30:46.902 INFO:tasks.workunit.client.0.smithi038.stdout:5/789: dwrite df/d15/d36/d67/dbf/d44/d48/d56/f5b [0,4194304] 0 2024-09-13T18:30:46.902 INFO:tasks.workunit.client.0.smithi038.stdout:5/790: chown df/d15/d36/d67/dbf/d44/d48/d56/l8d 10337 1 2024-09-13T18:30:46.903 INFO:tasks.workunit.client.0.smithi038.stdout:3/916: dwrite d0/dd/d17/d43/d89/f58 [0,4194304] 0 2024-09-13T18:30:46.920 INFO:tasks.workunit.client.0.smithi038.stdout:7/703: creat db/d21/f103 x:0 0 0 2024-09-13T18:30:46.920 INFO:tasks.workunit.client.0.smithi038.stdout:7/704: dread - db/d12/d1c/d3a/d26/d41/fe3 zero size 2024-09-13T18:30:46.920 INFO:tasks.workunit.client.0.smithi038.stdout:7/705: stat db/d12/d1c/d3a/d26/fa5 0 2024-09-13T18:30:46.921 INFO:tasks.workunit.client.0.smithi038.stdout:2/729: symlink d2/d1e/d44/d50/d46/l108 0 2024-09-13T18:30:46.921 INFO:tasks.workunit.client.0.smithi038.stdout:2/730: fdatasync d2/d1e/d44/d50/d46/d58/fe7 0 2024-09-13T18:30:46.921 INFO:tasks.workunit.client.0.smithi038.stdout:2/731: creat d2/d1e/d87/da4/f109 x:0 0 0 2024-09-13T18:30:46.921 INFO:tasks.workunit.client.0.smithi038.stdout:2/732: fdatasync d2/d1e/d44/d50/d39/f7d 0 2024-09-13T18:30:46.923 INFO:tasks.workunit.client.0.smithi038.stdout:0/786: rename d2/d7/d24/d92/d66/d49/fea to d2/d7/d24/d92/d66/d81/f105 0 2024-09-13T18:30:46.924 INFO:tasks.workunit.client.0.smithi038.stdout:5/791: mknod df/d15/d36/d67/dbf/d44/d48/d56/cf8 0 2024-09-13T18:30:46.925 INFO:tasks.workunit.client.0.smithi038.stdout:5/792: fdatasync df/d15/d36/d67/dbf/d44/d58/d9c/fb9 0 2024-09-13T18:30:46.927 INFO:tasks.workunit.client.0.smithi038.stdout:7/706: mkdir db/d12/df0/dd4/df1/d104 0 2024-09-13T18:30:46.927 INFO:tasks.workunit.client.0.smithi038.stdout:3/917: dwrite d0/dd/d17/d50/d5c/d23/d6b/f78 [4194304,4194304] 0 2024-09-13T18:30:46.933 INFO:tasks.workunit.client.0.smithi038.stdout:0/787: creat d2/d7/d24/dc7/f106 x:0 0 0 2024-09-13T18:30:46.933 INFO:tasks.workunit.client.0.smithi038.stdout:0/788: chown d2/d7/d55/f9c 3 1 2024-09-13T18:30:46.939 INFO:tasks.workunit.client.0.smithi038.stdout:7/707: unlink db/d21/cab 0 2024-09-13T18:30:46.941 INFO:tasks.workunit.client.0.smithi038.stdout:3/918: creat d0/dd/d17/d50/d5c/d1d/d30/d95/da6/d111/f11f x:0 0 0 2024-09-13T18:30:46.942 INFO:tasks.workunit.client.0.smithi038.stdout:0/789: write d2/d7/d55/f73 [895105,20151] 0 2024-09-13T18:30:46.949 INFO:tasks.workunit.client.0.smithi038.stdout:7/708: getdents db/d12/d13 0 2024-09-13T18:30:46.953 INFO:tasks.workunit.client.0.smithi038.stdout:3/919: mkdir d0/dd/d17/d50/d5c/d110/d120 0 2024-09-13T18:30:46.953 INFO:tasks.workunit.client.0.smithi038.stdout:0/790: write d2/d7/d24/d2b/f43 [1705801,113340] 0 2024-09-13T18:30:46.953 INFO:tasks.workunit.client.0.smithi038.stdout:5/793: getdents df/d15/d36/d67/dbf/d44/d48/d56 0 2024-09-13T18:30:46.955 INFO:tasks.workunit.client.0.smithi038.stdout:0/791: fsync d2/d7/d55/f73 0 2024-09-13T18:30:46.962 INFO:tasks.workunit.client.0.smithi038.stdout:7/709: mkdir db/d12/d1c/d3a/d105 0 2024-09-13T18:30:46.962 INFO:tasks.workunit.client.0.smithi038.stdout:7/710: truncate db/d12/d1c/d3a/d3c/d52/f6c 1743593 0 2024-09-13T18:30:46.962 INFO:tasks.workunit.client.0.smithi038.stdout:3/920: write d0/dd/d17/d50/d5c/d23/d7c/f82 [1437521,38541] 0 2024-09-13T18:30:46.964 INFO:tasks.workunit.client.0.smithi038.stdout:7/711: mkdir db/d12/d1c/d3a/d26/d41/dad/d106 0 2024-09-13T18:30:46.964 INFO:tasks.workunit.client.0.smithi038.stdout:7/712: readlink db/l95 0 2024-09-13T18:30:46.968 INFO:tasks.workunit.client.0.smithi038.stdout:7/713: creat db/d12/d1c/d3a/d3c/d52/d51/f107 x:0 0 0 2024-09-13T18:30:46.968 INFO:tasks.workunit.client.0.smithi038.stdout:7/714: chown db/d12/l27 18401 1 2024-09-13T18:30:46.990 INFO:tasks.workunit.client.0.smithi038.stdout:5/794: dwrite df/f66 [4194304,4194304] 0 2024-09-13T18:30:46.992 INFO:tasks.workunit.client.0.smithi038.stdout:0/792: dwrite d2/d7/d55/f68 [0,4194304] 0 2024-09-13T18:30:46.992 INFO:tasks.workunit.client.0.smithi038.stdout:7/715: dwrite db/d12/df0/dd4/d28/dd3/fde [0,4194304] 0 2024-09-13T18:30:46.992 INFO:tasks.workunit.client.0.smithi038.stdout:7/716: truncate db/d12/f68 1150073 0 2024-09-13T18:30:46.992 INFO:tasks.workunit.client.0.smithi038.stdout:3/921: dwrite d0/dd/d17/d50/d5c/fdd [0,4194304] 0 2024-09-13T18:30:46.993 INFO:tasks.workunit.client.0.smithi038.stdout:5/795: creat df/d15/d36/d67/dbf/d44/d58/d94/df1/ff9 x:0 0 0 2024-09-13T18:30:46.997 INFO:tasks.workunit.client.0.smithi038.stdout:7/717: mknod db/d12/df0/dd4/df1/c108 0 2024-09-13T18:30:47.001 INFO:tasks.workunit.client.0.smithi038.stdout:0/793: read d2/d7/d55/fbc [924868,53657] 0 2024-09-13T18:30:47.002 INFO:tasks.workunit.client.0.smithi038.stdout:5/796: mkdir df/d15/d36/d67/dbf/d44/df7/dfa 0 2024-09-13T18:30:47.003 INFO:tasks.workunit.client.0.smithi038.stdout:7/718: creat db/d12/d1c/d3a/d3c/d52/f109 x:0 0 0 2024-09-13T18:30:47.004 INFO:tasks.workunit.client.0.smithi038.stdout:5/797: symlink df/d15/d36/d67/dbf/d44/lfb 0 2024-09-13T18:30:47.007 INFO:tasks.workunit.client.0.smithi038.stdout:5/798: dread df/d15/d36/f3c [0,4194304] 0 2024-09-13T18:30:47.007 INFO:tasks.workunit.client.0.smithi038.stdout:5/799: stat df/d15/c6c 0 2024-09-13T18:30:47.015 INFO:tasks.workunit.client.0.smithi038.stdout:5/800: read fb [2621957,112997] 0 2024-09-13T18:30:47.016 INFO:tasks.workunit.client.0.smithi038.stdout:3/922: write d0/dd/d17/d50/d5c/d23/d52/fdb [492282,57745] 0 2024-09-13T18:30:47.018 INFO:tasks.workunit.client.0.smithi038.stdout:5/801: unlink df/d15/d36/d67/f77 0 2024-09-13T18:30:47.018 INFO:tasks.workunit.client.0.smithi038.stdout:5/802: chown df/d13/d49 7 1 2024-09-13T18:30:47.018 INFO:tasks.workunit.client.0.smithi038.stdout:5/803: write df/d15/d36/d67/dbf/f73 [8898655,88992] 0 2024-09-13T18:30:47.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:46 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:30:47.019 INFO:tasks.workunit.client.0.smithi038.stdout:3/923: creat d0/dd/d17/d50/d5c/f121 x:0 0 0 2024-09-13T18:30:47.019 INFO:tasks.workunit.client.0.smithi038.stdout:3/924: stat d0/dd/d17/d50/d5c/d1d/d30/d95 0 2024-09-13T18:30:47.020 INFO:tasks.workunit.client.0.smithi038.stdout:5/804: symlink df/d15/d36/d67/dbf/d44/d48/d9d/dce/lfc 0 2024-09-13T18:30:47.022 INFO:tasks.workunit.client.0.smithi038.stdout:0/794: dwrite d2/d7/d24/d92/d66/dda/fe9 [0,4194304] 0 2024-09-13T18:30:47.022 INFO:tasks.workunit.client.0.smithi038.stdout:0/795: chown d2/dc/le 91 1 2024-09-13T18:30:47.025 INFO:tasks.workunit.client.0.smithi038.stdout:0/796: symlink d2/d7/d24/d92/d66/d49/dc0/l107 0 2024-09-13T18:30:47.033 INFO:tasks.workunit.client.0.smithi038.stdout:0/797: dread d2/d7/d24/d92/d66/d49/f65 [0,4194304] 0 2024-09-13T18:30:47.038 INFO:tasks.workunit.client.0.smithi038.stdout:0/798: creat d2/dc/f108 x:0 0 0 2024-09-13T18:30:47.040 INFO:tasks.workunit.client.0.smithi038.stdout:0/799: mkdir d2/d7/d24/d92/d66/dda/d109 0 2024-09-13T18:30:47.040 INFO:tasks.workunit.client.0.smithi038.stdout:0/800: fsync d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f4d 0 2024-09-13T18:30:47.040 INFO:tasks.workunit.client.0.smithi038.stdout:0/801: chown d2/d7/d24/d92/d66/dda/fe9 26789494 1 2024-09-13T18:30:47.040 INFO:tasks.workunit.client.0.smithi038.stdout:0/802: write d2/d7/d24/d92/d66/d81/f83 [542627,49962] 0 2024-09-13T18:30:47.041 INFO:tasks.workunit.client.0.smithi038.stdout:0/803: mkdir d2/d7/d24/d92/d40/d87/dd6/d98/da0/df0/d10a 0 2024-09-13T18:30:47.042 INFO:tasks.workunit.client.0.smithi038.stdout:5/805: dwrite df/d15/d36/d67/dbf/d44/d58/f92 [0,4194304] 0 2024-09-13T18:30:47.043 INFO:tasks.workunit.client.0.smithi038.stdout:0/804: rename d2/d7/d24/d92/d40/d87/dd6/d98/dc5/d3f/lff to d2/d7/d24/d2b/db6/l10b 0 2024-09-13T18:30:47.046 INFO:tasks.workunit.client.0.smithi038.stdout:5/806: rmdir df/d15/d36/d67/dbf/d3e 39 2024-09-13T18:30:47.046 INFO:tasks.workunit.client.0.smithi038.stdout:5/807: readlink df/d15/d36/d67/dbf/d44/l60 0 2024-09-13T18:30:47.046 INFO:tasks.workunit.client.0.smithi038.stdout:0/805: symlink d2/d7/d24/dc7/l10c 0 2024-09-13T18:30:47.048 INFO:tasks.workunit.client.0.smithi038.stdout:0/806: dread d2/d7/d24/d92/d40/d87/d8f/fde [0,4194304] 0 2024-09-13T18:30:47.048 INFO:tasks.workunit.client.0.smithi038.stdout:5/808: creat df/d15/d36/d67/dbf/d44/d48/d56/ffd x:0 0 0 2024-09-13T18:30:47.050 INFO:tasks.workunit.client.0.smithi038.stdout:5/809: symlink df/d68/lfe 0 2024-09-13T18:30:47.059 INFO:tasks.workunit.client.0.smithi038.stdout:5/810: read df/d15/d36/d67/dbf/f4a [4073645,24527] 0 2024-09-13T18:30:47.059 INFO:tasks.workunit.client.0.smithi038.stdout:5/811: truncate df/d15/d36/d67/dbf/d44/d58/d94/df1/ff9 427663 0 2024-09-13T18:30:47.061 INFO:tasks.workunit.client.0.smithi038.stdout:5/812: link df/d15/d36/d67/dbf/d44/d58/d9c/fc1 df/d15/d36/d67/dbf/fff 0 2024-09-13T18:30:47.061 INFO:tasks.workunit.client.0.smithi038.stdout:5/813: fsync df/d15/d36/d67/dbf/f4a 0 2024-09-13T18:30:47.066 INFO:tasks.workunit.client.0.smithi038.stdout:5/814: dread df/d15/d36/d67/dbf/f4a [0,4194304] 0 2024-09-13T18:30:47.066 INFO:tasks.workunit.client.0.smithi038.stdout:5/815: truncate df/d15/d36/d67/dbf/d44/f51 3755465 0 2024-09-13T18:30:47.068 INFO:tasks.workunit.client.0.smithi038.stdout:5/816: dread df/f1b [0,4194304] 0 2024-09-13T18:30:47.069 INFO:tasks.workunit.client.0.smithi038.stdout:5/817: write df/d13/d49/d70/fa2 [1711317,86249] 0 2024-09-13T18:30:47.069 INFO:tasks.workunit.client.0.smithi038.stdout:5/818: fdatasync df/d15/d36/d67/dbf/f73 0 2024-09-13T18:30:47.070 INFO:tasks.workunit.client.0.smithi038.stdout:5/819: mknod df/d15/d36/d67/dbf/d44/df7/c100 0 2024-09-13T18:30:47.071 INFO:tasks.workunit.client.0.smithi038.stdout:5/820: dread df/d15/d36/d67/dbf/d44/fb5 [0,4194304] 0 2024-09-13T18:30:47.072 INFO:tasks.workunit.client.0.smithi038.stdout:5/821: getdents df/d13/d85 0 2024-09-13T18:30:47.082 INFO:tasks.workunit.client.0.smithi038.stdout:5/822: dread df/d15/d36/d67/dbf/d44/d58/fad [0,4194304] 0 2024-09-13T18:30:47.083 INFO:tasks.workunit.client.0.smithi038.stdout:5/823: link df/d15/d36/d67/dbf/d44/d48/d75/da7/fb1 df/d15/d36/d67/dbf/d44/f101 0 2024-09-13T18:30:47.083 INFO:tasks.workunit.client.0.smithi038.stdout:5/824: creat df/d15/d36/d67/dbf/d44/d58/d9c/f102 x:0 0 0 2024-09-13T18:30:47.088 INFO:tasks.workunit.client.0.smithi038.stdout:5/825: fsync df/d13/dc7/fd3 0 2024-09-13T18:30:47.284 INFO:tasks.workunit.client.0.smithi038.stdout:9/721: sync 2024-09-13T18:30:47.286 INFO:tasks.workunit.client.0.smithi038.stdout:9/722: getdents d0/d7/d2c/dbf 0 2024-09-13T18:30:47.287 INFO:tasks.workunit.client.0.smithi038.stdout:9/723: mknod d0/d7/d13/d2d/d3c/d50/d94/c103 0 2024-09-13T18:30:47.288 INFO:tasks.workunit.client.0.smithi038.stdout:9/724: write d0/d7/d2c/dbf/fd4 [204885,46572] 0 2024-09-13T18:30:47.288 INFO:tasks.workunit.client.0.smithi038.stdout:9/725: chown d0/d7/d13/f5d 27 1 2024-09-13T18:30:47.288 INFO:tasks.workunit.client.0.smithi038.stdout:9/726: creat d0/d7/d13/d2d/d3c/f104 x:0 0 0 2024-09-13T18:30:47.289 INFO:tasks.workunit.client.0.smithi038.stdout:9/727: read - d0/d7/d2c/d5a/d67/f87 zero size 2024-09-13T18:30:47.372 INFO:tasks.workunit.client.0.smithi038.stdout:6/810: sync 2024-09-13T18:30:47.375 INFO:tasks.workunit.client.0.smithi038.stdout:6/811: link dd/de/c21 dd/de/d61/d62/c11b 0 2024-09-13T18:30:47.376 INFO:tasks.workunit.client.0.smithi038.stdout:6/812: getdents dd/de/d2e/d9b 0 2024-09-13T18:30:47.378 INFO:tasks.workunit.client.0.smithi038.stdout:6/813: symlink dd/de/d2e/d2f/da0/l11c 0 2024-09-13T18:30:47.391 INFO:tasks.workunit.client.0.smithi038.stdout:6/814: read dd/de/d61/d62/f82 [1041832,51892] 0 2024-09-13T18:30:47.404 INFO:tasks.workunit.client.0.smithi038.stdout:6/815: dread dd/de/d2e/f64 [0,4194304] 0 2024-09-13T18:30:47.428 INFO:tasks.workunit.client.0.smithi038.stdout:6/816: dwrite dd/de/d61/d62/f82 [0,4194304] 0 2024-09-13T18:30:47.428 INFO:tasks.workunit.client.0.smithi038.stdout:6/817: stat dd/de/d2e/d2f/d4c 0 2024-09-13T18:30:47.443 INFO:tasks.workunit.client.0.smithi038.stdout:6/818: rename dd/de/d2e/d2f/d4c to dd/de/d2e/d9b/dbf/d11d 0 2024-09-13T18:30:47.447 INFO:tasks.workunit.client.0.smithi038.stdout:6/819: mkdir dd/de/d2e/d2f/d11e 0 2024-09-13T18:30:47.449 INFO:tasks.workunit.client.0.smithi038.stdout:6/820: dread dd/de/f4f [0,4194304] 0 2024-09-13T18:30:47.482 INFO:tasks.workunit.client.0.smithi038.stdout:6/821: dwrite dd/de/f1a [0,4194304] 0 2024-09-13T18:30:47.490 INFO:tasks.workunit.client.0.smithi038.stdout:6/822: write dd/de/d2e/d30/d27/f53 [858012,105870] 0 2024-09-13T18:30:47.496 INFO:tasks.workunit.client.0.smithi038.stdout:6/823: rename dd/de/d61/d62 to dd/de/d2e/d2f/da6/d11f 0 2024-09-13T18:30:47.499 INFO:tasks.workunit.client.0.smithi038.stdout:6/824: getdents dd/de/d31 0 2024-09-13T18:30:47.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:47 smithi038 ceph-mon[27689]: pgmap v26: 65 pgs: 65 active+clean; 2.9 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 145 MiB/s rd, 172 MiB/s wr, 311 op/s 2024-09-13T18:30:47.877 INFO:tasks.workunit.client.0.smithi038.stdout:2/733: sync 2024-09-13T18:30:47.878 INFO:tasks.workunit.client.0.smithi038.stdout:2/734: truncate d2/d1e/d44/d50/f32 997898 0 2024-09-13T18:30:47.881 INFO:tasks.workunit.client.0.smithi038.stdout:2/735: creat d2/d5c/d93/f10a x:0 0 0 2024-09-13T18:30:47.895 INFO:tasks.workunit.client.0.smithi038.stdout:2/736: dwrite d2/d1e/d44/d50/d46/da6/fd5 [0,4194304] 0 2024-09-13T18:30:47.898 INFO:tasks.workunit.client.0.smithi038.stdout:2/737: unlink d2/d5c/d93/d62/f80 0 2024-09-13T18:30:47.898 INFO:tasks.workunit.client.0.smithi038.stdout:2/738: chown d2/d1e/d44/d50/d39/d40/cdf 36177516 1 2024-09-13T18:30:47.904 INFO:tasks.workunit.client.0.smithi038.stdout:2/739: rename d2/d2a/db0/dde/df1 to d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d10b 0 2024-09-13T18:30:47.905 INFO:tasks.workunit.client.0.smithi038.stdout:2/740: creat d2/d1e/d44/d50/d39/d52/f10c x:0 0 0 2024-09-13T18:30:47.905 INFO:tasks.workunit.client.0.smithi038.stdout:2/741: truncate d2/f67 2314949 0 2024-09-13T18:30:47.929 INFO:tasks.workunit.client.0.smithi038.stdout:2/742: dwrite d2/d1e/d44/f76 [0,4194304] 0 2024-09-13T18:30:47.930 INFO:tasks.workunit.client.0.smithi038.stdout:2/743: stat d2/d1e/d87 0 2024-09-13T18:30:47.932 INFO:tasks.workunit.client.0.smithi038.stdout:2/744: creat d2/d1e/d44/d50/d39/d45/d107/f10d x:0 0 0 2024-09-13T18:30:47.940 INFO:tasks.workunit.client.0.smithi038.stdout:2/745: mknod d2/d1e/c10e 0 2024-09-13T18:30:47.941 INFO:tasks.workunit.client.0.smithi038.stdout:2/746: chown d2/d1e/d44/d50/d39/d40/cdf 612 1 2024-09-13T18:30:47.950 INFO:tasks.workunit.client.0.smithi038.stdout:2/747: dread d2/d1e/d44/d50/f2e [4194304,4194304] 0 2024-09-13T18:30:47.965 INFO:tasks.workunit.client.0.smithi038.stdout:2/748: dwrite d2/d1e/d44/d50/d46/d58/fe7 [0,4194304] 0 2024-09-13T18:30:47.965 INFO:tasks.workunit.client.0.smithi038.stdout:2/749: write d2/d5c/d93/f8e [531314,52493] 0 2024-09-13T18:30:47.968 INFO:tasks.workunit.client.0.smithi038.stdout:2/750: dread d2/d1e/d44/d50/d46/f85 [0,4194304] 0 2024-09-13T18:30:47.968 INFO:tasks.workunit.client.0.smithi038.stdout:2/751: fdatasync d2/d5c/d93/fef 0 2024-09-13T18:30:47.970 INFO:tasks.workunit.client.0.smithi038.stdout:2/752: creat d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d10b/f10f x:0 0 0 2024-09-13T18:30:47.979 INFO:tasks.workunit.client.0.smithi038.stdout:2/753: read d2/d5c/d93/f5a [3447958,68916] 0 2024-09-13T18:30:47.981 INFO:tasks.workunit.client.0.smithi038.stdout:2/754: creat d2/d1e/d44/d50/d46/f110 x:0 0 0 2024-09-13T18:30:47.988 INFO:tasks.workunit.client.0.smithi038.stdout:7/719: sync 2024-09-13T18:30:47.988 INFO:tasks.workunit.client.0.smithi038.stdout:3/925: sync 2024-09-13T18:30:47.988 INFO:tasks.workunit.client.0.smithi038.stdout:6/825: sync 2024-09-13T18:30:47.988 INFO:tasks.workunit.client.0.smithi038.stdout:7/720: chown db/d12/d13/ffd 285730 1 2024-09-13T18:30:47.989 INFO:tasks.workunit.client.0.smithi038.stdout:6/826: chown dd/de/d2e/d99/c8b 265114245 1 2024-09-13T18:30:47.989 INFO:tasks.workunit.client.0.smithi038.stdout:6/827: write dd/daa/fc8 [4452616,80995] 0 2024-09-13T18:30:47.989 INFO:tasks.workunit.client.0.smithi038.stdout:5/826: sync 2024-09-13T18:30:47.989 INFO:tasks.workunit.client.0.smithi038.stdout:9/728: sync 2024-09-13T18:30:47.989 INFO:tasks.workunit.client.0.smithi038.stdout:0/807: sync 2024-09-13T18:30:47.989 INFO:tasks.workunit.client.0.smithi038.stdout:0/808: truncate d2/d7/d24/d2b/d95/ff8 418856 0 2024-09-13T18:30:47.991 INFO:tasks.workunit.client.0.smithi038.stdout:7/721: rename db/d12/d1c/d3a/d3c/d52/d51/l67 to db/d12/d1c/l10a 0 2024-09-13T18:30:47.993 INFO:tasks.workunit.client.0.smithi038.stdout:6/828: creat dd/de/d2e/d9b/dbf/d11d/d60/f120 x:0 0 0 2024-09-13T18:30:47.993 INFO:tasks.workunit.client.0.smithi038.stdout:6/829: chown c8 303979409 1 2024-09-13T18:30:47.993 INFO:tasks.workunit.client.0.smithi038.stdout:6/830: creat dd/de/d2e/d2f/f121 x:0 0 0 2024-09-13T18:30:47.994 INFO:tasks.workunit.client.0.smithi038.stdout:5/827: truncate f3 5722065 0 2024-09-13T18:30:47.994 INFO:tasks.workunit.client.0.smithi038.stdout:5/828: chown df/d15/d36/d67/dbf/d44/d48/d56/c8e 456809 1 2024-09-13T18:30:47.994 INFO:tasks.workunit.client.0.smithi038.stdout:5/829: truncate df/d15/d36/d67/dbf/d44/d48/d75/da7/fbe 389886 0 2024-09-13T18:30:47.997 INFO:tasks.workunit.client.0.smithi038.stdout:0/809: mkdir d2/d7/d24/d92/d40/d87/d10d 0 2024-09-13T18:30:47.998 INFO:tasks.workunit.client.0.smithi038.stdout:7/722: creat db/d12/d1c/d3a/d3c/d8f/f10b x:0 0 0 2024-09-13T18:30:47.998 INFO:tasks.workunit.client.0.smithi038.stdout:7/723: readlink db/d12/d13/l9a 0 2024-09-13T18:30:48.000 INFO:tasks.workunit.client.0.smithi038.stdout:6/831: mkdir dd/df6/d122 0 2024-09-13T18:30:48.001 INFO:tasks.workunit.client.0.smithi038.stdout:5/830: symlink df/d15/d36/d67/dbf/d44/d58/dd6/l103 0 2024-09-13T18:30:48.001 INFO:tasks.workunit.client.0.smithi038.stdout:5/831: write df/d15/d36/d67/dbf/d44/d48/d75/f99 [2509643,48964] 0 2024-09-13T18:30:48.001 INFO:tasks.workunit.client.0.smithi038.stdout:5/832: readlink df/d15/d36/d67/dbf/d44/d58/dd6/l103 0 2024-09-13T18:30:48.002 INFO:tasks.workunit.client.0.smithi038.stdout:7/724: mknod db/d12/d1c/d3a/d3c/d52/dc6/c10c 0 2024-09-13T18:30:48.003 INFO:tasks.workunit.client.0.smithi038.stdout:6/832: creat dd/de/d2e/d2f/d11e/f123 x:0 0 0 2024-09-13T18:30:48.006 INFO:tasks.workunit.client.0.smithi038.stdout:7/725: symlink db/d12/df0/dd4/df1/l10d 0 2024-09-13T18:30:48.007 INFO:tasks.workunit.client.0.smithi038.stdout:5/833: write f3 [3299508,122480] 0 2024-09-13T18:30:48.007 INFO:tasks.workunit.client.0.smithi038.stdout:6/833: symlink dd/de/d2e/d2f/da6/dd9/l124 0 2024-09-13T18:30:48.008 INFO:tasks.workunit.client.0.smithi038.stdout:9/729: write d0/d7/d2c/d33/f4c [3441111,112348] 0 2024-09-13T18:30:48.008 INFO:tasks.workunit.client.0.smithi038.stdout:9/730: fdatasync d0/d7/d13/d2d/d3c/f104 0 2024-09-13T18:30:48.008 INFO:tasks.workunit.client.0.smithi038.stdout:9/731: fsync d0/d7/d13/d2d/d3e/d70/fab 0 2024-09-13T18:30:48.009 INFO:tasks.workunit.client.0.smithi038.stdout:7/726: truncate db/d12/d1c/d3a/d3c/d52/d9b/fdc 3609600 0 2024-09-13T18:30:48.009 INFO:tasks.workunit.client.0.smithi038.stdout:7/727: chown db/d12/d1c/d3a/d26/c9c 45841930 1 2024-09-13T18:30:48.010 INFO:tasks.workunit.client.0.smithi038.stdout:5/834: creat df/d15/d36/d67/dbf/d44/d52/f104 x:0 0 0 2024-09-13T18:30:48.011 INFO:tasks.workunit.client.0.smithi038.stdout:6/834: getdents dd/de/d2e/d2f/da6/dd9/d101 0 2024-09-13T18:30:48.012 INFO:tasks.workunit.client.0.smithi038.stdout:6/835: write dd/de/d2e/d9b/dbf/d11d/f4d [4364018,116146] 0 2024-09-13T18:30:48.012 INFO:tasks.workunit.client.0.smithi038.stdout:6/836: chown dd/de/d2e/d2f/d71/ffb 216078390 1 2024-09-13T18:30:48.012 INFO:tasks.workunit.client.0.smithi038.stdout:6/837: readlink dd/de/d61/l7b 0 2024-09-13T18:30:48.012 INFO:tasks.workunit.client.0.smithi038.stdout:6/838: write dd/de/d2e/d30/f59 [248,96978] 0 2024-09-13T18:30:48.012 INFO:tasks.workunit.client.0.smithi038.stdout:7/728: symlink db/d8e/l10e 0 2024-09-13T18:30:48.014 INFO:tasks.workunit.client.0.smithi038.stdout:3/926: dwrite d0/dd/d17/d50/d5c/d23/d52/f8c [4194304,4194304] 0 2024-09-13T18:30:48.014 INFO:tasks.workunit.client.0.smithi038.stdout:5/835: mkdir df/d13/d49/d9a/d105 0 2024-09-13T18:30:48.015 INFO:tasks.workunit.client.0.smithi038.stdout:6/839: creat dd/de/d2e/d2f/da0/f125 x:0 0 0 2024-09-13T18:30:48.015 INFO:tasks.workunit.client.0.smithi038.stdout:6/840: write dd/de/d2e/d9b/dbf/d11d/d86/f108 [668921,96331] 0 2024-09-13T18:30:48.016 INFO:tasks.workunit.client.0.smithi038.stdout:7/729: mknod db/d12/d13/c10f 0 2024-09-13T18:30:48.017 INFO:tasks.workunit.client.0.smithi038.stdout:5/836: creat df/f106 x:0 0 0 2024-09-13T18:30:48.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:47 smithi149 ceph-mon[35845]: pgmap v26: 65 pgs: 65 active+clean; 2.9 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 145 MiB/s rd, 172 MiB/s wr, 311 op/s 2024-09-13T18:30:48.019 INFO:tasks.workunit.client.0.smithi038.stdout:6/841: mkdir dd/df6/d122/d126 0 2024-09-13T18:30:48.019 INFO:tasks.workunit.client.0.smithi038.stdout:5/837: link df/lc8 df/d15/d36/d67/dbf/d3e/l107 0 2024-09-13T18:30:48.020 INFO:tasks.workunit.client.0.smithi038.stdout:0/810: dwrite d2/f1c [4194304,4194304] 0 2024-09-13T18:30:48.024 INFO:tasks.workunit.client.0.smithi038.stdout:5/838: symlink df/d15/d36/d67/dbf/d44/df7/l108 0 2024-09-13T18:30:48.029 INFO:tasks.workunit.client.0.smithi038.stdout:0/811: getdents d2/d7/d24/dc7 0 2024-09-13T18:30:48.032 INFO:tasks.workunit.client.0.smithi038.stdout:6/842: read dd/de/d2e/d2f/f9e [3227702,108999] 0 2024-09-13T18:30:48.034 INFO:tasks.workunit.client.0.smithi038.stdout:6/843: mknod dd/de/dc6/c127 0 2024-09-13T18:30:48.036 INFO:tasks.workunit.client.0.smithi038.stdout:6/844: symlink dd/de/d2e/d2f/da0/l128 0 2024-09-13T18:30:48.036 INFO:tasks.workunit.client.0.smithi038.stdout:6/845: creat dd/df6/f129 x:0 0 0 2024-09-13T18:30:48.036 INFO:tasks.workunit.client.0.smithi038.stdout:6/846: readlink l7 0 2024-09-13T18:30:48.037 INFO:tasks.workunit.client.0.smithi038.stdout:7/730: dwrite db/f10 [0,4194304] 0 2024-09-13T18:30:48.040 INFO:tasks.workunit.client.0.smithi038.stdout:6/847: creat dd/de/d61/f12a x:0 0 0 2024-09-13T18:30:48.041 INFO:tasks.workunit.client.0.smithi038.stdout:3/927: dwrite d0/dd/d17/f60 [0,4194304] 0 2024-09-13T18:30:48.043 INFO:tasks.workunit.client.0.smithi038.stdout:7/731: mknod db/d12/d1c/d3a/d105/c110 0 2024-09-13T18:30:48.043 INFO:tasks.workunit.client.0.smithi038.stdout:7/732: creat db/d21/f111 x:0 0 0 2024-09-13T18:30:48.045 INFO:tasks.workunit.client.0.smithi038.stdout:6/848: creat dd/de/d2e/d9b/dbf/f12b x:0 0 0 2024-09-13T18:30:48.049 INFO:tasks.workunit.client.0.smithi038.stdout:3/928: mkdir d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/deb/d122 0 2024-09-13T18:30:48.051 INFO:tasks.workunit.client.0.smithi038.stdout:6/849: symlink dd/de/d2e/d104/l12c 0 2024-09-13T18:30:48.052 INFO:tasks.workunit.client.0.smithi038.stdout:3/929: mkdir d0/dd/d123 0 2024-09-13T18:30:48.052 INFO:tasks.workunit.client.0.smithi038.stdout:3/930: truncate d0/dd/d17/d43/f117 463911 0 2024-09-13T18:30:48.055 INFO:tasks.workunit.client.0.smithi038.stdout:6/850: symlink dd/de/d2e/d2f/d11e/l12d 0 2024-09-13T18:30:48.056 INFO:tasks.workunit.client.0.smithi038.stdout:3/931: symlink d0/dd/d17/d50/d5c/d23/d93/l124 0 2024-09-13T18:30:48.057 INFO:tasks.workunit.client.0.smithi038.stdout:5/839: dwrite df/d13/d49/fd4 [0,4194304] 0 2024-09-13T18:30:48.057 INFO:tasks.workunit.client.0.smithi038.stdout:7/733: dread db/d21/f83 [0,4194304] 0 2024-09-13T18:30:48.057 INFO:tasks.workunit.client.0.smithi038.stdout:0/812: dwrite d2/dc/f14 [0,4194304] 0 2024-09-13T18:30:48.061 INFO:tasks.workunit.client.0.smithi038.stdout:3/932: mkdir d0/dd/d17/d50/d125 0 2024-09-13T18:30:48.065 INFO:tasks.workunit.client.0.smithi038.stdout:5/840: dread df/d15/d36/d67/dbf/f4d [0,4194304] 0 2024-09-13T18:30:48.066 INFO:tasks.workunit.client.0.smithi038.stdout:5/841: getdents df/d13/d85 0 2024-09-13T18:30:48.067 INFO:tasks.workunit.client.0.smithi038.stdout:7/734: symlink db/d12/d13/ded/l112 0 2024-09-13T18:30:48.072 INFO:tasks.workunit.client.0.smithi038.stdout:3/933: truncate d0/dd/d17/f1c 1612610 0 2024-09-13T18:30:48.072 INFO:tasks.workunit.client.0.smithi038.stdout:5/842: write df/d15/f39 [2315952,59470] 0 2024-09-13T18:30:48.074 INFO:tasks.workunit.client.0.smithi038.stdout:6/851: rmdir dd/de/d2e/d104 39 2024-09-13T18:30:48.074 INFO:tasks.workunit.client.0.smithi038.stdout:5/843: dread df/d15/d36/d67/dbf/d3e/fd9 [0,4194304] 0 2024-09-13T18:30:48.074 INFO:tasks.workunit.client.0.smithi038.stdout:5/844: write df/d15/d36/d67/dbf/d44/d48/d75/f99 [620744,122062] 0 2024-09-13T18:30:48.074 INFO:tasks.workunit.client.0.smithi038.stdout:5/845: fsync df/d13/d49/d70/fa2 0 2024-09-13T18:30:48.076 INFO:tasks.workunit.client.0.smithi038.stdout:7/735: creat db/d12/df0/dd4/d28/dd3/f113 x:0 0 0 2024-09-13T18:30:48.076 INFO:tasks.workunit.client.0.smithi038.stdout:7/736: write db/d12/d13/f32 [4593003,116912] 0 2024-09-13T18:30:48.081 INFO:tasks.workunit.client.0.smithi038.stdout:5/846: mknod df/d15/d36/d67/dbf/d44/d48/d54/c109 0 2024-09-13T18:30:48.085 INFO:tasks.workunit.client.0.smithi038.stdout:5/847: write df/d13/d49/d70/fa2 [658957,112800] 0 2024-09-13T18:30:48.086 INFO:tasks.workunit.client.0.smithi038.stdout:7/737: getdents db/d12 0 2024-09-13T18:30:48.087 INFO:tasks.workunit.client.0.smithi038.stdout:7/738: truncate db/d12/d1c/d3a/f1d 9080805 0 2024-09-13T18:30:48.087 INFO:tasks.workunit.client.0.smithi038.stdout:7/739: stat db/d12/d1c/d3a/d4b/ld5 0 2024-09-13T18:30:48.094 INFO:tasks.workunit.client.0.smithi038.stdout:3/934: read d0/dd/d17/f1c [838932,12361] 0 2024-09-13T18:30:48.094 INFO:tasks.workunit.client.0.smithi038.stdout:3/935: write d0/dd/d17/d43/f5d [7240923,15735] 0 2024-09-13T18:30:48.102 INFO:tasks.workunit.client.0.smithi038.stdout:6/852: write dd/de/d2e/d9b/dbf/d11d/f84 [1843130,6325] 0 2024-09-13T18:30:48.103 INFO:tasks.workunit.client.0.smithi038.stdout:7/740: dread db/d12/d1c/d3a/d3c/d8f/fdb [0,4194304] 0 2024-09-13T18:30:48.111 INFO:tasks.workunit.client.0.smithi038.stdout:5/848: dwrite f3 [0,4194304] 0 2024-09-13T18:30:48.111 INFO:tasks.workunit.client.0.smithi038.stdout:5/849: readlink df/d15/d36/d67/dbf/d44/df7/l108 0 2024-09-13T18:30:48.111 INFO:tasks.workunit.client.0.smithi038.stdout:5/850: write df/d15/d36/d67/dbf/d41/fd1 [638499,35170] 0 2024-09-13T18:30:48.111 INFO:tasks.workunit.client.0.smithi038.stdout:5/851: write df/d15/d36/d67/dbf/d44/d58/d9c/f102 [795479,44199] 0 2024-09-13T18:30:48.112 INFO:tasks.workunit.client.0.smithi038.stdout:5/852: creat df/d15/d36/d67/dbf/d44/d48/f10a x:0 0 0 2024-09-13T18:30:48.113 INFO:tasks.workunit.client.0.smithi038.stdout:6/853: write dd/de/d2e/d9b/dbf/d11d/d55/f7e [2925158,51782] 0 2024-09-13T18:30:48.116 INFO:tasks.workunit.client.0.smithi038.stdout:6/854: rename dd/de/d2e/d2f/da6/dd9/d101 to dd/de/d61/d12e 0 2024-09-13T18:30:48.119 INFO:tasks.workunit.client.0.smithi038.stdout:7/741: dwrite db/d12/d1c/d3a/d3c/d52/d51/f82 [0,4194304] 0 2024-09-13T18:30:48.120 INFO:tasks.workunit.client.0.smithi038.stdout:7/742: rename db/f10 to db/d12/df0/f114 0 2024-09-13T18:30:48.121 INFO:tasks.workunit.client.0.smithi038.stdout:6/855: dread dd/de/d2e/d2f/d71/fa4 [0,4194304] 0 2024-09-13T18:30:48.121 INFO:tasks.workunit.client.0.smithi038.stdout:7/743: creat db/d12/df0/dd4/d28/f115 x:0 0 0 2024-09-13T18:30:48.121 INFO:tasks.workunit.client.0.smithi038.stdout:7/744: fsync db/d12/f7b 0 2024-09-13T18:30:48.121 INFO:tasks.workunit.client.0.smithi038.stdout:7/745: creat db/d12/d1c/d3a/d26/d41/dad/f116 x:0 0 0 2024-09-13T18:30:48.122 INFO:tasks.workunit.client.0.smithi038.stdout:6/856: link dd/de/d31/cb8 dd/de/d2e/d9b/c12f 0 2024-09-13T18:30:48.124 INFO:tasks.workunit.client.0.smithi038.stdout:7/746: symlink db/d12/df0/dd4/l117 0 2024-09-13T18:30:48.125 INFO:tasks.workunit.client.0.smithi038.stdout:7/747: truncate db/d12/d1c/d3a/d3c/d52/f6c 439762 0 2024-09-13T18:30:48.128 INFO:tasks.workunit.client.0.smithi038.stdout:7/748: symlink db/d8e/l118 0 2024-09-13T18:30:48.128 INFO:tasks.workunit.client.0.smithi038.stdout:7/749: dread - db/d12/d1c/d3a/d3c/d52/dc6/feb zero size 2024-09-13T18:30:48.132 INFO:tasks.workunit.client.0.smithi038.stdout:7/750: creat db/f119 x:0 0 0 2024-09-13T18:30:48.134 INFO:tasks.workunit.client.0.smithi038.stdout:7/751: truncate db/d12/d1c/d3a/d4b/f65 744710 0 2024-09-13T18:30:48.138 INFO:tasks.workunit.client.0.smithi038.stdout:7/752: rename db/d12/d1c/d3a/d26/lfb to db/d21/l11a 0 2024-09-13T18:30:48.139 INFO:tasks.workunit.client.0.smithi038.stdout:7/753: unlink db/d12/d1c/d3a/lfe 0 2024-09-13T18:30:48.140 INFO:tasks.workunit.client.0.smithi038.stdout:7/754: write db/d12/d1c/d3a/d26/f93 [4601332,100171] 0 2024-09-13T18:30:48.142 INFO:tasks.workunit.client.0.smithi038.stdout:7/755: rename db/d12/df0/dd4/f23 to db/d12/df0/dd4/df1/d104/f11b 0 2024-09-13T18:30:48.142 INFO:tasks.workunit.client.0.smithi038.stdout:7/756: fsync db/f48 0 2024-09-13T18:30:48.142 INFO:tasks.workunit.client.0.smithi038.stdout:7/757: dread - db/d12/d1c/d3a/d26/d41/dad/fb2 zero size 2024-09-13T18:30:48.148 INFO:tasks.workunit.client.0.smithi038.stdout:6/857: dwrite dd/de/d2e/f6e [0,4194304] 0 2024-09-13T18:30:48.148 INFO:tasks.workunit.client.0.smithi038.stdout:6/858: chown dd/de/d2e/d9b/dbf/d11d/d55 290762 1 2024-09-13T18:30:48.148 INFO:tasks.workunit.client.0.smithi038.stdout:5/853: dwrite df/d15/d36/d67/dbf/d44/d48/d54/f90 [0,4194304] 0 2024-09-13T18:30:48.148 INFO:tasks.workunit.client.0.smithi038.stdout:5/854: symlink df/d15/d50/l10b 0 2024-09-13T18:30:48.150 INFO:tasks.workunit.client.0.smithi038.stdout:6/859: fdatasync dd/de/d2e/d9b/dbf/d11d/d55/f7e 0 2024-09-13T18:30:48.150 INFO:tasks.workunit.client.0.smithi038.stdout:6/860: write dd/de/d61/f12a [574721,48175] 0 2024-09-13T18:30:48.150 INFO:tasks.workunit.client.0.smithi038.stdout:6/861: write dd/de/d2e/d2f/d71/dc5/f103 [305063,20927] 0 2024-09-13T18:30:48.150 INFO:tasks.workunit.client.0.smithi038.stdout:5/855: truncate df/d15/f3d 3077908 0 2024-09-13T18:30:48.152 INFO:tasks.workunit.client.0.smithi038.stdout:6/862: symlink dd/de/d2e/d30/l130 0 2024-09-13T18:30:48.156 INFO:tasks.workunit.client.0.smithi038.stdout:6/863: rmdir dd/de/d2e/d2f/da0 39 2024-09-13T18:30:48.156 INFO:tasks.workunit.client.0.smithi038.stdout:6/864: stat dd/de/d61/da1/fe3 0 2024-09-13T18:30:48.156 INFO:tasks.workunit.client.0.smithi038.stdout:6/865: stat dd/de/d2e/d30/l130 0 2024-09-13T18:30:48.160 INFO:tasks.workunit.client.0.smithi038.stdout:6/866: symlink dd/de/l131 0 2024-09-13T18:30:48.160 INFO:tasks.workunit.client.0.smithi038.stdout:6/867: symlink dd/de/d61/l132 0 2024-09-13T18:30:48.161 INFO:tasks.workunit.client.0.smithi038.stdout:7/758: truncate db/d12/d1c/d3a/d3c/d52/d9b/fdc 1540638 0 2024-09-13T18:30:48.164 INFO:tasks.workunit.client.0.smithi038.stdout:5/856: dwrite df/f2a [0,4194304] 0 2024-09-13T18:30:48.165 INFO:tasks.workunit.client.0.smithi038.stdout:5/857: readlink df/d13/d49/d70/l7c 0 2024-09-13T18:30:48.166 INFO:tasks.workunit.client.0.smithi038.stdout:5/858: write df/d15/d36/d67/dbf/f73 [8393939,1211] 0 2024-09-13T18:30:48.166 INFO:tasks.workunit.client.0.smithi038.stdout:5/859: chown df/d13/d49/l55 334 1 2024-09-13T18:30:48.170 INFO:tasks.workunit.client.0.smithi038.stdout:7/759: dread db/d12/d1c/d3a/d3c/d52/dc6/fda [0,4194304] 0 2024-09-13T18:30:48.170 INFO:tasks.workunit.client.0.smithi038.stdout:7/760: fdatasync db/d12/d1c/d3a/d3c/d8f/f10b 0 2024-09-13T18:30:48.176 INFO:tasks.workunit.client.0.smithi038.stdout:5/860: rename df/d15/d36/d67/dbf/d44/d48/d54/c109 to df/d15/d36/d67/dbf/d44/d52/c10c 0 2024-09-13T18:30:48.176 INFO:tasks.workunit.client.0.smithi038.stdout:5/861: stat df/d13/d85/lab 0 2024-09-13T18:30:48.177 INFO:tasks.workunit.client.0.smithi038.stdout:7/761: mkdir db/d12/df0/d11c 0 2024-09-13T18:30:48.178 INFO:tasks.workunit.client.0.smithi038.stdout:7/762: getdents db/d12/df0/dd4/df1/d104 0 2024-09-13T18:30:48.179 INFO:tasks.workunit.client.0.smithi038.stdout:7/763: mkdir db/d12/d1c/d3a/d3c/d52/d9b/d11d 0 2024-09-13T18:30:48.180 INFO:tasks.workunit.client.0.smithi038.stdout:7/764: symlink db/d12/d1c/d3a/d26/d41/dad/l11e 0 2024-09-13T18:30:48.180 INFO:tasks.workunit.client.0.smithi038.stdout:7/765: truncate db/d21/f103 796892 0 2024-09-13T18:30:48.182 INFO:tasks.workunit.client.0.smithi038.stdout:7/766: creat db/d12/d1c/d3a/d3c/d52/dc6/def/f11f x:0 0 0 2024-09-13T18:30:48.182 INFO:tasks.workunit.client.0.smithi038.stdout:7/767: fdatasync db/d21/f75 0 2024-09-13T18:30:48.187 INFO:tasks.workunit.client.0.smithi038.stdout:5/862: dread df/d15/d36/d67/dbf/f73 [0,4194304] 0 2024-09-13T18:30:48.195 INFO:tasks.workunit.client.0.smithi038.stdout:5/863: mknod df/d15/d36/d67/dbf/d44/d58/d94/c10d 0 2024-09-13T18:30:48.196 INFO:tasks.workunit.client.0.smithi038.stdout:5/864: mknod df/d15/d36/d67/dbf/d44/d52/c10e 0 2024-09-13T18:30:48.196 INFO:tasks.workunit.client.0.smithi038.stdout:5/865: fsync df/d15/d36/d67/dbf/d44/d58/d9c/fc1 0 2024-09-13T18:30:48.197 INFO:tasks.workunit.client.0.smithi038.stdout:7/768: dwrite db/d12/d1c/d3a/d3c/d52/d51/fa2 [0,4194304] 0 2024-09-13T18:30:48.197 INFO:tasks.workunit.client.0.smithi038.stdout:5/866: unlink df/f10 0 2024-09-13T18:30:48.198 INFO:tasks.workunit.client.0.smithi038.stdout:5/867: chown df/d15/d36/d67/dbf/d44/df7 1019735771 1 2024-09-13T18:30:48.199 INFO:tasks.workunit.client.0.smithi038.stdout:5/868: mkdir df/d13/d85/d10f 0 2024-09-13T18:30:48.200 INFO:tasks.workunit.client.0.smithi038.stdout:5/869: creat df/d15/d36/d67/dbf/d44/d52/db6/f110 x:0 0 0 2024-09-13T18:30:48.201 INFO:tasks.workunit.client.0.smithi038.stdout:7/769: dread db/d12/d13/f54 [0,4194304] 0 2024-09-13T18:30:48.203 INFO:tasks.workunit.client.0.smithi038.stdout:7/770: rename db/d12/df0/dd4/d28/dd3/fde to db/d12/d13/d43/f120 0 2024-09-13T18:30:48.208 INFO:tasks.workunit.client.0.smithi038.stdout:7/771: rename db/d12/d1c/d3a/l62 to db/d12/d1c/d3a/l121 0 2024-09-13T18:30:48.208 INFO:tasks.workunit.client.0.smithi038.stdout:7/772: truncate db/d12/d13/fb3 625442 0 2024-09-13T18:30:48.215 INFO:tasks.workunit.client.0.smithi038.stdout:5/870: dwrite df/d15/d36/d67/dbf/d3e/fd9 [0,4194304] 0 2024-09-13T18:30:48.224 INFO:tasks.workunit.client.0.smithi038.stdout:7/773: dwrite db/d12/d13/fb3 [0,4194304] 0 2024-09-13T18:30:48.224 INFO:tasks.workunit.client.0.smithi038.stdout:7/774: chown db/d12/f18 283439 1 2024-09-13T18:30:48.247 INFO:tasks.workunit.client.0.smithi038.stdout:7/775: dwrite db/d12/d1c/d3a/d3c/f40 [0,4194304] 0 2024-09-13T18:30:48.247 INFO:tasks.workunit.client.0.smithi038.stdout:5/871: dwrite df/d15/d36/d67/dbf/f73 [0,4194304] 0 2024-09-13T18:30:48.247 INFO:tasks.workunit.client.0.smithi038.stdout:5/872: chown df/d15/d36/d67/dbf/d44/fb5 117 1 2024-09-13T18:30:48.247 INFO:tasks.workunit.client.0.smithi038.stdout:5/873: read df/d13/d49/d70/fa2 [999758,48226] 0 2024-09-13T18:30:48.247 INFO:tasks.workunit.client.0.smithi038.stdout:7/776: read db/d12/d13/d43/f4e [140819,80616] 0 2024-09-13T18:30:48.252 INFO:tasks.workunit.client.0.smithi038.stdout:5/874: mkdir df/d111 0 2024-09-13T18:30:48.267 INFO:tasks.workunit.client.0.smithi038.stdout:7/777: dwrite db/d12/d1c/d3a/d3c/d52/d51/fa2 [0,4194304] 0 2024-09-13T18:30:48.267 INFO:tasks.workunit.client.0.smithi038.stdout:7/778: truncate db/d12/df0/dd4/f7d 5175514 0 2024-09-13T18:30:48.268 INFO:tasks.workunit.client.0.smithi038.stdout:7/779: truncate db/d12/f68 1383101 0 2024-09-13T18:30:48.269 INFO:tasks.workunit.client.0.smithi038.stdout:7/780: rename db/d12/d1c/d3a/d3c/d8f/fdb to db/d12/d1c/d3a/d3c/d52/dc6/f122 0 2024-09-13T18:30:48.271 INFO:tasks.workunit.client.0.smithi038.stdout:7/781: mknod db/d12/d1c/d3a/d26/d41/dad/d106/c123 0 2024-09-13T18:30:48.272 INFO:tasks.workunit.client.0.smithi038.stdout:7/782: link db/d12/df0/dd4/f30 db/d12/d1c/d3a/d26/d41/f124 0 2024-09-13T18:30:48.273 INFO:tasks.workunit.client.0.smithi038.stdout:7/783: mknod db/d21/c125 0 2024-09-13T18:30:48.273 INFO:tasks.workunit.client.0.smithi038.stdout:7/784: truncate db/d12/d1c/d3a/d26/d41/f5d 4278175 0 2024-09-13T18:30:48.282 INFO:tasks.workunit.client.0.smithi038.stdout:5/875: dwrite df/d15/d36/f3a [4194304,4194304] 0 2024-09-13T18:30:48.282 INFO:tasks.workunit.client.0.smithi038.stdout:5/876: chown df/d15/d36/d67/dbf/d44/d48/d9d 2 1 2024-09-13T18:30:48.285 INFO:tasks.workunit.client.0.smithi038.stdout:7/785: read db/d12/f68 [1037482,88927] 0 2024-09-13T18:30:48.285 INFO:tasks.workunit.client.0.smithi038.stdout:5/877: getdents df/d13/d49/d9a 0 2024-09-13T18:30:48.285 INFO:tasks.workunit.client.0.smithi038.stdout:5/878: write df/d15/d36/d67/dbf/d44/d48/d75/fd7 [399524,95100] 0 2024-09-13T18:30:48.286 INFO:tasks.workunit.client.0.smithi038.stdout:7/786: mknod db/d12/d1c/d3a/d26/d41/dad/d106/c126 0 2024-09-13T18:30:48.287 INFO:tasks.workunit.client.0.smithi038.stdout:7/787: fsync db/d12/d1c/d3a/d4b/f77 0 2024-09-13T18:30:48.287 INFO:tasks.workunit.client.0.smithi038.stdout:5/879: symlink df/d15/d36/d67/dbf/d3e/l112 0 2024-09-13T18:30:48.288 INFO:tasks.workunit.client.0.smithi038.stdout:7/788: creat db/d12/d1c/d3a/d3c/d52/d9b/f127 x:0 0 0 2024-09-13T18:30:48.290 INFO:tasks.workunit.client.0.smithi038.stdout:5/880: creat df/d15/d50/f113 x:0 0 0 2024-09-13T18:30:48.290 INFO:tasks.workunit.client.0.smithi038.stdout:5/881: fdatasync df/d15/d36/d67/dbf/d3e/f33 0 2024-09-13T18:30:48.290 INFO:tasks.workunit.client.0.smithi038.stdout:5/882: chown df/d13/d49/fd4 218 1 2024-09-13T18:30:48.291 INFO:tasks.workunit.client.0.smithi038.stdout:7/789: creat db/d12/f128 x:0 0 0 2024-09-13T18:30:48.296 INFO:tasks.workunit.client.0.smithi038.stdout:7/790: dread db/d21/f83 [0,4194304] 0 2024-09-13T18:30:48.319 INFO:tasks.workunit.client.0.smithi038.stdout:7/791: dwrite db/d12/d1c/d3a/d3c/d52/dc6/fda [0,4194304] 0 2024-09-13T18:30:48.320 INFO:tasks.workunit.client.0.smithi038.stdout:5/883: dwrite df/d15/d36/d67/dbf/d44/d48/d75/da7/fbe [0,4194304] 0 2024-09-13T18:30:48.320 INFO:tasks.workunit.client.0.smithi038.stdout:5/884: readlink df/d15/d36/d67/dbf/d41/l91 0 2024-09-13T18:30:48.327 INFO:tasks.workunit.client.0.smithi038.stdout:7/792: rename db/d12/d1c/d3a/d3c/d52 to db/d12/d1c/d3a/d26/d41/dad/d106/d129 0 2024-09-13T18:30:48.329 INFO:tasks.workunit.client.0.smithi038.stdout:7/793: symlink db/d12/l12a 0 2024-09-13T18:30:48.329 INFO:tasks.workunit.client.0.smithi038.stdout:7/794: stat db/d21/c7e 0 2024-09-13T18:30:48.331 INFO:tasks.workunit.client.0.smithi038.stdout:7/795: rename db/d12/d1c/d3a/d105/c110 to db/d12/d1c/d3a/d26/d41/c12b 0 2024-09-13T18:30:48.332 INFO:tasks.workunit.client.0.smithi038.stdout:7/796: symlink db/d12/d1c/d3a/d26/d41/dad/l12c 0 2024-09-13T18:30:48.334 INFO:tasks.workunit.client.0.smithi038.stdout:7/797: creat db/d12/d1c/d3a/d105/f12d x:0 0 0 2024-09-13T18:30:48.343 INFO:tasks.workunit.client.0.smithi038.stdout:7/798: write db/d12/d13/f54 [413703,69898] 0 2024-09-13T18:30:48.345 INFO:tasks.workunit.client.0.smithi038.stdout:7/799: dread db/d12/f68 [0,4194304] 0 2024-09-13T18:30:48.346 INFO:tasks.workunit.client.0.smithi038.stdout:7/800: creat db/d12/d13/d43/f12e x:0 0 0 2024-09-13T18:30:48.346 INFO:tasks.workunit.client.0.smithi038.stdout:7/801: chown db/d12/d13/f63 2405598 1 2024-09-13T18:30:48.350 INFO:tasks.workunit.client.0.smithi038.stdout:7/802: getdents db/d12 0 2024-09-13T18:30:48.356 INFO:tasks.workunit.client.0.smithi038.stdout:7/803: dread db/f14 [0,4194304] 0 2024-09-13T18:30:48.356 INFO:tasks.workunit.client.0.smithi038.stdout:7/804: fsync db/d12/d1c/d3a/f1d 0 2024-09-13T18:30:48.356 INFO:tasks.workunit.client.0.smithi038.stdout:7/805: creat db/d12/df0/f12f x:0 0 0 2024-09-13T18:30:48.374 INFO:tasks.workunit.client.0.smithi038.stdout:7/806: dwrite db/d12/df0/dd4/f7d [0,4194304] 0 2024-09-13T18:30:48.380 INFO:tasks.workunit.client.0.smithi038.stdout:7/807: write db/d8e/fa7 [1841449,94239] 0 2024-09-13T18:30:48.382 INFO:tasks.workunit.client.0.smithi038.stdout:7/808: symlink db/d12/d1c/d3a/d26/d41/dad/d106/d129/l130 0 2024-09-13T18:30:48.383 INFO:tasks.workunit.client.0.smithi038.stdout:7/809: symlink db/d12/d1c/d3a/d26/l131 0 2024-09-13T18:30:48.385 INFO:tasks.workunit.client.0.smithi038.stdout:7/810: mknod db/d12/d1c/d3a/d3c/c132 0 2024-09-13T18:30:48.386 INFO:tasks.workunit.client.0.smithi038.stdout:7/811: symlink db/d12/d1c/d3a/d3c/l133 0 2024-09-13T18:30:48.388 INFO:tasks.workunit.client.0.smithi038.stdout:7/812: link db/d21/f83 db/d12/f134 0 2024-09-13T18:30:48.395 INFO:tasks.workunit.client.0.smithi038.stdout:7/813: dread db/d12/f18 [0,4194304] 0 2024-09-13T18:30:48.395 INFO:tasks.workunit.client.0.smithi038.stdout:7/814: dread - db/d21/ff7 zero size 2024-09-13T18:30:48.403 INFO:tasks.workunit.client.0.smithi038.stdout:7/815: creat db/d8e/f135 x:0 0 0 2024-09-13T18:30:48.403 INFO:tasks.workunit.client.0.smithi038.stdout:7/816: chown db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/def 4632377 1 2024-09-13T18:30:48.405 INFO:tasks.workunit.client.0.smithi038.stdout:7/817: truncate db/fc 1189639 0 2024-09-13T18:30:48.406 INFO:tasks.workunit.client.0.smithi038.stdout:7/818: rmdir db/d12/d13/ded 39 2024-09-13T18:30:48.408 INFO:tasks.workunit.client.0.smithi038.stdout:7/819: creat db/d12/d1c/d3a/d3c/f136 x:0 0 0 2024-09-13T18:30:48.408 INFO:tasks.workunit.client.0.smithi038.stdout:7/820: truncate db/d12/d1c/fc4 1685900 0 2024-09-13T18:30:48.410 INFO:tasks.workunit.client.0.smithi038.stdout:7/821: link db/d12/d13/d43/f4e db/d12/df0/dd4/d28/dd3/f137 0 2024-09-13T18:30:48.420 INFO:tasks.workunit.client.0.smithi038.stdout:7/822: write db/d12/d13/d43/f120 [2012852,124335] 0 2024-09-13T18:30:48.440 INFO:tasks.workunit.client.0.smithi038.stdout:7/823: dwrite db/d12/df0/dd4/d28/f9d [0,4194304] 0 2024-09-13T18:30:48.440 INFO:tasks.workunit.client.0.smithi038.stdout:7/824: readlink db/d12/d1c/d3a/d26/d41/dad/d106/d129/l5a 0 2024-09-13T18:30:48.468 INFO:tasks.workunit.client.0.smithi038.stdout:7/825: dwrite db/d12/d1c/d3a/f7f [0,4194304] 0 2024-09-13T18:30:48.470 INFO:tasks.workunit.client.0.smithi038.stdout:7/826: write db/d12/d1c/d3a/d26/d41/fe9 [569660,78770] 0 2024-09-13T18:30:48.470 INFO:tasks.workunit.client.0.smithi038.stdout:7/827: fsync db/d12/d1c/d3a/d26/d41/f124 0 2024-09-13T18:30:48.499 INFO:tasks.workunit.client.0.smithi038.stdout:2/755: sync 2024-09-13T18:30:48.553 INFO:tasks.workunit.client.0.smithi038.stdout:7/828: unlink db/d12/fe1 0 2024-09-13T18:30:48.555 INFO:tasks.workunit.client.0.smithi038.stdout:2/756: unlink d2/d1e/d44/d50/d39/d45/faf 0 2024-09-13T18:30:48.560 INFO:tasks.workunit.client.0.smithi038.stdout:7/829: symlink db/d12/d1c/d3a/d26/d41/dad/d106/d129/d9b/l138 0 2024-09-13T18:30:48.564 INFO:tasks.workunit.client.0.smithi038.stdout:2/757: rename d2/d1e/d44/d50/de0/cf7 to d2/d2a/dfe/c111 0 2024-09-13T18:30:48.564 INFO:tasks.workunit.client.0.smithi038.stdout:2/758: dread - d2/d1e/d87/fa5 zero size 2024-09-13T18:30:48.564 INFO:tasks.workunit.client.0.smithi038.stdout:2/759: rename d2 to d2/d1e/d44/d50/d39/d40/ddb/d112 22 2024-09-13T18:30:48.570 INFO:tasks.workunit.client.0.smithi038.stdout:7/830: dread db/d12/d1c/f79 [0,4194304] 0 2024-09-13T18:30:48.575 INFO:tasks.workunit.client.0.smithi038.stdout:2/760: write d2/d1e/d44/d50/d46/f71 [3777240,50673] 0 2024-09-13T18:30:48.578 INFO:tasks.workunit.client.0.smithi038.stdout:7/831: creat db/d12/d1c/d3a/f139 x:0 0 0 2024-09-13T18:30:48.578 INFO:tasks.workunit.client.0.smithi038.stdout:7/832: creat db/d12/d1c/f13a x:0 0 0 2024-09-13T18:30:48.581 INFO:tasks.workunit.client.0.smithi038.stdout:2/761: creat d2/d1e/d44/d50/de0/dff/f113 x:0 0 0 2024-09-13T18:30:48.586 INFO:tasks.workunit.client.0.smithi038.stdout:7/833: creat db/d12/d1c/d3a/d4b/f13b x:0 0 0 2024-09-13T18:30:48.588 INFO:tasks.workunit.client.0.smithi038.stdout:2/762: symlink d2/d1e/d44/d50/d46/db1/l114 0 2024-09-13T18:30:48.589 INFO:tasks.workunit.client.0.smithi038.stdout:7/834: mkdir db/d12/d1c/d3a/d26/d41/dad/d106/d129/d9b/d13c 0 2024-09-13T18:30:48.591 INFO:tasks.workunit.client.0.smithi038.stdout:2/763: rename d2/d1e/d44/d50/d46/f71 to d2/d1e/d44/d50/f115 0 2024-09-13T18:30:48.594 INFO:tasks.workunit.client.0.smithi038.stdout:7/835: creat db/d12/df0/dd4/df1/f13d x:0 0 0 2024-09-13T18:30:48.597 INFO:tasks.workunit.client.0.smithi038.stdout:2/764: creat d2/d1e/d44/d50/d46/da6/f116 x:0 0 0 2024-09-13T18:30:48.597 INFO:tasks.workunit.client.0.smithi038.stdout:2/765: chown d2/d5c/d93/fef 8 1 2024-09-13T18:30:48.600 INFO:tasks.workunit.client.0.smithi038.stdout:2/766: mknod d2/d1e/d44/d50/d39/d40/c117 0 2024-09-13T18:30:48.601 INFO:tasks.workunit.client.0.smithi038.stdout:7/836: rmdir db/d12/d13/d43 39 2024-09-13T18:30:48.608 INFO:tasks.workunit.client.0.smithi038.stdout:2/767: dread d2/d2a/f3d [0,4194304] 0 2024-09-13T18:30:48.608 INFO:tasks.workunit.client.0.smithi038.stdout:2/768: fsync d2/d1e/f95 0 2024-09-13T18:30:48.611 INFO:tasks.workunit.client.0.smithi038.stdout:2/769: creat d2/d2a/db0/dde/f118 x:0 0 0 2024-09-13T18:30:48.612 INFO:tasks.workunit.client.0.smithi038.stdout:2/770: write d2/d2a/db0/dde/f118 [775216,75321] 0 2024-09-13T18:30:48.612 INFO:tasks.workunit.client.0.smithi038.stdout:2/771: write d2/fe9 [235690,114306] 0 2024-09-13T18:30:48.614 INFO:tasks.workunit.client.0.smithi038.stdout:2/772: mkdir d2/da/d74/d119 0 2024-09-13T18:30:48.622 INFO:tasks.workunit.client.0.smithi038.stdout:7/837: dwrite db/f119 [0,4194304] 0 2024-09-13T18:30:48.624 INFO:tasks.workunit.client.0.smithi038.stdout:2/773: write d2/f47 [449117,26555] 0 2024-09-13T18:30:48.632 INFO:tasks.workunit.client.0.smithi038.stdout:7/838: dread db/d12/df0/dd4/df1/d104/f11b [0,4194304] 0 2024-09-13T18:30:48.633 INFO:tasks.workunit.client.0.smithi038.stdout:7/839: dread db/d12/d1c/d3a/d3c/f46 [0,4194304] 0 2024-09-13T18:30:48.635 INFO:tasks.workunit.client.0.smithi038.stdout:7/840: mknod db/d12/d1c/d3a/d26/d41/dad/d106/d129/d51/c13e 0 2024-09-13T18:30:48.636 INFO:tasks.workunit.client.0.smithi038.stdout:2/774: write d2/d5c/d93/d62/f70 [2280819,119842] 0 2024-09-13T18:30:48.638 INFO:tasks.workunit.client.0.smithi038.stdout:2/775: mknod d2/d1e/d44/d50/d39/d40/c11a 0 2024-09-13T18:30:48.640 INFO:tasks.workunit.client.0.smithi038.stdout:2/776: symlink d2/d1e/d48/l11b 0 2024-09-13T18:30:48.640 INFO:tasks.workunit.client.0.smithi038.stdout:2/777: creat d2/d1e/d44/d50/d46/db1/f11c x:0 0 0 2024-09-13T18:30:48.640 INFO:tasks.workunit.client.0.smithi038.stdout:2/778: dread - d2/d5c/d93/fef zero size 2024-09-13T18:30:48.640 INFO:tasks.workunit.client.0.smithi038.stdout:2/779: stat d2/da/d16/f24 0 2024-09-13T18:30:48.643 INFO:tasks.workunit.client.0.smithi038.stdout:7/841: write db/d12/d1c/f79 [1153335,78752] 0 2024-09-13T18:30:48.643 INFO:tasks.workunit.client.0.smithi038.stdout:7/842: fsync db/d12/d1c/d3a/d26/d41/dad/d106/d129/d51/f86 0 2024-09-13T18:30:48.664 INFO:tasks.workunit.client.0.smithi038.stdout:2/780: dwrite d2/d1e/d44/d50/d46/f85 [0,4194304] 0 2024-09-13T18:30:48.669 INFO:tasks.workunit.client.0.smithi038.stdout:7/843: dwrite db/d12/df0/dd4/df1/d104/f11b [0,4194304] 0 2024-09-13T18:30:48.670 INFO:tasks.workunit.client.0.smithi038.stdout:7/844: creat db/d12/d1c/f13f x:0 0 0 2024-09-13T18:30:48.670 INFO:tasks.workunit.client.0.smithi038.stdout:7/845: dread - db/d21/ff7 zero size 2024-09-13T18:30:48.683 INFO:tasks.workunit.client.0.smithi038.stdout:2/781: dwrite d2/d1e/d44/d50/d39/d45/fce [0,4194304] 0 2024-09-13T18:30:48.685 INFO:tasks.workunit.client.0.smithi038.stdout:2/782: dread d2/da/f94 [0,4194304] 0 2024-09-13T18:30:48.686 INFO:tasks.workunit.client.0.smithi038.stdout:2/783: creat d2/d1e/d44/d50/d39/d40/ddb/f11d x:0 0 0 2024-09-13T18:30:48.691 INFO:tasks.workunit.client.0.smithi038.stdout:2/784: rename d2/d1e/d44/d50/f73 to d2/d1e/d87/f11e 0 2024-09-13T18:30:48.697 INFO:tasks.workunit.client.0.smithi038.stdout:2/785: dread d2/d1e/f2f [0,4194304] 0 2024-09-13T18:30:48.698 INFO:tasks.workunit.client.0.smithi038.stdout:2/786: write d2/d1e/d44/d50/d39/d40/ddb/fe2 [886846,64676] 0 2024-09-13T18:30:48.698 INFO:tasks.workunit.client.0.smithi038.stdout:2/787: readlink d2/l43 0 2024-09-13T18:30:48.698 INFO:tasks.workunit.client.0.smithi038.stdout:2/788: write d2/d5c/dea/ff6 [49274,53287] 0 2024-09-13T18:30:48.698 INFO:tasks.workunit.client.0.smithi038.stdout:2/789: fsync d2/f5 0 2024-09-13T18:30:48.703 INFO:tasks.workunit.client.0.smithi038.stdout:2/790: creat d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/f11f x:0 0 0 2024-09-13T18:30:48.706 INFO:tasks.workunit.client.0.smithi038.stdout:2/791: mknod d2/d1e/d44/d50/d39/d40/ddb/d105/c120 0 2024-09-13T18:30:48.708 INFO:tasks.workunit.client.0.smithi038.stdout:7/846: dwrite db/fc [0,4194304] 0 2024-09-13T18:30:48.712 INFO:tasks.workunit.client.0.smithi038.stdout:7/847: creat db/f140 x:0 0 0 2024-09-13T18:30:48.712 INFO:tasks.workunit.client.0.smithi038.stdout:7/848: write db/d12/d1c/d3a/d26/d41/dad/d106/d129/f109 [600208,64885] 0 2024-09-13T18:30:48.712 INFO:tasks.workunit.client.0.smithi038.stdout:7/849: chown db/d12/df0/dd4/d28/f9d 46175 1 2024-09-13T18:30:48.723 INFO:tasks.workunit.client.0.smithi038.stdout:2/792: dwrite d2/d1e/d44/d50/d46/db1/ffc [0,4194304] 0 2024-09-13T18:30:48.730 INFO:tasks.workunit.client.0.smithi038.stdout:7/850: write db/d12/d1c/fc4 [1460873,97872] 0 2024-09-13T18:30:48.730 INFO:tasks.workunit.client.0.smithi038.stdout:7/851: chown db/f48 7555268 1 2024-09-13T18:30:48.735 INFO:tasks.workunit.client.0.smithi038.stdout:9/732: sync 2024-09-13T18:30:48.735 INFO:tasks.workunit.client.0.smithi038.stdout:6/868: sync 2024-09-13T18:30:48.735 INFO:tasks.workunit.client.0.smithi038.stdout:0/813: sync 2024-09-13T18:30:48.735 INFO:tasks.workunit.client.0.smithi038.stdout:3/936: sync 2024-09-13T18:30:48.737 INFO:tasks.workunit.client.0.smithi038.stdout:2/793: mkdir d2/d1e/d44/d50/de0/dff/d121 0 2024-09-13T18:30:48.739 INFO:tasks.workunit.client.0.smithi038.stdout:7/852: creat db/d12/df0/dd4/f141 x:0 0 0 2024-09-13T18:30:48.740 INFO:tasks.workunit.client.0.smithi038.stdout:7/853: readlink db/d12/df0/dd4/df1/l10d 0 2024-09-13T18:30:48.741 INFO:tasks.workunit.client.0.smithi038.stdout:3/937: getdents d0/dd/d17/d50/d5c/d23/d93/df7 0 2024-09-13T18:30:48.745 INFO:tasks.workunit.client.0.smithi038.stdout:6/869: symlink dd/df6/d122/l133 0 2024-09-13T18:30:48.748 INFO:tasks.workunit.client.0.smithi038.stdout:2/794: rename d2/d1e/d44/d50/d39/d40/ddb/d105/c120 to d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/dd6/c122 0 2024-09-13T18:30:48.751 INFO:tasks.workunit.client.0.smithi038.stdout:7/854: symlink db/d12/d1c/d3a/d26/d41/dad/d106/d129/d51/l142 0 2024-09-13T18:30:48.753 INFO:tasks.workunit.client.0.smithi038.stdout:6/870: creat dd/de/d61/da1/f134 x:0 0 0 2024-09-13T18:30:48.753 INFO:tasks.workunit.client.0.smithi038.stdout:5/885: sync 2024-09-13T18:30:48.755 INFO:tasks.workunit.client.0.smithi038.stdout:2/795: symlink d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d10b/l123 0 2024-09-13T18:30:48.757 INFO:tasks.workunit.client.0.smithi038.stdout:2/796: link d2/d1e/d44/d50/d46/f110 d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d10b/f124 0 2024-09-13T18:30:48.762 INFO:tasks.workunit.client.0.smithi038.stdout:2/797: rename d2/d5c/db3 to d2/d125 0 2024-09-13T18:30:48.765 INFO:tasks.workunit.client.0.smithi038.stdout:2/798: rename d2/d1e/d44/d50/d39/d40/f9b to d2/f126 0 2024-09-13T18:30:48.766 INFO:tasks.workunit.client.0.smithi038.stdout:7/855: dread db/fb5 [0,4194304] 0 2024-09-13T18:30:48.766 INFO:tasks.workunit.client.0.smithi038.stdout:7/856: dread - db/d21/f111 zero size 2024-09-13T18:30:48.766 INFO:tasks.workunit.client.0.smithi038.stdout:0/814: dwrite d2/d7/d24/ff6 [0,4194304] 0 2024-09-13T18:30:48.766 INFO:tasks.workunit.client.0.smithi038.stdout:0/815: write d2/dc/f28 [2682917,75598] 0 2024-09-13T18:30:48.766 INFO:tasks.workunit.client.0.smithi038.stdout:0/816: creat d2/d7/de1/f10e x:0 0 0 2024-09-13T18:30:48.768 INFO:tasks.workunit.client.0.smithi038.stdout:9/733: dwrite d0/d7/d13/d2d/d3c/dc9/fee [0,4194304] 0 2024-09-13T18:30:48.768 INFO:tasks.workunit.client.0.smithi038.stdout:2/799: rename d2/d1e/d44/d50/f32 to d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/dd6/f127 0 2024-09-13T18:30:48.768 INFO:tasks.workunit.client.0.smithi038.stdout:2/800: chown d2/d1e/d48/f64 389 1 2024-09-13T18:30:48.768 INFO:tasks.workunit.client.0.smithi038.stdout:3/938: dwrite d0/dd/d17/d50/d5c/d1d/fd9 [0,4194304] 0 2024-09-13T18:30:48.774 INFO:tasks.workunit.client.0.smithi038.stdout:7/857: rmdir db/d12/d1c/d3a/d26/d41/dad/d106/d129/d9b 39 2024-09-13T18:30:48.776 INFO:tasks.workunit.client.0.smithi038.stdout:0/817: symlink d2/d7/d24/d2b/d6d/l10f 0 2024-09-13T18:30:48.779 INFO:tasks.workunit.client.0.smithi038.stdout:0/818: write d2/d7/d24/d2b/f5d [625659,8004] 0 2024-09-13T18:30:48.782 INFO:tasks.workunit.client.0.smithi038.stdout:2/801: symlink d2/d1e/d44/d50/de0/dff/d121/l128 0 2024-09-13T18:30:48.782 INFO:tasks.workunit.client.0.smithi038.stdout:7/858: rmdir db/d12/d13/ded 39 2024-09-13T18:30:48.782 INFO:tasks.workunit.client.0.smithi038.stdout:7/859: fsync db/d12/df0/f114 0 2024-09-13T18:30:48.785 INFO:tasks.workunit.client.0.smithi038.stdout:0/819: unlink d2/d7/d24/d92/d40/d87/dd6/f103 0 2024-09-13T18:30:48.788 INFO:tasks.workunit.client.0.smithi038.stdout:6/871: dwrite dd/de/d2e/d9b/fba [0,4194304] 0 2024-09-13T18:30:48.788 INFO:tasks.workunit.client.0.smithi038.stdout:9/734: rename d0/d7/d2c/fdc to d0/d7/d2c/d33/d4a/dcf/f105 0 2024-09-13T18:30:48.788 INFO:tasks.workunit.client.0.smithi038.stdout:7/860: rename db/d12/d1c/d3a/d26/d41/dad to db/d12/d1c/d3a/d26/d41/dad/d143 22 2024-09-13T18:30:48.788 INFO:tasks.workunit.client.0.smithi038.stdout:9/735: fdatasync d0/d7/d13/f101 0 2024-09-13T18:30:48.788 INFO:tasks.workunit.client.0.smithi038.stdout:9/736: dread - d0/d2e/dc3/ff4 zero size 2024-09-13T18:30:48.788 INFO:tasks.workunit.client.0.smithi038.stdout:7/861: write db/d12/df0/dd4/d28/f115 [639210,32516] 0 2024-09-13T18:30:48.789 INFO:tasks.workunit.client.0.smithi038.stdout:5/886: dwrite df/d15/d36/d67/dbf/d44/d48/d75/f99 [0,4194304] 0 2024-09-13T18:30:48.790 INFO:tasks.workunit.client.0.smithi038.stdout:0/820: creat d2/d7/d24/d92/d40/d87/dd6/d98/da0/de0/f110 x:0 0 0 2024-09-13T18:30:48.795 INFO:tasks.workunit.client.0.smithi038.stdout:2/802: write d2/f126 [666710,1225] 0 2024-09-13T18:30:48.799 INFO:tasks.workunit.client.0.smithi038.stdout:0/821: creat d2/d7/d24/d92/d40/d87/dd6/d98/dc5/d3f/de2/f111 x:0 0 0 2024-09-13T18:30:48.799 INFO:tasks.workunit.client.0.smithi038.stdout:0/822: fsync d2/dc/f108 0 2024-09-13T18:30:48.799 INFO:tasks.workunit.client.0.smithi038.stdout:7/862: dread db/d8e/fa7 [0,4194304] 0 2024-09-13T18:30:48.801 INFO:tasks.workunit.client.0.smithi038.stdout:2/803: truncate d2/d5c/d93/f9c 164328 0 2024-09-13T18:30:48.801 INFO:tasks.workunit.client.0.smithi038.stdout:2/804: creat d2/d1e/d44/d50/d39/d52/d8b/dcb/f129 x:0 0 0 2024-09-13T18:30:48.802 INFO:tasks.workunit.client.0.smithi038.stdout:0/823: rmdir d2/d7/d24/d2b/d6d/da7 39 2024-09-13T18:30:48.802 INFO:tasks.workunit.client.0.smithi038.stdout:0/824: chown d2/d7/d24/d92/d40/d87/dab/fb8 18449270 1 2024-09-13T18:30:48.807 INFO:tasks.workunit.client.0.smithi038.stdout:2/805: mknod d2/d2a/db0/dde/c12a 0 2024-09-13T18:30:48.808 INFO:tasks.workunit.client.0.smithi038.stdout:5/887: dwrite df/d15/d36/d67/dbf/d44/d48/d75/fd8 [0,4194304] 0 2024-09-13T18:30:48.830 INFO:tasks.workunit.client.0.smithi038.stdout:7/863: rmdir db 39 2024-09-13T18:30:48.831 INFO:tasks.workunit.client.0.smithi038.stdout:7/864: dread - db/d12/df0/dd4/d28/fd8 zero size 2024-09-13T18:30:48.831 INFO:tasks.workunit.client.0.smithi038.stdout:7/865: chown db/fb5 788082235 1 2024-09-13T18:30:48.832 INFO:tasks.workunit.client.0.smithi038.stdout:2/806: mknod d2/d1e/d44/d50/d39/d52/d8b/c12b 0 2024-09-13T18:30:48.832 INFO:tasks.workunit.client.0.smithi038.stdout:2/807: chown d2 123 1 2024-09-13T18:30:48.832 INFO:tasks.workunit.client.0.smithi038.stdout:2/808: stat d2/d1e 0 2024-09-13T18:30:48.832 INFO:tasks.workunit.client.0.smithi038.stdout:2/809: chown d2/d1e/d44/d50/d46/d58/f103 74465 1 2024-09-13T18:30:48.832 INFO:tasks.workunit.client.0.smithi038.stdout:2/810: creat d2/d5c/d66/dda/f12c x:0 0 0 2024-09-13T18:30:48.856 INFO:tasks.workunit.client.0.smithi038.stdout:5/888: rename df/d15/d36/d67/dbf/d41/fd1 to df/d15/d36/d67/dbf/d44/d48/f114 0 2024-09-13T18:30:48.861 INFO:tasks.workunit.client.0.smithi038.stdout:0/825: rmdir d2/d7 39 2024-09-13T18:30:48.862 INFO:tasks.workunit.client.0.smithi038.stdout:7/866: symlink db/d12/d1c/d3a/d3c/d8f/l144 0 2024-09-13T18:30:48.863 INFO:tasks.workunit.client.0.smithi038.stdout:2/811: mkdir d2/da/d16/d12d 0 2024-09-13T18:30:48.865 INFO:tasks.workunit.client.0.smithi038.stdout:5/889: rmdir df/d13/d49/d70/df4 0 2024-09-13T18:30:48.867 INFO:tasks.workunit.client.0.smithi038.stdout:7/867: creat db/d12/d1c/d3a/d26/d41/dad/d106/d129/d9b/f145 x:0 0 0 2024-09-13T18:30:48.882 INFO:tasks.workunit.client.0.smithi038.stdout:5/890: dwrite df/d15/d36/d67/dbf/d44/d48/d56/f8b [0,4194304] 0 2024-09-13T18:30:48.888 INFO:tasks.workunit.client.0.smithi038.stdout:2/812: mkdir d2/d1e/d44/d50/d39/d45/d107/d12e 0 2024-09-13T18:30:48.890 INFO:tasks.workunit.client.0.smithi038.stdout:0/826: creat d2/d7/d24/d92/d40/d87/dd6/d98/da0/de0/f112 x:0 0 0 2024-09-13T18:30:48.890 INFO:tasks.workunit.client.0.smithi038.stdout:0/827: read - d2/f96 zero size 2024-09-13T18:30:48.892 INFO:tasks.workunit.client.0.smithi038.stdout:7/868: creat db/d12/df0/f146 x:0 0 0 2024-09-13T18:30:48.892 INFO:tasks.workunit.client.0.smithi038.stdout:7/869: dread - db/d12/d1c/d3a/d26/d41/dad/d106/d129/d9b/f127 zero size 2024-09-13T18:30:48.894 INFO:tasks.workunit.client.0.smithi038.stdout:5/891: rmdir df/d13/d85/d10f 0 2024-09-13T18:30:48.896 INFO:tasks.workunit.client.0.smithi038.stdout:2/813: mknod d2/da/c12f 0 2024-09-13T18:30:48.896 INFO:tasks.workunit.client.0.smithi038.stdout:2/814: dread - d2/d5c/d93/fef zero size 2024-09-13T18:30:48.896 INFO:tasks.workunit.client.0.smithi038.stdout:2/815: stat d2/d1e/c22 0 2024-09-13T18:30:48.896 INFO:tasks.workunit.client.0.smithi038.stdout:2/816: write d2/d5c/d93/fef [260666,96975] 0 2024-09-13T18:30:48.898 INFO:tasks.workunit.client.0.smithi038.stdout:0/828: mkdir d2/d7/d24/d92/d66/d49/dc0/d113 0 2024-09-13T18:30:48.900 INFO:tasks.workunit.client.0.smithi038.stdout:7/870: creat db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/f147 x:0 0 0 2024-09-13T18:30:48.901 INFO:tasks.workunit.client.0.smithi038.stdout:5/892: mknod df/d15/d36/d67/dbf/d44/d58/d9c/df2/c115 0 2024-09-13T18:30:48.901 INFO:tasks.workunit.client.0.smithi038.stdout:5/893: write df/d15/d36/d67/dbf/d44/d48/d75/da7/fbe [4615735,58343] 0 2024-09-13T18:30:48.904 INFO:tasks.workunit.client.0.smithi038.stdout:2/817: link d2/d5c/d66/dda/ff5 d2/d1e/d44/d50/d39/d40/f130 0 2024-09-13T18:30:48.905 INFO:tasks.workunit.client.0.smithi038.stdout:2/818: truncate d2/d5c/d93/d62/fa9 242814 0 2024-09-13T18:30:48.906 INFO:tasks.workunit.client.0.smithi038.stdout:0/829: mkdir d2/d7/d24/d2b/d114 0 2024-09-13T18:30:48.908 INFO:tasks.workunit.client.0.smithi038.stdout:7/871: creat db/d12/df0/dd4/d28/f148 x:0 0 0 2024-09-13T18:30:48.919 INFO:tasks.workunit.client.0.smithi038.stdout:0/830: write d2/d7/d24/d92/d66/d49/fc3 [1380763,49967] 0 2024-09-13T18:30:48.930 INFO:tasks.workunit.client.0.smithi038.stdout:0/831: dread d2/dc/f51 [0,4194304] 0 2024-09-13T18:30:48.931 INFO:tasks.workunit.client.0.smithi038.stdout:0/832: read - d2/d7/d24/f99 zero size 2024-09-13T18:30:48.931 INFO:tasks.workunit.client.0.smithi038.stdout:5/894: dwrite df/d15/d50/f113 [0,4194304] 0 2024-09-13T18:30:48.936 INFO:tasks.workunit.client.0.smithi038.stdout:2/819: dwrite d2/d1e/d44/d50/f9a [0,4194304] 0 2024-09-13T18:30:48.936 INFO:tasks.workunit.client.0.smithi038.stdout:2/820: creat d2/d1e/d44/d50/d46/d58/f131 x:0 0 0 2024-09-13T18:30:48.936 INFO:tasks.workunit.client.0.smithi038.stdout:2/821: write d2/d5c/d66/dda/ff3 [778165,8573] 0 2024-09-13T18:30:48.952 INFO:tasks.workunit.client.0.smithi038.stdout:0/833: dwrite d2/d7/d24/d92/f30 [0,4194304] 0 2024-09-13T18:30:48.952 INFO:tasks.workunit.client.0.smithi038.stdout:0/834: write d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fae [405995,55077] 0 2024-09-13T18:30:48.952 INFO:tasks.workunit.client.0.smithi038.stdout:0/835: chown d2/d7/d24/d92/d66/d81/f83 1996147 1 2024-09-13T18:30:48.958 INFO:tasks.workunit.client.0.smithi038.stdout:2/822: unlink d2/d1e/d44/d50/f2e 0 2024-09-13T18:30:48.959 INFO:tasks.workunit.client.0.smithi038.stdout:0/836: truncate d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f4d 7015 0 2024-09-13T18:30:48.963 INFO:tasks.workunit.client.0.smithi038.stdout:2/823: rename d2/d1e/d44/d50/d39/d40/c11a to d2/d1e/d44/d50/d39/d52/c132 0 2024-09-13T18:30:48.964 INFO:tasks.workunit.client.0.smithi038.stdout:0/837: creat d2/d7/d24/d92/d40/d87/d10d/f115 x:0 0 0 2024-09-13T18:30:48.965 INFO:tasks.workunit.client.0.smithi038.stdout:2/824: creat d2/d1e/d44/d50/d39/d40/ddb/d105/f133 x:0 0 0 2024-09-13T18:30:48.967 INFO:tasks.workunit.client.0.smithi038.stdout:0/838: creat d2/d7/d24/dc7/f116 x:0 0 0 2024-09-13T18:30:48.967 INFO:tasks.workunit.client.0.smithi038.stdout:0/839: write d2/dc/f39 [2585556,65965] 0 2024-09-13T18:30:48.967 INFO:tasks.workunit.client.0.smithi038.stdout:0/840: chown d2/d7/d24/d92/d66/feb 918488 1 2024-09-13T18:30:48.967 INFO:tasks.workunit.client.0.smithi038.stdout:2/825: creat d2/d1e/d48/f134 x:0 0 0 2024-09-13T18:30:48.978 INFO:tasks.workunit.client.0.smithi038.stdout:2/826: write d2/d1e/d44/d50/d46/da6/fd5 [2036868,128906] 0 2024-09-13T18:30:48.980 INFO:tasks.workunit.client.0.smithi038.stdout:2/827: link d2/d1e/d44/d50/d39/d52/f10c d2/d1e/d44/d50/d46/da6/f135 0 2024-09-13T18:30:48.987 INFO:tasks.workunit.client.0.smithi038.stdout:2/828: rename d2/d1e/d44/d50/d39/d40/ddb/d105/f99 to d2/d1e/f136 0 2024-09-13T18:30:48.990 INFO:tasks.workunit.client.0.smithi038.stdout:0/841: dwrite d2/d7/d24/d2b/f43 [0,4194304] 0 2024-09-13T18:30:48.991 INFO:tasks.workunit.client.0.smithi038.stdout:2/829: unlink d2/d1e/d44/d50/d46/da6/f116 0 2024-09-13T18:30:48.991 INFO:tasks.workunit.client.0.smithi038.stdout:2/830: chown d2/f6f 24 1 2024-09-13T18:30:48.993 INFO:tasks.workunit.client.0.smithi038.stdout:0/842: symlink d2/d7/d55/l117 0 2024-09-13T18:30:48.995 INFO:tasks.workunit.client.0.smithi038.stdout:0/843: mkdir d2/d7/d24/d92/d40/d87/dd6/d98/da0/df0/d118 0 2024-09-13T18:30:49.000 INFO:tasks.workunit.client.0.smithi038.stdout:5/895: dwrite df/d15/d36/d67/dbf/d41/f9e [0,4194304] 0 2024-09-13T18:30:49.000 INFO:tasks.workunit.client.0.smithi038.stdout:5/896: stat df/d15/d36/d67/dbf/d44/f101 0 2024-09-13T18:30:49.000 INFO:tasks.workunit.client.0.smithi038.stdout:5/897: stat df/d15/d36/d67/dbf/d44/d48/d56 0 2024-09-13T18:30:49.001 INFO:tasks.workunit.client.0.smithi038.stdout:5/898: write df/d13/d49/d70/fa2 [1265286,95832] 0 2024-09-13T18:30:49.001 INFO:tasks.workunit.client.0.smithi038.stdout:5/899: fsync df/d15/d36/f3c 0 2024-09-13T18:30:49.008 INFO:tasks.workunit.client.0.smithi038.stdout:5/900: getdents df/d15/d50 0 2024-09-13T18:30:49.008 INFO:tasks.workunit.client.0.smithi038.stdout:0/844: read d2/d7/d24/d92/d40/d87/fe5 [4167323,39374] 0 2024-09-13T18:30:49.009 INFO:tasks.workunit.client.0.smithi038.stdout:0/845: dread d2/d7/d24/d92/d40/d87/d8f/fde [0,4194304] 0 2024-09-13T18:30:49.009 INFO:tasks.workunit.client.0.smithi038.stdout:0/846: dread - d2/d7/d24/d2b/d95/fb9 zero size 2024-09-13T18:30:49.009 INFO:tasks.workunit.client.0.smithi038.stdout:0/847: chown d2/d7/d24/d92/da1/lad 119 1 2024-09-13T18:30:49.012 INFO:tasks.workunit.client.0.smithi038.stdout:0/848: mknod d2/d7/d24/d92/da1/c119 0 2024-09-13T18:30:49.013 INFO:tasks.workunit.client.0.smithi038.stdout:2/831: dwrite d2/d5c/d93/fb5 [0,4194304] 0 2024-09-13T18:30:49.019 INFO:tasks.workunit.client.0.smithi038.stdout:0/849: symlink d2/d7/d24/d92/d66/dda/l11a 0 2024-09-13T18:30:49.019 INFO:tasks.workunit.client.0.smithi038.stdout:0/850: chown d2/d7/d24/d92/c5b 60162378 1 2024-09-13T18:30:49.029 INFO:tasks.workunit.client.0.smithi038.stdout:0/851: dread d2/dc/f50 [0,4194304] 0 2024-09-13T18:30:49.034 INFO:tasks.workunit.client.0.smithi038.stdout:0/852: getdents d2/dc/d7f 0 2024-09-13T18:30:49.035 INFO:tasks.workunit.client.0.smithi038.stdout:5/901: dwrite f3 [0,4194304] 0 2024-09-13T18:30:49.038 INFO:tasks.workunit.client.0.smithi038.stdout:0/853: link d2/d7/d24/d2b/f2d d2/d7/d24/d92/d66/dda/d109/f11b 0 2024-09-13T18:30:49.041 INFO:tasks.workunit.client.0.smithi038.stdout:2/832: dwrite d2/fe9 [0,4194304] 0 2024-09-13T18:30:49.041 INFO:tasks.workunit.client.0.smithi038.stdout:2/833: creat d2/d1e/d87/da4/f137 x:0 0 0 2024-09-13T18:30:49.044 INFO:tasks.workunit.client.0.smithi038.stdout:0/854: creat d2/d7/d24/d92/d40/d87/dd6/d98/da0/df0/d10a/f11c x:0 0 0 2024-09-13T18:30:49.044 INFO:tasks.workunit.client.0.smithi038.stdout:0/855: fsync d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f4d 0 2024-09-13T18:30:49.054 INFO:tasks.workunit.client.0.smithi038.stdout:2/834: rename d2/f72 to d2/d5c/f138 0 2024-09-13T18:30:49.054 INFO:tasks.workunit.client.0.smithi038.stdout:2/835: chown d2/d5c/d66/dda/df9 317505 1 2024-09-13T18:30:49.054 INFO:tasks.workunit.client.0.smithi038.stdout:2/836: truncate d2/d1e/d44/d50/d39/d40/ddb/f11d 169831 0 2024-09-13T18:30:49.054 INFO:tasks.workunit.client.0.smithi038.stdout:2/837: fdatasync d2/f34 0 2024-09-13T18:30:49.054 INFO:tasks.workunit.client.0.smithi038.stdout:2/838: creat d2/d1e/d48/f139 x:0 0 0 2024-09-13T18:30:49.060 INFO:tasks.workunit.client.0.smithi038.stdout:5/902: dwrite df/d15/f7e [0,4194304] 0 2024-09-13T18:30:49.064 INFO:tasks.workunit.client.0.smithi038.stdout:0/856: link d2/d7/d24/d92/d66/d81/f83 d2/f11d 0 2024-09-13T18:30:49.078 INFO:tasks.workunit.client.0.smithi038.stdout:5/903: write df/d15/f7e [4607023,26497] 0 2024-09-13T18:30:49.079 INFO:tasks.workunit.client.0.smithi038.stdout:5/904: truncate df/d15/d36/d67/dbf/fff 790479 0 2024-09-13T18:30:49.079 INFO:tasks.workunit.client.0.smithi038.stdout:5/905: truncate fb 5018404 0 2024-09-13T18:30:49.082 INFO:tasks.workunit.client.0.smithi038.stdout:0/857: dwrite d2/d7/d24/d2b/ff3 [0,4194304] 0 2024-09-13T18:30:49.087 INFO:tasks.workunit.client.0.smithi038.stdout:0/858: mknod d2/d7/d24/d92/d66/d49/dc0/c11e 0 2024-09-13T18:30:49.090 INFO:tasks.workunit.client.0.smithi038.stdout:5/906: dread df/d15/f7e [0,4194304] 0 2024-09-13T18:30:49.091 INFO:tasks.workunit.client.0.smithi038.stdout:0/859: creat d2/d7/d24/d2b/dc1/f11f x:0 0 0 2024-09-13T18:30:49.093 INFO:tasks.workunit.client.0.smithi038.stdout:5/907: mknod df/d15/d36/d67/dbf/d44/d82/c116 0 2024-09-13T18:30:49.093 INFO:tasks.workunit.client.0.smithi038.stdout:5/908: chown df/d68/l84 255176971 1 2024-09-13T18:30:49.101 INFO:tasks.workunit.client.0.smithi038.stdout:5/909: write df/d15/d36/d67/dbf/d44/d48/d75/fd8 [3545104,75963] 0 2024-09-13T18:30:49.101 INFO:tasks.workunit.client.0.smithi038.stdout:0/860: rename d2/d7/d24/d2b/dc1 to d2/d7/d24/d92/d40/d87/dd6/d98/d120 0 2024-09-13T18:30:49.125 INFO:tasks.workunit.client.0.smithi038.stdout:5/910: dwrite df/d13/d49/d70/fa2 [0,4194304] 0 2024-09-13T18:30:49.126 INFO:tasks.workunit.client.0.smithi038.stdout:0/861: dwrite d2/d7/d24/d2b/d95/ff8 [0,4194304] 0 2024-09-13T18:30:49.126 INFO:tasks.workunit.client.0.smithi038.stdout:5/911: creat df/d13/dc7/f117 x:0 0 0 2024-09-13T18:30:49.129 INFO:tasks.workunit.client.0.smithi038.stdout:5/912: dread df/d15/d36/d67/dbf/d3e/fc6 [0,4194304] 0 2024-09-13T18:30:49.130 INFO:tasks.workunit.client.0.smithi038.stdout:5/913: write df/d13/d49/d70/fde [13195499,16802] 0 2024-09-13T18:30:49.135 INFO:tasks.workunit.client.0.smithi038.stdout:0/862: symlink d2/d7/d24/d92/d40/d87/dd6/d98/d120/l121 0 2024-09-13T18:30:49.135 INFO:tasks.workunit.client.0.smithi038.stdout:0/863: truncate d2/d7/d24/d92/d40/d87/dd6/d98/da0/df0/d10a/f11c 443966 0 2024-09-13T18:30:49.136 INFO:tasks.workunit.client.0.smithi038.stdout:5/914: symlink df/d15/d36/d67/dbf/d44/d48/d75/da7/l118 0 2024-09-13T18:30:49.142 INFO:tasks.workunit.client.0.smithi038.stdout:0/864: dread d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fd7 [0,4194304] 0 2024-09-13T18:30:49.144 INFO:tasks.workunit.client.0.smithi038.stdout:0/865: mknod d2/d7/d24/d2b/d6d/da7/c122 0 2024-09-13T18:30:49.147 INFO:tasks.workunit.client.0.smithi038.stdout:0/866: getdents d2/dc 0 2024-09-13T18:30:49.150 INFO:tasks.workunit.client.0.smithi038.stdout:0/867: mknod d2/d7/d24/d92/d66/dda/d109/c123 0 2024-09-13T18:30:49.150 INFO:tasks.workunit.client.0.smithi038.stdout:0/868: chown d2/d7/d24/d92/d40/d87/dd6/fa2 2489257 1 2024-09-13T18:30:49.154 INFO:tasks.workunit.client.0.smithi038.stdout:5/915: dwrite df/d13/d49/fd4 [0,4194304] 0 2024-09-13T18:30:49.154 INFO:tasks.workunit.client.0.smithi038.stdout:5/916: creat df/d15/d36/d67/dbf/d44/d58/d9c/f119 x:0 0 0 2024-09-13T18:30:49.157 INFO:tasks.workunit.client.0.smithi038.stdout:0/869: dread d2/d7/d24/d2b/f5d [0,4194304] 0 2024-09-13T18:30:49.157 INFO:tasks.workunit.client.0.smithi038.stdout:0/870: write d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f46 [17114,30304] 0 2024-09-13T18:30:49.157 INFO:tasks.workunit.client.0.smithi038.stdout:0/871: readlink d2/d7/d24/d92/da1/lc8 0 2024-09-13T18:30:49.185 INFO:tasks.workunit.client.0.smithi038.stdout:0/872: dwrite d2/d7/d24/d92/d40/d87/dd6/d98/da0/fb0 [0,4194304] 0 2024-09-13T18:30:49.185 INFO:tasks.workunit.client.0.smithi038.stdout:0/873: chown d2/d7/d24/d92/d40/d87/dd6/d98/l8b 310661 1 2024-09-13T18:30:49.185 INFO:tasks.workunit.client.0.smithi038.stdout:0/874: write d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f53 [1343890,26329] 0 2024-09-13T18:30:49.185 INFO:tasks.workunit.client.0.smithi038.stdout:0/875: fdatasync d2/d7/d24/d92/d66/d81/f93 0 2024-09-13T18:30:49.185 INFO:tasks.workunit.client.0.smithi038.stdout:5/917: dwrite df/d15/d36/f6f [4194304,4194304] 0 2024-09-13T18:30:49.190 INFO:tasks.workunit.client.0.smithi038.stdout:0/876: mknod d2/d7/d55/c124 0 2024-09-13T18:30:49.192 INFO:tasks.workunit.client.0.smithi038.stdout:5/918: dread df/d15/d36/d67/dbf/d3e/fd9 [0,4194304] 0 2024-09-13T18:30:49.196 INFO:tasks.workunit.client.0.smithi038.stdout:0/877: link d2/d7/d24/d92/d40/ff9 d2/d7/d24/d92/d66/d49/dce/f125 0 2024-09-13T18:30:49.196 INFO:tasks.workunit.client.0.smithi038.stdout:0/878: write d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f46 [727606,35364] 0 2024-09-13T18:30:49.198 INFO:tasks.workunit.client.0.smithi038.stdout:5/919: rename df/d15/d36/d67/dbf/d44/d58/fad to df/d13/d49/d9a/f11a 0 2024-09-13T18:30:49.201 INFO:tasks.workunit.client.0.smithi038.stdout:0/879: symlink d2/d7/d24/d92/d40/l126 0 2024-09-13T18:30:49.204 INFO:tasks.workunit.client.0.smithi038.stdout:5/920: link df/d13/d49/d9a/cd2 df/d15/c11b 0 2024-09-13T18:30:49.204 INFO:tasks.workunit.client.0.smithi038.stdout:5/921: fdatasync df/d15/d36/d67/dbf/d44/d58/d9c/f102 0 2024-09-13T18:30:49.206 INFO:tasks.workunit.client.0.smithi038.stdout:0/880: creat d2/d7/d24/d92/f127 x:0 0 0 2024-09-13T18:30:49.207 INFO:tasks.workunit.client.0.smithi038.stdout:5/922: rmdir df/d15/d36/d67/dbf/d44/df7 39 2024-09-13T18:30:49.207 INFO:tasks.workunit.client.0.smithi038.stdout:5/923: fsync df/d15/d36/d67/dbf/d3e/f33 0 2024-09-13T18:30:49.208 INFO:tasks.workunit.client.0.smithi038.stdout:7/872: sync 2024-09-13T18:30:49.209 INFO:tasks.workunit.client.0.smithi038.stdout:9/737: sync 2024-09-13T18:30:49.209 INFO:tasks.workunit.client.0.smithi038.stdout:6/872: sync 2024-09-13T18:30:49.209 INFO:tasks.workunit.client.0.smithi038.stdout:6/873: fsync dd/de/d2e/d2f/f94 0 2024-09-13T18:30:49.209 INFO:tasks.workunit.client.0.smithi038.stdout:0/881: mkdir d2/d7/d24/d92/d66/d49/dce/d128 0 2024-09-13T18:30:49.209 INFO:tasks.workunit.client.0.smithi038.stdout:0/882: truncate d2/d7/d24/d2b/ffe 68711 0 2024-09-13T18:30:49.210 INFO:tasks.workunit.client.0.smithi038.stdout:5/924: rename df/d68/lfe to df/d15/d36/d67/dbf/d44/d48/d9d/l11c 0 2024-09-13T18:30:49.213 INFO:tasks.workunit.client.0.smithi038.stdout:7/873: creat db/f149 x:0 0 0 2024-09-13T18:30:49.216 INFO:tasks.workunit.client.0.smithi038.stdout:9/738: getdents d0/d7/d2c/d6d/de6/df1 0 2024-09-13T18:30:49.216 INFO:tasks.workunit.client.0.smithi038.stdout:9/739: chown d0/d7/d13/d2d/d3e/d70/da2/d86/db6 33 1 2024-09-13T18:30:49.219 INFO:tasks.workunit.client.0.smithi038.stdout:6/874: unlink dd/de/d61/d12e/d83/fde 0 2024-09-13T18:30:49.219 INFO:tasks.workunit.client.0.smithi038.stdout:6/875: chown dd/de/d2e/d30/l8f 2764 1 2024-09-13T18:30:49.219 INFO:tasks.workunit.client.0.smithi038.stdout:6/876: truncate dd/de/d2e/d9b/dbf/d11d/d55/f93 580601 0 2024-09-13T18:30:49.221 INFO:tasks.workunit.client.0.smithi038.stdout:0/883: mknod d2/d7/d24/d92/d40/d87/d8f/c129 0 2024-09-13T18:30:49.226 INFO:tasks.workunit.client.0.smithi038.stdout:5/925: creat df/d15/d36/d67/dbf/d44/f11d x:0 0 0 2024-09-13T18:30:49.226 INFO:tasks.workunit.client.0.smithi038.stdout:5/926: truncate df/d15/d36/d67/dbf/d44/d48/f114 1340614 0 2024-09-13T18:30:49.226 INFO:tasks.workunit.client.0.smithi038.stdout:5/927: readlink df/d13/d49/lf3 0 2024-09-13T18:30:49.227 INFO:tasks.workunit.client.0.smithi038.stdout:5/928: readlink df/d15/d36/d67/dbf/d3e/l112 0 2024-09-13T18:30:49.227 INFO:tasks.workunit.client.0.smithi038.stdout:5/929: dread - df/d15/d36/d67/dbf/d44/d52/db6/dd5/fdb zero size 2024-09-13T18:30:49.227 INFO:tasks.workunit.client.0.smithi038.stdout:9/740: mkdir d0/d7/d13/d2d/d106 0 2024-09-13T18:30:49.229 INFO:tasks.workunit.client.0.smithi038.stdout:0/884: symlink d2/d7/d24/d2b/d95/l12a 0 2024-09-13T18:30:49.241 INFO:tasks.workunit.client.0.smithi038.stdout:5/930: dread df/d15/d36/d67/dbf/d44/d48/d56/f5b [0,4194304] 0 2024-09-13T18:30:49.242 INFO:tasks.workunit.client.0.smithi038.stdout:5/931: creat df/d15/d36/d67/dbf/d44/d48/d9d/dce/f11e x:0 0 0 2024-09-13T18:30:49.243 INFO:tasks.workunit.client.0.smithi038.stdout:5/932: creat df/da5/f11f x:0 0 0 2024-09-13T18:30:49.243 INFO:tasks.workunit.client.0.smithi038.stdout:5/933: chown df/d13/d49/d9a/f11a 1304 1 2024-09-13T18:30:49.244 INFO:tasks.workunit.client.0.smithi038.stdout:5/934: symlink df/d15/d36/d67/dbf/d44/d58/d9c/l120 0 2024-09-13T18:30:49.247 INFO:tasks.workunit.client.0.smithi038.stdout:7/874: dwrite db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/def/f11f [0,4194304] 0 2024-09-13T18:30:49.247 INFO:tasks.workunit.client.0.smithi038.stdout:7/875: chown db/d12/d1c/d3a/d26/d41/dad/l12c 1889 1 2024-09-13T18:30:49.247 INFO:tasks.workunit.client.0.smithi038.stdout:7/876: truncate db/d21/ff7 407157 0 2024-09-13T18:30:49.247 INFO:tasks.workunit.client.0.smithi038.stdout:5/935: getdents df/d15/d36/d67/dbf/d44/d52 0 2024-09-13T18:30:49.247 INFO:tasks.workunit.client.0.smithi038.stdout:5/936: truncate df/d68/fb7 9329358 0 2024-09-13T18:30:49.250 INFO:tasks.workunit.client.0.smithi038.stdout:7/877: rename db/d12/d13/ffd to db/d12/d1c/d3a/d26/d41/dad/d106/f14a 0 2024-09-13T18:30:49.251 INFO:tasks.workunit.client.0.smithi038.stdout:5/937: mknod df/d15/d36/d67/dbf/d44/d48/d9d/c121 0 2024-09-13T18:30:49.254 INFO:tasks.workunit.client.0.smithi038.stdout:7/878: getdents db/d12/df0/dd4/df1 0 2024-09-13T18:30:49.257 INFO:tasks.workunit.client.0.smithi038.stdout:5/938: unlink df/d15/c2e 0 2024-09-13T18:30:49.257 INFO:tasks.workunit.client.0.smithi038.stdout:5/939: dread - df/d13/d85/fbb zero size 2024-09-13T18:30:49.260 INFO:tasks.workunit.client.0.smithi038.stdout:5/940: unlink df/d13/d49/c4c 0 2024-09-13T18:30:49.261 INFO:tasks.workunit.client.0.smithi038.stdout:5/941: chown df/lc8 847 1 2024-09-13T18:30:49.263 INFO:tasks.workunit.client.0.smithi038.stdout:5/942: creat df/d15/d36/d67/dbf/d44/df7/f122 x:0 0 0 2024-09-13T18:30:49.263 INFO:tasks.workunit.client.0.smithi038.stdout:5/943: fsync df/d15/d36/d67/dbf/d44/f101 0 2024-09-13T18:30:49.263 INFO:tasks.workunit.client.0.smithi038.stdout:5/944: creat df/d15/d36/d67/dbf/d44/d82/f123 x:0 0 0 2024-09-13T18:30:49.263 INFO:tasks.workunit.client.0.smithi038.stdout:5/945: truncate df/d15/d36/d67/dbf/d44/d48/d56/f5f 4666537 0 2024-09-13T18:30:49.269 INFO:tasks.workunit.client.0.smithi038.stdout:5/946: creat df/d15/d50/f124 x:0 0 0 2024-09-13T18:30:49.297 INFO:tasks.workunit.client.0.smithi038.stdout:6/877: dwrite dd/de/d2e/d2f/da6/dd9/fe7 [0,4194304] 0 2024-09-13T18:30:49.297 INFO:tasks.workunit.client.0.smithi038.stdout:9/741: dwrite d0/d7/d13/f1e [0,4194304] 0 2024-09-13T18:30:49.299 INFO:tasks.workunit.client.0.smithi038.stdout:6/878: write dd/de/d61/f92 [4562092,3086] 0 2024-09-13T18:30:49.299 INFO:tasks.workunit.client.0.smithi038.stdout:6/879: fsync dd/f32 0 2024-09-13T18:30:49.299 INFO:tasks.workunit.client.0.smithi038.stdout:6/880: chown dd/de/d2e/d99/lfc 7085117 1 2024-09-13T18:30:49.300 INFO:tasks.workunit.client.0.smithi038.stdout:9/742: link d0/d7/d13/d2d/d3c/c68 d0/d7/d2c/d5a/c107 0 2024-09-13T18:30:49.300 INFO:tasks.workunit.client.0.smithi038.stdout:9/743: fdatasync d0/d7/d13/d2d/f6a 0 2024-09-13T18:30:49.301 INFO:tasks.workunit.client.0.smithi038.stdout:6/881: creat dd/de/d2e/d9b/dbf/d11d/d60/ddc/f135 x:0 0 0 2024-09-13T18:30:49.302 INFO:tasks.workunit.client.0.smithi038.stdout:6/882: getdents dd/de/d2e/d9b/dbf/d11d/d55 0 2024-09-13T18:30:49.304 INFO:tasks.workunit.client.0.smithi038.stdout:9/744: link d0/d7/d13/l99 d0/l108 0 2024-09-13T18:30:49.306 INFO:tasks.workunit.client.0.smithi038.stdout:9/745: getdents d0/d7/d2c/d5e/d100 0 2024-09-13T18:30:49.306 INFO:tasks.workunit.client.0.smithi038.stdout:9/746: readlink d0/d7/d13/d2d/d3c/d50/l5f 0 2024-09-13T18:30:49.307 INFO:tasks.workunit.client.0.smithi038.stdout:9/747: truncate d0/d7/d13/d2d/d3c/d50/f65 5073918 0 2024-09-13T18:30:49.307 INFO:tasks.workunit.client.0.smithi038.stdout:7/879: dwrite db/d12/d1c/f79 [0,4194304] 0 2024-09-13T18:30:49.308 INFO:tasks.workunit.client.0.smithi038.stdout:5/947: dwrite fb [0,4194304] 0 2024-09-13T18:30:49.309 INFO:tasks.workunit.client.0.smithi038.stdout:7/880: creat db/d12/d1c/f14b x:0 0 0 2024-09-13T18:30:49.309 INFO:tasks.workunit.client.0.smithi038.stdout:5/948: truncate df/d13/d49/d70/fa2 3579063 0 2024-09-13T18:30:49.312 INFO:tasks.workunit.client.0.smithi038.stdout:7/881: rename db/d12/d13/d43/f4e to db/d12/d1c/d3a/d26/d41/dad/d106/d129/f14c 0 2024-09-13T18:30:49.324 INFO:tasks.workunit.client.0.smithi038.stdout:6/883: dwrite dd/de/d2e/d30/d27/f53 [0,4194304] 0 2024-09-13T18:30:49.324 INFO:tasks.workunit.client.0.smithi038.stdout:6/884: chown dd/df6/ff7 25792 1 2024-09-13T18:30:49.326 INFO:tasks.workunit.client.0.smithi038.stdout:6/885: mkdir dd/de/d2e/d9b/dbf/d11d/d60/ddc/de4/d136 0 2024-09-13T18:30:49.327 INFO:tasks.workunit.client.0.smithi038.stdout:9/748: dwrite d0/d7/d13/d2d/d3c/d50/d94/ff6 [0,4194304] 0 2024-09-13T18:30:49.327 INFO:tasks.workunit.client.0.smithi038.stdout:9/749: read - d0/d7/d13/d2d/d3e/faf zero size 2024-09-13T18:30:49.327 INFO:tasks.workunit.client.0.smithi038.stdout:9/750: chown d0/d7/d13/d2d/d3e/df7 43295 1 2024-09-13T18:30:49.328 INFO:tasks.workunit.client.0.smithi038.stdout:6/886: mknod dd/de/d2e/d9b/dbf/d11d/d86/c137 0 2024-09-13T18:30:49.329 INFO:tasks.workunit.client.0.smithi038.stdout:6/887: write dd/de/d2e/d9b/dbf/d11d/d60/ddc/f135 [452020,58222] 0 2024-09-13T18:30:49.334 INFO:tasks.workunit.client.0.smithi038.stdout:9/751: dread d0/d7/d2c/d5a/d67/d9e/f9b [0,4194304] 0 2024-09-13T18:30:49.334 INFO:tasks.workunit.client.0.smithi038.stdout:7/882: dwrite db/d12/d1c/d3a/d26/d41/dad/fb2 [4194304,4194304] 0 2024-09-13T18:30:49.335 INFO:tasks.workunit.client.0.smithi038.stdout:9/752: creat d0/d2e/d7f/dd3/f109 x:0 0 0 2024-09-13T18:30:49.337 INFO:tasks.workunit.client.0.smithi038.stdout:9/753: dread d0/d7/d2c/f76 [0,4194304] 0 2024-09-13T18:30:49.337 INFO:tasks.workunit.client.0.smithi038.stdout:9/754: readlink d0/d7/d13/l14 0 2024-09-13T18:30:49.338 INFO:tasks.workunit.client.0.smithi038.stdout:6/888: write dd/de/d2e/d30/d27/f53 [3110818,32070] 0 2024-09-13T18:30:49.338 INFO:tasks.workunit.client.0.smithi038.stdout:6/889: chown dd/de/d61/d12e/d83/da5/cb9 287218050 1 2024-09-13T18:30:49.338 INFO:tasks.workunit.client.0.smithi038.stdout:6/890: write f9 [204570,68999] 0 2024-09-13T18:30:49.338 INFO:tasks.workunit.client.0.smithi038.stdout:6/891: readlink l7 0 2024-09-13T18:30:49.338 INFO:tasks.workunit.client.0.smithi038.stdout:9/755: creat d0/d7/d2c/d6d/d9c/f10a x:0 0 0 2024-09-13T18:30:49.359 INFO:tasks.workunit.client.0.smithi038.stdout:6/892: dwrite dd/de/d2e/d30/d27/f53 [0,4194304] 0 2024-09-13T18:30:49.359 INFO:tasks.workunit.client.0.smithi038.stdout:6/893: fsync dd/de/d2e/d9b/dbf/d11d/d55/fc0 0 2024-09-13T18:30:49.359 INFO:tasks.workunit.client.0.smithi038.stdout:6/894: chown c8 16569806 1 2024-09-13T18:30:49.362 INFO:tasks.workunit.client.0.smithi038.stdout:7/883: dwrite db/d12/d1c/d3a/d26/d41/fee [0,4194304] 0 2024-09-13T18:30:49.363 INFO:tasks.workunit.client.0.smithi038.stdout:7/884: creat db/d12/d13/f14d x:0 0 0 2024-09-13T18:30:49.364 INFO:tasks.workunit.client.0.smithi038.stdout:7/885: mkdir db/d12/d13/ded/d14e 0 2024-09-13T18:30:49.364 INFO:tasks.workunit.client.0.smithi038.stdout:7/886: write db/d12/d1c/d3a/d4b/f77 [8497647,5634] 0 2024-09-13T18:30:49.365 INFO:tasks.workunit.client.0.smithi038.stdout:7/887: unlink db/d12/d1c/d3a/d26/d41/dad/d106/d129/d51/f8d 0 2024-09-13T18:30:49.366 INFO:tasks.workunit.client.0.smithi038.stdout:7/888: rmdir db/d12/df0/dd4 39 2024-09-13T18:30:49.372 INFO:tasks.workunit.client.0.smithi038.stdout:6/895: dread dd/de/d2e/f4b [0,4194304] 0 2024-09-13T18:30:49.372 INFO:tasks.workunit.client.0.smithi038.stdout:6/896: truncate dd/de/d2e/d2f/d71/f75 4853524 0 2024-09-13T18:30:49.373 INFO:tasks.workunit.client.0.smithi038.stdout:7/889: dread db/d12/d1c/d3a/d26/d41/dad/d106/d129/d51/f82 [0,4194304] 0 2024-09-13T18:30:49.377 INFO:tasks.workunit.client.0.smithi038.stdout:6/897: rmdir dd/de/d2e/d9b/dbf/d11d/d60/ddc/de4 39 2024-09-13T18:30:49.377 INFO:tasks.workunit.client.0.smithi038.stdout:6/898: readlink dd/de/d2e/l49 0 2024-09-13T18:30:49.377 INFO:tasks.workunit.client.0.smithi038.stdout:6/899: chown dd/de/d2e/d30/f22 507558047 1 2024-09-13T18:30:49.379 INFO:tasks.workunit.client.0.smithi038.stdout:6/900: symlink dd/de/d2e/d2f/da0/l138 0 2024-09-13T18:30:49.380 INFO:tasks.workunit.client.0.smithi038.stdout:6/901: symlink dd/de/d61/da1/l139 0 2024-09-13T18:30:49.388 INFO:tasks.workunit.client.0.smithi038.stdout:6/902: write dd/de/d2e/d9b/dbf/d11d/f4d [190601,52192] 0 2024-09-13T18:30:49.392 INFO:tasks.workunit.client.0.smithi038.stdout:7/890: dwrite db/d12/d1c/d3a/d26/d41/dad/d106/d129/f6c [0,4194304] 0 2024-09-13T18:30:49.397 INFO:tasks.workunit.client.0.smithi038.stdout:7/891: creat db/d21/f14f x:0 0 0 2024-09-13T18:30:49.397 INFO:tasks.workunit.client.0.smithi038.stdout:7/892: fsync db/d12/df0/dd4/d28/f148 0 2024-09-13T18:30:49.397 INFO:tasks.workunit.client.0.smithi038.stdout:7/893: write db/d12/d13/f54 [131975,35661] 0 2024-09-13T18:30:49.397 INFO:tasks.workunit.client.0.smithi038.stdout:7/894: write db/d12/d13/ded/ff4 [393132,80103] 0 2024-09-13T18:30:49.398 INFO:tasks.workunit.client.0.smithi038.stdout:7/895: truncate db/d12/d1c/d3a/d26/d41/dad/d106/d129/d51/f82 1473150 0 2024-09-13T18:30:49.405 INFO:tasks.workunit.client.0.smithi038.stdout:7/896: write db/d12/d1c/d3a/d26/d41/dad/d106/d129/d51/fa2 [2825376,61375] 0 2024-09-13T18:30:49.406 INFO:tasks.workunit.client.0.smithi038.stdout:7/897: mknod db/c150 0 2024-09-13T18:30:49.408 INFO:tasks.workunit.client.0.smithi038.stdout:7/898: symlink db/d12/d1c/d3a/d105/l151 0 2024-09-13T18:30:49.409 INFO:tasks.workunit.client.0.smithi038.stdout:7/899: creat db/d8e/f152 x:0 0 0 2024-09-13T18:30:49.411 INFO:tasks.workunit.client.0.smithi038.stdout:7/900: symlink db/d12/d1c/d3a/l153 0 2024-09-13T18:30:49.412 INFO:tasks.workunit.client.0.smithi038.stdout:7/901: unlink db/d12/df0/dd4/f30 0 2024-09-13T18:30:49.412 INFO:tasks.workunit.client.0.smithi038.stdout:7/902: stat db/d12/d13/ded/l112 0 2024-09-13T18:30:49.412 INFO:tasks.workunit.client.0.smithi038.stdout:7/903: creat db/d21/f154 x:0 0 0 2024-09-13T18:30:49.412 INFO:tasks.workunit.client.0.smithi038.stdout:7/904: chown db/d21/f154 19324667 1 2024-09-13T18:30:49.414 INFO:tasks.workunit.client.0.smithi038.stdout:7/905: rename db/d8e/lec to db/d12/d1c/d3a/d26/d41/dad/l155 0 2024-09-13T18:30:49.414 INFO:tasks.workunit.client.0.smithi038.stdout:7/906: chown db/f14 8 1 2024-09-13T18:30:49.415 INFO:tasks.workunit.client.0.smithi038.stdout:7/907: rename db/d12/c19 to db/d12/d1c/c156 0 2024-09-13T18:30:49.416 INFO:tasks.workunit.client.0.smithi038.stdout:7/908: rename db/d12/d1c/fc2 to db/d12/d1c/f157 0 2024-09-13T18:30:49.417 INFO:tasks.workunit.client.0.smithi038.stdout:7/909: creat db/d12/d1c/d3a/d26/d41/dad/d106/d129/d9b/d13c/f158 x:0 0 0 2024-09-13T18:30:49.417 INFO:tasks.workunit.client.0.smithi038.stdout:7/910: mknod db/d12/df0/dd4/d28/dd3/c159 0 2024-09-13T18:30:49.434 INFO:tasks.workunit.client.0.smithi038.stdout:7/911: dwrite db/d12/df0/fff [0,4194304] 0 2024-09-13T18:30:49.438 INFO:tasks.workunit.client.0.smithi038.stdout:7/912: symlink db/d12/d1c/d3a/d26/d41/dad/d106/d129/d9b/d11d/l15a 0 2024-09-13T18:30:49.439 INFO:tasks.workunit.client.0.smithi038.stdout:7/913: mknod db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/def/c15b 0 2024-09-13T18:30:49.447 INFO:tasks.workunit.client.0.smithi038.stdout:3/939: sync 2024-09-13T18:30:49.459 INFO:tasks.workunit.client.0.smithi038.stdout:7/914: dwrite db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/f122 [4194304,4194304] 0 2024-09-13T18:30:49.465 INFO:tasks.workunit.client.0.smithi038.stdout:3/940: dwrite d0/dd/d17/d50/d5c/d1d/d30/d95/f6a [0,4194304] 0 2024-09-13T18:30:49.486 INFO:tasks.workunit.client.0.smithi038.stdout:3/941: dwrite d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/fb7 [0,4194304] 0 2024-09-13T18:30:49.490 INFO:tasks.workunit.client.0.smithi038.stdout:7/915: truncate db/d12/d1c/d3a/d26/d41/f124 3814458 0 2024-09-13T18:30:49.501 INFO:tasks.workunit.client.0.smithi038.stdout:3/942: dread d0/dd/d17/d43/d89/f5f [0,4194304] 0 2024-09-13T18:30:49.501 INFO:tasks.workunit.client.0.smithi038.stdout:3/943: chown d0/dd/d17/d50/d5c/d1d/fd9 263581 1 2024-09-13T18:30:49.509 INFO:tasks.workunit.client.0.smithi038.stdout:3/944: dread d0/fa [0,4194304] 0 2024-09-13T18:30:49.509 INFO:tasks.workunit.client.0.smithi038.stdout:3/945: chown d0/dd/d17/d50/d5c/d1d/dcb/ffa 319013 1 2024-09-13T18:30:49.509 INFO:tasks.workunit.client.0.smithi038.stdout:3/946: fdatasync d0/dd/d17/d50/d5c/d23/d52/f10f 0 2024-09-13T18:30:49.518 INFO:tasks.workunit.client.0.smithi038.stdout:2/839: sync 2024-09-13T18:30:49.518 INFO:tasks.workunit.client.0.smithi038.stdout:2/840: dread - d2/d1e/d44/d50/d39/d52/d8b/dcb/fed zero size 2024-09-13T18:30:49.520 INFO:tasks.workunit.client.0.smithi038.stdout:3/947: write d0/dd/d17/d50/d5c/d1d/d30/f77 [7823322,50502] 0 2024-09-13T18:30:49.520 INFO:tasks.workunit.client.0.smithi038.stdout:7/916: dwrite db/d12/f134 [0,4194304] 0 2024-09-13T18:30:49.520 INFO:tasks.workunit.client.0.smithi038.stdout:7/917: write db/d12/d1c/ff9 [559395,55354] 0 2024-09-13T18:30:49.521 INFO:tasks.workunit.client.0.smithi038.stdout:2/841: truncate d2/f37 4184258 0 2024-09-13T18:30:49.522 INFO:tasks.workunit.client.0.smithi038.stdout:3/948: creat d0/dd/d17/d50/d125/f126 x:0 0 0 2024-09-13T18:30:49.523 INFO:tasks.workunit.client.0.smithi038.stdout:7/918: getdents db/d12/d1c/d3a 0 2024-09-13T18:30:49.528 INFO:tasks.workunit.client.0.smithi038.stdout:2/842: rename d2/d125/fe8 to d2/d1e/d44/d50/d39/d45/f13a 0 2024-09-13T18:30:49.530 INFO:tasks.workunit.client.0.smithi038.stdout:3/949: symlink d0/dd/d17/d50/d5c/d1d/d30/d95/da6/l127 0 2024-09-13T18:30:49.537 INFO:tasks.workunit.client.0.smithi038.stdout:3/950: creat d0/dd/d17/d50/d5c/d23/d7c/f128 x:0 0 0 2024-09-13T18:30:49.542 INFO:tasks.workunit.client.0.smithi038.stdout:2/843: getdents d2/d1e/d44/d50/d39/d52/d8b/dcb 0 2024-09-13T18:30:49.542 INFO:tasks.workunit.client.0.smithi038.stdout:2/844: creat d2/d1e/d44/d50/d39/f13b x:0 0 0 2024-09-13T18:30:49.548 INFO:tasks.workunit.client.0.smithi038.stdout:3/951: rename d0/dd/d17/d79/f7f to d0/dd/d17/d50/d5c/d1d/dcc/f129 0 2024-09-13T18:30:49.548 INFO:tasks.workunit.client.0.smithi038.stdout:3/952: chown d0/dd/d17/d50/d5c/d110 641418 1 2024-09-13T18:30:49.554 INFO:tasks.workunit.client.0.smithi038.stdout:2/845: link d2/d5c/dea/ff6 d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d10b/f13c 0 2024-09-13T18:30:49.554 INFO:tasks.workunit.client.0.smithi038.stdout:2/846: chown d2/da/d16/f24 20015 1 2024-09-13T18:30:49.557 INFO:tasks.workunit.client.0.smithi038.stdout:3/953: getdents d0/dd/d17/d43/d89/db3 0 2024-09-13T18:30:49.560 INFO:tasks.workunit.client.0.smithi038.stdout:3/954: symlink d0/dd/d17/d50/d5c/d23/l12a 0 2024-09-13T18:30:49.563 INFO:tasks.workunit.client.0.smithi038.stdout:3/955: symlink d0/dd/d17/d50/d5c/d23/d52/l12b 0 2024-09-13T18:30:49.573 INFO:tasks.workunit.client.0.smithi038.stdout:3/956: rmdir d0/dd/d17/d50/d5c/d23/d7c 39 2024-09-13T18:30:49.573 INFO:tasks.workunit.client.0.smithi038.stdout:3/957: chown d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/l8f 1975378 1 2024-09-13T18:30:49.576 INFO:tasks.workunit.client.0.smithi038.stdout:3/958: mkdir d0/dd/d17/d50/d5c/d23/d7c/d9c/d12c 0 2024-09-13T18:30:49.576 INFO:tasks.workunit.client.0.smithi038.stdout:3/959: dread d0/dd/d17/d79/ffd [0,4194304] 0 2024-09-13T18:30:49.576 INFO:tasks.workunit.client.0.smithi038.stdout:3/960: fsync d0/dd/d17/d50/d5c/d23/d52/f10f 0 2024-09-13T18:30:49.579 INFO:tasks.workunit.client.0.smithi038.stdout:3/961: mknod d0/dd/d17/d50/d5c/d23/d7c/c12d 0 2024-09-13T18:30:49.581 INFO:tasks.workunit.client.0.smithi038.stdout:3/962: rename d0/dd/d17/d50/d5c/fbf to d0/dd/d17/d11c/f12e 0 2024-09-13T18:30:49.604 INFO:tasks.workunit.client.0.smithi038.stdout:3/963: dwrite d0/dd/d17/d50/d5c/d1d/dcc/f129 [4194304,4194304] 0 2024-09-13T18:30:49.604 INFO:tasks.workunit.client.0.smithi038.stdout:3/964: chown d0/dd/d17/d50/lc5 1502146 1 2024-09-13T18:30:49.606 INFO:tasks.workunit.client.0.smithi038.stdout:3/965: getdents d0/dd 0 2024-09-13T18:30:49.613 INFO:tasks.workunit.client.0.smithi038.stdout:3/966: dread d0/dd/d17/d50/d5c/d23/fc1 [0,4194304] 0 2024-09-13T18:30:49.613 INFO:tasks.workunit.client.0.smithi038.stdout:3/967: fsync d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/f7b 0 2024-09-13T18:30:49.614 INFO:tasks.workunit.client.0.smithi038.stdout:3/968: symlink d0/dd/d17/d50/d5c/d1d/dcb/l12f 0 2024-09-13T18:30:49.618 INFO:tasks.workunit.client.0.smithi038.stdout:3/969: rename d0/dd/d17/d43/d89/cb9 to d0/dd/d17/d50/d5c/d23/d6b/d103/c130 0 2024-09-13T18:30:49.618 INFO:tasks.workunit.client.0.smithi038.stdout:3/970: chown d0/dd/d17/d79/cbb 60 1 2024-09-13T18:30:49.620 INFO:tasks.workunit.client.0.smithi038.stdout:3/971: symlink d0/dd/d17/d79/l131 0 2024-09-13T18:30:49.960 INFO:tasks.workunit.client.0.smithi038.stdout:0/885: sync 2024-09-13T18:30:49.960 INFO:tasks.workunit.client.0.smithi038.stdout:0/886: creat d2/d7/d24/d92/d40/d87/dd6/d98/f12b x:0 0 0 2024-09-13T18:30:49.961 INFO:tasks.workunit.client.0.smithi038.stdout:0/887: symlink d2/d7/d24/d2b/d114/l12c 0 2024-09-13T18:30:49.963 INFO:tasks.workunit.client.0.smithi038.stdout:0/888: dread d2/d7/d55/fcf [0,4194304] 0 2024-09-13T18:30:49.964 INFO:tasks.workunit.client.0.smithi038.stdout:0/889: unlink d2/d7/d55/l117 0 2024-09-13T18:30:49.964 INFO:tasks.workunit.client.0.smithi038.stdout:0/890: chown d2/d7/d24/d92/d66/feb 23 1 2024-09-13T18:30:49.965 INFO:tasks.workunit.client.0.smithi038.stdout:0/891: dread - d2/d7/d24/d92/d40/d87/dd6/d98/ffb zero size 2024-09-13T18:30:49.965 INFO:tasks.workunit.client.0.smithi038.stdout:0/892: fdatasync d2/d7/d24/d92/d40/d87/dd6/d98/da0/ff5 0 2024-09-13T18:30:49.966 INFO:tasks.workunit.client.0.smithi038.stdout:0/893: creat d2/d7/d24/d2b/f12d x:0 0 0 2024-09-13T18:30:49.966 INFO:tasks.workunit.client.0.smithi038.stdout:0/894: truncate d2/d7/d24/d92/d66/d81/f105 508277 0 2024-09-13T18:30:49.974 INFO:tasks.workunit.client.0.smithi038.stdout:0/895: dread d2/d7/d24/d92/d40/d87/dd6/d98/da0/fb0 [0,4194304] 0 2024-09-13T18:30:49.993 INFO:tasks.workunit.client.0.smithi038.stdout:0/896: dwrite d2/d7/d24/d2b/f12d [0,4194304] 0 2024-09-13T18:30:49.996 INFO:tasks.workunit.client.0.smithi038.stdout:0/897: symlink d2/d7/d24/d92/d40/d87/dd6/d98/da0/de0/l12e 0 2024-09-13T18:30:49.997 INFO:tasks.workunit.client.0.smithi038.stdout:0/898: rmdir d2/d7/d24/d92/d40 39 2024-09-13T18:30:50.013 INFO:tasks.workunit.client.0.smithi038.stdout:0/899: dwrite d2/d7/d24/d92/d40/d87/dd6/d98/f12b [0,4194304] 0 2024-09-13T18:30:50.016 INFO:tasks.workunit.client.0.smithi038.stdout:0/900: symlink d2/d7/d24/d92/d40/d87/dd6/d98/da0/df0/d118/l12f 0 2024-09-13T18:30:50.016 INFO:tasks.workunit.client.0.smithi038.stdout:0/901: truncate d2/f96 643797 0 2024-09-13T18:30:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:49 smithi149 ceph-mon[35845]: pgmap v27: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 196 MiB/s rd, 242 MiB/s wr, 435 op/s 2024-09-13T18:30:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:49 smithi149 ceph-mon[35845]: Upgrade: Updating mgr.smithi038.jeygoq 2024-09-13T18:30:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:49 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:49 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.jeygoq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:30:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:49 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.jeygoq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:30:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:49 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:30:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:49 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:30:50.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:49 smithi149 ceph-mon[35845]: Deploying daemon mgr.smithi038.jeygoq on smithi038 2024-09-13T18:30:50.025 INFO:tasks.workunit.client.0.smithi038.stdout:0/902: dread d2/d7/d24/d92/fcc [0,4194304] 0 2024-09-13T18:30:50.026 INFO:tasks.workunit.client.0.smithi038.stdout:0/903: dread d2/d7/d24/d2b/ffe [0,4194304] 0 2024-09-13T18:30:50.028 INFO:tasks.workunit.client.0.smithi038.stdout:0/904: mknod d2/d7/d24/d92/d66/d49/dc0/c130 0 2024-09-13T18:30:50.028 INFO:tasks.workunit.client.0.smithi038.stdout:0/905: write d2/d7/d55/fe8 [409699,20641] 0 2024-09-13T18:30:50.028 INFO:tasks.workunit.client.0.smithi038.stdout:0/906: write d2/d7/d24/d92/d66/d49/fc3 [229558,76638] 0 2024-09-13T18:30:50.037 INFO:tasks.workunit.client.0.smithi038.stdout:0/907: dread d2/d7/d24/d92/d66/d81/f93 [0,4194304] 0 2024-09-13T18:30:50.044 INFO:tasks.workunit.client.0.smithi038.stdout:0/908: write d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fb3 [2167055,50872] 0 2024-09-13T18:30:50.044 INFO:tasks.workunit.client.0.smithi038.stdout:0/909: write d2/d7/d24/d92/d40/d87/dd6/d98/fba [234755,55422] 0 2024-09-13T18:30:50.045 INFO:tasks.workunit.client.0.smithi038.stdout:0/910: getdents d2/d7/d24/d92/d40/d87/dd6/d98/da0/df0 0 2024-09-13T18:30:50.046 INFO:tasks.workunit.client.0.smithi038.stdout:0/911: truncate d2/d7/d24/d2b/f5d 1542588 0 2024-09-13T18:30:50.049 INFO:tasks.workunit.client.0.smithi038.stdout:0/912: rename d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fd7 to d2/d7/d24/d92/d66/d49/dc0/d113/f131 0 2024-09-13T18:30:50.049 INFO:tasks.workunit.client.0.smithi038.stdout:0/913: rename d2/d7 to d2/d7/d24/d2b/db6/d132 22 2024-09-13T18:30:50.049 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:49 smithi038 ceph-mon[27689]: pgmap v27: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 196 MiB/s rd, 242 MiB/s wr, 435 op/s 2024-09-13T18:30:50.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:49 smithi038 ceph-mon[27689]: Upgrade: Updating mgr.smithi038.jeygoq 2024-09-13T18:30:50.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:49 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:50.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:49 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.jeygoq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:30:50.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:49 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi038.jeygoq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:30:50.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:49 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:30:50.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:49 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:30:50.050 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:49 smithi038 ceph-mon[27689]: Deploying daemon mgr.smithi038.jeygoq on smithi038 2024-09-13T18:30:50.052 INFO:tasks.workunit.client.0.smithi038.stdout:0/914: link d2/d7/d24/d92/d40/d87/dd6/d98/dc5/fb3 d2/dc/f133 0 2024-09-13T18:30:50.061 INFO:tasks.workunit.client.0.smithi038.stdout:0/915: creat d2/d7/d55/f134 x:0 0 0 2024-09-13T18:30:50.062 INFO:tasks.workunit.client.0.smithi038.stdout:0/916: symlink d2/d7/d24/d92/d40/d87/dd6/d98/d120/db7/l135 0 2024-09-13T18:30:50.062 INFO:tasks.workunit.client.0.smithi038.stdout:0/917: write d2/d7/d24/d92/d40/d87/dd6/d98/da0/de0/f110 [124005,99694] 0 2024-09-13T18:30:50.075 INFO:tasks.workunit.client.0.smithi038.stdout:7/919: sync 2024-09-13T18:30:50.075 INFO:tasks.workunit.client.0.smithi038.stdout:7/920: fdatasync db/d12/d1c/d3a/d26/d41/dad/d106/d129/d51/f97 0 2024-09-13T18:30:50.076 INFO:tasks.workunit.client.0.smithi038.stdout:7/921: rmdir db/d12/d1c/d3a/d3c 39 2024-09-13T18:30:50.077 INFO:tasks.workunit.client.0.smithi038.stdout:7/922: readlink db/d12/d1c/d3a/d26/d41/dad/d106/d129/d9b/l138 0 2024-09-13T18:30:50.077 INFO:tasks.workunit.client.0.smithi038.stdout:7/923: stat db/d12/d1c/d3a/d3c/d8f/ld1 0 2024-09-13T18:30:50.077 INFO:tasks.workunit.client.0.smithi038.stdout:7/924: chown db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/f147 1179 1 2024-09-13T18:30:50.077 INFO:tasks.workunit.client.0.smithi038.stdout:7/925: rmdir db/d12/d1c/d3a/d26/d41 39 2024-09-13T18:30:50.078 INFO:tasks.workunit.client.0.smithi038.stdout:6/903: sync 2024-09-13T18:30:50.078 INFO:tasks.workunit.client.0.smithi038.stdout:3/972: sync 2024-09-13T18:30:50.079 INFO:tasks.workunit.client.0.smithi038.stdout:2/847: sync 2024-09-13T18:30:50.079 INFO:tasks.workunit.client.0.smithi038.stdout:5/949: sync 2024-09-13T18:30:50.079 INFO:tasks.workunit.client.0.smithi038.stdout:9/756: sync 2024-09-13T18:30:50.079 INFO:tasks.workunit.client.0.smithi038.stdout:2/848: chown d2/d1e/d44/d50/d39/d40/ddb/d105/f133 9 1 2024-09-13T18:30:50.079 INFO:tasks.workunit.client.0.smithi038.stdout:2/849: dread d2/d1e/d44/d50/d39/d40/ddb/f11d [0,4194304] 0 2024-09-13T18:30:50.080 INFO:tasks.workunit.client.0.smithi038.stdout:6/904: truncate dd/f16 456170 0 2024-09-13T18:30:50.080 INFO:tasks.workunit.client.0.smithi038.stdout:2/850: dread d2/da/d74/f88 [0,4194304] 0 2024-09-13T18:30:50.083 INFO:tasks.workunit.client.0.smithi038.stdout:6/905: rename dd/de/d2e/d2f/d71/dc5/cd8 to dd/df6/d122/c13a 0 2024-09-13T18:30:50.084 INFO:tasks.workunit.client.0.smithi038.stdout:7/926: dread db/d12/d1c/ff9 [0,4194304] 0 2024-09-13T18:30:50.084 INFO:tasks.workunit.client.0.smithi038.stdout:9/757: rmdir d0/d7/d13/d2d/d3c/dc9 39 2024-09-13T18:30:50.086 INFO:tasks.workunit.client.0.smithi038.stdout:2/851: mkdir d2/d5c/d66/dda/d13d 0 2024-09-13T18:30:50.091 INFO:tasks.workunit.client.0.smithi038.stdout:2/852: getdents d2/d5c/d93/d62 0 2024-09-13T18:30:50.091 INFO:tasks.workunit.client.0.smithi038.stdout:2/853: fsync d2/fd0 0 2024-09-13T18:30:50.091 INFO:tasks.workunit.client.0.smithi038.stdout:2/854: write d2/da/f36 [2757200,125836] 0 2024-09-13T18:30:50.093 INFO:tasks.workunit.client.0.smithi038.stdout:0/918: dwrite d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f56 [4194304,4194304] 0 2024-09-13T18:30:50.093 INFO:tasks.workunit.client.0.smithi038.stdout:0/919: creat d2/d7/d24/d92/d40/d87/dd6/d98/f136 x:0 0 0 2024-09-13T18:30:50.093 INFO:tasks.workunit.client.0.smithi038.stdout:0/920: readlink d2/d7/d24/l82 0 2024-09-13T18:30:50.093 INFO:tasks.workunit.client.0.smithi038.stdout:3/973: write d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/fb7 [500772,124494] 0 2024-09-13T18:30:50.093 INFO:tasks.workunit.client.0.smithi038.stdout:3/974: chown d0/dd/d17/d79/dd5/fb0 1830532 1 2024-09-13T18:30:50.094 INFO:tasks.workunit.client.0.smithi038.stdout:2/855: unlink d2/d1e/d87/ldc 0 2024-09-13T18:30:50.096 INFO:tasks.workunit.client.0.smithi038.stdout:0/921: link d2/dc/f28 d2/d7/d24/d92/d40/d87/dd6/d98/da0/dcb/f137 0 2024-09-13T18:30:50.096 INFO:tasks.workunit.client.0.smithi038.stdout:2/856: dread d2/d5c/d93/fef [0,4194304] 0 2024-09-13T18:30:50.097 INFO:tasks.workunit.client.0.smithi038.stdout:3/975: rename d0/dd/d17/d50/d5c/d23/d7c/f128 to d0/dd/d17/d50/d5c/d23/d52/f132 0 2024-09-13T18:30:50.102 INFO:tasks.workunit.client.0.smithi038.stdout:9/758: write d0/d7/d13/f66 [1679397,18623] 0 2024-09-13T18:30:50.102 INFO:tasks.workunit.client.0.smithi038.stdout:0/922: truncate d2/d7/d24/d92/d40/d87/dd6/d98/d120/db7/fc9 2572462 0 2024-09-13T18:30:50.103 INFO:tasks.workunit.client.0.smithi038.stdout:3/976: creat d0/dd/d17/d50/d5c/d23/d7c/f133 x:0 0 0 2024-09-13T18:30:50.107 INFO:tasks.workunit.client.0.smithi038.stdout:7/927: write db/d12/d13/f1b [656033,94495] 0 2024-09-13T18:30:50.107 INFO:tasks.workunit.client.0.smithi038.stdout:7/928: fdatasync db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/f122 0 2024-09-13T18:30:50.107 INFO:tasks.workunit.client.0.smithi038.stdout:3/977: dread d0/dd/d17/d50/d5c/d1d/d30/fcd [0,4194304] 0 2024-09-13T18:30:50.108 INFO:tasks.workunit.client.0.smithi038.stdout:5/950: dwrite df/d15/d50/f113 [0,4194304] 0 2024-09-13T18:30:50.109 INFO:tasks.workunit.client.0.smithi038.stdout:6/906: dwrite dd/de/d2e/d99/f111 [0,4194304] 0 2024-09-13T18:30:50.111 INFO:tasks.workunit.client.0.smithi038.stdout:9/759: read d0/d7/d2c/d6d/d9c/fe5 [33338,16007] 0 2024-09-13T18:30:50.112 INFO:tasks.workunit.client.0.smithi038.stdout:7/929: mkdir db/d12/d13/ded/d15c 0 2024-09-13T18:30:50.113 INFO:tasks.workunit.client.0.smithi038.stdout:3/978: symlink d0/dd/d17/d50/d125/l134 0 2024-09-13T18:30:50.116 INFO:tasks.workunit.client.0.smithi038.stdout:5/951: creat df/d15/d36/d67/f125 x:0 0 0 2024-09-13T18:30:50.116 INFO:tasks.workunit.client.0.smithi038.stdout:5/952: creat df/d15/d36/d67/dbf/d44/d58/dd6/f126 x:0 0 0 2024-09-13T18:30:50.158 INFO:tasks.workunit.client.0.smithi038.stdout:0/923: symlink d2/l138 0 2024-09-13T18:30:50.164 INFO:tasks.workunit.client.0.smithi038.stdout:3/979: truncate d0/dd/d17/d50/d5c/f47 67140 0 2024-09-13T18:30:50.170 INFO:tasks.workunit.client.0.smithi038.stdout:5/953: symlink df/d15/d36/d67/dbf/d44/d58/d9c/l127 0 2024-09-13T18:30:50.187 INFO:tasks.workunit.client.0.smithi038.stdout:7/930: symlink db/d12/d1c/d3a/d26/l15d 0 2024-09-13T18:30:50.217 INFO:tasks.workunit.client.0.smithi038.stdout:6/907: mknod dd/de/d2e/d2f/da6/c13b 0 2024-09-13T18:30:50.249 INFO:tasks.workunit.client.0.smithi038.stdout:0/924: mkdir d2/dc/d139 0 2024-09-13T18:30:50.251 INFO:tasks.workunit.client.0.smithi038.stdout:3/980: link d0/dd/d17/d50/d5c/f55 d0/dd/d17/d50/d5c/d1d/d30/d95/da6/f135 0 2024-09-13T18:30:50.252 INFO:tasks.workunit.client.0.smithi038.stdout:5/954: write df/d15/d36/d67/dbf/d44/d48/d75/f8f [1536479,23783] 0 2024-09-13T18:30:50.255 INFO:tasks.workunit.client.0.smithi038.stdout:6/908: mkdir dd/d13c 0 2024-09-13T18:30:50.255 INFO:tasks.workunit.client.0.smithi038.stdout:6/909: read dd/de/d2e/d9b/dbf/d11d/d86/f108 [680537,105923] 0 2024-09-13T18:30:50.257 INFO:tasks.workunit.client.0.smithi038.stdout:0/925: truncate d2/d7/f9 341354 0 2024-09-13T18:30:50.257 INFO:tasks.workunit.client.0.smithi038.stdout:0/926: write d2/d7/d24/d92/d40/d87/dd6/d98/da0/de0/f110 [996104,79423] 0 2024-09-13T18:30:50.259 INFO:tasks.workunit.client.0.smithi038.stdout:3/981: dread d0/dd/d17/d79/f87 [4194304,4194304] 0 2024-09-13T18:30:50.261 INFO:tasks.workunit.client.0.smithi038.stdout:5/955: dread df/d15/d36/d67/dbf/d44/d48/d75/f8f [0,4194304] 0 2024-09-13T18:30:50.261 INFO:tasks.workunit.client.0.smithi038.stdout:5/956: chown df/d13/d49/fd4 53 1 2024-09-13T18:30:50.265 INFO:tasks.workunit.client.0.smithi038.stdout:6/910: write dd/de/d61/fd2 [2541611,93844] 0 2024-09-13T18:30:50.265 INFO:tasks.workunit.client.0.smithi038.stdout:6/911: fdatasync dd/f32 0 2024-09-13T18:30:50.265 INFO:tasks.workunit.client.0.smithi038.stdout:5/957: dread df/d15/d36/d67/dbf/d44/d48/d75/fd7 [0,4194304] 0 2024-09-13T18:30:50.266 INFO:tasks.workunit.client.0.smithi038.stdout:5/958: write df/d15/d36/d67/dbf/d44/d58/d94/fe4 [879362,89226] 0 2024-09-13T18:30:50.270 INFO:tasks.workunit.client.0.smithi038.stdout:3/982: write d0/dd/f5e [3370773,123309] 0 2024-09-13T18:30:50.271 INFO:tasks.workunit.client.0.smithi038.stdout:5/959: creat df/d13/f128 x:0 0 0 2024-09-13T18:30:50.282 INFO:tasks.workunit.client.0.smithi038.stdout:0/927: dwrite d2/d7/d24/d92/da1/fbb [0,4194304] 0 2024-09-13T18:30:50.282 INFO:tasks.workunit.client.0.smithi038.stdout:0/928: write d2/d7/d55/f73 [1649304,54841] 0 2024-09-13T18:30:50.283 INFO:tasks.workunit.client.0.smithi038.stdout:0/929: truncate d2/d7/d55/f9c 430757 0 2024-09-13T18:30:50.285 INFO:tasks.workunit.client.0.smithi038.stdout:3/983: dread d0/dd/d17/d43/f45 [0,4194304] 0 2024-09-13T18:30:50.288 INFO:tasks.workunit.client.0.smithi038.stdout:5/960: write f1 [97679,91565] 0 2024-09-13T18:30:50.288 INFO:tasks.workunit.client.0.smithi038.stdout:3/984: getdents d0/dd/d17/d50/d5c/d23/d52/d6e/d9d/deb 0 2024-09-13T18:30:50.289 INFO:tasks.workunit.client.0.smithi038.stdout:6/912: dwrite dd/de/d2e/d9b/dbf/d11d/d60/fda [0,4194304] 0 2024-09-13T18:30:50.289 INFO:tasks.workunit.client.0.smithi038.stdout:6/913: chown dd/de/d2e/d9b/dbf/d11d/d86 1076 1 2024-09-13T18:30:50.289 INFO:tasks.workunit.client.0.smithi038.stdout:6/914: stat dd/de/d2e/c3a 0 2024-09-13T18:30:50.289 INFO:tasks.workunit.client.0.smithi038.stdout:6/915: write dd/de/d2e/d2f/d71/fa4 [311525,113328] 0 2024-09-13T18:30:50.299 INFO:tasks.workunit.client.0.smithi038.stdout:3/985: unlink d0/dd/d17/d79/dd5/d105/l106 0 2024-09-13T18:30:50.300 INFO:tasks.workunit.client.0.smithi038.stdout:6/916: mknod dd/de/d2e/d9b/dbf/d11d/c13d 0 2024-09-13T18:30:50.300 INFO:tasks.workunit.client.0.smithi038.stdout:6/917: stat dd/de/d2e/f67 0 2024-09-13T18:30:50.301 INFO:tasks.workunit.client.0.smithi038.stdout:6/918: chown dd/de/d2e/d30/d27/f53 364726 1 2024-09-13T18:30:50.302 INFO:tasks.workunit.client.0.smithi038.stdout:0/930: dwrite d2/dc/f51 [0,4194304] 0 2024-09-13T18:30:50.302 INFO:tasks.workunit.client.0.smithi038.stdout:0/931: fdatasync d2/dc/f14 0 2024-09-13T18:30:50.303 INFO:tasks.workunit.client.0.smithi038.stdout:3/986: mknod d0/dd/d17/d79/dd5/d105/c136 0 2024-09-13T18:30:50.308 INFO:tasks.workunit.client.0.smithi038.stdout:0/932: truncate d2/d7/d24/d92/d66/f85 3713372 0 2024-09-13T18:30:50.308 INFO:tasks.workunit.client.0.smithi038.stdout:0/933: chown d2/d7/d24/d92/d66/d49/cef 21 1 2024-09-13T18:30:50.308 INFO:tasks.workunit.client.0.smithi038.stdout:0/934: write d2/d7/d24/d2b/f37 [3484236,10195] 0 2024-09-13T18:30:50.308 INFO:tasks.workunit.client.0.smithi038.stdout:0/935: chown d2/d7/d55/f73 118518615 1 2024-09-13T18:30:50.313 INFO:tasks.workunit.client.0.smithi038.stdout:7/931: creat db/d12/df0/dd4/d28/f15e x:0 0 0 2024-09-13T18:30:50.316 INFO:tasks.workunit.client.0.smithi038.stdout:7/932: symlink db/d12/d1c/d3a/l15f 0 2024-09-13T18:30:50.317 INFO:tasks.workunit.client.0.smithi038.stdout:6/919: dwrite dd/de/d2e/d9b/dbf/d11d/d86/f10c [0,4194304] 0 2024-09-13T18:30:50.317 INFO:tasks.workunit.client.0.smithi038.stdout:7/933: stat db/d21/f111 0 2024-09-13T18:30:50.330 INFO:tasks.workunit.client.0.smithi038.stdout:6/920: rmdir dd/de/d31/dca 39 2024-09-13T18:30:50.331 INFO:tasks.workunit.client.0.smithi038.stdout:6/921: stat dd/de/d2e/d104/l116 0 2024-09-13T18:30:50.331 INFO:tasks.workunit.client.0.smithi038.stdout:3/987: creat d0/f137 x:0 0 0 2024-09-13T18:30:50.332 INFO:tasks.workunit.client.0.smithi038.stdout:3/988: rmdir d0/dd/d17/d43/d89 39 2024-09-13T18:30:50.334 INFO:tasks.workunit.client.0.smithi038.stdout:7/934: dwrite db/d12/d1c/d3a/d26/d41/dad/d106/d129/d51/fa2 [0,4194304] 0 2024-09-13T18:30:50.334 INFO:tasks.workunit.client.0.smithi038.stdout:3/989: creat d0/dd/d17/d50/d5c/d110/f138 x:0 0 0 2024-09-13T18:30:50.338 INFO:tasks.workunit.client.0.smithi038.stdout:5/961: mkdir df/d15/d129 0 2024-09-13T18:30:50.339 INFO:tasks.workunit.client.0.smithi038.stdout:5/962: symlink df/d15/d36/d67/dbf/d44/d58/d9c/df2/l12a 0 2024-09-13T18:30:50.340 INFO:tasks.workunit.client.0.smithi038.stdout:5/963: rename df/d15/d36/d67/dbf/d44/d48/d56/c8e to df/d13/dc7/c12b 0 2024-09-13T18:30:50.341 INFO:tasks.workunit.client.0.smithi038.stdout:5/964: unlink df/d15/d36/f3c 0 2024-09-13T18:30:50.346 INFO:tasks.workunit.client.0.smithi038.stdout:6/922: dread dd/de/d2e/f64 [0,4194304] 0 2024-09-13T18:30:50.348 INFO:tasks.workunit.client.0.smithi038.stdout:6/923: mknod dd/de/d61/c13e 0 2024-09-13T18:30:50.349 INFO:tasks.workunit.client.0.smithi038.stdout:6/924: creat dd/de/d2e/d30/f13f x:0 0 0 2024-09-13T18:30:50.350 INFO:tasks.workunit.client.0.smithi038.stdout:7/935: read db/d21/f83 [3950744,70553] 0 2024-09-13T18:30:50.353 INFO:tasks.workunit.client.0.smithi038.stdout:7/936: rmdir db/d12/d13/ded/d15c 0 2024-09-13T18:30:50.356 INFO:tasks.workunit.client.0.smithi038.stdout:6/925: rename dd/daa to dd/de/d2e/d2f/d71/d140 0 2024-09-13T18:30:50.356 INFO:tasks.workunit.client.0.smithi038.stdout:6/926: chown dd/de/d2e/d9b/lcb 567444 1 2024-09-13T18:30:50.356 INFO:tasks.workunit.client.0.smithi038.stdout:6/927: write dd/de/d2e/d9b/dbf/d11d/d86/fec [119040,109597] 0 2024-09-13T18:30:50.356 INFO:tasks.workunit.client.0.smithi038.stdout:6/928: write dd/de/d2e/d2f/da6/d11f/ff9 [180645,107555] 0 2024-09-13T18:30:50.368 INFO:tasks.workunit.client.0.smithi038.stdout:7/937: dwrite db/d12/d1c/fc4 [0,4194304] 0 2024-09-13T18:30:50.368 INFO:tasks.workunit.client.0.smithi038.stdout:7/938: chown db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/c10c 19578412 1 2024-09-13T18:30:50.368 INFO:tasks.workunit.client.0.smithi038.stdout:7/939: write db/f48 [128534,28820] 0 2024-09-13T18:30:50.368 INFO:tasks.workunit.client.0.smithi038.stdout:3/990: dwrite d0/dd/d17/d50/d5c/d23/d52/f132 [0,4194304] 0 2024-09-13T18:30:50.368 INFO:tasks.workunit.client.0.smithi038.stdout:7/940: fsync db/d21/f83 0 2024-09-13T18:30:50.368 INFO:tasks.workunit.client.0.smithi038.stdout:6/929: write dd/de/d2e/d9b/fba [192010,63524] 0 2024-09-13T18:30:50.376 INFO:tasks.workunit.client.0.smithi038.stdout:3/991: read d0/dd/d17/d50/d5c/d23/d6b/f78 [5028496,49916] 0 2024-09-13T18:30:50.387 INFO:tasks.workunit.client.0.smithi038.stdout:3/992: dread d0/dd/d17/d50/d5c/d1d/d30/d95/f6a [0,4194304] 0 2024-09-13T18:30:50.387 INFO:tasks.workunit.client.0.smithi038.stdout:3/993: read d0/dd/d17/d43/d89/f5f [2556359,76527] 0 2024-09-13T18:30:50.387 INFO:tasks.workunit.client.0.smithi038.stdout:3/994: chown d0/dd/d17/d43/d89/db3 0 1 2024-09-13T18:30:50.387 INFO:tasks.workunit.client.0.smithi038.stdout:7/941: mkdir db/d12/d13/d43/d160 0 2024-09-13T18:30:50.390 INFO:tasks.workunit.client.0.smithi038.stdout:7/942: rmdir db/d12/d13/d43 39 2024-09-13T18:30:50.390 INFO:tasks.workunit.client.0.smithi038.stdout:7/943: readlink db/ld 0 2024-09-13T18:30:50.396 INFO:tasks.workunit.client.0.smithi038.stdout:6/930: dwrite f9 [0,4194304] 0 2024-09-13T18:30:50.396 INFO:tasks.workunit.client.0.smithi038.stdout:6/931: chown dd/de/d2e/d9b/dbf/d11d/d6f/lea 6607063 1 2024-09-13T18:30:50.396 INFO:tasks.workunit.client.0.smithi038.stdout:6/932: symlink dd/de/d2e/d30/l141 0 2024-09-13T18:30:50.397 INFO:tasks.workunit.client.0.smithi038.stdout:6/933: link dd/de/d2e/d9b/dbf/d11d/d55/l81 dd/de/d31/l142 0 2024-09-13T18:30:50.397 INFO:tasks.workunit.client.0.smithi038.stdout:6/934: chown dd/de/d61/d12e/d83/da5 755876 1 2024-09-13T18:30:50.398 INFO:tasks.workunit.client.0.smithi038.stdout:6/935: dread dd/de/f2c [0,4194304] 0 2024-09-13T18:30:50.399 INFO:tasks.workunit.client.0.smithi038.stdout:6/936: link dd/de/d31/dca/fcd dd/de/d2e/d9b/dbf/d11d/d55/f143 0 2024-09-13T18:30:50.400 INFO:tasks.workunit.client.0.smithi038.stdout:6/937: creat dd/de/d2e/d99/f144 x:0 0 0 2024-09-13T18:30:50.401 INFO:tasks.workunit.client.0.smithi038.stdout:3/995: dread d0/dd/d17/d79/f87 [0,4194304] 0 2024-09-13T18:30:50.402 INFO:tasks.workunit.client.0.smithi038.stdout:3/996: readlink d0/dd/d17/d50/d5c/d23/d6b/d103/l10a 0 2024-09-13T18:30:50.403 INFO:tasks.workunit.client.0.smithi038.stdout:6/938: mkdir dd/d145 0 2024-09-13T18:30:50.403 INFO:tasks.workunit.client.0.smithi038.stdout:7/944: dread db/d21/f75 [4194304,4194304] 0 2024-09-13T18:30:50.403 INFO:tasks.workunit.client.0.smithi038.stdout:6/939: write dd/de/d2e/d2f/da6/d11f/f82 [5067252,55001] 0 2024-09-13T18:30:50.403 INFO:tasks.workunit.client.0.smithi038.stdout:7/945: read db/d12/df0/dd4/d28/dd3/f137 [274555,102369] 0 2024-09-13T18:30:50.403 INFO:tasks.workunit.client.0.smithi038.stdout:7/946: chown db/d12/d1c/d3a/d105/l151 239441 1 2024-09-13T18:30:50.404 INFO:tasks.workunit.client.0.smithi038.stdout:7/947: dread db/d12/d1c/d3a/d26/d41/dad/d106/d129/fbf [0,4194304] 0 2024-09-13T18:30:50.405 INFO:tasks.workunit.client.0.smithi038.stdout:6/940: unlink dd/de/ca3 0 2024-09-13T18:30:50.406 INFO:tasks.workunit.client.0.smithi038.stdout:6/941: dread dd/de/d31/f74 [0,4194304] 0 2024-09-13T18:30:50.406 INFO:tasks.workunit.client.0.smithi038.stdout:6/942: write dd/de/d2e/d9b/dbf/d11d/d60/f120 [273008,78723] 0 2024-09-13T18:30:50.407 INFO:tasks.workunit.client.0.smithi038.stdout:3/997: rmdir d0/dd/d17/d50/d5c/d1d/d30/d95 39 2024-09-13T18:30:50.409 INFO:tasks.workunit.client.0.smithi038.stdout:3/998: mkdir d0/dd/d17/d50/d5c/d23/d52/d6e/d139 0 2024-09-13T18:30:50.411 INFO:tasks.workunit.client.0.smithi038.stdout:7/948: rmdir db/d12/df0/dd4 39 2024-09-13T18:30:50.413 INFO:tasks.workunit.client.0.smithi038.stdout:3/999: mknod d0/dd/d17/d50/d5c/d1d/c13a 0 2024-09-13T18:30:50.414 INFO:tasks.workunit.client.0.smithi038.stdout:7/949: symlink db/d12/d1c/d3a/d26/d41/dad/d106/d129/d9b/d11d/l161 0 2024-09-13T18:30:50.414 INFO:tasks.workunit.client.0.smithi038.stdout:7/950: chown db/d12/d1c/d3a/d26/d41/dad/d106/d129/c72 166 1 2024-09-13T18:30:50.427 INFO:tasks.workunit.client.0.smithi038.stdout:6/943: dwrite dd/de/d2e/d2f/da6/d11f/fcc [4194304,4194304] 0 2024-09-13T18:30:50.432 INFO:tasks.workunit.client.0.smithi038.stdout:6/944: unlink dd/de/d2e/d2f/fdd 0 2024-09-13T18:30:50.432 INFO:tasks.workunit.client.0.smithi038.stdout:6/945: chown dd/de/d2e/d2f/d71/fe1 1490 1 2024-09-13T18:30:50.450 INFO:tasks.workunit.client.0.smithi038.stdout:6/946: dwrite dd/de/d2e/d99/f80 [0,4194304] 0 2024-09-13T18:30:50.466 INFO:tasks.workunit.client.0.smithi038.stdout:6/947: dwrite dd/de/d2e/d9b/dbf/d11d/f4d [0,4194304] 0 2024-09-13T18:30:50.614 INFO:tasks.workunit.client.0.smithi038.stdout:6/948: getdents dd/de/d61/d12e/d83 0 2024-09-13T18:30:50.614 INFO:tasks.workunit.client.0.smithi038.stdout:6/949: read dd/de/d2e/d2f/f9e [1295546,53210] 0 2024-09-13T18:30:50.615 INFO:tasks.workunit.client.0.smithi038.stdout:6/950: readlink dd/l65 0 2024-09-13T18:30:50.615 INFO:tasks.workunit.client.0.smithi038.stdout:6/951: dread - dd/de/d2e/d9b/dbf/d11d/fc9 zero size 2024-09-13T18:30:50.616 INFO:tasks.workunit.client.0.smithi038.stdout:6/952: dread dd/de/d2e/d2f/da6/d11f/ff9 [0,4194304] 0 2024-09-13T18:30:50.616 INFO:tasks.workunit.client.0.smithi038.stdout:6/953: stat dd/de/d2e/d9b/dbf/d11d/f102 0 2024-09-13T18:30:50.617 INFO:tasks.workunit.client.0.smithi038.stdout:6/954: rename cc to dd/de/d2e/d9b/dbf/d11d/d6f/c146 0 2024-09-13T18:30:50.617 INFO:tasks.workunit.client.0.smithi038.stdout:6/955: write dd/de/d2e/d2f/d71/dc5/f103 [1155866,23496] 0 2024-09-13T18:30:50.618 INFO:tasks.workunit.client.0.smithi038.stdout:6/956: getdents dd/de/d31/dca 0 2024-09-13T18:30:50.621 INFO:tasks.workunit.client.0.smithi038.stdout:6/957: mknod dd/d13c/c147 0 2024-09-13T18:30:50.621 INFO:tasks.workunit.client.0.smithi038.stdout:6/958: readlink dd/de/d2e/d9b/dbf/d11d/d6f/l7c 0 2024-09-13T18:30:50.623 INFO:tasks.workunit.client.0.smithi038.stdout:6/959: symlink dd/de/d2e/d2f/da6/l148 0 2024-09-13T18:30:50.625 INFO:tasks.workunit.client.0.smithi038.stdout:6/960: rename dd/de/d2e/d2f/da0/l11c to dd/de/d2e/d2f/l149 0 2024-09-13T18:30:50.625 INFO:tasks.workunit.client.0.smithi038.stdout:6/961: chown dd/de/d2e/d9b/dbf/d11d/d55/fbd 57214 1 2024-09-13T18:30:50.625 INFO:tasks.workunit.client.0.smithi038.stdout:6/962: chown dd/de/d2e/d2f/da0/l128 5 1 2024-09-13T18:30:50.625 INFO:tasks.workunit.client.0.smithi038.stdout:6/963: fdatasync dd/de/d2e/d9b/dbf/d11d/fc9 0 2024-09-13T18:30:50.625 INFO:tasks.workunit.client.0.smithi038.stdout:6/964: chown dd/de/d2e/d9b/dbf/d11d/d86/fc1 11548488 1 2024-09-13T18:30:50.625 INFO:tasks.workunit.client.0.smithi038.stdout:6/965: rmdir dd/df6 39 2024-09-13T18:30:50.627 INFO:tasks.workunit.client.0.smithi038.stdout:6/966: unlink dd/de/d2e/d9b/dbf/d11d/d55/f5b 0 2024-09-13T18:30:50.910 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:30:50.910 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-13T18:30:50.980 INFO:tasks.workunit.client.0.smithi038.stdout:0/936: sync 2024-09-13T18:30:50.980 INFO:tasks.workunit.client.0.smithi038.stdout:9/760: sync 2024-09-13T18:30:50.980 INFO:tasks.workunit.client.0.smithi038.stdout:2/857: sync 2024-09-13T18:30:50.980 INFO:tasks.workunit.client.0.smithi038.stdout:9/761: stat d0/d7/d13/d2d/c36 0 2024-09-13T18:30:50.980 INFO:tasks.workunit.client.0.smithi038.stdout:2/858: truncate d2/d1e/d44/d50/d39/d40/ddb/f11d 1042317 0 2024-09-13T18:30:50.981 INFO:tasks.workunit.client.0.smithi038.stdout:9/762: mknod d0/d7/d13/d2d/d3e/d70/da2/d86/c10b 0 2024-09-13T18:30:50.983 INFO:tasks.workunit.client.0.smithi038.stdout:9/763: creat d0/d7/d2c/d33/f10c x:0 0 0 2024-09-13T18:30:50.993 INFO:tasks.workunit.client.0.smithi038.stdout:2/859: read d2/d1e/d44/d50/f9a [738721,88292] 0 2024-09-13T18:30:50.993 INFO:tasks.workunit.client.0.smithi038.stdout:2/860: stat d2/d1e/d87/f11e 0 2024-09-13T18:30:50.994 INFO:tasks.workunit.client.0.smithi038.stdout:2/861: dread d2/d5c/d93/d62/fa9 [0,4194304] 0 2024-09-13T18:30:50.994 INFO:tasks.workunit.client.0.smithi038.stdout:2/862: chown d2/d5c/d66/ld3 13613 1 2024-09-13T18:30:50.994 INFO:tasks.workunit.client.0.smithi038.stdout:0/937: write d2/d7/d24/d92/d66/d81/fb4 [2453068,26282] 0 2024-09-13T18:30:50.996 INFO:tasks.workunit.client.0.smithi038.stdout:0/938: unlink d2/d7/d55/fcf 0 2024-09-13T18:30:50.996 INFO:tasks.workunit.client.0.smithi038.stdout:0/939: fdatasync d2/d7/d24/d92/d40/d87/dd6/d98/dc5/f4d 0 2024-09-13T18:30:50.998 INFO:tasks.workunit.client.0.smithi038.stdout:9/764: read d0/d7/d2c/d6d/f75 [2310136,22260] 0 2024-09-13T18:30:51.000 INFO:tasks.workunit.client.0.smithi038.stdout:9/765: mkdir d0/d7/d2c/d5a/d67/d10d 0 2024-09-13T18:30:51.006 INFO:tasks.workunit.client.0.smithi038.stdout:0/940: dread d2/dc/f14 [0,4194304] 0 2024-09-13T18:30:51.012 INFO:tasks.workunit.client.0.smithi038.stdout:2/863: dwrite d2/d1e/d44/d50/d39/d40/ddb/f11d [0,4194304] 0 2024-09-13T18:30:51.012 INFO:tasks.workunit.client.0.smithi038.stdout:2/864: creat d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d10b/f13e x:0 0 0 2024-09-13T18:30:51.012 INFO:tasks.workunit.client.0.smithi038.stdout:2/865: readlink d2/d1e/d44/d50/d39/d52/d8b/dcb/lcf 0 2024-09-13T18:30:51.017 INFO:tasks.workunit.client.0.smithi038.stdout:0/941: dread d2/dc/f51 [0,4194304] 0 2024-09-13T18:30:51.017 INFO:tasks.workunit.client.0.smithi038.stdout:0/942: truncate d2/d7/d24/d92/d66/d81/f93 4407070 0 2024-09-13T18:30:51.021 INFO:tasks.workunit.client.0.smithi038.stdout:0/943: unlink d2/dc/f50 0 2024-09-13T18:30:51.024 INFO:tasks.workunit.client.0.smithi038.stdout:9/766: dwrite d0/d7/d2c/d5e/fe9 [0,4194304] 0 2024-09-13T18:30:51.024 INFO:tasks.workunit.client.0.smithi038.stdout:9/767: creat d0/d7/d13/d30/f10e x:0 0 0 2024-09-13T18:30:51.029 INFO:tasks.workunit.client.0.smithi038.stdout:9/768: symlink d0/d7/d13/d2d/d3c/dc9/l10f 0 2024-09-13T18:30:51.030 INFO:tasks.workunit.client.0.smithi038.stdout:2/866: dwrite d2/d1e/d44/d50/d46/db1/f11c [0,4194304] 0 2024-09-13T18:30:51.030 INFO:tasks.workunit.client.0.smithi038.stdout:2/867: truncate d2/d5c/d66/dda/f12c 788865 0 2024-09-13T18:30:51.030 INFO:tasks.workunit.client.0.smithi038.stdout:2/868: write d2/d1e/d44/d50/d39/d52/f10c [234221,52847] 0 2024-09-13T18:30:51.031 INFO:tasks.workunit.client.0.smithi038.stdout:9/769: rmdir d0/d7/d2c/d5e/dc5 39 2024-09-13T18:30:51.036 INFO:tasks.workunit.client.0.smithi038.stdout:2/869: mknod d2/d1e/d44/d50/de0/dff/d121/c13f 0 2024-09-13T18:30:51.042 INFO:tasks.workunit.client.0.smithi038.stdout:2/870: rmdir d2/d5c/d66/dda/df9 39 2024-09-13T18:30:51.042 INFO:tasks.workunit.client.0.smithi038.stdout:2/871: chown d2/fd0 15454 1 2024-09-13T18:30:51.044 INFO:tasks.workunit.client.0.smithi038.stdout:2/872: symlink d2/da/l140 0 2024-09-13T18:30:51.045 INFO:tasks.workunit.client.0.smithi038.stdout:0/944: dwrite d2/d7/d24/d92/d40/ff9 [0,4194304] 0 2024-09-13T18:30:51.045 INFO:tasks.workunit.client.0.smithi038.stdout:2/873: dread d2/d5c/d93/f9c [0,4194304] 0 2024-09-13T18:30:51.049 INFO:tasks.workunit.client.0.smithi038.stdout:2/874: rmdir d2/d1e/d44/d50/d39/d52/d8b 39 2024-09-13T18:30:51.052 INFO:tasks.workunit.client.0.smithi038.stdout:2/875: link d2/d1e/d44/d50/d39/d40/ddb/d105/lbf d2/d1e/d44/d50/d39/d45/l141 0 2024-09-13T18:30:51.052 INFO:tasks.workunit.client.0.smithi038.stdout:2/876: write d2/d1e/d44/d50/d39/faa [547983,83548] 0 2024-09-13T18:30:51.054 INFO:tasks.workunit.client.0.smithi038.stdout:2/877: dread d2/d5c/d93/d62/f91 [0,4194304] 0 2024-09-13T18:30:51.071 INFO:tasks.workunit.client.0.smithi038.stdout:9/770: dwrite d0/d7/d13/f5d [0,4194304] 0 2024-09-13T18:30:51.071 INFO:tasks.workunit.client.0.smithi038.stdout:0/945: dwrite d2/ff7 [0,4194304] 0 2024-09-13T18:30:51.071 INFO:tasks.workunit.client.0.smithi038.stdout:0/946: readlink d2/d7/d24/d92/d40/d87/dd6/d98/da0/df0/d118/l12f 0 2024-09-13T18:30:51.072 INFO:tasks.workunit.client.0.smithi038.stdout:9/771: creat d0/d7/d13/d2d/d3c/d50/f110 x:0 0 0 2024-09-13T18:30:51.072 INFO:tasks.workunit.client.0.smithi038.stdout:9/772: write d0/d7/d13/d2d/d3c/d50/f98 [636758,80022] 0 2024-09-13T18:30:51.074 INFO:tasks.workunit.client.0.smithi038.stdout:0/947: symlink d2/d7/d24/d92/d40/d87/d8f/l13a 0 2024-09-13T18:30:51.075 INFO:tasks.workunit.client.0.smithi038.stdout:0/948: stat d2/d7/d24/d2b/f37 0 2024-09-13T18:30:51.075 INFO:tasks.workunit.client.0.smithi038.stdout:0/949: write d2/d7/d24/d92/da1/fbb [5104963,100188] 0 2024-09-13T18:30:51.076 INFO:tasks.workunit.client.0.smithi038.stdout:9/773: rename d0/f6 to d0/d7/d2c/dbf/f111 0 2024-09-13T18:30:51.076 INFO:tasks.workunit.client.0.smithi038.stdout:9/774: chown d0/d7/d13/d2d/d3c/d50/d94/c103 1286 1 2024-09-13T18:30:51.076 INFO:tasks.workunit.client.0.smithi038.stdout:9/775: dread - d0/d7/d13/d2d/d3c/d50/fdb zero size 2024-09-13T18:30:51.076 INFO:tasks.workunit.client.0.smithi038.stdout:2/878: dwrite d2/d1e/f9d [4194304,4194304] 0 2024-09-13T18:30:51.076 INFO:tasks.workunit.client.0.smithi038.stdout:2/879: fdatasync d2/d1e/d44/d50/d46/d58/f131 0 2024-09-13T18:30:51.078 INFO:tasks.workunit.client.0.smithi038.stdout:0/950: creat d2/dc/f13b x:0 0 0 2024-09-13T18:30:51.079 INFO:tasks.workunit.client.0.smithi038.stdout:0/951: truncate d2/d7/d24/dc7/f116 227149 0 2024-09-13T18:30:51.081 INFO:tasks.workunit.client.0.smithi038.stdout:0/952: dread d2/d7/d24/d2b/f5d [0,4194304] 0 2024-09-13T18:30:51.081 INFO:tasks.workunit.client.0.smithi038.stdout:0/953: dread - d2/d7/d24/d92/d66/d81/ffc zero size 2024-09-13T18:30:51.082 INFO:tasks.workunit.client.0.smithi038.stdout:0/954: write d2/d7/d24/d92/d40/d87/dd6/d98/f12b [4771722,41129] 0 2024-09-13T18:30:51.151 INFO:tasks.workunit.client.0.smithi038.stdout:2/880: link d2/d5c/d93/d62/f70 d2/d5c/d66/dda/d13d/f142 0 2024-09-13T18:30:51.155 INFO:tasks.workunit.client.0.smithi038.stdout:6/967: sync 2024-09-13T18:30:51.155 INFO:tasks.workunit.client.0.smithi038.stdout:5/965: sync 2024-09-13T18:30:51.155 INFO:tasks.workunit.client.0.smithi038.stdout:7/951: sync 2024-09-13T18:30:51.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/966: chown df/d13/dc7 65326063 1 2024-09-13T18:30:51.156 INFO:tasks.workunit.client.0.smithi038.stdout:7/952: chown db/d12/df0/cf8 11571 1 2024-09-13T18:30:51.156 INFO:tasks.workunit.client.0.smithi038.stdout:5/967: chown df/d15/d36/d67/dbf/d44/d58/l9f 782996 1 2024-09-13T18:30:51.158 INFO:tasks.workunit.client.0.smithi038.stdout:2/881: dread d2/d1e/d44/d50/d46/db1/f11c [0,4194304] 0 2024-09-13T18:30:51.158 INFO:tasks.workunit.client.0.smithi038.stdout:0/955: mknod d2/d7/d24/d2b/c13c 0 2024-09-13T18:30:51.158 INFO:tasks.workunit.client.0.smithi038.stdout:0/956: fsync d2/dc/d7f/f8c 0 2024-09-13T18:30:51.159 INFO:tasks.workunit.client.0.smithi038.stdout:0/957: write d2/d7/d55/fbc [1333871,97107] 0 2024-09-13T18:30:51.159 INFO:tasks.workunit.client.0.smithi038.stdout:0/958: chown d2/d7/f102 21 1 2024-09-13T18:30:51.160 INFO:tasks.workunit.client.0.smithi038.stdout:7/953: truncate db/d12/d1c/f157 106110 0 2024-09-13T18:30:51.160 INFO:tasks.workunit.client.0.smithi038.stdout:6/968: creat dd/de/d2e/d2f/d71/f14a x:0 0 0 2024-09-13T18:30:51.160 INFO:tasks.workunit.client.0.smithi038.stdout:6/969: fdatasync f9 0 2024-09-13T18:30:51.161 INFO:tasks.workunit.client.0.smithi038.stdout:6/970: truncate dd/de/d2e/d104/f119 417303 0 2024-09-13T18:30:51.161 INFO:tasks.workunit.client.0.smithi038.stdout:5/968: symlink df/d15/d36/d67/dbf/d44/d58/d9c/l12c 0 2024-09-13T18:30:51.161 INFO:tasks.workunit.client.0.smithi038.stdout:5/969: readlink df/d15/d36/d67/dbf/d44/d58/dd6/l103 0 2024-09-13T18:30:51.161 INFO:tasks.workunit.client.0.smithi038.stdout:5/970: chown df/d15/d36/d67/dbf/d44/d58/dd6/f126 21196 1 2024-09-13T18:30:51.162 INFO:tasks.workunit.client.0.smithi038.stdout:2/882: creat d2/d1e/d44/d50/d39/d40/ddb/d105/f143 x:0 0 0 2024-09-13T18:30:51.162 INFO:tasks.workunit.client.0.smithi038.stdout:2/883: chown d2/da/d74/f88 285 1 2024-09-13T18:30:51.163 INFO:tasks.workunit.client.0.smithi038.stdout:0/959: unlink d2/d7/d24/c9d 0 2024-09-13T18:30:51.166 INFO:tasks.workunit.client.0.smithi038.stdout:7/954: rename db/d8e/f135 to db/d12/d1c/d3a/d3c/f162 0 2024-09-13T18:30:51.166 INFO:tasks.workunit.client.0.smithi038.stdout:7/955: fdatasync db/d12/f128 0 2024-09-13T18:30:51.167 INFO:tasks.workunit.client.0.smithi038.stdout:6/971: mkdir dd/df6/d14b 0 2024-09-13T18:30:51.168 INFO:tasks.workunit.client.0.smithi038.stdout:5/971: symlink df/d15/d36/l12d 0 2024-09-13T18:30:51.169 INFO:tasks.workunit.client.0.smithi038.stdout:7/956: rename db/d12/ce6 to db/d21/c163 0 2024-09-13T18:30:51.170 INFO:tasks.workunit.client.0.smithi038.stdout:5/972: symlink df/d15/d36/d67/dbf/d44/d58/l12e 0 2024-09-13T18:30:51.171 INFO:tasks.workunit.client.0.smithi038.stdout:5/973: creat df/d15/d36/d67/dbf/d44/df7/f12f x:0 0 0 2024-09-13T18:30:51.172 INFO:tasks.workunit.client.0.smithi038.stdout:7/957: creat db/d12/d1c/d3a/d26/d41/f164 x:0 0 0 2024-09-13T18:30:51.177 INFO:tasks.workunit.client.0.smithi038.stdout:0/960: dread d2/dc/f51 [4194304,4194304] 0 2024-09-13T18:30:51.178 INFO:tasks.workunit.client.0.smithi038.stdout:0/961: symlink d2/d7/d24/d92/d66/d49/dc0/l13d 0 2024-09-13T18:30:51.180 INFO:tasks.workunit.client.0.smithi038.stdout:0/962: truncate d2/f1c 2420721 0 2024-09-13T18:30:51.180 INFO:tasks.workunit.client.0.smithi038.stdout:0/963: chown d2/d7/d24/d92/f127 16252 1 2024-09-13T18:30:51.181 INFO:tasks.workunit.client.0.smithi038.stdout:6/972: dread dd/de/d2e/d9b/dbf/d11d/d55/ffd [0,4194304] 0 2024-09-13T18:30:51.181 INFO:tasks.workunit.client.0.smithi038.stdout:6/973: chown dd/de/d2e/d2f/f9e 1 1 2024-09-13T18:30:51.182 INFO:tasks.workunit.client.0.smithi038.stdout:7/958: dread db/d12/d1c/d3a/d26/d41/dad/d106/d129/d9b/fbd [0,4194304] 0 2024-09-13T18:30:51.182 INFO:tasks.workunit.client.0.smithi038.stdout:0/964: creat d2/d7/d24/d92/d40/d87/f13e x:0 0 0 2024-09-13T18:30:51.183 INFO:tasks.workunit.client.0.smithi038.stdout:6/974: truncate dd/de/d2e/d9b/dbf/d11d/fe5 2301190 0 2024-09-13T18:30:51.183 INFO:tasks.workunit.client.0.smithi038.stdout:6/975: stat dd/de/d2e/d2f/d71 0 2024-09-13T18:30:51.184 INFO:tasks.workunit.client.0.smithi038.stdout:7/959: link db/d12/df0/fff db/d12/df0/dd4/df1/f165 0 2024-09-13T18:30:51.187 INFO:tasks.workunit.client.0.smithi038.stdout:7/960: symlink db/d12/d13/l166 0 2024-09-13T18:30:51.196 INFO:tasks.workunit.client.0.smithi038.stdout:2/884: dwrite d2/d1e/d44/d50/d39/d40/ddb/d105/f133 [0,4194304] 0 2024-09-13T18:30:51.201 INFO:tasks.workunit.client.0.smithi038.stdout:2/885: mkdir d2/da/d16/d12d/d144 0 2024-09-13T18:30:51.201 INFO:tasks.workunit.client.0.smithi038.stdout:2/886: fsync d2/d1e/d44/d50/f9a 0 2024-09-13T18:30:51.203 INFO:tasks.workunit.client.0.smithi038.stdout:2/887: unlink d2/d1e/d44/d50/d39/d45/l141 0 2024-09-13T18:30:51.205 INFO:tasks.workunit.client.0.smithi038.stdout:2/888: truncate d2/d5c/d93/fb5 1628785 0 2024-09-13T18:30:51.205 INFO:tasks.workunit.client.0.smithi038.stdout:2/889: write d2/d1e/d44/d50/d46/f110 [510130,81567] 0 2024-09-13T18:30:51.219 INFO:tasks.workunit.client.0.smithi038.stdout:5/974: dwrite f1 [4194304,4194304] 0 2024-09-13T18:30:51.219 INFO:tasks.workunit.client.0.smithi038.stdout:5/975: creat df/d15/d36/d67/dbf/d44/f130 x:0 0 0 2024-09-13T18:30:51.221 INFO:tasks.workunit.client.0.smithi038.stdout:5/976: getdents df 0 2024-09-13T18:30:51.222 INFO:tasks.workunit.client.0.smithi038.stdout:5/977: fdatasync df/d15/d36/d67/dbf/d44/d48/d56/ffd 0 2024-09-13T18:30:51.222 INFO:tasks.workunit.client.0.smithi038.stdout:5/978: fsync df/d15/d36/d67/dbf/d44/d58/d9c/f119 0 2024-09-13T18:30:51.222 INFO:tasks.workunit.client.0.smithi038.stdout:5/979: write df/d13/d49/d70/fde [13889211,35869] 0 2024-09-13T18:30:51.223 INFO:tasks.workunit.client.0.smithi038.stdout:5/980: symlink df/d15/d129/l131 0 2024-09-13T18:30:51.223 INFO:tasks.workunit.client.0.smithi038.stdout:5/981: creat df/d15/d36/d67/dbf/d44/d52/db6/dd5/f132 x:0 0 0 2024-09-13T18:30:51.223 INFO:tasks.workunit.client.0.smithi038.stdout:0/965: dwrite d2/d7/d24/d92/d40/d87/dd6/d98/ffb [0,4194304] 0 2024-09-13T18:30:51.223 INFO:tasks.workunit.client.0.smithi038.stdout:6/976: dwrite dd/de/d2e/d9b/dbf/d11d/d55/fc0 [4194304,4194304] 0 2024-09-13T18:30:51.223 INFO:tasks.workunit.client.0.smithi038.stdout:6/977: getdents dd/de/d2e/d9b/dbf/d11d/d60/ddc/de4/d136 0 2024-09-13T18:30:51.223 INFO:tasks.workunit.client.0.smithi038.stdout:7/961: dwrite db/d12/df0/dd4/d28/f6f [0,4194304] 0 2024-09-13T18:30:51.224 INFO:tasks.workunit.client.0.smithi038.stdout:5/982: truncate df/d15/d36/d67/dbf/d44/d58/d9c/fc1 581731 0 2024-09-13T18:30:51.227 INFO:tasks.workunit.client.0.smithi038.stdout:0/966: mknod d2/d7/d24/d92/d40/d87/d10d/c13f 0 2024-09-13T18:30:51.227 INFO:tasks.workunit.client.0.smithi038.stdout:0/967: chown d2 1434165 1 2024-09-13T18:30:51.229 INFO:tasks.workunit.client.0.smithi038.stdout:6/978: creat dd/de/d61/d12e/de8/f14c x:0 0 0 2024-09-13T18:30:51.229 INFO:tasks.workunit.client.0.smithi038.stdout:6/979: truncate dd/de/d2e/d9b/dbf/d11d/d60/f120 486724 0 2024-09-13T18:30:51.229 INFO:tasks.workunit.client.0.smithi038.stdout:6/980: creat dd/de/d2e/d2f/d11e/f14d x:0 0 0 2024-09-13T18:30:51.232 INFO:tasks.workunit.client.0.smithi038.stdout:7/962: creat db/d12/d1c/d3a/f167 x:0 0 0 2024-09-13T18:30:51.232 INFO:tasks.workunit.client.0.smithi038.stdout:7/963: write db/f140 [465063,19073] 0 2024-09-13T18:30:51.234 INFO:tasks.workunit.client.0.smithi038.stdout:5/983: unlink df/da5/lc3 0 2024-09-13T18:30:51.240 INFO:tasks.workunit.client.0.smithi038.stdout:6/981: mkdir dd/de/d2e/d9b/dbf/d11d/d6f/d14e 0 2024-09-13T18:30:51.240 INFO:tasks.workunit.client.0.smithi038.stdout:0/968: dread d2/d7/d24/d92/f30 [0,4194304] 0 2024-09-13T18:30:51.240 INFO:tasks.workunit.client.0.smithi038.stdout:6/982: write dd/de/d2e/d99/f111 [5032928,80553] 0 2024-09-13T18:30:51.242 INFO:tasks.workunit.client.0.smithi038.stdout:7/964: mknod db/d12/d1c/d3a/d3c/d8f/c168 0 2024-09-13T18:30:51.242 INFO:tasks.workunit.client.0.smithi038.stdout:7/965: write db/d12/d1c/d3a/d26/d41/dad/d106/d129/d9b/fbd [3625541,115751] 0 2024-09-13T18:30:51.242 INFO:tasks.workunit.client.0.smithi038.stdout:7/966: fdatasync db/f48 0 2024-09-13T18:30:51.243 INFO:tasks.workunit.client.0.smithi038.stdout:5/984: creat df/d15/d36/d67/dbf/f133 x:0 0 0 2024-09-13T18:30:51.243 INFO:tasks.workunit.client.0.smithi038.stdout:5/985: truncate df/d68/fba 456915 0 2024-09-13T18:30:51.243 INFO:tasks.workunit.client.0.smithi038.stdout:5/986: chown df/d15/d36/d67/dbf/d44/d52/db6/f110 54033 1 2024-09-13T18:30:51.246 INFO:tasks.workunit.client.0.smithi038.stdout:0/969: symlink d2/d7/d24/d92/d66/dda/d109/l140 0 2024-09-13T18:30:51.249 INFO:tasks.workunit.client.0.smithi038.stdout:6/983: creat dd/de/f14f x:0 0 0 2024-09-13T18:30:51.251 INFO:tasks.workunit.client.0.smithi038.stdout:7/967: unlink db/d12/d1c/f13a 0 2024-09-13T18:30:51.254 INFO:tasks.workunit.client.0.smithi038.stdout:5/987: creat df/d15/d36/d67/dbf/d44/d48/d75/f134 x:0 0 0 2024-09-13T18:30:51.255 INFO:tasks.workunit.client.0.smithi038.stdout:0/970: mkdir d2/d7/d24/d92/d66/dda/d141 0 2024-09-13T18:30:51.258 INFO:tasks.workunit.client.0.smithi038.stdout:7/968: link db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/fd0 db/d12/df0/dd4/d28/f169 0 2024-09-13T18:30:51.258 INFO:tasks.workunit.client.0.smithi038.stdout:7/969: chown db/d12/d1c/d3a/d26/d41/dad/d106/d129/d51 115154334 1 2024-09-13T18:30:51.260 INFO:tasks.workunit.client.0.smithi038.stdout:5/988: rename df/d15/d36/d67/dbf/fff to df/f135 0 2024-09-13T18:30:51.261 INFO:tasks.workunit.client.0.smithi038.stdout:7/970: mknod db/d12/d1c/d3a/d26/d41/dad/c16a 0 2024-09-13T18:30:51.261 INFO:tasks.workunit.client.0.smithi038.stdout:7/971: read db/d12/d13/f1b [449462,112370] 0 2024-09-13T18:30:51.261 INFO:tasks.workunit.client.0.smithi038.stdout:7/972: chown db/d12/d1c/d3a/d3c/l56 12057314 1 2024-09-13T18:30:51.262 INFO:tasks.workunit.client.0.smithi038.stdout:7/973: dread - db/d12/d1c/d3a/d26/d41/dad/ffa zero size 2024-09-13T18:30:51.262 INFO:tasks.workunit.client.0.smithi038.stdout:6/984: dwrite dd/de/d2e/d30/ff2 [0,4194304] 0 2024-09-13T18:30:51.262 INFO:tasks.workunit.client.0.smithi038.stdout:6/985: chown dd/de/d2e/d2f/d11e/f123 30882802 1 2024-09-13T18:30:51.264 INFO:tasks.workunit.client.0.smithi038.stdout:0/971: rename d2/d7/d24/d92/d66/f85 to d2/d7/d24/d92/d40/d87/dab/f142 0 2024-09-13T18:30:51.265 INFO:tasks.workunit.client.0.smithi038.stdout:0/972: creat d2/d7/d24/d92/d40/d87/dd6/d98/da0/df0/d10a/f143 x:0 0 0 2024-09-13T18:30:51.271 INFO:tasks.workunit.client.0.smithi038.stdout:7/974: dread db/f14 [0,4194304] 0 2024-09-13T18:30:51.273 INFO:tasks.workunit.client.0.smithi038.stdout:6/986: unlink dd/f16 0 2024-09-13T18:30:51.275 INFO:tasks.workunit.client.0.smithi038.stdout:0/973: symlink d2/d7/d24/l144 0 2024-09-13T18:30:51.276 INFO:tasks.workunit.client.0.smithi038.stdout:0/974: write d2/d7/d24/d92/d40/d87/dab/fb8 [114468,111319] 0 2024-09-13T18:30:51.276 INFO:tasks.workunit.client.0.smithi038.stdout:0/975: readlink d2/d7/d24/l144 0 2024-09-13T18:30:51.276 INFO:tasks.workunit.client.0.smithi038.stdout:5/989: dwrite df/d15/f7e [0,4194304] 0 2024-09-13T18:30:51.277 INFO:tasks.workunit.client.0.smithi038.stdout:7/975: mknod db/d12/d1c/d3a/d26/d41/dad/d106/d129/d51/c16b 0 2024-09-13T18:30:51.277 INFO:tasks.workunit.client.0.smithi038.stdout:7/976: truncate db/d21/f14f 441992 0 2024-09-13T18:30:51.277 INFO:tasks.workunit.client.0.smithi038.stdout:7/977: chown db/d12/d1c/d3a/d26/d41/dad/d106/d129/d9b/f127 6636532 1 2024-09-13T18:30:51.280 INFO:tasks.workunit.client.0.smithi038.stdout:0/976: rename d2/d7/d24/d92/d40/d87/dd6/d98/d120/db7/fc9 to d2/d7/d24/d92/d66/dda/f145 0 2024-09-13T18:30:51.282 INFO:tasks.workunit.client.0.smithi038.stdout:5/990: write df/d15/d36/d67/dbf/d44/d48/f114 [1089847,75988] 0 2024-09-13T18:30:51.283 INFO:tasks.workunit.client.0.smithi038.stdout:7/978: rmdir db/d12/d1c/d3a/d26 39 2024-09-13T18:30:51.284 INFO:tasks.workunit.client.0.smithi038.stdout:0/977: stat d2/d7/d24/d92/d66/c8d 0 2024-09-13T18:30:51.287 INFO:tasks.workunit.client.0.smithi038.stdout:5/991: truncate f3 4175824 0 2024-09-13T18:30:51.287 INFO:tasks.workunit.client.0.smithi038.stdout:5/992: dread - df/d15/d36/d67/dbf/d44/d82/f123 zero size 2024-09-13T18:30:51.287 INFO:tasks.workunit.client.0.smithi038.stdout:5/993: chown df/d15/d36/d67/dbf/d44/f11d 23 1 2024-09-13T18:30:51.288 INFO:tasks.workunit.client.0.smithi038.stdout:7/979: creat db/d12/d1c/d3a/d26/d41/f16c x:0 0 0 2024-09-13T18:30:51.288 INFO:tasks.workunit.client.0.smithi038.stdout:6/987: dwrite dd/de/d31/f74 [0,4194304] 0 2024-09-13T18:30:51.291 INFO:tasks.workunit.client.0.smithi038.stdout:0/978: mknod d2/d7/d24/d2b/d114/c146 0 2024-09-13T18:30:51.291 INFO:tasks.workunit.client.0.smithi038.stdout:5/994: rmdir df/dca 39 2024-09-13T18:30:51.291 INFO:tasks.workunit.client.0.smithi038.stdout:5/995: stat df/d15/d36/d67/dbf/d44/d58/d9c/cdc 0 2024-09-13T18:30:51.292 INFO:tasks.workunit.client.0.smithi038.stdout:5/996: creat df/d15/d36/d67/dbf/d44/d48/d75/f136 x:0 0 0 2024-09-13T18:30:51.295 INFO:tasks.workunit.client.0.smithi038.stdout:7/980: link db/d12/d1c/d3a/d4b/ld5 db/d12/d13/ded/l16d 0 2024-09-13T18:30:51.302 INFO:tasks.workunit.client.0.smithi038.stdout:5/997: readlink df/d15/d36/d67/dbf/d44/d48/d9d/dce/lfc 0 2024-09-13T18:30:51.303 INFO:tasks.workunit.client.0.smithi038.stdout:7/981: mknod db/d12/d1c/d3a/c16e 0 2024-09-13T18:30:51.305 INFO:tasks.workunit.client.0.smithi038.stdout:6/988: rename dd/de/dce/ce9 to dd/de/d61/d12e/c150 0 2024-09-13T18:30:51.307 INFO:tasks.workunit.client.0.smithi038.stdout:0/979: rmdir d2/d7/d24/d92/d40/d87/dd6/d98/da0/de0 39 2024-09-13T18:30:51.308 INFO:tasks.workunit.client.0.smithi038.stdout:0/980: getdents d2/d7/d24/d92/d40/d87/dd6/d98/dec 0 2024-09-13T18:30:51.309 INFO:tasks.workunit.client.0.smithi038.stdout:7/982: rmdir db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/def 39 2024-09-13T18:30:51.311 INFO:tasks.workunit.client.0.smithi038.stdout:0/981: rmdir d2/d7/d24/d92/d66/d49/dce 39 2024-09-13T18:30:51.315 INFO:tasks.workunit.client.0.smithi038.stdout:6/989: read dd/de/d2e/d9b/dbf/d11d/d60/ddc/de4/f10e [1569103,78167] 0 2024-09-13T18:30:51.317 INFO:tasks.workunit.client.0.smithi038.stdout:6/990: truncate dd/de/d2e/d9b/dbf/f110 989852 0 2024-09-13T18:30:51.320 INFO:tasks.workunit.client.0.smithi038.stdout:6/991: creat dd/de/d61/d12e/d83/f151 x:0 0 0 2024-09-13T18:30:51.321 INFO:tasks.workunit.client.0.smithi038.stdout:5/998: dwrite df/d15/d36/d67/dbf/d44/d48/d75/fd8 [0,4194304] 0 2024-09-13T18:30:51.327 INFO:tasks.workunit.client.0.smithi038.stdout:5/999: mkdir df/d15/d36/d67/dbf/d44/d58/d137 0 2024-09-13T18:30:51.330 INFO:tasks.workunit.client.0.smithi038.stdout:7/983: dwrite db/d12/d1c/d3a/d26/d41/fe3 [0,4194304] 0 2024-09-13T18:30:51.330 INFO:tasks.workunit.client.0.smithi038.stdout:6/992: link dd/f11 dd/de/d2e/d30/d27/f152 0 2024-09-13T18:30:51.334 INFO:tasks.workunit.client.0.smithi038.stdout:7/984: creat db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/def/f16f x:0 0 0 2024-09-13T18:30:51.336 INFO:tasks.workunit.client.0.smithi038.stdout:7/985: link db/d12/d1c/d3a/d26/d41/dad/cdf db/d12/df0/dd4/c170 0 2024-09-13T18:30:51.337 INFO:tasks.workunit.client.0.smithi038.stdout:7/986: symlink db/d21/l171 0 2024-09-13T18:30:51.343 INFO:tasks.workunit.client.0.smithi038.stdout:7/987: read db/d21/f75 [7642943,99178] 0 2024-09-13T18:30:51.343 INFO:tasks.workunit.client.0.smithi038.stdout:7/988: symlink db/d12/d1c/d3a/d4b/l172 0 2024-09-13T18:30:51.346 INFO:tasks.workunit.client.0.smithi038.stdout:7/989: dread db/d12/df0/dd4/f2c [0,4194304] 0 2024-09-13T18:30:51.347 INFO:tasks.workunit.client.0.smithi038.stdout:7/990: write db/d12/df0/dd4/d28/f15e [681846,62037] 0 2024-09-13T18:30:51.353 INFO:tasks.workunit.client.0.smithi038.stdout:7/991: dread db/d12/df0/f114 [0,4194304] 0 2024-09-13T18:30:51.368 INFO:tasks.workunit.client.0.smithi038.stdout:7/992: dwrite db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/fe8 [0,4194304] 0 2024-09-13T18:30:51.502 INFO:tasks.workunit.client.0.smithi038.stdout:7/993: rename db/d12/d13/d43/f12e to db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/f173 0 2024-09-13T18:30:51.503 INFO:tasks.workunit.client.0.smithi038.stdout:7/994: write db/d12/df0/dd4/d28/f15e [375103,46182] 0 2024-09-13T18:30:51.515 INFO:tasks.workunit.client.0.smithi038.stdout:7/995: symlink db/d12/d1c/d3a/d26/d41/dad/l174 0 2024-09-13T18:30:51.516 INFO:tasks.workunit.client.0.smithi038.stdout:7/996: rename db/d12/d1c/d3a/d3c/f40 to db/d12/d1c/d3a/d26/d41/dad/d106/d129/f175 0 2024-09-13T18:30:51.516 INFO:tasks.workunit.client.0.smithi038.stdout:7/997: chown db/fc 45622788 1 2024-09-13T18:30:51.518 INFO:tasks.workunit.client.0.smithi038.stdout:7/998: rename db/d12/d1c/d3a/d26/d41/dad/d106/d129/d51/ca6 to db/d12/d1c/d3a/d26/d41/dad/d106/d129/dc6/c176 0 2024-09-13T18:30:51.519 INFO:tasks.workunit.client.0.smithi038.stdout:7/999: unlink db/d21/l11a 0 2024-09-13T18:30:51.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.527+0000 7ff525008640 1 -- 172.21.15.38:0/2030103034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff520103010 msgr2=0x7ff520105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.527+0000 7ff525008640 1 --2- 172.21.15.38:0/2030103034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff520103010 0x7ff520105400 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff514009880 tx=0x7ff51402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.527+0000 7ff525008640 1 -- 172.21.15.38:0/2030103034 shutdown_connections 2024-09-13T18:30:51.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.527+0000 7ff525008640 1 --2- 172.21.15.38:0/2030103034 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff520103010 0x7ff520105400 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.527+0000 7ff525008640 1 --2- 172.21.15.38:0/2030103034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5201006e0 0x7ff520102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.527+0000 7ff525008640 1 -- 172.21.15.38:0/2030103034 >> 172.21.15.38:0/2030103034 conn(0x7ff5200fa280 msgr2=0x7ff5200fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:51.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.527+0000 7ff525008640 1 -- 172.21.15.38:0/2030103034 shutdown_connections 2024-09-13T18:30:51.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.527+0000 7ff525008640 1 -- 172.21.15.38:0/2030103034 wait complete. 2024-09-13T18:30:51.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.528+0000 7ff525008640 1 Processor -- start 2024-09-13T18:30:51.530 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.528+0000 7ff525008640 1 -- start start 2024-09-13T18:30:51.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.528+0000 7ff525008640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5201006e0 0x7ff5200ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.528+0000 7ff525008640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff520103010 0x7ff5200fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.528+0000 7ff525008640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200febd0 con 0x7ff520103010 2024-09-13T18:30:51.531 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.528+0000 7ff525008640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200fed40 con 0x7ff5201006e0 2024-09-13T18:30:51.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.528+0000 7ff51e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff520103010 0x7ff5200fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.528+0000 7ff51e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff520103010 0x7ff5200fe690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51610/0 (socket says 172.21.15.38:51610) 2024-09-13T18:30:51.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.528+0000 7ff51e59c640 1 -- 172.21.15.38:0/1156701859 learned_addr learned my addr 172.21.15.38:0/1156701859 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:51.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.528+0000 7ff51ed9d640 1 --2- 172.21.15.38:0/1156701859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5201006e0 0x7ff5200ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.529+0000 7ff51e59c640 1 -- 172.21.15.38:0/1156701859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5201006e0 msgr2=0x7ff5200ffff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.529+0000 7ff51e59c640 1 --2- 172.21.15.38:0/1156701859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5201006e0 0x7ff5200ffff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.529+0000 7ff51e59c640 1 -- 172.21.15.38:0/1156701859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff514009560 con 0x7ff520103010 2024-09-13T18:30:51.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.529+0000 7ff51ed9d640 1 --2- 172.21.15.38:0/1156701859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5201006e0 0x7ff5200ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:51.532 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.529+0000 7ff51e59c640 1 --2- 172.21.15.38:0/1156701859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff520103010 0x7ff5200fe690 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff514004650 tx=0x7ff5140055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:51.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.529+0000 7ff507fff640 1 -- 172.21.15.38:0/1156701859 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff514004aa0 con 0x7ff520103010 2024-09-13T18:30:51.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.529+0000 7ff525008640 1 -- 172.21.15.38:0/1156701859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5200ff020 con 0x7ff520103010 2024-09-13T18:30:51.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.529+0000 7ff525008640 1 -- 172.21.15.38:0/1156701859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52019d620 con 0x7ff520103010 2024-09-13T18:30:51.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.530+0000 7ff507fff640 1 -- 172.21.15.38:0/1156701859 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff514005d50 con 0x7ff520103010 2024-09-13T18:30:51.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.530+0000 7ff507fff640 1 -- 172.21.15.38:0/1156701859 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5140318b0 con 0x7ff520103010 2024-09-13T18:30:51.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.531+0000 7ff525008640 1 -- 172.21.15.38:0/1156701859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50c005280 con 0x7ff520103010 2024-09-13T18:30:51.533 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.531+0000 7ff507fff640 1 -- 172.21.15.38:0/1156701859 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7ff514031b10 con 0x7ff520103010 2024-09-13T18:30:51.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.532+0000 7ff507fff640 1 --2- 172.21.15.38:0/1156701859 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7ff50806cd90 0x7ff50806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.532+0000 7ff507fff640 1 -- 172.21.15.38:0/1156701859 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff5140ad4e0 con 0x7ff520103010 2024-09-13T18:30:51.534 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.532+0000 7ff51ed9d640 1 --2- 172.21.15.38:0/1156701859 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7ff50806cd90 0x7ff50806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.532+0000 7ff51ed9d640 1 --2- 172.21.15.38:0/1156701859 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7ff50806cd90 0x7ff50806f250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff510009fc0 tx=0x7ff510005f90 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:51.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.540+0000 7ff507fff640 1 -- 172.21.15.38:0/1156701859 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff514077660 con 0x7ff520103010 2024-09-13T18:30:51.613 INFO:tasks.workunit.client.0.smithi038.stdout:9/776: sync 2024-09-13T18:30:51.614 INFO:tasks.workunit.client.0.smithi038.stdout:9/777: mkdir d0/d7/d13/d2d/d3c/d50/d112 0 2024-09-13T18:30:51.617 INFO:tasks.workunit.client.0.smithi038.stdout:9/778: symlink d0/d7/d13/l113 0 2024-09-13T18:30:51.617 INFO:tasks.workunit.client.0.smithi038.stdout:9/779: fsync d0/d7/d2c/d5a/d67/d9e/f6b 0 2024-09-13T18:30:51.638 INFO:tasks.workunit.client.0.smithi038.stdout:9/780: dwrite d0/d7/d13/d2d/d3e/f6e [0,4194304] 0 2024-09-13T18:30:51.642 INFO:tasks.workunit.client.0.smithi038.stdout:9/781: getdents d0/d7/d2c/d6d/de6 0 2024-09-13T18:30:51.643 INFO:tasks.workunit.client.0.smithi038.stdout:9/782: mkdir d0/d7/d2c/d6d/de6/d114 0 2024-09-13T18:30:51.647 INFO:tasks.workunit.client.0.smithi038.stdout:9/783: rename d0/d7/d13/d2d/d3c/d50/c60 to d0/d7/d2c/d6d/de6/df1/c115 0 2024-09-13T18:30:51.681 INFO:tasks.workunit.client.0.smithi038.stdout:9/784: dwrite d0/d7/d13/d30/fbd [0,4194304] 0 2024-09-13T18:30:51.689 INFO:tasks.workunit.client.0.smithi038.stdout:9/785: creat d0/d7/d13/d2d/d3c/dfa/f116 x:0 0 0 2024-09-13T18:30:51.689 INFO:tasks.workunit.client.0.smithi038.stdout:9/786: chown d0/d7/d2c/d5e/cc8 14506044 1 2024-09-13T18:30:51.698 INFO:tasks.workunit.client.0.smithi038.stdout:9/787: write d0/d7/d13/f1e [2601034,22913] 0 2024-09-13T18:30:51.702 INFO:tasks.workunit.client.0.smithi038.stdout:9/788: link d0/d7/d2c/d5e/c92 d0/dac/c117 0 2024-09-13T18:30:51.703 INFO:tasks.workunit.client.0.smithi038.stdout:9/789: mknod d0/c118 0 2024-09-13T18:30:51.723 INFO:tasks.workunit.client.0.smithi038.stdout:0/982: sync 2024-09-13T18:30:51.723 INFO:tasks.workunit.client.0.smithi038.stdout:2/890: sync 2024-09-13T18:30:51.723 INFO:tasks.workunit.client.0.smithi038.stdout:6/993: sync 2024-09-13T18:30:51.723 INFO:tasks.workunit.client.0.smithi038.stdout:2/891: creat d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d10b/f145 x:0 0 0 2024-09-13T18:30:51.724 INFO:tasks.workunit.client.0.smithi038.stdout:2/892: write d2/f126 [2637763,96224] 0 2024-09-13T18:30:51.725 INFO:tasks.workunit.client.0.smithi038.stdout:2/893: rename d2/da/f28 to d2/d5c/d93/f146 0 2024-09-13T18:30:51.726 INFO:tasks.workunit.client.0.smithi038.stdout:2/894: getdents d2/d1e/d44/d50/de0/dff/d121 0 2024-09-13T18:30:51.728 INFO:tasks.workunit.client.0.smithi038.stdout:9/790: dwrite d0/d7/d13/d2d/d3c/d50/f65 [0,4194304] 0 2024-09-13T18:30:51.728 INFO:tasks.workunit.client.0.smithi038.stdout:2/895: write d2/d1e/f136 [845042,120469] 0 2024-09-13T18:30:51.729 INFO:tasks.workunit.client.0.smithi038.stdout:2/896: symlink d2/d1e/d44/l147 0 2024-09-13T18:30:51.735 INFO:tasks.workunit.client.0.smithi038.stdout:0/983: dread d2/d7/d24/d2b/ff3 [0,4194304] 0 2024-09-13T18:30:51.735 INFO:tasks.workunit.client.0.smithi038.stdout:6/994: dread dd/de/d2e/f67 [0,4194304] 0 2024-09-13T18:30:51.737 INFO:tasks.workunit.client.0.smithi038.stdout:6/995: dread dd/de/d2e/d2f/da6/d11f/ff9 [0,4194304] 0 2024-09-13T18:30:51.737 INFO:tasks.workunit.client.0.smithi038.stdout:6/996: fdatasync dd/de/d2e/f64 0 2024-09-13T18:30:51.737 INFO:tasks.workunit.client.0.smithi038.stdout:6/997: fdatasync dd/de/d2e/d9b/dbf/d11d/d55/f143 0 2024-09-13T18:30:51.738 INFO:tasks.workunit.client.0.smithi038.stdout:0/984: getdents d2/d7/d24/d92/d40/d87/dd6/d98/dc5/d3f/de2 0 2024-09-13T18:30:51.740 INFO:tasks.workunit.client.0.smithi038.stdout:6/998: creat dd/de/d2e/d9b/dbf/d11d/d86/dac/f153 x:0 0 0 2024-09-13T18:30:51.741 INFO:tasks.workunit.client.0.smithi038.stdout:0/985: mkdir d2/d7/d24/d2b/d114/d147 0 2024-09-13T18:30:51.743 INFO:tasks.workunit.client.0.smithi038.stdout:6/999: symlink dd/de/d2e/d2f/d71/dc5/l154 0 2024-09-13T18:30:51.743 INFO:tasks.workunit.client.0.smithi038.stdout:2/897: read d2/d1e/d44/fa7 [647737,13216] 0 2024-09-13T18:30:51.744 INFO:tasks.workunit.client.0.smithi038.stdout:0/986: mknod d2/d7/d24/d92/d40/d9a/c148 0 2024-09-13T18:30:51.744 INFO:tasks.workunit.client.0.smithi038.stdout:9/791: write d0/d7/d2c/d5e/f8a [2851053,128651] 0 2024-09-13T18:30:51.747 INFO:tasks.workunit.client.0.smithi038.stdout:2/898: rmdir d2/da/d16 39 2024-09-13T18:30:51.747 INFO:tasks.workunit.client.0.smithi038.stdout:2/899: creat d2/d1e/d44/d50/d39/d52/f148 x:0 0 0 2024-09-13T18:30:51.749 INFO:tasks.workunit.client.0.smithi038.stdout:9/792: creat d0/d7/d2c/f119 x:0 0 0 2024-09-13T18:30:51.749 INFO:tasks.workunit.client.0.smithi038.stdout:9/793: fsync d0/d7/d2c/d33/d4a/ff3 0 2024-09-13T18:30:51.752 INFO:tasks.workunit.client.0.smithi038.stdout:9/794: mknod d0/d2e/c11a 0 2024-09-13T18:30:51.752 INFO:tasks.workunit.client.0.smithi038.stdout:9/795: chown d0/dac 527 1 2024-09-13T18:30:51.752 INFO:tasks.workunit.client.0.smithi038.stdout:9/796: write d0/d7/d13/d2d/d3e/d70/da2/da6/fb1 [52359,106614] 0 2024-09-13T18:30:51.752 INFO:tasks.workunit.client.0.smithi038.stdout:9/797: stat d0/d2e/f7c 0 2024-09-13T18:30:51.752 INFO:tasks.workunit.client.0.smithi038.stdout:9/798: stat d0/d7/f31 0 2024-09-13T18:30:51.754 INFO:tasks.workunit.client.0.smithi038.stdout:9/799: creat d0/d7/d2c/d5a/d67/d10d/f11b x:0 0 0 2024-09-13T18:30:51.765 INFO:tasks.workunit.client.0.smithi038.stdout:9/800: dread d0/d7/d13/d2d/d3c/d50/fff [0,4194304] 0 2024-09-13T18:30:51.766 INFO:tasks.workunit.client.0.smithi038.stdout:0/987: dwrite d2/d7/f4a [0,4194304] 0 2024-09-13T18:30:51.766 INFO:tasks.workunit.client.0.smithi038.stdout:2/900: dwrite d2/d5c/f138 [0,4194304] 0 2024-09-13T18:30:51.768 INFO:tasks.workunit.client.0.smithi038.stdout:2/901: creat d2/d1e/d44/d50/d39/d52/d8b/dcb/f149 x:0 0 0 2024-09-13T18:30:51.769 INFO:tasks.workunit.client.0.smithi038.stdout:0/988: getdents d2/d7/d24/d92/d40/d87/d10d 0 2024-09-13T18:30:51.772 INFO:tasks.workunit.client.0.smithi038.stdout:0/989: rename d2/d7/d24/d92/lac to d2/d7/d24/d92/d66/dda/l149 0 2024-09-13T18:30:51.775 INFO:tasks.workunit.client.0.smithi038.stdout:9/801: dread d0/d7/d13/d2d/d3c/dc9/fee [0,4194304] 0 2024-09-13T18:30:51.785 INFO:tasks.workunit.client.0.smithi038.stdout:0/990: dread d2/d7/d24/ff6 [0,4194304] 0 2024-09-13T18:30:51.785 INFO:tasks.workunit.client.0.smithi038.stdout:2/902: dwrite d2/d1e/d48/f64 [0,4194304] 0 2024-09-13T18:30:51.785 INFO:tasks.workunit.client.0.smithi038.stdout:2/903: read d2/d1e/f4e [610124,95080] 0 2024-09-13T18:30:51.787 INFO:tasks.workunit.client.0.smithi038.stdout:0/991: rename d2/dc/f13b to d2/d7/d24/d92/d40/d87/dd6/d98/dc5/d3f/de2/f14a 0 2024-09-13T18:30:51.787 INFO:tasks.workunit.client.0.smithi038.stdout:0/992: dread - d2/d7/de1/fed zero size 2024-09-13T18:30:51.789 INFO:tasks.workunit.client.0.smithi038.stdout:0/993: rmdir d2/d7/de1 39 2024-09-13T18:30:51.789 INFO:tasks.workunit.client.0.smithi038.stdout:0/994: chown d2/d7/d24/f84 97036 1 2024-09-13T18:30:51.791 INFO:tasks.workunit.client.0.smithi038.stdout:0/995: symlink d2/d7/d24/d92/d40/d87/dd6/l14b 0 2024-09-13T18:30:51.791 INFO:tasks.workunit.client.0.smithi038.stdout:0/996: chown d2/d7/d24/d92/d40/d87/cbf 60202320 1 2024-09-13T18:30:51.796 INFO:tasks.workunit.client.0.smithi038.stdout:9/802: dwrite d0/d7/d2c/d33/ffb [0,4194304] 0 2024-09-13T18:30:51.804 INFO:tasks.workunit.client.0.smithi038.stdout:2/904: write d2/d1e/d44/d50/d39/f5d [7472725,78025] 0 2024-09-13T18:30:51.806 INFO:tasks.workunit.client.0.smithi038.stdout:2/905: mkdir d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d14a 0 2024-09-13T18:30:51.811 INFO:tasks.workunit.client.0.smithi038.stdout:0/997: dwrite d2/d7/d24/d2b/f5d [0,4194304] 0 2024-09-13T18:30:51.814 INFO:tasks.workunit.client.0.smithi038.stdout:0/998: rename d2/ff7 to d2/d7/d24/d92/d40/d87/f14c 0 2024-09-13T18:30:51.814 INFO:tasks.workunit.client.0.smithi038.stdout:0/999: read d2/d7/d24/d92/d66/d81/f83 [359432,78518] 0 2024-09-13T18:30:51.820 INFO:tasks.workunit.client.0.smithi038.stdout:9/803: dwrite d0/d2e/f25 [0,4194304] 0 2024-09-13T18:30:51.820 INFO:tasks.workunit.client.0.smithi038.stdout:9/804: readlink d0/d7/d13/d2d/d3e/d70/da2/d86/db6/lde 0 2024-09-13T18:30:51.821 INFO:tasks.workunit.client.0.smithi038.stdout:9/805: rmdir d0/d7/d2c/d5a/d67 39 2024-09-13T18:30:51.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.851+0000 7ff525008640 1 -- 172.21.15.38:0/1156701859 --> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff50c000bf0 con 0x7ff50806cd90 2024-09-13T18:30:51.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.853+0000 7ff507fff640 1 -- 172.21.15.38:0/1156701859 <== mgr.24387 v2:172.21.15.149:6828/2070517292 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7ff50c000bf0 con 0x7ff50806cd90 2024-09-13T18:30:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.855+0000 7ff525008640 1 -- 172.21.15.38:0/1156701859 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7ff50806cd90 msgr2=0x7ff50806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.855+0000 7ff525008640 1 --2- 172.21.15.38:0/1156701859 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7ff50806cd90 0x7ff50806f250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff510009fc0 tx=0x7ff510005f90 comp rx=0 tx=0).stop 2024-09-13T18:30:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.855+0000 7ff525008640 1 -- 172.21.15.38:0/1156701859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff520103010 msgr2=0x7ff5200fe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.855+0000 7ff525008640 1 --2- 172.21.15.38:0/1156701859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff520103010 0x7ff5200fe690 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff514004650 tx=0x7ff5140055a0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.855+0000 7ff525008640 1 -- 172.21.15.38:0/1156701859 shutdown_connections 2024-09-13T18:30:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.855+0000 7ff525008640 1 --2- 172.21.15.38:0/1156701859 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7ff50806cd90 0x7ff50806f250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.855+0000 7ff525008640 1 --2- 172.21.15.38:0/1156701859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff520103010 0x7ff5200fe690 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.855+0000 7ff525008640 1 --2- 172.21.15.38:0/1156701859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5201006e0 0x7ff5200ffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.855+0000 7ff525008640 1 -- 172.21.15.38:0/1156701859 >> 172.21.15.38:0/1156701859 conn(0x7ff5200fa280 msgr2=0x7ff5200fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.855+0000 7ff525008640 1 -- 172.21.15.38:0/1156701859 shutdown_connections 2024-09-13T18:30:51.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.855+0000 7ff525008640 1 -- 172.21.15.38:0/1156701859 wait complete. 2024-09-13T18:30:51.866 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:30:51.936 INFO:tasks.workunit.client.0.smithi038.stdout:2/906: dwrite d2/f37 [0,4194304] 0 2024-09-13T18:30:51.937 INFO:tasks.workunit.client.0.smithi038.stdout:2/907: truncate d2/d5c/d66/dda/f12c 459956 0 2024-09-13T18:30:51.937 INFO:tasks.workunit.client.0.smithi038.stdout:2/908: chown d2/da/l33 259 1 2024-09-13T18:30:51.938 INFO:tasks.workunit.client.0.smithi038.stdout:2/909: mknod d2/d1e/d44/d50/d39/d45/d107/c14b 0 2024-09-13T18:30:51.939 INFO:tasks.workunit.client.0.smithi038.stdout:2/910: creat d2/d5c/d66/dda/df9/f14c x:0 0 0 2024-09-13T18:30:51.940 INFO:tasks.workunit.client.0.smithi038.stdout:2/911: rename d2/da/f36 to d2/d5c/d66/f14d 0 2024-09-13T18:30:51.942 INFO:tasks.workunit.client.0.smithi038.stdout:2/912: getdents d2/d1e/d44/d50/d39/d40 0 2024-09-13T18:30:51.942 INFO:tasks.workunit.client.0.smithi038.stdout:2/913: getdents d2/d1e/d44/d50/d39/d45/d107/d12e 0 2024-09-13T18:30:51.945 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.943+0000 7f9b8465c640 1 -- 172.21.15.38:0/156713912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b7c100dd0 msgr2=0x7f9b7c101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.943+0000 7f9b8465c640 1 --2- 172.21.15.38:0/156713912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b7c100dd0 0x7f9b7c101250 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009880 tx=0x7f9b6c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.943+0000 7f9b8465c640 1 -- 172.21.15.38:0/156713912 shutdown_connections 2024-09-13T18:30:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.943+0000 7f9b8465c640 1 --2- 172.21.15.38:0/156713912 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b7c100dd0 0x7f9b7c101250 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.943+0000 7f9b8465c640 1 --2- 172.21.15.38:0/156713912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b7c0ffbd0 0x7f9b7c0fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.943+0000 7f9b8465c640 1 -- 172.21.15.38:0/156713912 >> 172.21.15.38:0/156713912 conn(0x7f9b7c0fb360 msgr2=0x7f9b7c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.943+0000 7f9b8465c640 1 -- 172.21.15.38:0/156713912 shutdown_connections 2024-09-13T18:30:51.946 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.943+0000 7f9b8465c640 1 -- 172.21.15.38:0/156713912 wait complete. 2024-09-13T18:30:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.944+0000 7f9b8465c640 1 Processor -- start 2024-09-13T18:30:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.944+0000 7f9b8465c640 1 -- start start 2024-09-13T18:30:51.947 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.944+0000 7f9b8465c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b7c0ffbd0 0x7f9b7c195590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.944+0000 7f9b8465c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b7c100dd0 0x7f9b7c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.944+0000 7f9b8465c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c1960a0 con 0x7f9b7c0ffbd0 2024-09-13T18:30:51.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.944+0000 7f9b8465c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c196210 con 0x7f9b7c100dd0 2024-09-13T18:30:51.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.945+0000 7f9b823f8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b7c0ffbd0 0x7f9b7c195590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.945+0000 7f9b823f8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b7c0ffbd0 0x7f9b7c195590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51630/0 (socket says 172.21.15.38:51630) 2024-09-13T18:30:51.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.945+0000 7f9b823f8640 1 -- 172.21.15.38:0/2461735453 learned_addr learned my addr 172.21.15.38:0/2461735453 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:51.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.945+0000 7f9b81bf7640 1 --2- 172.21.15.38:0/2461735453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b7c100dd0 0x7f9b7c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.945+0000 7f9b823f8640 1 -- 172.21.15.38:0/2461735453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b7c100dd0 msgr2=0x7f9b7c195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:51.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.945+0000 7f9b823f8640 1 --2- 172.21.15.38:0/2461735453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b7c100dd0 0x7f9b7c195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:51.948 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.945+0000 7f9b823f8640 1 -- 172.21.15.38:0/2461735453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c009560 con 0x7f9b7c0ffbd0 2024-09-13T18:30:51.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.945+0000 7f9b823f8640 1 --2- 172.21.15.38:0/2461735453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b7c0ffbd0 0x7f9b7c195590 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800d900 tx=0x7f9b7800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:51.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.945+0000 7f9b737fe640 1 -- 172.21.15.38:0/2461735453 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b78009c00 con 0x7f9b7c0ffbd0 2024-09-13T18:30:51.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.946+0000 7f9b8465c640 1 -- 172.21.15.38:0/2461735453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7c19acb0 con 0x7f9b7c0ffbd0 2024-09-13T18:30:51.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.946+0000 7f9b737fe640 1 -- 172.21.15.38:0/2461735453 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b78009d60 con 0x7f9b7c0ffbd0 2024-09-13T18:30:51.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.946+0000 7f9b737fe640 1 -- 172.21.15.38:0/2461735453 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b7800f5f0 con 0x7f9b7c0ffbd0 2024-09-13T18:30:51.949 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.946+0000 7f9b8465c640 1 -- 172.21.15.38:0/2461735453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7c19b230 con 0x7f9b7c0ffbd0 2024-09-13T18:30:51.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.947+0000 7f9b8465c640 1 -- 172.21.15.38:0/2461735453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7c18f630 con 0x7f9b7c0ffbd0 2024-09-13T18:30:51.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.948+0000 7f9b737fe640 1 -- 172.21.15.38:0/2461735453 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f9b78010460 con 0x7f9b7c0ffbd0 2024-09-13T18:30:51.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.948+0000 7f9b737fe640 1 --2- 172.21.15.38:0/2461735453 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f9b6806cd90 0x7f9b6806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:51.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.949+0000 7f9b737fe640 1 -- 172.21.15.38:0/2461735453 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f9b7808c470 con 0x7f9b7c0ffbd0 2024-09-13T18:30:51.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.949+0000 7f9b81bf7640 1 --2- 172.21.15.38:0/2461735453 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f9b6806cd90 0x7f9b6806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:51.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.951+0000 7f9b81bf7640 1 --2- 172.21.15.38:0/2461735453 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f9b6806cd90 0x7f9b6806f250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c196ab0 tx=0x7f9b6c031400 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:51.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:51.954+0000 7f9b737fe640 1 -- 172.21.15.38:0/2461735453 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9b78056570 con 0x7f9b7c0ffbd0 2024-09-13T18:30:51.968 INFO:tasks.workunit.client.0.smithi038.stdout:2/914: dwrite d2/d5c/d66/dda/df9/f106 [0,4194304] 0 2024-09-13T18:30:51.980 INFO:tasks.workunit.client.0.smithi038.stdout:2/915: dwrite d2/d1e/d87/f11e [0,4194304] 0 2024-09-13T18:30:51.996 INFO:tasks.workunit.client.0.smithi038.stdout:2/916: dwrite d2/d1e/d44/d50/d39/fa1 [0,4194304] 0 2024-09-13T18:30:52.011 INFO:tasks.workunit.client.0.smithi038.stdout:2/917: dwrite d2/d1e/d44/d50/d46/da6/fd5 [4194304,4194304] 0 2024-09-13T18:30:52.033 INFO:tasks.workunit.client.0.smithi038.stdout:2/918: dwrite d2/d1e/d44/d50/d39/d52/f8f [0,4194304] 0 2024-09-13T18:30:52.033 INFO:tasks.workunit.client.0.smithi038.stdout:2/919: dread - d2/d1e/d44/d50/d39/d40/f130 zero size 2024-09-13T18:30:52.033 INFO:tasks.workunit.client.0.smithi038.stdout:2/920: chown d2/d1e/d44/l5e 4125 1 2024-09-13T18:30:52.033 INFO:tasks.workunit.client.0.smithi038.stdout:2/921: read - d2/ffb zero size 2024-09-13T18:30:52.035 INFO:tasks.workunit.client.0.smithi038.stdout:2/922: symlink d2/d1e/d44/d50/d39/d45/l14e 0 2024-09-13T18:30:52.036 INFO:tasks.workunit.client.0.smithi038.stdout:2/923: truncate d2/d1e/f8a 4340701 0 2024-09-13T18:30:52.036 INFO:tasks.workunit.client.0.smithi038.stdout:2/924: read d2/d5c/d93/d62/fa9 [215819,17810] 0 2024-09-13T18:30:52.036 INFO:tasks.workunit.client.0.smithi038.stdout:2/925: chown d2/d1e/d44/d50/d39/fa1 58427 1 2024-09-13T18:30:52.037 INFO:tasks.workunit.client.0.smithi038.stdout:2/926: mknod d2/d5c/dea/c14f 0 2024-09-13T18:30:52.037 INFO:tasks.workunit.client.0.smithi038.stdout:2/927: symlink d2/d1e/d87/da4/l150 0 2024-09-13T18:30:52.039 INFO:tasks.workunit.client.0.smithi038.stdout:2/928: mkdir d2/d1e/d44/d50/d39/d45/d151 0 2024-09-13T18:30:52.054 INFO:tasks.workunit.client.0.smithi038.stdout:2/929: dwrite d2/da/f77 [0,4194304] 0 2024-09-13T18:30:52.060 INFO:tasks.workunit.client.0.smithi038.stdout:2/930: dread d2/d1e/d44/fa7 [0,4194304] 0 2024-09-13T18:30:52.060 INFO:tasks.workunit.client.0.smithi038.stdout:2/931: chown d2/d5c/d93/d62/fa9 2242610 1 2024-09-13T18:30:52.060 INFO:tasks.workunit.client.0.smithi038.stdout:2/932: chown d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/dd6/c122 4 1 2024-09-13T18:30:52.062 INFO:tasks.workunit.client.0.smithi038.stdout:2/933: link d2/d1e/d44/d50/f115 d2/d1e/d48/f152 0 2024-09-13T18:30:52.070 INFO:tasks.workunit.client.0.smithi038.stdout:2/934: dread d2/da/f77 [0,4194304] 0 2024-09-13T18:30:52.073 INFO:tasks.workunit.client.0.smithi038.stdout:2/935: mknod d2/d1e/d44/d50/d39/d40/c153 0 2024-09-13T18:30:52.073 INFO:tasks.workunit.client.0.smithi038.stdout:2/936: write d2/d1e/d44/d50/d39/f13b [10019,29703] 0 2024-09-13T18:30:52.073 INFO:tasks.workunit.client.0.smithi038.stdout:2/937: rename d2 to d2/d1e/d44/d50/d39/d45/d107/d154 22 2024-09-13T18:30:52.076 INFO:tasks.workunit.client.0.smithi038.stdout:2/938: mknod d2/d5c/d66/dda/d13d/c155 0 2024-09-13T18:30:52.076 INFO:tasks.workunit.client.0.smithi038.stdout:2/939: stat d2/d5c/d93/f146 0 2024-09-13T18:30:52.076 INFO:tasks.workunit.client.0.smithi038.stdout:2/940: fdatasync d2/d1e/d44/d50/d39/d45/fce 0 2024-09-13T18:30:52.077 INFO:tasks.workunit.client.0.smithi038.stdout:2/941: dread d2/d5c/d66/dda/f12c [0,4194304] 0 2024-09-13T18:30:52.078 INFO:tasks.workunit.client.0.smithi038.stdout:2/942: creat d2/d1e/d44/f156 x:0 0 0 2024-09-13T18:30:52.080 INFO:tasks.workunit.client.0.smithi038.stdout:2/943: truncate d2/f26 1290653 0 2024-09-13T18:30:52.080 INFO:tasks.workunit.client.0.smithi038.stdout:2/944: stat d2/d2a/l69 0 2024-09-13T18:30:52.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:51 smithi038 ceph-mon[27689]: pgmap v28: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 115 MiB/s rd, 141 MiB/s wr, 268 op/s 2024-09-13T18:30:52.082 INFO:tasks.workunit.client.0.smithi038.stdout:2/945: dread d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/dd6/fdd [0,4194304] 0 2024-09-13T18:30:52.082 INFO:tasks.workunit.client.0.smithi038.stdout:2/946: dread d2/d5c/d93/d62/fa9 [0,4194304] 0 2024-09-13T18:30:52.082 INFO:tasks.workunit.client.0.smithi038.stdout:2/947: stat d2/d1e/d44/d50/d46/d58 0 2024-09-13T18:30:52.084 INFO:tasks.workunit.client.0.smithi038.stdout:2/948: creat d2/da/d74/f157 x:0 0 0 2024-09-13T18:30:52.086 INFO:tasks.workunit.client.0.smithi038.stdout:2/949: link d2/d1e/f95 d2/d1e/d44/d50/d46/f158 0 2024-09-13T18:30:52.093 INFO:tasks.workunit.client.0.smithi038.stdout:2/950: write d2/d1e/d44/d50/d46/d58/f7e [2760157,37400] 0 2024-09-13T18:30:52.098 INFO:tasks.workunit.client.0.smithi038.stdout:2/951: truncate d2/d1e/d44/f75 930439 0 2024-09-13T18:30:52.100 INFO:tasks.workunit.client.0.smithi038.stdout:2/952: link d2/d2a/l69 d2/d1e/d44/d50/d39/d45/d107/l159 0 2024-09-13T18:30:52.108 INFO:tasks.workunit.client.0.smithi038.stdout:2/953: dread d2/d2a/f35 [4194304,4194304] 0 2024-09-13T18:30:52.109 INFO:tasks.workunit.client.0.smithi038.stdout:2/954: getdents d2/d5c/d66/dda/d13d 0 2024-09-13T18:30:52.109 INFO:tasks.workunit.client.0.smithi038.stdout:2/955: truncate d2/d1e/d44/d50/d46/f110 1125398 0 2024-09-13T18:30:52.110 INFO:tasks.workunit.client.0.smithi038.stdout:2/956: getdents d2/d5c/d66/dda/df9 0 2024-09-13T18:30:52.112 INFO:tasks.workunit.client.0.smithi038.stdout:2/957: getdents d2/da 0 2024-09-13T18:30:52.112 INFO:tasks.workunit.client.0.smithi038.stdout:2/958: truncate d2/d5c/d66/dda/f12c 1107844 0 2024-09-13T18:30:52.114 INFO:tasks.workunit.client.0.smithi038.stdout:2/959: truncate d2/f86 3144552 0 2024-09-13T18:30:52.117 INFO:tasks.workunit.client.0.smithi038.stdout:2/960: rmdir d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d10b 39 2024-09-13T18:30:52.117 INFO:tasks.workunit.client.0.smithi038.stdout:2/961: chown d2/d1e/c22 81105 1 2024-09-13T18:30:52.139 INFO:tasks.workunit.client.0.smithi038.stdout:2/962: dwrite d2/d1e/d44/d50/d39/d45/d107/f10d [0,4194304] 0 2024-09-13T18:30:52.139 INFO:tasks.workunit.client.0.smithi038.stdout:2/963: readlink d2/da/l33 0 2024-09-13T18:30:52.147 INFO:tasks.workunit.client.0.smithi038.stdout:2/964: rename d2/d2a/l9f to d2/d1e/d87/da4/l15a 0 2024-09-13T18:30:52.154 INFO:tasks.workunit.client.0.smithi038.stdout:2/965: dread d2/d1e/d44/d50/d46/f85 [0,4194304] 0 2024-09-13T18:30:52.170 INFO:tasks.workunit.client.0.smithi038.stdout:9/806: sync 2024-09-13T18:30:52.171 INFO:tasks.workunit.client.0.smithi038.stdout:2/966: dwrite d2/da/d74/f88 [0,4194304] 0 2024-09-13T18:30:52.171 INFO:tasks.workunit.client.0.smithi038.stdout:9/807: rename d0/d7/d13/f1e to d0/d2e/f11c 0 2024-09-13T18:30:52.175 INFO:tasks.workunit.client.0.smithi038.stdout:2/967: symlink d2/da/l15b 0 2024-09-13T18:30:52.177 INFO:tasks.workunit.client.0.smithi038.stdout:9/808: symlink d0/d7/d2c/d6d/de6/l11d 0 2024-09-13T18:30:52.179 INFO:tasks.workunit.client.0.smithi038.stdout:2/968: creat d2/d2a/db0/f15c x:0 0 0 2024-09-13T18:30:52.179 INFO:tasks.workunit.client.0.smithi038.stdout:2/969: write d2/d5c/d93/d62/f70 [2554950,75261] 0 2024-09-13T18:30:52.179 INFO:tasks.workunit.client.0.smithi038.stdout:2/970: read d2/d1e/d44/f75 [325777,72817] 0 2024-09-13T18:30:52.182 INFO:tasks.workunit.client.0.smithi038.stdout:2/971: mkdir d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d14a/d15d 0 2024-09-13T18:30:52.183 INFO:tasks.workunit.client.0.smithi038.stdout:2/972: symlink d2/d1e/d87/l15e 0 2024-09-13T18:30:52.183 INFO:tasks.workunit.client.0.smithi038.stdout:2/973: readlink d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d10b/l123 0 2024-09-13T18:30:52.185 INFO:tasks.workunit.client.0.smithi038.stdout:2/974: rename d2/d1e/d48/l11b to d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d14a/l15f 0 2024-09-13T18:30:52.187 INFO:tasks.workunit.client.0.smithi038.stdout:2/975: truncate d2/d1e/d44/f76 1302775 0 2024-09-13T18:30:52.188 INFO:tasks.workunit.client.0.smithi038.stdout:2/976: symlink d2/d1e/d44/d50/d39/l160 0 2024-09-13T18:30:52.199 INFO:tasks.workunit.client.0.smithi038.stdout:9/809: dwrite d0/d7/d13/d30/fc7 [0,4194304] 0 2024-09-13T18:30:52.202 INFO:tasks.workunit.client.0.smithi038.stdout:2/977: dwrite d2/d1e/d44/d50/d39/fa1 [0,4194304] 0 2024-09-13T18:30:52.203 INFO:tasks.workunit.client.0.smithi038.stdout:9/810: unlink d0/d7/d2c/d5a/d67/d9e/le1 0 2024-09-13T18:30:52.213 INFO:tasks.workunit.client.0.smithi038.stdout:9/811: read d0/d7/d2c/d5e/fe9 [3460937,78649] 0 2024-09-13T18:30:52.214 INFO:tasks.workunit.client.0.smithi038.stdout:9/812: creat d0/d7/d2c/d5a/f11e x:0 0 0 2024-09-13T18:30:52.214 INFO:tasks.workunit.client.0.smithi038.stdout:9/813: fsync d0/f1 0 2024-09-13T18:30:52.219 INFO:tasks.workunit.client.0.smithi038.stdout:2/978: dwrite d2/d1e/d44/d50/d39/d52/d8b/dcb/f129 [0,4194304] 0 2024-09-13T18:30:52.224 INFO:tasks.workunit.client.0.smithi038.stdout:2/979: rename d2/da/d16/l55 to d2/da/d74/l161 0 2024-09-13T18:30:52.226 INFO:tasks.workunit.client.0.smithi038.stdout:2/980: symlink d2/d1e/d48/l162 0 2024-09-13T18:30:52.226 INFO:tasks.workunit.client.0.smithi038.stdout:2/981: dread - d2/d5c/d93/f10a zero size 2024-09-13T18:30:52.228 INFO:tasks.workunit.client.0.smithi038.stdout:2/982: unlink d2/d5c/d93/cfd 0 2024-09-13T18:30:52.228 INFO:tasks.workunit.client.0.smithi038.stdout:9/814: write d0/d7/d2c/f76 [1059545,11032] 0 2024-09-13T18:30:52.230 INFO:tasks.workunit.client.0.smithi038.stdout:2/983: symlink d2/d1e/d44/d50/d39/d40/ddb/d105/dc9/d14a/l163 0 2024-09-13T18:30:52.232 INFO:tasks.workunit.client.0.smithi038.stdout:9/815: rename d0/d7/d13/d2d/d3e/d70/l9a to d0/d7/d2c/d5e/l11f 0 2024-09-13T18:30:52.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.230+0000 7f9b8465c640 1 -- 172.21.15.38:0/2461735453 --> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b7c02c560 con 0x7f9b6806cd90 2024-09-13T18:30:52.234 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.232+0000 7f9b737fe640 1 -- 172.21.15.38:0/2461735453 <== mgr.24387 v2:172.21.15.149:6828/2070517292 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f9b7c02c560 con 0x7f9b6806cd90 2024-09-13T18:30:52.234 INFO:tasks.workunit.client.0.smithi038.stdout:2/984: mkdir d2/d1e/d44/d50/d39/d52/d8b/dcb/d164 0 2024-09-13T18:30:52.235 INFO:tasks.workunit.client.0.smithi038.stdout:2/985: write d2/d1e/d44/d50/d46/d58/f103 [530164,19768] 0 2024-09-13T18:30:52.235 INFO:tasks.workunit.client.0.smithi038.stdout:2/986: write d2/d1e/d44/f156 [108610,76614] 0 2024-09-13T18:30:52.236 INFO:tasks.workunit.client.0.smithi038.stdout:2/987: symlink d2/d1e/d44/d50/d39/d40/ddb/l165 0 2024-09-13T18:30:52.236 INFO:tasks.workunit.client.0.smithi038.stdout:2/988: getdents d2/d1e/d44/d50/d39/d52/d8b/dcb/d164 0 2024-09-13T18:30:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.235+0000 7f9b8465c640 1 -- 172.21.15.38:0/2461735453 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f9b6806cd90 msgr2=0x7f9b6806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.235+0000 7f9b8465c640 1 --2- 172.21.15.38:0/2461735453 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f9b6806cd90 0x7f9b6806f250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c196ab0 tx=0x7f9b6c031400 comp rx=0 tx=0).stop 2024-09-13T18:30:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.235+0000 7f9b8465c640 1 -- 172.21.15.38:0/2461735453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b7c0ffbd0 msgr2=0x7f9b7c195590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.235+0000 7f9b8465c640 1 --2- 172.21.15.38:0/2461735453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b7c0ffbd0 0x7f9b7c195590 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800d900 tx=0x7f9b7800ddc0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.235+0000 7f9b8465c640 1 -- 172.21.15.38:0/2461735453 shutdown_connections 2024-09-13T18:30:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.235+0000 7f9b8465c640 1 --2- 172.21.15.38:0/2461735453 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f9b6806cd90 0x7f9b6806f250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.235+0000 7f9b8465c640 1 --2- 172.21.15.38:0/2461735453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b7c100dd0 0x7f9b7c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.235+0000 7f9b8465c640 1 --2- 172.21.15.38:0/2461735453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b7c0ffbd0 0x7f9b7c195590 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.235+0000 7f9b8465c640 1 -- 172.21.15.38:0/2461735453 >> 172.21.15.38:0/2461735453 conn(0x7f9b7c0fb360 msgr2=0x7f9b7c1044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:52.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.235+0000 7f9b8465c640 1 -- 172.21.15.38:0/2461735453 shutdown_connections 2024-09-13T18:30:52.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.236+0000 7f9b8465c640 1 -- 172.21.15.38:0/2461735453 wait complete. 2024-09-13T18:30:52.239 INFO:tasks.workunit.client.0.smithi038.stdout:2/989: mkdir d2/da/d16/d12d/d166 0 2024-09-13T18:30:52.239 INFO:tasks.workunit.client.0.smithi038.stdout:2/990: fdatasync d2/d5c/d93/d62/f91 0 2024-09-13T18:30:52.240 INFO:tasks.workunit.client.0.smithi038.stdout:2/991: mknod d2/d2a/db0/dde/c167 0 2024-09-13T18:30:52.256 INFO:tasks.workunit.client.0.smithi038.stdout:2/992: dwrite d2/d2a/db0/f15c [0,4194304] 0 2024-09-13T18:30:52.256 INFO:tasks.workunit.client.0.smithi038.stdout:2/993: chown d2/da/lb4 644371 1 2024-09-13T18:30:52.256 INFO:tasks.workunit.client.0.smithi038.stdout:2/994: write d2/d1e/d48/f134 [915486,33050] 0 2024-09-13T18:30:52.257 INFO:tasks.workunit.client.0.smithi038.stdout:2/995: dread d2/d5c/d93/f9c [0,4194304] 0 2024-09-13T18:30:52.260 INFO:tasks.workunit.client.0.smithi038.stdout:2/996: getdents d2/d5c/d93 0 2024-09-13T18:30:52.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:51 smithi149 ceph-mon[35845]: pgmap v28: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 115 MiB/s rd, 141 MiB/s wr, 268 op/s 2024-09-13T18:30:52.270 INFO:tasks.workunit.client.0.smithi038.stdout:2/997: dread d2/d1e/d44/d50/d39/d52/d8b/dcb/f129 [0,4194304] 0 2024-09-13T18:30:52.271 INFO:tasks.workunit.client.0.smithi038.stdout:2/998: link d2/da/f1d d2/da/d74/f168 0 2024-09-13T18:30:52.272 INFO:tasks.workunit.client.0.smithi038.stdout:2/999: symlink d2/da/d16/d12d/l169 0 2024-09-13T18:30:52.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.343+0000 7f63395f3640 1 -- 172.21.15.38:0/1016538665 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63340ffcf0 msgr2=0x7f6334100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.343+0000 7f63395f3640 1 --2- 172.21.15.38:0/1016538665 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63340ffcf0 0x7f6334100170 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f631c009880 tx=0x7f631c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.343+0000 7f63395f3640 1 -- 172.21.15.38:0/1016538665 shutdown_connections 2024-09-13T18:30:52.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.343+0000 7f63395f3640 1 --2- 172.21.15.38:0/1016538665 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63340ffcf0 0x7f6334100170 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.343+0000 7f63395f3640 1 --2- 172.21.15.38:0/1016538665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63340feaf0 0x7f63340feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.343+0000 7f63395f3640 1 -- 172.21.15.38:0/1016538665 >> 172.21.15.38:0/1016538665 conn(0x7f63340fa280 msgr2=0x7f63340fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:52.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.343+0000 7f63395f3640 1 -- 172.21.15.38:0/1016538665 shutdown_connections 2024-09-13T18:30:52.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.343+0000 7f63395f3640 1 -- 172.21.15.38:0/1016538665 wait complete. 2024-09-13T18:30:52.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.344+0000 7f63395f3640 1 Processor -- start 2024-09-13T18:30:52.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.344+0000 7f63395f3640 1 -- start start 2024-09-13T18:30:52.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.345+0000 7f63395f3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63340feaf0 0x7f63340687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.345+0000 7f63395f3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63340ffcf0 0x7f633419a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.345+0000 7f63395f3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633419a880 con 0x7f63340feaf0 2024-09-13T18:30:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.345+0000 7f63395f3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633419a9f0 con 0x7f63340ffcf0 2024-09-13T18:30:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.345+0000 7f6332ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63340feaf0 0x7f63340687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.345+0000 7f6332ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63340feaf0 0x7f63340687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50864/0 (socket says 172.21.15.38:50864) 2024-09-13T18:30:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.345+0000 7f6332ffd640 1 -- 172.21.15.38:0/3582356550 learned_addr learned my addr 172.21.15.38:0/3582356550 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.345+0000 7f632bfff640 1 --2- 172.21.15.38:0/3582356550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63340ffcf0 0x7f633419a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.345+0000 7f6332ffd640 1 -- 172.21.15.38:0/3582356550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63340ffcf0 msgr2=0x7f633419a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.345+0000 7f6332ffd640 1 --2- 172.21.15.38:0/3582356550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63340ffcf0 0x7f633419a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.345+0000 7f6332ffd640 1 -- 172.21.15.38:0/3582356550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c009560 con 0x7f63340feaf0 2024-09-13T18:30:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.346+0000 7f6332ffd640 1 --2- 172.21.15.38:0/3582356550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63340feaf0 0x7f63340687d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6324009d30 tx=0x7f632400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:52.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.346+0000 7f6330ff9640 1 -- 172.21.15.38:0/3582356550 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63240041f0 con 0x7f63340feaf0 2024-09-13T18:30:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.346+0000 7f6330ff9640 1 -- 172.21.15.38:0/3582356550 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6324004350 con 0x7f63340feaf0 2024-09-13T18:30:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.346+0000 7f6330ff9640 1 -- 172.21.15.38:0/3582356550 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f632401a760 con 0x7f63340feaf0 2024-09-13T18:30:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.346+0000 7f63395f3640 1 -- 172.21.15.38:0/3582356550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63341940e0 con 0x7f63340feaf0 2024-09-13T18:30:52.350 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.347+0000 7f63395f3640 1 -- 172.21.15.38:0/3582356550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6334194570 con 0x7f63340feaf0 2024-09-13T18:30:52.351 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.348+0000 7f63395f3640 1 -- 172.21.15.38:0/3582356550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633418e530 con 0x7f63340feaf0 2024-09-13T18:30:52.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.349+0000 7f6330ff9640 1 -- 172.21.15.38:0/3582356550 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f632401a8c0 con 0x7f63340feaf0 2024-09-13T18:30:52.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.350+0000 7f6330ff9640 1 --2- 172.21.15.38:0/3582356550 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f632006cdc0 0x7f632006f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.350+0000 7f6330ff9640 1 -- 172.21.15.38:0/3582356550 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f6324066310 con 0x7f63340feaf0 2024-09-13T18:30:52.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.350+0000 7f632bfff640 1 --2- 172.21.15.38:0/3582356550 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f632006cdc0 0x7f632006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.353 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.351+0000 7f632bfff640 1 --2- 172.21.15.38:0/3582356550 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f632006cdc0 0x7f632006f280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f631c031460 tx=0x7f631c000bc0 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:52.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.355+0000 7f6330ff9640 1 -- 172.21.15.38:0/3582356550 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6324095060 con 0x7f63340feaf0 2024-09-13T18:30:52.459 INFO:tasks.workunit.client.0.smithi038.stdout:9/816: sync 2024-09-13T18:30:52.462 INFO:tasks.workunit.client.0.smithi038.stdout:9/817: creat d0/d7/d13/d2d/f120 x:0 0 0 2024-09-13T18:30:52.462 INFO:tasks.workunit.client.0.smithi038.stdout:9/818: stat d0/d7/d13/d2d/d3e/faf 0 2024-09-13T18:30:52.470 INFO:tasks.workunit.client.0.smithi038.stdout:9/819: dread d0/d7/d2c/dbf/f111 [0,4194304] 0 2024-09-13T18:30:52.470 INFO:tasks.workunit.client.0.smithi038.stdout:9/820: write d0/d7/d13/f42 [1217804,30351] 0 2024-09-13T18:30:52.472 INFO:tasks.workunit.client.0.smithi038.stdout:9/821: rename d0/d2e/f7c to d0/d7/d2c/d5a/da4/f121 0 2024-09-13T18:30:52.473 INFO:tasks.workunit.client.0.smithi038.stdout:9/822: mkdir d0/d7/d122 0 2024-09-13T18:30:52.474 INFO:tasks.workunit.client.0.smithi038.stdout:9/823: symlink d0/d7/d13/d2d/d3c/d50/l123 0 2024-09-13T18:30:52.474 INFO:tasks.workunit.client.0.smithi038.stdout:9/824: dread - d0/d7/d13/d2d/d3e/faf zero size 2024-09-13T18:30:52.475 INFO:tasks.workunit.client.0.smithi038.stdout:9/825: symlink d0/d2e/d7f/l124 0 2024-09-13T18:30:52.475 INFO:tasks.workunit.client.0.smithi038.stdout:9/826: creat d0/d7/d2c/d33/f125 x:0 0 0 2024-09-13T18:30:52.476 INFO:tasks.workunit.client.0.smithi038.stdout:9/827: dread d0/d7/d2c/d5e/f97 [0,4194304] 0 2024-09-13T18:30:52.478 INFO:tasks.workunit.client.0.smithi038.stdout:9/828: unlink d0/d7/d13/d2d/d3c/f104 0 2024-09-13T18:30:52.478 INFO:tasks.workunit.client.0.smithi038.stdout:9/829: write d0/d7/d13/d2d/d3e/f88 [1199517,93801] 0 2024-09-13T18:30:52.478 INFO:tasks.workunit.client.0.smithi038.stdout:9/830: chown d0/d7/d13/d2d/d106 584423094 1 2024-09-13T18:30:52.478 INFO:tasks.workunit.client.0.smithi038.stdout:9/831: chown d0/d7/d2c/d33/f4c 35140 1 2024-09-13T18:30:52.486 INFO:tasks.workunit.client.0.smithi038.stdout:9/832: dread d0/f1 [0,4194304] 0 2024-09-13T18:30:52.486 INFO:tasks.workunit.client.0.smithi038.stdout:9/833: write d0/d7/d2c/d5a/fe3 [121762,126472] 0 2024-09-13T18:30:52.493 INFO:tasks.workunit.client.0.smithi038.stdout:9/834: write d0/d7/d2c/d5a/dd8/f9f [66287,39946] 0 2024-09-13T18:30:52.495 INFO:tasks.workunit.client.0.smithi038.stdout:9/835: dread d0/d7/d13/d2d/d3e/d70/da2/d86/fe4 [0,4194304] 0 2024-09-13T18:30:52.495 INFO:tasks.workunit.client.0.smithi038.stdout:9/836: truncate d0/d7/d13/d2d/d3c/dc9/fee 5202510 0 2024-09-13T18:30:52.505 INFO:tasks.workunit.client.0.smithi038.stdout:9/837: dread d0/d7/d2c/d33/f4c [0,4194304] 0 2024-09-13T18:30:52.508 INFO:tasks.workunit.client.0.smithi038.stdout:9/838: mkdir d0/d7/d13/d2d/d3e/df7/d126 0 2024-09-13T18:30:52.510 INFO:tasks.workunit.client.0.smithi038.stdout:9/839: mkdir d0/d7/d13/d2d/d3e/d127 0 2024-09-13T18:30:52.510 INFO:tasks.workunit.client.0.smithi038.stdout:9/840: fsync d0/d7/d2c/f119 0 2024-09-13T18:30:52.518 INFO:tasks.workunit.client.0.smithi038.stdout:9/841: getdents d0/d7/d13/d2d/d3e 0 2024-09-13T18:30:52.519 INFO:tasks.workunit.client.0.smithi038.stdout:9/842: mkdir d0/d7/d2c/d6d/de6/d128 0 2024-09-13T18:30:52.527 INFO:tasks.workunit.client.0.smithi038.stdout:9/843: dread d0/d7/d2c/d5a/f72 [0,4194304] 0 2024-09-13T18:30:52.533 INFO:tasks.workunit.client.0.smithi038.stdout:9/844: dread d0/d7/d2c/d5a/fe3 [0,4194304] 0 2024-09-13T18:30:52.539 INFO:tasks.workunit.client.0.smithi038.stdout:9/845: dread d0/d7/d13/f5d [0,4194304] 0 2024-09-13T18:30:52.544 INFO:tasks.workunit.client.0.smithi038.stdout:9/846: rename d0/d7/d2c/l43 to d0/d7/d13/d2d/d3c/dc9/l129 0 2024-09-13T18:30:52.547 INFO:tasks.workunit.client.0.smithi038.stdout:9/847: truncate d0/f8 403400 0 2024-09-13T18:30:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.600+0000 7f63395f3640 1 -- 172.21.15.38:0/3582356550 --> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f633402c5e0 con 0x7f632006cdc0 2024-09-13T18:30:52.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.611+0000 7f6330ff9640 1 -- 172.21.15.38:0/3582356550 <== mgr.24387 v2:172.21.15.149:6828/2070517292 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f633402c5e0 con 0x7f632006cdc0 2024-09-13T18:30:52.614 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:30:52.614 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (7m) 40s ago 8m 24.1M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:30:52.614 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (8m) 40s ago 8m 7864k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:30:52.614 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (7m) 47s ago 7m 7708k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:30:52.614 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (8m) 40s ago 8m 6899k - 18.2.4-845-ge4e227b3 67ddd33fa72f 30c026e97a6b 2024-09-13T18:30:52.614 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (7m) 47s ago 7m 6895k - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c179d7df975 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (6m) 40s ago 8m 87.4M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (2m) 40s ago 2m 154M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (3m) 40s ago 3m 87.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (3m) 47s ago 3m 20.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (2m) 47s ago 2m 20.5M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:9283,8765,8443 running (10m) 40s ago 9m 127M - 18.2.4-845-ge4e227b3 67ddd33fa72f 1cebd33ffd6a 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (71s) 47s ago 7m 463M - 18.2.4-860-g6c6b083f 8a91f241d7d4 49cdb3f4164b 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (10m) 40s ago 10m 51.0M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f b654a36a9082 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (7m) 47s ago 7m 42.7M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 0133a107f35d 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (8m) 40s ago 8m 15.6M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (7m) 47s ago 7m 16.0M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (6m) 40s ago 6m 108M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 69a9e66fb097 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (6m) 40s ago 6m 120M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 07986b4ba73b 2024-09-13T18:30:52.615 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (5m) 40s ago 5m 98.6M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f e44cdda01aee 2024-09-13T18:30:52.616 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (5m) 47s ago 5m 112M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:30:52.616 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (4m) 47s ago 4m 114M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:30:52.616 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (4m) 47s ago 4m 109M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:30:52.616 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 starting - - - - 2024-09-13T18:30:52.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.615+0000 7f63395f3640 1 -- 172.21.15.38:0/3582356550 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f632006cdc0 msgr2=0x7f632006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.615+0000 7f63395f3640 1 --2- 172.21.15.38:0/3582356550 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f632006cdc0 0x7f632006f280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f631c031460 tx=0x7f631c000bc0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.615+0000 7f63395f3640 1 -- 172.21.15.38:0/3582356550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63340feaf0 msgr2=0x7f63340687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.615+0000 7f63395f3640 1 --2- 172.21.15.38:0/3582356550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63340feaf0 0x7f63340687d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6324009d30 tx=0x7f632400c6a0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.619 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.615+0000 7f63395f3640 1 -- 172.21.15.38:0/3582356550 shutdown_connections 2024-09-13T18:30:52.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.615+0000 7f63395f3640 1 --2- 172.21.15.38:0/3582356550 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f632006cdc0 0x7f632006f280 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f631c031460 tx=0x7f631c000bc0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.615+0000 7f63395f3640 1 --2- 172.21.15.38:0/3582356550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f63340ffcf0 0x7f633419a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.615+0000 7f63395f3640 1 --2- 172.21.15.38:0/3582356550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63340feaf0 0x7f63340687d0 secure :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6324009d30 tx=0x7f632400c6a0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.615+0000 7f63395f3640 1 -- 172.21.15.38:0/3582356550 >> 172.21.15.38:0/3582356550 conn(0x7f63340fa280 msgr2=0x7f6334103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:52.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.616+0000 7f63395f3640 1 -- 172.21.15.38:0/3582356550 shutdown_connections 2024-09-13T18:30:52.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.616+0000 7f63395f3640 1 -- 172.21.15.38:0/3582356550 wait complete. 2024-09-13T18:30:52.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.757+0000 7fadc2662640 1 -- 172.21.15.38:0/3001856058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadbc10b790 msgr2=0x7fadbc10bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.757+0000 7fadc2662640 1 --2- 172.21.15.38:0/3001856058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadbc10b790 0x7fadbc10bc10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009880 tx=0x7fadb002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.760 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.758+0000 7fadc2662640 1 -- 172.21.15.38:0/3001856058 shutdown_connections 2024-09-13T18:30:52.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.758+0000 7fadc2662640 1 --2- 172.21.15.38:0/3001856058 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadbc10b790 0x7fadbc10bc10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.758+0000 7fadc2662640 1 --2- 172.21.15.38:0/3001856058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadbc10a8b0 0x7fadbc10acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.758+0000 7fadc2662640 1 -- 172.21.15.38:0/3001856058 >> 172.21.15.38:0/3001856058 conn(0x7fadbc069fe0 msgr2=0x7fadbc06a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:52.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.758+0000 7fadc2662640 1 -- 172.21.15.38:0/3001856058 shutdown_connections 2024-09-13T18:30:52.761 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.758+0000 7fadc2662640 1 -- 172.21.15.38:0/3001856058 wait complete. 2024-09-13T18:30:52.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.759+0000 7fadc2662640 1 Processor -- start 2024-09-13T18:30:52.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.759+0000 7fadc2662640 1 -- start start 2024-09-13T18:30:52.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.759+0000 7fadc2662640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadbc10a8b0 0x7fadbc19fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.759+0000 7fadc2662640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadbc10b790 0x7fadbc1a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.759+0000 7fadc2662640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc1a0970 con 0x7fadbc10b790 2024-09-13T18:30:52.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.759+0000 7fadc2662640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc1a0ae0 con 0x7fadbc10a8b0 2024-09-13T18:30:52.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.760+0000 7fadbbfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadbc10a8b0 0x7fadbc19fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.760+0000 7fadbbfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadbc10a8b0 0x7fadbc19fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.38:43638/0 (socket says 172.21.15.38:43638) 2024-09-13T18:30:52.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.760+0000 7fadbbfff640 1 -- 172.21.15.38:0/1189969052 learned_addr learned my addr 172.21.15.38:0/1189969052 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:52.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.760+0000 7fadbbfff640 1 -- 172.21.15.38:0/1189969052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadbc10b790 msgr2=0x7fadbc1a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:52.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.760+0000 7fadbbfff640 1 --2- 172.21.15.38:0/1189969052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadbc10b790 0x7fadbc1a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:52.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.760+0000 7fadbbfff640 1 -- 172.21.15.38:0/1189969052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb0009560 con 0x7fadbc10a8b0 2024-09-13T18:30:52.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.760+0000 7fadbbfff640 1 --2- 172.21.15.38:0/1189969052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadbc10a8b0 0x7fadbc19fef0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c8f0 tx=0x7fadac00cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:52.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.761+0000 7fadb97fa640 1 -- 172.21.15.38:0/1189969052 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadac0041f0 con 0x7fadbc10a8b0 2024-09-13T18:30:52.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.761+0000 7fadb97fa640 1 -- 172.21.15.38:0/1189969052 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fadac007df0 con 0x7fadbc10a8b0 2024-09-13T18:30:52.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.761+0000 7fadb97fa640 1 -- 172.21.15.38:0/1189969052 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadac003e70 con 0x7fadbc10a8b0 2024-09-13T18:30:52.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.761+0000 7fadc2662640 1 -- 172.21.15.38:0/1189969052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadbc1a55c0 con 0x7fadbc10a8b0 2024-09-13T18:30:52.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.761+0000 7fadc2662640 1 -- 172.21.15.38:0/1189969052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadbc1a5b10 con 0x7fadbc10a8b0 2024-09-13T18:30:52.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.763+0000 7fada2ffd640 1 -- 172.21.15.38:0/1189969052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c005250 con 0x7fadbc10a8b0 2024-09-13T18:30:52.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.763+0000 7fadb97fa640 1 -- 172.21.15.38:0/1189969052 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7fadac007950 con 0x7fadbc10a8b0 2024-09-13T18:30:52.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.764+0000 7fadb97fa640 1 --2- 172.21.15.38:0/1189969052 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fada406cde0 0x7fada406f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:52.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.764+0000 7fadb97fa640 1 -- 172.21.15.38:0/1189969052 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fadac013070 con 0x7fadbc10a8b0 2024-09-13T18:30:52.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.764+0000 7fadbb7fe640 1 --2- 172.21.15.38:0/1189969052 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fada406cde0 0x7fada406f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:52.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.764+0000 7fadbb7fe640 1 --2- 172.21.15.38:0/1189969052 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fada406cde0 0x7fada406f2a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fadb002a9c0 tx=0x7fadb0000bc0 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:52.771 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:52.768+0000 7fadb97fa640 1 -- 172.21.15.38:0/1189969052 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fadac056750 con 0x7fadbc10a8b0 2024-09-13T18:30:52.835 INFO:tasks.workunit.client.0.smithi038.stdout:9/848: sync 2024-09-13T18:30:52.835 INFO:tasks.workunit.client.0.smithi038.stdout:9/849: getdents d0/d7/d2c/d5e/d100 0 2024-09-13T18:30:52.835 INFO:tasks.workunit.client.0.smithi038.stdout:9/850: readlink d0/d7/d13/d2d/d3c/d50/l123 0 2024-09-13T18:30:52.836 INFO:tasks.workunit.client.0.smithi038.stdout:9/851: symlink d0/d7/d2c/d6d/de6/l12a 0 2024-09-13T18:30:52.836 INFO:tasks.workunit.client.0.smithi038.stdout:9/852: write d0/d7/d2c/d5a/d67/d9e/f6b [1011179,102601] 0 2024-09-13T18:30:52.837 INFO:tasks.workunit.client.0.smithi038.stdout:9/853: mkdir d0/d7/d122/d12b 0 2024-09-13T18:30:52.857 INFO:tasks.workunit.client.0.smithi038.stdout:9/854: dwrite d0/d7/d2c/d6d/fd1 [0,4194304] 0 2024-09-13T18:30:52.857 INFO:tasks.workunit.client.0.smithi038.stdout:9/855: fdatasync d0/d7/d13/d2d/d3e/d70/da2/f79 0 2024-09-13T18:30:52.858 INFO:tasks.workunit.client.0.smithi038.stdout:9/856: stat d0/c74 0 2024-09-13T18:30:52.860 INFO:tasks.workunit.client.0.smithi038.stdout:9/857: creat d0/d7/d13/d2d/d3c/dc9/f12c x:0 0 0 2024-09-13T18:30:52.860 INFO:tasks.workunit.client.0.smithi038.stdout:9/858: read d0/f1 [2806365,16495] 0 2024-09-13T18:30:52.881 INFO:tasks.workunit.client.0.smithi038.stdout:9/859: dwrite d0/d7/d2c/f49 [4194304,4194304] 0 2024-09-13T18:30:52.902 INFO:tasks.workunit.client.0.smithi038.stdout:9/860: dwrite d0/d7/d2c/d5e/fbb [0,4194304] 0 2024-09-13T18:30:52.905 INFO:tasks.workunit.client.0.smithi038.stdout:9/861: mknod d0/d2e/dc3/c12d 0 2024-09-13T18:30:52.907 INFO:tasks.workunit.client.0.smithi038.stdout:9/862: truncate d0/d7/d2c/d5a/dd8/f9f 3007770 0 2024-09-13T18:30:52.907 INFO:tasks.workunit.client.0.smithi038.stdout:9/863: chown d0/d7/d13/d2d/d3c/d50/l5f 6026 1 2024-09-13T18:30:52.907 INFO:tasks.workunit.client.0.smithi038.stdout:9/864: write d0/d7/d13/d2d/d3c/dfa/f116 [962113,105356] 0 2024-09-13T18:30:52.926 INFO:tasks.workunit.client.0.smithi038.stdout:9/865: dwrite d0/d2e/f11c [0,4194304] 0 2024-09-13T18:30:52.927 INFO:tasks.workunit.client.0.smithi038.stdout:9/866: creat d0/d7/d2c/d6d/de6/d128/f12e x:0 0 0 2024-09-13T18:30:52.936 INFO:tasks.workunit.client.0.smithi038.stdout:9/867: dread d0/d2e/d7f/f8e [0,4194304] 0 2024-09-13T18:30:52.936 INFO:tasks.workunit.client.0.smithi038.stdout:9/868: readlink d0/d7/d13/d2d/d3c/d50/l7a 0 2024-09-13T18:30:52.936 INFO:tasks.workunit.client.0.smithi038.stdout:9/869: rename d0 to d0/d7/d2c/d33/df8/d12f 22 2024-09-13T18:30:52.936 INFO:tasks.workunit.client.0.smithi038.stdout:9/870: write d0/d7/d13/d2d/d3c/ffe [311695,85746] 0 2024-09-13T18:30:52.938 INFO:tasks.workunit.client.0.smithi038.stdout:9/871: mknod d0/d7/d13/d2d/d3e/d70/c130 0 2024-09-13T18:30:52.942 INFO:tasks.workunit.client.0.smithi038.stdout:9/872: dread d0/f2f [0,4194304] 0 2024-09-13T18:30:52.942 INFO:tasks.workunit.client.0.smithi038.stdout:9/873: truncate d0/d7/d13/d2d/d3e/d70/da2/d86/fe4 972311 0 2024-09-13T18:30:52.942 INFO:tasks.workunit.client.0.smithi038.stdout:9/874: write d0/d7/d13/f101 [527276,18628] 0 2024-09-13T18:30:52.949 INFO:tasks.workunit.client.0.smithi038.stdout:9/875: dread d0/d7/d13/d2d/d3c/d50/d94/ff6 [0,4194304] 0 2024-09-13T18:30:52.950 INFO:tasks.workunit.client.0.smithi038.stdout:9/876: getdents d0/d7/d2c/d5a/d67 0 2024-09-13T18:30:52.952 INFO:tasks.workunit.client.0.smithi038.stdout:9/877: creat d0/d7/d2c/d33/d4a/f131 x:0 0 0 2024-09-13T18:30:52.953 INFO:tasks.workunit.client.0.smithi038.stdout:9/878: creat d0/d7/d2c/f132 x:0 0 0 2024-09-13T18:30:52.953 INFO:tasks.workunit.client.0.smithi038.stdout:9/879: write d0/d7/d13/d2d/d3e/d70/da2/d86/fe4 [1526826,127510] 0 2024-09-13T18:30:52.954 INFO:tasks.workunit.client.0.smithi038.stdout:9/880: creat d0/d7/d2c/d33/d4a/dcf/f133 x:0 0 0 2024-09-13T18:30:52.954 INFO:tasks.workunit.client.0.smithi038.stdout:9/881: truncate d0/d7/d2c/d33/f96 188638 0 2024-09-13T18:30:52.955 INFO:tasks.workunit.client.0.smithi038.stdout:9/882: symlink d0/d7/d13/d2d/d3c/d50/d112/l134 0 2024-09-13T18:30:52.955 INFO:tasks.workunit.client.0.smithi038.stdout:9/883: readlink d0/d7/l24 0 2024-09-13T18:30:52.957 INFO:tasks.workunit.client.0.smithi038.stdout:9/884: mkdir d0/d7/d2c/d5a/d135 0 2024-09-13T18:30:52.957 INFO:tasks.workunit.client.0.smithi038.stdout:9/885: write d0/d7/fb5 [1027369,29932] 0 2024-09-13T18:30:52.957 INFO:tasks.workunit.client.0.smithi038.stdout:9/886: creat d0/d7/d13/d2d/d3e/d70/da2/d86/f136 x:0 0 0 2024-09-13T18:30:52.974 INFO:tasks.workunit.client.0.smithi038.stdout:9/887: dwrite d0/d7/d2c/d5a/f72 [12582912,4194304] 0 2024-09-13T18:30:52.974 INFO:tasks.workunit.client.0.smithi038.stdout:9/888: fsync d0/d7/d13/d2d/d3c/d50/f65 0 2024-09-13T18:30:52.983 INFO:tasks.workunit.client.0.smithi038.stdout:9/889: dread d0/d7/d2c/d5e/fbb [0,4194304] 0 2024-09-13T18:30:52.985 INFO:tasks.workunit.client.0.smithi038.stdout:9/890: creat d0/d7/d2c/d5a/dd8/f137 x:0 0 0 2024-09-13T18:30:52.999 INFO:tasks.workunit.client.0.smithi038.stdout:9/891: truncate d0/d7/d2c/d5a/f72 11141593 0 2024-09-13T18:30:53.015 INFO:tasks.workunit.client.0.smithi038.stdout:9/892: dwrite d0/dac/f102 [0,4194304] 0 2024-09-13T18:30:53.019 INFO:tasks.workunit.client.0.smithi038.stdout:9/893: dread d0/d7/d13/d2d/d3c/f3f [0,4194304] 0 2024-09-13T18:30:53.019 INFO:tasks.workunit.client.0.smithi038.stdout:9/894: chown d0/d7/d2c/d5a/d67/d10d 11169 1 2024-09-13T18:30:53.020 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:52 smithi038 ceph-mon[27689]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:53.020 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:52 smithi038 ceph-mon[27689]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:53.021 INFO:tasks.workunit.client.0.smithi038.stdout:9/895: creat d0/d7/d2c/d33/d4a/df0/f138 x:0 0 0 2024-09-13T18:30:53.025 INFO:tasks.workunit.client.0.smithi038.stdout:9/896: rename d0/d7/d2c/dbf to d0/d139 0 2024-09-13T18:30:53.040 INFO:tasks.workunit.client.0.smithi038.stdout:9/897: dwrite d0/d139/fda [0,4194304] 0 2024-09-13T18:30:53.041 INFO:tasks.workunit.client.0.smithi038.stdout:9/898: write d0/d7/d2c/d5a/fe3 [384311,124216] 0 2024-09-13T18:30:53.048 INFO:tasks.workunit.client.0.smithi038.stdout:9/899: write d0/d7/d13/d2d/d3c/dc9/fee [4079651,70477] 0 2024-09-13T18:30:53.049 INFO:tasks.workunit.client.0.smithi038.stdout:9/900: symlink d0/d7/d2c/d5a/d67/d10d/l13a 0 2024-09-13T18:30:53.050 INFO:tasks.workunit.client.0.smithi038.stdout:9/901: rename d0/d7/c15 to d0/d7/d13/d2d/d3e/d70/da2/d86/c13b 0 2024-09-13T18:30:53.050 INFO:tasks.workunit.client.0.smithi038.stdout:9/902: truncate d0/d7/d13/f85 5161691 0 2024-09-13T18:30:53.052 INFO:tasks.workunit.client.0.smithi038.stdout:9/903: link d0/d7/l24 d0/d7/d2c/d5e/d100/l13c 0 2024-09-13T18:30:53.052 INFO:tasks.workunit.client.0.smithi038.stdout:9/904: truncate d0/d7/d2c/d5a/da4/f121 1598128 0 2024-09-13T18:30:53.070 INFO:tasks.workunit.client.0.smithi038.stdout:9/905: dwrite d0/d7/d2c/d5a/f72 [4194304,4194304] 0 2024-09-13T18:30:53.070 INFO:tasks.workunit.client.0.smithi038.stdout:9/906: chown d0/d7/d2c/d33/fca 8 1 2024-09-13T18:30:53.070 INFO:tasks.workunit.client.0.smithi038.stdout:9/907: chown d0/d7/d2c/d33/f4c 71 1 2024-09-13T18:30:53.071 INFO:tasks.workunit.client.0.smithi038.stdout:9/908: symlink d0/d7/d13/d2d/l13d 0 2024-09-13T18:30:53.071 INFO:tasks.workunit.client.0.smithi038.stdout:9/909: truncate d0/d7/d13/d2d/d3c/d50/f98 1675448 0 2024-09-13T18:30:53.072 INFO:tasks.workunit.client.0.smithi038.stdout:9/910: unlink d0/d7/d2c/d5a/da4/cb9 0 2024-09-13T18:30:53.072 INFO:tasks.workunit.client.0.smithi038.stdout:9/911: stat d0/c74 0 2024-09-13T18:30:53.081 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.079+0000 7fada2ffd640 1 -- 172.21.15.38:0/1189969052 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fad9c0057d0 con 0x7fadbc10a8b0 2024-09-13T18:30:53.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.080+0000 7fadb97fa640 1 -- 172.21.15.38:0/1189969052 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+838 (secure 0 0 0) 0x7fadac059d70 con 0x7fadbc10a8b0 2024-09-13T18:30:53.083 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:30:53.083 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:30:53.083 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T18:30:53.083 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:30:53.083 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 1, 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 1 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 13, 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 1 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:30:53.084 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:30:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.083+0000 7fada2ffd640 1 -- 172.21.15.38:0/1189969052 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fada406cde0 msgr2=0x7fada406f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.083+0000 7fada2ffd640 1 --2- 172.21.15.38:0/1189969052 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fada406cde0 0x7fada406f2a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fadb002a9c0 tx=0x7fadb0000bc0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.083+0000 7fada2ffd640 1 -- 172.21.15.38:0/1189969052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadbc10a8b0 msgr2=0x7fadbc19fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.083+0000 7fada2ffd640 1 --2- 172.21.15.38:0/1189969052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadbc10a8b0 0x7fadbc19fef0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c8f0 tx=0x7fadac00cdb0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.084+0000 7fada2ffd640 1 -- 172.21.15.38:0/1189969052 shutdown_connections 2024-09-13T18:30:53.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.084+0000 7fada2ffd640 1 --2- 172.21.15.38:0/1189969052 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7fada406cde0 0x7fada406f2a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.084+0000 7fada2ffd640 1 --2- 172.21.15.38:0/1189969052 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fadbc10b790 0x7fadbc1a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.084+0000 7fada2ffd640 1 --2- 172.21.15.38:0/1189969052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fadbc10a8b0 0x7fadbc19fef0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.084+0000 7fada2ffd640 1 -- 172.21.15.38:0/1189969052 >> 172.21.15.38:0/1189969052 conn(0x7fadbc069fe0 msgr2=0x7fadbc10e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:53.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.084+0000 7fada2ffd640 1 -- 172.21.15.38:0/1189969052 shutdown_connections 2024-09-13T18:30:53.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.084+0000 7fada2ffd640 1 -- 172.21.15.38:0/1189969052 wait complete. 2024-09-13T18:30:53.091 INFO:tasks.workunit.client.0.smithi038.stdout:9/912: dwrite d0/d7/fb5 [0,4194304] 0 2024-09-13T18:30:53.095 INFO:tasks.workunit.client.0.smithi038.stdout:9/913: truncate d0/d7/d2c/d5a/f64 155916 0 2024-09-13T18:30:53.095 INFO:tasks.workunit.client.0.smithi038.stdout:9/914: fsync d0/d2e/dc3/ff4 0 2024-09-13T18:30:53.103 INFO:tasks.workunit.client.0.smithi038.stdout:9/915: write d0/dac/f102 [3396192,6988] 0 2024-09-13T18:30:53.105 INFO:tasks.workunit.client.0.smithi038.stdout:9/916: rename d0/d7/d13/db8 to d0/d7/d122/d13e 0 2024-09-13T18:30:53.127 INFO:tasks.workunit.client.0.smithi038.stdout:9/917: dread d0/d7/d13/d30/fd7 [0,4194304] 0 2024-09-13T18:30:53.144 INFO:tasks.workunit.client.0.smithi038.stdout:9/918: dwrite d0/d7/d2c/d33/d4a/ff3 [0,4194304] 0 2024-09-13T18:30:53.144 INFO:tasks.workunit.client.0.smithi038.stdout:9/919: chown d0/d7/d2c/f132 30509 1 2024-09-13T18:30:53.145 INFO:tasks.workunit.client.0.smithi038.stdout:9/920: getdents d0/d7/d2c/d5a/d67 0 2024-09-13T18:30:53.146 INFO:tasks.workunit.client.0.smithi038.stdout:9/921: mknod d0/d7/d2c/d5a/da4/c13f 0 2024-09-13T18:30:53.146 INFO:tasks.workunit.client.0.smithi038.stdout:9/922: truncate d0/d7/d13/d2d/ff2 1039366 0 2024-09-13T18:30:53.167 INFO:tasks.workunit.client.0.smithi038.stdout:9/923: dwrite d0/d7/d2c/fa7 [0,4194304] 0 2024-09-13T18:30:53.169 INFO:tasks.workunit.client.0.smithi038.stdout:9/924: rename d0/d7/d2c/cf9 to d0/d7/d13/d2d/d3e/df7/c140 0 2024-09-13T18:30:53.169 INFO:tasks.workunit.client.0.smithi038.stdout:9/925: chown d0/d7/d13/d2d/d3e/c48 0 1 2024-09-13T18:30:53.173 INFO:tasks.workunit.client.0.smithi038.stdout:9/926: rename d0/d7/d13/d2d/d3c/d50 to d0/d2e/d7f/d141 0 2024-09-13T18:30:53.175 INFO:tasks.workunit.client.0.smithi038.stdout:9/927: getdents d0/d2e/d7f/dd3 0 2024-09-13T18:30:53.176 INFO:tasks.workunit.client.0.smithi038.stdout:9/928: truncate d0/d7/d2c/d33/ffb 2498217 0 2024-09-13T18:30:53.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.192+0000 7f50dce1c640 1 -- 172.21.15.38:0/636196197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50d80ffb90 msgr2=0x7f50d80fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.192+0000 7f50dce1c640 1 --2- 172.21.15.38:0/636196197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50d80ffb90 0x7f50d80fff90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009880 tx=0x7f50c802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.195 INFO:tasks.workunit.client.0.smithi038.stdout:9/929: dwrite d0/d7/d13/d2d/f6a [0,4194304] 0 2024-09-13T18:30:53.195 INFO:tasks.workunit.client.0.smithi038.stdout:9/930: chown d0/d7/d13/d2d/d3c/dc9/l129 15357 1 2024-09-13T18:30:53.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.192+0000 7f50dce1c640 1 -- 172.21.15.38:0/636196197 shutdown_connections 2024-09-13T18:30:53.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.192+0000 7f50dce1c640 1 --2- 172.21.15.38:0/636196197 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d8100d90 0x7f50d8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.192+0000 7f50dce1c640 1 --2- 172.21.15.38:0/636196197 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50d80ffb90 0x7f50d80fff90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.193+0000 7f50dce1c640 1 -- 172.21.15.38:0/636196197 >> 172.21.15.38:0/636196197 conn(0x7f50d80fb360 msgr2=0x7f50d80fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:53.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.193+0000 7f50dce1c640 1 -- 172.21.15.38:0/636196197 shutdown_connections 2024-09-13T18:30:53.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.193+0000 7f50dce1c640 1 -- 172.21.15.38:0/636196197 wait complete. 2024-09-13T18:30:53.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.193+0000 7f50dce1c640 1 Processor -- start 2024-09-13T18:30:53.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.194+0000 7f50dce1c640 1 -- start start 2024-09-13T18:30:53.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.194+0000 7f50dce1c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50d80ffb90 0x7f50d8195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.194+0000 7f50dce1c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d8100d90 0x7f50d8195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.194+0000 7f50dce1c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8196040 con 0x7f50d80ffb90 2024-09-13T18:30:53.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.194+0000 7f50dce1c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d81961b0 con 0x7f50d8100d90 2024-09-13T18:30:53.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.194+0000 7f50d659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50d80ffb90 0x7f50d8195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.194+0000 7f50d5d9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d8100d90 0x7f50d8195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.194+0000 7f50d659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50d80ffb90 0x7f50d8195530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50908/0 (socket says 172.21.15.38:50908) 2024-09-13T18:30:53.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.194+0000 7f50d659c640 1 -- 172.21.15.38:0/1793074375 learned_addr learned my addr 172.21.15.38:0/1793074375 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:53.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.195+0000 7f50d659c640 1 -- 172.21.15.38:0/1793074375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d8100d90 msgr2=0x7f50d8195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.195+0000 7f50d659c640 1 --2- 172.21.15.38:0/1793074375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d8100d90 0x7f50d8195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.195+0000 7f50d659c640 1 -- 172.21.15.38:0/1793074375 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c8009560 con 0x7f50d80ffb90 2024-09-13T18:30:53.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.195+0000 7f50d659c640 1 --2- 172.21.15.38:0/1793074375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50d80ffb90 0x7f50d8195530 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f50c8006010 tx=0x7f50c80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:53.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.195+0000 7f50c77fe640 1 -- 172.21.15.38:0/1793074375 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50c8004aa0 con 0x7f50d80ffb90 2024-09-13T18:30:53.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.195+0000 7f50dce1c640 1 -- 172.21.15.38:0/1793074375 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d806a010 con 0x7f50d80ffb90 2024-09-13T18:30:53.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.195+0000 7f50c77fe640 1 -- 172.21.15.38:0/1793074375 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f50c8005d50 con 0x7f50d80ffb90 2024-09-13T18:30:53.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.195+0000 7f50c77fe640 1 -- 172.21.15.38:0/1793074375 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50c8031950 con 0x7f50d80ffb90 2024-09-13T18:30:53.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.196+0000 7f50dce1c640 1 -- 172.21.15.38:0/1793074375 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d806a580 con 0x7f50d80ffb90 2024-09-13T18:30:53.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.198+0000 7f50dce1c640 1 -- 172.21.15.38:0/1793074375 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d8108640 con 0x7f50d80ffb90 2024-09-13T18:30:53.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.199+0000 7f50c77fe640 1 -- 172.21.15.38:0/1793074375 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f50c8004c00 con 0x7f50d80ffb90 2024-09-13T18:30:53.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.200+0000 7f50c77fe640 1 --2- 172.21.15.38:0/1793074375 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f50c006cd80 0x7f50c006f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.200+0000 7f50c77fe640 1 -- 172.21.15.38:0/1793074375 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f50c80ad5e0 con 0x7f50d80ffb90 2024-09-13T18:30:53.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.200+0000 7f50d5d9b640 1 --2- 172.21.15.38:0/1793074375 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f50c006cd80 0x7f50c006f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.201+0000 7f50d5d9b640 1 --2- 172.21.15.38:0/1793074375 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f50c006cd80 0x7f50c006f240 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f50d8196a50 tx=0x7f50cc005f90 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:53.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.206+0000 7f50c77fe640 1 -- 172.21.15.38:0/1793074375 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f50c80776c0 con 0x7f50d80ffb90 2024-09-13T18:30:53.212 INFO:tasks.workunit.client.0.smithi038.stdout:9/931: dwrite d0/d7/d13/d30/fc7 [0,4194304] 0 2024-09-13T18:30:53.213 INFO:tasks.workunit.client.0.smithi038.stdout:9/932: creat d0/d7/d122/f142 x:0 0 0 2024-09-13T18:30:53.214 INFO:tasks.workunit.client.0.smithi038.stdout:9/933: mknod d0/d7/d13/d2d/d3e/df7/c143 0 2024-09-13T18:30:53.216 INFO:tasks.workunit.client.0.smithi038.stdout:9/934: mknod d0/d7/d2c/d6d/de6/d128/c144 0 2024-09-13T18:30:53.224 INFO:tasks.workunit.client.0.smithi038.stdout:9/935: rmdir d0/d7/d13 39 2024-09-13T18:30:53.224 INFO:tasks.workunit.client.0.smithi038.stdout:9/936: dread - d0/d7/d2c/d5a/d67/f87 zero size 2024-09-13T18:30:53.229 INFO:tasks.workunit.client.0.smithi038.stdout:9/937: dread d0/d2e/fb2 [0,4194304] 0 2024-09-13T18:30:53.230 INFO:tasks.workunit.client.0.smithi038.stdout:9/938: mknod d0/d7/d13/d2d/d3e/d70/c145 0 2024-09-13T18:30:53.230 INFO:tasks.workunit.client.0.smithi038.stdout:9/939: chown d0/d7/d2c/d33/la8 807 1 2024-09-13T18:30:53.237 INFO:tasks.workunit.client.0.smithi038.stdout:9/940: write d0/d7/d2c/d5a/f64 [97027,98281] 0 2024-09-13T18:30:53.239 INFO:tasks.workunit.client.0.smithi038.stdout:9/941: getdents d0/d7/d2c/d5a/d67/d10d 0 2024-09-13T18:30:53.241 INFO:tasks.workunit.client.0.smithi038.stdout:9/942: creat d0/d7/d2c/f146 x:0 0 0 2024-09-13T18:30:53.241 INFO:tasks.workunit.client.0.smithi038.stdout:9/943: write d0/f1 [2315847,103364] 0 2024-09-13T18:30:53.243 INFO:tasks.workunit.client.0.smithi038.stdout:9/944: mkdir d0/d7/d2c/d5e/d100/d147 0 2024-09-13T18:30:53.256 INFO:tasks.workunit.client.0.smithi038.stdout:9/945: truncate d0/d7/d13/d30/fc7 1554817 0 2024-09-13T18:30:53.256 INFO:tasks.workunit.client.0.smithi038.stdout:9/946: chown d0/d2e/d7f/d141/da5 2141562 1 2024-09-13T18:30:53.256 INFO:tasks.workunit.client.0.smithi038.stdout:9/947: write d0/d7/d13/d2d/fb4 [36454,57443] 0 2024-09-13T18:30:53.257 INFO:tasks.workunit.client.0.smithi038.stdout:9/948: truncate d0/d7/d2c/d33/d4a/dcf/fe2 327294 0 2024-09-13T18:30:53.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:52 smithi149 ceph-mon[35845]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:53.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:52 smithi149 ceph-mon[35845]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:53.274 INFO:tasks.workunit.client.0.smithi038.stdout:9/949: dwrite d0/d7/d13/d2d/f39 [0,4194304] 0 2024-09-13T18:30:53.294 INFO:tasks.workunit.client.0.smithi038.stdout:9/950: dwrite d0/d7/d13/d30/f6f [0,4194304] 0 2024-09-13T18:30:53.297 INFO:tasks.workunit.client.0.smithi038.stdout:9/951: fdatasync d0/d7/d13/d2d/d3e/d70/da2/d86/fe4 0 2024-09-13T18:30:53.298 INFO:tasks.workunit.client.0.smithi038.stdout:9/952: dread d0/d7/d2c/d5e/f97 [0,4194304] 0 2024-09-13T18:30:53.298 INFO:tasks.workunit.client.0.smithi038.stdout:9/953: chown d0/d7/d13/d2d/d3e/fea 11 1 2024-09-13T18:30:53.298 INFO:tasks.workunit.client.0.smithi038.stdout:9/954: dread - d0/d7/d13/d30/f10e zero size 2024-09-13T18:30:53.300 INFO:tasks.workunit.client.0.smithi038.stdout:9/955: mknod d0/d2e/dc3/c148 0 2024-09-13T18:30:53.302 INFO:tasks.workunit.client.0.smithi038.stdout:9/956: stat d0/d7/l8c 0 2024-09-13T18:30:53.302 INFO:tasks.workunit.client.0.smithi038.stdout:9/957: chown d0/d7/d13/d2d/l13d 503 1 2024-09-13T18:30:53.304 INFO:tasks.workunit.client.0.smithi038.stdout:9/958: unlink d0/d7/d2c/d5a/d67/d10d/f11b 0 2024-09-13T18:30:53.313 INFO:tasks.workunit.client.0.smithi038.stdout:9/959: dread d0/d7/f31 [0,4194304] 0 2024-09-13T18:30:53.314 INFO:tasks.workunit.client.0.smithi038.stdout:9/960: symlink d0/d2e/d7f/d141/d112/l149 0 2024-09-13T18:30:53.314 INFO:tasks.workunit.client.0.smithi038.stdout:9/961: truncate d0/d7/d2c/d33/d4a/dcf/f133 743376 0 2024-09-13T18:30:53.322 INFO:tasks.workunit.client.0.smithi038.stdout:9/962: write d0/d7/d13/f85 [1801333,94467] 0 2024-09-13T18:30:53.322 INFO:tasks.workunit.client.0.smithi038.stdout:9/963: write d0/d2e/d7f/d141/fdb [9782,55344] 0 2024-09-13T18:30:53.322 INFO:tasks.workunit.client.0.smithi038.stdout:9/964: chown d0/d7/d2c/d5a/dd8/f9f 66407831 1 2024-09-13T18:30:53.322 INFO:tasks.workunit.client.0.smithi038.stdout:9/965: write d0/d7/d2c/f132 [725533,42562] 0 2024-09-13T18:30:53.343 INFO:tasks.workunit.client.0.smithi038.stdout:9/966: dwrite d0/d7/d2c/fa7 [0,4194304] 0 2024-09-13T18:30:53.344 INFO:tasks.workunit.client.0.smithi038.stdout:9/967: link d0/d2e/d7f/d141/fce d0/d7/d2c/d33/f14a 0 2024-09-13T18:30:53.345 INFO:tasks.workunit.client.0.smithi038.stdout:9/968: chown d0/d7/d13/d2d/d3e/d70/da2/da6 1658 1 2024-09-13T18:30:53.346 INFO:tasks.workunit.client.0.smithi038.stdout:9/969: creat d0/d7/d2c/d5a/d67/d10d/f14b x:0 0 0 2024-09-13T18:30:53.368 INFO:tasks.workunit.client.0.smithi038.stdout:9/970: dwrite d0/d7/d2c/d5e/fbb [0,4194304] 0 2024-09-13T18:30:53.368 INFO:tasks.workunit.client.0.smithi038.stdout:9/971: readlink d0/d7/d13/d30/l53 0 2024-09-13T18:30:53.375 INFO:tasks.workunit.client.0.smithi038.stdout:9/972: dread d0/d7/d2c/d5e/f80 [0,4194304] 0 2024-09-13T18:30:53.375 INFO:tasks.workunit.client.0.smithi038.stdout:9/973: dread - d0/d7/d2c/d33/d4a/f131 zero size 2024-09-13T18:30:53.382 INFO:tasks.workunit.client.0.smithi038.stdout:9/974: dread d0/d7/d2c/d5a/fe3 [0,4194304] 0 2024-09-13T18:30:53.382 INFO:tasks.workunit.client.0.smithi038.stdout:9/975: dread - d0/d7/d2c/d5a/dd8/f137 zero size 2024-09-13T18:30:53.382 INFO:tasks.workunit.client.0.smithi038.stdout:9/976: fsync d0/d7/d2c/d6d/d9c/fe5 0 2024-09-13T18:30:53.385 INFO:tasks.workunit.client.0.smithi038.stdout:9/977: dread d0/d7/d2c/d33/ffb [0,4194304] 0 2024-09-13T18:30:53.387 INFO:tasks.workunit.client.0.smithi038.stdout:9/978: rename d0/d7/d13/d2d/d3e/df7/c140 to d0/d7/d122/d12b/c14c 0 2024-09-13T18:30:53.388 INFO:tasks.workunit.client.0.smithi038.stdout:9/979: symlink d0/d7/d2c/d5e/dc5/l14d 0 2024-09-13T18:30:53.389 INFO:tasks.workunit.client.0.smithi038.stdout:9/980: mkdir d0/d7/d2c/d5a/d67/d10d/d14e 0 2024-09-13T18:30:53.390 INFO:tasks.workunit.client.0.smithi038.stdout:9/981: unlink d0/d7/d2c/d5a/d67/d9e/f6b 0 2024-09-13T18:30:53.392 INFO:tasks.workunit.client.0.smithi038.stdout:9/982: creat d0/d7/d13/d2d/d106/f14f x:0 0 0 2024-09-13T18:30:53.394 INFO:tasks.workunit.client.0.smithi038.stdout:9/983: mkdir d0/d7/d2c/d5a/da4/d150 0 2024-09-13T18:30:53.394 INFO:tasks.workunit.client.0.smithi038.stdout:9/984: getdents d0/d7/d2c/d5a/d67/d10d/d14e 0 2024-09-13T18:30:53.394 INFO:tasks.workunit.client.0.smithi038.stdout:9/985: creat d0/d2e/d7f/f151 x:0 0 0 2024-09-13T18:30:53.395 INFO:tasks.workunit.client.0.smithi038.stdout:9/986: mknod d0/d7/d13/d2d/d3e/d70/c152 0 2024-09-13T18:30:53.398 INFO:tasks.workunit.client.0.smithi038.stdout:9/987: rename d0/d7/d13/d2d/d3e/d70/da2/c8b to d0/d7/d2c/d6d/de6/df1/c153 0 2024-09-13T18:30:53.402 INFO:tasks.workunit.client.0.smithi038.stdout:9/988: dread d0/d7/d13/d2d/d3c/ffe [0,4194304] 0 2024-09-13T18:30:53.404 INFO:tasks.workunit.client.0.smithi038.stdout:9/989: mknod d0/d7/d13/d2d/d106/c154 0 2024-09-13T18:30:53.404 INFO:tasks.workunit.client.0.smithi038.stdout:9/990: write d0/d7/d2c/d33/fca [1914627,10241] 0 2024-09-13T18:30:53.404 INFO:tasks.workunit.client.0.smithi038.stdout:9/991: readlink d0/d2e/d7f/dd3/lfd 0 2024-09-13T18:30:53.405 INFO:tasks.workunit.client.0.smithi038.stdout:9/992: creat d0/d7/d2c/d5a/da4/f155 x:0 0 0 2024-09-13T18:30:53.405 INFO:tasks.workunit.client.0.smithi038.stdout:9/993: read d0/d7/d13/f66 [587395,37057] 0 2024-09-13T18:30:53.405 INFO:tasks.workunit.client.0.smithi038.stdout:9/994: fdatasync d0/d7/d13/d2d/d3e/d70/da2/da6/fb1 0 2024-09-13T18:30:53.406 INFO:tasks.workunit.client.0.smithi038.stdout:9/995: link d0/d7/d2c/f132 d0/dac/f156 0 2024-09-13T18:30:53.407 INFO:tasks.workunit.client.0.smithi038.stdout:9/996: stat d0/d7/d13/l99 0 2024-09-13T18:30:53.432 INFO:tasks.workunit.client.0.smithi038.stdout:9/997: truncate d0/d2e/d7f/d141/fff 4030628 0 2024-09-13T18:30:53.452 INFO:tasks.workunit.client.0.smithi038.stdout:9/998: dwrite d0/d7/d2c/d33/f10c [0,4194304] 0 2024-09-13T18:30:53.460 INFO:tasks.workunit.client.0.smithi038.stdout:9/999: write d0/d2e/f11c [1442542,112897] 0 2024-09-13T18:30:53.464 INFO:tasks.workunit.client.0.smithi038.stderr:+ rm -rf -- ./tmp.REO17CeZ0B 2024-09-13T18:30:53.551 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:30:53.551 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:30:53.551 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:30:53.551 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:30:53.551 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:30:53.551 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:30:53.551 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:30:53.551 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:30:53.551 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:30:53.552 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:30:53.553 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:30:53.553 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:30:53.553 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:30:53.553 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:30:53.553 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:30:53.553 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:30:53.553 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:30:53.553 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:30:53.553 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:30:53.553 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:30:53.553 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:30:53.553 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:30:53.554 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:30:53.554 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:30:53.554 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:30:53.554 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:30:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.547+0000 7f50dce1c640 1 -- 172.21.15.38:0/1793074375 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f50d806acd0 con 0x7f50d80ffb90 2024-09-13T18:30:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.548+0000 7f50c77fe640 1 -- 172.21.15.38:0/1793074375 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7f50c807ace0 con 0x7f50d80ffb90 2024-09-13T18:30:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:30:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.551+0000 7f50dce1c640 1 -- 172.21.15.38:0/1793074375 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f50c006cd80 msgr2=0x7f50c006f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.551+0000 7f50dce1c640 1 --2- 172.21.15.38:0/1793074375 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f50c006cd80 0x7f50c006f240 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f50d8196a50 tx=0x7f50cc005f90 comp rx=0 tx=0).stop 2024-09-13T18:30:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.551+0000 7f50dce1c640 1 -- 172.21.15.38:0/1793074375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50d80ffb90 msgr2=0x7f50d8195530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.551+0000 7f50dce1c640 1 --2- 172.21.15.38:0/1793074375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50d80ffb90 0x7f50d8195530 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f50c8006010 tx=0x7f50c80055a0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.551+0000 7f50dce1c640 1 -- 172.21.15.38:0/1793074375 shutdown_connections 2024-09-13T18:30:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.551+0000 7f50dce1c640 1 --2- 172.21.15.38:0/1793074375 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f50c006cd80 0x7f50c006f240 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.551+0000 7f50dce1c640 1 --2- 172.21.15.38:0/1793074375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50d8100d90 0x7f50d8195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.551+0000 7f50dce1c640 1 --2- 172.21.15.38:0/1793074375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f50d80ffb90 0x7f50d8195530 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.551+0000 7f50dce1c640 1 -- 172.21.15.38:0/1793074375 >> 172.21.15.38:0/1793074375 conn(0x7f50d80fb360 msgr2=0x7f50d8103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.551+0000 7f50dce1c640 1 -- 172.21.15.38:0/1793074375 shutdown_connections 2024-09-13T18:30:53.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.551+0000 7f50dce1c640 1 -- 172.21.15.38:0/1793074375 wait complete. 2024-09-13T18:30:53.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.672+0000 7f4061d9b640 1 -- 172.21.15.38:0/3605554844 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c032d00 con 0x7f4064107890 2024-09-13T18:30:53.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.673+0000 7f4069213640 1 -- 172.21.15.38:0/3605554844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064107890 msgr2=0x7f4064107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.675 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.673+0000 7f4069213640 1 --2- 172.21.15.38:0/3605554844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064107890 0x7f4064107c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f405c00afd0 tx=0x7f405c02b510 comp rx=0 tx=0).stop 2024-09-13T18:30:53.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.673+0000 7f4069213640 1 -- 172.21.15.38:0/3605554844 shutdown_connections 2024-09-13T18:30:53.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.673+0000 7f4069213640 1 --2- 172.21.15.38:0/3605554844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4064070fe0 0x7f4064071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.673+0000 7f4069213640 1 --2- 172.21.15.38:0/3605554844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064107890 0x7f4064107c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.673+0000 7f4069213640 1 -- 172.21.15.38:0/3605554844 >> 172.21.15.38:0/3605554844 conn(0x7f406406cc10 msgr2=0x7f406406f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:53.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.673+0000 7f4069213640 1 -- 172.21.15.38:0/3605554844 shutdown_connections 2024-09-13T18:30:53.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.673+0000 7f4069213640 1 -- 172.21.15.38:0/3605554844 wait complete. 2024-09-13T18:30:53.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.674+0000 7f4069213640 1 Processor -- start 2024-09-13T18:30:53.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.674+0000 7f4069213640 1 -- start start 2024-09-13T18:30:53.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.674+0000 7f4069213640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4064070fe0 0x7f40640727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.674+0000 7f4069213640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064107890 0x7f4064072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.674+0000 7f4069213640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4064073250 con 0x7f4064070fe0 2024-09-13T18:30:53.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.674+0000 7f4069213640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40640733c0 con 0x7f4064107890 2024-09-13T18:30:53.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.675+0000 7f4062d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4064070fe0 0x7f40640727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.675+0000 7f4062d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4064070fe0 0x7f40640727d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50916/0 (socket says 172.21.15.38:50916) 2024-09-13T18:30:53.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.675+0000 7f4062d9d640 1 -- 172.21.15.38:0/174530551 learned_addr learned my addr 172.21.15.38:0/174530551 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:53.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.675+0000 7f406259c640 1 --2- 172.21.15.38:0/174530551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064107890 0x7f4064072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.676+0000 7f4062d9d640 1 -- 172.21.15.38:0/174530551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064107890 msgr2=0x7f4064072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.676+0000 7f4062d9d640 1 --2- 172.21.15.38:0/174530551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064107890 0x7f4064072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.676+0000 7f4062d9d640 1 -- 172.21.15.38:0/174530551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0078e0 con 0x7f4064070fe0 2024-09-13T18:30:53.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.676+0000 7f4062d9d640 1 --2- 172.21.15.38:0/174530551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4064070fe0 0x7f40640727d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f405c007bd0 tx=0x7f405c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:53.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.677+0000 7f405bfff640 1 -- 172.21.15.38:0/174530551 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c007ea0 con 0x7f4064070fe0 2024-09-13T18:30:53.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.677+0000 7f405bfff640 1 -- 172.21.15.38:0/174530551 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f405c032d70 con 0x7f4064070fe0 2024-09-13T18:30:53.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.677+0000 7f405bfff640 1 -- 172.21.15.38:0/174530551 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c03dc40 con 0x7f4064070fe0 2024-09-13T18:30:53.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.678+0000 7f4069213640 1 -- 172.21.15.38:0/174530551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4064073640 con 0x7f4064070fe0 2024-09-13T18:30:53.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.678+0000 7f4069213640 1 -- 172.21.15.38:0/174530551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4064073be0 con 0x7f4064070fe0 2024-09-13T18:30:53.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.680+0000 7f4069213640 1 -- 172.21.15.38:0/174530551 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4064071460 con 0x7f4064070fe0 2024-09-13T18:30:53.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.681+0000 7f405bfff640 1 -- 172.21.15.38:0/174530551 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f405c039040 con 0x7f4064070fe0 2024-09-13T18:30:53.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.682+0000 7f405bfff640 1 --2- 172.21.15.38:0/174530551 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f405006cef0 0x7f405006f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:53.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.682+0000 7f405bfff640 1 -- 172.21.15.38:0/174530551 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f405c0ac470 con 0x7f4064070fe0 2024-09-13T18:30:53.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.683+0000 7f406259c640 1 --2- 172.21.15.38:0/174530551 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f405006cef0 0x7f405006f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:53.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.683+0000 7f406259c640 1 --2- 172.21.15.38:0/174530551 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f405006cef0 0x7f405006f3b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f40640835d0 tx=0x7f4054005f90 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:53.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.691+0000 7f405bfff640 1 -- 172.21.15.38:0/174530551 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f405c076490 con 0x7f4064070fe0 2024-09-13T18:30:53.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.966+0000 7f4069213640 1 -- 172.21.15.38:0/174530551 --> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f406407ca60 con 0x7f405006cef0 2024-09-13T18:30:53.969 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:53 smithi038 ceph-mon[27689]: pgmap v29: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 152 MiB/s rd, 187 MiB/s wr, 383 op/s 2024-09-13T18:30:53.969 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:53 smithi038 ceph-mon[27689]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:53.970 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:53 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1189969052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:30:53.970 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:53 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1793074375' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:30:53.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.967+0000 7f405bfff640 1 -- 172.21.15.38:0/174530551 <== mgr.24387 v2:172.21.15.149:6828/2070517292 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f406407ca60 con 0x7f405006cef0 2024-09-13T18:30:53.971 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:30:53.971 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:30:53.971 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:30:53.971 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:30:53.971 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [], 2024-09-13T18:30:53.971 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "1/23 daemons upgraded", 2024-09-13T18:30:53.971 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T18:30:53.971 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:30:53.971 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:30:53.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.970+0000 7f4069213640 1 -- 172.21.15.38:0/174530551 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f405006cef0 msgr2=0x7f405006f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.970+0000 7f4069213640 1 --2- 172.21.15.38:0/174530551 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f405006cef0 0x7f405006f3b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f40640835d0 tx=0x7f4054005f90 comp rx=0 tx=0).stop 2024-09-13T18:30:53.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.970+0000 7f4069213640 1 -- 172.21.15.38:0/174530551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4064070fe0 msgr2=0x7f40640727d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:53.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.970+0000 7f4069213640 1 --2- 172.21.15.38:0/174530551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4064070fe0 0x7f40640727d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f405c007bd0 tx=0x7f405c003ba0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.970+0000 7f4069213640 1 -- 172.21.15.38:0/174530551 shutdown_connections 2024-09-13T18:30:53.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.970+0000 7f4069213640 1 --2- 172.21.15.38:0/174530551 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f405006cef0 0x7f405006f3b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.970+0000 7f4069213640 1 --2- 172.21.15.38:0/174530551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4064107890 0x7f4064072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.970+0000 7f4069213640 1 --2- 172.21.15.38:0/174530551 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4064070fe0 0x7f40640727d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:53.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.970+0000 7f4069213640 1 -- 172.21.15.38:0/174530551 >> 172.21.15.38:0/174530551 conn(0x7f406406cc10 msgr2=0x7f406406f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:53.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.970+0000 7f4069213640 1 -- 172.21.15.38:0/174530551 shutdown_connections 2024-09-13T18:30:53.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:53.970+0000 7f4069213640 1 -- 172.21.15.38:0/174530551 wait complete. 2024-09-13T18:30:54.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.080+0000 7f98396bd640 1 -- 172.21.15.38:0/2832549742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9834102fb0 msgr2=0x7f98341053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.080+0000 7f98396bd640 1 --2- 172.21.15.38:0/2832549742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9834102fb0 0x7f98341053a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f981c0098b0 tx=0x7f981c02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.080+0000 7f98396bd640 1 -- 172.21.15.38:0/2832549742 shutdown_connections 2024-09-13T18:30:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.080+0000 7f98396bd640 1 --2- 172.21.15.38:0/2832549742 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9834102fb0 0x7f98341053a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.080+0000 7f98396bd640 1 --2- 172.21.15.38:0/2832549742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834100680 0x7f9834102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.080+0000 7f98396bd640 1 -- 172.21.15.38:0/2832549742 >> 172.21.15.38:0/2832549742 conn(0x7f98340fa280 msgr2=0x7f98340fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.081+0000 7f98396bd640 1 -- 172.21.15.38:0/2832549742 shutdown_connections 2024-09-13T18:30:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.081+0000 7f98396bd640 1 -- 172.21.15.38:0/2832549742 wait complete. 2024-09-13T18:30:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.081+0000 7f98396bd640 1 Processor -- start 2024-09-13T18:30:54.084 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.081+0000 7f98396bd640 1 -- start start 2024-09-13T18:30:54.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f98396bd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834100680 0x7f98341955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:54.085 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f98396bd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9834102fb0 0x7f9834195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:54.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f98396bd640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98341960d0 con 0x7f9834102fb0 2024-09-13T18:30:54.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f98396bd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9834196240 con 0x7f9834100680 2024-09-13T18:30:54.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f982bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9834102fb0 0x7f9834195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:54.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f982bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9834102fb0 0x7f9834195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50928/0 (socket says 172.21.15.38:50928) 2024-09-13T18:30:54.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f9832ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834100680 0x7f98341955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:54.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f982bfff640 1 -- 172.21.15.38:0/4050979048 learned_addr learned my addr 172.21.15.38:0/4050979048 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:30:54.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f982bfff640 1 -- 172.21.15.38:0/4050979048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834100680 msgr2=0x7f98341955c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f982bfff640 1 --2- 172.21.15.38:0/4050979048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834100680 0x7f98341955c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f982bfff640 1 -- 172.21.15.38:0/4050979048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c009560 con 0x7f9834102fb0 2024-09-13T18:30:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f9832ffd640 1 --2- 172.21.15.38:0/4050979048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834100680 0x7f98341955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:30:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.082+0000 7f982bfff640 1 --2- 172.21.15.38:0/4050979048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9834102fb0 0x7f9834195b00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f981c004650 tx=0x7f981c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.083+0000 7f9830ff9640 1 -- 172.21.15.38:0/4050979048 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f981c004aa0 con 0x7f9834102fb0 2024-09-13T18:30:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.083+0000 7f9830ff9640 1 -- 172.21.15.38:0/4050979048 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f981c005d50 con 0x7f9834102fb0 2024-09-13T18:30:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.083+0000 7f98396bd640 1 -- 172.21.15.38:0/4050979048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98340fe470 con 0x7f9834102fb0 2024-09-13T18:30:54.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.083+0000 7f9830ff9640 1 -- 172.21.15.38:0/4050979048 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f981c0318f0 con 0x7f9834102fb0 2024-09-13T18:30:54.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.083+0000 7f98396bd640 1 -- 172.21.15.38:0/4050979048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98340fe960 con 0x7f9834102fb0 2024-09-13T18:30:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.084+0000 7f98396bd640 1 -- 172.21.15.38:0/4050979048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98341086a0 con 0x7f9834102fb0 2024-09-13T18:30:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.085+0000 7f9830ff9640 1 -- 172.21.15.38:0/4050979048 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 25) v1 ==== 90954+0+0 (secure 0 0 0) 0x7f981c004c00 con 0x7f9834102fb0 2024-09-13T18:30:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.085+0000 7f9830ff9640 1 --2- 172.21.15.38:0/4050979048 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f982006cd90 0x7f982006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:30:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.086+0000 7f9830ff9640 1 -- 172.21.15.38:0/4050979048 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f981c0ad5a0 con 0x7f9834102fb0 2024-09-13T18:30:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.086+0000 7f9832ffd640 1 --2- 172.21.15.38:0/4050979048 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f982006cd90 0x7f982006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:30:54.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.086+0000 7f9832ffd640 1 --2- 172.21.15.38:0/4050979048 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f982006cd90 0x7f982006f250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98240096a0 tx=0x7f9824012040 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:30:54.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.090+0000 7f9830ff9640 1 -- 172.21.15.38:0/4050979048 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f981c077720 con 0x7f9834102fb0 2024-09-13T18:30:54.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:53 smithi149 ceph-mon[35845]: pgmap v29: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 152 MiB/s rd, 187 MiB/s wr, 383 op/s 2024-09-13T18:30:54.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:53 smithi149 ceph-mon[35845]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:54.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:53 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1189969052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:30:54.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:53 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1793074375' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:30:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.393+0000 7f98396bd640 1 -- 172.21.15.38:0/4050979048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9834108830 con 0x7f9834102fb0 2024-09-13T18:30:54.396 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.394+0000 7f9830ff9640 1 -- 172.21.15.38:0/4050979048 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f981c07ad40 con 0x7f9834102fb0 2024-09-13T18:30:54.396 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:30:54.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.397+0000 7f98396bd640 1 -- 172.21.15.38:0/4050979048 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f982006cd90 msgr2=0x7f982006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:54.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.397+0000 7f98396bd640 1 --2- 172.21.15.38:0/4050979048 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f982006cd90 0x7f982006f250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98240096a0 tx=0x7f9824012040 comp rx=0 tx=0).stop 2024-09-13T18:30:54.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.397+0000 7f98396bd640 1 -- 172.21.15.38:0/4050979048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9834102fb0 msgr2=0x7f9834195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:30:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.397+0000 7f98396bd640 1 --2- 172.21.15.38:0/4050979048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9834102fb0 0x7f9834195b00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f981c004650 tx=0x7f981c0055a0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.397+0000 7f98396bd640 1 -- 172.21.15.38:0/4050979048 shutdown_connections 2024-09-13T18:30:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.397+0000 7f98396bd640 1 --2- 172.21.15.38:0/4050979048 >> [v2:172.21.15.149:6828/2070517292,v1:172.21.15.149:6829/2070517292] conn(0x7f982006cd90 0x7f982006f250 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.397+0000 7f98396bd640 1 --2- 172.21.15.38:0/4050979048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9834102fb0 0x7f9834195b00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.397+0000 7f98396bd640 1 --2- 172.21.15.38:0/4050979048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9834100680 0x7f98341955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:30:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.397+0000 7f98396bd640 1 -- 172.21.15.38:0/4050979048 >> 172.21.15.38:0/4050979048 conn(0x7f98340fa280 msgr2=0x7f98340fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:30:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.397+0000 7f98396bd640 1 -- 172.21.15.38:0/4050979048 shutdown_connections 2024-09-13T18:30:54.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:30:54.397+0000 7f98396bd640 1 -- 172.21.15.38:0/4050979048 wait complete. 2024-09-13T18:30:55.051 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:54 smithi038 ceph-mon[27689]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:55.051 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:54 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/4050979048' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:30:55.170 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:54 smithi149 ceph-mon[35845]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:30:55.170 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:54 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/4050979048' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:30:55.903 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:55 smithi038 ceph-mon[27689]: pgmap v30: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 89 MiB/s rd, 116 MiB/s wr, 239 op/s 2024-09-13T18:30:56.181 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:55 smithi149 ceph-mon[35845]: pgmap v30: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 89 MiB/s rd, 116 MiB/s wr, 239 op/s 2024-09-13T18:30:57.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:57 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:57.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:57 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:57.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:57 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:30:57.502 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:57 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:57.502 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:57 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:30:57.502 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:57 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:30:58.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:30:58 smithi038 ceph-mon[27689]: pgmap v31: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 89 MiB/s rd, 116 MiB/s wr, 239 op/s 2024-09-13T18:30:58.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:30:58 smithi149 ceph-mon[35845]: pgmap v31: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 89 MiB/s rd, 116 MiB/s wr, 239 op/s 2024-09-13T18:31:00.307 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:00 smithi038 ceph-mon[27689]: pgmap v32: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 101 MiB/s rd, 130 MiB/s wr, 371 op/s 2024-09-13T18:31:00.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:00 smithi149 ceph-mon[35845]: pgmap v32: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 101 MiB/s rd, 130 MiB/s wr, 371 op/s 2024-09-13T18:31:01.245 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:01 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:31:01.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:01 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:31:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:02 smithi038 ceph-mon[27689]: pgmap v33: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 50 MiB/s rd, 60 MiB/s wr, 247 op/s 2024-09-13T18:31:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:02 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:02 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:02.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:02 smithi149 ceph-mon[35845]: pgmap v33: 65 pgs: 65 active+clean; 2.1 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 50 MiB/s rd, 60 MiB/s wr, 247 op/s 2024-09-13T18:31:02.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:02 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:02.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:02 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:03.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:03 smithi038 ceph-mon[27689]: pgmap v34: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 51 MiB/s rd, 61 MiB/s wr, 380 op/s 2024-09-13T18:31:03.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:03 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:03.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:03 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:03.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:03 smithi038 ceph-mon[27689]: Standby manager daemon smithi038.jeygoq restarted 2024-09-13T18:31:03.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:03 smithi038 ceph-mon[27689]: Standby manager daemon smithi038.jeygoq started 2024-09-13T18:31:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:03 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.jeygoq/crt"}]: dispatch 2024-09-13T18:31:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:03 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:31:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:03 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.jeygoq/key"}]: dispatch 2024-09-13T18:31:03.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:03 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:31:03.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:03 smithi149 ceph-mon[35845]: pgmap v34: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 51 MiB/s rd, 61 MiB/s wr, 380 op/s 2024-09-13T18:31:03.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:03 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:03.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:03 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:03.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:03 smithi149 ceph-mon[35845]: Standby manager daemon smithi038.jeygoq restarted 2024-09-13T18:31:03.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:03 smithi149 ceph-mon[35845]: Standby manager daemon smithi038.jeygoq started 2024-09-13T18:31:03.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:03 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.jeygoq/crt"}]: dispatch 2024-09-13T18:31:03.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:03 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:31:03.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:03 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi038.jeygoq/key"}]: dispatch 2024-09-13T18:31:03.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:03 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:31:04.553 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:04 smithi038 ceph-mon[27689]: mgrmap e26: smithi149.eabzne(active, since 63s), standbys: smithi038.jeygoq 2024-09-13T18:31:04.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:04 smithi149 ceph-mon[35845]: mgrmap e26: smithi149.eabzne(active, since 63s), standbys: smithi038.jeygoq 2024-09-13T18:31:05.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:05 smithi149 ceph-mon[35845]: pgmap v35: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 13 MiB/s rd, 15 MiB/s wr, 265 op/s 2024-09-13T18:31:05.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:05 smithi038 ceph-mon[27689]: pgmap v35: 65 pgs: 65 active+clean; 1.6 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 13 MiB/s rd, 15 MiB/s wr, 265 op/s 2024-09-13T18:31:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:31:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:31:07.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:07.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:31:07.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mgr fail", "who": "smithi149.eabzne"}]: dispatch 2024-09-13T18:31:07.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mgr fail", "who": "smithi149.eabzne"}]: dispatch 2024-09-13T18:31:07.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: Activating manager daemon smithi038.jeygoq 2024-09-13T18:31:07.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T18:31:07.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd='[{"prefix": "mgr fail", "who": "smithi149.eabzne"}]': finished 2024-09-13T18:31:07.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: mgrmap e27: smithi038.jeygoq(active, starting, since 0.014674s) 2024-09-13T18:31:07.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:31:07.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:31:07.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dtnkqo"}]: dispatch 2024-09-13T18:31:07.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:31:07.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:31:07.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:31:07.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr metadata", "who": "smithi038.jeygoq", "id": "smithi038.jeygoq"}]: dispatch 2024-09-13T18:31:07.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:31:07.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:31:07.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:31:07.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:31:07.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:31:07.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:31:07.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T18:31:07.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T18:31:07.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T18:31:07.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: Manager daemon smithi038.jeygoq is now available 2024-09-13T18:31:07.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:31:07.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:31:07.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:31:07.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:31:07.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/trash_purge_schedule"}]: dispatch 2024-09-13T18:31:07.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:07 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/trash_purge_schedule"}]: dispatch 2024-09-13T18:31:07.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:07.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:07.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:31:07.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:31:07.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' 2024-09-13T18:31:07.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:31:07.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.24387 172.21.15.149:0/2401407632' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mgr fail", "who": "smithi149.eabzne"}]: dispatch 2024-09-13T18:31:07.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "mgr fail", "who": "smithi149.eabzne"}]: dispatch 2024-09-13T18:31:07.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: Activating manager daemon smithi038.jeygoq 2024-09-13T18:31:07.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T18:31:07.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.24387 ' entity='mgr.smithi149.eabzne' cmd='[{"prefix": "mgr fail", "who": "smithi149.eabzne"}]': finished 2024-09-13T18:31:07.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: mgrmap e27: smithi038.jeygoq(active, starting, since 0.014674s) 2024-09-13T18:31:07.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:31:07.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:31:07.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dtnkqo"}]: dispatch 2024-09-13T18:31:07.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:31:07.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:31:07.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:31:07.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr metadata", "who": "smithi038.jeygoq", "id": "smithi038.jeygoq"}]: dispatch 2024-09-13T18:31:07.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:31:07.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:31:07.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:31:07.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:31:07.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:31:07.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:31:07.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T18:31:07.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T18:31:07.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T18:31:07.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: Manager daemon smithi038.jeygoq is now available 2024-09-13T18:31:07.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:31:07.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:31:07.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:31:07.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/mirror_snapshot_schedule"}]: dispatch 2024-09-13T18:31:07.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/trash_purge_schedule"}]: dispatch 2024-09-13T18:31:07.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:07 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi038.jeygoq/trash_purge_schedule"}]: dispatch 2024-09-13T18:31:08.612 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:08 smithi149 ceph-mon[35845]: mgrmap e28: smithi038.jeygoq(active, since 1.0144s) 2024-09-13T18:31:08.613 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:08 smithi149 ceph-mon[35845]: pgmap v3: 65 pgs: 65 active+clean; 907 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail 2024-09-13T18:31:08.752 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:08 smithi038 ceph-mon[27689]: mgrmap e28: smithi038.jeygoq(active, since 1.0144s) 2024-09-13T18:31:08.752 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:08 smithi038 ceph-mon[27689]: pgmap v3: 65 pgs: 65 active+clean; 907 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail 2024-09-13T18:31:09.491 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:09 smithi149 ceph-mon[35845]: [13/Sep/2024:18:31:08] ENGINE Bus STARTING 2024-09-13T18:31:09.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:09 smithi038 ceph-mon[27689]: [13/Sep/2024:18:31:08] ENGINE Bus STARTING 2024-09-13T18:31:10.448 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:10 smithi149 ceph-mon[35845]: [13/Sep/2024:18:31:08] ENGINE Serving on https://172.21.15.38:7150 2024-09-13T18:31:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:10 smithi149 ceph-mon[35845]: [13/Sep/2024:18:31:08] ENGINE Error in HTTPServer.serve 2024-09-13T18:31:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Traceback (most recent call last): 2024-09-13T18:31:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T18:31:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self._connections.run(self.expiration_interval) 2024-09-13T18:31:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T18:31:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self._run(expiration_interval) 2024-09-13T18:31:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T18:31:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T18:31:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T18:31:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T18:31:10.449 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T18:31:10.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: s = self.context.wrap_socket( 2024-09-13T18:31:10.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T18:31:10.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: return self.sslsocket_class._create( 2024-09-13T18:31:10.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T18:31:10.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self.do_handshake() 2024-09-13T18:31:10.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T18:31:10.450 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: self._sslobj.do_handshake() 2024-09-13T18:31:10.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T18:31:10.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:10 smithi149 ceph-mon[35845]: [13/Sep/2024:18:31:09] ENGINE Serving on http://172.21.15.38:8765 2024-09-13T18:31:10.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:10 smithi149 ceph-mon[35845]: [13/Sep/2024:18:31:09] ENGINE Bus STARTED 2024-09-13T18:31:10.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:10 smithi149 ceph-mon[35845]: mgrmap e29: smithi038.jeygoq(active, since 3s) 2024-09-13T18:31:10.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:10 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:10.451 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:10 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:10.764 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:10 smithi038 ceph-mon[27689]: [13/Sep/2024:18:31:08] ENGINE Serving on https://172.21.15.38:7150 2024-09-13T18:31:10.764 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:10 smithi038 ceph-mon[27689]: [13/Sep/2024:18:31:08] ENGINE Error in HTTPServer.serve 2024-09-13T18:31:10.764 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Traceback (most recent call last): 2024-09-13T18:31:10.764 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T18:31:10.764 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._connections.run(self.expiration_interval) 2024-09-13T18:31:10.764 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._run(expiration_interval) 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: s = self.context.wrap_socket( 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: return self.sslsocket_class._create( 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self.do_handshake() 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T18:31:10.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: self._sslobj.do_handshake() 2024-09-13T18:31:10.766 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T18:31:10.766 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:10 smithi038 ceph-mon[27689]: [13/Sep/2024:18:31:09] ENGINE Serving on http://172.21.15.38:8765 2024-09-13T18:31:10.766 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:10 smithi038 ceph-mon[27689]: [13/Sep/2024:18:31:09] ENGINE Bus STARTED 2024-09-13T18:31:10.766 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:10 smithi038 ceph-mon[27689]: mgrmap e29: smithi038.jeygoq(active, since 3s) 2024-09-13T18:31:10.766 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:10 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:10.766 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:10 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:11.359 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:31:11.359 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T18:31:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:11 smithi038 ceph-mon[27689]: pgmap v5: 65 pgs: 65 active+clean; 907 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail 2024-09-13T18:31:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:11 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:11 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:11 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:31:11.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:11 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:31:11.984 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:11 smithi149 ceph-mon[35845]: pgmap v5: 65 pgs: 65 active+clean; 907 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail 2024-09-13T18:31:11.984 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:11 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:11.984 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:11 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:11.984 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:11 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:31:11.984 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:11 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:31:12.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:12 smithi038 ceph-mon[27689]: Standby manager daemon smithi149.eabzne started 2024-09-13T18:31:12.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:12 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/3294422760' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/crt"}]: dispatch 2024-09-13T18:31:12.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:12 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/3294422760' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:31:12.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:12 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/3294422760' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/key"}]: dispatch 2024-09-13T18:31:12.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:12 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/3294422760' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:31:13.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:12 smithi149 ceph-mon[35845]: Standby manager daemon smithi149.eabzne started 2024-09-13T18:31:13.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:12 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/3294422760' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/crt"}]: dispatch 2024-09-13T18:31:13.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:12 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/3294422760' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:31:13.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:12 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/3294422760' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/key"}]: dispatch 2024-09-13T18:31:13.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:12 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/3294422760' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:31:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:13 smithi149 ceph-mon[35845]: pgmap v6: 65 pgs: 65 active+clean; 847 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 40 KiB/s rd, 59 KiB/s wr, 37 op/s 2024-09-13T18:31:14.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:13 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr metadata", "who": "smithi149.eabzne", "id": "smithi149.eabzne"}]: dispatch 2024-09-13T18:31:14.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:13 smithi149 ceph-mon[35845]: mgrmap e30: smithi038.jeygoq(active, since 6s), standbys: smithi149.eabzne 2024-09-13T18:31:14.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:13 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:14.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:13 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:14.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:13 smithi038 ceph-mon[27689]: pgmap v6: 65 pgs: 65 active+clean; 847 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 40 KiB/s rd, 59 KiB/s wr, 37 op/s 2024-09-13T18:31:14.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:13 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr metadata", "who": "smithi149.eabzne", "id": "smithi149.eabzne"}]: dispatch 2024-09-13T18:31:14.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:13 smithi038 ceph-mon[27689]: mgrmap e30: smithi038.jeygoq(active, since 6s), standbys: smithi149.eabzne 2024-09-13T18:31:14.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:13 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:14.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:13 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:15.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:15 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:15.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:15 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:15.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:15 smithi149 ceph-mon[35845]: pgmap v7: 65 pgs: 65 active+clean; 323 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 265 op/s 2024-09-13T18:31:15.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:15 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:15.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:15 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:15.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:15 smithi038 ceph-mon[27689]: pgmap v7: 65 pgs: 65 active+clean; 323 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 265 op/s 2024-09-13T18:31:17.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:17 smithi149 ceph-mon[35845]: pgmap v8: 65 pgs: 65 active+clean; 323 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 857 KiB/s rd, 1.0 MiB/s wr, 206 op/s 2024-09-13T18:31:17.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:17 smithi038 ceph-mon[27689]: pgmap v8: 65 pgs: 65 active+clean; 323 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 857 KiB/s rd, 1.0 MiB/s wr, 206 op/s 2024-09-13T18:31:19.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:19 smithi149 ceph-mon[35845]: pgmap v9: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 328 op/s 2024-09-13T18:31:19.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:19 smithi038 ceph-mon[27689]: pgmap v9: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 328 op/s 2024-09-13T18:31:21.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:21 smithi149 ceph-mon[35845]: pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 301 op/s 2024-09-13T18:31:21.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:21 smithi038 ceph-mon[27689]: pgmap v10: 65 pgs: 65 active+clean; 293 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 301 op/s 2024-09-13T18:31:22.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:22 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:31:22.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:22 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:31:23.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:23 smithi149 ceph-mon[35845]: pgmap v11: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 312 op/s 2024-09-13T18:31:23.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:23 smithi038 ceph-mon[27689]: pgmap v11: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 312 op/s 2024-09-13T18:31:24.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.486+0000 7f98ecae0640 1 -- 172.21.15.38:0/1481394566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e8102f40 msgr2=0x7f98e8105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.486+0000 7f98ecae0640 1 --2- 172.21.15.38:0/1481394566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e8102f40 0x7f98e8105330 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0098b0 tx=0x7f98dc02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.487+0000 7f98ecae0640 1 -- 172.21.15.38:0/1481394566 shutdown_connections 2024-09-13T18:31:24.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.487+0000 7f98ecae0640 1 --2- 172.21.15.38:0/1481394566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e8102f40 0x7f98e8105330 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.487+0000 7f98ecae0640 1 --2- 172.21.15.38:0/1481394566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98e8100610 0x7f98e8102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.487+0000 7f98ecae0640 1 -- 172.21.15.38:0/1481394566 >> 172.21.15.38:0/1481394566 conn(0x7f98e80fa230 msgr2=0x7f98e80fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:24.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.487+0000 7f98ecae0640 1 -- 172.21.15.38:0/1481394566 shutdown_connections 2024-09-13T18:31:24.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.487+0000 7f98ecae0640 1 -- 172.21.15.38:0/1481394566 wait complete. 2024-09-13T18:31:24.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.488+0000 7f98ecae0640 1 Processor -- start 2024-09-13T18:31:24.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.488+0000 7f98ecae0640 1 -- start start 2024-09-13T18:31:24.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.488+0000 7f98ecae0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e8100610 0x7f98e80fff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.488+0000 7f98ecae0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98e8102f40 0x7f98e80fe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.488+0000 7f98ecae0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80feb00 con 0x7f98e8100610 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.488+0000 7f98ecae0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80fec70 con 0x7f98e8102f40 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.488+0000 7f98e659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e8100610 0x7f98e80fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.488+0000 7f98e659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e8100610 0x7f98e80fff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42182/0 (socket says 172.21.15.38:42182) 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.488+0000 7f98e659c640 1 -- 172.21.15.38:0/3966225516 learned_addr learned my addr 172.21.15.38:0/3966225516 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.488+0000 7f98e5d9b640 1 --2- 172.21.15.38:0/3966225516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98e8102f40 0x7f98e80fe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.488+0000 7f98e659c640 1 -- 172.21.15.38:0/3966225516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98e8102f40 msgr2=0x7f98e80fe5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.488+0000 7f98e659c640 1 --2- 172.21.15.38:0/3966225516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98e8102f40 0x7f98e80fe5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.489+0000 7f98e659c640 1 -- 172.21.15.38:0/3966225516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc009560 con 0x7f98e8100610 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.489+0000 7f98e659c640 1 --2- 172.21.15.38:0/3966225516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e8100610 0x7f98e80fff70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f98d800e970 tx=0x7f98d800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.489+0000 7f98d77fe640 1 -- 172.21.15.38:0/3966225516 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d800cc90 con 0x7f98e8100610 2024-09-13T18:31:24.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.489+0000 7f98ecae0640 1 -- 172.21.15.38:0/3966225516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e80fef50 con 0x7f98e8100610 2024-09-13T18:31:24.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.489+0000 7f98d77fe640 1 -- 172.21.15.38:0/3966225516 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f98d800cdf0 con 0x7f98e8100610 2024-09-13T18:31:24.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.489+0000 7f98d77fe640 1 -- 172.21.15.38:0/3966225516 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d8018770 con 0x7f98e8100610 2024-09-13T18:31:24.495 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.489+0000 7f98ecae0640 1 -- 172.21.15.38:0/3966225516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e819d5d0 con 0x7f98e8100610 2024-09-13T18:31:24.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.491+0000 7f98ecae0640 1 -- 172.21.15.38:0/3966225516 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e8109000 con 0x7f98e8100610 2024-09-13T18:31:24.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.491+0000 7f98d77fe640 1 -- 172.21.15.38:0/3966225516 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f98d8010b60 con 0x7f98e8100610 2024-09-13T18:31:24.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.492+0000 7f98d77fe640 1 --2- 172.21.15.38:0/3966225516 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f98d006cd90 0x7f98d006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.492+0000 7f98d77fe640 1 -- 172.21.15.38:0/3966225516 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f98d8014070 con 0x7f98e8100610 2024-09-13T18:31:24.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.492+0000 7f98e5d9b640 1 --2- 172.21.15.38:0/3966225516 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f98d006cd90 0x7f98d006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.496 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.493+0000 7f98e5d9b640 1 --2- 172.21.15.38:0/3966225516 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f98d006cd90 0x7f98d006f250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f98dc006010 tx=0x7f98dc031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:24.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.497+0000 7f98d77fe640 1 -- 172.21.15.38:0/3966225516 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f98d8052e20 con 0x7f98e8100610 2024-09-13T18:31:24.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.691+0000 7f98ecae0640 1 -- 172.21.15.38:0/3966225516 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98e8103980 con 0x7f98d006cd90 2024-09-13T18:31:24.696 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.693+0000 7f98d77fe640 1 -- 172.21.15.38:0/3966225516 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f98e8103980 con 0x7f98d006cd90 2024-09-13T18:31:24.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.695+0000 7f98ecae0640 1 -- 172.21.15.38:0/3966225516 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f98d006cd90 msgr2=0x7f98d006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.695+0000 7f98ecae0640 1 --2- 172.21.15.38:0/3966225516 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f98d006cd90 0x7f98d006f250 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f98dc006010 tx=0x7f98dc031400 comp rx=0 tx=0).stop 2024-09-13T18:31:24.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.695+0000 7f98ecae0640 1 -- 172.21.15.38:0/3966225516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e8100610 msgr2=0x7f98e80fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.695+0000 7f98ecae0640 1 --2- 172.21.15.38:0/3966225516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e8100610 0x7f98e80fff70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f98d800e970 tx=0x7f98d800ee30 comp rx=0 tx=0).stop 2024-09-13T18:31:24.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.695+0000 7f98ecae0640 1 -- 172.21.15.38:0/3966225516 shutdown_connections 2024-09-13T18:31:24.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.695+0000 7f98ecae0640 1 --2- 172.21.15.38:0/3966225516 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f98d006cd90 0x7f98d006f250 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.695+0000 7f98ecae0640 1 --2- 172.21.15.38:0/3966225516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98e8102f40 0x7f98e80fe5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.695+0000 7f98ecae0640 1 --2- 172.21.15.38:0/3966225516 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98e8100610 0x7f98e80fff70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.695+0000 7f98ecae0640 1 -- 172.21.15.38:0/3966225516 >> 172.21.15.38:0/3966225516 conn(0x7f98e80fa230 msgr2=0x7f98e80fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:24.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.695+0000 7f98ecae0640 1 -- 172.21.15.38:0/3966225516 shutdown_connections 2024-09-13T18:31:24.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.695+0000 7f98ecae0640 1 -- 172.21.15.38:0/3966225516 wait complete. 2024-09-13T18:31:24.707 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:31:24.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.783+0000 7f785383f640 1 -- 172.21.15.38:0/1851609365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f784c102fb0 msgr2=0x7f784c1053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.783+0000 7f785383f640 1 --2- 172.21.15.38:0/1851609365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f784c102fb0 0x7f784c1053a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f783c0098b0 tx=0x7f783c02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.783+0000 7f785383f640 1 -- 172.21.15.38:0/1851609365 shutdown_connections 2024-09-13T18:31:24.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.783+0000 7f785383f640 1 --2- 172.21.15.38:0/1851609365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f784c102fb0 0x7f784c1053a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.783+0000 7f785383f640 1 --2- 172.21.15.38:0/1851609365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f784c100680 0x7f784c102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.783+0000 7f785383f640 1 -- 172.21.15.38:0/1851609365 >> 172.21.15.38:0/1851609365 conn(0x7f784c0fa280 msgr2=0x7f784c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:24.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.783+0000 7f785383f640 1 -- 172.21.15.38:0/1851609365 shutdown_connections 2024-09-13T18:31:24.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.783+0000 7f785383f640 1 -- 172.21.15.38:0/1851609365 wait complete. 2024-09-13T18:31:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.784+0000 7f785383f640 1 Processor -- start 2024-09-13T18:31:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.784+0000 7f785383f640 1 -- start start 2024-09-13T18:31:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.784+0000 7f785383f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f784c100680 0x7f784c1955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.784+0000 7f785383f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f784c102fb0 0x7f784c195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.784+0000 7f785383f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c1960d0 con 0x7f784c100680 2024-09-13T18:31:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.784+0000 7f785383f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c196240 con 0x7f784c102fb0 2024-09-13T18:31:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.784+0000 7f78515db640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f784c100680 0x7f784c1955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.784+0000 7f78515db640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f784c100680 0x7f784c1955c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42210/0 (socket says 172.21.15.38:42210) 2024-09-13T18:31:24.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.784+0000 7f78515db640 1 -- 172.21.15.38:0/919510048 learned_addr learned my addr 172.21.15.38:0/919510048 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:24.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.785+0000 7f7850dda640 1 --2- 172.21.15.38:0/919510048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f784c102fb0 0x7f784c195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.785+0000 7f78515db640 1 -- 172.21.15.38:0/919510048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f784c102fb0 msgr2=0x7f784c195b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.785+0000 7f78515db640 1 --2- 172.21.15.38:0/919510048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f784c102fb0 0x7f784c195b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.785+0000 7f78515db640 1 -- 172.21.15.38:0/919510048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c009560 con 0x7f784c100680 2024-09-13T18:31:24.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.785+0000 7f78515db640 1 --2- 172.21.15.38:0/919510048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f784c100680 0x7f784c1955c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f784800e9a0 tx=0x7f784800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:24.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.785+0000 7f78427fc640 1 -- 172.21.15.38:0/919510048 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f784800cc90 con 0x7f784c100680 2024-09-13T18:31:24.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.785+0000 7f785383f640 1 -- 172.21.15.38:0/919510048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c19ace0 con 0x7f784c100680 2024-09-13T18:31:24.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.785+0000 7f78427fc640 1 -- 172.21.15.38:0/919510048 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f784800cdf0 con 0x7f784c100680 2024-09-13T18:31:24.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.785+0000 7f78427fc640 1 -- 172.21.15.38:0/919510048 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7848018770 con 0x7f784c100680 2024-09-13T18:31:24.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.785+0000 7f785383f640 1 -- 172.21.15.38:0/919510048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784c19b1b0 con 0x7f784c100680 2024-09-13T18:31:24.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.786+0000 7f785383f640 1 -- 172.21.15.38:0/919510048 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784c1086a0 con 0x7f784c100680 2024-09-13T18:31:24.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.788+0000 7f78427fc640 1 -- 172.21.15.38:0/919510048 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f7848010b60 con 0x7f784c100680 2024-09-13T18:31:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.788+0000 7f78427fc640 1 --2- 172.21.15.38:0/919510048 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f783806cd80 0x7f783806f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.788+0000 7f78427fc640 1 -- 172.21.15.38:0/919510048 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7848014070 con 0x7f784c100680 2024-09-13T18:31:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.788+0000 7f7850dda640 1 --2- 172.21.15.38:0/919510048 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f783806cd80 0x7f783806f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:24.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.789+0000 7f7850dda640 1 --2- 172.21.15.38:0/919510048 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f783806cd80 0x7f783806f240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f783c006010 tx=0x7f783c031420 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:24.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.793+0000 7f78427fc640 1 -- 172.21.15.38:0/919510048 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7848052e20 con 0x7f784c100680 2024-09-13T18:31:24.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.987+0000 7f785383f640 1 -- 172.21.15.38:0/919510048 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f784c103a70 con 0x7f783806cd80 2024-09-13T18:31:24.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.989+0000 7f78427fc640 1 -- 172.21.15.38:0/919510048 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f784c103a70 con 0x7f783806cd80 2024-09-13T18:31:24.994 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.991+0000 7f785383f640 1 -- 172.21.15.38:0/919510048 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f783806cd80 msgr2=0x7f783806f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.991+0000 7f785383f640 1 --2- 172.21.15.38:0/919510048 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f783806cd80 0x7f783806f240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f783c006010 tx=0x7f783c031420 comp rx=0 tx=0).stop 2024-09-13T18:31:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.991+0000 7f785383f640 1 -- 172.21.15.38:0/919510048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f784c100680 msgr2=0x7f784c1955c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.991+0000 7f785383f640 1 --2- 172.21.15.38:0/919510048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f784c100680 0x7f784c1955c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f784800e9a0 tx=0x7f784800ee60 comp rx=0 tx=0).stop 2024-09-13T18:31:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.991+0000 7f785383f640 1 -- 172.21.15.38:0/919510048 shutdown_connections 2024-09-13T18:31:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.991+0000 7f785383f640 1 --2- 172.21.15.38:0/919510048 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f783806cd80 0x7f783806f240 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.991+0000 7f785383f640 1 --2- 172.21.15.38:0/919510048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f784c102fb0 0x7f784c195b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.991+0000 7f785383f640 1 --2- 172.21.15.38:0/919510048 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f784c100680 0x7f784c1955c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.991+0000 7f785383f640 1 -- 172.21.15.38:0/919510048 >> 172.21.15.38:0/919510048 conn(0x7f784c0fa280 msgr2=0x7f784c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:24.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.991+0000 7f785383f640 1 -- 172.21.15.38:0/919510048 shutdown_connections 2024-09-13T18:31:24.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:24.991+0000 7f785383f640 1 -- 172.21.15.38:0/919510048 wait complete. 2024-09-13T18:31:25.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.092+0000 7fd149fcb640 1 -- 172.21.15.38:0/3871309706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd144102f30 msgr2=0x7fd144105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.092+0000 7fd149fcb640 1 --2- 172.21.15.38:0/3871309706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd144102f30 0x7fd144105320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd1380098b0 tx=0x7fd13802a4d0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.092+0000 7fd149fcb640 1 -- 172.21.15.38:0/3871309706 shutdown_connections 2024-09-13T18:31:25.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.092+0000 7fd149fcb640 1 --2- 172.21.15.38:0/3871309706 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd144102f30 0x7fd144105320 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.092+0000 7fd149fcb640 1 --2- 172.21.15.38:0/3871309706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd144100600 0x7fd1441029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.092+0000 7fd149fcb640 1 -- 172.21.15.38:0/3871309706 >> 172.21.15.38:0/3871309706 conn(0x7fd1440fa200 msgr2=0x7fd1440fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:25.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.092+0000 7fd149fcb640 1 -- 172.21.15.38:0/3871309706 shutdown_connections 2024-09-13T18:31:25.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.093+0000 7fd149fcb640 1 -- 172.21.15.38:0/3871309706 wait complete. 2024-09-13T18:31:25.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.093+0000 7fd149fcb640 1 Processor -- start 2024-09-13T18:31:25.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.093+0000 7fd149fcb640 1 -- start start 2024-09-13T18:31:25.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.093+0000 7fd149fcb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd144100600 0x7fd144195540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.093+0000 7fd149fcb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd144102f30 0x7fd144195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.093+0000 7fd149fcb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd144195fc0 con 0x7fd144100600 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.093+0000 7fd149fcb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd144196130 con 0x7fd144102f30 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.094+0000 7fd1437fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd144100600 0x7fd144195540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.094+0000 7fd1437fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd144100600 0x7fd144195540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42236/0 (socket says 172.21.15.38:42236) 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.094+0000 7fd1437fe640 1 -- 172.21.15.38:0/874521522 learned_addr learned my addr 172.21.15.38:0/874521522 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.094+0000 7fd142ffd640 1 --2- 172.21.15.38:0/874521522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd144102f30 0x7fd144195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.094+0000 7fd1437fe640 1 -- 172.21.15.38:0/874521522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd144102f30 msgr2=0x7fd144195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.094+0000 7fd1437fe640 1 --2- 172.21.15.38:0/874521522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd144102f30 0x7fd144195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.094+0000 7fd1437fe640 1 -- 172.21.15.38:0/874521522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd138009560 con 0x7fd144100600 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.094+0000 7fd1437fe640 1 --2- 172.21.15.38:0/874521522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd144100600 0x7fd144195540 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c8a0 tx=0x7fd13400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.094+0000 7fd140ff9640 1 -- 172.21.15.38:0/874521522 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd134007b80 con 0x7fd144100600 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.095+0000 7fd149fcb640 1 -- 172.21.15.38:0/874521522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14419ac10 con 0x7fd144100600 2024-09-13T18:31:25.099 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.095+0000 7fd140ff9640 1 -- 172.21.15.38:0/874521522 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd134007ce0 con 0x7fd144100600 2024-09-13T18:31:25.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.095+0000 7fd140ff9640 1 -- 172.21.15.38:0/874521522 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd134018770 con 0x7fd144100600 2024-09-13T18:31:25.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.095+0000 7fd149fcb640 1 -- 172.21.15.38:0/874521522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14419b0e0 con 0x7fd144100600 2024-09-13T18:31:25.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.096+0000 7fd149fcb640 1 -- 172.21.15.38:0/874521522 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd144108620 con 0x7fd144100600 2024-09-13T18:31:25.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.097+0000 7fd140ff9640 1 -- 172.21.15.38:0/874521522 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fd13400f450 con 0x7fd144100600 2024-09-13T18:31:25.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.097+0000 7fd140ff9640 1 --2- 172.21.15.38:0/874521522 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd12c06cd90 0x7fd12c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.097+0000 7fd140ff9640 1 -- 172.21.15.38:0/874521522 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd13408c930 con 0x7fd144100600 2024-09-13T18:31:25.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.098+0000 7fd142ffd640 1 --2- 172.21.15.38:0/874521522 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd12c06cd90 0x7fd12c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.098+0000 7fd142ffd640 1 --2- 172.21.15.38:0/874521522 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd12c06cd90 0x7fd12c06f250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd138006010 tx=0x7fd138005b50 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:25.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.106+0000 7fd140ff9640 1 -- 172.21.15.38:0/874521522 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd13405a340 con 0x7fd144100600 2024-09-13T18:31:25.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.341+0000 7fd149fcb640 1 -- 172.21.15.38:0/874521522 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd14419b3b0 con 0x7fd12c06cd90 2024-09-13T18:31:25.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.361+0000 7fd140ff9640 1 -- 172.21.15.38:0/874521522 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd14419b3b0 con 0x7fd12c06cd90 2024-09-13T18:31:25.368 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:31:25.368 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (7m) 12s ago 9m 24.1M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:31:25.368 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (9m) 12s ago 9m 8082k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:31:25.368 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (8m) 15s ago 8m 7818k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:31:25.368 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (9m) 12s ago 9m 6899k - 18.2.4-845-ge4e227b3 67ddd33fa72f 30c026e97a6b 2024-09-13T18:31:25.368 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (8m) 15s ago 8m 6895k - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c179d7df975 2024-09-13T18:31:25.368 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (7m) 12s ago 8m 85.9M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (3m) 12s ago 3m 226M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (3m) 12s ago 3m 156M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (3m) 15s ago 3m 23.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (3m) 15s ago 3m 23.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (29s) 12s ago 10m 458M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (104s) 15s ago 8m 96.0M - 18.2.4-860-g6c6b083f 8a91f241d7d4 49cdb3f4164b 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (10m) 12s ago 10m 53.6M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f b654a36a9082 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (8m) 15s ago 8m 41.8M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 0133a107f35d 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (9m) 12s ago 9m 15.4M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (8m) 15s ago 8m 15.7M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (7m) 12s ago 7m 213M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 69a9e66fb097 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (6m) 12s ago 6m 217M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 07986b4ba73b 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (6m) 12s ago 6m 180M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f e44cdda01aee 2024-09-13T18:31:25.369 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (5m) 15s ago 5m 246M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:31:25.370 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (5m) 15s ago 5m 230M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:31:25.370 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (5m) 15s ago 5m 214M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:31:25.370 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (48s) 12s ago 8m 46.8M - 2.43.0 a07b618ecd1d 0bd86db112b3 2024-09-13T18:31:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.364+0000 7fd149fcb640 1 -- 172.21.15.38:0/874521522 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd12c06cd90 msgr2=0x7fd12c06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.364+0000 7fd149fcb640 1 --2- 172.21.15.38:0/874521522 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd12c06cd90 0x7fd12c06f250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd138006010 tx=0x7fd138005b50 comp rx=0 tx=0).stop 2024-09-13T18:31:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.364+0000 7fd149fcb640 1 -- 172.21.15.38:0/874521522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd144100600 msgr2=0x7fd144195540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.364+0000 7fd149fcb640 1 --2- 172.21.15.38:0/874521522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd144100600 0x7fd144195540 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c8a0 tx=0x7fd13400cd60 comp rx=0 tx=0).stop 2024-09-13T18:31:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.365+0000 7fd149fcb640 1 -- 172.21.15.38:0/874521522 shutdown_connections 2024-09-13T18:31:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.365+0000 7fd149fcb640 1 --2- 172.21.15.38:0/874521522 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd12c06cd90 0x7fd12c06f250 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.365+0000 7fd149fcb640 1 --2- 172.21.15.38:0/874521522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd144102f30 0x7fd144195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.365+0000 7fd149fcb640 1 --2- 172.21.15.38:0/874521522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd144100600 0x7fd144195540 secure :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c8a0 tx=0x7fd13400cd60 comp rx=0 tx=0).stop 2024-09-13T18:31:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.365+0000 7fd149fcb640 1 -- 172.21.15.38:0/874521522 >> 172.21.15.38:0/874521522 conn(0x7fd1440fa200 msgr2=0x7fd1440fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.366+0000 7fd149fcb640 1 -- 172.21.15.38:0/874521522 shutdown_connections 2024-09-13T18:31:25.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.366+0000 7fd149fcb640 1 -- 172.21.15.38:0/874521522 wait complete. 2024-09-13T18:31:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.506+0000 7f055a2b0640 1 -- 172.21.15.38:0/994956335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0554068050 msgr2=0x7f05540fe760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.506+0000 7f055a2b0640 1 --2- 172.21.15.38:0/994956335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0554068050 0x7f05540fe760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f054c009b60 tx=0x7f054c02a760 comp rx=0 tx=0).stop 2024-09-13T18:31:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.507+0000 7f055a2b0640 1 -- 172.21.15.38:0/994956335 shutdown_connections 2024-09-13T18:31:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.507+0000 7f055a2b0640 1 --2- 172.21.15.38:0/994956335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0554068050 0x7f05540fe760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.507+0000 7f055a2b0640 1 --2- 172.21.15.38:0/994956335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0554067bc0 0x7f05540fe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.507+0000 7f055a2b0640 1 -- 172.21.15.38:0/994956335 >> 172.21.15.38:0/994956335 conn(0x7f05540f99b0 msgr2=0x7f05540fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:25.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.508+0000 7f055a2b0640 1 -- 172.21.15.38:0/994956335 shutdown_connections 2024-09-13T18:31:25.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.508+0000 7f055a2b0640 1 -- 172.21.15.38:0/994956335 wait complete. 2024-09-13T18:31:25.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.510+0000 7f055a2b0640 1 Processor -- start 2024-09-13T18:31:25.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.510+0000 7f055a2b0640 1 -- start start 2024-09-13T18:31:25.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.511+0000 7f055a2b0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0554067bc0 0x7f05541975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.511+0000 7f055a2b0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0554068050 0x7f0554197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.511+0000 7f055a2b0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05541980f0 con 0x7f0554068050 2024-09-13T18:31:25.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.511+0000 7f055a2b0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0554198260 con 0x7f0554067bc0 2024-09-13T18:31:25.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.511+0000 7f0553fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0554067bc0 0x7f05541975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.511+0000 7f0553fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0554067bc0 0x7f05541975e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.38:49978/0 (socket says 172.21.15.38:49978) 2024-09-13T18:31:25.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.511+0000 7f0553fff640 1 -- 172.21.15.38:0/1120151521 learned_addr learned my addr 172.21.15.38:0/1120151521 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:25.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.511+0000 7f05537fe640 1 --2- 172.21.15.38:0/1120151521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0554068050 0x7f0554197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.512+0000 7f0553fff640 1 -- 172.21.15.38:0/1120151521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0554068050 msgr2=0x7f0554197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.512+0000 7f0553fff640 1 --2- 172.21.15.38:0/1120151521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0554068050 0x7f0554197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.512+0000 7f0553fff640 1 -- 172.21.15.38:0/1120151521 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c009840 con 0x7f0554067bc0 2024-09-13T18:31:25.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.512+0000 7f0553fff640 1 --2- 172.21.15.38:0/1120151521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0554067bc0 0x7f05541975e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f054800e8e0 tx=0x7f054800eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:25.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.513+0000 7f05517fa640 1 -- 172.21.15.38:0/1120151521 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f054800cc30 con 0x7f0554067bc0 2024-09-13T18:31:25.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.513+0000 7f05517fa640 1 -- 172.21.15.38:0/1120151521 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f054800cd90 con 0x7f0554067bc0 2024-09-13T18:31:25.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.513+0000 7f05517fa640 1 -- 172.21.15.38:0/1120151521 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f054801a830 con 0x7f0554067bc0 2024-09-13T18:31:25.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.514+0000 7f055a2b0640 1 -- 172.21.15.38:0/1120151521 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055419cd00 con 0x7f0554067bc0 2024-09-13T18:31:25.517 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.514+0000 7f055a2b0640 1 -- 172.21.15.38:0/1120151521 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055419d1a0 con 0x7f0554067bc0 2024-09-13T18:31:25.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.516+0000 7f05517fa640 1 -- 172.21.15.38:0/1120151521 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f054801a990 con 0x7f0554067bc0 2024-09-13T18:31:25.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.517+0000 7f05517fa640 1 --2- 172.21.15.38:0/1120151521 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f053c06cdd0 0x7f053c06f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.517+0000 7f05517fa640 1 -- 172.21.15.38:0/1120151521 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f054808cc30 con 0x7f0554067bc0 2024-09-13T18:31:25.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.517+0000 7f055a2b0640 1 -- 172.21.15.38:0/1120151521 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05541044b0 con 0x7f0554067bc0 2024-09-13T18:31:25.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.518+0000 7f05537fe640 1 --2- 172.21.15.38:0/1120151521 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f053c06cdd0 0x7f053c06f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.520+0000 7f05537fe640 1 --2- 172.21.15.38:0/1120151521 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f053c06cdd0 0x7f053c06f290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f054c031040 tx=0x7f054c00b040 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:25.529 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.526+0000 7f05517fa640 1 -- 172.21.15.38:0/1120151521 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0548056b90 con 0x7f0554067bc0 2024-09-13T18:31:25.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:25 smithi149 ceph-mon[35845]: pgmap v12: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 323 op/s 2024-09-13T18:31:25.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:25 smithi149 ceph-mon[35845]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:31:25.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.817+0000 7f055a2b0640 1 -- 172.21.15.38:0/1120151521 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f055419d820 con 0x7f0554067bc0 2024-09-13T18:31:25.821 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:25 smithi038 ceph-mon[27689]: pgmap v12: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 323 op/s 2024-09-13T18:31:25.821 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:25 smithi038 ceph-mon[27689]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:31:25.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.818+0000 7f05517fa640 1 -- 172.21.15.38:0/1120151521 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f054805a1b0 con 0x7f0554067bc0 2024-09-13T18:31:25.822 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:31:25.822 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:31:25.822 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T18:31:25.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:31:25.822 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:31:25.822 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:31:25.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:31:25.822 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:31:25.822 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T18:31:25.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:31:25.823 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:31:25.823 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:31:25.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:31:25.823 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:31:25.823 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 12, 2024-09-13T18:31:25.823 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:31:25.823 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:31:25.823 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:31:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.820+0000 7f055a2b0640 1 -- 172.21.15.38:0/1120151521 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f053c06cdd0 msgr2=0x7f053c06f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.820+0000 7f055a2b0640 1 --2- 172.21.15.38:0/1120151521 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f053c06cdd0 0x7f053c06f290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f054c031040 tx=0x7f054c00b040 comp rx=0 tx=0).stop 2024-09-13T18:31:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.820+0000 7f055a2b0640 1 -- 172.21.15.38:0/1120151521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0554067bc0 msgr2=0x7f05541975e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.820+0000 7f055a2b0640 1 --2- 172.21.15.38:0/1120151521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0554067bc0 0x7f05541975e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f054800e8e0 tx=0x7f054800eda0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.820+0000 7f055a2b0640 1 -- 172.21.15.38:0/1120151521 shutdown_connections 2024-09-13T18:31:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.820+0000 7f055a2b0640 1 --2- 172.21.15.38:0/1120151521 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0554068050 0x7f0554197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.820+0000 7f055a2b0640 1 --2- 172.21.15.38:0/1120151521 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f053c06cdd0 0x7f053c06f290 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.820+0000 7f055a2b0640 1 --2- 172.21.15.38:0/1120151521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0554067bc0 0x7f05541975e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.820+0000 7f055a2b0640 1 -- 172.21.15.38:0/1120151521 >> 172.21.15.38:0/1120151521 conn(0x7f05540f99b0 msgr2=0x7f0554105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:25.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.820+0000 7f055a2b0640 1 -- 172.21.15.38:0/1120151521 shutdown_connections 2024-09-13T18:31:25.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.820+0000 7f055a2b0640 1 -- 172.21.15.38:0/1120151521 wait complete. 2024-09-13T18:31:25.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.925+0000 7f4514aee640 1 -- 172.21.15.38:0/1789981057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45100fee10 msgr2=0x7f45100ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.925+0000 7f4514aee640 1 --2- 172.21.15.38:0/1789981057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45100fee10 0x7f45100ff270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4504009880 tx=0x7f450402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.925+0000 7f4514aee640 1 -- 172.21.15.38:0/1789981057 shutdown_connections 2024-09-13T18:31:25.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.925+0000 7f4514aee640 1 --2- 172.21.15.38:0/1789981057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45100fee10 0x7f45100ff270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.925+0000 7f4514aee640 1 --2- 172.21.15.38:0/1789981057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45100fe4d0 0x7f45100fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.925+0000 7f4514aee640 1 -- 172.21.15.38:0/1789981057 >> 172.21.15.38:0/1789981057 conn(0x7f45100fa280 msgr2=0x7f45100fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:25.928 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.925+0000 7f4514aee640 1 -- 172.21.15.38:0/1789981057 shutdown_connections 2024-09-13T18:31:25.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.925+0000 7f4514aee640 1 -- 172.21.15.38:0/1789981057 wait complete. 2024-09-13T18:31:25.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.926+0000 7f4514aee640 1 Processor -- start 2024-09-13T18:31:25.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.926+0000 7f4514aee640 1 -- start start 2024-09-13T18:31:25.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.926+0000 7f4514aee640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45100fe4d0 0x7f4510197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.926+0000 7f4514aee640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45100fee10 0x7f4510197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.926+0000 7f4514aee640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45101982a0 con 0x7f45100fe4d0 2024-09-13T18:31:25.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.926+0000 7f4514aee640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4510198410 con 0x7f45100fee10 2024-09-13T18:31:25.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.927+0000 7f450e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45100fe4d0 0x7f4510197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.927+0000 7f450e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45100fe4d0 0x7f4510197790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42264/0 (socket says 172.21.15.38:42264) 2024-09-13T18:31:25.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.927+0000 7f450e59c640 1 -- 172.21.15.38:0/1688524504 learned_addr learned my addr 172.21.15.38:0/1688524504 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:25.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.927+0000 7f450dd9b640 1 --2- 172.21.15.38:0/1688524504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45100fee10 0x7f4510197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.927+0000 7f450e59c640 1 -- 172.21.15.38:0/1688524504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45100fee10 msgr2=0x7f4510197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:25.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.927+0000 7f450e59c640 1 --2- 172.21.15.38:0/1688524504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45100fee10 0x7f4510197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:25.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.927+0000 7f450e59c640 1 -- 172.21.15.38:0/1688524504 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504009560 con 0x7f45100fe4d0 2024-09-13T18:31:25.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.927+0000 7f450e59c640 1 --2- 172.21.15.38:0/1688524504 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45100fe4d0 0x7f4510197790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f450000e9a0 tx=0x7f450000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:25.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.927+0000 7f44ff7fe640 1 -- 172.21.15.38:0/1688524504 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f450000cd50 con 0x7f45100fe4d0 2024-09-13T18:31:25.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.927+0000 7f44ff7fe640 1 -- 172.21.15.38:0/1688524504 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f450000ceb0 con 0x7f45100fe4d0 2024-09-13T18:31:25.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.927+0000 7f4514aee640 1 -- 172.21.15.38:0/1688524504 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451019ceb0 con 0x7f45100fe4d0 2024-09-13T18:31:25.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.928+0000 7f4514aee640 1 -- 172.21.15.38:0/1688524504 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451019d370 con 0x7f45100fe4d0 2024-09-13T18:31:25.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.928+0000 7f44ff7fe640 1 -- 172.21.15.38:0/1688524504 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4500010430 con 0x7f45100fe4d0 2024-09-13T18:31:25.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.929+0000 7f4514aee640 1 -- 172.21.15.38:0/1688524504 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451010a8a0 con 0x7f45100fe4d0 2024-09-13T18:31:25.932 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.929+0000 7f44ff7fe640 1 -- 172.21.15.38:0/1688524504 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f4500005020 con 0x7f45100fe4d0 2024-09-13T18:31:25.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.930+0000 7f44ff7fe640 1 --2- 172.21.15.38:0/1688524504 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f44f806cd90 0x7f44f806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:25.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.930+0000 7f44ff7fe640 1 -- 172.21.15.38:0/1688524504 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4500014070 con 0x7f45100fe4d0 2024-09-13T18:31:25.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.930+0000 7f450dd9b640 1 --2- 172.21.15.38:0/1688524504 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f44f806cd90 0x7f44f806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:25.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.931+0000 7f450dd9b640 1 --2- 172.21.15.38:0/1688524504 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f44f806cd90 0x7f44f806f250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4510198cb0 tx=0x7f4504031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:25.937 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:25.935+0000 7f44ff7fe640 1 -- 172.21.15.38:0/1688524504 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4500056b90 con 0x7f45100fe4d0 2024-09-13T18:31:26.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.178+0000 7f4514aee640 1 -- 172.21.15.38:0/1688524504 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f451019d9b0 con 0x7f45100fe4d0 2024-09-13T18:31:26.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.179+0000 7f44ff7fe640 1 -- 172.21.15.38:0/1688524504 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7f450005a1b0 con 0x7f45100fe4d0 2024-09-13T18:31:26.181 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:31:26.182 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:31:26.183 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:31:26.184 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:31:26.184 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:31:26.184 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:31:26.184 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:31:26.184 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:31:26.184 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:31:26.184 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:31:26.184 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:31:26.184 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:31:26.184 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:31:26.184 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:31:26.188 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:31:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.182+0000 7f4514aee640 1 -- 172.21.15.38:0/1688524504 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f44f806cd90 msgr2=0x7f44f806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.182+0000 7f4514aee640 1 --2- 172.21.15.38:0/1688524504 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f44f806cd90 0x7f44f806f250 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4510198cb0 tx=0x7f4504031400 comp rx=0 tx=0).stop 2024-09-13T18:31:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.182+0000 7f4514aee640 1 -- 172.21.15.38:0/1688524504 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45100fe4d0 msgr2=0x7f4510197790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.182+0000 7f4514aee640 1 --2- 172.21.15.38:0/1688524504 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45100fe4d0 0x7f4510197790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f450000e9a0 tx=0x7f450000eda0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.182+0000 7f4514aee640 1 -- 172.21.15.38:0/1688524504 shutdown_connections 2024-09-13T18:31:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.182+0000 7f4514aee640 1 --2- 172.21.15.38:0/1688524504 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f44f806cd90 0x7f44f806f250 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.182+0000 7f4514aee640 1 --2- 172.21.15.38:0/1688524504 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45100fee10 0x7f4510197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.182+0000 7f4514aee640 1 --2- 172.21.15.38:0/1688524504 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45100fe4d0 0x7f4510197790 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.182+0000 7f4514aee640 1 -- 172.21.15.38:0/1688524504 >> 172.21.15.38:0/1688524504 conn(0x7f45100fa280 msgr2=0x7f4510106b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.182+0000 7f4514aee640 1 -- 172.21.15.38:0/1688524504 shutdown_connections 2024-09-13T18:31:26.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.182+0000 7f4514aee640 1 -- 172.21.15.38:0/1688524504 wait complete. 2024-09-13T18:31:26.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.320+0000 7fe62911e640 1 -- 172.21.15.38:0/1454890420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6240feaf0 msgr2=0x7fe6240feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:26.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.320+0000 7fe62911e640 1 --2- 172.21.15.38:0/1454890420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6240feaf0 0x7fe6240feef0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe614009880 tx=0x7fe61402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.320+0000 7fe62911e640 1 -- 172.21.15.38:0/1454890420 shutdown_connections 2024-09-13T18:31:26.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.320+0000 7fe62911e640 1 --2- 172.21.15.38:0/1454890420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6240ffcf0 0x7fe624100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.320+0000 7fe62911e640 1 --2- 172.21.15.38:0/1454890420 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6240feaf0 0x7fe6240feef0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.320+0000 7fe62911e640 1 -- 172.21.15.38:0/1454890420 >> 172.21.15.38:0/1454890420 conn(0x7fe6240fa280 msgr2=0x7fe6240fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:26.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.321+0000 7fe62911e640 1 -- 172.21.15.38:0/1454890420 shutdown_connections 2024-09-13T18:31:26.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.321+0000 7fe62911e640 1 -- 172.21.15.38:0/1454890420 wait complete. 2024-09-13T18:31:26.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.321+0000 7fe62911e640 1 Processor -- start 2024-09-13T18:31:26.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.322+0000 7fe62911e640 1 -- start start 2024-09-13T18:31:26.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.322+0000 7fe62911e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6240feaf0 0x7fe624102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:26.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.322+0000 7fe62911e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6240ffcf0 0x7fe6241010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:26.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.322+0000 7fe62911e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe624102fe0 con 0x7fe6240feaf0 2024-09-13T18:31:26.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.322+0000 7fe62911e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe624101640 con 0x7fe6240ffcf0 2024-09-13T18:31:26.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.322+0000 7fe622d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6240feaf0 0x7fe624102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:26.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.322+0000 7fe622d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6240feaf0 0x7fe624102a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42276/0 (socket says 172.21.15.38:42276) 2024-09-13T18:31:26.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.322+0000 7fe622d9d640 1 -- 172.21.15.38:0/2161472352 learned_addr learned my addr 172.21.15.38:0/2161472352 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:26.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.322+0000 7fe62259c640 1 --2- 172.21.15.38:0/2161472352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6240ffcf0 0x7fe6241010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:26.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.323+0000 7fe622d9d640 1 -- 172.21.15.38:0/2161472352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6240ffcf0 msgr2=0x7fe6241010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:26.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.323+0000 7fe622d9d640 1 --2- 172.21.15.38:0/2161472352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6240ffcf0 0x7fe6241010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.323+0000 7fe622d9d640 1 -- 172.21.15.38:0/2161472352 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe614009560 con 0x7fe6240feaf0 2024-09-13T18:31:26.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.323+0000 7fe62259c640 1 --2- 172.21.15.38:0/2161472352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6240ffcf0 0x7fe6241010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:26.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.323+0000 7fe622d9d640 1 --2- 172.21.15.38:0/2161472352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6240feaf0 0x7fe624102a10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe614005ab0 tx=0x7fe614004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:26.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.323+0000 7fe60bfff640 1 -- 172.21.15.38:0/2161472352 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6140053e0 con 0x7fe6240feaf0 2024-09-13T18:31:26.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.323+0000 7fe60bfff640 1 -- 172.21.15.38:0/2161472352 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe614005540 con 0x7fe6240feaf0 2024-09-13T18:31:26.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.323+0000 7fe62911e640 1 -- 172.21.15.38:0/2161472352 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6241018c0 con 0x7fe6240feaf0 2024-09-13T18:31:26.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.323+0000 7fe60bfff640 1 -- 172.21.15.38:0/2161472352 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe614031990 con 0x7fe6240feaf0 2024-09-13T18:31:26.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.323+0000 7fe62911e640 1 -- 172.21.15.38:0/2161472352 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe624101db0 con 0x7fe6240feaf0 2024-09-13T18:31:26.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.325+0000 7fe62911e640 1 -- 172.21.15.38:0/2161472352 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6241075c0 con 0x7fe6240feaf0 2024-09-13T18:31:26.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.325+0000 7fe60bfff640 1 -- 172.21.15.38:0/2161472352 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fe614003c90 con 0x7fe6240feaf0 2024-09-13T18:31:26.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.326+0000 7fe60bfff640 1 --2- 172.21.15.38:0/2161472352 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe60c06cd90 0x7fe60c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:26.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.326+0000 7fe60bfff640 1 -- 172.21.15.38:0/2161472352 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe6140ad410 con 0x7fe6240feaf0 2024-09-13T18:31:26.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.327+0000 7fe62259c640 1 --2- 172.21.15.38:0/2161472352 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe60c06cd90 0x7fe60c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:26.329 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.327+0000 7fe62259c640 1 --2- 172.21.15.38:0/2161472352 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe60c06cd90 0x7fe60c06f250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe624102790 tx=0x7fe618005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:26.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.331+0000 7fe60bfff640 1 -- 172.21.15.38:0/2161472352 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe614077440 con 0x7fe6240feaf0 2024-09-13T18:31:26.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.676+0000 7fe62911e640 1 -- 172.21.15.38:0/2161472352 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6240fc4b0 con 0x7fe60c06cd90 2024-09-13T18:31:26.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.677+0000 7fe60bfff640 1 -- 172.21.15.38:0/2161472352 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fe6240fc4b0 con 0x7fe60c06cd90 2024-09-13T18:31:26.680 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:31:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:31:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:31:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:31:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:31:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2024-09-13T18:31:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:31:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "2/23 daemons upgraded", 2024-09-13T18:31:26.680 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "", 2024-09-13T18:31:26.681 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:31:26.681 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:31:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.680+0000 7fe62911e640 1 -- 172.21.15.38:0/2161472352 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe60c06cd90 msgr2=0x7fe60c06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.680+0000 7fe62911e640 1 --2- 172.21.15.38:0/2161472352 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe60c06cd90 0x7fe60c06f250 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe624102790 tx=0x7fe618005f90 comp rx=0 tx=0).stop 2024-09-13T18:31:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.680+0000 7fe62911e640 1 -- 172.21.15.38:0/2161472352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6240feaf0 msgr2=0x7fe624102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.680+0000 7fe62911e640 1 --2- 172.21.15.38:0/2161472352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6240feaf0 0x7fe624102a10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe614005ab0 tx=0x7fe614004c60 comp rx=0 tx=0).stop 2024-09-13T18:31:26.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.680+0000 7fe62911e640 1 -- 172.21.15.38:0/2161472352 shutdown_connections 2024-09-13T18:31:26.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.680+0000 7fe62911e640 1 --2- 172.21.15.38:0/2161472352 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe60c06cd90 0x7fe60c06f250 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.680+0000 7fe62911e640 1 --2- 172.21.15.38:0/2161472352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6240ffcf0 0x7fe6241010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.680+0000 7fe62911e640 1 --2- 172.21.15.38:0/2161472352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6240feaf0 0x7fe624102a10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.680+0000 7fe62911e640 1 -- 172.21.15.38:0/2161472352 >> 172.21.15.38:0/2161472352 conn(0x7fe6240fa280 msgr2=0x7fe6240fbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:26.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.680+0000 7fe62911e640 1 -- 172.21.15.38:0/2161472352 shutdown_connections 2024-09-13T18:31:26.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.680+0000 7fe62911e640 1 -- 172.21.15.38:0/2161472352 wait complete. 2024-09-13T18:31:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:26 smithi149 ceph-mon[35845]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:31:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:26 smithi149 ceph-mon[35845]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:31:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:26 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1120151521' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:31:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:26 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/1688524504' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:31:26.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.780+0000 7f92ceb38640 1 -- 172.21.15.38:0/2284972391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c8100680 msgr2=0x7f92c8102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:26.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.780+0000 7f92ceb38640 1 --2- 172.21.15.38:0/2284972391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c8100680 0x7f92c8102a70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0098b0 tx=0x7f92bc02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.780+0000 7f92ceb38640 1 -- 172.21.15.38:0/2284972391 shutdown_connections 2024-09-13T18:31:26.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.780+0000 7f92ceb38640 1 --2- 172.21.15.38:0/2284972391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92c8102fb0 0x7f92c81053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.780+0000 7f92ceb38640 1 --2- 172.21.15.38:0/2284972391 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c8100680 0x7f92c8102a70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.780+0000 7f92ceb38640 1 -- 172.21.15.38:0/2284972391 >> 172.21.15.38:0/2284972391 conn(0x7f92c80fa280 msgr2=0x7f92c80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:26.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.780+0000 7f92ceb38640 1 -- 172.21.15.38:0/2284972391 shutdown_connections 2024-09-13T18:31:26.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.780+0000 7f92ceb38640 1 -- 172.21.15.38:0/2284972391 wait complete. 2024-09-13T18:31:26.784 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:26 smithi038 ceph-mon[27689]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:31:26.784 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:26 smithi038 ceph-mon[27689]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:31:26.784 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:26 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1120151521' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:31:26.784 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:26 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/1688524504' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:31:26.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.781+0000 7f92ceb38640 1 Processor -- start 2024-09-13T18:31:26.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.781+0000 7f92ceb38640 1 -- start start 2024-09-13T18:31:26.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.781+0000 7f92ceb38640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c8100680 0x7f92c819bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:26.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.781+0000 7f92ceb38640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92c8102fb0 0x7f92c819c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:26.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.781+0000 7f92ceb38640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c819c740 con 0x7f92c8100680 2024-09-13T18:31:26.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.781+0000 7f92ceb38640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c819c8b0 con 0x7f92c8102fb0 2024-09-13T18:31:26.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.781+0000 7f92cc8d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c8100680 0x7f92c819bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:26.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.781+0000 7f92cc8d4640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c8100680 0x7f92c819bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42300/0 (socket says 172.21.15.38:42300) 2024-09-13T18:31:26.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.781+0000 7f92cc8d4640 1 -- 172.21.15.38:0/2474453542 learned_addr learned my addr 172.21.15.38:0/2474453542 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:26.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.781+0000 7f92c7fff640 1 --2- 172.21.15.38:0/2474453542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92c8102fb0 0x7f92c819c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:26.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.782+0000 7f92cc8d4640 1 -- 172.21.15.38:0/2474453542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92c8102fb0 msgr2=0x7f92c819c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:26.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.782+0000 7f92cc8d4640 1 --2- 172.21.15.38:0/2474453542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92c8102fb0 0x7f92c819c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:26.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.782+0000 7f92cc8d4640 1 -- 172.21.15.38:0/2474453542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc009560 con 0x7f92c8100680 2024-09-13T18:31:26.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.782+0000 7f92cc8d4640 1 --2- 172.21.15.38:0/2474453542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c8100680 0x7f92c819bc30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f92bc006010 tx=0x7f92bc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:26.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.782+0000 7f92c5ffb640 1 -- 172.21.15.38:0/2474453542 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92bc004aa0 con 0x7f92c8100680 2024-09-13T18:31:26.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.782+0000 7f92ceb38640 1 -- 172.21.15.38:0/2474453542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c81004f0 con 0x7f92c8100680 2024-09-13T18:31:26.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.782+0000 7f92ceb38640 1 -- 172.21.15.38:0/2474453542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c81a1640 con 0x7f92c8100680 2024-09-13T18:31:26.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.782+0000 7f92c5ffb640 1 -- 172.21.15.38:0/2474453542 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f92bc005d50 con 0x7f92c8100680 2024-09-13T18:31:26.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.783+0000 7f92c5ffb640 1 -- 172.21.15.38:0/2474453542 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92bc031950 con 0x7f92c8100680 2024-09-13T18:31:26.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.784+0000 7f92ceb38640 1 -- 172.21.15.38:0/2474453542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac005280 con 0x7f92c8100680 2024-09-13T18:31:26.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.784+0000 7f92c5ffb640 1 -- 172.21.15.38:0/2474453542 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f92bc003c20 con 0x7f92c8100680 2024-09-13T18:31:26.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.785+0000 7f92c5ffb640 1 --2- 172.21.15.38:0/2474453542 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f92b806cd80 0x7f92b806f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:26.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.785+0000 7f92c5ffb640 1 -- 172.21.15.38:0/2474453542 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f92bc0ad750 con 0x7f92c8100680 2024-09-13T18:31:26.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.786+0000 7f92c7fff640 1 --2- 172.21.15.38:0/2474453542 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f92b806cd80 0x7f92b806f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:26.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.786+0000 7f92c7fff640 1 --2- 172.21.15.38:0/2474453542 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f92b806cd80 0x7f92b806f240 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f92c8068790 tx=0x7f92b4005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:26.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:26.794+0000 7f92c5ffb640 1 -- 172.21.15.38:0/2474453542 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f92bc077700 con 0x7f92c8100680 2024-09-13T18:31:27.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.051+0000 7f92ceb38640 1 -- 172.21.15.38:0/2474453542 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f92ac0050f0 con 0x7f92c8100680 2024-09-13T18:31:27.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.051+0000 7f92c5ffb640 1 -- 172.21.15.38:0/2474453542 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f92bc07ad20 con 0x7f92c8100680 2024-09-13T18:31:27.054 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:31:27.056 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.054+0000 7f92ceb38640 1 -- 172.21.15.38:0/2474453542 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f92b806cd80 msgr2=0x7f92b806f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:27.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.054+0000 7f92ceb38640 1 --2- 172.21.15.38:0/2474453542 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f92b806cd80 0x7f92b806f240 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f92c8068790 tx=0x7f92b4005f90 comp rx=0 tx=0).stop 2024-09-13T18:31:27.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.054+0000 7f92ceb38640 1 -- 172.21.15.38:0/2474453542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c8100680 msgr2=0x7f92c819bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:27.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.054+0000 7f92ceb38640 1 --2- 172.21.15.38:0/2474453542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c8100680 0x7f92c819bc30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f92bc006010 tx=0x7f92bc0055a0 comp rx=0 tx=0).stop 2024-09-13T18:31:27.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.054+0000 7f92ceb38640 1 -- 172.21.15.38:0/2474453542 shutdown_connections 2024-09-13T18:31:27.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.054+0000 7f92ceb38640 1 --2- 172.21.15.38:0/2474453542 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f92b806cd80 0x7f92b806f240 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:27.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.054+0000 7f92ceb38640 1 --2- 172.21.15.38:0/2474453542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92c8102fb0 0x7f92c819c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:27.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.054+0000 7f92ceb38640 1 --2- 172.21.15.38:0/2474453542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f92c8100680 0x7f92c819bc30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:27.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.054+0000 7f92ceb38640 1 -- 172.21.15.38:0/2474453542 >> 172.21.15.38:0/2474453542 conn(0x7f92c80fa280 msgr2=0x7f92c80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:27.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.054+0000 7f92ceb38640 1 -- 172.21.15.38:0/2474453542 shutdown_connections 2024-09-13T18:31:27.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:27.054+0000 7f92ceb38640 1 -- 172.21.15.38:0/2474453542 wait complete. 2024-09-13T18:31:27.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:27 smithi149 ceph-mon[35845]: pgmap v13: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 184 op/s 2024-09-13T18:31:27.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:27 smithi149 ceph-mon[35845]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:31:27.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:27 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/2474453542' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:31:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:27 smithi038 ceph-mon[27689]: pgmap v13: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 184 op/s 2024-09-13T18:31:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:27 smithi038 ceph-mon[27689]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:31:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:27 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/2474453542' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:31:29.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:29 smithi149 ceph-mon[35845]: pgmap v14: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 309 op/s 2024-09-13T18:31:29.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:29 smithi038 ceph-mon[27689]: pgmap v14: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 309 op/s 2024-09-13T18:31:31.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:31 smithi038 ceph-mon[27689]: pgmap v15: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 163 op/s 2024-09-13T18:31:31.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:31 smithi149 ceph-mon[35845]: pgmap v15: 65 pgs: 65 active+clean; 314 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 163 op/s 2024-09-13T18:31:33.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:33 smithi149 ceph-mon[35845]: pgmap v16: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 199 op/s 2024-09-13T18:31:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:33 smithi038 ceph-mon[27689]: pgmap v16: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 199 op/s 2024-09-13T18:31:35.743 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:35 smithi038 ceph-mon[27689]: pgmap v17: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 346 op/s 2024-09-13T18:31:35.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:35 smithi149 ceph-mon[35845]: pgmap v17: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 346 op/s 2024-09-13T18:31:37.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:37 smithi149 ceph-mon[35845]: pgmap v18: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 319 op/s 2024-09-13T18:31:37.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:37 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:31:37.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:37 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:37.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:37 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:37.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:37 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:31:37.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:37 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:31:37.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:37 smithi149 ceph-mon[35845]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-13T18:31:37.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:37 smithi149 ceph-mon[35845]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T18:31:37.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:37 smithi038 ceph-mon[27689]: pgmap v18: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 319 op/s 2024-09-13T18:31:37.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:37 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:31:37.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:37 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:37.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:37 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:37.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:37 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:31:37.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:37 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:31:37.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:37 smithi038 ceph-mon[27689]: Updating smithi038:/etc/ceph/ceph.conf 2024-09-13T18:31:37.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:37 smithi038 ceph-mon[27689]: Updating smithi149:/etc/ceph/ceph.conf 2024-09-13T18:31:39.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:38 smithi038 ceph-mon[27689]: Updating smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:31:39.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:38 smithi038 ceph-mon[27689]: Updating smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:31:39.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:38 smithi038 ceph-mon[27689]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:31:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:38 smithi038 ceph-mon[27689]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:31:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:38 smithi038 ceph-mon[27689]: Updating smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:31:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:38 smithi038 ceph-mon[27689]: Updating smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:31:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:38 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:38 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:38 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:38 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:39.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:38 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:38 smithi149 ceph-mon[35845]: Updating smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:31:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:38 smithi149 ceph-mon[35845]: Updating smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T18:31:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:38 smithi149 ceph-mon[35845]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:31:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:38 smithi149 ceph-mon[35845]: Updating smithi038:/etc/ceph/ceph.client.admin.keyring 2024-09-13T18:31:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:38 smithi149 ceph-mon[35845]: Updating smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:31:39.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:38 smithi149 ceph-mon[35845]: Updating smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T18:31:39.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:38 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:39.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:38 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:39.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:38 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:39.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:38 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:39.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:38 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:40.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:39 smithi038 ceph-mon[27689]: Reconfiguring prometheus.smithi038 (dependencies changed)... 2024-09-13T18:31:40.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:39 smithi038 ceph-mon[27689]: Reconfiguring daemon prometheus.smithi038 on smithi038 2024-09-13T18:31:40.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:39 smithi038 ceph-mon[27689]: pgmap v19: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 545 op/s 2024-09-13T18:31:40.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:39 smithi149 ceph-mon[35845]: Reconfiguring prometheus.smithi038 (dependencies changed)... 2024-09-13T18:31:40.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:39 smithi149 ceph-mon[35845]: Reconfiguring daemon prometheus.smithi038 on smithi038 2024-09-13T18:31:40.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:39 smithi149 ceph-mon[35845]: pgmap v19: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 545 op/s 2024-09-13T18:31:42.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:41 smithi149 ceph-mon[35845]: pgmap v20: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 420 op/s 2024-09-13T18:31:42.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:41 smithi038 ceph-mon[27689]: pgmap v20: 65 pgs: 65 active+clean; 325 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 420 op/s 2024-09-13T18:31:44.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:43 smithi149 ceph-mon[35845]: pgmap v21: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 610 op/s 2024-09-13T18:31:44.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:43 smithi038 ceph-mon[27689]: pgmap v21: 65 pgs: 65 active+clean; 326 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 610 op/s 2024-09-13T18:31:46.134 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:45 smithi038 ceph-mon[27689]: pgmap v22: 65 pgs: 65 active+clean; 316 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 860 op/s 2024-09-13T18:31:46.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:45 smithi149 ceph-mon[35845]: pgmap v22: 65 pgs: 65 active+clean; 316 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 860 op/s 2024-09-13T18:31:48.128 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:47 smithi038 ceph-mon[27689]: pgmap v23: 65 pgs: 65 active+clean; 316 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 702 op/s 2024-09-13T18:31:48.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:47 smithi149 ceph-mon[35845]: pgmap v23: 65 pgs: 65 active+clean; 316 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 702 op/s 2024-09-13T18:31:50.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:49 smithi149 ceph-mon[35845]: pgmap v24: 65 pgs: 65 active+clean; 291 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 1.10k op/s 2024-09-13T18:31:50.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:49 smithi038 ceph-mon[27689]: pgmap v24: 65 pgs: 65 active+clean; 291 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 1.10k op/s 2024-09-13T18:31:52.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:51 smithi149 ceph-mon[35845]: pgmap v25: 65 pgs: 65 active+clean; 291 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 872 op/s 2024-09-13T18:31:52.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:51 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:31:52.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:51 smithi038 ceph-mon[27689]: pgmap v25: 65 pgs: 65 active+clean; 291 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 872 op/s 2024-09-13T18:31:52.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:51 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:31:54.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:53 smithi038 ceph-mon[27689]: pgmap v26: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 993 op/s 2024-09-13T18:31:54.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:53 smithi149 ceph-mon[35845]: pgmap v26: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 993 op/s 2024-09-13T18:31:56.128 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:55 smithi149 ceph-mon[35845]: pgmap v27: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 868 op/s 2024-09-13T18:31:56.128 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:55 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:56.128 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:55 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:56.128 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:55 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:31:56.128 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:55 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:31:56.173 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:55 smithi038 ceph-mon[27689]: pgmap v27: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 868 op/s 2024-09-13T18:31:56.173 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:55 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:56.173 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:55 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:31:56.173 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:55 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:31:56.173 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:55 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:31:57.132 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:56 smithi149 ceph-mon[35845]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:31:57.180 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:56 smithi038 ceph-mon[27689]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:31:57.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.177+0000 7fef5e772640 1 -- 172.21.15.38:0/1156741529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580feaf0 msgr2=0x7fef580feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:57.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.177+0000 7fef5e772640 1 --2- 172.21.15.38:0/1156741529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580feaf0 0x7fef580feef0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fef48009880 tx=0x7fef4802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.177+0000 7fef5e772640 1 -- 172.21.15.38:0/1156741529 shutdown_connections 2024-09-13T18:31:57.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.177+0000 7fef5e772640 1 --2- 172.21.15.38:0/1156741529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef580ffcf0 0x7fef58100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.177+0000 7fef5e772640 1 --2- 172.21.15.38:0/1156741529 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580feaf0 0x7fef580feef0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.177+0000 7fef5e772640 1 -- 172.21.15.38:0/1156741529 >> 172.21.15.38:0/1156741529 conn(0x7fef580fa280 msgr2=0x7fef580fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:57.181 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.177+0000 7fef5e772640 1 -- 172.21.15.38:0/1156741529 shutdown_connections 2024-09-13T18:31:57.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.177+0000 7fef5e772640 1 -- 172.21.15.38:0/1156741529 wait complete. 2024-09-13T18:31:57.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.178+0000 7fef5e772640 1 Processor -- start 2024-09-13T18:31:57.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.179+0000 7fef5e772640 1 -- start start 2024-09-13T18:31:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.179+0000 7fef5e772640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580feaf0 0x7fef58068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.179+0000 7fef5e772640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef580ffcf0 0x7fef5819c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.179+0000 7fef5e772640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef58195fa0 con 0x7fef580feaf0 2024-09-13T18:31:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.179+0000 7fef5e772640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5819ca70 con 0x7fef580ffcf0 2024-09-13T18:31:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.179+0000 7fef57fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580feaf0 0x7fef58068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.179+0000 7fef57fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580feaf0 0x7fef58068790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40808/0 (socket says 172.21.15.38:40808) 2024-09-13T18:31:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.179+0000 7fef57fff640 1 -- 172.21.15.38:0/392535191 learned_addr learned my addr 172.21.15.38:0/392535191 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.179+0000 7fef577fe640 1 --2- 172.21.15.38:0/392535191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef580ffcf0 0x7fef5819c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.180+0000 7fef577fe640 1 -- 172.21.15.38:0/392535191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580feaf0 msgr2=0x7fef58068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:57.183 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.180+0000 7fef577fe640 1 --2- 172.21.15.38:0/392535191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580feaf0 0x7fef58068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.180+0000 7fef577fe640 1 -- 172.21.15.38:0/392535191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009560 con 0x7fef580ffcf0 2024-09-13T18:31:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.180+0000 7fef577fe640 1 --2- 172.21.15.38:0/392535191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef580ffcf0 0x7fef5819c530 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00e970 tx=0x7fef4c00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.180+0000 7fef557fa640 1 -- 172.21.15.38:0/392535191 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef4c009640 con 0x7fef580ffcf0 2024-09-13T18:31:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.180+0000 7fef557fa640 1 -- 172.21.15.38:0/392535191 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef4c00cc90 con 0x7fef580ffcf0 2024-09-13T18:31:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.180+0000 7fef557fa640 1 -- 172.21.15.38:0/392535191 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef4c0187c0 con 0x7fef580ffcf0 2024-09-13T18:31:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.180+0000 7fef5e772640 1 -- 172.21.15.38:0/392535191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5819cca0 con 0x7fef580ffcf0 2024-09-13T18:31:57.184 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.180+0000 7fef5e772640 1 -- 172.21.15.38:0/392535191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5819d190 con 0x7fef580ffcf0 2024-09-13T18:31:57.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.182+0000 7fef557fa640 1 -- 172.21.15.38:0/392535191 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fef4c010430 con 0x7fef580ffcf0 2024-09-13T18:31:57.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.182+0000 7fef557fa640 1 --2- 172.21.15.38:0/392535191 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fef4006cde0 0x7fef4006f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:57.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.182+0000 7fef557fa640 1 -- 172.21.15.38:0/392535191 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fef4c014070 con 0x7fef580ffcf0 2024-09-13T18:31:57.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.183+0000 7fef5e772640 1 -- 172.21.15.38:0/392535191 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5818e530 con 0x7fef580ffcf0 2024-09-13T18:31:57.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.183+0000 7fef57fff640 1 --2- 172.21.15.38:0/392535191 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fef4006cde0 0x7fef4006f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:57.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.183+0000 7fef57fff640 1 --2- 172.21.15.38:0/392535191 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fef4006cde0 0x7fef4006f2a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fef48009230 tx=0x7fef48000bc0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:57.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.188+0000 7fef557fa640 1 -- 172.21.15.38:0/392535191 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fef4c052e20 con 0x7fef580ffcf0 2024-09-13T18:31:57.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.458+0000 7fef5e772640 1 -- 172.21.15.38:0/392535191 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef5802c640 con 0x7fef4006cde0 2024-09-13T18:31:57.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.460+0000 7fef557fa640 1 -- 172.21.15.38:0/392535191 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fef5802c640 con 0x7fef4006cde0 2024-09-13T18:31:57.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.462+0000 7fef5e772640 1 -- 172.21.15.38:0/392535191 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fef4006cde0 msgr2=0x7fef4006f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:57.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.462+0000 7fef5e772640 1 --2- 172.21.15.38:0/392535191 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fef4006cde0 0x7fef4006f2a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fef48009230 tx=0x7fef48000bc0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.462+0000 7fef5e772640 1 -- 172.21.15.38:0/392535191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef580ffcf0 msgr2=0x7fef5819c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:57.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.462+0000 7fef5e772640 1 --2- 172.21.15.38:0/392535191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef580ffcf0 0x7fef5819c530 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00e970 tx=0x7fef4c00ee30 comp rx=0 tx=0).stop 2024-09-13T18:31:57.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.462+0000 7fef5e772640 1 -- 172.21.15.38:0/392535191 shutdown_connections 2024-09-13T18:31:57.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.462+0000 7fef5e772640 1 --2- 172.21.15.38:0/392535191 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fef4006cde0 0x7fef4006f2a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.462+0000 7fef5e772640 1 --2- 172.21.15.38:0/392535191 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef580ffcf0 0x7fef5819c530 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.462+0000 7fef5e772640 1 --2- 172.21.15.38:0/392535191 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef580feaf0 0x7fef58068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.462+0000 7fef5e772640 1 -- 172.21.15.38:0/392535191 >> 172.21.15.38:0/392535191 conn(0x7fef580fa280 msgr2=0x7fef58103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:57.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.462+0000 7fef5e772640 1 -- 172.21.15.38:0/392535191 shutdown_connections 2024-09-13T18:31:57.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.463+0000 7fef5e772640 1 -- 172.21.15.38:0/392535191 wait complete. 2024-09-13T18:31:57.477 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:31:57.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.568+0000 7fcd23471640 1 -- 172.21.15.38:0/868312082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd1c0ffb80 msgr2=0x7fcd1c0fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:57.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.568+0000 7fcd23471640 1 --2- 172.21.15.38:0/868312082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd1c0ffb80 0x7fcd1c0fff80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009880 tx=0x7fcd1802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.568+0000 7fcd23471640 1 -- 172.21.15.38:0/868312082 shutdown_connections 2024-09-13T18:31:57.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.568+0000 7fcd23471640 1 --2- 172.21.15.38:0/868312082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd1c100d80 0x7fcd1c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.568+0000 7fcd23471640 1 --2- 172.21.15.38:0/868312082 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd1c0ffb80 0x7fcd1c0fff80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.568+0000 7fcd23471640 1 -- 172.21.15.38:0/868312082 >> 172.21.15.38:0/868312082 conn(0x7fcd1c0fb310 msgr2=0x7fcd1c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:57.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.568+0000 7fcd23471640 1 -- 172.21.15.38:0/868312082 shutdown_connections 2024-09-13T18:31:57.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.568+0000 7fcd23471640 1 -- 172.21.15.38:0/868312082 wait complete. 2024-09-13T18:31:57.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.569+0000 7fcd23471640 1 Processor -- start 2024-09-13T18:31:57.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.569+0000 7fcd23471640 1 -- start start 2024-09-13T18:31:57.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.569+0000 7fcd23471640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd1c0ffb80 0x7fcd1c195520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:57.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.569+0000 7fcd23471640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd1c100d80 0x7fcd1c195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:57.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.569+0000 7fcd23471640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c196030 con 0x7fcd1c100d80 2024-09-13T18:31:57.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.569+0000 7fcd23471640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1961a0 con 0x7fcd1c0ffb80 2024-09-13T18:31:57.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.570+0000 7fcd20a0c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd1c100d80 0x7fcd1c195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.570+0000 7fcd20a0c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd1c100d80 0x7fcd1c195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40834/0 (socket says 172.21.15.38:40834) 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.570+0000 7fcd20a0c640 1 -- 172.21.15.38:0/2044013976 learned_addr learned my addr 172.21.15.38:0/2044013976 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.570+0000 7fcd2120d640 1 --2- 172.21.15.38:0/2044013976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd1c0ffb80 0x7fcd1c195520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.570+0000 7fcd2120d640 1 -- 172.21.15.38:0/2044013976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd1c100d80 msgr2=0x7fcd1c195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.570+0000 7fcd2120d640 1 --2- 172.21.15.38:0/2044013976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd1c100d80 0x7fcd1c195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.570+0000 7fcd2120d640 1 -- 172.21.15.38:0/2044013976 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18009560 con 0x7fcd1c0ffb80 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.571+0000 7fcd2120d640 1 --2- 172.21.15.38:0/2044013976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd1c0ffb80 0x7fcd1c195520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd1802a9c0 tx=0x7fcd180055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.571+0000 7fcd127fc640 1 -- 172.21.15.38:0/2044013976 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd18004aa0 con 0x7fcd1c0ffb80 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.571+0000 7fcd127fc640 1 -- 172.21.15.38:0/2044013976 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd18005d50 con 0x7fcd1c0ffb80 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.571+0000 7fcd23471640 1 -- 172.21.15.38:0/2044013976 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c19abe0 con 0x7fcd1c0ffb80 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.571+0000 7fcd127fc640 1 -- 172.21.15.38:0/2044013976 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd180318b0 con 0x7fcd1c0ffb80 2024-09-13T18:31:57.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.571+0000 7fcd23471640 1 -- 172.21.15.38:0/2044013976 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c19b0d0 con 0x7fcd1c0ffb80 2024-09-13T18:31:57.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.572+0000 7fcd23471640 1 -- 172.21.15.38:0/2044013976 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c108630 con 0x7fcd1c0ffb80 2024-09-13T18:31:57.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.573+0000 7fcd127fc640 1 -- 172.21.15.38:0/2044013976 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fcd18003b90 con 0x7fcd1c0ffb80 2024-09-13T18:31:57.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.574+0000 7fcd127fc640 1 --2- 172.21.15.38:0/2044013976 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcd0806cd80 0x7fcd0806f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:57.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.574+0000 7fcd127fc640 1 -- 172.21.15.38:0/2044013976 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcd180ad750 con 0x7fcd1c0ffb80 2024-09-13T18:31:57.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.574+0000 7fcd20a0c640 1 --2- 172.21.15.38:0/2044013976 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcd0806cd80 0x7fcd0806f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:57.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.574+0000 7fcd20a0c640 1 --2- 172.21.15.38:0/2044013976 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcd0806cd80 0x7fcd0806f240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c196a40 tx=0x7fcd0c005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:57.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.578+0000 7fcd127fc640 1 -- 172.21.15.38:0/2044013976 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcd180776e0 con 0x7fcd1c0ffb80 2024-09-13T18:31:57.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.827+0000 7fcd23471640 1 -- 172.21.15.38:0/2044013976 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd1c19b3b0 con 0x7fcd0806cd80 2024-09-13T18:31:57.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.829+0000 7fcd127fc640 1 -- 172.21.15.38:0/2044013976 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fcd1c19b3b0 con 0x7fcd0806cd80 2024-09-13T18:31:57.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.834+0000 7fcd23471640 1 -- 172.21.15.38:0/2044013976 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcd0806cd80 msgr2=0x7fcd0806f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:57.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.834+0000 7fcd23471640 1 --2- 172.21.15.38:0/2044013976 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcd0806cd80 0x7fcd0806f240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c196a40 tx=0x7fcd0c005f90 comp rx=0 tx=0).stop 2024-09-13T18:31:57.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.834+0000 7fcd23471640 1 -- 172.21.15.38:0/2044013976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd1c0ffb80 msgr2=0x7fcd1c195520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.834+0000 7fcd23471640 1 --2- 172.21.15.38:0/2044013976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd1c0ffb80 0x7fcd1c195520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd1802a9c0 tx=0x7fcd180055a0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.834+0000 7fcd23471640 1 -- 172.21.15.38:0/2044013976 shutdown_connections 2024-09-13T18:31:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.834+0000 7fcd23471640 1 --2- 172.21.15.38:0/2044013976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcd1c100d80 0x7fcd1c195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.834+0000 7fcd23471640 1 --2- 172.21.15.38:0/2044013976 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcd0806cd80 0x7fcd0806f240 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.834+0000 7fcd23471640 1 --2- 172.21.15.38:0/2044013976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd1c0ffb80 0x7fcd1c195520 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.834+0000 7fcd23471640 1 -- 172.21.15.38:0/2044013976 >> 172.21.15.38:0/2044013976 conn(0x7fcd1c0fb310 msgr2=0x7fcd1c103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.834+0000 7fcd23471640 1 -- 172.21.15.38:0/2044013976 shutdown_connections 2024-09-13T18:31:57.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.834+0000 7fcd23471640 1 -- 172.21.15.38:0/2044013976 wait complete. 2024-09-13T18:31:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.961+0000 7fa9f939d640 1 -- 172.21.15.38:0/3851519847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4100dc0 msgr2=0x7fa9f4103230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:57.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.961+0000 7fa9f939d640 1 --2- 172.21.15.38:0/3851519847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4100dc0 0x7fa9f4103230 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009c20 tx=0x7fa9dc02a980 comp rx=0 tx=0).stop 2024-09-13T18:31:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.962+0000 7fa9f939d640 1 -- 172.21.15.38:0/3851519847 shutdown_connections 2024-09-13T18:31:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.962+0000 7fa9f939d640 1 --2- 172.21.15.38:0/3851519847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f4100dc0 0x7fa9f4103230 secure :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009c20 tx=0x7fa9dc02a980 comp rx=0 tx=0).stop 2024-09-13T18:31:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.962+0000 7fa9f939d640 1 --2- 172.21.15.38:0/3851519847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f40fe470 0x7fa9f4100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.962+0000 7fa9f939d640 1 -- 172.21.15.38:0/3851519847 >> 172.21.15.38:0/3851519847 conn(0x7fa9f40fa280 msgr2=0x7fa9f40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.962+0000 7fa9f939d640 1 -- 172.21.15.38:0/3851519847 shutdown_connections 2024-09-13T18:31:57.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.963+0000 7fa9f939d640 1 -- 172.21.15.38:0/3851519847 wait complete. 2024-09-13T18:31:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.963+0000 7fa9f939d640 1 Processor -- start 2024-09-13T18:31:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.964+0000 7fa9f939d640 1 -- start start 2024-09-13T18:31:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.964+0000 7fa9f939d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f40fe470 0x7fa9f419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:57.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.964+0000 7fa9f939d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f419c320 0x7fa9f41a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.964+0000 7fa9f939d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f419c7a0 con 0x7fa9f40fe470 2024-09-13T18:31:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.964+0000 7fa9f939d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f419c910 con 0x7fa9f419c320 2024-09-13T18:31:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.965+0000 7fa9f2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f40fe470 0x7fa9f419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.965+0000 7fa9f2ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f40fe470 0x7fa9f419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40848/0 (socket says 172.21.15.38:40848) 2024-09-13T18:31:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.965+0000 7fa9f2ffd640 1 -- 172.21.15.38:0/4102936720 learned_addr learned my addr 172.21.15.38:0/4102936720 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:57.967 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.965+0000 7fa9f27fc640 1 --2- 172.21.15.38:0/4102936720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f419c320 0x7fa9f41a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:57.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.966+0000 7fa9f2ffd640 1 -- 172.21.15.38:0/4102936720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f419c320 msgr2=0x7fa9f41a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:57.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.966+0000 7fa9f2ffd640 1 --2- 172.21.15.38:0/4102936720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f419c320 0x7fa9f41a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:57.968 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.966+0000 7fa9f2ffd640 1 -- 172.21.15.38:0/4102936720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc009900 con 0x7fa9f40fe470 2024-09-13T18:31:57.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.966+0000 7fa9f2ffd640 1 --2- 172.21.15.38:0/4102936720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f40fe470 0x7fa9f419bde0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00b420 tx=0x7fa9ec00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:57.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.967+0000 7fa9ebfff640 1 -- 172.21.15.38:0/4102936720 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9ec011800 con 0x7fa9f40fe470 2024-09-13T18:31:57.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.967+0000 7fa9ebfff640 1 -- 172.21.15.38:0/4102936720 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9ec011e00 con 0x7fa9f40fe470 2024-09-13T18:31:57.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.967+0000 7fa9f939d640 1 -- 172.21.15.38:0/4102936720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f4104af0 con 0x7fa9f40fe470 2024-09-13T18:31:57.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.967+0000 7fa9f939d640 1 -- 172.21.15.38:0/4102936720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f4105040 con 0x7fa9f40fe470 2024-09-13T18:31:57.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.967+0000 7fa9ebfff640 1 -- 172.21.15.38:0/4102936720 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9ec00f2e0 con 0x7fa9f40fe470 2024-09-13T18:31:57.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.969+0000 7fa9f939d640 1 -- 172.21.15.38:0/4102936720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f4101220 con 0x7fa9f40fe470 2024-09-13T18:31:57.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.970+0000 7fa9ebfff640 1 -- 172.21.15.38:0/4102936720 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fa9ec010380 con 0x7fa9f40fe470 2024-09-13T18:31:57.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.971+0000 7fa9ebfff640 1 --2- 172.21.15.38:0/4102936720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa9d406cef0 0x7fa9d406f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:57.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.971+0000 7fa9ebfff640 1 -- 172.21.15.38:0/4102936720 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa9ec08c630 con 0x7fa9f40fe470 2024-09-13T18:31:57.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.971+0000 7fa9f27fc640 1 --2- 172.21.15.38:0/4102936720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa9d406cef0 0x7fa9d406f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:57.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.972+0000 7fa9f27fc640 1 --2- 172.21.15.38:0/4102936720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa9d406cef0 0x7fa9d406f3b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc02aef0 tx=0x7fa9dc03c040 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:57.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:57.977+0000 7fa9ebfff640 1 -- 172.21.15.38:0/4102936720 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa9ec0566a0 con 0x7fa9f40fe470 2024-09-13T18:31:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:57 smithi038 ceph-mon[27689]: pgmap v28: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 581 op/s 2024-09-13T18:31:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:57 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.eabzne", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:31:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:57 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.eabzne", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:31:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:57 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:31:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:57 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:31:58.161 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:57 smithi149 ceph-mon[35845]: pgmap v28: 65 pgs: 65 active+clean; 278 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 581 op/s 2024-09-13T18:31:58.161 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:57 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.eabzne", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:31:58.161 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:57 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi149.eabzne", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T18:31:58.161 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:57 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T18:31:58.161 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:57 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:31:58.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.255+0000 7fa9f939d640 1 -- 172.21.15.38:0/4102936720 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9f40feef0 con 0x7fa9d406cef0 2024-09-13T18:31:58.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.268+0000 7fa9ebfff640 1 -- 172.21.15.38:0/4102936720 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fa9f40feef0 con 0x7fa9d406cef0 2024-09-13T18:31:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:31:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (8m) 44s ago 9m 24.1M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:31:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (9m) 44s ago 9m 8082k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:31:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (8m) 48s ago 8m 7818k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:31:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (9m) 44s ago 9m 6899k - 18.2.4-845-ge4e227b3 67ddd33fa72f 30c026e97a6b 2024-09-13T18:31:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (8m) 48s ago 8m 6895k - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c179d7df975 2024-09-13T18:31:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (8m) 44s ago 9m 85.9M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:31:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (4m) 44s ago 4m 226M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:31:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (4m) 44s ago 4m 156M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:31:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (4m) 48s ago 4m 23.2M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:31:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (4m) 48s ago 4m 23.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:31:58.271 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (62s) 44s ago 11m 458M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:31:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (2m) 48s ago 8m 96.0M - 18.2.4-860-g6c6b083f 8a91f241d7d4 49cdb3f4164b 2024-09-13T18:31:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (11m) 44s ago 11m 53.6M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f b654a36a9082 2024-09-13T18:31:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (8m) 48s ago 8m 41.8M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 0133a107f35d 2024-09-13T18:31:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (9m) 44s ago 9m 15.4M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:31:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (8m) 48s ago 8m 15.7M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:31:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (7m) 44s ago 7m 213M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 69a9e66fb097 2024-09-13T18:31:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (7m) 44s ago 7m 217M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 07986b4ba73b 2024-09-13T18:31:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (6m) 44s ago 6m 180M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f e44cdda01aee 2024-09-13T18:31:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (6m) 48s ago 6m 246M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:31:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (6m) 48s ago 6m 230M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:31:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (5m) 48s ago 5m 214M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:31:58.272 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 starting - - - - 2024-09-13T18:31:58.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.271+0000 7fa9f939d640 1 -- 172.21.15.38:0/4102936720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa9d406cef0 msgr2=0x7fa9d406f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.271+0000 7fa9f939d640 1 --2- 172.21.15.38:0/4102936720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa9d406cef0 0x7fa9d406f3b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc02aef0 tx=0x7fa9dc03c040 comp rx=0 tx=0).stop 2024-09-13T18:31:58.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.271+0000 7fa9f939d640 1 -- 172.21.15.38:0/4102936720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f40fe470 msgr2=0x7fa9f419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.271+0000 7fa9f939d640 1 --2- 172.21.15.38:0/4102936720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f40fe470 0x7fa9f419bde0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00b420 tx=0x7fa9ec00b8e0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.271+0000 7fa9f939d640 1 -- 172.21.15.38:0/4102936720 shutdown_connections 2024-09-13T18:31:58.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.271+0000 7fa9f939d640 1 --2- 172.21.15.38:0/4102936720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa9d406cef0 0x7fa9d406f3b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.271+0000 7fa9f939d640 1 --2- 172.21.15.38:0/4102936720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9f419c320 0x7fa9f41a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.271+0000 7fa9f939d640 1 --2- 172.21.15.38:0/4102936720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9f40fe470 0x7fa9f419bde0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.271+0000 7fa9f939d640 1 -- 172.21.15.38:0/4102936720 >> 172.21.15.38:0/4102936720 conn(0x7fa9f40fa280 msgr2=0x7fa9f40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:58.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.271+0000 7fa9f939d640 1 -- 172.21.15.38:0/4102936720 shutdown_connections 2024-09-13T18:31:58.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.271+0000 7fa9f939d640 1 -- 172.21.15.38:0/4102936720 wait complete. 2024-09-13T18:31:58.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.378+0000 7f2e7d476640 1 -- 172.21.15.38:0/2879820600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e780fee10 msgr2=0x7f2e780ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.378+0000 7f2e7d476640 1 --2- 172.21.15.38:0/2879820600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e780fee10 0x7f2e780ff270 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009880 tx=0x7f2e6c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.378+0000 7f2e7d476640 1 -- 172.21.15.38:0/2879820600 shutdown_connections 2024-09-13T18:31:58.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.378+0000 7f2e7d476640 1 --2- 172.21.15.38:0/2879820600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e780fee10 0x7f2e780ff270 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.378+0000 7f2e7d476640 1 --2- 172.21.15.38:0/2879820600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e780fe4d0 0x7f2e780fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.379+0000 7f2e7d476640 1 -- 172.21.15.38:0/2879820600 >> 172.21.15.38:0/2879820600 conn(0x7f2e780fa280 msgr2=0x7f2e780fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:58.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.379+0000 7f2e7d476640 1 -- 172.21.15.38:0/2879820600 shutdown_connections 2024-09-13T18:31:58.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.379+0000 7f2e7d476640 1 -- 172.21.15.38:0/2879820600 wait complete. 2024-09-13T18:31:58.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.379+0000 7f2e7d476640 1 Processor -- start 2024-09-13T18:31:58.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.380+0000 7f2e7d476640 1 -- start start 2024-09-13T18:31:58.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.380+0000 7f2e7d476640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e780fe4d0 0x7f2e781977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:58.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.380+0000 7f2e7d476640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e780fee10 0x7f2e78197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:58.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.380+0000 7f2e7d476640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e781982d0 con 0x7f2e780fe4d0 2024-09-13T18:31:58.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.380+0000 7f2e7d476640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e78198440 con 0x7f2e780fee10 2024-09-13T18:31:58.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.380+0000 7f2e76ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e780fe4d0 0x7f2e781977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:58.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.380+0000 7f2e76ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e780fe4d0 0x7f2e781977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40870/0 (socket says 172.21.15.38:40870) 2024-09-13T18:31:58.386 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.380+0000 7f2e76ffd640 1 -- 172.21.15.38:0/4104804968 learned_addr learned my addr 172.21.15.38:0/4104804968 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:58.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.380+0000 7f2e767fc640 1 --2- 172.21.15.38:0/4104804968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e780fee10 0x7f2e78197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:58.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.381+0000 7f2e76ffd640 1 -- 172.21.15.38:0/4104804968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e780fee10 msgr2=0x7f2e78197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.381+0000 7f2e76ffd640 1 --2- 172.21.15.38:0/4104804968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e780fee10 0x7f2e78197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.381+0000 7f2e76ffd640 1 -- 172.21.15.38:0/4104804968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c009560 con 0x7f2e780fe4d0 2024-09-13T18:31:58.387 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.381+0000 7f2e76ffd640 1 --2- 172.21.15.38:0/4104804968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e780fe4d0 0x7f2e781977c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800e9a0 tx=0x7f2e6800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:58.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.381+0000 7f2e5ffff640 1 -- 172.21.15.38:0/4104804968 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e6800cc90 con 0x7f2e780fe4d0 2024-09-13T18:31:58.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.381+0000 7f2e5ffff640 1 -- 172.21.15.38:0/4104804968 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2e6800cdf0 con 0x7f2e780fe4d0 2024-09-13T18:31:58.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.381+0000 7f2e7d476640 1 -- 172.21.15.38:0/4104804968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7819cee0 con 0x7f2e780fe4d0 2024-09-13T18:31:58.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.381+0000 7f2e7d476640 1 -- 172.21.15.38:0/4104804968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7819d3a0 con 0x7f2e780fe4d0 2024-09-13T18:31:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.382+0000 7f2e5ffff640 1 -- 172.21.15.38:0/4104804968 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e68018770 con 0x7f2e780fe4d0 2024-09-13T18:31:58.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.383+0000 7f2e7d476640 1 -- 172.21.15.38:0/4104804968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7810a880 con 0x7f2e780fe4d0 2024-09-13T18:31:58.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.383+0000 7f2e5ffff640 1 -- 172.21.15.38:0/4104804968 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f2e68018a50 con 0x7f2e780fe4d0 2024-09-13T18:31:58.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.384+0000 7f2e5ffff640 1 --2- 172.21.15.38:0/4104804968 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2e6006cd80 0x7f2e6006f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:58.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.384+0000 7f2e5ffff640 1 -- 172.21.15.38:0/4104804968 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2e68014070 con 0x7f2e780fe4d0 2024-09-13T18:31:58.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.384+0000 7f2e767fc640 1 --2- 172.21.15.38:0/4104804968 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2e6006cd80 0x7f2e6006f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:58.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.384+0000 7f2e767fc640 1 --2- 172.21.15.38:0/4104804968 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2e6006cd80 0x7f2e6006f240 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2e78198ce0 tx=0x7f2e6c005d90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:58.391 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.388+0000 7f2e5ffff640 1 -- 172.21.15.38:0/4104804968 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2e68052e20 con 0x7f2e780fe4d0 2024-09-13T18:31:58.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.723+0000 7f2e7d476640 1 -- 172.21.15.38:0/4104804968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2e7819d670 con 0x7f2e780fe4d0 2024-09-13T18:31:58.726 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:31:58.726 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:31:58.726 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2 2024-09-13T18:31:58.726 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:31:58.726 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:31:58.726 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:31:58.726 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:31:58.726 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:31:58.726 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T18:31:58.726 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:31:58.726 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:31:58.727 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:31:58.727 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:31:58.727 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:31:58.727 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 12, 2024-09-13T18:31:58.727 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:31:58.727 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:31:58.727 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:31:58.727 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.723+0000 7f2e5ffff640 1 -- 172.21.15.38:0/4104804968 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f2e68056af0 con 0x7f2e780fe4d0 2024-09-13T18:31:58.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.726+0000 7f2e7d476640 1 -- 172.21.15.38:0/4104804968 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2e6006cd80 msgr2=0x7f2e6006f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.729 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.726+0000 7f2e7d476640 1 --2- 172.21.15.38:0/4104804968 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2e6006cd80 0x7f2e6006f240 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2e78198ce0 tx=0x7f2e6c005d90 comp rx=0 tx=0).stop 2024-09-13T18:31:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.726+0000 7f2e7d476640 1 -- 172.21.15.38:0/4104804968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e780fe4d0 msgr2=0x7f2e781977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.726+0000 7f2e7d476640 1 --2- 172.21.15.38:0/4104804968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e780fe4d0 0x7f2e781977c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800e9a0 tx=0x7f2e6800ee60 comp rx=0 tx=0).stop 2024-09-13T18:31:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.727+0000 7f2e7d476640 1 -- 172.21.15.38:0/4104804968 shutdown_connections 2024-09-13T18:31:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.727+0000 7f2e7d476640 1 --2- 172.21.15.38:0/4104804968 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2e6006cd80 0x7f2e6006f240 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.727+0000 7f2e7d476640 1 --2- 172.21.15.38:0/4104804968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e780fee10 0x7f2e78197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.727+0000 7f2e7d476640 1 --2- 172.21.15.38:0/4104804968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2e780fe4d0 0x7f2e781977c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.727+0000 7f2e7d476640 1 -- 172.21.15.38:0/4104804968 >> 172.21.15.38:0/4104804968 conn(0x7f2e780fa280 msgr2=0x7f2e78106b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.727+0000 7f2e7d476640 1 -- 172.21.15.38:0/4104804968 shutdown_connections 2024-09-13T18:31:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.727+0000 7f2e7d476640 1 -- 172.21.15.38:0/4104804968 wait complete. 2024-09-13T18:31:58.848 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.846+0000 7ffbea519640 1 -- 172.21.15.38:0/3138780174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbe40fe480 msgr2=0x7ffbe40fe880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.846+0000 7ffbea519640 1 --2- 172.21.15.38:0/3138780174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbe40fe480 0x7ffbe40fe880 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009880 tx=0x7ffbd402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.846+0000 7ffbea519640 1 -- 172.21.15.38:0/3138780174 shutdown_connections 2024-09-13T18:31:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.846+0000 7ffbea519640 1 --2- 172.21.15.38:0/3138780174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbe40fedc0 0x7ffbe40ff220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.846+0000 7ffbea519640 1 --2- 172.21.15.38:0/3138780174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbe40fe480 0x7ffbe40fe880 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.846+0000 7ffbea519640 1 -- 172.21.15.38:0/3138780174 >> 172.21.15.38:0/3138780174 conn(0x7ffbe40fa250 msgr2=0x7ffbe40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.846+0000 7ffbea519640 1 -- 172.21.15.38:0/3138780174 shutdown_connections 2024-09-13T18:31:58.849 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.846+0000 7ffbea519640 1 -- 172.21.15.38:0/3138780174 wait complete. 2024-09-13T18:31:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.847+0000 7ffbea519640 1 Processor -- start 2024-09-13T18:31:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.847+0000 7ffbea519640 1 -- start start 2024-09-13T18:31:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.847+0000 7ffbea519640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbe40fe480 0x7ffbe41976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.847+0000 7ffbea519640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbe40fedc0 0x7ffbe4197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.847+0000 7ffbea519640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe41981f0 con 0x7ffbe40fe480 2024-09-13T18:31:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.847+0000 7ffbea519640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4198360 con 0x7ffbe40fedc0 2024-09-13T18:31:58.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.847+0000 7ffbe3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbe40fe480 0x7ffbe41976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.847+0000 7ffbe3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbe40fe480 0x7ffbe41976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40888/0 (socket says 172.21.15.38:40888) 2024-09-13T18:31:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.847+0000 7ffbe3fff640 1 -- 172.21.15.38:0/731374151 learned_addr learned my addr 172.21.15.38:0/731374151 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.847+0000 7ffbdbfff640 1 --2- 172.21.15.38:0/731374151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbe40fedc0 0x7ffbe4197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.848+0000 7ffbe3fff640 1 -- 172.21.15.38:0/731374151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbe40fedc0 msgr2=0x7ffbe4197c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.848+0000 7ffbe3fff640 1 --2- 172.21.15.38:0/731374151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbe40fedc0 0x7ffbe4197c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.848+0000 7ffbe3fff640 1 -- 172.21.15.38:0/731374151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4009560 con 0x7ffbe40fe480 2024-09-13T18:31:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.848+0000 7ffbe3fff640 1 --2- 172.21.15.38:0/731374151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbe40fe480 0x7ffbe41976e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4006010 tx=0x7ffbd4005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.848+0000 7ffbe1ffb640 1 -- 172.21.15.38:0/731374151 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbd4004b20 con 0x7ffbe40fe480 2024-09-13T18:31:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.848+0000 7ffbe1ffb640 1 -- 172.21.15.38:0/731374151 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffbd4004c80 con 0x7ffbe40fe480 2024-09-13T18:31:58.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.848+0000 7ffbea519640 1 -- 172.21.15.38:0/731374151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe419cda0 con 0x7ffbe40fe480 2024-09-13T18:31:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.848+0000 7ffbea519640 1 -- 172.21.15.38:0/731374151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe419d230 con 0x7ffbe40fe480 2024-09-13T18:31:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.848+0000 7ffbe1ffb640 1 -- 172.21.15.38:0/731374151 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbd40319f0 con 0x7ffbe40fe480 2024-09-13T18:31:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.849+0000 7ffbea519640 1 -- 172.21.15.38:0/731374151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe410a830 con 0x7ffbe40fe480 2024-09-13T18:31:58.853 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.850+0000 7ffbe1ffb640 1 -- 172.21.15.38:0/731374151 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7ffbd4003d00 con 0x7ffbe40fe480 2024-09-13T18:31:58.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.851+0000 7ffbe1ffb640 1 --2- 172.21.15.38:0/731374151 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ffbd006cd90 0x7ffbd006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:58.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.852+0000 7ffbe1ffb640 1 -- 172.21.15.38:0/731374151 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ffbd40ad8b0 con 0x7ffbe40fe480 2024-09-13T18:31:58.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.852+0000 7ffbdbfff640 1 --2- 172.21.15.38:0/731374151 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ffbd006cd90 0x7ffbd006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:58.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.852+0000 7ffbdbfff640 1 --2- 172.21.15.38:0/731374151 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ffbd006cd90 0x7ffbd006f250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4198c00 tx=0x7ffbcc00b410 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:58.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:58.856+0000 7ffbe1ffb640 1 -- 172.21.15.38:0/731374151 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffbd4077860 con 0x7ffbe40fe480 2024-09-13T18:31:58.998 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:58 smithi149 ceph-mon[35845]: Upgrade: Updating mgr.smithi149.eabzne 2024-09-13T18:31:58.998 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:58 smithi149 ceph-mon[35845]: Deploying daemon mgr.smithi149.eabzne on smithi149 2024-09-13T18:31:58.998 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:58 smithi149 ceph-mon[35845]: from='client.24533 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:31:58.998 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:58 smithi149 ceph-mon[35845]: from='client.24537 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:31:58.998 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:58 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/4104804968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:31:59.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:58 smithi038 ceph-mon[27689]: Upgrade: Updating mgr.smithi149.eabzne 2024-09-13T18:31:59.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:58 smithi038 ceph-mon[27689]: Deploying daemon mgr.smithi149.eabzne on smithi149 2024-09-13T18:31:59.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:58 smithi038 ceph-mon[27689]: from='client.24533 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:31:59.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:58 smithi038 ceph-mon[27689]: from='client.24537 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:31:59.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:58 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/4104804968' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:31:59.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.255+0000 7ffbea519640 1 -- 172.21.15.38:0/731374151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffbe419d770 con 0x7ffbe40fe480 2024-09-13T18:31:59.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.256+0000 7ffbe1ffb640 1 -- 172.21.15.38:0/731374151 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7ffbd407ae80 con 0x7ffbe40fe480 2024-09-13T18:31:59.259 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:31:59.259 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:31:59.259 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:31:59.259 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:31:59.260 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:31:59.261 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:31:59.262 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:31:59.262 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:31:59.262 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:31:59.262 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:31:59.262 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:31:59.262 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:31:59.262 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:31:59.262 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:31:59.262 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:31:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.260+0000 7ffbea519640 1 -- 172.21.15.38:0/731374151 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ffbd006cd90 msgr2=0x7ffbd006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.260+0000 7ffbea519640 1 --2- 172.21.15.38:0/731374151 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ffbd006cd90 0x7ffbd006f250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4198c00 tx=0x7ffbcc00b410 comp rx=0 tx=0).stop 2024-09-13T18:31:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.260+0000 7ffbea519640 1 -- 172.21.15.38:0/731374151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbe40fe480 msgr2=0x7ffbe41976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.260+0000 7ffbea519640 1 --2- 172.21.15.38:0/731374151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbe40fe480 0x7ffbe41976e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4006010 tx=0x7ffbd4005610 comp rx=0 tx=0).stop 2024-09-13T18:31:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.260+0000 7ffbea519640 1 -- 172.21.15.38:0/731374151 shutdown_connections 2024-09-13T18:31:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.260+0000 7ffbea519640 1 --2- 172.21.15.38:0/731374151 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ffbd006cd90 0x7ffbd006f250 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.260+0000 7ffbea519640 1 --2- 172.21.15.38:0/731374151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbe40fedc0 0x7ffbe4197c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.260+0000 7ffbea519640 1 --2- 172.21.15.38:0/731374151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffbe40fe480 0x7ffbe41976e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.260+0000 7ffbea519640 1 -- 172.21.15.38:0/731374151 >> 172.21.15.38:0/731374151 conn(0x7ffbe40fa250 msgr2=0x7ffbe4106ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.261+0000 7ffbea519640 1 -- 172.21.15.38:0/731374151 shutdown_connections 2024-09-13T18:31:59.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.261+0000 7ffbea519640 1 -- 172.21.15.38:0/731374151 wait complete. 2024-09-13T18:31:59.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.365+0000 7facedfb5640 1 -- 172.21.15.38:0/948284188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face80fee10 msgr2=0x7face80ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.365+0000 7facedfb5640 1 --2- 172.21.15.38:0/948284188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face80fee10 0x7face80ff270 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7facd0009880 tx=0x7facd002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.365+0000 7facedfb5640 1 -- 172.21.15.38:0/948284188 shutdown_connections 2024-09-13T18:31:59.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.365+0000 7facedfb5640 1 --2- 172.21.15.38:0/948284188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face80fee10 0x7face80ff270 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.365+0000 7facedfb5640 1 --2- 172.21.15.38:0/948284188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7face80fe4d0 0x7face80fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.366+0000 7facedfb5640 1 -- 172.21.15.38:0/948284188 >> 172.21.15.38:0/948284188 conn(0x7face80fa280 msgr2=0x7face80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:59.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.366+0000 7facedfb5640 1 -- 172.21.15.38:0/948284188 shutdown_connections 2024-09-13T18:31:59.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.366+0000 7facedfb5640 1 -- 172.21.15.38:0/948284188 wait complete. 2024-09-13T18:31:59.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.366+0000 7facedfb5640 1 Processor -- start 2024-09-13T18:31:59.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.366+0000 7facedfb5640 1 -- start start 2024-09-13T18:31:59.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.367+0000 7facedfb5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7face80fe4d0 0x7face8197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.367+0000 7facedfb5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face80fee10 0x7face8197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.371 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.367+0000 7facedfb5640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face81982a0 con 0x7face80fee10 2024-09-13T18:31:59.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.367+0000 7facedfb5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face8198410 con 0x7face80fe4d0 2024-09-13T18:31:59.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.367+0000 7face6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face80fee10 0x7face8197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.367+0000 7face6ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face80fee10 0x7face8197cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40914/0 (socket says 172.21.15.38:40914) 2024-09-13T18:31:59.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.367+0000 7face6ffd640 1 -- 172.21.15.38:0/4021299567 learned_addr learned my addr 172.21.15.38:0/4021299567 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:59.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.367+0000 7face77fe640 1 --2- 172.21.15.38:0/4021299567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7face80fe4d0 0x7face8197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.367+0000 7face6ffd640 1 -- 172.21.15.38:0/4021299567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7face80fe4d0 msgr2=0x7face8197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.367+0000 7face6ffd640 1 --2- 172.21.15.38:0/4021299567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7face80fe4d0 0x7face8197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.367+0000 7face6ffd640 1 -- 172.21.15.38:0/4021299567 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd0009560 con 0x7face80fee10 2024-09-13T18:31:59.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.367+0000 7face77fe640 1 --2- 172.21.15.38:0/4021299567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7face80fe4d0 0x7face8197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:31:59.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.368+0000 7face6ffd640 1 --2- 172.21.15.38:0/4021299567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face80fee10 0x7face8197cd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7facd0006010 tx=0x7facd0005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.368+0000 7face4ff9640 1 -- 172.21.15.38:0/4021299567 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facd0004b20 con 0x7face80fee10 2024-09-13T18:31:59.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.368+0000 7face4ff9640 1 -- 172.21.15.38:0/4021299567 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7facd0004c80 con 0x7face80fee10 2024-09-13T18:31:59.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.368+0000 7face4ff9640 1 -- 172.21.15.38:0/4021299567 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facd00319f0 con 0x7face80fee10 2024-09-13T18:31:59.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.368+0000 7facedfb5640 1 -- 172.21.15.38:0/4021299567 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face819ce50 con 0x7face80fee10 2024-09-13T18:31:59.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.368+0000 7facedfb5640 1 -- 172.21.15.38:0/4021299567 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face819d310 con 0x7face80fee10 2024-09-13T18:31:59.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.369+0000 7facedfb5640 1 -- 172.21.15.38:0/4021299567 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face810a8a0 con 0x7face80fee10 2024-09-13T18:31:59.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.370+0000 7face4ff9640 1 -- 172.21.15.38:0/4021299567 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7facd0003d00 con 0x7face80fee10 2024-09-13T18:31:59.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.370+0000 7face4ff9640 1 --2- 172.21.15.38:0/4021299567 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7facd406cd90 0x7facd406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.371+0000 7face4ff9640 1 -- 172.21.15.38:0/4021299567 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7facd00ad7e0 con 0x7face80fee10 2024-09-13T18:31:59.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.371+0000 7face77fe640 1 --2- 172.21.15.38:0/4021299567 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7facd406cd90 0x7facd406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.371+0000 7face77fe640 1 --2- 172.21.15.38:0/4021299567 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7facd406cd90 0x7facd406f250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7facd8005fd0 tx=0x7facd800b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.376+0000 7face4ff9640 1 -- 172.21.15.38:0/4021299567 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7facd0077810 con 0x7face80fee10 2024-09-13T18:31:59.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.608+0000 7facedfb5640 1 -- 172.21.15.38:0/4021299567 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7face8108220 con 0x7facd406cd90 2024-09-13T18:31:59.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.609+0000 7face4ff9640 1 -- 172.21.15.38:0/4021299567 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7face8108220 con 0x7facd406cd90 2024-09-13T18:31:59.612 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:31:59.612 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:31:59.612 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:31:59.612 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:31:59.612 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:31:59.612 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2024-09-13T18:31:59.612 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:31:59.612 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "2/23 daemons upgraded", 2024-09-13T18:31:59.612 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T18:31:59.612 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:31:59.612 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:31:59.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.612+0000 7facedfb5640 1 -- 172.21.15.38:0/4021299567 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7facd406cd90 msgr2=0x7facd406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.612+0000 7facedfb5640 1 --2- 172.21.15.38:0/4021299567 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7facd406cd90 0x7facd406f250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7facd8005fd0 tx=0x7facd800b390 comp rx=0 tx=0).stop 2024-09-13T18:31:59.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.612+0000 7facedfb5640 1 -- 172.21.15.38:0/4021299567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face80fee10 msgr2=0x7face8197cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.612+0000 7facedfb5640 1 --2- 172.21.15.38:0/4021299567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face80fee10 0x7face8197cd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7facd0006010 tx=0x7facd0005610 comp rx=0 tx=0).stop 2024-09-13T18:31:59.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.612+0000 7facedfb5640 1 -- 172.21.15.38:0/4021299567 shutdown_connections 2024-09-13T18:31:59.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.612+0000 7facedfb5640 1 --2- 172.21.15.38:0/4021299567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7face80fee10 0x7face8197cd0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.612+0000 7facedfb5640 1 --2- 172.21.15.38:0/4021299567 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7facd406cd90 0x7facd406f250 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.612+0000 7facedfb5640 1 --2- 172.21.15.38:0/4021299567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7face80fe4d0 0x7face8197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.612+0000 7facedfb5640 1 -- 172.21.15.38:0/4021299567 >> 172.21.15.38:0/4021299567 conn(0x7face80fa280 msgr2=0x7face8106b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:59.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.612+0000 7facedfb5640 1 -- 172.21.15.38:0/4021299567 shutdown_connections 2024-09-13T18:31:59.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.612+0000 7facedfb5640 1 -- 172.21.15.38:0/4021299567 wait complete. 2024-09-13T18:31:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.716+0000 7f74bbb94640 1 -- 172.21.15.38:0/706163787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74b40ffcf0 msgr2=0x7f74b4100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.716+0000 7f74bbb94640 1 --2- 172.21.15.38:0/706163787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74b40ffcf0 0x7f74b4100170 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009880 tx=0x7f74a402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.716+0000 7f74bbb94640 1 -- 172.21.15.38:0/706163787 shutdown_connections 2024-09-13T18:31:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.716+0000 7f74bbb94640 1 --2- 172.21.15.38:0/706163787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74b40ffcf0 0x7f74b4100170 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.716+0000 7f74bbb94640 1 --2- 172.21.15.38:0/706163787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b40feaf0 0x7f74b40feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.716+0000 7f74bbb94640 1 -- 172.21.15.38:0/706163787 >> 172.21.15.38:0/706163787 conn(0x7f74b40fa280 msgr2=0x7f74b40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:31:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.716+0000 7f74bbb94640 1 -- 172.21.15.38:0/706163787 shutdown_connections 2024-09-13T18:31:59.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.716+0000 7f74bbb94640 1 -- 172.21.15.38:0/706163787 wait complete. 2024-09-13T18:31:59.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.716+0000 7f74bbb94640 1 Processor -- start 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74bbb94640 1 -- start start 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74bbb94640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74b40feaf0 0x7f74b41955b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74bbb94640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b40ffcf0 0x7f74b4195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74bbb94640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b41960c0 con 0x7f74b40feaf0 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74bbb94640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4196230 con 0x7f74b40ffcf0 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74b9930640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74b40feaf0 0x7f74b41955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74b912f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b40ffcf0 0x7f74b4195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74b9930640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74b40feaf0 0x7f74b41955b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40942/0 (socket says 172.21.15.38:40942) 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74b9930640 1 -- 172.21.15.38:0/92329975 learned_addr learned my addr 172.21.15.38:0/92329975 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74b912f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b40ffcf0 0x7f74b4195af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.38:35416/0 (socket says 172.21.15.38:35416) 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74b9930640 1 -- 172.21.15.38:0/92329975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b40ffcf0 msgr2=0x7f74b4195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74b9930640 1 --2- 172.21.15.38:0/92329975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b40ffcf0 0x7f74b4195af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:31:59.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74b9930640 1 -- 172.21.15.38:0/92329975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4009560 con 0x7f74b40feaf0 2024-09-13T18:31:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.717+0000 7f74b9930640 1 --2- 172.21.15.38:0/92329975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74b40feaf0 0x7f74b41955b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f74b000e970 tx=0x7f74b000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.718+0000 7f74aaffd640 1 -- 172.21.15.38:0/92329975 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74b0009700 con 0x7f74b40feaf0 2024-09-13T18:31:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.718+0000 7f74aaffd640 1 -- 172.21.15.38:0/92329975 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74b00044c0 con 0x7f74b40feaf0 2024-09-13T18:31:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.718+0000 7f74bbb94640 1 -- 172.21.15.38:0/92329975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b419acd0 con 0x7f74b40feaf0 2024-09-13T18:31:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.718+0000 7f74aaffd640 1 -- 172.21.15.38:0/92329975 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74b0003ea0 con 0x7f74b40feaf0 2024-09-13T18:31:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.718+0000 7f74bbb94640 1 -- 172.21.15.38:0/92329975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b419b1c0 con 0x7f74b40feaf0 2024-09-13T18:31:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.719+0000 7f74bbb94640 1 -- 172.21.15.38:0/92329975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b41075a0 con 0x7f74b40feaf0 2024-09-13T18:31:59.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.720+0000 7f74aaffd640 1 -- 172.21.15.38:0/92329975 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 30) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f74b000cc90 con 0x7f74b40feaf0 2024-09-13T18:31:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.720+0000 7f74aaffd640 1 --2- 172.21.15.38:0/92329975 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f74a006cd90 0x7f74a006f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:31:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.721+0000 7f74aaffd640 1 -- 172.21.15.38:0/92329975 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f74b0014070 con 0x7f74b40feaf0 2024-09-13T18:31:59.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.721+0000 7f74b912f640 1 --2- 172.21.15.38:0/92329975 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f74a006cd90 0x7f74a006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:31:59.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.721+0000 7f74b912f640 1 --2- 172.21.15.38:0/92329975 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f74a006cd90 0x7f74a006f250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f74b4196ad0 tx=0x7f74a4031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:31:59.728 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:31:59.726+0000 7f74aaffd640 1 -- 172.21.15.38:0/92329975 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f74b0056b40 con 0x7f74b40feaf0 2024-09-13T18:32:00.005 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:59 smithi149 ceph-mon[35845]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:32:00.005 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:59 smithi149 ceph-mon[35845]: pgmap v29: 65 pgs: 65 active+clean; 268 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 770 op/s 2024-09-13T18:32:00.005 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:31:59 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/731374151' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:32:00.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.113+0000 7f74bbb94640 1 -- 172.21.15.38:0/92329975 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f74b41077f0 con 0x7f74b40feaf0 2024-09-13T18:32:00.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.113+0000 7f74aaffd640 1 -- 172.21.15.38:0/92329975 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f74b005a160 con 0x7f74b40feaf0 2024-09-13T18:32:00.116 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:32:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.116+0000 7f74bbb94640 1 -- 172.21.15.38:0/92329975 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f74a006cd90 msgr2=0x7f74a006f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.116+0000 7f74bbb94640 1 --2- 172.21.15.38:0/92329975 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f74a006cd90 0x7f74a006f250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f74b4196ad0 tx=0x7f74a4031400 comp rx=0 tx=0).stop 2024-09-13T18:32:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.116+0000 7f74bbb94640 1 -- 172.21.15.38:0/92329975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74b40feaf0 msgr2=0x7f74b41955b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.116+0000 7f74bbb94640 1 --2- 172.21.15.38:0/92329975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74b40feaf0 0x7f74b41955b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f74b000e970 tx=0x7f74b000ee30 comp rx=0 tx=0).stop 2024-09-13T18:32:00.119 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:59 smithi038 ceph-mon[27689]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:32:00.119 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:59 smithi038 ceph-mon[27689]: pgmap v29: 65 pgs: 65 active+clean; 268 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 770 op/s 2024-09-13T18:32:00.119 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:31:59 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/731374151' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:32:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.116+0000 7f74bbb94640 1 -- 172.21.15.38:0/92329975 shutdown_connections 2024-09-13T18:32:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.116+0000 7f74bbb94640 1 --2- 172.21.15.38:0/92329975 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f74a006cd90 0x7f74a006f250 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.116+0000 7f74bbb94640 1 --2- 172.21.15.38:0/92329975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74b40ffcf0 0x7f74b4195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.116+0000 7f74bbb94640 1 --2- 172.21.15.38:0/92329975 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74b40feaf0 0x7f74b41955b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.116+0000 7f74bbb94640 1 -- 172.21.15.38:0/92329975 >> 172.21.15.38:0/92329975 conn(0x7f74b40fa280 msgr2=0x7f74b4067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.117+0000 7f74bbb94640 1 -- 172.21.15.38:0/92329975 shutdown_connections 2024-09-13T18:32:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:00.117+0000 7f74bbb94640 1 -- 172.21.15.38:0/92329975 wait complete. 2024-09-13T18:32:01.221 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:00 smithi149 ceph-mon[35845]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:32:01.221 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:00 smithi149 ceph-mon[35845]: from='client.? 172.21.15.38:0/92329975' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:32:01.221 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:00 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:01.221 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:00 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:01.221 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:00 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:01.300 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:00 smithi038 ceph-mon[27689]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:32:01.300 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:00 smithi038 ceph-mon[27689]: from='client.? 172.21.15.38:0/92329975' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:32:01.300 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:00 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:01.300 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:00 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:01.300 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:00 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:02.142 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:01 smithi149 ceph-mon[35845]: pgmap v30: 65 pgs: 65 active+clean; 268 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 375 op/s 2024-09-13T18:32:02.142 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:01 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:02.142 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:01 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:01 smithi038 ceph-mon[27689]: pgmap v30: 65 pgs: 65 active+clean; 268 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 375 op/s 2024-09-13T18:32:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:01 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:01 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:02.954 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-13T18:32:02.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-13T18:32:03.305 DEBUG:teuthology.parallel:result is None 2024-09-13T18:32:04.250 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:03 smithi149 ceph-mon[35845]: pgmap v31: 65 pgs: 65 active+clean; 268 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 499 op/s 2024-09-13T18:32:04.250 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:03 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:04.251 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:03 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:04.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:03 smithi038 ceph-mon[27689]: pgmap v31: 65 pgs: 65 active+clean; 268 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 499 op/s 2024-09-13T18:32:04.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:03 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:04.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:03 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:05.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:05 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:05.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:05 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:05.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:05 smithi149 ceph-mon[35845]: pgmap v32: 65 pgs: 65 active+clean; 247 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 552 op/s 2024-09-13T18:32:05.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:05 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:05.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:05 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:05.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:05 smithi038 ceph-mon[27689]: pgmap v32: 65 pgs: 65 active+clean; 247 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 552 op/s 2024-09-13T18:32:06.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:06 smithi149 ceph-mon[35845]: Standby manager daemon smithi149.eabzne restarted 2024-09-13T18:32:06.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:06 smithi149 ceph-mon[35845]: Standby manager daemon smithi149.eabzne started 2024-09-13T18:32:06.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:06 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/4012548613' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/crt"}]: dispatch 2024-09-13T18:32:06.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:06 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/4012548613' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:32:06.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:06 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/4012548613' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/key"}]: dispatch 2024-09-13T18:32:06.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:06 smithi149 ceph-mon[35845]: from='mgr.? 172.21.15.149:0/4012548613' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:32:06.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:06 smithi038 ceph-mon[27689]: Standby manager daemon smithi149.eabzne restarted 2024-09-13T18:32:06.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:06 smithi038 ceph-mon[27689]: Standby manager daemon smithi149.eabzne started 2024-09-13T18:32:06.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:06 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/4012548613' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/crt"}]: dispatch 2024-09-13T18:32:06.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:06 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/4012548613' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T18:32:06.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:06 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/4012548613' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi149.eabzne/key"}]: dispatch 2024-09-13T18:32:06.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:06 smithi038 ceph-mon[27689]: from='mgr.? 172.21.15.149:0/4012548613' entity='mgr.smithi149.eabzne' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T18:32:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:07 smithi149 ceph-mon[35845]: mgrmap e31: smithi038.jeygoq(active, since 59s), standbys: smithi149.eabzne 2024-09-13T18:32:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:07 smithi149 ceph-mon[35845]: pgmap v33: 65 pgs: 65 active+clean; 247 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 487 op/s 2024-09-13T18:32:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:07 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:32:07.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:07 smithi038 ceph-mon[27689]: mgrmap e31: smithi038.jeygoq(active, since 59s), standbys: smithi149.eabzne 2024-09-13T18:32:07.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:07 smithi038 ceph-mon[27689]: pgmap v33: 65 pgs: 65 active+clean; 247 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 487 op/s 2024-09-13T18:32:07.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:07 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:32:08.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:08 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:08.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:08 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:09.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:08 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:09.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:08 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:09.965 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: pgmap v34: 65 pgs: 65 active+clean; 241 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 690 op/s 2024-09-13T18:32:09.965 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:09.965 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:09.965 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:09.965 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:32:09.965 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:09.965 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:09.966 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:09.966 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:09.966 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi038.jeygoq"}]: dispatch 2024-09-13T18:32:09.966 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi038.jeygoq"}]: dispatch 2024-09-13T18:32:09.966 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi038.jeygoq"}]': finished 2024-09-13T18:32:09.966 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.eabzne"}]: dispatch 2024-09-13T18:32:09.966 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.eabzne"}]: dispatch 2024-09-13T18:32:09.966 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.eabzne"}]': finished 2024-09-13T18:32:09.966 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:09 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T18:32:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: pgmap v34: 65 pgs: 65 active+clean; 241 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 690 op/s 2024-09-13T18:32:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:32:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:10.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:10.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:10.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:10.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi038.jeygoq"}]: dispatch 2024-09-13T18:32:10.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi038.jeygoq"}]: dispatch 2024-09-13T18:32:10.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi038.jeygoq"}]': finished 2024-09-13T18:32:10.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.eabzne"}]: dispatch 2024-09-13T18:32:10.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.eabzne"}]: dispatch 2024-09-13T18:32:10.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi149.eabzne"}]': finished 2024-09-13T18:32:10.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:09 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T18:32:10.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:10 smithi038 ceph-mon[27689]: Upgrade: Setting container_image for all mgr 2024-09-13T18:32:11.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:10 smithi149 ceph-mon[35845]: Upgrade: Setting container_image for all mgr 2024-09-13T18:32:11.791 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:11 smithi038 ceph-mon[27689]: pgmap v35: 65 pgs: 65 active+clean; 241 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 501 op/s 2024-09-13T18:32:11.791 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:11 smithi038 ceph-mon[27689]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:11.791 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:11 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:32:11.791 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:11 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:32:11.792 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:11 smithi038 ceph-mon[27689]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:11 smithi149 ceph-mon[35845]: pgmap v35: 65 pgs: 65 active+clean; 241 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 501 op/s 2024-09-13T18:32:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:11 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:11 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:32:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:11 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:32:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:11 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:12.655 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:12 smithi149 ceph-mon[35845]: Upgrade: Updating mon.smithi038 2024-09-13T18:32:12.655 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:12 smithi149 ceph-mon[35845]: Deploying daemon mon.smithi038 on smithi038 2024-09-13T18:32:12.882 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:12 smithi038 ceph-mon[27689]: Upgrade: Updating mon.smithi038 2024-09-13T18:32:12.882 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:12 smithi038 ceph-mon[27689]: Deploying daemon mon.smithi038 on smithi038 2024-09-13T18:32:13.268 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-13T18:32:13.269 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T18:32:13.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:13 smithi038 systemd[1]: Stopping Ceph mon.smithi038 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:32:13.655 DEBUG:teuthology.parallel:result is None 2024-09-13T18:32:13.655 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:32:13.688 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:32:13.688 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T18:32:13.712 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:13 smithi149 ceph-mon[35845]: pgmap v36: 65 pgs: 65 active+clean; 230 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 772 op/s 2024-09-13T18:32:13.720 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T18:32:13.720 DEBUG:teuthology.parallel:result is None 2024-09-13T18:32:14.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:13 smithi038 ceph-mon[27689]: pgmap v36: 65 pgs: 65 active+clean; 230 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 772 op/s 2024-09-13T18:32:14.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:13 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038[27685]: 2024-09-13T18:32:13.615+0000 7f676a496640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi038 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:32:14.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:13 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038[27685]: 2024-09-13T18:32:13.615+0000 7f676a496640 -1 mon.smithi038@0(leader) e2 *** Got Signal Terminated *** 2024-09-13T18:32:14.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:13 smithi038 podman[91342]: 2024-09-13 18:32:13.841105274 +0000 UTC m=+0.377309508 container died b654a36a9082ebd6a1e52701c0a775e0e2f67663814b3ebbe57edbf6c1136212 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=reef-e4e227b, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T18:32:14.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:14 smithi038 podman[91342]: 2024-09-13 18:32:14.339936024 +0000 UTC m=+0.876140256 container cleanup b654a36a9082ebd6a1e52701c0a775e0e2f67663814b3ebbe57edbf6c1136212 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, RELEASE=reef-e4e227b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T18:32:14.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:14 smithi038 bash[91342]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038 2024-09-13T18:32:14.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:14 smithi038 podman[91373]: 2024-09-13 18:32:14.583077037 +0000 UTC m=+0.742469818 container remove b654a36a9082ebd6a1e52701c0a775e0e2f67663814b3ebbe57edbf6c1136212 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-e4e227b, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-13T18:32:14.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:14 smithi038 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi038.service: Deactivated successfully. 2024-09-13T18:32:14.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:14 smithi038 systemd[1]: Stopped Ceph mon.smithi038 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:32:14.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:14 smithi038 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi038.service: Consumed 12.388s CPU time. 2024-09-13T18:32:15.320 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:14 smithi038 systemd[1]: Starting Ceph mon.smithi038 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:32:15.320 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 podman[91503]: 2024-09-13 18:32:15.06648659 +0000 UTC m=+0.016670045 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:32:15.320 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 podman[91503]: 2024-09-13 18:32:15.31817458 +0000 UTC m=+0.268358021 container create e7c5577a18c9f10bfd49e24e92aa2300b96e44b0190c0b1f827972a3dd5afae4 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-13T18:32:15.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 podman[91503]: 2024-09-13 18:32:15.520868515 +0000 UTC m=+0.471051957 container init e7c5577a18c9f10bfd49e24e92aa2300b96e44b0190c0b1f827972a3dd5afae4 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-13T18:32:15.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 podman[91503]: 2024-09-13 18:32:15.524274167 +0000 UTC m=+0.474457609 container start e7c5577a18c9f10bfd49e24e92aa2300b96e44b0190c0b1f827972a3dd5afae4 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T18:32:15.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T18:32:15.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable), process ceph-mon, pid 2 2024-09-13T18:32:15.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: pidfile_write: ignore empty --pid-file 2024-09-13T18:32:15.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: load: jerasure load: lrc 2024-09-13T18:32:15.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: RocksDB version: 7.9.2 2024-09-13T18:32:15.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Git sha 0 2024-09-13T18:32:15.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Compile date 2024-09-10 12:59:06 2024-09-13T18:32:15.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: DB SUMMARY 2024-09-13T18:32:15.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: DB Session ID: FFU9M0977HBILCSIYYF2 2024-09-13T18:32:15.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: CURRENT file: CURRENT 2024-09-13T18:32:15.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T18:32:15.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1266 Bytes 2024-09-13T18:32:15.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi038/store.db dir, Total Num: 1, files: 000029.sst 2024-09-13T18:32:15.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi038/store.db: 000027.log size: 2705773 ; 2024-09-13T18:32:15.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.error_if_exists: 0 2024-09-13T18:32:15.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.create_if_missing: 0 2024-09-13T18:32:15.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.paranoid_checks: 1 2024-09-13T18:32:15.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T18:32:15.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T18:32:15.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.env: 0x561030927bc0 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.info_log: 0x56103144edc0 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.statistics: (nil) 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.use_fsync: 0 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_log_file_size: 0 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.allow_fallocate: 1 2024-09-13T18:32:15.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.use_direct_reads: 0 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.db_log_dir: 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.wal_dir: 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T18:32:15.586 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.write_buffer_manager: 0x56103145c320 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.unordered_write: 0 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T18:32:15.587 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.row_cache: None 2024-09-13T18:32:15.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.wal_filter: None 2024-09-13T18:32:15.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T18:32:15.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T18:32:15.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.two_write_queues: 0 2024-09-13T18:32:15.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T18:32:15.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.wal_compression: 0 2024-09-13T18:32:15.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.atomic_flush: 0 2024-09-13T18:32:15.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T18:32:15.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T18:32:15.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T18:32:15.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.log_readahead_size: 0 2024-09-13T18:32:15.588 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_background_jobs: 2 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_background_compactions: -1 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_subcompactions: 1 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T18:32:15.589 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_open_files: -1 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_background_flushes: -1 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Compression algorithms supported: 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: kZSTD supported: 0 2024-09-13T18:32:15.590 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: kXpressCompression supported: 0 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: kBZip2Compression supported: 0 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: kLZ4Compression supported: 1 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: kZlibCompression supported: 1 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: kSnappyCompression supported: 1 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi038/store.db/MANIFEST-000015 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.merge_operator: 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_filter: None 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T18:32:15.591 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56103144ea20) 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: cache_index_and_filter_blocks: 1 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: pin_top_level_index_and_filter: 1 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: index_type: 0 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: data_block_index_type: 0 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: index_shortening: 1 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: checksum: 4 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: no_block_cache: 0 2024-09-13T18:32:15.592 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache: 0x5610314431f0 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache_name: BinnedLRUCache 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache_options: 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: capacity : 536870912 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: num_shard_bits : 4 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: strict_capacity_limit : 0 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: high_pri_pool_ratio: 0.000 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_cache_compressed: (nil) 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: persistent_cache: (nil) 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_size: 4096 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_size_deviation: 10 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_restart_interval: 16 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: index_block_restart_interval: 1 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: metadata_block_size: 4096 2024-09-13T18:32:15.593 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: partition_filters: 0 2024-09-13T18:32:15.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: use_delta_encoding: 1 2024-09-13T18:32:15.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: filter_policy: bloomfilter 2024-09-13T18:32:15.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: whole_key_filtering: 1 2024-09-13T18:32:15.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: verify_compression: 0 2024-09-13T18:32:15.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: read_amp_bytes_per_bit: 0 2024-09-13T18:32:15.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: format_version: 5 2024-09-13T18:32:15.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: enable_index_compression: 1 2024-09-13T18:32:15.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: block_align: 0 2024-09-13T18:32:15.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: max_auto_readahead_size: 262144 2024-09-13T18:32:15.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: prepopulate_block_cache: 0 2024-09-13T18:32:15.594 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: initial_auto_readahead_size: 8192 2024-09-13T18:32:15.595 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T18:32:15.595 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T18:32:15.595 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T18:32:15.596 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compression: NoCompression 2024-09-13T18:32:15.596 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T18:32:15.596 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T18:32:15.596 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T18:32:15.596 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.num_levels: 7 2024-09-13T18:32:15.596 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T18:32:15.596 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T18:32:15.596 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T18:32:15.596 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T18:32:15.596 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T18:32:15.596 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T18:32:15.596 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T18:32:15.597 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T18:32:15.598 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T18:32:15.599 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.inplace_update_support: 0 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.bloom_locality: 0 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.max_successive_merges: 0 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T18:32:15.600 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.ttl: 2592000 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.enable_blob_files: false 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.min_blob_size: 0 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T18:32:15.601 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T18:32:15.602 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T18:32:15.602 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T18:32:15.602 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi038/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 31, last_sequence is 10243, log_number is 27,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 27 2024-09-13T18:32:15.602 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 27 2024-09-13T18:32:15.602 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 394bf0cb-bfd2-49da-84eb-664a4c4f7be8 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726252335552706, "job": 1, "event": "recovery_started", "wal_files": [27]} 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #27 mode 2 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726252335560707, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 32, "file_size": 2461700, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10244, "largest_seqno": 11474, "table_properties": {"data_size": 2455139, "index_size": 4108, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1413, "raw_key_size": 12478, "raw_average_key_size": 22, "raw_value_size": 2443005, "raw_average_value_size": 4458, "num_data_blocks": 188, "num_entries": 548, "num_filter_entries": 548, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726252335, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "394bf0cb-bfd2-49da-84eb-664a4c4f7be8", "db_session_id": "FFU9M0977HBILCSIYYF2", "orig_file_number": 32, "seqno_to_time_mapping": "N/A"}} 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726252335560804, "job": 1, "event": "recovery_finished"} 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [db/version_set.cc:5047] Creating manifest 34 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi038/store.db/000027.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56103146ee00 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: DB pointer 0x561031562000 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** DB Stats ** 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T18:32:15.603 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** Compaction Stats [default] ** 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: L0 1/0 2.35 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: L6 1/0 5.23 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Sum 2/0 7.58 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T18:32:15.604 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** Compaction Stats [default] ** 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 597.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T18:32:15.605 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Cumulative compaction: 0.00 GB write, 214.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Interval compaction: 0.00 GB write, 214.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Block cache BinnedLRUCache@0x5610314431f0#2 capacity: 512.00 MB usage: 6.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: starting mon.smithi038 rank 0 at public addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] at bind addrs [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi038 fsid ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: mon.smithi038@-1(???) e2 preinit fsid ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: mon.smithi038@-1(???).mds e18 new map 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: mon.smithi038@-1(???).mds e18 print_map 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: e18 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:32:15.606 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: legacy client fscid: 1 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: Filesystem 'cephfs' (1) 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: fs_name cephfs 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: epoch 18 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: tableserver 0 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: root 0 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: session_timeout 60 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: session_autoclose 300 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: max_file_size 1099511627776 2024-09-13T18:32:15.607 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: max_xattr_size 65536 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: required_client_features {} 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: last_failure 0 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: last_failure_osd_epoch 47 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: max_mds 2 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: in 0,1 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: up {0=14484,1=24275} 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: failed 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: damaged 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: stopped 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: data_pools [3] 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: metadata_pool 2 2024-09-13T18:32:15.608 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: inline_data disabled 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: balancer 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: bal_rank_mask -1 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: standby_count_wanted 1 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: [mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: [mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: [mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: [mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout: 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: mon.smithi038@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: mon.smithi038@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: mon.smithi038@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: mon.smithi038@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T18:32:15.609 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 ceph-mon[91522]: mon.smithi038@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-13T18:32:16.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 bash[91503]: e7c5577a18c9f10bfd49e24e92aa2300b96e44b0190c0b1f827972a3dd5afae4 2024-09-13T18:32:16.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:15 smithi038 systemd[1]: Started Ceph mon.smithi038 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:32:17.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:17 smithi038 ceph-mon[91522]: pgmap v37: 65 pgs: 65 active+clean; 225 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 691 op/s 2024-09-13T18:32:17.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:17 smithi038 ceph-mon[91522]: pgmap v38: 65 pgs: 65 active+clean; 225 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 517 op/s 2024-09-13T18:32:17.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:17 smithi038 ceph-mon[91522]: mon.smithi038 calling monitor election 2024-09-13T18:32:17.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:17 smithi038 ceph-mon[91522]: mon.smithi038 is new leader, mons smithi038,smithi149 in quorum (ranks 0,1) 2024-09-13T18:32:17.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:17 smithi038 ceph-mon[91522]: monmap e2: 2 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0],smithi149=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:32:17.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:17 smithi038 ceph-mon[91522]: fsmap cephfs:2 {0=cephfs.smithi038.dtnkqo=up:active,1=cephfs.smithi149.doanhj=up:active} 2 up:standby-replay 2024-09-13T18:32:17.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:17 smithi038 ceph-mon[91522]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T18:32:17.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:17 smithi038 ceph-mon[91522]: mgrmap e31: smithi038.jeygoq(active, since 70s), standbys: smithi149.eabzne 2024-09-13T18:32:17.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:17 smithi038 ceph-mon[91522]: overall HEALTH_OK 2024-09-13T18:32:17.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:17 smithi038 ceph-mon[91522]: from='mgr.14726 ' entity='' 2024-09-13T18:32:17.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:17 smithi038 ceph-mon[91522]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:17.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:17.461 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:17 smithi149 ceph-mon[35845]: pgmap v37: 65 pgs: 65 active+clean; 225 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 691 op/s 2024-09-13T18:32:17.462 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:17 smithi149 ceph-mon[35845]: pgmap v38: 65 pgs: 65 active+clean; 225 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 517 op/s 2024-09-13T18:32:17.462 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:17 smithi149 ceph-mon[35845]: mon.smithi038 calling monitor election 2024-09-13T18:32:17.462 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:17 smithi149 ceph-mon[35845]: mon.smithi038 is new leader, mons smithi038,smithi149 in quorum (ranks 0,1) 2024-09-13T18:32:17.462 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:17 smithi149 ceph-mon[35845]: monmap e2: 2 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0],smithi149=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:32:17.462 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:17 smithi149 ceph-mon[35845]: fsmap cephfs:2 {0=cephfs.smithi038.dtnkqo=up:active,1=cephfs.smithi149.doanhj=up:active} 2 up:standby-replay 2024-09-13T18:32:17.462 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:17 smithi149 ceph-mon[35845]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T18:32:17.462 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:17 smithi149 ceph-mon[35845]: mgrmap e31: smithi038.jeygoq(active, since 70s), standbys: smithi149.eabzne 2024-09-13T18:32:17.462 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:17 smithi149 ceph-mon[35845]: overall HEALTH_OK 2024-09-13T18:32:17.462 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:17 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='' 2024-09-13T18:32:17.462 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:17 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:17.462 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:17 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:19.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:19 smithi149 ceph-mon[35845]: pgmap v39: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 573 op/s 2024-09-13T18:32:19.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:19 smithi038 ceph-mon[91522]: pgmap v39: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 573 op/s 2024-09-13T18:32:21.728 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:21 smithi038 ceph-mon[91522]: pgmap v40: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 850 KiB/s rd, 879 KiB/s wr, 370 op/s 2024-09-13T18:32:21.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:21 smithi149 ceph-mon[35845]: pgmap v40: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 850 KiB/s rd, 879 KiB/s wr, 370 op/s 2024-09-13T18:32:22.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:22 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:32:22.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:22 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:22.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:22 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:22.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:22 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:32:22.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:22 smithi038 ceph-mon[91522]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:22.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:22 smithi038 ceph-mon[91522]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:24.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:23 smithi149 ceph-mon[35845]: pgmap v41: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 854 KiB/s rd, 883 KiB/s wr, 372 op/s 2024-09-13T18:32:24.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:23 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:24.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:23 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:24.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:23 smithi038 ceph-mon[91522]: pgmap v41: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 854 KiB/s rd, 883 KiB/s wr, 372 op/s 2024-09-13T18:32:24.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:23 smithi038 ceph-mon[91522]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:24.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:23 smithi038 ceph-mon[91522]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:26.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:25 smithi149 ceph-mon[35845]: pgmap v42: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 283 KiB/s rd, 200 KiB/s wr, 101 op/s 2024-09-13T18:32:26.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:25 smithi038 ceph-mon[91522]: pgmap v42: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 283 KiB/s rd, 200 KiB/s wr, 101 op/s 2024-09-13T18:32:27.384 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:27 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:27.385 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:27 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:27.385 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:27 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:27.385 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:27 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:32:27.385 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:27 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:27.385 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:27 smithi149 ceph-mon[35845]: pgmap v43: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 283 KiB/s rd, 190 KiB/s wr, 58 op/s 2024-09-13T18:32:27.385 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:27 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:27.385 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:27 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:27.385 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:27 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T18:32:27.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:27 smithi038 ceph-mon[91522]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:27.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:27 smithi038 ceph-mon[91522]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:27.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:27 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:27.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:27 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:32:27.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:27 smithi038 ceph-mon[91522]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:27.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:27 smithi038 ceph-mon[91522]: pgmap v43: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 283 KiB/s rd, 190 KiB/s wr, 58 op/s 2024-09-13T18:32:27.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:27 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:27.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:27 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:27.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:27 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T18:32:29.044 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:28 smithi149 ceph-mon[35845]: Upgrade: Updating mon.smithi149 2024-09-13T18:32:29.044 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:28 smithi149 ceph-mon[35845]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:29.044 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:28 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:32:29.044 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:28 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:32:29.044 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:28 smithi149 ceph-mon[35845]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:29.045 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:28 smithi149 ceph-mon[35845]: Deploying daemon mon.smithi149 on smithi149 2024-09-13T18:32:29.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:28 smithi038 ceph-mon[91522]: Upgrade: Updating mon.smithi149 2024-09-13T18:32:29.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:28 smithi038 ceph-mon[91522]: from='mgr.14726 ' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:29.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T18:32:29.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T18:32:29.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:29.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:28 smithi038 ceph-mon[91522]: Deploying daemon mon.smithi149 on smithi149 2024-09-13T18:32:29.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:29 smithi149 systemd[1]: Stopping Ceph mon.smithi149 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:32:29.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:29 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149[35841]: 2024-09-13T18:32:29.563+0000 7fbddeeae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi149 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:32:29.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:29 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149[35841]: 2024-09-13T18:32:29.563+0000 7fbddeeae640 -1 mon.smithi149@1(peon) e2 *** Got Signal Terminated *** 2024-09-13T18:32:30.140 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:29 smithi149 podman[76749]: 2024-09-13 18:32:29.80902539 +0000 UTC m=+0.341863990 container died 0133a107f35deb6fa5590d40c02761a232f3a5db05c53bada749f805a12c06a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, RELEASE=reef-e4e227b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:32:30.140 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:30 smithi149 podman[76749]: 2024-09-13 18:32:30.138425399 +0000 UTC m=+0.671264041 container cleanup 0133a107f35deb6fa5590d40c02761a232f3a5db05c53bada749f805a12c06a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=reef-e4e227b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T18:32:30.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.215+0000 7fdac0a2a640 1 -- 172.21.15.38:0/3519777964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdabc100630 msgr2=0x7fdabc102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.215+0000 7fdac0a2a640 1 --2- 172.21.15.38:0/3519777964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdabc100630 0x7fdabc102a20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0098b0 tx=0x7fdaac02a4f0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.215+0000 7fdac0a2a640 1 -- 172.21.15.38:0/3519777964 shutdown_connections 2024-09-13T18:32:30.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.215+0000 7fdac0a2a640 1 --2- 172.21.15.38:0/3519777964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdabc102f60 0x7fdabc105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.215+0000 7fdac0a2a640 1 --2- 172.21.15.38:0/3519777964 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdabc100630 0x7fdabc102a20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.215+0000 7fdac0a2a640 1 -- 172.21.15.38:0/3519777964 >> 172.21.15.38:0/3519777964 conn(0x7fdabc0fa250 msgr2=0x7fdabc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:30.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.215+0000 7fdac0a2a640 1 -- 172.21.15.38:0/3519777964 shutdown_connections 2024-09-13T18:32:30.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.215+0000 7fdac0a2a640 1 -- 172.21.15.38:0/3519777964 wait complete. 2024-09-13T18:32:30.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.216+0000 7fdac0a2a640 1 Processor -- start 2024-09-13T18:32:30.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.216+0000 7fdac0a2a640 1 -- start start 2024-09-13T18:32:30.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdac0a2a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdabc100630 0x7fdabc1956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdac0a2a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdabc102f60 0x7fdabc195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdac0a2a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc1961b0 con 0x7fdabc102f60 2024-09-13T18:32:30.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdac0a2a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc196320 con 0x7fdabc100630 2024-09-13T18:32:30.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdab9d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdabc102f60 0x7fdabc195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdab9d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdabc102f60 0x7fdabc195be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50240/0 (socket says 172.21.15.38:50240) 2024-09-13T18:32:30.221 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdab9d9b640 1 -- 172.21.15.38:0/1699309737 learned_addr learned my addr 172.21.15.38:0/1699309737 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:32:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdaba59c640 1 -- 172.21.15.38:0/1699309737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdabc100630 msgr2=0x7fdabc1956a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-13T18:32:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdaba59c640 1 --2- 172.21.15.38:0/1699309737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdabc100630 0x7fdabc1956a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:32:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdab9d9b640 1 -- 172.21.15.38:0/1699309737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdabc100630 msgr2=0x7fdabc1956a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:32:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdab9d9b640 1 --2- 172.21.15.38:0/1699309737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdabc100630 0x7fdabc1956a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdab9d9b640 1 -- 172.21.15.38:0/1699309737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac009560 con 0x7fdabc102f60 2024-09-13T18:32:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.217+0000 7fdab9d9b640 1 --2- 172.21.15.38:0/1699309737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdabc102f60 0x7fdabc195be0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400b4d0 tx=0x7fdaa400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.218+0000 7fdab37fe640 1 -- 172.21.15.38:0/1699309737 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaa4010840 con 0x7fdabc102f60 2024-09-13T18:32:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.218+0000 7fdac0a2a640 1 -- 172.21.15.38:0/1699309737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc19ad70 con 0x7fdabc102f60 2024-09-13T18:32:30.222 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.218+0000 7fdab37fe640 1 -- 172.21.15.38:0/1699309737 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdaa4010e40 con 0x7fdabc102f60 2024-09-13T18:32:30.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.218+0000 7fdab37fe640 1 -- 172.21.15.38:0/1699309737 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaa4017360 con 0x7fdabc102f60 2024-09-13T18:32:30.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.218+0000 7fdac0a2a640 1 -- 172.21.15.38:0/1699309737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc19b2e0 con 0x7fdabc102f60 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.219+0000 7fdac0a2a640 1 -- 172.21.15.38:0/1699309737 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdabc1086f0 con 0x7fdabc102f60 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.219+0000 7fdab37fe640 1 -- 172.21.15.38:0/1699309737 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 31) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fdaa40174c0 con 0x7fdabc102f60 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.220+0000 7fdab37fe640 1 --2- 172.21.15.38:0/1699309737 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fdaa806ccd0 0x7fdaa806f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.220+0000 7fdab37fe640 1 -- 172.21.15.38:0/1699309737 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fdaa408c220 con 0x7fdabc102f60 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.220+0000 7fdaba59c640 1 --2- 172.21.15.38:0/1699309737 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fdaa806ccd0 0x7fdaa806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.220+0000 7fdaba59c640 1 --2- 172.21.15.38:0/1699309737 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fdaa806ccd0 0x7fdaa806f190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdaac004ec0 tx=0x7fdaac000bc0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.227 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.225+0000 7fdab37fe640 1 -- 172.21.15.38:0/1699309737 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdaa40562a0 con 0x7fdabc102f60 2024-09-13T18:32:30.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.417+0000 7fdac0a2a640 1 -- 172.21.15.38:0/1699309737 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdabc1039c0 con 0x7fdaa806ccd0 2024-09-13T18:32:30.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.418+0000 7fdab37fe640 1 -- 172.21.15.38:0/1699309737 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fdabc1039c0 con 0x7fdaa806ccd0 2024-09-13T18:32:30.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.420+0000 7fdac0a2a640 1 -- 172.21.15.38:0/1699309737 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fdaa806ccd0 msgr2=0x7fdaa806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.420+0000 7fdac0a2a640 1 --2- 172.21.15.38:0/1699309737 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fdaa806ccd0 0x7fdaa806f190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdaac004ec0 tx=0x7fdaac000bc0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.420+0000 7fdac0a2a640 1 -- 172.21.15.38:0/1699309737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdabc102f60 msgr2=0x7fdabc195be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.420+0000 7fdac0a2a640 1 --2- 172.21.15.38:0/1699309737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdabc102f60 0x7fdabc195be0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400b4d0 tx=0x7fdaa400b990 comp rx=0 tx=0).stop 2024-09-13T18:32:30.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.420+0000 7fdac0a2a640 1 -- 172.21.15.38:0/1699309737 shutdown_connections 2024-09-13T18:32:30.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.420+0000 7fdac0a2a640 1 --2- 172.21.15.38:0/1699309737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdabc102f60 0x7fdabc195be0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.420+0000 7fdac0a2a640 1 --2- 172.21.15.38:0/1699309737 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fdaa806ccd0 0x7fdaa806f190 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.420+0000 7fdac0a2a640 1 --2- 172.21.15.38:0/1699309737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdabc100630 0x7fdabc1956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.420+0000 7fdac0a2a640 1 -- 172.21.15.38:0/1699309737 >> 172.21.15.38:0/1699309737 conn(0x7fdabc0fa250 msgr2=0x7fdabc0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:30.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.421+0000 7fdac0a2a640 1 -- 172.21.15.38:0/1699309737 shutdown_connections 2024-09-13T18:32:30.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.421+0000 7fdac0a2a640 1 -- 172.21.15.38:0/1699309737 wait complete. 2024-09-13T18:32:30.432 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:32:30.509 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.506+0000 7ff9fb885640 1 -- 172.21.15.38:0/2486420431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9f40ffcf0 msgr2=0x7ff9f4100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.506+0000 7ff9fb885640 1 --2- 172.21.15.38:0/2486420431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9f40ffcf0 0x7ff9f4100170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009880 tx=0x7ff9e402a4d0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.506+0000 7ff9fb885640 1 -- 172.21.15.38:0/2486420431 shutdown_connections 2024-09-13T18:32:30.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.506+0000 7ff9fb885640 1 --2- 172.21.15.38:0/2486420431 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9f40ffcf0 0x7ff9f4100170 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.506+0000 7ff9fb885640 1 --2- 172.21.15.38:0/2486420431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f40feaf0 0x7ff9f40feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.506+0000 7ff9fb885640 1 -- 172.21.15.38:0/2486420431 >> 172.21.15.38:0/2486420431 conn(0x7ff9f40fa280 msgr2=0x7ff9f40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:30.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.506+0000 7ff9fb885640 1 -- 172.21.15.38:0/2486420431 shutdown_connections 2024-09-13T18:32:30.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.506+0000 7ff9fb885640 1 -- 172.21.15.38:0/2486420431 wait complete. 2024-09-13T18:32:30.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.506+0000 7ff9fb885640 1 Processor -- start 2024-09-13T18:32:30.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.506+0000 7ff9fb885640 1 -- start start 2024-09-13T18:32:30.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9fb885640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9f40feaf0 0x7ff9f4102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9fb885640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f40ffcf0 0x7ff9f41010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9fb885640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f4101610 con 0x7ff9f40feaf0 2024-09-13T18:32:30.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9fb885640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f4101780 con 0x7ff9f40ffcf0 2024-09-13T18:32:30.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9f8e20640 1 -- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f40ffcf0 msgr2=0x7ff9f41010d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-13T18:32:30.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9f9621640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9f40feaf0 0x7ff9f4102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9f8e20640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f40ffcf0 0x7ff9f41010d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:32:30.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9f9621640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9f40feaf0 0x7ff9f4102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50258/0 (socket says 172.21.15.38:50258) 2024-09-13T18:32:30.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9f9621640 1 -- 172.21.15.38:0/1264505218 learned_addr learned my addr 172.21.15.38:0/1264505218 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:32:30.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9f9621640 1 -- 172.21.15.38:0/1264505218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f40ffcf0 msgr2=0x7ff9f41010d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:32:30.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9f9621640 1 --2- 172.21.15.38:0/1264505218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f40ffcf0 0x7ff9f41010d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9f9621640 1 -- 172.21.15.38:0/1264505218 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e4009560 con 0x7ff9f40feaf0 2024-09-13T18:32:30.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9f9621640 1 --2- 172.21.15.38:0/1264505218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9f40feaf0 0x7ff9f4102a80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000b4d0 tx=0x7ff9f000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.512 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9ea7fc640 1 -- 172.21.15.38:0/1264505218 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9f0010840 con 0x7ff9f40feaf0 2024-09-13T18:32:30.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9fb885640 1 -- 172.21.15.38:0/1264505218 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f4101a60 con 0x7ff9f40feaf0 2024-09-13T18:32:30.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9ea7fc640 1 -- 172.21.15.38:0/1264505218 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff9f0010e40 con 0x7ff9f40feaf0 2024-09-13T18:32:30.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9ea7fc640 1 -- 172.21.15.38:0/1264505218 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9f0017360 con 0x7ff9f40feaf0 2024-09-13T18:32:30.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.507+0000 7ff9fb885640 1 -- 172.21.15.38:0/1264505218 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f419d6b0 con 0x7ff9f40feaf0 2024-09-13T18:32:30.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.509+0000 7ff9fb885640 1 -- 172.21.15.38:0/1264505218 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f4107640 con 0x7ff9f40feaf0 2024-09-13T18:32:30.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.509+0000 7ff9ea7fc640 1 -- 172.21.15.38:0/1264505218 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 31) v1 ==== 90952+0+0 (secure 0 0 0) 0x7ff9f000f3c0 con 0x7ff9f40feaf0 2024-09-13T18:32:30.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.509+0000 7ff9ea7fc640 1 --2- 172.21.15.38:0/1264505218 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff9e006ccd0 0x7ff9e006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.510+0000 7ff9ea7fc640 1 -- 172.21.15.38:0/1264505218 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff9f008c2c0 con 0x7ff9f40feaf0 2024-09-13T18:32:30.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.510+0000 7ff9f8e20640 1 --2- 172.21.15.38:0/1264505218 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff9e006ccd0 0x7ff9e006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.513 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.510+0000 7ff9f8e20640 1 --2- 172.21.15.38:0/1264505218 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff9e006ccd0 0x7ff9e006f190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4004ec0 tx=0x7ff9e4000bc0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.514+0000 7ff9ea7fc640 1 -- 172.21.15.38:0/1264505218 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff9f00562d0 con 0x7ff9f40feaf0 2024-09-13T18:32:30.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:30 smithi149 bash[76749]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149 2024-09-13T18:32:30.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:30 smithi149 podman[76763]: 2024-09-13 18:32:30.339717799 +0000 UTC m=+0.523772148 container remove 0133a107f35deb6fa5590d40c02761a232f3a5db05c53bada749f805a12c06a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T18:32:30.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.714+0000 7ff9fb885640 1 -- 172.21.15.38:0/1264505218 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9f40683f0 con 0x7ff9e006ccd0 2024-09-13T18:32:30.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.716+0000 7ff9ea7fc640 1 -- 172.21.15.38:0/1264505218 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7ff9f40683f0 con 0x7ff9e006ccd0 2024-09-13T18:32:30.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.717+0000 7ff9fb885640 1 -- 172.21.15.38:0/1264505218 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff9e006ccd0 msgr2=0x7ff9e006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.717+0000 7ff9fb885640 1 --2- 172.21.15.38:0/1264505218 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff9e006ccd0 0x7ff9e006f190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4004ec0 tx=0x7ff9e4000bc0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.717+0000 7ff9fb885640 1 -- 172.21.15.38:0/1264505218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9f40feaf0 msgr2=0x7ff9f4102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.717+0000 7ff9fb885640 1 --2- 172.21.15.38:0/1264505218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9f40feaf0 0x7ff9f4102a80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000b4d0 tx=0x7ff9f000b990 comp rx=0 tx=0).stop 2024-09-13T18:32:30.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.718+0000 7ff9fb885640 1 -- 172.21.15.38:0/1264505218 shutdown_connections 2024-09-13T18:32:30.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.718+0000 7ff9fb885640 1 --2- 172.21.15.38:0/1264505218 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff9e006ccd0 0x7ff9e006f190 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.718+0000 7ff9fb885640 1 --2- 172.21.15.38:0/1264505218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9f40ffcf0 0x7ff9f41010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.718+0000 7ff9fb885640 1 --2- 172.21.15.38:0/1264505218 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9f40feaf0 0x7ff9f4102a80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.718+0000 7ff9fb885640 1 -- 172.21.15.38:0/1264505218 >> 172.21.15.38:0/1264505218 conn(0x7ff9f40fa280 msgr2=0x7ff9f4067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:30.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.718+0000 7ff9fb885640 1 -- 172.21.15.38:0/1264505218 shutdown_connections 2024-09-13T18:32:30.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.718+0000 7ff9fb885640 1 -- 172.21.15.38:0/1264505218 wait complete. 2024-09-13T18:32:30.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.801+0000 7f1cc77ce640 1 -- 172.21.15.38:0/1499321296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cc00feaa0 msgr2=0x7f1cc00feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:30.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.801+0000 7f1cc77ce640 1 --2- 172.21.15.38:0/1499321296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cc00feaa0 0x7f1cc00feea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009880 tx=0x7f1cbc02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.801+0000 7f1cc77ce640 1 -- 172.21.15.38:0/1499321296 shutdown_connections 2024-09-13T18:32:30.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.801+0000 7f1cc77ce640 1 --2- 172.21.15.38:0/1499321296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc00ffca0 0x7f1cc0100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.801+0000 7f1cc77ce640 1 --2- 172.21.15.38:0/1499321296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cc00feaa0 0x7f1cc00feea0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.801+0000 7f1cc77ce640 1 -- 172.21.15.38:0/1499321296 >> 172.21.15.38:0/1499321296 conn(0x7f1cc00fa250 msgr2=0x7f1cc00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:30.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.802+0000 7f1cc77ce640 1 -- 172.21.15.38:0/1499321296 shutdown_connections 2024-09-13T18:32:30.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.802+0000 7f1cc77ce640 1 -- 172.21.15.38:0/1499321296 wait complete. 2024-09-13T18:32:30.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.802+0000 7f1cc77ce640 1 Processor -- start 2024-09-13T18:32:30.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.802+0000 7f1cc77ce640 1 -- start start 2024-09-13T18:32:30.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.802+0000 7f1cc77ce640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc00feaa0 0x7f1cc0068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.806 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.802+0000 7f1cc77ce640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cc00ffca0 0x7f1cc019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.802+0000 7f1cc77ce640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc019a960 con 0x7f1cc00ffca0 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.802+0000 7f1cc77ce640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc019aaa0 con 0x7f1cc00feaa0 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.802+0000 7f1cc556a640 1 -- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc00feaa0 msgr2=0x7f1cc0068fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cc556a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc00feaa0 0x7f1cc0068fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cc4d69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cc00ffca0 0x7f1cc019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cc4d69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cc00ffca0 0x7f1cc019a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50282/0 (socket says 172.21.15.38:50282) 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cc4d69640 1 -- 172.21.15.38:0/2539076138 learned_addr learned my addr 172.21.15.38:0/2539076138 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cc4d69640 1 -- 172.21.15.38:0/2539076138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc00feaa0 msgr2=0x7f1cc0068fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cc4d69640 1 --2- 172.21.15.38:0/2539076138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc00feaa0 0x7f1cc0068fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cc4d69640 1 -- 172.21.15.38:0/2539076138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc009560 con 0x7f1cc00ffca0 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cc4d69640 1 --2- 172.21.15.38:0/2539076138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cc00ffca0 0x7f1cc019a390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000b4d0 tx=0x7f1cb000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cb67fc640 1 -- 172.21.15.38:0/2539076138 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb00107e0 con 0x7f1cc00ffca0 2024-09-13T18:32:30.807 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cb67fc640 1 -- 172.21.15.38:0/2539076138 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1cb0010de0 con 0x7f1cc00ffca0 2024-09-13T18:32:30.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cc77ce640 1 -- 172.21.15.38:0/2539076138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc019ad50 con 0x7f1cc00ffca0 2024-09-13T18:32:30.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cb67fc640 1 -- 172.21.15.38:0/2539076138 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb0017ea0 con 0x7f1cc00ffca0 2024-09-13T18:32:30.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.803+0000 7f1cc77ce640 1 -- 172.21.15.38:0/2539076138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc019b2c0 con 0x7f1cc00ffca0 2024-09-13T18:32:30.808 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.804+0000 7f1cc77ce640 1 -- 172.21.15.38:0/2539076138 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc01075f0 con 0x7f1cc00ffca0 2024-09-13T18:32:30.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.805+0000 7f1cb67fc640 1 -- 172.21.15.38:0/2539076138 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 31) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f1cb0017360 con 0x7f1cc00ffca0 2024-09-13T18:32:30.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.805+0000 7f1cb67fc640 1 --2- 172.21.15.38:0/2539076138 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1cac06ccd0 0x7f1cac06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:30.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.806+0000 7f1cb67fc640 1 -- 172.21.15.38:0/2539076138 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1cb008c020 con 0x7f1cc00ffca0 2024-09-13T18:32:30.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.806+0000 7f1cc556a640 1 --2- 172.21.15.38:0/2539076138 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1cac06ccd0 0x7f1cac06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:30.809 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.806+0000 7f1cc556a640 1 --2- 172.21.15.38:0/2539076138 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1cac06ccd0 0x7f1cac06f190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc004ec0 tx=0x7f1cbc000bc0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:30.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.810+0000 7f1cb67fc640 1 -- 172.21.15.38:0/2539076138 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1cb00560b0 con 0x7f1cc00ffca0 2024-09-13T18:32:30.984 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:30 smithi149 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi149.service: Deactivated successfully. 2024-09-13T18:32:30.984 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:30 smithi149 systemd[1]: Stopped Ceph mon.smithi149 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:32:30.984 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:30 smithi149 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi149.service: Consumed 6.119s CPU time. 2024-09-13T18:32:30.984 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:30 smithi149 systemd[1]: Starting Ceph mon.smithi149 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:32:30.993 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:30.990+0000 7f1cc77ce640 1 -- 172.21.15.38:0/2539076138 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cc019b510 con 0x7f1cac06ccd0 2024-09-13T18:32:31.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.000+0000 7f1cb67fc640 1 -- 172.21.15.38:0/2539076138 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f1cc019b510 con 0x7f1cac06ccd0 2024-09-13T18:32:31.003 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:32:31.003 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (8m) 8s ago 10m 24.1M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:32:31.003 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (10m) 8s ago 10m 8200k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:32:31.003 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (9m) 27s ago 9m 7884k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:32:31.003 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (10m) 8s ago 10m 6899k - 18.2.4-845-ge4e227b3 67ddd33fa72f 30c026e97a6b 2024-09-13T18:32:31.003 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (9m) 27s ago 9m 6895k - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c179d7df975 2024-09-13T18:32:31.003 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (8m) 8s ago 9m 87.4M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:32:31.003 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (4m) 8s ago 4m 180M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:32:31.003 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (4m) 8s ago 4m 99.1M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:32:31.003 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (4m) 27s ago 4m 25.0M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:32:31.003 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (4m) 27s ago 4m 25.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:32:31.003 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (95s) 8s ago 11m 484M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:32:31.004 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (30s) 27s ago 9m 63.5M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:32:31.004 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (15s) 8s ago 11m 25.4M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:32:31.004 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (9m) 27s ago 9m 45.2M 2048M 18.2.4-845-ge4e227b3 67ddd33fa72f 0133a107f35d 2024-09-13T18:32:31.004 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (10m) 8s ago 10m 15.5M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:32:31.004 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (9m) 27s ago 9m 15.8M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:32:31.004 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (8m) 8s ago 8m 249M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 69a9e66fb097 2024-09-13T18:32:31.004 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (7m) 8s ago 7m 256M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 07986b4ba73b 2024-09-13T18:32:31.004 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (7m) 8s ago 7m 214M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f e44cdda01aee 2024-09-13T18:32:31.004 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (7m) 27s ago 7m 273M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:32:31.004 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (6m) 27s ago 6m 259M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:32:31.004 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (6m) 27s ago 6m 219M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:32:31.004 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (35s) 8s ago 9m 44.8M - 2.43.0 a07b618ecd1d c04b1dcdc8c3 2024-09-13T18:32:31.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.002+0000 7f1cc77ce640 1 -- 172.21.15.38:0/2539076138 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1cac06ccd0 msgr2=0x7f1cac06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.002+0000 7f1cc77ce640 1 --2- 172.21.15.38:0/2539076138 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1cac06ccd0 0x7f1cac06f190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc004ec0 tx=0x7f1cbc000bc0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.002+0000 7f1cc77ce640 1 -- 172.21.15.38:0/2539076138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cc00ffca0 msgr2=0x7f1cc019a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.002+0000 7f1cc77ce640 1 --2- 172.21.15.38:0/2539076138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cc00ffca0 0x7f1cc019a390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000b4d0 tx=0x7f1cb000b990 comp rx=0 tx=0).stop 2024-09-13T18:32:31.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.002+0000 7f1cc77ce640 1 -- 172.21.15.38:0/2539076138 shutdown_connections 2024-09-13T18:32:31.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.002+0000 7f1cc77ce640 1 --2- 172.21.15.38:0/2539076138 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1cc00ffca0 0x7f1cc019a390 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.002+0000 7f1cc77ce640 1 --2- 172.21.15.38:0/2539076138 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1cac06ccd0 0x7f1cac06f190 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.002+0000 7f1cc77ce640 1 --2- 172.21.15.38:0/2539076138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1cc00feaa0 0x7f1cc0068fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.002+0000 7f1cc77ce640 1 -- 172.21.15.38:0/2539076138 >> 172.21.15.38:0/2539076138 conn(0x7f1cc00fa250 msgr2=0x7f1cc0102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:31.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.002+0000 7f1cc77ce640 1 -- 172.21.15.38:0/2539076138 shutdown_connections 2024-09-13T18:32:31.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.002+0000 7f1cc77ce640 1 -- 172.21.15.38:0/2539076138 wait complete. 2024-09-13T18:32:31.088 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.086+0000 7f1d10fb9640 1 -- 172.21.15.38:0/2685564686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0c0ffca0 msgr2=0x7f1d0c100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.086+0000 7f1d10fb9640 1 --2- 172.21.15.38:0/2685564686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0c0ffca0 0x7f1d0c100120 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009880 tx=0x7f1d0002a4d0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.086+0000 7f1d10fb9640 1 -- 172.21.15.38:0/2685564686 shutdown_connections 2024-09-13T18:32:31.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.086+0000 7f1d10fb9640 1 --2- 172.21.15.38:0/2685564686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0c0ffca0 0x7f1d0c100120 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.086+0000 7f1d10fb9640 1 --2- 172.21.15.38:0/2685564686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d0c0feaa0 0x7f1d0c0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.086+0000 7f1d10fb9640 1 -- 172.21.15.38:0/2685564686 >> 172.21.15.38:0/2685564686 conn(0x7f1d0c0fa250 msgr2=0x7f1d0c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:31.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.086+0000 7f1d10fb9640 1 -- 172.21.15.38:0/2685564686 shutdown_connections 2024-09-13T18:32:31.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.086+0000 7f1d10fb9640 1 -- 172.21.15.38:0/2685564686 wait complete. 2024-09-13T18:32:31.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.087+0000 7f1d10fb9640 1 Processor -- start 2024-09-13T18:32:31.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.087+0000 7f1d10fb9640 1 -- start start 2024-09-13T18:32:31.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.087+0000 7f1d10fb9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0c0feaa0 0x7f1d0c102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.087+0000 7f1d10fb9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d0c0ffca0 0x7f1d0c101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.087+0000 7f1d10fb9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c1015c0 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.087+0000 7f1d10fb9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c101730 con 0x7f1d0c0ffca0 2024-09-13T18:32:31.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.087+0000 7f1d0a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0c0feaa0 0x7f1d0c102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.087+0000 7f1d0a59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0c0feaa0 0x7f1d0c102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50298/0 (socket says 172.21.15.38:50298) 2024-09-13T18:32:31.091 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.087+0000 7f1d09d9b640 1 -- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d0c0ffca0 msgr2=0x7f1d0c101080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.149:3300/0 2024-09-13T18:32:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.087+0000 7f1d0a59c640 1 -- 172.21.15.38:0/1232263217 learned_addr learned my addr 172.21.15.38:0/1232263217 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:32:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.087+0000 7f1d09d9b640 1 --2- 172.21.15.38:0/1232263217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d0c0ffca0 0x7f1d0c101080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:32:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.088+0000 7f1d0a59c640 1 -- 172.21.15.38:0/1232263217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d0c0ffca0 msgr2=0x7f1d0c101080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:32:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.088+0000 7f1d0a59c640 1 --2- 172.21.15.38:0/1232263217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d0c0ffca0 0x7f1d0c101080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.088+0000 7f1d0a59c640 1 -- 172.21.15.38:0/1232263217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d00009560 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.088+0000 7f1d0a59c640 1 --2- 172.21.15.38:0/1232263217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0c0feaa0 0x7f1d0c102a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00b4d0 tx=0x7f1cfc00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.088+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/1232263217 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cfc010840 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.088+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/1232263217 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1cfc010e40 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.088+0000 7f1d10fb9640 1 -- 172.21.15.38:0/1232263217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c101a10 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.088+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/1232263217 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cfc017360 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.088+0000 7f1d10fb9640 1 -- 172.21.15.38:0/1232263217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c19d630 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.089+0000 7f1d10fb9640 1 -- 172.21.15.38:0/1232263217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c1075f0 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.090+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/1232263217 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 31) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f1cfc0109a0 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.090+0000 7f1cfb7fe640 1 --2- 172.21.15.38:0/1232263217 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1cf406cd30 0x7f1cf406f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.090+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/1232263217 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1cfc08c1c0 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.090+0000 7f1d09d9b640 1 --2- 172.21.15.38:0/1232263217 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1cf406cd30 0x7f1cf406f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.091+0000 7f1d09d9b640 1 --2- 172.21.15.38:0/1232263217 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1cf406cd30 0x7f1cf406f1f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1d00004ec0 tx=0x7f1d00000bc0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:31.097 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.094+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/1232263217 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1cfc056250 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.236 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:30 smithi149 podman[76887]: 2024-09-13 18:32:30.884566658 +0000 UTC m=+0.015795999 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:32:31.236 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 podman[76887]: 2024-09-13 18:32:31.027254185 +0000 UTC m=+0.158483558 container create 66ddd3b3914176146d35baecab1d3d4b743ee11a27550d94b0e64b5f85f5a3e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T18:32:31.236 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 podman[76887]: 2024-09-13 18:32:31.234570669 +0000 UTC m=+0.365800004 container init 66ddd3b3914176146d35baecab1d3d4b743ee11a27550d94b0e64b5f85f5a3e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T18:32:31.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.334+0000 7f1d10fb9640 1 -- 172.21.15.38:0/1232263217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1d0c19da20 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.334+0000 7f1cfb7fe640 1 -- 172.21.15.38:0/1232263217 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+838 (secure 0 0 0) 0x7f1cfc059870 con 0x7f1d0c0feaa0 2024-09-13T18:32:31.337 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:32:31.337 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:32:31.337 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 1, 2024-09-13T18:32:31.337 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 1 2024-09-13T18:32:31.337 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 11, 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 3 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:32:31.338 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:32:31.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.337+0000 7f1d10fb9640 1 -- 172.21.15.38:0/1232263217 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1cf406cd30 msgr2=0x7f1cf406f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.337+0000 7f1d10fb9640 1 --2- 172.21.15.38:0/1232263217 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1cf406cd30 0x7f1cf406f1f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1d00004ec0 tx=0x7f1d00000bc0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.337+0000 7f1d10fb9640 1 -- 172.21.15.38:0/1232263217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0c0feaa0 msgr2=0x7f1d0c102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.339 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.337+0000 7f1d10fb9640 1 --2- 172.21.15.38:0/1232263217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0c0feaa0 0x7f1d0c102a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00b4d0 tx=0x7f1cfc00b990 comp rx=0 tx=0).stop 2024-09-13T18:32:31.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.337+0000 7f1d10fb9640 1 -- 172.21.15.38:0/1232263217 shutdown_connections 2024-09-13T18:32:31.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.337+0000 7f1d10fb9640 1 --2- 172.21.15.38:0/1232263217 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1cf406cd30 0x7f1cf406f1f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.337+0000 7f1d10fb9640 1 --2- 172.21.15.38:0/1232263217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d0c0ffca0 0x7f1d0c101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.337+0000 7f1d10fb9640 1 --2- 172.21.15.38:0/1232263217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d0c0feaa0 0x7f1d0c102a30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.337+0000 7f1d10fb9640 1 -- 172.21.15.38:0/1232263217 >> 172.21.15.38:0/1232263217 conn(0x7f1d0c0fa250 msgr2=0x7f1d0c0fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:31.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.337+0000 7f1d10fb9640 1 -- 172.21.15.38:0/1232263217 shutdown_connections 2024-09-13T18:32:31.340 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.337+0000 7f1d10fb9640 1 -- 172.21.15.38:0/1232263217 wait complete. 2024-09-13T18:32:31.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.422+0000 7f1c0a651640 1 -- 172.21.15.38:0/307991376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c04100d90 msgr2=0x7f1c04101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.422+0000 7f1c0a651640 1 --2- 172.21.15.38:0/307991376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c04100d90 0x7f1c04101210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009880 tx=0x7f1bf802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.422+0000 7f1c0a651640 1 -- 172.21.15.38:0/307991376 shutdown_connections 2024-09-13T18:32:31.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.422+0000 7f1c0a651640 1 --2- 172.21.15.38:0/307991376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c04100d90 0x7f1c04101210 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.422+0000 7f1c0a651640 1 --2- 172.21.15.38:0/307991376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c040ffb90 0x7f1c040fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.422+0000 7f1c0a651640 1 -- 172.21.15.38:0/307991376 >> 172.21.15.38:0/307991376 conn(0x7f1c040fb320 msgr2=0x7f1c040fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:31.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.422+0000 7f1c0a651640 1 -- 172.21.15.38:0/307991376 shutdown_connections 2024-09-13T18:32:31.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.422+0000 7f1c0a651640 1 -- 172.21.15.38:0/307991376 wait complete. 2024-09-13T18:32:31.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.422+0000 7f1c0a651640 1 Processor -- start 2024-09-13T18:32:31.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.422+0000 7f1c0a651640 1 -- start start 2024-09-13T18:32:31.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c0a651640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c040ffb90 0x7f1c041955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c0a651640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c04100d90 0x7f1c04195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c0a651640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c041960e0 con 0x7f1c040ffb90 2024-09-13T18:32:31.427 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c0a651640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c04196250 con 0x7f1c04100d90 2024-09-13T18:32:31.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c03fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c040ffb90 0x7f1c041955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c03fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c040ffb90 0x7f1c041955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50312/0 (socket says 172.21.15.38:50312) 2024-09-13T18:32:31.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c03fff640 1 -- 172.21.15.38:0/301004842 learned_addr learned my addr 172.21.15.38:0/301004842 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:32:31.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c037fe640 1 --2- 172.21.15.38:0/301004842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c04100d90 0x7f1c04195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c03fff640 1 -- 172.21.15.38:0/301004842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c04100d90 msgr2=0x7f1c04195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c03fff640 1 --2- 172.21.15.38:0/301004842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c04100d90 0x7f1c04195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c03fff640 1 -- 172.21.15.38:0/301004842 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf8009560 con 0x7f1c040ffb90 2024-09-13T18:32:31.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c037fe640 1 --2- 172.21.15.38:0/301004842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c04100d90 0x7f1c04195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:32:31.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c03fff640 1 --2- 172.21.15.38:0/301004842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c040ffb90 0x7f1c041955d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400d900 tx=0x7f1bf400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:31.428 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c017fa640 1 -- 172.21.15.38:0/301004842 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf4009c00 con 0x7f1c040ffb90 2024-09-13T18:32:31.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c0a651640 1 -- 172.21.15.38:0/301004842 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0419acf0 con 0x7f1c040ffb90 2024-09-13T18:32:31.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.423+0000 7f1c017fa640 1 -- 172.21.15.38:0/301004842 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1bf4009d60 con 0x7f1c040ffb90 2024-09-13T18:32:31.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.424+0000 7f1c017fa640 1 -- 172.21.15.38:0/301004842 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf400f5f0 con 0x7f1c040ffb90 2024-09-13T18:32:31.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.424+0000 7f1c0a651640 1 -- 172.21.15.38:0/301004842 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0419b260 con 0x7f1c040ffb90 2024-09-13T18:32:31.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.425+0000 7f1c0a651640 1 -- 172.21.15.38:0/301004842 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0418f5f0 con 0x7f1c040ffb90 2024-09-13T18:32:31.429 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.425+0000 7f1c017fa640 1 -- 172.21.15.38:0/301004842 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 31) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f1bf4010460 con 0x7f1c040ffb90 2024-09-13T18:32:31.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.425+0000 7f1c017fa640 1 --2- 172.21.15.38:0/301004842 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1bec06cd80 0x7f1bec06f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.426+0000 7f1c017fa640 1 -- 172.21.15.38:0/301004842 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1bf408c650 con 0x7f1c040ffb90 2024-09-13T18:32:31.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.426+0000 7f1c037fe640 1 --2- 172.21.15.38:0/301004842 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1bec06cd80 0x7f1bec06f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.430 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.426+0000 7f1c037fe640 1 --2- 172.21.15.38:0/301004842 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1bec06cd80 0x7f1bec06f240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8031460 tx=0x7f1bf8000bc0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:31.432 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.430+0000 7f1c017fa640 1 -- 172.21.15.38:0/301004842 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1bf4056550 con 0x7f1c040ffb90 2024-09-13T18:32:31.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 podman[76887]: 2024-09-13 18:32:31.237978524 +0000 UTC m=+0.369207867 container start 66ddd3b3914176146d35baecab1d3d4b743ee11a27550d94b0e64b5f85f5a3e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux ) 2024-09-13T18:32:31.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T18:32:31.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable), process ceph-mon, pid 2 2024-09-13T18:32:31.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: pidfile_write: ignore empty --pid-file 2024-09-13T18:32:31.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: load: jerasure load: lrc 2024-09-13T18:32:31.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: RocksDB version: 7.9.2 2024-09-13T18:32:31.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Git sha 0 2024-09-13T18:32:31.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Compile date 2024-09-10 12:59:06 2024-09-13T18:32:31.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: DB SUMMARY 2024-09-13T18:32:31.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: DB Session ID: BDM06ZXJKGMWCLX3P72K 2024-09-13T18:32:31.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: CURRENT file: CURRENT 2024-09-13T18:32:31.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T18:32:31.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1159 Bytes 2024-09-13T18:32:31.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi149/store.db dir, Total Num: 1, files: 000024.sst 2024-09-13T18:32:31.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi149/store.db: 000022.log size: 4601413 ; 2024-09-13T18:32:31.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.error_if_exists: 0 2024-09-13T18:32:31.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.create_if_missing: 0 2024-09-13T18:32:31.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.paranoid_checks: 1 2024-09-13T18:32:31.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T18:32:31.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T18:32:31.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T18:32:31.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.env: 0x55e0babf8bc0 2024-09-13T18:32:31.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T18:32:31.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.info_log: 0x55e0bca6edc0 2024-09-13T18:32:31.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T18:32:31.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.statistics: (nil) 2024-09-13T18:32:31.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.use_fsync: 0 2024-09-13T18:32:31.523 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_log_file_size: 0 2024-09-13T18:32:31.523 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T18:32:31.523 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T18:32:31.523 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T18:32:31.523 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T18:32:31.523 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.allow_fallocate: 1 2024-09-13T18:32:31.525 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T18:32:31.525 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T18:32:31.525 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.use_direct_reads: 0 2024-09-13T18:32:31.525 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T18:32:31.525 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T18:32:31.525 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.db_log_dir: 2024-09-13T18:32:31.525 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.wal_dir: 2024-09-13T18:32:31.525 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T18:32:31.525 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T18:32:31.526 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T18:32:31.526 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T18:32:31.526 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T18:32:31.526 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T18:32:31.526 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T18:32:31.526 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T18:32:31.526 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.write_buffer_manager: 0x55e0bca7c320 2024-09-13T18:32:31.526 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T18:32:31.526 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T18:32:31.526 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T18:32:31.526 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T18:32:31.527 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T18:32:31.527 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T18:32:31.527 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T18:32:31.527 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T18:32:31.527 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.unordered_write: 0 2024-09-13T18:32:31.527 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T18:32:31.528 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T18:32:31.528 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T18:32:31.528 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T18:32:31.528 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.row_cache: None 2024-09-13T18:32:31.528 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.wal_filter: None 2024-09-13T18:32:31.528 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T18:32:31.528 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T18:32:31.528 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.two_write_queues: 0 2024-09-13T18:32:31.528 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T18:32:31.528 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.wal_compression: 0 2024-09-13T18:32:31.529 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.atomic_flush: 0 2024-09-13T18:32:31.529 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T18:32:31.529 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T18:32:31.529 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T18:32:31.529 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.log_readahead_size: 0 2024-09-13T18:32:31.529 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T18:32:31.529 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T18:32:31.529 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T18:32:31.529 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T18:32:31.529 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T18:32:31.529 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T18:32:31.529 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T18:32:31.530 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_background_jobs: 2 2024-09-13T18:32:31.530 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_background_compactions: -1 2024-09-13T18:32:31.530 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_subcompactions: 1 2024-09-13T18:32:31.530 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T18:32:31.530 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T18:32:31.530 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T18:32:31.530 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T18:32:31.530 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T18:32:31.530 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T18:32:31.530 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T18:32:31.530 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T18:32:31.530 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_open_files: -1 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_background_flushes: -1 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Compression algorithms supported: 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: kZSTD supported: 0 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: kXpressCompression supported: 0 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: kBZip2Compression supported: 0 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: kLZ4Compression supported: 1 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: kZlibCompression supported: 1 2024-09-13T18:32:31.531 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T18:32:31.532 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: kSnappyCompression supported: 1 2024-09-13T18:32:31.532 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T18:32:31.532 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T18:32:31.532 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi149/store.db/MANIFEST-000010 2024-09-13T18:32:31.532 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T18:32:31.532 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T18:32:31.532 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.merge_operator: 2024-09-13T18:32:31.532 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_filter: None 2024-09-13T18:32:31.532 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T18:32:31.532 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T18:32:31.533 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T18:32:31.533 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T18:32:31.533 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e0bca6ea20) 2024-09-13T18:32:31.533 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: cache_index_and_filter_blocks: 1 2024-09-13T18:32:31.533 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T18:32:31.533 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T18:32:31.533 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: pin_top_level_index_and_filter: 1 2024-09-13T18:32:31.533 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_type: 0 2024-09-13T18:32:31.534 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_block_index_type: 0 2024-09-13T18:32:31.534 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_shortening: 1 2024-09-13T18:32:31.534 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T18:32:31.534 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: checksum: 4 2024-09-13T18:32:31.534 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: no_block_cache: 0 2024-09-13T18:32:31.534 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache: 0x55e0bca631f0 2024-09-13T18:32:31.534 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_name: BinnedLRUCache 2024-09-13T18:32:31.534 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_options: 2024-09-13T18:32:31.534 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: capacity : 536870912 2024-09-13T18:32:31.534 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: num_shard_bits : 4 2024-09-13T18:32:31.534 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: strict_capacity_limit : 0 2024-09-13T18:32:31.535 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: high_pri_pool_ratio: 0.000 2024-09-13T18:32:31.535 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_cache_compressed: (nil) 2024-09-13T18:32:31.535 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: persistent_cache: (nil) 2024-09-13T18:32:31.535 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_size: 4096 2024-09-13T18:32:31.535 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_size_deviation: 10 2024-09-13T18:32:31.535 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_restart_interval: 16 2024-09-13T18:32:31.535 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: index_block_restart_interval: 1 2024-09-13T18:32:31.535 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: metadata_block_size: 4096 2024-09-13T18:32:31.535 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: partition_filters: 0 2024-09-13T18:32:31.535 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: use_delta_encoding: 1 2024-09-13T18:32:31.535 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: filter_policy: bloomfilter 2024-09-13T18:32:31.536 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: whole_key_filtering: 1 2024-09-13T18:32:31.536 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: verify_compression: 0 2024-09-13T18:32:31.536 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: read_amp_bytes_per_bit: 0 2024-09-13T18:32:31.536 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: format_version: 5 2024-09-13T18:32:31.536 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: enable_index_compression: 1 2024-09-13T18:32:31.536 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: block_align: 0 2024-09-13T18:32:31.536 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_auto_readahead_size: 262144 2024-09-13T18:32:31.536 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: prepopulate_block_cache: 0 2024-09-13T18:32:31.536 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: initial_auto_readahead_size: 8192 2024-09-13T18:32:31.536 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T18:32:31.536 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T18:32:31.536 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T18:32:31.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compression: NoCompression 2024-09-13T18:32:31.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T18:32:31.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T18:32:31.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T18:32:31.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.num_levels: 7 2024-09-13T18:32:31.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T18:32:31.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T18:32:31.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T18:32:31.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T18:32:31.537 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T18:32:31.538 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T18:32:31.538 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T18:32:31.538 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T18:32:31.538 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T18:32:31.538 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T18:32:31.538 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T18:32:31.539 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T18:32:31.539 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T18:32:31.539 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T18:32:31.539 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T18:32:31.539 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T18:32:31.539 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T18:32:31.539 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T18:32:31.539 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T18:32:31.540 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T18:32:31.540 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T18:32:31.540 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T18:32:31.540 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T18:32:31.540 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T18:32:31.540 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T18:32:31.540 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T18:32:31.540 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T18:32:31.540 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T18:32:31.540 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T18:32:31.540 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T18:32:31.540 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T18:32:31.541 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T18:32:31.542 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T18:32:31.542 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T18:32:31.542 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T18:32:31.542 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T18:32:31.542 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T18:32:31.542 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T18:32:31.542 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T18:32:31.542 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T18:32:31.542 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.inplace_update_support: 0 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.bloom_locality: 0 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.max_successive_merges: 0 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.ttl: 2592000 2024-09-13T18:32:31.543 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.enable_blob_files: false 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.min_blob_size: 0 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T18:32:31.544 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi149/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 26, last_sequence is 10190, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 22 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1b4a73f2-624c-4634-8cd4-cff87cd2b297 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726252351264477, "job": 1, "event": "recovery_started", "wal_files": [22]} 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726252351275088, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 2759280, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10195, "largest_seqno": 11817, "table_properties": {"data_size": 2751719, "index_size": 4852, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1669, "raw_key_size": 14700, "raw_average_key_size": 22, "raw_value_size": 2737472, "raw_average_value_size": 4244, "num_data_blocks": 222, "num_entries": 645, "num_filter_entries": 645, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726252351, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1b4a73f2-624c-4634-8cd4-cff87cd2b297", "db_session_id": "BDM06ZXJKGMWCLX3P72K", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726252351275215, "job": 1, "event": "recovery_finished"} 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi149/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e0bca8ee00 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: DB pointer 0x55e0bcb82000 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T18:32:31.545 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** DB Stats ** 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** Compaction Stats [default] ** 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: L0 1/0 2.63 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 606.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T18:32:31.546 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: L6 1/0 5.23 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Sum 2/0 7.86 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 606.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 606.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** Compaction Stats [default] ** 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 606.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T18:32:31.547 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Cumulative compaction: 0.00 GB write, 173.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Interval compaction: 0.00 GB write, 173.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Block cache BinnedLRUCache@0x55e0bca631f0#2 capacity: 512.00 MB usage: 6.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: starting mon.smithi149 rank 1 at public addrs [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] at bind addrs [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi149 fsid ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: mon.smithi149@-1(???) e2 preinit fsid ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: mon.smithi149@-1(???).mds e18 new map 2024-09-13T18:32:31.548 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: mon.smithi149@-1(???).mds e18 print_map 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: e18 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: legacy client fscid: 1 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: Filesystem 'cephfs' (1) 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: fs_name cephfs 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: epoch 18 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: tableserver 0 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: root 0 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: session_timeout 60 2024-09-13T18:32:31.549 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: session_autoclose 300 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_file_size 1099511627776 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_xattr_size 65536 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: required_client_features {} 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: last_failure 0 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: last_failure_osd_epoch 47 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: max_mds 2 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: in 0,1 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: up {0=14484,1=24275} 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: failed 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: damaged 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: stopped 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: data_pools [3] 2024-09-13T18:32:31.550 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: metadata_pool 2 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: inline_data disabled 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: balancer 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: bal_rank_mask -1 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: standby_count_wanted 1 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: [mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: [mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: [mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: [mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout: 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: mon.smithi149@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: mon.smithi149@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: mon.smithi149@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T18:32:31.551 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: mon.smithi149@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T18:32:31.552 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 ceph-mon[76906]: mon.smithi149@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-13T18:32:31.552 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 bash[76887]: 66ddd3b3914176146d35baecab1d3d4b743ee11a27550d94b0e64b5f85f5a3e1 2024-09-13T18:32:31.552 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:31 smithi149 systemd[1]: Started Ceph mon.smithi149 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:32:31.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.640+0000 7f1c0a651640 1 -- 172.21.15.38:0/301004842 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1c0402c4e0 con 0x7f1c040ffb90 2024-09-13T18:32:31.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.640+0000 7f1c017fa640 1 -- 172.21.15.38:0/301004842 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7f1bf4059b70 con 0x7f1c040ffb90 2024-09-13T18:32:31.643 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:32:31.643 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:32:31.643 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:32:31.643 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:32:31.643 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:32:31.644 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:32:31.645 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:32:31.646 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:32:31.646 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:32:31.646 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:32:31.646 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:32:31.646 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:32:31.647 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:32:31.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.643+0000 7f1c0a651640 1 -- 172.21.15.38:0/301004842 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1bec06cd80 msgr2=0x7f1bec06f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.643+0000 7f1c0a651640 1 --2- 172.21.15.38:0/301004842 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1bec06cd80 0x7f1bec06f240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8031460 tx=0x7f1bf8000bc0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.643+0000 7f1c0a651640 1 -- 172.21.15.38:0/301004842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c040ffb90 msgr2=0x7f1c041955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.643+0000 7f1c0a651640 1 --2- 172.21.15.38:0/301004842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c040ffb90 0x7f1c041955d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400d900 tx=0x7f1bf400ddc0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.643+0000 7f1c0a651640 1 -- 172.21.15.38:0/301004842 shutdown_connections 2024-09-13T18:32:31.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.643+0000 7f1c0a651640 1 --2- 172.21.15.38:0/301004842 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1bec06cd80 0x7f1bec06f240 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.643+0000 7f1c0a651640 1 --2- 172.21.15.38:0/301004842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c04100d90 0x7f1c04195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.643+0000 7f1c0a651640 1 --2- 172.21.15.38:0/301004842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c040ffb90 0x7f1c041955d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.643+0000 7f1c0a651640 1 -- 172.21.15.38:0/301004842 >> 172.21.15.38:0/301004842 conn(0x7f1c040fb320 msgr2=0x7f1c04104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:31.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.643+0000 7f1c0a651640 1 -- 172.21.15.38:0/301004842 shutdown_connections 2024-09-13T18:32:31.647 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.643+0000 7f1c0a651640 1 -- 172.21.15.38:0/301004842 wait complete. 2024-09-13T18:32:31.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.729+0000 7f5acad5d640 1 -- 172.21.15.38:0/1264952830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac40feaf0 msgr2=0x7f5ac40feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.729+0000 7f5acad5d640 1 --2- 172.21.15.38:0/1264952830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac40feaf0 0x7f5ac40feef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4009880 tx=0x7f5ab402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.729+0000 7f5acad5d640 1 -- 172.21.15.38:0/1264952830 shutdown_connections 2024-09-13T18:32:31.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.729+0000 7f5acad5d640 1 --2- 172.21.15.38:0/1264952830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ac40ffcf0 0x7f5ac4100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.732 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.729+0000 7f5acad5d640 1 --2- 172.21.15.38:0/1264952830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac40feaf0 0x7f5ac40feef0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.729+0000 7f5acad5d640 1 -- 172.21.15.38:0/1264952830 >> 172.21.15.38:0/1264952830 conn(0x7f5ac40fa280 msgr2=0x7f5ac40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:31.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.729+0000 7f5acad5d640 1 -- 172.21.15.38:0/1264952830 shutdown_connections 2024-09-13T18:32:31.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.729+0000 7f5acad5d640 1 -- 172.21.15.38:0/1264952830 wait complete. 2024-09-13T18:32:31.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.730+0000 7f5acad5d640 1 Processor -- start 2024-09-13T18:32:31.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.730+0000 7f5acad5d640 1 -- start start 2024-09-13T18:32:31.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.730+0000 7f5acad5d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ac40feaf0 0x7f5ac4102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.730+0000 7f5acad5d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac40ffcf0 0x7f5ac41010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.730+0000 7f5acad5d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac4101610 con 0x7f5ac40ffcf0 2024-09-13T18:32:31.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.730+0000 7f5acad5d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac4101780 con 0x7f5ac40feaf0 2024-09-13T18:32:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.730+0000 7f5ac3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac40ffcf0 0x7f5ac41010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.730+0000 7f5ac3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac40ffcf0 0x7f5ac41010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50322/0 (socket says 172.21.15.38:50322) 2024-09-13T18:32:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.730+0000 7f5ac8af9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ac40feaf0 0x7f5ac4102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.730+0000 7f5ac3fff640 1 -- 172.21.15.38:0/2400061808 learned_addr learned my addr 172.21.15.38:0/2400061808 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:32:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.730+0000 7f5ac8af9640 1 -- 172.21.15.38:0/2400061808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ac40feaf0 msgr2=0x7f5ac4102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T18:32:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.730+0000 7f5ac8af9640 1 -- 172.21.15.38:0/2400061808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ac40feaf0 msgr2=0x7f5ac4102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:32:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.731+0000 7f5ac8af9640 1 --2- 172.21.15.38:0/2400061808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ac40feaf0 0x7f5ac4102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:32:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.731+0000 7f5ac8af9640 1 --2- 172.21.15.38:0/2400061808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ac40feaf0 0x7f5ac4102a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:32:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.731+0000 7f5ac3fff640 1 -- 172.21.15.38:0/2400061808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ac40feaf0 msgr2=0x7f5ac4102a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:32:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.731+0000 7f5ac3fff640 1 --2- 172.21.15.38:0/2400061808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ac40feaf0 0x7f5ac4102a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.731+0000 7f5ac3fff640 1 -- 172.21.15.38:0/2400061808 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab4009560 con 0x7f5ac40ffcf0 2024-09-13T18:32:31.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.731+0000 7f5ac3fff640 1 --2- 172.21.15.38:0/2400061808 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac40ffcf0 0x7f5ac41010d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800d8d0 tx=0x7f5ab800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:31.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.731+0000 7f5ac1ffb640 1 -- 172.21.15.38:0/2400061808 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ab800bea0 con 0x7f5ac40ffcf0 2024-09-13T18:32:31.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.731+0000 7f5ac1ffb640 1 -- 172.21.15.38:0/2400061808 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ab8009c00 con 0x7f5ac40ffcf0 2024-09-13T18:32:31.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.731+0000 7f5acad5d640 1 -- 172.21.15.38:0/2400061808 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac4101a60 con 0x7f5ac40ffcf0 2024-09-13T18:32:31.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.731+0000 7f5ac1ffb640 1 -- 172.21.15.38:0/2400061808 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ab800f680 con 0x7f5ac40ffcf0 2024-09-13T18:32:31.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.731+0000 7f5acad5d640 1 -- 172.21.15.38:0/2400061808 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac419d630 con 0x7f5ac40ffcf0 2024-09-13T18:32:31.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.732+0000 7f5acad5d640 1 -- 172.21.15.38:0/2400061808 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac40feef0 con 0x7f5ac40ffcf0 2024-09-13T18:32:31.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.733+0000 7f5ac1ffb640 1 -- 172.21.15.38:0/2400061808 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 31) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f5ab8010460 con 0x7f5ac40ffcf0 2024-09-13T18:32:31.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.733+0000 7f5ac1ffb640 1 --2- 172.21.15.38:0/2400061808 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5aac06cd90 0x7f5aac06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:31.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.733+0000 7f5ac1ffb640 1 -- 172.21.15.38:0/2400061808 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5ab808c4a0 con 0x7f5ac40ffcf0 2024-09-13T18:32:31.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.733+0000 7f5ac8af9640 1 --2- 172.21.15.38:0/2400061808 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5aac06cd90 0x7f5aac06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:31.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.734+0000 7f5ac8af9640 1 --2- 172.21.15.38:0/2400061808 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5aac06cd90 0x7f5aac06f250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4000c00 tx=0x7f5ab4031420 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:31.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.738+0000 7f5ac1ffb640 1 -- 172.21.15.38:0/2400061808 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5ab8059eb0 con 0x7f5ac40ffcf0 2024-09-13T18:32:31.929 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.927+0000 7f5acad5d640 1 -- 172.21.15.38:0/2400061808 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ac40fc4a0 con 0x7f5aac06cd90 2024-09-13T18:32:31.930 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.928+0000 7f5ac1ffb640 1 -- 172.21.15.38:0/2400061808 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f5ac40fc4a0 con 0x7f5aac06cd90 2024-09-13T18:32:31.930 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:32:31.931 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:32:31.931 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:32:31.931 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:32:31.931 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:32:31.931 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr" 2024-09-13T18:32:31.931 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:32:31.931 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "3/23 daemons upgraded", 2024-09-13T18:32:31.931 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T18:32:31.931 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:32:31.931 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:32:31.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.930+0000 7f5acad5d640 1 -- 172.21.15.38:0/2400061808 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5aac06cd90 msgr2=0x7f5aac06f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.930+0000 7f5acad5d640 1 --2- 172.21.15.38:0/2400061808 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5aac06cd90 0x7f5aac06f250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4000c00 tx=0x7f5ab4031420 comp rx=0 tx=0).stop 2024-09-13T18:32:31.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.930+0000 7f5acad5d640 1 -- 172.21.15.38:0/2400061808 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac40ffcf0 msgr2=0x7f5ac41010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:31.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.930+0000 7f5acad5d640 1 --2- 172.21.15.38:0/2400061808 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac40ffcf0 0x7f5ac41010d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800d8d0 tx=0x7f5ab800dd90 comp rx=0 tx=0).stop 2024-09-13T18:32:31.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.930+0000 7f5acad5d640 1 -- 172.21.15.38:0/2400061808 shutdown_connections 2024-09-13T18:32:31.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.930+0000 7f5acad5d640 1 --2- 172.21.15.38:0/2400061808 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ac40ffcf0 0x7f5ac41010d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.930+0000 7f5acad5d640 1 --2- 172.21.15.38:0/2400061808 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5aac06cd90 0x7f5aac06f250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.930+0000 7f5acad5d640 1 --2- 172.21.15.38:0/2400061808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ac40feaf0 0x7f5ac4102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:31.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.930+0000 7f5acad5d640 1 -- 172.21.15.38:0/2400061808 >> 172.21.15.38:0/2400061808 conn(0x7f5ac40fa280 msgr2=0x7f5ac40fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:31.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.930+0000 7f5acad5d640 1 -- 172.21.15.38:0/2400061808 shutdown_connections 2024-09-13T18:32:31.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:31.930+0000 7f5acad5d640 1 -- 172.21.15.38:0/2400061808 wait complete. 2024-09-13T18:32:32.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.017+0000 7fad33e31640 1 -- 172.21.15.38:0/1081922785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c0ffcf0 msgr2=0x7fad2c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:32.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.017+0000 7fad33e31640 1 --2- 172.21.15.38:0/1081922785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c0ffcf0 0x7fad2c100170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009880 tx=0x7fad1c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.017+0000 7fad33e31640 1 -- 172.21.15.38:0/1081922785 shutdown_connections 2024-09-13T18:32:32.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.017+0000 7fad33e31640 1 --2- 172.21.15.38:0/1081922785 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c0ffcf0 0x7fad2c100170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.017+0000 7fad33e31640 1 --2- 172.21.15.38:0/1081922785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad2c0feaf0 0x7fad2c0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.017+0000 7fad33e31640 1 -- 172.21.15.38:0/1081922785 >> 172.21.15.38:0/1081922785 conn(0x7fad2c0fa280 msgr2=0x7fad2c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:32.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.017+0000 7fad33e31640 1 -- 172.21.15.38:0/1081922785 shutdown_connections 2024-09-13T18:32:32.020 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.017+0000 7fad33e31640 1 -- 172.21.15.38:0/1081922785 wait complete. 2024-09-13T18:32:32.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad33e31640 1 Processor -- start 2024-09-13T18:32:32.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad33e31640 1 -- start start 2024-09-13T18:32:32.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad33e31640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c0feaf0 0x7fad2c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad33e31640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad2c0ffcf0 0x7fad2c19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad33e31640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c19a880 con 0x7fad2c0feaf0 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad33e31640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c19a9f0 con 0x7fad2c0ffcf0 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad31bcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c0feaf0 0x7fad2c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad31bcd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c0feaf0 0x7fad2c0687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50352/0 (socket says 172.21.15.38:50352) 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad31bcd640 1 -- 172.21.15.38:0/2707623425 learned_addr learned my addr 172.21.15.38:0/2707623425 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad313cc640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad2c0ffcf0 0x7fad2c19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad313cc640 1 -- 172.21.15.38:0/2707623425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad2c0ffcf0 msgr2=0x7fad2c19a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad313cc640 1 -- 172.21.15.38:0/2707623425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad2c0ffcf0 msgr2=0x7fad2c19a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad313cc640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad2c0ffcf0 0x7fad2c19a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.018+0000 7fad313cc640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad2c0ffcf0 0x7fad2c19a2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.019+0000 7fad31bcd640 1 -- 172.21.15.38:0/2707623425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad2c0ffcf0 msgr2=0x7fad2c19a2b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:32:32.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.019+0000 7fad31bcd640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad2c0ffcf0 0x7fad2c19a2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.019+0000 7fad31bcd640 1 -- 172.21.15.38:0/2707623425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c009560 con 0x7fad2c0feaf0 2024-09-13T18:32:32.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.019+0000 7fad31bcd640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c0feaf0 0x7fad2c0687d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fad2800d6f0 tx=0x7fad2800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:32.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.019+0000 7fad22ffd640 1 -- 172.21.15.38:0/2707623425 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad28009a30 con 0x7fad2c0feaf0 2024-09-13T18:32:32.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.019+0000 7fad22ffd640 1 -- 172.21.15.38:0/2707623425 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad280044c0 con 0x7fad2c0feaf0 2024-09-13T18:32:32.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.019+0000 7fad33e31640 1 -- 172.21.15.38:0/2707623425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2c19acd0 con 0x7fad2c0feaf0 2024-09-13T18:32:32.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.019+0000 7fad22ffd640 1 -- 172.21.15.38:0/2707623425 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad28003d60 con 0x7fad2c0feaf0 2024-09-13T18:32:32.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.019+0000 7fad33e31640 1 -- 172.21.15.38:0/2707623425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2c19b1c0 con 0x7fad2c0feaf0 2024-09-13T18:32:32.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.020+0000 7fad33e31640 1 -- 172.21.15.38:0/2707623425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c18e530 con 0x7fad2c0feaf0 2024-09-13T18:32:32.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.021+0000 7fad22ffd640 1 -- 172.21.15.38:0/2707623425 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 31) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fad28009b90 con 0x7fad2c0feaf0 2024-09-13T18:32:32.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.021+0000 7fad22ffd640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fad1806cd90 0x7fad1806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:32:32.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.022+0000 7fad22ffd640 1 -- 172.21.15.38:0/2707623425 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fad2808c170 con 0x7fad2c0feaf0 2024-09-13T18:32:32.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.022+0000 7fad313cc640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fad1806cd90 0x7fad1806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:32:32.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.022+0000 7fad313cc640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fad1806cd90 0x7fad1806f250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad2c068550 tx=0x7fad1c031420 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:32:32.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.026+0000 7fad22ffd640 1 -- 172.21.15.38:0/2707623425 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fad280560f0 con 0x7fad2c0feaf0 2024-09-13T18:32:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.265+0000 7fad33e31640 1 -- 172.21.15.38:0/2707623425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fad2c1075a0 con 0x7fad2c0feaf0 2024-09-13T18:32:32.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.266+0000 7fad22ffd640 1 -- 172.21.15.38:0/2707623425 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fad28059710 con 0x7fad2c0feaf0 2024-09-13T18:32:32.268 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:32:32.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.268+0000 7fad33e31640 1 -- 172.21.15.38:0/2707623425 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fad1806cd90 msgr2=0x7fad1806f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.268+0000 7fad33e31640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fad1806cd90 0x7fad1806f250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad2c068550 tx=0x7fad1c031420 comp rx=0 tx=0).stop 2024-09-13T18:32:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.268+0000 7fad33e31640 1 -- 172.21.15.38:0/2707623425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c0feaf0 msgr2=0x7fad2c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:32:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.268+0000 7fad33e31640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c0feaf0 0x7fad2c0687d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fad2800d6f0 tx=0x7fad2800dbb0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.268+0000 7fad33e31640 1 -- 172.21.15.38:0/2707623425 shutdown_connections 2024-09-13T18:32:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.268+0000 7fad33e31640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fad1806cd90 0x7fad1806f250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.268+0000 7fad33e31640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad2c0ffcf0 0x7fad2c19a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.268+0000 7fad33e31640 1 --2- 172.21.15.38:0/2707623425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fad2c0feaf0 0x7fad2c0687d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:32:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.268+0000 7fad33e31640 1 -- 172.21.15.38:0/2707623425 >> 172.21.15.38:0/2707623425 conn(0x7fad2c0fa280 msgr2=0x7fad2c103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:32:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.268+0000 7fad33e31640 1 -- 172.21.15.38:0/2707623425 shutdown_connections 2024-09-13T18:32:32.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:32:32.268+0000 7fad33e31640 1 -- 172.21.15.38:0/2707623425 wait complete. 2024-09-13T18:32:33.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:32 smithi149 ceph-mon[76906]: pgmap v44: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 284 KiB/s rd, 191 KiB/s wr, 60 op/s 2024-09-13T18:32:33.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:32 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:32:33.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:32 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:32:33.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:32 smithi038 ceph-mon[91522]: pgmap v44: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 284 KiB/s rd, 191 KiB/s wr, 60 op/s 2024-09-13T18:32:33.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:32 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi038"}]: dispatch 2024-09-13T18:32:33.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:32 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mon metadata", "id": "smithi149"}]: dispatch 2024-09-13T18:32:34.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: pgmap v45: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.2 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-13T18:32:34.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:32:34.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:32:34.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:32:34.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1232263217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:34.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/301004842' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:32:34.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:32:34.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2707623425' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:32:34.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: pgmap v46: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.2 KiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-13T18:32:34.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: mon.smithi149 calling monitor election 2024-09-13T18:32:34.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: mon.smithi038 calling monitor election 2024-09-13T18:32:34.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: mon.smithi038 is new leader, mons smithi038,smithi149 in quorum (ranks 0,1) 2024-09-13T18:32:34.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: monmap e2: 2 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0],smithi149=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:32:34.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: fsmap cephfs:2 {0=cephfs.smithi038.dtnkqo=up:active,1=cephfs.smithi149.doanhj=up:active} 2 up:standby-replay 2024-09-13T18:32:34.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T18:32:34.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: mgrmap e31: smithi038.jeygoq(active, since 86s), standbys: smithi149.eabzne 2024-09-13T18:32:34.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: overall HEALTH_OK 2024-09-13T18:32:34.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:34.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:34.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:33 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:34.117 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: pgmap v45: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.2 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-13T18:32:34.117 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:32:34.117 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:32:34.117 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:32:34.117 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1232263217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:34.117 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/301004842' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:32:34.117 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2707623425' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: pgmap v46: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 6.2 KiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: mon.smithi149 calling monitor election 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: mon.smithi038 calling monitor election 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: mon.smithi038 is new leader, mons smithi038,smithi149 in quorum (ranks 0,1) 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: monmap e2: 2 mons at {smithi038=[v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0],smithi149=[v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: fsmap cephfs:2 {0=cephfs.smithi038.dtnkqo=up:active,1=cephfs.smithi149.doanhj=up:active} 2 up:standby-replay 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: osdmap e49: 6 total, 6 up, 6 in 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: mgrmap e31: smithi038.jeygoq(active, since 86s), standbys: smithi149.eabzne 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: overall HEALTH_OK 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:34.118 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:33 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:36.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:35 smithi038 ceph-mon[91522]: pgmap v47: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-13T18:32:36.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:35 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:36.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:35 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:36.265 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:35 smithi149 ceph-mon[76906]: pgmap v47: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-13T18:32:36.265 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:35 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:36.265 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:35 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:37.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:37.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:37.203 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:32:37.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:37.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:37.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:32:38.247 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:37 smithi149 ceph-mon[76906]: pgmap v48: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T18:32:38.247 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:37 smithi149 ceph-mon[76906]: mgrmap e32: smithi038.jeygoq(active, since 90s), standbys: smithi149.eabzne 2024-09-13T18:32:38.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:37 smithi038 ceph-mon[91522]: pgmap v48: 65 pgs: 65 active+clean; 210 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T18:32:38.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:37 smithi038 ceph-mon[91522]: mgrmap e32: smithi038.jeygoq(active, since 90s), standbys: smithi149.eabzne 2024-09-13T18:32:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:38 smithi149 ceph-mon[76906]: pgmap v49: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-13T18:32:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:38 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:38 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:38 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:38 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:32:39.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:38 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:39.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:38 smithi038 ceph-mon[91522]: pgmap v49: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-13T18:32:39.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:38 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:39.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:38 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:39.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:38 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:39.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:38 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:32:39.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:38 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:40.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:39 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:40.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:39 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:40.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:39 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:40.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:39 smithi149 ceph-mon[76906]: Upgrade: Setting container_image for all mon 2024-09-13T18:32:40.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:39 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:40.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:39 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi038"}]: dispatch 2024-09-13T18:32:40.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:39 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi038"}]': finished 2024-09-13T18:32:40.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:39 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi149"}]: dispatch 2024-09-13T18:32:40.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:39 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi149"}]': finished 2024-09-13T18:32:40.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:39 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:40.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:39 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:40.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:39 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:40.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:39 smithi038 ceph-mon[91522]: Upgrade: Setting container_image for all mon 2024-09-13T18:32:40.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:39 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:40.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:39 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi038"}]: dispatch 2024-09-13T18:32:40.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:39 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi038"}]': finished 2024-09-13T18:32:40.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:39 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi149"}]: dispatch 2024-09-13T18:32:40.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:39 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi149"}]': finished 2024-09-13T18:32:41.740 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:41 smithi038 ceph-mon[91522]: pgmap v50: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-13T18:32:41.740 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:41 smithi038 ceph-mon[91522]: Upgrade: Updating crash.smithi038 (1/2) 2024-09-13T18:32:41.740 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:41.740 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T18:32:41.740 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:41.741 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:41 smithi038 ceph-mon[91522]: Deploying daemon crash.smithi038 on smithi038 2024-09-13T18:32:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:41 smithi149 ceph-mon[76906]: pgmap v50: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-13T18:32:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:41 smithi149 ceph-mon[76906]: Upgrade: Updating crash.smithi038 (1/2) 2024-09-13T18:32:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi038", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T18:32:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:41 smithi149 ceph-mon[76906]: Deploying daemon crash.smithi038 on smithi038 2024-09-13T18:32:43.705 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:43 smithi038 ceph-mon[91522]: pgmap v51: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-13T18:32:43.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:43 smithi149 ceph-mon[76906]: pgmap v51: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-13T18:32:45.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:44 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:45.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:44 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:45.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:44 smithi149 ceph-mon[76906]: pgmap v52: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-13T18:32:45.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:44 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:45.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:44 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:45.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:44 smithi038 ceph-mon[91522]: pgmap v52: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-13T18:32:46.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:46 smithi149 ceph-mon[76906]: Upgrade: Updating crash.smithi149 (2/2) 2024-09-13T18:32:46.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:46 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:46.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:46 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T18:32:46.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:46 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:46.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:46 smithi149 ceph-mon[76906]: Deploying daemon crash.smithi149 on smithi149 2024-09-13T18:32:46.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:46 smithi038 ceph-mon[91522]: Upgrade: Updating crash.smithi149 (2/2) 2024-09-13T18:32:46.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:46 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:46.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:46 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi149", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T18:32:46.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:46 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:46.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:46 smithi038 ceph-mon[91522]: Deploying daemon crash.smithi149 on smithi149 2024-09-13T18:32:47.371 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:47 smithi149 ceph-mon[76906]: pgmap v53: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-13T18:32:47.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:47 smithi038 ceph-mon[91522]: pgmap v53: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-13T18:32:50.013 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:49 smithi038 ceph-mon[91522]: pgmap v54: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T18:32:50.013 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:49 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:50.013 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:49 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:50.013 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:49 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:49 smithi149 ceph-mon[76906]: pgmap v54: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T18:32:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:49 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:49 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:49 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:51.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:51 smithi038 ceph-mon[91522]: pgmap v55: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:32:51.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:51.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:51.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:32:52.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:51 smithi149 ceph-mon[76906]: pgmap v55: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:32:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:32:53.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:52 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:53.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:52 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:53.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:52 smithi149 ceph-mon[76906]: pgmap v56: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 4 op/s 2024-09-13T18:32:53.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:52 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:53.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:52 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:53.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:52 smithi038 ceph-mon[91522]: pgmap v56: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 4 op/s 2024-09-13T18:32:54.758 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:54 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:54.758 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:54 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:54.758 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:54 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:54.759 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:54 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:54.908 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:54 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:54.908 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:54 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:54.908 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:54 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:54.908 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:54 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:55.824 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:55 smithi038 ceph-mon[91522]: pgmap v57: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:32:55.824 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:55 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:55.825 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:55 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:56.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:55 smithi149 ceph-mon[76906]: pgmap v57: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:32:56.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:55 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:56.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:55 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:57.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:57 smithi149 ceph-mon[76906]: pgmap v58: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:32:57.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:57 smithi038 ceph-mon[91522]: pgmap v58: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:32:58.770 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:58.770 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:58.770 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:58.770 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:32:58.770 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:58.770 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:58.770 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:58.770 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:58.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:58.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: Upgrade: Setting container_image for all crash 2024-09-13T18:32:58.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:58.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi038"}]: dispatch 2024-09-13T18:32:58.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi038"}]': finished 2024-09-13T18:32:58.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi149"}]: dispatch 2024-09-13T18:32:58.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi149"}]': finished 2024-09-13T18:32:58.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T18:32:58.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T18:32:58.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:58 smithi038 ceph-mon[91522]: Upgrade: osd.0 is safe to restart 2024-09-13T18:32:59.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:59.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:59.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:32:59.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:32:59.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:59.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:32:59.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:59.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:59.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:32:59.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: Upgrade: Setting container_image for all crash 2024-09-13T18:32:59.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:32:59.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi038"}]: dispatch 2024-09-13T18:32:59.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi038"}]': finished 2024-09-13T18:32:59.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi149"}]: dispatch 2024-09-13T18:32:59.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi149"}]': finished 2024-09-13T18:32:59.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T18:32:59.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T18:32:59.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:58 smithi149 ceph-mon[76906]: Upgrade: osd.0 is safe to restart 2024-09-13T18:33:00.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:59 smithi038 ceph-mon[91522]: pgmap v59: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:33:00.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:00.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T18:33:00.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:32:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:33:00.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:59 smithi149 ceph-mon[76906]: pgmap v59: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:33:00.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:00.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T18:33:00.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:32:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:33:00.948 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:00 smithi038 ceph-mon[91522]: Upgrade: Updating osd.0 2024-09-13T18:33:00.948 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:00 smithi038 ceph-mon[91522]: Deploying daemon osd.0 on smithi038 2024-09-13T18:33:01.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:00 smithi149 ceph-mon[76906]: Upgrade: Updating osd.0 2024-09-13T18:33:01.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:00 smithi149 ceph-mon[76906]: Deploying daemon osd.0 on smithi038 2024-09-13T18:33:02.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:01 smithi038 ceph-mon[91522]: pgmap v60: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:33:02.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:01 smithi149 ceph-mon[76906]: pgmap v60: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:33:02.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.360+0000 7f52f6056640 1 -- 172.21.15.38:0/1229504795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00744e0 msgr2=0x7f52f0072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.360+0000 7f52f6056640 1 --2- 172.21.15.38:0/1229504795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00744e0 0x7f52f0072940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009880 tx=0x7f52e002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.360+0000 7f52f6056640 1 -- 172.21.15.38:0/1229504795 shutdown_connections 2024-09-13T18:33:02.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.360+0000 7f52f6056640 1 --2- 172.21.15.38:0/1229504795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f0072f10 0x7f52f0073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.360+0000 7f52f6056640 1 --2- 172.21.15.38:0/1229504795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00744e0 0x7f52f0072940 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.360+0000 7f52f6056640 1 -- 172.21.15.38:0/1229504795 >> 172.21.15.38:0/1229504795 conn(0x7f52f00fb310 msgr2=0x7f52f00fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.360+0000 7f52f6056640 1 -- 172.21.15.38:0/1229504795 shutdown_connections 2024-09-13T18:33:02.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.360+0000 7f52f6056640 1 -- 172.21.15.38:0/1229504795 wait complete. 2024-09-13T18:33:02.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.361+0000 7f52f6056640 1 Processor -- start 2024-09-13T18:33:02.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.361+0000 7f52f6056640 1 -- start start 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.361+0000 7f52f6056640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f0072f10 0x7f52f019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.361+0000 7f52f6056640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00744e0 0x7f52f019c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.361+0000 7f52f6056640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f019c630 con 0x7f52f00744e0 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.361+0000 7f52f6056640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f019c7a0 con 0x7f52f0072f10 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.361+0000 7f52eeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00744e0 0x7f52f019c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.361+0000 7f52eeffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00744e0 0x7f52f019c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60886/0 (socket says 172.21.15.38:60886) 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.361+0000 7f52eeffd640 1 -- 172.21.15.38:0/2550864343 learned_addr learned my addr 172.21.15.38:0/2550864343 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.361+0000 7f52ef7fe640 1 --2- 172.21.15.38:0/2550864343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f0072f10 0x7f52f019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.362+0000 7f52eeffd640 1 -- 172.21.15.38:0/2550864343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f0072f10 msgr2=0x7f52f019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.362+0000 7f52eeffd640 1 --2- 172.21.15.38:0/2550864343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f0072f10 0x7f52f019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.362+0000 7f52eeffd640 1 -- 172.21.15.38:0/2550864343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0009560 con 0x7f52f00744e0 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.362+0000 7f52eeffd640 1 --2- 172.21.15.38:0/2550864343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00744e0 0x7f52f019c060 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f52d800d720 tx=0x7f52d800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.362+0000 7f52ecff9640 1 -- 172.21.15.38:0/2550864343 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52d80051f0 con 0x7f52f00744e0 2024-09-13T18:33:02.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.362+0000 7f52ecff9640 1 -- 172.21.15.38:0/2550864343 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f52d8009820 con 0x7f52f00744e0 2024-09-13T18:33:02.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.362+0000 7f52f6056640 1 -- 172.21.15.38:0/2550864343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f01a1240 con 0x7f52f00744e0 2024-09-13T18:33:02.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.362+0000 7f52ecff9640 1 -- 172.21.15.38:0/2550864343 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52d8004d40 con 0x7f52f00744e0 2024-09-13T18:33:02.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.362+0000 7f52f6056640 1 -- 172.21.15.38:0/2550864343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f01a1750 con 0x7f52f00744e0 2024-09-13T18:33:02.367 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.363+0000 7f52f6056640 1 -- 172.21.15.38:0/2550864343 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f010ec40 con 0x7f52f00744e0 2024-09-13T18:33:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.364+0000 7f52ecff9640 1 -- 172.21.15.38:0/2550864343 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f52d8009990 con 0x7f52f00744e0 2024-09-13T18:33:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.364+0000 7f52ecff9640 1 --2- 172.21.15.38:0/2550864343 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f52dc06cc50 0x7f52dc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.364+0000 7f52ecff9640 1 -- 172.21.15.38:0/2550864343 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f52d808bf60 con 0x7f52f00744e0 2024-09-13T18:33:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.364+0000 7f52ef7fe640 1 --2- 172.21.15.38:0/2550864343 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f52dc06cc50 0x7f52dc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.365+0000 7f52ef7fe640 1 --2- 172.21.15.38:0/2550864343 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f52dc06cc50 0x7f52dc06f110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f52e0000c00 tx=0x7f52e0031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.372 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.369+0000 7f52ecff9640 1 -- 172.21.15.38:0/2550864343 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f52d80bfe20 con 0x7f52f00744e0 2024-09-13T18:33:02.449 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:02 smithi038 systemd[1]: Stopping Ceph osd.0 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:33:02.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.569+0000 7f52f6056640 1 -- 172.21.15.38:0/2550864343 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52f0102b50 con 0x7f52dc06cc50 2024-09-13T18:33:02.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.570+0000 7f52ecff9640 1 -- 172.21.15.38:0/2550864343 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f52f0102b50 con 0x7f52dc06cc50 2024-09-13T18:33:02.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.572+0000 7f52f6056640 1 -- 172.21.15.38:0/2550864343 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f52dc06cc50 msgr2=0x7f52dc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.572+0000 7f52f6056640 1 --2- 172.21.15.38:0/2550864343 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f52dc06cc50 0x7f52dc06f110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f52e0000c00 tx=0x7f52e0031400 comp rx=0 tx=0).stop 2024-09-13T18:33:02.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.572+0000 7f52f6056640 1 -- 172.21.15.38:0/2550864343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00744e0 msgr2=0x7f52f019c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.572+0000 7f52f6056640 1 --2- 172.21.15.38:0/2550864343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00744e0 0x7f52f019c060 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f52d800d720 tx=0x7f52d800dbe0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.572+0000 7f52f6056640 1 -- 172.21.15.38:0/2550864343 shutdown_connections 2024-09-13T18:33:02.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.572+0000 7f52f6056640 1 --2- 172.21.15.38:0/2550864343 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52f00744e0 0x7f52f019c060 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.572+0000 7f52f6056640 1 --2- 172.21.15.38:0/2550864343 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f52dc06cc50 0x7f52dc06f110 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.575 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.572+0000 7f52f6056640 1 --2- 172.21.15.38:0/2550864343 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52f0072f10 0x7f52f019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.572+0000 7f52f6056640 1 -- 172.21.15.38:0/2550864343 >> 172.21.15.38:0/2550864343 conn(0x7f52f00fb310 msgr2=0x7f52f01013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.573+0000 7f52f6056640 1 -- 172.21.15.38:0/2550864343 shutdown_connections 2024-09-13T18:33:02.576 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.573+0000 7f52f6056640 1 -- 172.21.15.38:0/2550864343 wait complete. 2024-09-13T18:33:02.584 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:33:02.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.658+0000 7f96dca73640 1 -- 172.21.15.38:0/1377025348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96d8100630 msgr2=0x7f96d8102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.662 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.658+0000 7f96dca73640 1 --2- 172.21.15.38:0/1377025348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96d8100630 0x7f96d8102a20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f96c80098b0 tx=0x7f96c802a4d0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.658+0000 7f96dca73640 1 -- 172.21.15.38:0/1377025348 shutdown_connections 2024-09-13T18:33:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.658+0000 7f96dca73640 1 --2- 172.21.15.38:0/1377025348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96d8102f60 0x7f96d8105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.658+0000 7f96dca73640 1 --2- 172.21.15.38:0/1377025348 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96d8100630 0x7f96d8102a20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.658+0000 7f96dca73640 1 -- 172.21.15.38:0/1377025348 >> 172.21.15.38:0/1377025348 conn(0x7f96d80fa250 msgr2=0x7f96d80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.658+0000 7f96dca73640 1 -- 172.21.15.38:0/1377025348 shutdown_connections 2024-09-13T18:33:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.658+0000 7f96dca73640 1 -- 172.21.15.38:0/1377025348 wait complete. 2024-09-13T18:33:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.659+0000 7f96dca73640 1 Processor -- start 2024-09-13T18:33:02.663 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.659+0000 7f96dca73640 1 -- start start 2024-09-13T18:33:02.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.659+0000 7f96dca73640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96d8100630 0x7f96d80fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.659+0000 7f96dca73640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96d8102f60 0x7f96d80fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.659+0000 7f96dca73640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d80feb20 con 0x7f96d8102f60 2024-09-13T18:33:02.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.659+0000 7f96dca73640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d80fec90 con 0x7f96d8100630 2024-09-13T18:33:02.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.659+0000 7f96d5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96d8102f60 0x7f96d80fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.659+0000 7f96d5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96d8102f60 0x7f96d80fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60912/0 (socket says 172.21.15.38:60912) 2024-09-13T18:33:02.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.659+0000 7f96d5d9b640 1 -- 172.21.15.38:0/2604115610 learned_addr learned my addr 172.21.15.38:0/2604115610 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:02.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.660+0000 7f96d5d9b640 1 -- 172.21.15.38:0/2604115610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96d8100630 msgr2=0x7f96d80fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.660+0000 7f96d5d9b640 1 --2- 172.21.15.38:0/2604115610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96d8100630 0x7f96d80fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.660+0000 7f96d5d9b640 1 -- 172.21.15.38:0/2604115610 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c8009560 con 0x7f96d8102f60 2024-09-13T18:33:02.665 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.660+0000 7f96d5d9b640 1 --2- 172.21.15.38:0/2604115610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96d8102f60 0x7f96d80fe5e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00d6f0 tx=0x7f96cc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.660+0000 7f96c77fe640 1 -- 172.21.15.38:0/2604115610 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96cc009a30 con 0x7f96d8102f60 2024-09-13T18:33:02.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.660+0000 7f96c77fe640 1 -- 172.21.15.38:0/2604115610 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f96cc009b90 con 0x7f96d8102f60 2024-09-13T18:33:02.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.660+0000 7f96dca73640 1 -- 172.21.15.38:0/2604115610 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d80fef70 con 0x7f96d8102f60 2024-09-13T18:33:02.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.660+0000 7f96c77fe640 1 -- 172.21.15.38:0/2604115610 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96cc00f5d0 con 0x7f96d8102f60 2024-09-13T18:33:02.666 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.660+0000 7f96dca73640 1 -- 172.21.15.38:0/2604115610 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d819d5c0 con 0x7f96d8102f60 2024-09-13T18:33:02.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.661+0000 7f96dca73640 1 -- 172.21.15.38:0/2604115610 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d8100a10 con 0x7f96d8102f60 2024-09-13T18:33:02.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.662+0000 7f96c77fe640 1 -- 172.21.15.38:0/2604115610 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f96cc009d00 con 0x7f96d8102f60 2024-09-13T18:33:02.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.662+0000 7f96c77fe640 1 --2- 172.21.15.38:0/2604115610 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f96c006cc60 0x7f96c006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.662+0000 7f96c77fe640 1 -- 172.21.15.38:0/2604115610 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f96cc08c380 con 0x7f96d8102f60 2024-09-13T18:33:02.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.662+0000 7f96d659c640 1 --2- 172.21.15.38:0/2604115610 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f96c006cc60 0x7f96c006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.667 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.663+0000 7f96d659c640 1 --2- 172.21.15.38:0/2604115610 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f96c006cc60 0x7f96c006f120 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f96c802a9f0 tx=0x7f96c8000bc0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.667+0000 7f96c77fe640 1 -- 172.21.15.38:0/2604115610 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f96cc056480 con 0x7f96d8102f60 2024-09-13T18:33:02.795 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:02 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0[45914]: 2024-09-13T18:33:02.446+0000 7fc4595a8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:33:02.796 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:02 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0[45914]: 2024-09-13T18:33:02.446+0000 7fc4595a8640 -1 osd.0 49 *** Got signal Terminated *** 2024-09-13T18:33:02.796 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:02 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0[45914]: 2024-09-13T18:33:02.446+0000 7fc4595a8640 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:33:02.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.861+0000 7f96dca73640 1 -- 172.21.15.38:0/2604115610 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f96d81039e0 con 0x7f96c006cc60 2024-09-13T18:33:02.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.862+0000 7f96c77fe640 1 -- 172.21.15.38:0/2604115610 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f96d81039e0 con 0x7f96c006cc60 2024-09-13T18:33:02.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.864+0000 7f96dca73640 1 -- 172.21.15.38:0/2604115610 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f96c006cc60 msgr2=0x7f96c006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.864+0000 7f96dca73640 1 --2- 172.21.15.38:0/2604115610 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f96c006cc60 0x7f96c006f120 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f96c802a9f0 tx=0x7f96c8000bc0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.864+0000 7f96dca73640 1 -- 172.21.15.38:0/2604115610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96d8102f60 msgr2=0x7f96d80fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.864+0000 7f96dca73640 1 --2- 172.21.15.38:0/2604115610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96d8102f60 0x7f96d80fe5e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00d6f0 tx=0x7f96cc00dbb0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.864+0000 7f96dca73640 1 -- 172.21.15.38:0/2604115610 shutdown_connections 2024-09-13T18:33:02.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.864+0000 7f96dca73640 1 --2- 172.21.15.38:0/2604115610 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96d8102f60 0x7f96d80fe5e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.864+0000 7f96dca73640 1 --2- 172.21.15.38:0/2604115610 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f96c006cc60 0x7f96c006f120 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.867 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.864+0000 7f96dca73640 1 --2- 172.21.15.38:0/2604115610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96d8100630 0x7f96d80fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.864+0000 7f96dca73640 1 -- 172.21.15.38:0/2604115610 >> 172.21.15.38:0/2604115610 conn(0x7f96d80fa250 msgr2=0x7f96d80fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.864+0000 7f96dca73640 1 -- 172.21.15.38:0/2604115610 shutdown_connections 2024-09-13T18:33:02.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.864+0000 7f96dca73640 1 -- 172.21.15.38:0/2604115610 wait complete. 2024-09-13T18:33:02.950 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.948+0000 7fa37c993640 1 -- 172.21.15.38:0/1465601817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3780ffcf0 msgr2=0x7fa378100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.948+0000 7fa37c993640 1 --2- 172.21.15.38:0/1465601817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3780ffcf0 0x7fa378100170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa360009880 tx=0x7fa36002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.948+0000 7fa37c993640 1 -- 172.21.15.38:0/1465601817 shutdown_connections 2024-09-13T18:33:02.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.948+0000 7fa37c993640 1 --2- 172.21.15.38:0/1465601817 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3780ffcf0 0x7fa378100170 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.948+0000 7fa37c993640 1 --2- 172.21.15.38:0/1465601817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3780feaf0 0x7fa3780feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.948+0000 7fa37c993640 1 -- 172.21.15.38:0/1465601817 >> 172.21.15.38:0/1465601817 conn(0x7fa3780fa280 msgr2=0x7fa3780fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:02.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.948+0000 7fa37c993640 1 -- 172.21.15.38:0/1465601817 shutdown_connections 2024-09-13T18:33:02.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.948+0000 7fa37c993640 1 -- 172.21.15.38:0/1465601817 wait complete. 2024-09-13T18:33:02.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa37c993640 1 Processor -- start 2024-09-13T18:33:02.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa37c993640 1 -- start start 2024-09-13T18:33:02.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa37c993640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3780feaf0 0x7fa3781955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa37c993640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3780ffcf0 0x7fa378195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa37c993640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3781960b0 con 0x7fa3780feaf0 2024-09-13T18:33:02.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa37c993640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa378196220 con 0x7fa3780ffcf0 2024-09-13T18:33:02.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa37659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3780feaf0 0x7fa3781955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa37659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3780feaf0 0x7fa3781955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60930/0 (socket says 172.21.15.38:60930) 2024-09-13T18:33:02.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa37659c640 1 -- 172.21.15.38:0/3934732472 learned_addr learned my addr 172.21.15.38:0/3934732472 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa375d9b640 1 --2- 172.21.15.38:0/3934732472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3780ffcf0 0x7fa378195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa37659c640 1 -- 172.21.15.38:0/3934732472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3780ffcf0 msgr2=0x7fa378195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa37659c640 1 --2- 172.21.15.38:0/3934732472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3780ffcf0 0x7fa378195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa37659c640 1 -- 172.21.15.38:0/3934732472 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360009560 con 0x7fa3780feaf0 2024-09-13T18:33:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.949+0000 7fa375d9b640 1 --2- 172.21.15.38:0/3934732472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3780ffcf0 0x7fa378195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.950+0000 7fa37659c640 1 --2- 172.21.15.38:0/3934732472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3780feaf0 0x7fa3781955a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa36800d900 tx=0x7fa36800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.950+0000 7fa36f7fe640 1 -- 172.21.15.38:0/3934732472 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa368009c00 con 0x7fa3780feaf0 2024-09-13T18:33:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.950+0000 7fa37c993640 1 -- 172.21.15.38:0/3934732472 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37819acc0 con 0x7fa3780feaf0 2024-09-13T18:33:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.950+0000 7fa36f7fe640 1 -- 172.21.15.38:0/3934732472 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa368009d60 con 0x7fa3780feaf0 2024-09-13T18:33:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.950+0000 7fa36f7fe640 1 -- 172.21.15.38:0/3934732472 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa36800f5f0 con 0x7fa3780feaf0 2024-09-13T18:33:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.950+0000 7fa37c993640 1 -- 172.21.15.38:0/3934732472 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37819b1c0 con 0x7fa3780feaf0 2024-09-13T18:33:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.951+0000 7fa37c993640 1 -- 172.21.15.38:0/3934732472 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3781075c0 con 0x7fa3780feaf0 2024-09-13T18:33:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.951+0000 7fa36f7fe640 1 -- 172.21.15.38:0/3934732472 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa368010460 con 0x7fa3780feaf0 2024-09-13T18:33:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.952+0000 7fa36f7fe640 1 --2- 172.21.15.38:0/3934732472 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa36406cc50 0x7fa36406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.952+0000 7fa36f7fe640 1 -- 172.21.15.38:0/3934732472 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa36808c3f0 con 0x7fa3780feaf0 2024-09-13T18:33:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.952+0000 7fa375d9b640 1 --2- 172.21.15.38:0/3934732472 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa36406cc50 0x7fa36406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:02.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.953+0000 7fa375d9b640 1 --2- 172.21.15.38:0/3934732472 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa36406cc50 0x7fa36406f110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa378196ac0 tx=0x7fa360031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:02.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:02.956+0000 7fa36f7fe640 1 -- 172.21.15.38:0/3934732472 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa368056510 con 0x7fa3780feaf0 2024-09-13T18:33:03.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:02 smithi038 ceph-mon[91522]: osd.0 marked itself down and dead 2024-09-13T18:33:03.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.139+0000 7fa37c993640 1 -- 172.21.15.38:0/3934732472 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3780fc350 con 0x7fa36406cc50 2024-09-13T18:33:03.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.148+0000 7fa36f7fe640 1 -- 172.21.15.38:0/3934732472 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fa3780fc350 con 0x7fa36406cc50 2024-09-13T18:33:03.151 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:33:03.151 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (9m) 9s ago 10m 24.1M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:33:03.151 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (11m) 9s ago 11m 8238k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:33:03.151 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (9m) 11s ago 9m 7972k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:33:03.151 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (19s) 9s ago 10m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:33:03.151 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (14s) 11s ago 9m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:33:03.151 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (9m) 9s ago 10m 87.7M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (5m) 9s ago 5m 157M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (5m) 9s ago 5m 98.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (5m) 11s ago 5m 25.8M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (5m) 11s ago 5m 25.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (2m) 9s ago 12m 486M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (62s) 11s ago 9m 438M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (48s) 9s ago 12m 42.2M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (32s) 11s ago 9m 27.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (10m) 9s ago 10m 15.5M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (9m) 11s ago 9m 15.7M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (8m) 9s ago 8m 248M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 69a9e66fb097 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (8m) 9s ago 8m 256M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 07986b4ba73b 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (7m) 9s ago 7m 212M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f e44cdda01aee 2024-09-13T18:33:03.152 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (7m) 11s ago 7m 281M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:33:03.153 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (7m) 11s ago 7m 267M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:33:03.153 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (6m) 11s ago 6m 227M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:33:03.153 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (67s) 9s ago 10m 49.4M - 2.43.0 a07b618ecd1d c04b1dcdc8c3 2024-09-13T18:33:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.150+0000 7fa37c993640 1 -- 172.21.15.38:0/3934732472 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa36406cc50 msgr2=0x7fa36406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.151+0000 7fa37c993640 1 --2- 172.21.15.38:0/3934732472 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa36406cc50 0x7fa36406f110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa378196ac0 tx=0x7fa360031400 comp rx=0 tx=0).stop 2024-09-13T18:33:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.151+0000 7fa37c993640 1 -- 172.21.15.38:0/3934732472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3780feaf0 msgr2=0x7fa3781955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.151+0000 7fa37c993640 1 --2- 172.21.15.38:0/3934732472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3780feaf0 0x7fa3781955a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa36800d900 tx=0x7fa36800ddc0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.151+0000 7fa37c993640 1 -- 172.21.15.38:0/3934732472 shutdown_connections 2024-09-13T18:33:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.151+0000 7fa37c993640 1 --2- 172.21.15.38:0/3934732472 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa36406cc50 0x7fa36406f110 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.151+0000 7fa37c993640 1 --2- 172.21.15.38:0/3934732472 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3780ffcf0 0x7fa378195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.151+0000 7fa37c993640 1 --2- 172.21.15.38:0/3934732472 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa3780feaf0 0x7fa3781955a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.151+0000 7fa37c993640 1 -- 172.21.15.38:0/3934732472 >> 172.21.15.38:0/3934732472 conn(0x7fa3780fa280 msgr2=0x7fa3780fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.151+0000 7fa37c993640 1 -- 172.21.15.38:0/3934732472 shutdown_connections 2024-09-13T18:33:03.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.151+0000 7fa37c993640 1 -- 172.21.15.38:0/3934732472 wait complete. 2024-09-13T18:33:03.224 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:02 smithi149 ceph-mon[76906]: osd.0 marked itself down and dead 2024-09-13T18:33:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.234+0000 7f1c04299640 1 -- 172.21.15.38:0/3384410069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bfc0ffb10 msgr2=0x7f1bfc0fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.234+0000 7f1c04299640 1 --2- 172.21.15.38:0/3384410069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bfc0ffb10 0x7f1bfc0fff10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009880 tx=0x7f1bf802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.234+0000 7f1c04299640 1 -- 172.21.15.38:0/3384410069 shutdown_connections 2024-09-13T18:33:03.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.234+0000 7f1c04299640 1 --2- 172.21.15.38:0/3384410069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bfc100d10 0x7f1bfc101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.234+0000 7f1c04299640 1 --2- 172.21.15.38:0/3384410069 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bfc0ffb10 0x7f1bfc0fff10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.234+0000 7f1c04299640 1 -- 172.21.15.38:0/3384410069 >> 172.21.15.38:0/3384410069 conn(0x7f1bfc0fb2c0 msgr2=0x7f1bfc0fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.234+0000 7f1c04299640 1 -- 172.21.15.38:0/3384410069 shutdown_connections 2024-09-13T18:33:03.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.234+0000 7f1c04299640 1 -- 172.21.15.38:0/3384410069 wait complete. 2024-09-13T18:33:03.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.234+0000 7f1c04299640 1 Processor -- start 2024-09-13T18:33:03.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.234+0000 7f1c04299640 1 -- start start 2024-09-13T18:33:03.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.235+0000 7f1c04299640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bfc0ffb10 0x7f1bfc074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.235+0000 7f1c04299640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bfc100d10 0x7f1bfc0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.235+0000 7f1c04299640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc072de0 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.235+0000 7f1c04299640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc072f50 con 0x7f1bfc100d10 2024-09-13T18:33:03.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.235+0000 7f1c02035640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bfc0ffb10 0x7f1bfc074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.235+0000 7f1c02035640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bfc0ffb10 0x7f1bfc074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60936/0 (socket says 172.21.15.38:60936) 2024-09-13T18:33:03.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.235+0000 7f1c02035640 1 -- 172.21.15.38:0/220929405 learned_addr learned my addr 172.21.15.38:0/220929405 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:03.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.235+0000 7f1c01834640 1 --2- 172.21.15.38:0/220929405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bfc100d10 0x7f1bfc0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.235+0000 7f1c02035640 1 -- 172.21.15.38:0/220929405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bfc100d10 msgr2=0x7f1bfc0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.235+0000 7f1c02035640 1 --2- 172.21.15.38:0/220929405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bfc100d10 0x7f1bfc0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.244 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.235+0000 7f1c02035640 1 -- 172.21.15.38:0/220929405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf8009560 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.235+0000 7f1c02035640 1 --2- 172.21.15.38:0/220929405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bfc0ffb10 0x7f1bfc074250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8006010 tx=0x7f1bf80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.236+0000 7f1bf37fe640 1 -- 172.21.15.38:0/220929405 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf8004aa0 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.236+0000 7f1c04299640 1 -- 172.21.15.38:0/220929405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc0731d0 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.236+0000 7f1c04299640 1 -- 172.21.15.38:0/220929405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc19d530 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.236+0000 7f1bf37fe640 1 -- 172.21.15.38:0/220929405 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1bf8005d50 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.236+0000 7f1bf37fe640 1 -- 172.21.15.38:0/220929405 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf8031950 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.237+0000 7f1c04299640 1 -- 172.21.15.38:0/220929405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be0005280 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.237+0000 7f1bf37fe640 1 -- 172.21.15.38:0/220929405 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1bf8031ab0 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.237+0000 7f1bf37fe640 1 --2- 172.21.15.38:0/220929405 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1be806cc60 0x7f1be806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.238+0000 7f1bf37fe640 1 -- 172.21.15.38:0/220929405 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1bf80ad420 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.238+0000 7f1c01834640 1 --2- 172.21.15.38:0/220929405 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1be806cc60 0x7f1be806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.246 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.238+0000 7f1c01834640 1 --2- 172.21.15.38:0/220929405 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1be806cc60 0x7f1be806f120 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc073fd0 tx=0x7f1bec005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.247 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.242+0000 7f1bf37fe640 1 -- 172.21.15.38:0/220929405 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1bf80775f0 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.490 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.488+0000 7f1c04299640 1 -- 172.21.15.38:0/220929405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1be0005d40 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.490 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:03 smithi038 podman[100487]: 2024-09-13 18:33:03.292202266 +0000 UTC m=+0.970014082 container died 69a9e66fb0976ba9bdfb0273a96298372c384865f771bde379bcc8ab76246f91 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-e4e227b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T18:33:03.491 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.488+0000 7f1bf37fe640 1 -- 172.21.15.38:0/220929405 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+732 (secure 0 0 0) 0x7f1bf807ac10 con 0x7f1bfc0ffb10 2024-09-13T18:33:03.491 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:33:03.491 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:33:03.491 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:33:03.491 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:33:03.491 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:33:03.491 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:33:03.491 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:33:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:33:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 5 2024-09-13T18:33:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:33:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:33:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:33:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:33:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:33:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 9, 2024-09-13T18:33:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 4 2024-09-13T18:33:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:33:03.492 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:33:03.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.490+0000 7f1c04299640 1 -- 172.21.15.38:0/220929405 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1be806cc60 msgr2=0x7f1be806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.490+0000 7f1c04299640 1 --2- 172.21.15.38:0/220929405 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1be806cc60 0x7f1be806f120 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc073fd0 tx=0x7f1bec005f90 comp rx=0 tx=0).stop 2024-09-13T18:33:03.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.490+0000 7f1c04299640 1 -- 172.21.15.38:0/220929405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bfc0ffb10 msgr2=0x7f1bfc074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.490+0000 7f1c04299640 1 --2- 172.21.15.38:0/220929405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bfc0ffb10 0x7f1bfc074250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8006010 tx=0x7f1bf80055a0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.490+0000 7f1c04299640 1 -- 172.21.15.38:0/220929405 shutdown_connections 2024-09-13T18:33:03.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.490+0000 7f1c04299640 1 --2- 172.21.15.38:0/220929405 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1be806cc60 0x7f1be806f120 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.493 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.490+0000 7f1c04299640 1 --2- 172.21.15.38:0/220929405 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bfc100d10 0x7f1bfc0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.490+0000 7f1c04299640 1 --2- 172.21.15.38:0/220929405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1bfc0ffb10 0x7f1bfc074250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.490+0000 7f1c04299640 1 -- 172.21.15.38:0/220929405 >> 172.21.15.38:0/220929405 conn(0x7f1bfc0fb2c0 msgr2=0x7f1bfc103f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.490+0000 7f1c04299640 1 -- 172.21.15.38:0/220929405 shutdown_connections 2024-09-13T18:33:03.494 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.490+0000 7f1c04299640 1 -- 172.21.15.38:0/220929405 wait complete. 2024-09-13T18:33:03.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.574+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2936629849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fcc0ffca0 msgr2=0x7f9fcc100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.574+0000 7f9fd0cca640 1 --2- 172.21.15.38:0/2936629849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fcc0ffca0 0x7f9fcc100120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009880 tx=0x7f9fc002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.574+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2936629849 shutdown_connections 2024-09-13T18:33:03.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.574+0000 7f9fd0cca640 1 --2- 172.21.15.38:0/2936629849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fcc0ffca0 0x7f9fcc100120 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.574+0000 7f9fd0cca640 1 --2- 172.21.15.38:0/2936629849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0feaa0 0x7f9fcc0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.574+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2936629849 >> 172.21.15.38:0/2936629849 conn(0x7f9fcc0fa250 msgr2=0x7f9fcc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.574+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2936629849 shutdown_connections 2024-09-13T18:33:03.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.574+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2936629849 wait complete. 2024-09-13T18:33:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.575+0000 7f9fd0cca640 1 Processor -- start 2024-09-13T18:33:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.575+0000 7f9fd0cca640 1 -- start start 2024-09-13T18:33:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.575+0000 7f9fd0cca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fcc0feaa0 0x7f9fcc197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.575+0000 7f9fd0cca640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0ffca0 0x7f9fcc197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.575+0000 7f9fd0cca640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc198260 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.575+0000 7f9fd0cca640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc1983d0 con 0x7f9fcc0ffca0 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.575+0000 7f9fca59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fcc0feaa0 0x7f9fcc197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.576+0000 7f9fca59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fcc0feaa0 0x7f9fcc197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60946/0 (socket says 172.21.15.38:60946) 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.576+0000 7f9fca59c640 1 -- 172.21.15.38:0/2049517193 learned_addr learned my addr 172.21.15.38:0/2049517193 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.576+0000 7f9fc9d9b640 1 --2- 172.21.15.38:0/2049517193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0ffca0 0x7f9fcc197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.576+0000 7f9fca59c640 1 -- 172.21.15.38:0/2049517193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0ffca0 msgr2=0x7f9fcc197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.576+0000 7f9fca59c640 1 --2- 172.21.15.38:0/2049517193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0ffca0 0x7f9fcc197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.576+0000 7f9fca59c640 1 -- 172.21.15.38:0/2049517193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc0009560 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.576+0000 7f9fca59c640 1 --2- 172.21.15.38:0/2049517193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fcc0feaa0 0x7f9fcc197750 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00d720 tx=0x7f9fbc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.576+0000 7f9fbb7fe640 1 -- 172.21.15.38:0/2049517193 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fbc0041f0 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.576+0000 7f9fbb7fe640 1 -- 172.21.15.38:0/2049517193 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9fbc004350 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.576+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2049517193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc19ce70 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.576+0000 7f9fbb7fe640 1 -- 172.21.15.38:0/2049517193 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fbc003d40 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.576+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2049517193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc19d3b0 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.577+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2049517193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fcc0feea0 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.578+0000 7f9fbb7fe640 1 -- 172.21.15.38:0/2049517193 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9fbc009820 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.578+0000 7f9fbb7fe640 1 --2- 172.21.15.38:0/2049517193 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9fb406cc60 0x7f9fb406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.578+0000 7f9fbb7fe640 1 -- 172.21.15.38:0/2049517193 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9fbc08be70 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.578+0000 7f9fc9d9b640 1 --2- 172.21.15.38:0/2049517193 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9fb406cc60 0x7f9fb406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.582 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.579+0000 7f9fc9d9b640 1 --2- 172.21.15.38:0/2049517193 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9fb406cc60 0x7f9fb406f120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc198c70 tx=0x7f9fc0031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.585 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.583+0000 7f9fbb7fe640 1 -- 172.21.15.38:0/2049517193 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9fbc0560c0 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.798 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.796+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2049517193 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9fcc1077e0 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.800 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.798+0000 7f9fbb7fe640 1 -- 172.21.15.38:0/2049517193 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7f9fbc017760 con 0x7f9fcc0feaa0 2024-09-13T18:33:03.801 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:33:03.801 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:33:03.801 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:33:03.801 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:33:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:33:03.801 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:33:03.801 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:33:03.801 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:33:03.801 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:33:03.801 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:33:03.801 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:33:03.802 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:33:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:33:03.804 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:33:03.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.801+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2049517193 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9fb406cc60 msgr2=0x7f9fb406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.801+0000 7f9fd0cca640 1 --2- 172.21.15.38:0/2049517193 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9fb406cc60 0x7f9fb406f120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc198c70 tx=0x7f9fc0031400 comp rx=0 tx=0).stop 2024-09-13T18:33:03.804 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.801+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2049517193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fcc0feaa0 msgr2=0x7f9fcc197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.801+0000 7f9fd0cca640 1 --2- 172.21.15.38:0/2049517193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fcc0feaa0 0x7f9fcc197750 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00d720 tx=0x7f9fbc00dbe0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.801+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2049517193 shutdown_connections 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.801+0000 7f9fd0cca640 1 --2- 172.21.15.38:0/2049517193 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9fb406cc60 0x7f9fb406f120 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.801+0000 7f9fd0cca640 1 --2- 172.21.15.38:0/2049517193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fcc0ffca0 0x7f9fcc197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.801+0000 7f9fd0cca640 1 --2- 172.21.15.38:0/2049517193 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fcc0feaa0 0x7f9fcc197750 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.801+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2049517193 >> 172.21.15.38:0/2049517193 conn(0x7f9fcc0fa250 msgr2=0x7f9fcc0fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.801+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2049517193 shutdown_connections 2024-09-13T18:33:03.805 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.801+0000 7f9fd0cca640 1 -- 172.21.15.38:0/2049517193 wait complete. 2024-09-13T18:33:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.893+0000 7f131b928640 1 -- 172.21.15.38:0/556674943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1314100630 msgr2=0x7f1314102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.893+0000 7f131b928640 1 --2- 172.21.15.38:0/556674943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1314100630 0x7f1314102a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13100098b0 tx=0x7f131002a4d0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.893+0000 7f131b928640 1 -- 172.21.15.38:0/556674943 shutdown_connections 2024-09-13T18:33:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.893+0000 7f131b928640 1 --2- 172.21.15.38:0/556674943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1314102f60 0x7f1314105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.893+0000 7f131b928640 1 --2- 172.21.15.38:0/556674943 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1314100630 0x7f1314102a20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.896 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.893+0000 7f131b928640 1 -- 172.21.15.38:0/556674943 >> 172.21.15.38:0/556674943 conn(0x7f13140fa250 msgr2=0x7f13140fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.893+0000 7f131b928640 1 -- 172.21.15.38:0/556674943 shutdown_connections 2024-09-13T18:33:03.897 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.893+0000 7f131b928640 1 -- 172.21.15.38:0/556674943 wait complete. 2024-09-13T18:33:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.894+0000 7f131b928640 1 Processor -- start 2024-09-13T18:33:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.894+0000 7f131b928640 1 -- start start 2024-09-13T18:33:03.898 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.894+0000 7f131b928640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1314100630 0x7f13140fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.894+0000 7f131b928640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1314102f60 0x7f13140fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.894+0000 7f131b928640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13140feb20 con 0x7f1314102f60 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.894+0000 7f131b928640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13140fec90 con 0x7f1314100630 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.894+0000 7f1318ec3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1314102f60 0x7f13140fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.895+0000 7f1318ec3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1314102f60 0x7f13140fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60956/0 (socket says 172.21.15.38:60956) 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.895+0000 7f1318ec3640 1 -- 172.21.15.38:0/278710787 learned_addr learned my addr 172.21.15.38:0/278710787 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.895+0000 7f13196c4640 1 --2- 172.21.15.38:0/278710787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1314100630 0x7f13140fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.895+0000 7f1318ec3640 1 -- 172.21.15.38:0/278710787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1314100630 msgr2=0x7f13140fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.895+0000 7f1318ec3640 1 --2- 172.21.15.38:0/278710787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1314100630 0x7f13140fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.895+0000 7f1318ec3640 1 -- 172.21.15.38:0/278710787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1310009560 con 0x7f1314102f60 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.895+0000 7f1318ec3640 1 --2- 172.21.15.38:0/278710787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1314102f60 0x7f13140fe5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f130400d6c0 tx=0x7f130400db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.895+0000 7f130a7fc640 1 -- 172.21.15.38:0/278710787 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13040051f0 con 0x7f1314102f60 2024-09-13T18:33:03.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.895+0000 7f131b928640 1 -- 172.21.15.38:0/278710787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13140fef70 con 0x7f1314102f60 2024-09-13T18:33:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.895+0000 7f130a7fc640 1 -- 172.21.15.38:0/278710787 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1304009820 con 0x7f1314102f60 2024-09-13T18:33:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.895+0000 7f130a7fc640 1 -- 172.21.15.38:0/278710787 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1304004da0 con 0x7f1314102f60 2024-09-13T18:33:03.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.895+0000 7f131b928640 1 -- 172.21.15.38:0/278710787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131419d5e0 con 0x7f1314102f60 2024-09-13T18:33:03.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.896+0000 7f131b928640 1 -- 172.21.15.38:0/278710787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13141086a0 con 0x7f1314102f60 2024-09-13T18:33:03.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.897+0000 7f130a7fc640 1 -- 172.21.15.38:0/278710787 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1304009990 con 0x7f1314102f60 2024-09-13T18:33:03.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.897+0000 7f130a7fc640 1 --2- 172.21.15.38:0/278710787 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f130006cc50 0x7f130006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:03.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.898+0000 7f130a7fc640 1 -- 172.21.15.38:0/278710787 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f130408bf60 con 0x7f1314102f60 2024-09-13T18:33:03.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.898+0000 7f13196c4640 1 --2- 172.21.15.38:0/278710787 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f130006cc50 0x7f130006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:03.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.898+0000 7f13196c4640 1 --2- 172.21.15.38:0/278710787 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f130006cc50 0x7f130006f110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1310000c00 tx=0x7f1310031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:03.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:03.902+0000 7f130a7fc640 1 -- 172.21.15.38:0/278710787 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1304056090 con 0x7f1314102f60 2024-09-13T18:33:04.018 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:03 smithi038 podman[100487]: 2024-09-13 18:33:03.74780591 +0000 UTC m=+1.425617728 container cleanup 69a9e66fb0976ba9bdfb0273a96298372c384865f771bde379bcc8ab76246f91 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0, RELEASE=reef-e4e227b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T18:33:04.018 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:03 smithi038 bash[100487]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0 2024-09-13T18:33:04.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:03 smithi038 ceph-mon[91522]: pgmap v61: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:33:04.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:03 smithi038 ceph-mon[91522]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:04.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:03 smithi038 ceph-mon[91522]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T18:33:04.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:03 smithi038 ceph-mon[91522]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T18:33:04.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:03 smithi038 ceph-mon[91522]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:04.018 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:03 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/220929405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:04.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.098+0000 7f131b928640 1 -- 172.21.15.38:0/278710787 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13141039e0 con 0x7f130006cc50 2024-09-13T18:33:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.099+0000 7f130a7fc640 1 -- 172.21.15.38:0/278710787 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f13141039e0 con 0x7f130006cc50 2024-09-13T18:33:04.102 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:33:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:33:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:33:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:33:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:33:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr", 2024-09-13T18:33:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-13T18:33:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "mon" 2024-09-13T18:33:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:33:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "6/23 daemons upgraded", 2024-09-13T18:33:04.103 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T18:33:04.103 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:33:04.103 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:33:04.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.102+0000 7f131b928640 1 -- 172.21.15.38:0/278710787 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f130006cc50 msgr2=0x7f130006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.104 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.102+0000 7f131b928640 1 --2- 172.21.15.38:0/278710787 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f130006cc50 0x7f130006f110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1310000c00 tx=0x7f1310031400 comp rx=0 tx=0).stop 2024-09-13T18:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.102+0000 7f131b928640 1 -- 172.21.15.38:0/278710787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1314102f60 msgr2=0x7f13140fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.102+0000 7f131b928640 1 --2- 172.21.15.38:0/278710787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1314102f60 0x7f13140fe5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f130400d6c0 tx=0x7f130400db80 comp rx=0 tx=0).stop 2024-09-13T18:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.102+0000 7f131b928640 1 -- 172.21.15.38:0/278710787 shutdown_connections 2024-09-13T18:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.102+0000 7f131b928640 1 --2- 172.21.15.38:0/278710787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1314102f60 0x7f13140fe5e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.102+0000 7f131b928640 1 --2- 172.21.15.38:0/278710787 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f130006cc50 0x7f130006f110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.102+0000 7f131b928640 1 --2- 172.21.15.38:0/278710787 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1314100630 0x7f13140fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.102+0000 7f131b928640 1 -- 172.21.15.38:0/278710787 >> 172.21.15.38:0/278710787 conn(0x7f13140fa250 msgr2=0x7f13140fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.102+0000 7f131b928640 1 -- 172.21.15.38:0/278710787 shutdown_connections 2024-09-13T18:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.102+0000 7f131b928640 1 -- 172.21.15.38:0/278710787 wait complete. 2024-09-13T18:33:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.198+0000 7fa53a9ba640 1 -- 172.21.15.38:0/1269542205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa534100630 msgr2=0x7fa534102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.198+0000 7fa53a9ba640 1 --2- 172.21.15.38:0/1269542205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa534100630 0x7fa534102a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa5240098b0 tx=0x7fa52402a4d0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.198+0000 7fa53a9ba640 1 -- 172.21.15.38:0/1269542205 shutdown_connections 2024-09-13T18:33:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.198+0000 7fa53a9ba640 1 --2- 172.21.15.38:0/1269542205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa534102f60 0x7fa534105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.198+0000 7fa53a9ba640 1 --2- 172.21.15.38:0/1269542205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa534100630 0x7fa534102a20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.198+0000 7fa53a9ba640 1 -- 172.21.15.38:0/1269542205 >> 172.21.15.38:0/1269542205 conn(0x7fa5340fa230 msgr2=0x7fa5340fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.198+0000 7fa53a9ba640 1 -- 172.21.15.38:0/1269542205 shutdown_connections 2024-09-13T18:33:04.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.198+0000 7fa53a9ba640 1 -- 172.21.15.38:0/1269542205 wait complete. 2024-09-13T18:33:04.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.198+0000 7fa53a9ba640 1 Processor -- start 2024-09-13T18:33:04.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.198+0000 7fa53a9ba640 1 -- start start 2024-09-13T18:33:04.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.199+0000 7fa53a9ba640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa534100630 0x7fa534195580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.199+0000 7fa53a9ba640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa534102f60 0x7fa534195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.199+0000 7fa53a9ba640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa534196090 con 0x7fa534100630 2024-09-13T18:33:04.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.199+0000 7fa53a9ba640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa534196200 con 0x7fa534102f60 2024-09-13T18:33:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.199+0000 7fa533fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa534100630 0x7fa534195580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.199+0000 7fa533fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa534100630 0x7fa534195580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:60984/0 (socket says 172.21.15.38:60984) 2024-09-13T18:33:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.199+0000 7fa533fff640 1 -- 172.21.15.38:0/2825199412 learned_addr learned my addr 172.21.15.38:0/2825199412 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.199+0000 7fa5337fe640 1 --2- 172.21.15.38:0/2825199412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa534102f60 0x7fa534195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.199+0000 7fa533fff640 1 -- 172.21.15.38:0/2825199412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa534102f60 msgr2=0x7fa534195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.199+0000 7fa533fff640 1 --2- 172.21.15.38:0/2825199412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa534102f60 0x7fa534195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.199+0000 7fa533fff640 1 -- 172.21.15.38:0/2825199412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa524009560 con 0x7fa534100630 2024-09-13T18:33:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.200+0000 7fa533fff640 1 --2- 172.21.15.38:0/2825199412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa534100630 0x7fa534195580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa524006010 tx=0x7fa5240055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.200+0000 7fa5317fa640 1 -- 172.21.15.38:0/2825199412 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa524004aa0 con 0x7fa534100630 2024-09-13T18:33:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.200+0000 7fa5317fa640 1 -- 172.21.15.38:0/2825199412 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa524004c00 con 0x7fa534100630 2024-09-13T18:33:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.200+0000 7fa5317fa640 1 -- 172.21.15.38:0/2825199412 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa524031860 con 0x7fa534100630 2024-09-13T18:33:04.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.200+0000 7fa53a9ba640 1 -- 172.21.15.38:0/2825199412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53419ac40 con 0x7fa534100630 2024-09-13T18:33:04.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.200+0000 7fa53a9ba640 1 -- 172.21.15.38:0/2825199412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53419b130 con 0x7fa534100630 2024-09-13T18:33:04.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.201+0000 7fa53a9ba640 1 -- 172.21.15.38:0/2825199412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5341086a0 con 0x7fa534100630 2024-09-13T18:33:04.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.202+0000 7fa5317fa640 1 -- 172.21.15.38:0/2825199412 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa524003b90 con 0x7fa534100630 2024-09-13T18:33:04.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.202+0000 7fa5317fa640 1 --2- 172.21.15.38:0/2825199412 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa51c06cc50 0x7fa51c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:04.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.203+0000 7fa5317fa640 1 -- 172.21.15.38:0/2825199412 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa5240ad5b0 con 0x7fa534100630 2024-09-13T18:33:04.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.203+0000 7fa5337fe640 1 --2- 172.21.15.38:0/2825199412 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa51c06cc50 0x7fa51c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:04.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.203+0000 7fa5337fe640 1 --2- 172.21.15.38:0/2825199412 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa51c06cc50 0x7fa51c06f110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa534196aa0 tx=0x7fa528005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:04.209 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.207+0000 7fa5317fa640 1 -- 172.21.15.38:0/2825199412 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa524077760 con 0x7fa534100630 2024-09-13T18:33:04.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:03 smithi149 ceph-mon[76906]: pgmap v61: 65 pgs: 65 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:33:04.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:03 smithi149 ceph-mon[76906]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:04.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:03 smithi149 ceph-mon[76906]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T18:33:04.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:03 smithi149 ceph-mon[76906]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T18:33:04.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:03 smithi149 ceph-mon[76906]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:04.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:03 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/220929405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:04.331 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:04 smithi038 podman[100591]: 2024-09-13 18:33:04.016201707 +0000 UTC m=+0.717012343 container remove 69a9e66fb0976ba9bdfb0273a96298372c384865f771bde379bcc8ab76246f91 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=reef-e4e227b, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T18:33:04.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.470+0000 7fa53a9ba640 1 -- 172.21.15.38:0/2825199412 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa534108860 con 0x7fa534100630 2024-09-13T18:33:04.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.471+0000 7fa5317fa640 1 -- 172.21.15.38:0/2825199412 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+100 (secure 0 0 0) 0x7fa52407ad80 con 0x7fa534100630 2024-09-13T18:33:04.473 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_WARN 1 osds down 2024-09-13T18:33:04.473 INFO:teuthology.orchestra.run.smithi038.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T18:33:04.474 INFO:teuthology.orchestra.run.smithi038.stdout: osd.0 (root=default,host=smithi038) is down 2024-09-13T18:33:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.473+0000 7fa53a9ba640 1 -- 172.21.15.38:0/2825199412 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa51c06cc50 msgr2=0x7fa51c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.473+0000 7fa53a9ba640 1 --2- 172.21.15.38:0/2825199412 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa51c06cc50 0x7fa51c06f110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa534196aa0 tx=0x7fa528005f90 comp rx=0 tx=0).stop 2024-09-13T18:33:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.473+0000 7fa53a9ba640 1 -- 172.21.15.38:0/2825199412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa534100630 msgr2=0x7fa534195580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:04.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.473+0000 7fa53a9ba640 1 --2- 172.21.15.38:0/2825199412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa534100630 0x7fa534195580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa524006010 tx=0x7fa5240055a0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.473+0000 7fa53a9ba640 1 -- 172.21.15.38:0/2825199412 shutdown_connections 2024-09-13T18:33:04.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.473+0000 7fa53a9ba640 1 --2- 172.21.15.38:0/2825199412 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa51c06cc50 0x7fa51c06f110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.473+0000 7fa53a9ba640 1 --2- 172.21.15.38:0/2825199412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa534102f60 0x7fa534195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.473+0000 7fa53a9ba640 1 --2- 172.21.15.38:0/2825199412 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa534100630 0x7fa534195580 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:04.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.473+0000 7fa53a9ba640 1 -- 172.21.15.38:0/2825199412 >> 172.21.15.38:0/2825199412 conn(0x7fa5340fa230 msgr2=0x7fa5340fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:04.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.473+0000 7fa53a9ba640 1 -- 172.21.15.38:0/2825199412 shutdown_connections 2024-09-13T18:33:04.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:04.473+0000 7fa53a9ba640 1 -- 172.21.15.38:0/2825199412 wait complete. 2024-09-13T18:33:04.689 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:04 smithi038 podman[100743]: 2024-09-13 18:33:04.273793058 +0000 UTC m=+0.016661052 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:33:04.689 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:04 smithi038 podman[100743]: 2024-09-13 18:33:04.397538709 +0000 UTC m=+0.140406703 container create 667c6f607a51b4538e367be3b8c66c249274928613911de3addab0f5508a5ba8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T18:33:04.689 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:04 smithi038 podman[100743]: 2024-09-13 18:33:04.612236505 +0000 UTC m=+0.355104490 container init 667c6f607a51b4538e367be3b8c66c249274928613911de3addab0f5508a5ba8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:33:04.689 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:04 smithi038 podman[100743]: 2024-09-13 18:33:04.615675986 +0000 UTC m=+0.358543970 container start 667c6f607a51b4538e367be3b8c66c249274928613911de3addab0f5508a5ba8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:33:04.689 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:04 smithi038 podman[100743]: 2024-09-13 18:33:04.68700456 +0000 UTC m=+0.429872554 container attach 667c6f607a51b4538e367be3b8c66c249274928613911de3addab0f5508a5ba8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:33:05.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:04 smithi038 ceph-mon[91522]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:05.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:04 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2049517193' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:33:05.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:04 smithi038 ceph-mon[91522]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T18:33:05.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:04 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2825199412' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:33:05.082 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:04 smithi038 podman[100743]: 2024-09-13 18:33:04.812684178 +0000 UTC m=+0.555552163 container died 667c6f607a51b4538e367be3b8c66c249274928613911de3addab0f5508a5ba8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T18:33:05.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:04 smithi149 ceph-mon[76906]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:05.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:04 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2049517193' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:33:05.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:04 smithi149 ceph-mon[76906]: osdmap e51: 6 total, 5 up, 6 in 2024-09-13T18:33:05.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:04 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2825199412' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:33:06.044 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:05 smithi038 ceph-mon[91522]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:06.044 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:05 smithi038 ceph-mon[91522]: pgmap v64: 65 pgs: 9 stale+active+clean, 56 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:33:06.045 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:05 smithi038 podman[100768]: 2024-09-13 18:33:05.583433967 +0000 UTC m=+0.764766928 container remove 667c6f607a51b4538e367be3b8c66c249274928613911de3addab0f5508a5ba8 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T18:33:06.045 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:05 smithi038 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-13T18:33:06.045 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:05 smithi038 systemd[1]: Stopped Ceph osd.0 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:33:06.045 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:05 smithi038 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.0.service: Consumed 1min 5.546s CPU time. 2024-09-13T18:33:06.045 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:05 smithi038 systemd[1]: Starting Ceph osd.0 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:33:06.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:05 smithi149 ceph-mon[76906]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:06.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:05 smithi149 ceph-mon[76906]: pgmap v64: 65 pgs: 9 stale+active+clean, 56 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:33:06.323 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 podman[100866]: 2024-09-13 18:33:05.945149002 +0000 UTC m=+0.016332821 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:33:06.323 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 podman[100866]: 2024-09-13 18:33:06.043204233 +0000 UTC m=+0.114388047 container create f26ca0aa027170de7ac33354a610d060c7e170d53e7c229e5be2ccf6c9c6c86a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T18:33:06.323 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 podman[100866]: 2024-09-13 18:33:06.229687464 +0000 UTC m=+0.300871278 container init f26ca0aa027170de7ac33354a610d060c7e170d53e7c229e5be2ccf6c9c6c86a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T18:33:06.324 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 podman[100866]: 2024-09-13 18:33:06.233297548 +0000 UTC m=+0.304481356 container start f26ca0aa027170de7ac33354a610d060c7e170d53e7c229e5be2ccf6c9c6c86a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:33:06.324 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 podman[100866]: 2024-09-13 18:33:06.321160822 +0000 UTC m=+0.392344636 container attach f26ca0aa027170de7ac33354a610d060c7e170d53e7c229e5be2ccf6c9c6c86a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T18:33:06.575 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate[100881]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:33:06.575 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 bash[100866]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:33:06.575 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate[100881]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T18:33:06.575 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 bash[100866]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T18:33:06.575 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate[100881]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T18:33:06.575 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 bash[100866]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T18:33:06.575 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate[100881]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T18:33:06.575 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 bash[100866]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T18:33:06.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]: dispatch 2024-09-13T18:33:06.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]}]: dispatch 2024-09-13T18:33:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 2]}]: dispatch 2024-09-13T18:33:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]: dispatch 2024-09-13T18:33:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 0]}]: dispatch 2024-09-13T18:33:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 0]}]: dispatch 2024-09-13T18:33:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 0]}]: dispatch 2024-09-13T18:33:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 0]}]: dispatch 2024-09-13T18:33:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 5]}]: dispatch 2024-09-13T18:33:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:33:06.832 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate[100881]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T18:33:06.833 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 bash[100866]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T18:33:06.833 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate[100881]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:33:06.833 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 bash[100866]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:33:06.833 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate[100881]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T18:33:06.833 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 bash[100866]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T18:33:06.833 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:06 smithi038 podman[100866]: 2024-09-13 18:33:06.598999069 +0000 UTC m=+0.670182890 container died f26ca0aa027170de7ac33354a610d060c7e170d53e7c229e5be2ccf6c9c6c86a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-13T18:33:07.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]: dispatch 2024-09-13T18:33:07.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]}]: dispatch 2024-09-13T18:33:07.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 2]}]: dispatch 2024-09-13T18:33:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]: dispatch 2024-09-13T18:33:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 0]}]: dispatch 2024-09-13T18:33:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 0]}]: dispatch 2024-09-13T18:33:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 0]}]: dispatch 2024-09-13T18:33:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 0]}]: dispatch 2024-09-13T18:33:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 5]}]: dispatch 2024-09-13T18:33:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:33:07.559 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:07 smithi038 podman[101007]: 2024-09-13 18:33:07.267393087 +0000 UTC m=+0.662514410 container remove f26ca0aa027170de7ac33354a610d060c7e170d53e7c229e5be2ccf6c9c6c86a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:33:07.559 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:07 smithi038 podman[101064]: 2024-09-13 18:33:07.379942071 +0000 UTC m=+0.016698848 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:33:07.823 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:07 smithi038 podman[101064]: 2024-09-13 18:33:07.610110037 +0000 UTC m=+0.246866816 container create 741f349e9433855b71157f2a9778be2be492abf280097950cf76577a9ed1257a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T18:33:08.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:07 smithi149 ceph-mon[76906]: pgmap v65: 65 pgs: 9 stale+active+clean, 56 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T18:33:08.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]': finished 2024-09-13T18:33:08.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]}]': finished 2024-09-13T18:33:08.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 2]}]': finished 2024-09-13T18:33:08.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]': finished 2024-09-13T18:33:08.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 0]}]': finished 2024-09-13T18:33:08.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 0]}]': finished 2024-09-13T18:33:08.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 0]}]': finished 2024-09-13T18:33:08.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 0]}]': finished 2024-09-13T18:33:08.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 5]}]': finished 2024-09-13T18:33:08.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:07 smithi149 ceph-mon[76906]: osdmap e52: 6 total, 5 up, 6 in 2024-09-13T18:33:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:07 smithi038 ceph-mon[91522]: pgmap v65: 65 pgs: 9 stale+active+clean, 56 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T18:33:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]': finished 2024-09-13T18:33:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]}]': finished 2024-09-13T18:33:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 2]}]': finished 2024-09-13T18:33:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 0]}]': finished 2024-09-13T18:33:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 0]}]': finished 2024-09-13T18:33:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 0]}]': finished 2024-09-13T18:33:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 0]}]': finished 2024-09-13T18:33:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 0]}]': finished 2024-09-13T18:33:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [3, 5]}]': finished 2024-09-13T18:33:08.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:07 smithi038 ceph-mon[91522]: osdmap e52: 6 total, 5 up, 6 in 2024-09-13T18:33:08.082 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:07 smithi038 podman[101064]: 2024-09-13 18:33:07.843089697 +0000 UTC m=+0.479846483 container init 741f349e9433855b71157f2a9778be2be492abf280097950cf76577a9ed1257a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T18:33:08.082 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:07 smithi038 podman[101064]: 2024-09-13 18:33:07.847221733 +0000 UTC m=+0.483978510 container start 741f349e9433855b71157f2a9778be2be492abf280097950cf76577a9ed1257a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T18:33:08.082 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:07 smithi038 ceph-osd[101086]: -- 172.21.15.38:0/746053634 <== mon.0 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56355248f1e0 con 0x56355242dc00 2024-09-13T18:33:08.082 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:07 smithi038 bash[101064]: 741f349e9433855b71157f2a9778be2be492abf280097950cf76577a9ed1257a 2024-09-13T18:33:08.083 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:07 smithi038 systemd[1]: Started Ceph osd.0 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:33:08.668 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:08 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0[101080]: 2024-09-13T18:33:08.385+0000 7f287ed97640 -1 Falling back to public interface 2024-09-13T18:33:09.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:08 smithi038 ceph-mon[91522]: osdmap e53: 6 total, 5 up, 6 in 2024-09-13T18:33:09.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:08 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:09.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:08 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:09.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:08 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:33:09.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:08 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:09.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:08 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:09.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:08 smithi038 ceph-mon[91522]: osdmap e54: 6 total, 5 up, 6 in 2024-09-13T18:33:09.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:08 smithi149 ceph-mon[76906]: osdmap e53: 6 total, 5 up, 6 in 2024-09-13T18:33:09.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:08 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:09.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:08 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:09.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:08 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:33:09.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:08 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:09.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:08 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:09.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:08 smithi149 ceph-mon[76906]: osdmap e54: 6 total, 5 up, 6 in 2024-09-13T18:33:10.100 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:09 smithi038 ceph-mon[91522]: pgmap v68: 65 pgs: 14 active+undersized, 5 unknown, 4 peering, 17 active+undersized+degraded, 25 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 0 op/s; 47/279 objects degraded (16.846%) 2024-09-13T18:33:10.100 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:09 smithi038 ceph-mon[91522]: Health check failed: Degraded data redundancy: 47/279 objects degraded (16.846%), 17 pgs degraded (PG_DEGRADED) 2024-09-13T18:33:10.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:09 smithi149 ceph-mon[76906]: pgmap v68: 65 pgs: 14 active+undersized, 5 unknown, 4 peering, 17 active+undersized+degraded, 25 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 0 op/s; 47/279 objects degraded (16.846%) 2024-09-13T18:33:10.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:09 smithi149 ceph-mon[76906]: Health check failed: Degraded data redundancy: 47/279 objects degraded (16.846%), 17 pgs degraded (PG_DEGRADED) 2024-09-13T18:33:11.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:10 smithi038 ceph-mon[91522]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T18:33:11.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:10 smithi038 ceph-mon[91522]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T18:33:11.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:10 smithi149 ceph-mon[76906]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T18:33:11.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:10 smithi149 ceph-mon[76906]: osdmap e56: 6 total, 5 up, 6 in 2024-09-13T18:33:12.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:11 smithi149 ceph-mon[76906]: pgmap v71: 65 pgs: 14 active+undersized, 5 unknown, 4 peering, 17 active+undersized+degraded, 25 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 op/s; 47/279 objects degraded (16.846%) 2024-09-13T18:33:12.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:11 smithi149 ceph-mon[76906]: osdmap e57: 6 total, 5 up, 6 in 2024-09-13T18:33:12.287 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:11 smithi038 ceph-mon[91522]: pgmap v71: 65 pgs: 14 active+undersized, 5 unknown, 4 peering, 17 active+undersized+degraded, 25 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 op/s; 47/279 objects degraded (16.846%) 2024-09-13T18:33:12.287 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:11 smithi038 ceph-mon[91522]: osdmap e57: 6 total, 5 up, 6 in 2024-09-13T18:33:13.831 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:13 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0[101080]: 2024-09-13T18:33:13.461+0000 7f287ed97640 -1 osd.0 49 log_to_monitors true 2024-09-13T18:33:14.193 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:33:14 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0[101080]: 2024-09-13T18:33:14.033+0000 7f2872b28640 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:33:14.194 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:13 smithi038 ceph-mon[91522]: pgmap v74: 65 pgs: 9 active+clean+remapped, 14 active+undersized, 17 active+undersized+degraded, 25 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 16 KiB/s wr, 29 op/s; 47/282 objects degraded (16.667%); 9/282 objects misplaced (3.191%); 4.0 MiB/s, 191 objects/s recovering 2024-09-13T18:33:14.194 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:14.194 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:14.194 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:13 smithi038 ceph-mon[91522]: from='osd.0 [v2:172.21.15.38:6802/3683619056,v1:172.21.15.38:6803/3683619056]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T18:33:14.194 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:14.195 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:14.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:13 smithi149 ceph-mon[76906]: pgmap v74: 65 pgs: 9 active+clean+remapped, 14 active+undersized, 17 active+undersized+degraded, 25 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 16 KiB/s wr, 29 op/s; 47/282 objects degraded (16.667%); 9/282 objects misplaced (3.191%); 4.0 MiB/s, 191 objects/s recovering 2024-09-13T18:33:14.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:14.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:14.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:13 smithi149 ceph-mon[76906]: from='osd.0 [v2:172.21.15.38:6802/3683619056,v1:172.21.15.38:6803/3683619056]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T18:33:14.274 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:14.274 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:15.249 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:15 smithi038 ceph-mon[91522]: from='osd.0 [v2:172.21.15.38:6802/3683619056,v1:172.21.15.38:6803/3683619056]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T18:33:15.249 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:15 smithi038 ceph-mon[91522]: osdmap e58: 6 total, 5 up, 6 in 2024-09-13T18:33:15.249 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:15 smithi038 ceph-mon[91522]: from='osd.0 [v2:172.21.15.38:6802/3683619056,v1:172.21.15.38:6803/3683619056]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-13T18:33:15.249 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:15 smithi038 ceph-mon[91522]: pgmap v76: 65 pgs: 9 active+clean+remapped, 14 active+undersized, 17 active+undersized+degraded, 25 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 14 KiB/s wr, 26 op/s; 47/282 objects degraded (16.667%); 9/282 objects misplaced (3.191%); 3.5 MiB/s, 168 objects/s recovering 2024-09-13T18:33:15.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:15 smithi149 ceph-mon[76906]: from='osd.0 [v2:172.21.15.38:6802/3683619056,v1:172.21.15.38:6803/3683619056]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T18:33:15.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:15 smithi149 ceph-mon[76906]: osdmap e58: 6 total, 5 up, 6 in 2024-09-13T18:33:15.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:15 smithi149 ceph-mon[76906]: from='osd.0 [v2:172.21.15.38:6802/3683619056,v1:172.21.15.38:6803/3683619056]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-13T18:33:15.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:15 smithi149 ceph-mon[76906]: pgmap v76: 65 pgs: 9 active+clean+remapped, 14 active+undersized, 17 active+undersized+degraded, 25 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 14 KiB/s wr, 26 op/s; 47/282 objects degraded (16.667%); 9/282 objects misplaced (3.191%); 3.5 MiB/s, 168 objects/s recovering 2024-09-13T18:33:16.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:16 smithi038 ceph-mon[91522]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T18:33:16.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:16 smithi038 ceph-mon[91522]: osd.0 [v2:172.21.15.38:6802/3683619056,v1:172.21.15.38:6803/3683619056] boot 2024-09-13T18:33:16.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:16 smithi038 ceph-mon[91522]: osdmap e59: 6 total, 6 up, 6 in 2024-09-13T18:33:16.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:16 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:33:16.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:16 smithi038 ceph-mon[91522]: Health check update: Degraded data redundancy: 47/282 objects degraded (16.667%), 17 pgs degraded (PG_DEGRADED) 2024-09-13T18:33:16.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:16 smithi038 ceph-mon[91522]: osdmap e60: 6 total, 6 up, 6 in 2024-09-13T18:33:16.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:16 smithi149 ceph-mon[76906]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T18:33:16.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:16 smithi149 ceph-mon[76906]: osd.0 [v2:172.21.15.38:6802/3683619056,v1:172.21.15.38:6803/3683619056] boot 2024-09-13T18:33:16.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:16 smithi149 ceph-mon[76906]: osdmap e59: 6 total, 6 up, 6 in 2024-09-13T18:33:16.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:16 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T18:33:16.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:16 smithi149 ceph-mon[76906]: Health check update: Degraded data redundancy: 47/282 objects degraded (16.667%), 17 pgs degraded (PG_DEGRADED) 2024-09-13T18:33:16.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:16 smithi149 ceph-mon[76906]: osdmap e60: 6 total, 6 up, 6 in 2024-09-13T18:33:17.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:17 smithi038 ceph-mon[91522]: pgmap v79: 65 pgs: 9 active+clean+remapped, 14 active+undersized, 17 active+undersized+degraded, 25 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 13 KiB/s wr, 24 op/s; 47/282 objects degraded (16.667%); 9/282 objects misplaced (3.191%); 3.3 MiB/s, 159 objects/s recovering 2024-09-13T18:33:17.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:17 smithi038 ceph-mon[91522]: osdmap e61: 6 total, 6 up, 6 in 2024-09-13T18:33:17.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:17.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:17.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:33:17.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:33:17.875 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:17.876 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:33:17.876 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:17.876 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:17.876 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:17.876 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T18:33:18.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:17 smithi149 ceph-mon[76906]: pgmap v79: 65 pgs: 9 active+clean+remapped, 14 active+undersized, 17 active+undersized+degraded, 25 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 13 KiB/s wr, 24 op/s; 47/282 objects degraded (16.667%); 9/282 objects misplaced (3.191%); 3.3 MiB/s, 159 objects/s recovering 2024-09-13T18:33:18.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:17 smithi149 ceph-mon[76906]: osdmap e61: 6 total, 6 up, 6 in 2024-09-13T18:33:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:33:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:33:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:33:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T18:33:18.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:18 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T18:33:18.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:18 smithi149 ceph-mon[76906]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-09-13T18:33:18.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:18 smithi149 ceph-mon[76906]: osdmap e62: 6 total, 6 up, 6 in 2024-09-13T18:33:18.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:18 smithi149 ceph-mon[76906]: osdmap e63: 6 total, 6 up, 6 in 2024-09-13T18:33:18.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:18 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T18:33:18.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:18 smithi038 ceph-mon[91522]: Upgrade: unsafe to stop osd(s) at this time (13 PGs are or would become offline) 2024-09-13T18:33:18.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:18 smithi038 ceph-mon[91522]: osdmap e62: 6 total, 6 up, 6 in 2024-09-13T18:33:18.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:18 smithi038 ceph-mon[91522]: osdmap e63: 6 total, 6 up, 6 in 2024-09-13T18:33:20.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:19 smithi149 ceph-mon[76906]: pgmap v82: 65 pgs: 1 active+recovering+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+remapped, 1 active+clean+remapped, 6 active+undersized, 2 active+undersized+degraded, 50 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 2919/282 objects degraded (1035.106%); 0 B/s, 0 keys/s, 92 objects/s recovering 2024-09-13T18:33:20.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:19 smithi149 ceph-mon[76906]: osdmap e64: 6 total, 6 up, 6 in 2024-09-13T18:33:20.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:19 smithi038 ceph-mon[91522]: pgmap v82: 65 pgs: 1 active+recovering+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+remapped, 1 active+clean+remapped, 6 active+undersized, 2 active+undersized+degraded, 50 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 2919/282 objects degraded (1035.106%); 0 B/s, 0 keys/s, 92 objects/s recovering 2024-09-13T18:33:20.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:19 smithi038 ceph-mon[91522]: osdmap e64: 6 total, 6 up, 6 in 2024-09-13T18:33:21.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:20 smithi149 ceph-mon[76906]: Health check update: Degraded data redundancy: 2919/282 objects degraded (1035.106%), 6 pgs degraded (PG_DEGRADED) 2024-09-13T18:33:21.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:20 smithi149 ceph-mon[76906]: osdmap e65: 6 total, 6 up, 6 in 2024-09-13T18:33:21.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:20 smithi038 ceph-mon[91522]: Health check update: Degraded data redundancy: 2919/282 objects degraded (1035.106%), 6 pgs degraded (PG_DEGRADED) 2024-09-13T18:33:21.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:20 smithi038 ceph-mon[91522]: osdmap e65: 6 total, 6 up, 6 in 2024-09-13T18:33:22.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:21 smithi149 ceph-mon[76906]: pgmap v85: 65 pgs: 1 active+recovering+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+remapped, 59 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 2912/282 objects degraded (1032.624%); 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-13T18:33:22.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:22.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:33:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:21 smithi149 ceph-mon[76906]: osdmap e66: 6 total, 6 up, 6 in 2024-09-13T18:33:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:21 smithi038 ceph-mon[91522]: pgmap v85: 65 pgs: 1 active+recovering+undersized+remapped, 4 active+recovery_wait+undersized+degraded+remapped, 1 active+undersized+remapped, 59 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 2912/282 objects degraded (1032.624%); 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-13T18:33:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:33:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:21 smithi038 ceph-mon[91522]: osdmap e66: 6 total, 6 up, 6 in 2024-09-13T18:33:24.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:23 smithi149 ceph-mon[76906]: pgmap v88: 65 pgs: 1 active+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 62 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 1482/282 objects degraded (525.532%); 0 B/s, 265 objects/s recovering 2024-09-13T18:33:24.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:23 smithi149 ceph-mon[76906]: osdmap e67: 6 total, 6 up, 6 in 2024-09-13T18:33:24.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:23 smithi038 ceph-mon[91522]: pgmap v88: 65 pgs: 1 active+undersized+remapped, 2 active+recovery_wait+undersized+degraded+remapped, 62 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 1482/282 objects degraded (525.532%); 0 B/s, 265 objects/s recovering 2024-09-13T18:33:24.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:23 smithi038 ceph-mon[91522]: osdmap e67: 6 total, 6 up, 6 in 2024-09-13T18:33:25.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:24 smithi149 ceph-mon[76906]: osdmap e68: 6 total, 6 up, 6 in 2024-09-13T18:33:25.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:24 smithi038 ceph-mon[91522]: osdmap e68: 6 total, 6 up, 6 in 2024-09-13T18:33:26.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:25 smithi149 ceph-mon[76906]: pgmap v91: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 448 objects/s recovering 2024-09-13T18:33:26.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:25 smithi149 ceph-mon[76906]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1482/282 objects degraded (525.532%), 2 pgs degraded) 2024-09-13T18:33:26.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:25 smithi149 ceph-mon[76906]: Cluster is now healthy 2024-09-13T18:33:26.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:25 smithi038 ceph-mon[91522]: pgmap v91: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 448 objects/s recovering 2024-09-13T18:33:26.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:25 smithi038 ceph-mon[91522]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1482/282 objects degraded (525.532%), 2 pgs degraded) 2024-09-13T18:33:26.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:25 smithi038 ceph-mon[91522]: Cluster is now healthy 2024-09-13T18:33:27.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:27 smithi038 ceph-mon[91522]: pgmap v92: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 0 B/s, 308 objects/s recovering 2024-09-13T18:33:28.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:27 smithi149 ceph-mon[76906]: pgmap v92: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 0 B/s, 308 objects/s recovering 2024-09-13T18:33:30.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:29 smithi149 ceph-mon[76906]: pgmap v93: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 263 objects/s recovering 2024-09-13T18:33:30.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:29 smithi038 ceph-mon[91522]: pgmap v93: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 263 objects/s recovering 2024-09-13T18:33:32.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:31 smithi149 ceph-mon[76906]: pgmap v94: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 1 objects/s recovering 2024-09-13T18:33:32.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:31 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:32.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:31 smithi038 ceph-mon[91522]: pgmap v94: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 1 objects/s recovering 2024-09-13T18:33:32.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:31 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:33.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:32 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T18:33:33.041 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:32 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T18:33:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:33 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T18:33:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:33 smithi038 ceph-mon[91522]: Upgrade: osd.1 is safe to restart 2024-09-13T18:33:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:33 smithi038 ceph-mon[91522]: pgmap v95: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s; 0 B/s, 1 objects/s recovering 2024-09-13T18:33:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:33 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:33.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:33 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T18:33:33.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:33 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:33:34.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:33 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T18:33:34.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:33 smithi149 ceph-mon[76906]: Upgrade: osd.1 is safe to restart 2024-09-13T18:33:34.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:33 smithi149 ceph-mon[76906]: pgmap v95: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s; 0 B/s, 1 objects/s recovering 2024-09-13T18:33:34.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:33 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:34.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:33 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T18:33:34.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:33 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:33:34.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.563+0000 7f26a00ba640 1 -- 172.21.15.38:0/3448959929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26980feaf0 msgr2=0x7f26980feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:34.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.563+0000 7f26a00ba640 1 --2- 172.21.15.38:0/3448959929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26980feaf0 0x7f26980feef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2688009c20 tx=0x7f268802a970 comp rx=0 tx=0).stop 2024-09-13T18:33:34.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.563+0000 7f26a00ba640 1 -- 172.21.15.38:0/3448959929 shutdown_connections 2024-09-13T18:33:34.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.563+0000 7f26a00ba640 1 --2- 172.21.15.38:0/3448959929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26980ffcf0 0x7f2698100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:34.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.563+0000 7f26a00ba640 1 --2- 172.21.15.38:0/3448959929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26980feaf0 0x7f26980feef0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.563+0000 7f26a00ba640 1 -- 172.21.15.38:0/3448959929 >> 172.21.15.38:0/3448959929 conn(0x7f26980fa280 msgr2=0x7f26980fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.563+0000 7f26a00ba640 1 -- 172.21.15.38:0/3448959929 shutdown_connections 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.563+0000 7f26a00ba640 1 -- 172.21.15.38:0/3448959929 wait complete. 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.563+0000 7f26a00ba640 1 Processor -- start 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f26a00ba640 1 -- start start 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f26a00ba640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26980feaf0 0x7f2698102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f26a00ba640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26980ffcf0 0x7f26981010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f26a00ba640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2698101610 con 0x7f26980ffcf0 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f26a00ba640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2698101780 con 0x7f26980feaf0 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f269d655640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26980ffcf0 0x7f26981010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f269d655640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26980ffcf0 0x7f26981010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59308/0 (socket says 172.21.15.38:59308) 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f269d655640 1 -- 172.21.15.38:0/2315299578 learned_addr learned my addr 172.21.15.38:0/2315299578 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:34.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f269de56640 1 --2- 172.21.15.38:0/2315299578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26980feaf0 0x7f2698102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f269d655640 1 -- 172.21.15.38:0/2315299578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26980feaf0 msgr2=0x7f2698102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f269d655640 1 --2- 172.21.15.38:0/2315299578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26980feaf0 0x7f2698102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f269d655640 1 -- 172.21.15.38:0/2315299578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2688009900 con 0x7f26980ffcf0 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f269d655640 1 --2- 172.21.15.38:0/2315299578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26980ffcf0 0x7f26981010d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f268c00b420 tx=0x7f268c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.564+0000 7f2696ffd640 1 -- 172.21.15.38:0/2315299578 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f268c011800 con 0x7f26980ffcf0 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.565+0000 7f2696ffd640 1 -- 172.21.15.38:0/2315299578 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f268c011e00 con 0x7f26980ffcf0 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.565+0000 7f2696ffd640 1 -- 172.21.15.38:0/2315299578 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f268c00f2e0 con 0x7f26980ffcf0 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.565+0000 7f26a00ba640 1 -- 172.21.15.38:0/2315299578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2698101a60 con 0x7f26980ffcf0 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.565+0000 7f26a00ba640 1 -- 172.21.15.38:0/2315299578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269819d6d0 con 0x7f26980ffcf0 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.566+0000 7f26a00ba640 1 -- 172.21.15.38:0/2315299578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2698107620 con 0x7f26980ffcf0 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.566+0000 7f2696ffd640 1 -- 172.21.15.38:0/2315299578 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f268c010380 con 0x7f26980ffcf0 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.567+0000 7f2696ffd640 1 --2- 172.21.15.38:0/2315299578 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f268006cc50 0x7f268006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:34.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.567+0000 7f2696ffd640 1 -- 172.21.15.38:0/2315299578 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f268c08bce0 con 0x7f26980ffcf0 2024-09-13T18:33:34.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.567+0000 7f269de56640 1 --2- 172.21.15.38:0/2315299578 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f268006cc50 0x7f268006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:34.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.567+0000 7f269de56640 1 --2- 172.21.15.38:0/2315299578 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f268006cc50 0x7f268006f110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f268802ae90 tx=0x7f2688000f40 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:34.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.572+0000 7f2696ffd640 1 -- 172.21.15.38:0/2315299578 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f268c055d70 con 0x7f26980ffcf0 2024-09-13T18:33:34.763 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.760+0000 7f26a00ba640 1 -- 172.21.15.38:0/2315299578 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2698068430 con 0x7f268006cc50 2024-09-13T18:33:34.764 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.762+0000 7f2696ffd640 1 -- 172.21.15.38:0/2315299578 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2698068430 con 0x7f268006cc50 2024-09-13T18:33:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.764+0000 7f26a00ba640 1 -- 172.21.15.38:0/2315299578 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f268006cc50 msgr2=0x7f268006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.764+0000 7f26a00ba640 1 --2- 172.21.15.38:0/2315299578 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f268006cc50 0x7f268006f110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f268802ae90 tx=0x7f2688000f40 comp rx=0 tx=0).stop 2024-09-13T18:33:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.764+0000 7f26a00ba640 1 -- 172.21.15.38:0/2315299578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26980ffcf0 msgr2=0x7f26981010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:34.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.764+0000 7f26a00ba640 1 --2- 172.21.15.38:0/2315299578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26980ffcf0 0x7f26981010d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f268c00b420 tx=0x7f268c00b8e0 comp rx=0 tx=0).stop 2024-09-13T18:33:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.764+0000 7f26a00ba640 1 -- 172.21.15.38:0/2315299578 shutdown_connections 2024-09-13T18:33:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.764+0000 7f26a00ba640 1 --2- 172.21.15.38:0/2315299578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26980ffcf0 0x7f26981010d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.764+0000 7f26a00ba640 1 --2- 172.21.15.38:0/2315299578 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f268006cc50 0x7f268006f110 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.764+0000 7f26a00ba640 1 --2- 172.21.15.38:0/2315299578 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26980feaf0 0x7f2698102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.764+0000 7f26a00ba640 1 -- 172.21.15.38:0/2315299578 >> 172.21.15.38:0/2315299578 conn(0x7f26980fa280 msgr2=0x7f2698067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.764+0000 7f26a00ba640 1 -- 172.21.15.38:0/2315299578 shutdown_connections 2024-09-13T18:33:34.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.764+0000 7f26a00ba640 1 -- 172.21.15.38:0/2315299578 wait complete. 2024-09-13T18:33:34.777 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:33:34.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:34 smithi038 ceph-mon[91522]: Upgrade: Updating osd.1 2024-09-13T18:33:34.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:34 smithi038 ceph-mon[91522]: Deploying daemon osd.1 on smithi038 2024-09-13T18:33:34.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.848+0000 7fb9004d3640 1 -- 172.21.15.38:0/3730673911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8f80feaf0 msgr2=0x7fb8f80feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:34.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.848+0000 7fb9004d3640 1 --2- 172.21.15.38:0/3730673911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8f80feaf0 0x7fb8f80feef0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009c20 tx=0x7fb8f402a970 comp rx=0 tx=0).stop 2024-09-13T18:33:34.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.849+0000 7fb9004d3640 1 -- 172.21.15.38:0/3730673911 shutdown_connections 2024-09-13T18:33:34.851 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.849+0000 7fb9004d3640 1 --2- 172.21.15.38:0/3730673911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8f80ffcf0 0x7fb8f8100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.849+0000 7fb9004d3640 1 --2- 172.21.15.38:0/3730673911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8f80feaf0 0x7fb8f80feef0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.849+0000 7fb9004d3640 1 -- 172.21.15.38:0/3730673911 >> 172.21.15.38:0/3730673911 conn(0x7fb8f80fa280 msgr2=0x7fb8f80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.849+0000 7fb9004d3640 1 -- 172.21.15.38:0/3730673911 shutdown_connections 2024-09-13T18:33:34.852 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.849+0000 7fb9004d3640 1 -- 172.21.15.38:0/3730673911 wait complete. 2024-09-13T18:33:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.849+0000 7fb9004d3640 1 Processor -- start 2024-09-13T18:33:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.849+0000 7fb9004d3640 1 -- start start 2024-09-13T18:33:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.849+0000 7fb9004d3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8f80feaf0 0x7fb8f8068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.849+0000 7fb9004d3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8f80ffcf0 0x7fb8f819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.849+0000 7fb9004d3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f819a8e0 con 0x7fb8f80ffcf0 2024-09-13T18:33:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.849+0000 7fb9004d3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f819aa20 con 0x7fb8f80feaf0 2024-09-13T18:33:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb8fda6e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8f80ffcf0 0x7fb8f819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb8fda6e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8f80ffcf0 0x7fb8f819a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59326/0 (socket says 172.21.15.38:59326) 2024-09-13T18:33:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb8fda6e640 1 -- 172.21.15.38:0/4278061837 learned_addr learned my addr 172.21.15.38:0/4278061837 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb8fe26f640 1 --2- 172.21.15.38:0/4278061837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8f80feaf0 0x7fb8f8068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:34.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb8fda6e640 1 -- 172.21.15.38:0/4278061837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8f80feaf0 msgr2=0x7fb8f8068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb8fda6e640 1 --2- 172.21.15.38:0/4278061837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8f80feaf0 0x7fb8f8068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb8fda6e640 1 -- 172.21.15.38:0/4278061837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f4009900 con 0x7fb8f80ffcf0 2024-09-13T18:33:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb8fe26f640 1 --2- 172.21.15.38:0/4278061837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8f80feaf0 0x7fb8f8068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:33:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb8fda6e640 1 --2- 172.21.15.38:0/4278061837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8f80ffcf0 0x7fb8f819a310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800d8d0 tx=0x7fb8e800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb8ef7fe640 1 -- 172.21.15.38:0/4278061837 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e8009c00 con 0x7fb8f80ffcf0 2024-09-13T18:33:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb8ef7fe640 1 -- 172.21.15.38:0/4278061837 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb8e80044c0 con 0x7fb8f80ffcf0 2024-09-13T18:33:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb9004d3640 1 -- 172.21.15.38:0/4278061837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f819acd0 con 0x7fb8f80ffcf0 2024-09-13T18:33:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb8ef7fe640 1 -- 172.21.15.38:0/4278061837 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8e80049d0 con 0x7fb8f80ffcf0 2024-09-13T18:33:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.850+0000 7fb9004d3640 1 -- 172.21.15.38:0/4278061837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f819b220 con 0x7fb8f80ffcf0 2024-09-13T18:33:34.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.851+0000 7fb9004d3640 1 -- 172.21.15.38:0/4278061837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f81075a0 con 0x7fb8f80ffcf0 2024-09-13T18:33:34.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.852+0000 7fb8ef7fe640 1 -- 172.21.15.38:0/4278061837 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb8e8004020 con 0x7fb8f80ffcf0 2024-09-13T18:33:34.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.852+0000 7fb8ef7fe640 1 --2- 172.21.15.38:0/4278061837 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb8e406cc60 0x7fb8e406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:34.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.852+0000 7fb8ef7fe640 1 -- 172.21.15.38:0/4278061837 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fb8e808c350 con 0x7fb8f80ffcf0 2024-09-13T18:33:34.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.853+0000 7fb8fe26f640 1 --2- 172.21.15.38:0/4278061837 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb8e406cc60 0x7fb8e406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:34.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.853+0000 7fb8fe26f640 1 --2- 172.21.15.38:0/4278061837 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb8e406cc60 0x7fb8e406f120 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb8f402ae90 tx=0x7fb8f4000f40 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:34.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:34.857+0000 7fb8ef7fe640 1 -- 172.21.15.38:0/4278061837 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb8e8056360 con 0x7fb8f80ffcf0 2024-09-13T18:33:35.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:34 smithi149 ceph-mon[76906]: Upgrade: Updating osd.1 2024-09-13T18:33:35.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:34 smithi149 ceph-mon[76906]: Deploying daemon osd.1 on smithi038 2024-09-13T18:33:35.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.045+0000 7fb9004d3640 1 -- 172.21.15.38:0/4278061837 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8f8104640 con 0x7fb8e406cc60 2024-09-13T18:33:35.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.047+0000 7fb8ef7fe640 1 -- 172.21.15.38:0/4278061837 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb8f8104640 con 0x7fb8e406cc60 2024-09-13T18:33:35.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.048+0000 7fb9004d3640 1 -- 172.21.15.38:0/4278061837 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb8e406cc60 msgr2=0x7fb8e406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:35.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.048+0000 7fb9004d3640 1 --2- 172.21.15.38:0/4278061837 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb8e406cc60 0x7fb8e406f120 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb8f402ae90 tx=0x7fb8f4000f40 comp rx=0 tx=0).stop 2024-09-13T18:33:35.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.048+0000 7fb9004d3640 1 -- 172.21.15.38:0/4278061837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8f80ffcf0 msgr2=0x7fb8f819a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:35.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.048+0000 7fb9004d3640 1 --2- 172.21.15.38:0/4278061837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8f80ffcf0 0x7fb8f819a310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800d8d0 tx=0x7fb8e800dd90 comp rx=0 tx=0).stop 2024-09-13T18:33:35.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.048+0000 7fb9004d3640 1 -- 172.21.15.38:0/4278061837 shutdown_connections 2024-09-13T18:33:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.048+0000 7fb9004d3640 1 --2- 172.21.15.38:0/4278061837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb8f80ffcf0 0x7fb8f819a310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.048+0000 7fb9004d3640 1 --2- 172.21.15.38:0/4278061837 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb8e406cc60 0x7fb8e406f120 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.048+0000 7fb9004d3640 1 --2- 172.21.15.38:0/4278061837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8f80feaf0 0x7fb8f8068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.048+0000 7fb9004d3640 1 -- 172.21.15.38:0/4278061837 >> 172.21.15.38:0/4278061837 conn(0x7fb8f80fa280 msgr2=0x7fb8f8102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.049+0000 7fb9004d3640 1 -- 172.21.15.38:0/4278061837 shutdown_connections 2024-09-13T18:33:35.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.049+0000 7fb9004d3640 1 -- 172.21.15.38:0/4278061837 wait complete. 2024-09-13T18:33:35.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.135+0000 7feaea9c8640 1 -- 172.21.15.38:0/1364099382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feae40feaf0 msgr2=0x7feae40feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:35.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.135+0000 7feaea9c8640 1 --2- 172.21.15.38:0/1364099382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feae40feaf0 0x7feae40feef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fead4009880 tx=0x7fead402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.135+0000 7feaea9c8640 1 -- 172.21.15.38:0/1364099382 shutdown_connections 2024-09-13T18:33:35.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.135+0000 7feaea9c8640 1 --2- 172.21.15.38:0/1364099382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae40ffcf0 0x7feae4100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.135+0000 7feaea9c8640 1 --2- 172.21.15.38:0/1364099382 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feae40feaf0 0x7feae40feef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.135+0000 7feaea9c8640 1 -- 172.21.15.38:0/1364099382 >> 172.21.15.38:0/1364099382 conn(0x7feae40fa280 msgr2=0x7feae40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:35.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.135+0000 7feaea9c8640 1 -- 172.21.15.38:0/1364099382 shutdown_connections 2024-09-13T18:33:35.138 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.135+0000 7feaea9c8640 1 -- 172.21.15.38:0/1364099382 wait complete. 2024-09-13T18:33:35.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.136+0000 7feaea9c8640 1 Processor -- start 2024-09-13T18:33:35.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.136+0000 7feaea9c8640 1 -- start start 2024-09-13T18:33:35.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.136+0000 7feaea9c8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feae40feaf0 0x7feae4102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:35.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.136+0000 7feaea9c8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae40ffcf0 0x7feae41010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:35.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.136+0000 7feaea9c8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae4102fe0 con 0x7feae40feaf0 2024-09-13T18:33:35.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.136+0000 7feaea9c8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae4101640 con 0x7feae40ffcf0 2024-09-13T18:33:35.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.136+0000 7feae3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feae40feaf0 0x7feae4102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:35.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.136+0000 7feae3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feae40feaf0 0x7feae4102a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59344/0 (socket says 172.21.15.38:59344) 2024-09-13T18:33:35.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.136+0000 7feae3fff640 1 -- 172.21.15.38:0/3099565601 learned_addr learned my addr 172.21.15.38:0/3099565601 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:35.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.136+0000 7feae37fe640 1 --2- 172.21.15.38:0/3099565601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae40ffcf0 0x7feae41010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:35.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.137+0000 7feae3fff640 1 -- 172.21.15.38:0/3099565601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae40ffcf0 msgr2=0x7feae41010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:35.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.137+0000 7feae3fff640 1 --2- 172.21.15.38:0/3099565601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae40ffcf0 0x7feae41010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.137+0000 7feae3fff640 1 -- 172.21.15.38:0/3099565601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4009560 con 0x7feae40feaf0 2024-09-13T18:33:35.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.137+0000 7feae3fff640 1 --2- 172.21.15.38:0/3099565601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feae40feaf0 0x7feae4102a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fead4006010 tx=0x7fead40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:35.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.137+0000 7feae17fa640 1 -- 172.21.15.38:0/3099565601 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead4004aa0 con 0x7feae40feaf0 2024-09-13T18:33:35.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.137+0000 7feae17fa640 1 -- 172.21.15.38:0/3099565601 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fead4005d50 con 0x7feae40feaf0 2024-09-13T18:33:35.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.137+0000 7feaea9c8640 1 -- 172.21.15.38:0/3099565601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae41018c0 con 0x7feae40feaf0 2024-09-13T18:33:35.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.137+0000 7feae17fa640 1 -- 172.21.15.38:0/3099565601 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead4031950 con 0x7feae40feaf0 2024-09-13T18:33:35.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.137+0000 7feaea9c8640 1 -- 172.21.15.38:0/3099565601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae4101db0 con 0x7feae40feaf0 2024-09-13T18:33:35.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.138+0000 7feaea9c8640 1 -- 172.21.15.38:0/3099565601 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae41075c0 con 0x7feae40feaf0 2024-09-13T18:33:35.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.140+0000 7feae17fa640 1 -- 172.21.15.38:0/3099565601 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fead4004c00 con 0x7feae40feaf0 2024-09-13T18:33:35.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.140+0000 7feae17fa640 1 --2- 172.21.15.38:0/3099565601 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7feacc06cc60 0x7feacc06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:35.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.140+0000 7feae17fa640 1 -- 172.21.15.38:0/3099565601 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fead40ad5c0 con 0x7feae40feaf0 2024-09-13T18:33:35.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.140+0000 7feae37fe640 1 --2- 172.21.15.38:0/3099565601 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7feacc06cc60 0x7feacc06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:35.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.141+0000 7feae37fe640 1 --2- 172.21.15.38:0/3099565601 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7feacc06cc60 0x7feacc06f120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feae4102790 tx=0x7fead8005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:35.151 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.148+0000 7feae17fa640 1 -- 172.21.15.38:0/3099565601 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fead4077660 con 0x7feae40feaf0 2024-09-13T18:33:35.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.333+0000 7feaea9c8640 1 -- 172.21.15.38:0/3099565601 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feae40fc4b0 con 0x7feacc06cc60 2024-09-13T18:33:35.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.343+0000 7feae17fa640 1 -- 172.21.15.38:0/3099565601 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7feae40fc4b0 con 0x7feacc06cc60 2024-09-13T18:33:35.346 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:33:35.346 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (9m) 22s ago 11m 24.1M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:33:35.346 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (11m) 22s ago 11m 8262k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:33:35.346 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (10m) 43s ago 10m 7972k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:33:35.346 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (51s) 22s ago 11m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:33:35.346 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (47s) 43s ago 10m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:33:35.346 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (9m) 22s ago 11m 87.2M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:33:35.346 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (5m) 22s ago 5m 157M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:33:35.346 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (5m) 22s ago 5m 98.5M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:33:35.346 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (5m) 43s ago 5m 25.8M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:33:35.346 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (5m) 43s ago 5m 25.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:33:35.346 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (2m) 22s ago 12m 488M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:33:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (95s) 43s ago 10m 438M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:33:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (80s) 22s ago 12m 44.2M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:33:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (64s) 43s ago 10m 27.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:33:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (11m) 22s ago 11m 15.6M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:33:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (10m) 43s ago 10m 15.7M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:33:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (27s) 22s ago 9m 11.9M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:33:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (8m) 22s ago 8m 256M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f 07986b4ba73b 2024-09-13T18:33:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (8m) 22s ago 8m 213M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f e44cdda01aee 2024-09-13T18:33:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (8m) 43s ago 8m 281M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:33:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (7m) 43s ago 7m 267M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:33:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (7m) 43s ago 7m 227M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:33:35.347 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (100s) 22s ago 10m 51.8M - 2.43.0 a07b618ecd1d c04b1dcdc8c3 2024-09-13T18:33:35.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.345+0000 7feaea9c8640 1 -- 172.21.15.38:0/3099565601 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7feacc06cc60 msgr2=0x7feacc06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:35.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.345+0000 7feaea9c8640 1 --2- 172.21.15.38:0/3099565601 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7feacc06cc60 0x7feacc06f120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feae4102790 tx=0x7fead8005f90 comp rx=0 tx=0).stop 2024-09-13T18:33:35.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.345+0000 7feaea9c8640 1 -- 172.21.15.38:0/3099565601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feae40feaf0 msgr2=0x7feae4102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:35.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.345+0000 7feaea9c8640 1 --2- 172.21.15.38:0/3099565601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feae40feaf0 0x7feae4102a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fead4006010 tx=0x7fead40055a0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.348 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.346+0000 7feaea9c8640 1 -- 172.21.15.38:0/3099565601 shutdown_connections 2024-09-13T18:33:35.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.346+0000 7feaea9c8640 1 --2- 172.21.15.38:0/3099565601 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7feacc06cc60 0x7feacc06f120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.346+0000 7feaea9c8640 1 --2- 172.21.15.38:0/3099565601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feae40ffcf0 0x7feae41010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.346+0000 7feaea9c8640 1 --2- 172.21.15.38:0/3099565601 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7feae40feaf0 0x7feae4102a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.346+0000 7feaea9c8640 1 -- 172.21.15.38:0/3099565601 >> 172.21.15.38:0/3099565601 conn(0x7feae40fa280 msgr2=0x7feae40fbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:35.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.346+0000 7feaea9c8640 1 -- 172.21.15.38:0/3099565601 shutdown_connections 2024-09-13T18:33:35.349 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.346+0000 7feaea9c8640 1 -- 172.21.15.38:0/3099565601 wait complete. 2024-09-13T18:33:35.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.437+0000 7f78565e3640 1 -- 172.21.15.38:0/578082758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7850100630 msgr2=0x7f7850102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:35.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.437+0000 7f78565e3640 1 --2- 172.21.15.38:0/578082758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7850100630 0x7f7850102a20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f78400098b0 tx=0x7f784002a4d0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.437+0000 7f78565e3640 1 -- 172.21.15.38:0/578082758 shutdown_connections 2024-09-13T18:33:35.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.437+0000 7f78565e3640 1 --2- 172.21.15.38:0/578082758 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7850102f60 0x7f7850105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.437+0000 7f78565e3640 1 --2- 172.21.15.38:0/578082758 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7850100630 0x7f7850102a20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.437+0000 7f78565e3640 1 -- 172.21.15.38:0/578082758 >> 172.21.15.38:0/578082758 conn(0x7f78500fa250 msgr2=0x7f78500fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:35.440 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.437+0000 7f78565e3640 1 -- 172.21.15.38:0/578082758 shutdown_connections 2024-09-13T18:33:35.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.437+0000 7f78565e3640 1 -- 172.21.15.38:0/578082758 wait complete. 2024-09-13T18:33:35.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.438+0000 7f78565e3640 1 Processor -- start 2024-09-13T18:33:35.441 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.438+0000 7f78565e3640 1 -- start start 2024-09-13T18:33:35.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.438+0000 7f78565e3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7850100630 0x7f78500fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:35.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.438+0000 7f78565e3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7850102f60 0x7f78500fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:35.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.438+0000 7f78565e3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78500feb20 con 0x7f7850100630 2024-09-13T18:33:35.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.438+0000 7f78565e3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78500fec90 con 0x7f7850102f60 2024-09-13T18:33:35.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.438+0000 7f784ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7850100630 0x7f78500fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:35.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.438+0000 7f784ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7850100630 0x7f78500fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59352/0 (socket says 172.21.15.38:59352) 2024-09-13T18:33:35.442 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.438+0000 7f784ffff640 1 -- 172.21.15.38:0/950262233 learned_addr learned my addr 172.21.15.38:0/950262233 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:35.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.438+0000 7f784f7fe640 1 --2- 172.21.15.38:0/950262233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7850102f60 0x7f78500fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:35.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.439+0000 7f784ffff640 1 -- 172.21.15.38:0/950262233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7850102f60 msgr2=0x7f78500fe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:35.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.439+0000 7f784ffff640 1 --2- 172.21.15.38:0/950262233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7850102f60 0x7f78500fe5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.439+0000 7f784ffff640 1 -- 172.21.15.38:0/950262233 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840009560 con 0x7f7850100630 2024-09-13T18:33:35.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.439+0000 7f784ffff640 1 --2- 172.21.15.38:0/950262233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7850100630 0x7f78500fff90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7840006010 tx=0x7f78400055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:35.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.439+0000 7f784d7fa640 1 -- 172.21.15.38:0/950262233 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7840004b20 con 0x7f7850100630 2024-09-13T18:33:35.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.439+0000 7f784d7fa640 1 -- 172.21.15.38:0/950262233 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7840004c80 con 0x7f7850100630 2024-09-13T18:33:35.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.439+0000 7f78565e3640 1 -- 172.21.15.38:0/950262233 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78500fef10 con 0x7f7850100630 2024-09-13T18:33:35.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.439+0000 7f78565e3640 1 -- 172.21.15.38:0/950262233 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785019d5e0 con 0x7f7850100630 2024-09-13T18:33:35.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.439+0000 7f784d7fa640 1 -- 172.21.15.38:0/950262233 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7840031b00 con 0x7f7850100630 2024-09-13T18:33:35.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.440+0000 7f78565e3640 1 -- 172.21.15.38:0/950262233 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7850100a10 con 0x7f7850100630 2024-09-13T18:33:35.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.441+0000 7f784d7fa640 1 -- 172.21.15.38:0/950262233 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f78400035f0 con 0x7f7850100630 2024-09-13T18:33:35.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.441+0000 7f784d7fa640 1 --2- 172.21.15.38:0/950262233 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f783806cc60 0x7f783806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:35.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.441+0000 7f784d7fa640 1 -- 172.21.15.38:0/950262233 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f78400ad770 con 0x7f7850100630 2024-09-13T18:33:35.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.441+0000 7f784f7fe640 1 --2- 172.21.15.38:0/950262233 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f783806cc60 0x7f783806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:35.445 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.442+0000 7f784f7fe640 1 --2- 172.21.15.38:0/950262233 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f783806cc60 0x7f783806f120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f78500ffd10 tx=0x7f784400a250 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:35.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.445+0000 7f784d7fa640 1 -- 172.21.15.38:0/950262233 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f78400778b0 con 0x7f7850100630 2024-09-13T18:33:35.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.687+0000 7f78565e3640 1 -- 172.21.15.38:0/950262233 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7850108860 con 0x7f7850100630 2024-09-13T18:33:35.690 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:35 smithi038 ceph-mon[91522]: pgmap v96: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 0 B/s, 1 objects/s recovering 2024-09-13T18:33:35.690 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:35 smithi038 ceph-mon[91522]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:35.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.687+0000 7f784d7fa640 1 -- 172.21.15.38:0/950262233 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f784007aed0 con 0x7f7850100630 2024-09-13T18:33:35.690 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:33:35.690 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:33:35.690 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 5, 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 1 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 9, 2024-09-13T18:33:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 5 2024-09-13T18:33:35.692 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:33:35.692 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:33:35.692 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.690+0000 7f78565e3640 1 -- 172.21.15.38:0/950262233 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f783806cc60 msgr2=0x7f783806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:35.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.690+0000 7f78565e3640 1 --2- 172.21.15.38:0/950262233 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f783806cc60 0x7f783806f120 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f78500ffd10 tx=0x7f784400a250 comp rx=0 tx=0).stop 2024-09-13T18:33:35.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.690+0000 7f78565e3640 1 -- 172.21.15.38:0/950262233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7850100630 msgr2=0x7f78500fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:35.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.690+0000 7f78565e3640 1 --2- 172.21.15.38:0/950262233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7850100630 0x7f78500fff90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7840006010 tx=0x7f78400055f0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.690+0000 7f78565e3640 1 -- 172.21.15.38:0/950262233 shutdown_connections 2024-09-13T18:33:35.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.690+0000 7f78565e3640 1 --2- 172.21.15.38:0/950262233 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f783806cc60 0x7f783806f120 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.690+0000 7f78565e3640 1 --2- 172.21.15.38:0/950262233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7850102f60 0x7f78500fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.690+0000 7f78565e3640 1 --2- 172.21.15.38:0/950262233 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7850100630 0x7f78500fff90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.690+0000 7f78565e3640 1 -- 172.21.15.38:0/950262233 >> 172.21.15.38:0/950262233 conn(0x7f78500fa250 msgr2=0x7f78500fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:35.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.690+0000 7f78565e3640 1 -- 172.21.15.38:0/950262233 shutdown_connections 2024-09-13T18:33:35.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.690+0000 7f78565e3640 1 -- 172.21.15.38:0/950262233 wait complete. 2024-09-13T18:33:35.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.777+0000 7fcaf720a640 1 -- 172.21.15.38:0/3218880319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf00ffc80 msgr2=0x7fcaf0100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:35.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.777+0000 7fcaf720a640 1 --2- 172.21.15.38:0/3218880319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf00ffc80 0x7fcaf0100100 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009880 tx=0x7fcadc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.777+0000 7fcaf720a640 1 -- 172.21.15.38:0/3218880319 shutdown_connections 2024-09-13T18:33:35.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.777+0000 7fcaf720a640 1 --2- 172.21.15.38:0/3218880319 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf00ffc80 0x7fcaf0100100 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.777+0000 7fcaf720a640 1 --2- 172.21.15.38:0/3218880319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcaf00fea80 0x7fcaf00fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.777+0000 7fcaf720a640 1 -- 172.21.15.38:0/3218880319 >> 172.21.15.38:0/3218880319 conn(0x7fcaf00fa230 msgr2=0x7fcaf00fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.777+0000 7fcaf720a640 1 -- 172.21.15.38:0/3218880319 shutdown_connections 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.777+0000 7fcaf720a640 1 -- 172.21.15.38:0/3218880319 wait complete. 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaf720a640 1 Processor -- start 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaf720a640 1 -- start start 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaf720a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf00fea80 0x7fcaf0194430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaf720a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcaf00ffc80 0x7fcaf0194970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaf720a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf0194f40 con 0x7fcaf00fea80 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaf720a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf01950b0 con 0x7fcaf00ffc80 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaf4fa6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf00fea80 0x7fcaf0194430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaf4fa6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf00fea80 0x7fcaf0194430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59360/0 (socket says 172.21.15.38:59360) 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaf4fa6640 1 -- 172.21.15.38:0/501625966 learned_addr learned my addr 172.21.15.38:0/501625966 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaeffff640 1 --2- 172.21.15.38:0/501625966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcaf00ffc80 0x7fcaf0194970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaf4fa6640 1 -- 172.21.15.38:0/501625966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcaf00ffc80 msgr2=0x7fcaf0194970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaf4fa6640 1 --2- 172.21.15.38:0/501625966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcaf00ffc80 0x7fcaf0194970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.778+0000 7fcaf4fa6640 1 -- 172.21.15.38:0/501625966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc009560 con 0x7fcaf00fea80 2024-09-13T18:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.779+0000 7fcaf4fa6640 1 --2- 172.21.15.38:0/501625966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf00fea80 0x7fcaf0194430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009880 tx=0x7fcae4009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.779+0000 7fcaedffb640 1 -- 172.21.15.38:0/501625966 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae4012070 con 0x7fcaf00fea80 2024-09-13T18:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.779+0000 7fcaedffb640 1 -- 172.21.15.38:0/501625966 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcae4007d90 con 0x7fcaf00fea80 2024-09-13T18:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.779+0000 7fcaf720a640 1 -- 172.21.15.38:0/501625966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf00684b0 con 0x7fcaf00fea80 2024-09-13T18:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.779+0000 7fcaedffb640 1 -- 172.21.15.38:0/501625966 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae4018e80 con 0x7fcaf00fea80 2024-09-13T18:33:35.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.779+0000 7fcaf720a640 1 -- 172.21.15.38:0/501625966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf0068a80 con 0x7fcaf00fea80 2024-09-13T18:33:35.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.780+0000 7fcaf720a640 1 -- 172.21.15.38:0/501625966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf0107550 con 0x7fcaf00fea80 2024-09-13T18:33:35.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.781+0000 7fcaedffb640 1 -- 172.21.15.38:0/501625966 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcae4016070 con 0x7fcaf00fea80 2024-09-13T18:33:35.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.781+0000 7fcaedffb640 1 --2- 172.21.15.38:0/501625966 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcae006cc50 0x7fcae006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:35.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.781+0000 7fcaedffb640 1 -- 172.21.15.38:0/501625966 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fcae408d8e0 con 0x7fcaf00fea80 2024-09-13T18:33:35.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.781+0000 7fcaeffff640 1 --2- 172.21.15.38:0/501625966 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcae006cc50 0x7fcae006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:35.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.782+0000 7fcaeffff640 1 --2- 172.21.15.38:0/501625966 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcae006cc50 0x7fcae006f110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0195950 tx=0x7fcadc031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:35.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.786+0000 7fcaedffb640 1 -- 172.21.15.38:0/501625966 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcae4057a20 con 0x7fcaf00fea80 2024-09-13T18:33:35.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.995+0000 7fcaf720a640 1 -- 172.21.15.38:0/501625966 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcaf00008d0 con 0x7fcaf00fea80 2024-09-13T18:33:35.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.995+0000 7fcaedffb640 1 -- 172.21.15.38:0/501625966 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7fcae405b040 con 0x7fcaf00fea80 2024-09-13T18:33:35.998 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:33:35.998 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:33:35.998 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:33:35.998 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:33:35.998 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:33:35.999 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:33:36.000 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:33:36.001 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:33:36.001 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:33:36.001 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:33:36.001 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:33:36.001 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:33:36.001 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:33:36.001 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:33:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:33:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.998+0000 7fcaf720a640 1 -- 172.21.15.38:0/501625966 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcae006cc50 msgr2=0x7fcae006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.998+0000 7fcaf720a640 1 --2- 172.21.15.38:0/501625966 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcae006cc50 0x7fcae006f110 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0195950 tx=0x7fcadc031400 comp rx=0 tx=0).stop 2024-09-13T18:33:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.998+0000 7fcaf720a640 1 -- 172.21.15.38:0/501625966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf00fea80 msgr2=0x7fcaf0194430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.998+0000 7fcaf720a640 1 --2- 172.21.15.38:0/501625966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf00fea80 0x7fcaf0194430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009880 tx=0x7fcae4009d40 comp rx=0 tx=0).stop 2024-09-13T18:33:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.998+0000 7fcaf720a640 1 -- 172.21.15.38:0/501625966 shutdown_connections 2024-09-13T18:33:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.998+0000 7fcaf720a640 1 --2- 172.21.15.38:0/501625966 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcae006cc50 0x7fcae006f110 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.998+0000 7fcaf720a640 1 --2- 172.21.15.38:0/501625966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcaf00ffc80 0x7fcaf0194970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.998+0000 7fcaf720a640 1 --2- 172.21.15.38:0/501625966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcaf00fea80 0x7fcaf0194430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.998+0000 7fcaf720a640 1 -- 172.21.15.38:0/501625966 >> 172.21.15.38:0/501625966 conn(0x7fcaf00fa230 msgr2=0x7fcaf0102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.998+0000 7fcaf720a640 1 -- 172.21.15.38:0/501625966 shutdown_connections 2024-09-13T18:33:36.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:35.998+0000 7fcaf720a640 1 -- 172.21.15.38:0/501625966 wait complete. 2024-09-13T18:33:36.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:35 smithi149 ceph-mon[76906]: pgmap v96: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 0 B/s, 1 objects/s recovering 2024-09-13T18:33:36.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:35 smithi149 ceph-mon[76906]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:36.089 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.087+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/2222360356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ec0feaf0 msgr2=0x7fd2ec0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:36.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.087+0000 7fd2f0fd0640 1 --2- 172.21.15.38:0/2222360356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ec0feaf0 0x7fd2ec0feef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009880 tx=0x7fd2dc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.087+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/2222360356 shutdown_connections 2024-09-13T18:33:36.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.087+0000 7fd2f0fd0640 1 --2- 172.21.15.38:0/2222360356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2ec0ffcf0 0x7fd2ec100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.087+0000 7fd2f0fd0640 1 --2- 172.21.15.38:0/2222360356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ec0feaf0 0x7fd2ec0feef0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.087+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/2222360356 >> 172.21.15.38:0/2222360356 conn(0x7fd2ec0fa280 msgr2=0x7fd2ec0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:36.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.087+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/2222360356 shutdown_connections 2024-09-13T18:33:36.090 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.087+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/2222360356 wait complete. 2024-09-13T18:33:36.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.088+0000 7fd2f0fd0640 1 Processor -- start 2024-09-13T18:33:36.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.088+0000 7fd2f0fd0640 1 -- start start 2024-09-13T18:33:36.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.088+0000 7fd2f0fd0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ec0feaf0 0x7fd2ec102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:36.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.088+0000 7fd2f0fd0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2ec0ffcf0 0x7fd2ec1010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:36.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.088+0000 7fd2f0fd0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec102fe0 con 0x7fd2ec0feaf0 2024-09-13T18:33:36.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.088+0000 7fd2f0fd0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec101640 con 0x7fd2ec0ffcf0 2024-09-13T18:33:36.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.088+0000 7fd2ea59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ec0feaf0 0x7fd2ec102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:36.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.088+0000 7fd2ea59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ec0feaf0 0x7fd2ec102a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59372/0 (socket says 172.21.15.38:59372) 2024-09-13T18:33:36.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.088+0000 7fd2ea59c640 1 -- 172.21.15.38:0/878184120 learned_addr learned my addr 172.21.15.38:0/878184120 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:36.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.088+0000 7fd2e9d9b640 1 --2- 172.21.15.38:0/878184120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2ec0ffcf0 0x7fd2ec1010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:36.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.088+0000 7fd2ea59c640 1 -- 172.21.15.38:0/878184120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2ec0ffcf0 msgr2=0x7fd2ec1010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:36.092 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.088+0000 7fd2ea59c640 1 --2- 172.21.15.38:0/878184120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2ec0ffcf0 0x7fd2ec1010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.089+0000 7fd2ea59c640 1 -- 172.21.15.38:0/878184120 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc009560 con 0x7fd2ec0feaf0 2024-09-13T18:33:36.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.089+0000 7fd2ea59c640 1 --2- 172.21.15.38:0/878184120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ec0feaf0 0x7fd2ec102a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0054f0 tx=0x7fd2dc005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:36.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.089+0000 7fd2db7fe640 1 -- 172.21.15.38:0/878184120 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2dc004aa0 con 0x7fd2ec0feaf0 2024-09-13T18:33:36.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.089+0000 7fd2db7fe640 1 -- 172.21.15.38:0/878184120 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd2dc004c00 con 0x7fd2ec0feaf0 2024-09-13T18:33:36.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.089+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/878184120 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ec1018c0 con 0x7fd2ec0feaf0 2024-09-13T18:33:36.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.089+0000 7fd2db7fe640 1 -- 172.21.15.38:0/878184120 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2dc0319f0 con 0x7fd2ec0feaf0 2024-09-13T18:33:36.093 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.089+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/878184120 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ec101db0 con 0x7fd2ec0feaf0 2024-09-13T18:33:36.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.090+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/878184120 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ec1075c0 con 0x7fd2ec0feaf0 2024-09-13T18:33:36.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.090+0000 7fd2db7fe640 1 -- 172.21.15.38:0/878184120 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd2dc003c90 con 0x7fd2ec0feaf0 2024-09-13T18:33:36.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.091+0000 7fd2db7fe640 1 --2- 172.21.15.38:0/878184120 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2d406cc50 0x7fd2d406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:36.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.091+0000 7fd2db7fe640 1 -- 172.21.15.38:0/878184120 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fd2dc0ad670 con 0x7fd2ec0feaf0 2024-09-13T18:33:36.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.091+0000 7fd2e9d9b640 1 --2- 172.21.15.38:0/878184120 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2d406cc50 0x7fd2d406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:36.094 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.092+0000 7fd2e9d9b640 1 --2- 172.21.15.38:0/878184120 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2d406cc50 0x7fd2d406f110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec102790 tx=0x7fd2e000b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:36.098 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.095+0000 7fd2db7fe640 1 -- 172.21.15.38:0/878184120 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd2dc0777b0 con 0x7fd2ec0feaf0 2024-09-13T18:33:36.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.284+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/878184120 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2ec0fc4b0 con 0x7fd2d406cc50 2024-09-13T18:33:36.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.285+0000 7fd2db7fe640 1 -- 172.21.15.38:0/878184120 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd2ec0fc4b0 con 0x7fd2d406cc50 2024-09-13T18:33:36.288 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:33:36.288 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:33:36.288 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:33:36.288 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:33:36.288 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:33:36.288 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr", 2024-09-13T18:33:36.288 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-13T18:33:36.288 INFO:teuthology.orchestra.run.smithi038.stdout: "mon" 2024-09-13T18:33:36.288 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:33:36.288 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "7/23 daemons upgraded", 2024-09-13T18:33:36.289 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T18:33:36.289 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:33:36.289 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:33:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.287+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/878184120 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2d406cc50 msgr2=0x7fd2d406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.287+0000 7fd2f0fd0640 1 --2- 172.21.15.38:0/878184120 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2d406cc50 0x7fd2d406f110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec102790 tx=0x7fd2e000b390 comp rx=0 tx=0).stop 2024-09-13T18:33:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.287+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/878184120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ec0feaf0 msgr2=0x7fd2ec102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.287+0000 7fd2f0fd0640 1 --2- 172.21.15.38:0/878184120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ec0feaf0 0x7fd2ec102a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0054f0 tx=0x7fd2dc005520 comp rx=0 tx=0).stop 2024-09-13T18:33:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.287+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/878184120 shutdown_connections 2024-09-13T18:33:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.287+0000 7fd2f0fd0640 1 --2- 172.21.15.38:0/878184120 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2d406cc50 0x7fd2d406f110 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.287+0000 7fd2f0fd0640 1 --2- 172.21.15.38:0/878184120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2ec0ffcf0 0x7fd2ec1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.287+0000 7fd2f0fd0640 1 --2- 172.21.15.38:0/878184120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2ec0feaf0 0x7fd2ec102a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.287+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/878184120 >> 172.21.15.38:0/878184120 conn(0x7fd2ec0fa280 msgr2=0x7fd2ec0fbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:36.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.287+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/878184120 shutdown_connections 2024-09-13T18:33:36.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.287+0000 7fd2f0fd0640 1 -- 172.21.15.38:0/878184120 wait complete. 2024-09-13T18:33:36.374 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.372+0000 7f3f5536b640 1 -- 172.21.15.38:0/3244910973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f500feaf0 msgr2=0x7f3f500feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:36.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.372+0000 7f3f5536b640 1 --2- 172.21.15.38:0/3244910973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f500feaf0 0x7f3f500feef0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009880 tx=0x7f3f4002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.372+0000 7f3f5536b640 1 -- 172.21.15.38:0/3244910973 shutdown_connections 2024-09-13T18:33:36.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.372+0000 7f3f5536b640 1 --2- 172.21.15.38:0/3244910973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f500ffcf0 0x7f3f50100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.372+0000 7f3f5536b640 1 --2- 172.21.15.38:0/3244910973 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f500feaf0 0x7f3f500feef0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.372+0000 7f3f5536b640 1 -- 172.21.15.38:0/3244910973 >> 172.21.15.38:0/3244910973 conn(0x7f3f500fa280 msgr2=0x7f3f500fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:36.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.372+0000 7f3f5536b640 1 -- 172.21.15.38:0/3244910973 shutdown_connections 2024-09-13T18:33:36.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.372+0000 7f3f5536b640 1 -- 172.21.15.38:0/3244910973 wait complete. 2024-09-13T18:33:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f5536b640 1 Processor -- start 2024-09-13T18:33:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f5536b640 1 -- start start 2024-09-13T18:33:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f5536b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f500feaf0 0x7f3f50195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f5536b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f500ffcf0 0x7f3f50195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f5536b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50196180 con 0x7f3f500feaf0 2024-09-13T18:33:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f5536b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f501962f0 con 0x7f3f500ffcf0 2024-09-13T18:33:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f4effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f500feaf0 0x7f3f50195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f4effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f500feaf0 0x7f3f50195670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:59392/0 (socket says 172.21.15.38:59392) 2024-09-13T18:33:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f4effd640 1 -- 172.21.15.38:0/9176988 learned_addr learned my addr 172.21.15.38:0/9176988 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:33:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f4effd640 1 -- 172.21.15.38:0/9176988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f500ffcf0 msgr2=0x7f3f50195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:36.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f4e7fc640 1 --2- 172.21.15.38:0/9176988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f500ffcf0 0x7f3f50195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:36.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f4effd640 1 --2- 172.21.15.38:0/9176988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f500ffcf0 0x7f3f50195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.373+0000 7f3f4effd640 1 -- 172.21.15.38:0/9176988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f40009560 con 0x7f3f500feaf0 2024-09-13T18:33:36.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.374+0000 7f3f4effd640 1 --2- 172.21.15.38:0/9176988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f500feaf0 0x7f3f50195670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f400055a0 tx=0x7f3f400055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:36.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.374+0000 7f3f37fff640 1 -- 172.21.15.38:0/9176988 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f40004aa0 con 0x7f3f500feaf0 2024-09-13T18:33:36.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.374+0000 7f3f37fff640 1 -- 172.21.15.38:0/9176988 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3f40005d50 con 0x7f3f500feaf0 2024-09-13T18:33:36.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.374+0000 7f3f5536b640 1 -- 172.21.15.38:0/9176988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5019acc0 con 0x7f3f500feaf0 2024-09-13T18:33:36.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.374+0000 7f3f37fff640 1 -- 172.21.15.38:0/9176988 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f40031840 con 0x7f3f500feaf0 2024-09-13T18:33:36.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.374+0000 7f3f5536b640 1 -- 172.21.15.38:0/9176988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5019b1b0 con 0x7f3f500feaf0 2024-09-13T18:33:36.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.375+0000 7f3f5536b640 1 -- 172.21.15.38:0/9176988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f501075c0 con 0x7f3f500feaf0 2024-09-13T18:33:36.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.375+0000 7f3f37fff640 1 -- 172.21.15.38:0/9176988 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3f40004c00 con 0x7f3f500feaf0 2024-09-13T18:33:36.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.376+0000 7f3f37fff640 1 --2- 172.21.15.38:0/9176988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f3f3806cc50 0x7f3f3806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:33:36.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.376+0000 7f3f37fff640 1 -- 172.21.15.38:0/9176988 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f3f400ad670 con 0x7f3f500feaf0 2024-09-13T18:33:36.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.376+0000 7f3f4e7fc640 1 --2- 172.21.15.38:0/9176988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f3f3806cc50 0x7f3f3806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:33:36.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.377+0000 7f3f4e7fc640 1 --2- 172.21.15.38:0/9176988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f3f3806cc50 0x7f3f3806f110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3f50196b20 tx=0x7f3f44005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:33:36.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.380+0000 7f3f37fff640 1 -- 172.21.15.38:0/9176988 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3f40077700 con 0x7f3f500feaf0 2024-09-13T18:33:36.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.632+0000 7f3f5536b640 1 -- 172.21.15.38:0/9176988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3f50107750 con 0x7f3f500feaf0 2024-09-13T18:33:36.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.632+0000 7f3f37fff640 1 -- 172.21.15.38:0/9176988 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3f4007ad20 con 0x7f3f500feaf0 2024-09-13T18:33:36.635 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:33:36.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.634+0000 7f3f5536b640 1 -- 172.21.15.38:0/9176988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f3f3806cc50 msgr2=0x7f3f3806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:36.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.634+0000 7f3f5536b640 1 --2- 172.21.15.38:0/9176988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f3f3806cc50 0x7f3f3806f110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3f50196b20 tx=0x7f3f44005f90 comp rx=0 tx=0).stop 2024-09-13T18:33:36.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.634+0000 7f3f5536b640 1 -- 172.21.15.38:0/9176988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f500feaf0 msgr2=0x7f3f50195670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:33:36.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.634+0000 7f3f5536b640 1 --2- 172.21.15.38:0/9176988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f500feaf0 0x7f3f50195670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f400055a0 tx=0x7f3f400055d0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.634+0000 7f3f5536b640 1 -- 172.21.15.38:0/9176988 shutdown_connections 2024-09-13T18:33:36.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.634+0000 7f3f5536b640 1 --2- 172.21.15.38:0/9176988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f3f3806cc50 0x7f3f3806f110 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.634+0000 7f3f5536b640 1 --2- 172.21.15.38:0/9176988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f500ffcf0 0x7f3f50195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.634+0000 7f3f5536b640 1 --2- 172.21.15.38:0/9176988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3f500feaf0 0x7f3f50195670 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:33:36.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.634+0000 7f3f5536b640 1 -- 172.21.15.38:0/9176988 >> 172.21.15.38:0/9176988 conn(0x7f3f500fa280 msgr2=0x7f3f500fbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:33:36.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.634+0000 7f3f5536b640 1 -- 172.21.15.38:0/9176988 shutdown_connections 2024-09-13T18:33:36.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:33:36.634+0000 7f3f5536b640 1 -- 172.21.15.38:0/9176988 wait complete. 2024-09-13T18:33:37.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:36 smithi149 ceph-mon[76906]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:37.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:36 smithi149 ceph-mon[76906]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:37.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:36 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/950262233' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:37.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:36 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/501625966' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:33:37.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:37.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:33:37.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:36 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/9176988' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:33:37.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:36 smithi038 ceph-mon[91522]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:37.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:36 smithi038 ceph-mon[91522]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:37.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:36 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/950262233' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:37.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:36 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/501625966' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:33:37.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:37.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:33:37.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:36 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/9176988' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:33:37.083 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:36 smithi038 systemd[1]: Stopping Ceph osd.1 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:33:37.581 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:37 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1[53752]: 2024-09-13T18:33:37.179+0000 7f8bf542d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:33:37.581 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:37 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1[53752]: 2024-09-13T18:33:37.179+0000 7f8bf542d640 -1 osd.1 68 *** Got signal Terminated *** 2024-09-13T18:33:37.581 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:37 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1[53752]: 2024-09-13T18:33:37.179+0000 7f8bf542d640 -1 osd.1 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:33:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:37 smithi149 ceph-mon[76906]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:37 smithi149 ceph-mon[76906]: pgmap v97: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:33:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:37 smithi149 ceph-mon[76906]: osd.1 marked itself down and dead 2024-09-13T18:33:38.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:37 smithi038 ceph-mon[91522]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:33:38.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:37 smithi038 ceph-mon[91522]: pgmap v97: 65 pgs: 65 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:33:38.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:37 smithi038 ceph-mon[91522]: osd.1 marked itself down and dead 2024-09-13T18:33:38.458 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:38 smithi038 podman[105969]: 2024-09-13 18:33:38.135493754 +0000 UTC m=+1.100447151 container died 07986b4ba73bf907d75cc9eeb3eac34a94e241e510f13398e7b8424cd3a71146 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-e4e227b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-13T18:33:38.822 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:38 smithi149 ceph-mon[76906]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T18:33:38.822 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:38 smithi149 ceph-mon[76906]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T18:33:38.822 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:38 smithi149 ceph-mon[76906]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T18:33:38.831 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:38 smithi038 podman[105969]: 2024-09-13 18:33:38.638425164 +0000 UTC m=+1.603378562 container cleanup 07986b4ba73bf907d75cc9eeb3eac34a94e241e510f13398e7b8424cd3a71146 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=reef-e4e227b) 2024-09-13T18:33:38.831 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:38 smithi038 bash[105969]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1 2024-09-13T18:33:38.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:38 smithi038 ceph-mon[91522]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T18:33:38.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:38 smithi038 ceph-mon[91522]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T18:33:38.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:38 smithi038 ceph-mon[91522]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T18:33:39.227 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:38 smithi038 podman[105995]: 2024-09-13 18:33:38.890089096 +0000 UTC m=+0.752820311 container remove 07986b4ba73bf907d75cc9eeb3eac34a94e241e510f13398e7b8424cd3a71146 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=reef-e4e227b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T18:33:39.496 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:39 smithi038 podman[106083]: 2024-09-13 18:33:39.128405221 +0000 UTC m=+0.016714025 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:33:39.496 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:39 smithi038 podman[106083]: 2024-09-13 18:33:39.241114857 +0000 UTC m=+0.129423690 container create 36dcaf5dfd52e64309e0fba18ddf153aecb3ace35355b6afe7fb7a50cda06967 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:33:39.496 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:39 smithi038 podman[106083]: 2024-09-13 18:33:39.494066494 +0000 UTC m=+0.382375295 container init 36dcaf5dfd52e64309e0fba18ddf153aecb3ace35355b6afe7fb7a50cda06967 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:33:39.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:39 smithi038 ceph-mon[91522]: pgmap v99: 65 pgs: 11 stale+active+clean, 54 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T18:33:39.832 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:39 smithi038 podman[106083]: 2024-09-13 18:33:39.497546864 +0000 UTC m=+0.385855662 container start 36dcaf5dfd52e64309e0fba18ddf153aecb3ace35355b6afe7fb7a50cda06967 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:33:39.832 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:39 smithi038 podman[106083]: 2024-09-13 18:33:39.577047975 +0000 UTC m=+0.465356775 container attach 36dcaf5dfd52e64309e0fba18ddf153aecb3ace35355b6afe7fb7a50cda06967 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T18:33:39.832 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:39 smithi038 podman[106083]: 2024-09-13 18:33:39.689981765 +0000 UTC m=+0.578290557 container died 36dcaf5dfd52e64309e0fba18ddf153aecb3ace35355b6afe7fb7a50cda06967 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T18:33:40.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:39 smithi149 ceph-mon[76906]: pgmap v99: 65 pgs: 11 stale+active+clean, 54 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T18:33:40.595 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:40 smithi038 podman[106107]: 2024-09-13 18:33:40.331300614 +0000 UTC m=+0.631164431 container remove 36dcaf5dfd52e64309e0fba18ddf153aecb3ace35355b6afe7fb7a50cda06967 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-13T18:33:40.595 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:40 smithi038 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-13T18:33:40.595 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:40 smithi038 systemd[1]: Stopped Ceph osd.1 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:33:40.595 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:40 smithi038 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 9.844s CPU time. 2024-09-13T18:33:40.921 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:40 smithi038 ceph-mon[91522]: Health check failed: Degraded data redundancy: 5/282 objects degraded (1.773%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T18:33:40.922 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:40 smithi038 systemd[1]: Starting Ceph osd.1 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:33:40.922 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:40 smithi038 podman[106204]: 2024-09-13 18:33:40.710390501 +0000 UTC m=+0.016528025 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:33:40.922 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:40 smithi038 podman[106204]: 2024-09-13 18:33:40.816121274 +0000 UTC m=+0.122258859 container create 9406ce2e6a2d42629348520411319d75f8752908f2b6bd3c2b729cd67b262b5e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:33:41.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:40 smithi149 ceph-mon[76906]: Health check failed: Degraded data redundancy: 5/282 objects degraded (1.773%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T18:33:41.331 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 podman[106204]: 2024-09-13 18:33:41.043803722 +0000 UTC m=+0.349941245 container init 9406ce2e6a2d42629348520411319d75f8752908f2b6bd3c2b729cd67b262b5e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-09-13T18:33:41.331 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 podman[106204]: 2024-09-13 18:33:41.047144794 +0000 UTC m=+0.353282317 container start 9406ce2e6a2d42629348520411319d75f8752908f2b6bd3c2b729cd67b262b5e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T18:33:41.331 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 podman[106204]: 2024-09-13 18:33:41.143717196 +0000 UTC m=+0.449854722 container attach 9406ce2e6a2d42629348520411319d75f8752908f2b6bd3c2b729cd67b262b5e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T18:33:41.716 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate[106219]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:33:41.717 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 bash[106204]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:33:41.717 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate[106219]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T18:33:41.717 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 bash[106204]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T18:33:41.717 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate[106219]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T18:33:41.717 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 bash[106204]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T18:33:41.718 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate[106219]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T18:33:41.718 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 bash[106204]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T18:33:41.718 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate[106219]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T18:33:41.718 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 bash[106204]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T18:33:41.718 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate[106219]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:33:41.718 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 bash[106204]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:33:41.718 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate[106219]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T18:33:41.718 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 bash[106204]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T18:33:41.718 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:41 smithi038 podman[106204]: 2024-09-13 18:33:41.407013922 +0000 UTC m=+0.713151448 container died 9406ce2e6a2d42629348520411319d75f8752908f2b6bd3c2b729cd67b262b5e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:33:42.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:41 smithi149 ceph-mon[76906]: pgmap v101: 65 pgs: 4 active+undersized, 7 stale+active+clean, 3 active+undersized+degraded, 51 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 5/282 objects degraded (1.773%) 2024-09-13T18:33:42.025 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:41 smithi038 ceph-mon[91522]: pgmap v101: 65 pgs: 4 active+undersized, 7 stale+active+clean, 3 active+undersized+degraded, 51 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 5/282 objects degraded (1.773%) 2024-09-13T18:33:42.331 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:42 smithi038 podman[106340]: 2024-09-13 18:33:42.023336427 +0000 UTC m=+0.610144963 container remove 9406ce2e6a2d42629348520411319d75f8752908f2b6bd3c2b729cd67b262b5e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:33:42.331 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:42 smithi038 podman[106400]: 2024-09-13 18:33:42.13863822 +0000 UTC m=+0.016835185 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:33:42.331 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:42 smithi038 podman[106400]: 2024-09-13 18:33:42.266142378 +0000 UTC m=+0.144339388 container create b2f99a2919b92ac33d06fe2ae40b3701d2da5c7f0faf0e9f981ca90365dc5e4d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T18:33:42.831 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:42 smithi038 podman[106400]: 2024-09-13 18:33:42.510205862 +0000 UTC m=+0.388402827 container init b2f99a2919b92ac33d06fe2ae40b3701d2da5c7f0faf0e9f981ca90365dc5e4d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:33:42.831 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:42 smithi038 podman[106400]: 2024-09-13 18:33:42.513662243 +0000 UTC m=+0.391859214 container start b2f99a2919b92ac33d06fe2ae40b3701d2da5c7f0faf0e9f981ca90365dc5e4d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-13T18:33:42.831 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:42 smithi038 ceph-osd[106419]: -- 172.21.15.38:0/3373276887 <== mon.0 v2:172.21.15.38:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564f9cbad1e0 con 0x564f9d92c000 2024-09-13T18:33:42.832 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:42 smithi038 bash[106400]: b2f99a2919b92ac33d06fe2ae40b3701d2da5c7f0faf0e9f981ca90365dc5e4d 2024-09-13T18:33:42.832 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:42 smithi038 systemd[1]: Started Ceph osd.1 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:33:43.331 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:43 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1[106415]: 2024-09-13T18:33:43.049+0000 7efd1fbb3640 -1 Falling back to public interface 2024-09-13T18:33:43.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:43 smithi038 ceph-mon[91522]: pgmap v102: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 43/282 objects degraded (15.248%) 2024-09-13T18:33:43.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:43.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:43.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:33:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:43 smithi149 ceph-mon[76906]: pgmap v102: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 43/282 objects degraded (15.248%) 2024-09-13T18:33:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:44.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:33:46.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:45 smithi149 ceph-mon[76906]: pgmap v103: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 43/282 objects degraded (15.248%) 2024-09-13T18:33:46.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:45 smithi038 ceph-mon[91522]: pgmap v103: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 43/282 objects degraded (15.248%) 2024-09-13T18:33:48.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:47 smithi149 ceph-mon[76906]: pgmap v104: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 43/282 objects degraded (15.248%) 2024-09-13T18:33:48.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:48.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:47 smithi038 ceph-mon[91522]: pgmap v104: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 43/282 objects degraded (15.248%) 2024-09-13T18:33:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:48.566 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:48 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1[106415]: 2024-09-13T18:33:48.175+0000 7efd1fbb3640 -1 osd.1 68 log_to_monitors true 2024-09-13T18:33:48.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:48 smithi038 ceph-mon[91522]: from='osd.1 [v2:172.21.15.38:6810/3218305916,v1:172.21.15.38:6811/3218305916]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T18:33:48.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:48 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:48.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:48 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:48.832 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:33:48 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1[106415]: 2024-09-13T18:33:48.689+0000 7efd13944640 -1 osd.1 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:33:48.989 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:48 smithi149 ceph-mon[76906]: from='osd.1 [v2:172.21.15.38:6810/3218305916,v1:172.21.15.38:6811/3218305916]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T18:33:48.989 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:48 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:48.989 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:48 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:49.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:49 smithi038 ceph-mon[91522]: pgmap v105: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 43/282 objects degraded (15.248%) 2024-09-13T18:33:49.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:49 smithi038 ceph-mon[91522]: from='osd.1 [v2:172.21.15.38:6810/3218305916,v1:172.21.15.38:6811/3218305916]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T18:33:49.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:49 smithi038 ceph-mon[91522]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T18:33:49.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:49 smithi038 ceph-mon[91522]: from='osd.1 [v2:172.21.15.38:6810/3218305916,v1:172.21.15.38:6811/3218305916]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-13T18:33:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:49 smithi149 ceph-mon[76906]: pgmap v105: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 206 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 43/282 objects degraded (15.248%) 2024-09-13T18:33:50.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:49 smithi149 ceph-mon[76906]: from='osd.1 [v2:172.21.15.38:6810/3218305916,v1:172.21.15.38:6811/3218305916]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T18:33:50.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:49 smithi149 ceph-mon[76906]: osdmap e71: 6 total, 5 up, 6 in 2024-09-13T18:33:50.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:49 smithi149 ceph-mon[76906]: from='osd.1 [v2:172.21.15.38:6810/3218305916,v1:172.21.15.38:6811/3218305916]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-13T18:33:50.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:50 smithi038 ceph-mon[91522]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T18:33:50.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:50 smithi038 ceph-mon[91522]: osd.1 [v2:172.21.15.38:6810/3218305916,v1:172.21.15.38:6811/3218305916] boot 2024-09-13T18:33:50.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:50 smithi038 ceph-mon[91522]: osdmap e72: 6 total, 6 up, 6 in 2024-09-13T18:33:50.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:50 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:33:50.952 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:50 smithi038 ceph-mon[91522]: Health check update: Degraded data redundancy: 43/282 objects degraded (15.248%), 15 pgs degraded (PG_DEGRADED) 2024-09-13T18:33:51.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:50 smithi149 ceph-mon[76906]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T18:33:51.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:50 smithi149 ceph-mon[76906]: osd.1 [v2:172.21.15.38:6810/3218305916,v1:172.21.15.38:6811/3218305916] boot 2024-09-13T18:33:51.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:50 smithi149 ceph-mon[76906]: osdmap e72: 6 total, 6 up, 6 in 2024-09-13T18:33:51.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:50 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T18:33:51.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:50 smithi149 ceph-mon[76906]: Health check update: Degraded data redundancy: 43/282 objects degraded (15.248%), 15 pgs degraded (PG_DEGRADED) 2024-09-13T18:33:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: pgmap v108: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 43/282 objects degraded (15.248%) 2024-09-13T18:33:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: osdmap e73: 6 total, 6 up, 6 in 2024-09-13T18:33:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:33:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:33:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:33:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T18:33:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:33:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: pgmap v108: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 43/282 objects degraded (15.248%) 2024-09-13T18:33:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: osdmap e73: 6 total, 6 up, 6 in 2024-09-13T18:33:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:33:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:33:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:33:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:33:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T18:33:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:33:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:33:53.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:52 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T18:33:53.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:52 smithi149 ceph-mon[76906]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-13T18:33:53.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:52 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T18:33:53.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:52 smithi038 ceph-mon[91522]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-13T18:33:54.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:53 smithi149 ceph-mon[76906]: pgmap v110: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 22/282 objects degraded (7.801%) 2024-09-13T18:33:54.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:53 smithi038 ceph-mon[91522]: pgmap v110: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 22/282 objects degraded (7.801%) 2024-09-13T18:33:55.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:54 smithi149 ceph-mon[76906]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/282 objects degraded (7.801%), 7 pgs degraded) 2024-09-13T18:33:55.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:54 smithi149 ceph-mon[76906]: Cluster is now healthy 2024-09-13T18:33:55.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:54 smithi038 ceph-mon[91522]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/282 objects degraded (7.801%), 7 pgs degraded) 2024-09-13T18:33:55.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:54 smithi038 ceph-mon[91522]: Cluster is now healthy 2024-09-13T18:33:56.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:55 smithi149 ceph-mon[76906]: pgmap v111: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s 2024-09-13T18:33:56.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:55 smithi038 ceph-mon[91522]: pgmap v111: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s 2024-09-13T18:33:58.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:57 smithi149 ceph-mon[76906]: pgmap v112: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-13T18:33:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:57 smithi038 ceph-mon[91522]: pgmap v112: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-09-13T18:34:00.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:33:59 smithi149 ceph-mon[76906]: pgmap v113: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:34:00.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:33:59 smithi038 ceph-mon[91522]: pgmap v113: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:34:02.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:01 smithi038 ceph-mon[91522]: pgmap v114: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-13T18:34:02.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:01 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:02.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:01 smithi149 ceph-mon[76906]: pgmap v114: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-13T18:34:02.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:01 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:03.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:03 smithi038 ceph-mon[91522]: pgmap v115: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-13T18:34:04.251 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:03 smithi149 ceph-mon[76906]: pgmap v115: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-13T18:34:06.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:05 smithi038 ceph-mon[91522]: pgmap v116: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:34:06.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:05 smithi149 ceph-mon[76906]: pgmap v116: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:34:06.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.733+0000 7f860c22d640 1 -- 172.21.15.38:0/3557166791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86040feaf0 msgr2=0x7f86040feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:06.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.733+0000 7f860c22d640 1 --2- 172.21.15.38:0/3557166791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86040feaf0 0x7f86040feef0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8600009880 tx=0x7f860002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:06.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.733+0000 7f860c22d640 1 -- 172.21.15.38:0/3557166791 shutdown_connections 2024-09-13T18:34:06.742 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.733+0000 7f860c22d640 1 --2- 172.21.15.38:0/3557166791 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86040ffcf0 0x7f8604100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.733+0000 7f860c22d640 1 --2- 172.21.15.38:0/3557166791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86040feaf0 0x7f86040feef0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.733+0000 7f860c22d640 1 -- 172.21.15.38:0/3557166791 >> 172.21.15.38:0/3557166791 conn(0x7f86040fa280 msgr2=0x7f86040fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.733+0000 7f860c22d640 1 -- 172.21.15.38:0/3557166791 shutdown_connections 2024-09-13T18:34:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.733+0000 7f860c22d640 1 -- 172.21.15.38:0/3557166791 wait complete. 2024-09-13T18:34:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.734+0000 7f860c22d640 1 Processor -- start 2024-09-13T18:34:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.734+0000 7f860c22d640 1 -- start start 2024-09-13T18:34:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.734+0000 7f860c22d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86040feaf0 0x7f8604195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.734+0000 7f860c22d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86040ffcf0 0x7f8604195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.734+0000 7f860c22d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8604196180 con 0x7f86040ffcf0 2024-09-13T18:34:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.734+0000 7f860c22d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86041962f0 con 0x7f86040feaf0 2024-09-13T18:34:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.734+0000 7f86097c8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86040ffcf0 0x7f8604195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.734+0000 7f86097c8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86040ffcf0 0x7f8604195bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45476/0 (socket says 172.21.15.38:45476) 2024-09-13T18:34:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.734+0000 7f86097c8640 1 -- 172.21.15.38:0/4087453544 learned_addr learned my addr 172.21.15.38:0/4087453544 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.734+0000 7f8609fc9640 1 --2- 172.21.15.38:0/4087453544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86040feaf0 0x7f8604195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.735+0000 7f86097c8640 1 -- 172.21.15.38:0/4087453544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86040feaf0 msgr2=0x7f8604195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.735+0000 7f86097c8640 1 --2- 172.21.15.38:0/4087453544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86040feaf0 0x7f8604195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.735+0000 7f86097c8640 1 -- 172.21.15.38:0/4087453544 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600009560 con 0x7f86040ffcf0 2024-09-13T18:34:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.735+0000 7f86097c8640 1 --2- 172.21.15.38:0/4087453544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86040ffcf0 0x7f8604195bb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f85f400d720 tx=0x7f85f400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.735+0000 7f85faffd640 1 -- 172.21.15.38:0/4087453544 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f40051f0 con 0x7f86040ffcf0 2024-09-13T18:34:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.735+0000 7f85faffd640 1 -- 172.21.15.38:0/4087453544 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85f4009820 con 0x7f86040ffcf0 2024-09-13T18:34:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.735+0000 7f860c22d640 1 -- 172.21.15.38:0/4087453544 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860419ad20 con 0x7f86040ffcf0 2024-09-13T18:34:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.735+0000 7f85faffd640 1 -- 172.21.15.38:0/4087453544 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f4004d40 con 0x7f86040ffcf0 2024-09-13T18:34:06.744 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.735+0000 7f860c22d640 1 -- 172.21.15.38:0/4087453544 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860419b270 con 0x7f86040ffcf0 2024-09-13T18:34:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.736+0000 7f85faffd640 1 -- 172.21.15.38:0/4087453544 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f85f4009990 con 0x7f86040ffcf0 2024-09-13T18:34:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.737+0000 7f860c22d640 1 -- 172.21.15.38:0/4087453544 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86041075c0 con 0x7f86040ffcf0 2024-09-13T18:34:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.737+0000 7f85faffd640 1 --2- 172.21.15.38:0/4087453544 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f85f006cc50 0x7f85f006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.737+0000 7f85faffd640 1 -- 172.21.15.38:0/4087453544 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f85f408c230 con 0x7f86040ffcf0 2024-09-13T18:34:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.737+0000 7f8609fc9640 1 --2- 172.21.15.38:0/4087453544 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f85f006cc50 0x7f85f006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.738+0000 7f8609fc9640 1 --2- 172.21.15.38:0/4087453544 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f85f006cc50 0x7f85f006f110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8600000c00 tx=0x7f8600031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.742+0000 7f85faffd640 1 -- 172.21.15.38:0/4087453544 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f85f40561e0 con 0x7f86040ffcf0 2024-09-13T18:34:06.938 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.935+0000 7f860c22d640 1 -- 172.21.15.38:0/4087453544 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f86040fc4b0 con 0x7f85f006cc50 2024-09-13T18:34:06.939 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.936+0000 7f85faffd640 1 -- 172.21.15.38:0/4087453544 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f86040fc4b0 con 0x7f85f006cc50 2024-09-13T18:34:06.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.939+0000 7f860c22d640 1 -- 172.21.15.38:0/4087453544 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f85f006cc50 msgr2=0x7f85f006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:06.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.939+0000 7f860c22d640 1 --2- 172.21.15.38:0/4087453544 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f85f006cc50 0x7f85f006f110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8600000c00 tx=0x7f8600031400 comp rx=0 tx=0).stop 2024-09-13T18:34:06.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.939+0000 7f860c22d640 1 -- 172.21.15.38:0/4087453544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86040ffcf0 msgr2=0x7f8604195bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:06.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.939+0000 7f860c22d640 1 --2- 172.21.15.38:0/4087453544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86040ffcf0 0x7f8604195bb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f85f400d720 tx=0x7f85f400dbe0 comp rx=0 tx=0).stop 2024-09-13T18:34:06.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.939+0000 7f860c22d640 1 -- 172.21.15.38:0/4087453544 shutdown_connections 2024-09-13T18:34:06.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.939+0000 7f860c22d640 1 --2- 172.21.15.38:0/4087453544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f86040ffcf0 0x7f8604195bb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:06.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.939+0000 7f860c22d640 1 --2- 172.21.15.38:0/4087453544 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f85f006cc50 0x7f85f006f110 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:06.942 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.939+0000 7f860c22d640 1 --2- 172.21.15.38:0/4087453544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86040feaf0 0x7f8604195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:06.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.939+0000 7f860c22d640 1 -- 172.21.15.38:0/4087453544 >> 172.21.15.38:0/4087453544 conn(0x7f86040fa280 msgr2=0x7f86040fbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:06.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.939+0000 7f860c22d640 1 -- 172.21.15.38:0/4087453544 shutdown_connections 2024-09-13T18:34:06.943 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:06.939+0000 7f860c22d640 1 -- 172.21.15.38:0/4087453544 wait complete. 2024-09-13T18:34:06.951 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:34:06.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T18:34:06.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:06.998 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:34:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.026+0000 7f48c95d6640 1 -- 172.21.15.38:0/1907754701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48c40ffcf0 msgr2=0x7f48c4100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.026+0000 7f48c95d6640 1 --2- 172.21.15.38:0/1907754701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48c40ffcf0 0x7f48c4100170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009880 tx=0x7f48ac02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.026+0000 7f48c95d6640 1 -- 172.21.15.38:0/1907754701 shutdown_connections 2024-09-13T18:34:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.026+0000 7f48c95d6640 1 --2- 172.21.15.38:0/1907754701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48c40ffcf0 0x7f48c4100170 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.026+0000 7f48c95d6640 1 --2- 172.21.15.38:0/1907754701 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48c40feaf0 0x7f48c40feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.029 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.026+0000 7f48c95d6640 1 -- 172.21.15.38:0/1907754701 >> 172.21.15.38:0/1907754701 conn(0x7f48c40fa280 msgr2=0x7f48c40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.026+0000 7f48c95d6640 1 -- 172.21.15.38:0/1907754701 shutdown_connections 2024-09-13T18:34:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.026+0000 7f48c95d6640 1 -- 172.21.15.38:0/1907754701 wait complete. 2024-09-13T18:34:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.027+0000 7f48c95d6640 1 Processor -- start 2024-09-13T18:34:07.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.027+0000 7f48c95d6640 1 -- start start 2024-09-13T18:34:07.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.027+0000 7f48c95d6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48c40feaf0 0x7f48c4102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.027+0000 7f48c95d6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48c40ffcf0 0x7f48c41010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.027+0000 7f48c95d6640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c4102fc0 con 0x7f48c40ffcf0 2024-09-13T18:34:07.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.027+0000 7f48c95d6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c4101640 con 0x7f48c40feaf0 2024-09-13T18:34:07.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.027+0000 7f48c27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48c40ffcf0 0x7f48c41010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.027+0000 7f48c27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48c40ffcf0 0x7f48c41010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45490/0 (socket says 172.21.15.38:45490) 2024-09-13T18:34:07.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.027+0000 7f48c27fc640 1 -- 172.21.15.38:0/491681463 learned_addr learned my addr 172.21.15.38:0/491681463 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:07.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.027+0000 7f48c2ffd640 1 --2- 172.21.15.38:0/491681463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48c40feaf0 0x7f48c4102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.028+0000 7f48c27fc640 1 -- 172.21.15.38:0/491681463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48c40feaf0 msgr2=0x7f48c4102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.028+0000 7f48c27fc640 1 --2- 172.21.15.38:0/491681463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48c40feaf0 0x7f48c4102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.028+0000 7f48c27fc640 1 -- 172.21.15.38:0/491681463 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac009560 con 0x7f48c40ffcf0 2024-09-13T18:34:07.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.028+0000 7f48c27fc640 1 --2- 172.21.15.38:0/491681463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48c40ffcf0 0x7f48c41010d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f48ac031460 tx=0x7f48ac0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.028+0000 7f48bbfff640 1 -- 172.21.15.38:0/491681463 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48ac004c60 con 0x7f48c40ffcf0 2024-09-13T18:34:07.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.028+0000 7f48c95d6640 1 -- 172.21.15.38:0/491681463 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c41018c0 con 0x7f48c40ffcf0 2024-09-13T18:34:07.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.028+0000 7f48bbfff640 1 -- 172.21.15.38:0/491681463 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f48ac003a90 con 0x7f48c40ffcf0 2024-09-13T18:34:07.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.028+0000 7f48bbfff640 1 -- 172.21.15.38:0/491681463 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48ac031b10 con 0x7f48c40ffcf0 2024-09-13T18:34:07.032 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.028+0000 7f48c95d6640 1 -- 172.21.15.38:0/491681463 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c4101db0 con 0x7f48c40ffcf0 2024-09-13T18:34:07.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.029+0000 7f48c95d6640 1 -- 172.21.15.38:0/491681463 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c41075a0 con 0x7f48c40ffcf0 2024-09-13T18:34:07.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.030+0000 7f48bbfff640 1 -- 172.21.15.38:0/491681463 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f48ac003c00 con 0x7f48c40ffcf0 2024-09-13T18:34:07.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.030+0000 7f48bbfff640 1 --2- 172.21.15.38:0/491681463 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f48b006cc50 0x7f48b006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.031+0000 7f48bbfff640 1 -- 172.21.15.38:0/491681463 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f48ac0ad900 con 0x7f48c40ffcf0 2024-09-13T18:34:07.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.031+0000 7f48c2ffd640 1 --2- 172.21.15.38:0/491681463 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f48b006cc50 0x7f48b006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.031+0000 7f48c2ffd640 1 --2- 172.21.15.38:0/491681463 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f48b006cc50 0x7f48b006f110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48c40ffb50 tx=0x7f48b4007600 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.035+0000 7f48bbfff640 1 -- 172.21.15.38:0/491681463 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f48ac0779c0 con 0x7f48c40ffcf0 2024-09-13T18:34:07.228 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.225+0000 7f48c95d6640 1 -- 172.21.15.38:0/491681463 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48c40683f0 con 0x7f48b006cc50 2024-09-13T18:34:07.229 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.227+0000 7f48bbfff640 1 -- 172.21.15.38:0/491681463 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f48c40683f0 con 0x7f48b006cc50 2024-09-13T18:34:07.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.229+0000 7f48c95d6640 1 -- 172.21.15.38:0/491681463 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f48b006cc50 msgr2=0x7f48b006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.229+0000 7f48c95d6640 1 --2- 172.21.15.38:0/491681463 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f48b006cc50 0x7f48b006f110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48c40ffb50 tx=0x7f48b4007600 comp rx=0 tx=0).stop 2024-09-13T18:34:07.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.229+0000 7f48c95d6640 1 -- 172.21.15.38:0/491681463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48c40ffcf0 msgr2=0x7f48c41010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.229+0000 7f48c95d6640 1 --2- 172.21.15.38:0/491681463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48c40ffcf0 0x7f48c41010d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f48ac031460 tx=0x7f48ac0056e0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.229+0000 7f48c95d6640 1 -- 172.21.15.38:0/491681463 shutdown_connections 2024-09-13T18:34:07.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.229+0000 7f48c95d6640 1 --2- 172.21.15.38:0/491681463 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48c40ffcf0 0x7f48c41010d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.229+0000 7f48c95d6640 1 --2- 172.21.15.38:0/491681463 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f48b006cc50 0x7f48b006f110 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.232 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.229+0000 7f48c95d6640 1 --2- 172.21.15.38:0/491681463 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48c40feaf0 0x7f48c4102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.229+0000 7f48c95d6640 1 -- 172.21.15.38:0/491681463 >> 172.21.15.38:0/491681463 conn(0x7f48c40fa280 msgr2=0x7f48c4067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.230+0000 7f48c95d6640 1 -- 172.21.15.38:0/491681463 shutdown_connections 2024-09-13T18:34:07.233 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.230+0000 7f48c95d6640 1 -- 172.21.15.38:0/491681463 wait complete. 2024-09-13T18:34:07.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T18:34:07.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:07.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:34:07.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.315+0000 7fe673d91640 1 -- 172.21.15.38:0/2607837803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c100680 msgr2=0x7fe66c102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.315+0000 7fe673d91640 1 --2- 172.21.15.38:0/2607837803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c100680 0x7fe66c102a70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe6680098b0 tx=0x7fe66802a4d0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.315+0000 7fe673d91640 1 -- 172.21.15.38:0/2607837803 shutdown_connections 2024-09-13T18:34:07.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.315+0000 7fe673d91640 1 --2- 172.21.15.38:0/2607837803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe66c102fb0 0x7fe66c1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.318 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.315+0000 7fe673d91640 1 --2- 172.21.15.38:0/2607837803 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c100680 0x7fe66c102a70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.315+0000 7fe673d91640 1 -- 172.21.15.38:0/2607837803 >> 172.21.15.38:0/2607837803 conn(0x7fe66c0fa280 msgr2=0x7fe66c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:07.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.316+0000 7fe673d91640 1 -- 172.21.15.38:0/2607837803 shutdown_connections 2024-09-13T18:34:07.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.316+0000 7fe673d91640 1 -- 172.21.15.38:0/2607837803 wait complete. 2024-09-13T18:34:07.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.316+0000 7fe673d91640 1 Processor -- start 2024-09-13T18:34:07.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe673d91640 1 -- start start 2024-09-13T18:34:07.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe673d91640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c100680 0x7fe66c1955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.320 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe673d91640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe66c102fb0 0x7fe66c195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe673d91640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c1960e0 con 0x7fe66c100680 2024-09-13T18:34:07.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe673d91640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c196250 con 0x7fe66c102fb0 2024-09-13T18:34:07.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe671b2d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c100680 0x7fe66c1955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe671b2d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c100680 0x7fe66c1955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45510/0 (socket says 172.21.15.38:45510) 2024-09-13T18:34:07.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe671b2d640 1 -- 172.21.15.38:0/3843411795 learned_addr learned my addr 172.21.15.38:0/3843411795 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:07.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe67132c640 1 --2- 172.21.15.38:0/3843411795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe66c102fb0 0x7fe66c195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe671b2d640 1 -- 172.21.15.38:0/3843411795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe66c102fb0 msgr2=0x7fe66c195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe671b2d640 1 --2- 172.21.15.38:0/3843411795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe66c102fb0 0x7fe66c195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe671b2d640 1 -- 172.21.15.38:0/3843411795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe668009560 con 0x7fe66c100680 2024-09-13T18:34:07.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.317+0000 7fe67132c640 1 --2- 172.21.15.38:0/3843411795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe66c102fb0 0x7fe66c195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:07.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.318+0000 7fe671b2d640 1 --2- 172.21.15.38:0/3843411795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c100680 0x7fe66c1955d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe668004650 tx=0x7fe6680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.321 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.318+0000 7fe662ffd640 1 -- 172.21.15.38:0/3843411795 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe668004aa0 con 0x7fe66c100680 2024-09-13T18:34:07.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.318+0000 7fe662ffd640 1 -- 172.21.15.38:0/3843411795 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe668005d50 con 0x7fe66c100680 2024-09-13T18:34:07.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.318+0000 7fe673d91640 1 -- 172.21.15.38:0/3843411795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66c19ac90 con 0x7fe66c100680 2024-09-13T18:34:07.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.318+0000 7fe662ffd640 1 -- 172.21.15.38:0/3843411795 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe668031950 con 0x7fe66c100680 2024-09-13T18:34:07.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.318+0000 7fe673d91640 1 -- 172.21.15.38:0/3843411795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66c19b180 con 0x7fe66c100680 2024-09-13T18:34:07.322 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.319+0000 7fe673d91640 1 -- 172.21.15.38:0/3843411795 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66c1086f0 con 0x7fe66c100680 2024-09-13T18:34:07.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.319+0000 7fe662ffd640 1 -- 172.21.15.38:0/3843411795 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe668003c20 con 0x7fe66c100680 2024-09-13T18:34:07.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.320+0000 7fe662ffd640 1 --2- 172.21.15.38:0/3843411795 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe65806cc60 0x7fe65806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.320+0000 7fe662ffd640 1 -- 172.21.15.38:0/3843411795 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fe6680ad680 con 0x7fe66c100680 2024-09-13T18:34:07.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.320+0000 7fe67132c640 1 --2- 172.21.15.38:0/3843411795 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe65806cc60 0x7fe65806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.321+0000 7fe67132c640 1 --2- 172.21.15.38:0/3843411795 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe65806cc60 0x7fe65806f120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe66c196af0 tx=0x7fe65c005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.324+0000 7fe662ffd640 1 -- 172.21.15.38:0/3843411795 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe668077710 con 0x7fe66c100680 2024-09-13T18:34:07.510 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.508+0000 7fe673d91640 1 -- 172.21.15.38:0/3843411795 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe66c103a30 con 0x7fe65806cc60 2024-09-13T18:34:07.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.517+0000 7fe662ffd640 1 -- 172.21.15.38:0/3843411795 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fe66c103a30 con 0x7fe65806cc60 2024-09-13T18:34:07.520 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:34:07.520 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (10m) 19s ago 11m 24.1M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (12m) 19s ago 12m 8308k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (11m) 76s ago 11m 7972k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (84s) 19s ago 12m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (79s) 76s ago 10m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (10m) 19s ago 11m 87.2M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (6m) 19s ago 6m 156M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (6m) 19s ago 6m 98.3M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (6m) 76s ago 6m 25.8M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (6m) 76s ago 6m 25.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (3m) 19s ago 13m 490M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (2m) 76s ago 10m 438M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (112s) 19s ago 13m 45.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:34:07.521 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (96s) 76s ago 10m 27.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:34:07.522 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (11m) 19s ago 11m 15.4M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:34:07.522 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (10m) 76s ago 10m 15.7M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:34:07.522 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (60s) 19s ago 10m 130M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:34:07.522 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (25s) 19s ago 9m 12.1M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 b2f99a2919b9 2024-09-13T18:34:07.522 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (9m) 19s ago 9m 244M 1217M 18.2.4-845-ge4e227b3 67ddd33fa72f e44cdda01aee 2024-09-13T18:34:07.522 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (8m) 76s ago 8m 281M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:34:07.522 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (8m) 76s ago 8m 267M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:34:07.522 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (7m) 76s ago 7m 227M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:34:07.522 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (2m) 19s ago 11m 51.9M - 2.43.0 a07b618ecd1d c04b1dcdc8c3 2024-09-13T18:34:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.520+0000 7fe673d91640 1 -- 172.21.15.38:0/3843411795 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe65806cc60 msgr2=0x7fe65806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.520+0000 7fe673d91640 1 --2- 172.21.15.38:0/3843411795 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe65806cc60 0x7fe65806f120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe66c196af0 tx=0x7fe65c005f90 comp rx=0 tx=0).stop 2024-09-13T18:34:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.520+0000 7fe673d91640 1 -- 172.21.15.38:0/3843411795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c100680 msgr2=0x7fe66c1955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.520+0000 7fe673d91640 1 --2- 172.21.15.38:0/3843411795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c100680 0x7fe66c1955d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe668004650 tx=0x7fe6680055a0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.520+0000 7fe673d91640 1 -- 172.21.15.38:0/3843411795 shutdown_connections 2024-09-13T18:34:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.520+0000 7fe673d91640 1 --2- 172.21.15.38:0/3843411795 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe65806cc60 0x7fe65806f120 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.520+0000 7fe673d91640 1 --2- 172.21.15.38:0/3843411795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe66c102fb0 0x7fe66c195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.520+0000 7fe673d91640 1 --2- 172.21.15.38:0/3843411795 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe66c100680 0x7fe66c1955d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.520+0000 7fe673d91640 1 -- 172.21.15.38:0/3843411795 >> 172.21.15.38:0/3843411795 conn(0x7fe66c0fa280 msgr2=0x7fe66c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:07.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.520+0000 7fe673d91640 1 -- 172.21.15.38:0/3843411795 shutdown_connections 2024-09-13T18:34:07.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.520+0000 7fe673d91640 1 -- 172.21.15.38:0/3843411795 wait complete. 2024-09-13T18:34:07.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.605+0000 7f48100e1640 1 -- 172.21.15.38:0/3322071793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4808100d90 msgr2=0x7f4808101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.605+0000 7f48100e1640 1 --2- 172.21.15.38:0/3322071793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4808100d90 0x7f4808101210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009880 tx=0x7f47f802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.605+0000 7f48100e1640 1 -- 172.21.15.38:0/3322071793 shutdown_connections 2024-09-13T18:34:07.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.605+0000 7f48100e1640 1 --2- 172.21.15.38:0/3322071793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4808100d90 0x7f4808101210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.605+0000 7f48100e1640 1 --2- 172.21.15.38:0/3322071793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48080ffb90 0x7f48080fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.605+0000 7f48100e1640 1 -- 172.21.15.38:0/3322071793 >> 172.21.15.38:0/3322071793 conn(0x7f48080fb320 msgr2=0x7f48080fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:07.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.605+0000 7f48100e1640 1 -- 172.21.15.38:0/3322071793 shutdown_connections 2024-09-13T18:34:07.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.605+0000 7f48100e1640 1 -- 172.21.15.38:0/3322071793 wait complete. 2024-09-13T18:34:07.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.606+0000 7f48100e1640 1 Processor -- start 2024-09-13T18:34:07.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.606+0000 7f48100e1640 1 -- start start 2024-09-13T18:34:07.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.606+0000 7f48100e1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48080ffb90 0x7f4808074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.606+0000 7f48100e1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4808100d90 0x7f48080728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.606+0000 7f48100e1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4808072de0 con 0x7f4808100d90 2024-09-13T18:34:07.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.606+0000 7f48100e1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4808072f50 con 0x7f48080ffb90 2024-09-13T18:34:07.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.606+0000 7f480d67c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4808100d90 0x7f48080728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.606+0000 7f480d67c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4808100d90 0x7f48080728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45538/0 (socket says 172.21.15.38:45538) 2024-09-13T18:34:07.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.606+0000 7f480d67c640 1 -- 172.21.15.38:0/2610394102 learned_addr learned my addr 172.21.15.38:0/2610394102 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:07.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.607+0000 7f480de7d640 1 --2- 172.21.15.38:0/2610394102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48080ffb90 0x7f4808074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.607+0000 7f480d67c640 1 -- 172.21.15.38:0/2610394102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48080ffb90 msgr2=0x7f4808074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.607+0000 7f480d67c640 1 --2- 172.21.15.38:0/2610394102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48080ffb90 0x7f4808074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.607+0000 7f480d67c640 1 -- 172.21.15.38:0/2610394102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f8009560 con 0x7f4808100d90 2024-09-13T18:34:07.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.607+0000 7f480de7d640 1 --2- 172.21.15.38:0/2610394102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48080ffb90 0x7f4808074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:07.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.607+0000 7f480d67c640 1 --2- 172.21.15.38:0/2610394102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4808100d90 0x7f48080728a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47f8000c00 tx=0x7f47f80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.607+0000 7f47feffd640 1 -- 172.21.15.38:0/2610394102 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47f8004aa0 con 0x7f4808100d90 2024-09-13T18:34:07.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.607+0000 7f48100e1640 1 -- 172.21.15.38:0/2610394102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48080731d0 con 0x7f4808100d90 2024-09-13T18:34:07.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.607+0000 7f47feffd640 1 -- 172.21.15.38:0/2610394102 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f47f8005d50 con 0x7f4808100d90 2024-09-13T18:34:07.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.607+0000 7f47feffd640 1 -- 172.21.15.38:0/2610394102 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47f80318f0 con 0x7f4808100d90 2024-09-13T18:34:07.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.607+0000 7f48100e1640 1 -- 172.21.15.38:0/2610394102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480819d630 con 0x7f4808100d90 2024-09-13T18:34:07.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.608+0000 7f48100e1640 1 -- 172.21.15.38:0/2610394102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48080fff90 con 0x7f4808100d90 2024-09-13T18:34:07.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.609+0000 7f47feffd640 1 -- 172.21.15.38:0/2610394102 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f47f8004c00 con 0x7f4808100d90 2024-09-13T18:34:07.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.609+0000 7f47feffd640 1 --2- 172.21.15.38:0/2610394102 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f47f406cc50 0x7f47f406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.609+0000 7f47feffd640 1 -- 172.21.15.38:0/2610394102 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f47f80ad630 con 0x7f4808100d90 2024-09-13T18:34:07.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.609+0000 7f480de7d640 1 --2- 172.21.15.38:0/2610394102 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f47f406cc50 0x7f47f406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.610+0000 7f480de7d640 1 --2- 172.21.15.38:0/2610394102 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f47f406cc50 0x7f47f406f110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4808100bf0 tx=0x7f4804005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.613+0000 7f47feffd640 1 -- 172.21.15.38:0/2610394102 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f47f80776c0 con 0x7f4808100d90 2024-09-13T18:34:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.887+0000 7f48100e1640 1 -- 172.21.15.38:0/2610394102 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4808108660 con 0x7f4808100d90 2024-09-13T18:34:07.890 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.888+0000 7f47feffd640 1 -- 172.21.15.38:0/2610394102 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f47f807ace0 con 0x7f4808100d90 2024-09-13T18:34:07.890 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:34:07.890 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4, 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:34:07.891 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 8, 2024-09-13T18:34:07.892 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T18:34:07.892 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:34:07.892 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:34:07.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.890+0000 7f48100e1640 1 -- 172.21.15.38:0/2610394102 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f47f406cc50 msgr2=0x7f47f406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.890+0000 7f48100e1640 1 --2- 172.21.15.38:0/2610394102 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f47f406cc50 0x7f47f406f110 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4808100bf0 tx=0x7f4804005f90 comp rx=0 tx=0).stop 2024-09-13T18:34:07.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.890+0000 7f48100e1640 1 -- 172.21.15.38:0/2610394102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4808100d90 msgr2=0x7f48080728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.890+0000 7f48100e1640 1 --2- 172.21.15.38:0/2610394102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4808100d90 0x7f48080728a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47f8000c00 tx=0x7f47f80055a0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.890+0000 7f48100e1640 1 -- 172.21.15.38:0/2610394102 shutdown_connections 2024-09-13T18:34:07.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.890+0000 7f48100e1640 1 --2- 172.21.15.38:0/2610394102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4808100d90 0x7f48080728a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.890+0000 7f48100e1640 1 --2- 172.21.15.38:0/2610394102 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f47f406cc50 0x7f47f406f110 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.890+0000 7f48100e1640 1 --2- 172.21.15.38:0/2610394102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48080ffb90 0x7f4808074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.890+0000 7f48100e1640 1 -- 172.21.15.38:0/2610394102 >> 172.21.15.38:0/2610394102 conn(0x7f48080fb320 msgr2=0x7f4808104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:07.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.890+0000 7f48100e1640 1 -- 172.21.15.38:0/2610394102 shutdown_connections 2024-09-13T18:34:07.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.890+0000 7f48100e1640 1 -- 172.21.15.38:0/2610394102 wait complete. 2024-09-13T18:34:07.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.975+0000 7f5b26b77640 1 -- 172.21.15.38:0/2064206980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b200ffca0 msgr2=0x7f5b20100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.975+0000 7f5b26b77640 1 --2- 172.21.15.38:0/2064206980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b200ffca0 0x7f5b20100120 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009880 tx=0x7f5b0c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.976+0000 7f5b26b77640 1 -- 172.21.15.38:0/2064206980 shutdown_connections 2024-09-13T18:34:07.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.976+0000 7f5b26b77640 1 --2- 172.21.15.38:0/2064206980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b200ffca0 0x7f5b20100120 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.976+0000 7f5b26b77640 1 --2- 172.21.15.38:0/2064206980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b200feaa0 0x7f5b200feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.976+0000 7f5b26b77640 1 -- 172.21.15.38:0/2064206980 >> 172.21.15.38:0/2064206980 conn(0x7f5b200fa230 msgr2=0x7f5b200fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:07.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.976+0000 7f5b26b77640 1 -- 172.21.15.38:0/2064206980 shutdown_connections 2024-09-13T18:34:07.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.976+0000 7f5b26b77640 1 -- 172.21.15.38:0/2064206980 wait complete. 2024-09-13T18:34:07.979 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b26b77640 1 Processor -- start 2024-09-13T18:34:07.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b26b77640 1 -- start start 2024-09-13T18:34:07.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b26b77640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b200feaa0 0x7f5b20102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b26b77640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b200ffca0 0x7f5b20101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b26b77640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b201015c0 con 0x7f5b200ffca0 2024-09-13T18:34:07.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b26b77640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b20101730 con 0x7f5b200feaa0 2024-09-13T18:34:07.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b200ffca0 0x7f5b20101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b200ffca0 0x7f5b20101080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45550/0 (socket says 172.21.15.38:45550) 2024-09-13T18:34:07.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b1ffff640 1 -- 172.21.15.38:0/3578791326 learned_addr learned my addr 172.21.15.38:0/3578791326 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:07.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b24913640 1 --2- 172.21.15.38:0/3578791326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b200feaa0 0x7f5b20102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b1ffff640 1 -- 172.21.15.38:0/3578791326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b200feaa0 msgr2=0x7f5b20102a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:07.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b1ffff640 1 --2- 172.21.15.38:0/3578791326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b200feaa0 0x7f5b20102a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:07.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.977+0000 7f5b1ffff640 1 -- 172.21.15.38:0/3578791326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c009560 con 0x7f5b200ffca0 2024-09-13T18:34:07.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.978+0000 7f5b1ffff640 1 --2- 172.21.15.38:0/3578791326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b200ffca0 0x7f5b20101080 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c031460 tx=0x7f5b0c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.978+0000 7f5b1dffb640 1 -- 172.21.15.38:0/3578791326 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b0c004aa0 con 0x7f5b200ffca0 2024-09-13T18:34:07.981 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.978+0000 7f5b1dffb640 1 -- 172.21.15.38:0/3578791326 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5b0c004c00 con 0x7f5b200ffca0 2024-09-13T18:34:07.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.978+0000 7f5b26b77640 1 -- 172.21.15.38:0/3578791326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b201019b0 con 0x7f5b200ffca0 2024-09-13T18:34:07.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.978+0000 7f5b1dffb640 1 -- 172.21.15.38:0/3578791326 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b0c0319c0 con 0x7f5b200ffca0 2024-09-13T18:34:07.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.978+0000 7f5b26b77640 1 -- 172.21.15.38:0/3578791326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b20101e60 con 0x7f5b200ffca0 2024-09-13T18:34:07.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.980+0000 7f5b1dffb640 1 -- 172.21.15.38:0/3578791326 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5b0c031b20 con 0x7f5b200ffca0 2024-09-13T18:34:07.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.980+0000 7f5b26b77640 1 -- 172.21.15.38:0/3578791326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b20107570 con 0x7f5b200ffca0 2024-09-13T18:34:07.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.980+0000 7f5b1dffb640 1 --2- 172.21.15.38:0/3578791326 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5b1006cc50 0x7f5b1006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:07.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.980+0000 7f5b1dffb640 1 -- 172.21.15.38:0/3578791326 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f5b0c0ad670 con 0x7f5b200ffca0 2024-09-13T18:34:07.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.980+0000 7f5b24913640 1 --2- 172.21.15.38:0/3578791326 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5b1006cc50 0x7f5b1006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:07.983 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.981+0000 7f5b24913640 1 --2- 172.21.15.38:0/3578791326 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5b1006cc50 0x7f5b1006f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b200ffb00 tx=0x7f5b14009500 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:07.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:07.985+0000 7f5b1dffb640 1 -- 172.21.15.38:0/3578791326 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5b0c0777b0 con 0x7f5b200ffca0 2024-09-13T18:34:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:07 smithi038 ceph-mon[91522]: pgmap v117: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:34:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:07 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T18:34:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:07 smithi038 ceph-mon[91522]: Upgrade: osd.2 is safe to restart 2024-09-13T18:34:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.216+0000 7f5b26b77640 1 -- 172.21.15.38:0/3578791326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5b20107700 con 0x7f5b200ffca0 2024-09-13T18:34:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.217+0000 7f5b1dffb640 1 -- 172.21.15.38:0/3578791326 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7f5b0c07add0 con 0x7f5b200ffca0 2024-09-13T18:34:08.219 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:34:08.220 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:34:08.221 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:34:08.222 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:34:08.222 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:34:08.222 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:34:08.222 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:34:08.222 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:34:08.222 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:34:08.222 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:34:08.222 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:34:08.222 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:34:08.222 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:34:08.222 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:34:08.223 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:34:08.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.219+0000 7f5b26b77640 1 -- 172.21.15.38:0/3578791326 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5b1006cc50 msgr2=0x7f5b1006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.219+0000 7f5b26b77640 1 --2- 172.21.15.38:0/3578791326 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5b1006cc50 0x7f5b1006f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b200ffb00 tx=0x7f5b14009500 comp rx=0 tx=0).stop 2024-09-13T18:34:08.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.219+0000 7f5b26b77640 1 -- 172.21.15.38:0/3578791326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b200ffca0 msgr2=0x7f5b20101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.219+0000 7f5b26b77640 1 --2- 172.21.15.38:0/3578791326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b200ffca0 0x7f5b20101080 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c031460 tx=0x7f5b0c0055a0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.219+0000 7f5b26b77640 1 -- 172.21.15.38:0/3578791326 shutdown_connections 2024-09-13T18:34:08.223 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.219+0000 7f5b26b77640 1 --2- 172.21.15.38:0/3578791326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b200ffca0 0x7f5b20101080 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.219+0000 7f5b26b77640 1 --2- 172.21.15.38:0/3578791326 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5b1006cc50 0x7f5b1006f110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.219+0000 7f5b26b77640 1 --2- 172.21.15.38:0/3578791326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b200feaa0 0x7f5b20102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.219+0000 7f5b26b77640 1 -- 172.21.15.38:0/3578791326 >> 172.21.15.38:0/3578791326 conn(0x7f5b200fa230 msgr2=0x7f5b20068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.219+0000 7f5b26b77640 1 -- 172.21.15.38:0/3578791326 shutdown_connections 2024-09-13T18:34:08.224 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.219+0000 7f5b26b77640 1 -- 172.21.15.38:0/3578791326 wait complete. 2024-09-13T18:34:08.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:07 smithi149 ceph-mon[76906]: pgmap v117: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:34:08.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:07 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T18:34:08.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:07 smithi149 ceph-mon[76906]: Upgrade: osd.2 is safe to restart 2024-09-13T18:34:08.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.308+0000 7fb871e48640 1 -- 172.21.15.38:0/471169024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c100680 msgr2=0x7fb86c102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.308+0000 7fb871e48640 1 --2- 172.21.15.38:0/471169024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c100680 0x7fb86c102a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0098b0 tx=0x7fb85c02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.308+0000 7fb871e48640 1 -- 172.21.15.38:0/471169024 shutdown_connections 2024-09-13T18:34:08.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.308+0000 7fb871e48640 1 --2- 172.21.15.38:0/471169024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb86c102fb0 0x7fb86c1053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.308+0000 7fb871e48640 1 --2- 172.21.15.38:0/471169024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c100680 0x7fb86c102a70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.308+0000 7fb871e48640 1 -- 172.21.15.38:0/471169024 >> 172.21.15.38:0/471169024 conn(0x7fb86c0fa280 msgr2=0x7fb86c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.308+0000 7fb871e48640 1 -- 172.21.15.38:0/471169024 shutdown_connections 2024-09-13T18:34:08.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.308+0000 7fb871e48640 1 -- 172.21.15.38:0/471169024 wait complete. 2024-09-13T18:34:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.309+0000 7fb871e48640 1 Processor -- start 2024-09-13T18:34:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.309+0000 7fb871e48640 1 -- start start 2024-09-13T18:34:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.309+0000 7fb871e48640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb86c100680 0x7fb86c1955b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.309+0000 7fb871e48640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c102fb0 0x7fb86c195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.309+0000 7fb871e48640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c1960c0 con 0x7fb86c102fb0 2024-09-13T18:34:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.309+0000 7fb871e48640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c196230 con 0x7fb86c100680 2024-09-13T18:34:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.309+0000 7fb86affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c102fb0 0x7fb86c195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.309+0000 7fb86affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c102fb0 0x7fb86c195af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45558/0 (socket says 172.21.15.38:45558) 2024-09-13T18:34:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.309+0000 7fb86affd640 1 -- 172.21.15.38:0/3075699141 learned_addr learned my addr 172.21.15.38:0/3075699141 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.309+0000 7fb86b7fe640 1 --2- 172.21.15.38:0/3075699141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb86c100680 0x7fb86c1955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.310+0000 7fb86affd640 1 -- 172.21.15.38:0/3075699141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb86c100680 msgr2=0x7fb86c1955b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.310+0000 7fb86affd640 1 --2- 172.21.15.38:0/3075699141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb86c100680 0x7fb86c1955b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.310+0000 7fb86affd640 1 -- 172.21.15.38:0/3075699141 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c009560 con 0x7fb86c102fb0 2024-09-13T18:34:08.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.310+0000 7fb86affd640 1 --2- 172.21.15.38:0/3075699141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c102fb0 0x7fb86c195af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb86000e970 tx=0x7fb86000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.310+0000 7fb868ff9640 1 -- 172.21.15.38:0/3075699141 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb860009700 con 0x7fb86c102fb0 2024-09-13T18:34:08.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.310+0000 7fb868ff9640 1 -- 172.21.15.38:0/3075699141 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb8600054c0 con 0x7fb86c102fb0 2024-09-13T18:34:08.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.310+0000 7fb871e48640 1 -- 172.21.15.38:0/3075699141 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c19acd0 con 0x7fb86c102fb0 2024-09-13T18:34:08.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.310+0000 7fb868ff9640 1 -- 172.21.15.38:0/3075699141 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb860010430 con 0x7fb86c102fb0 2024-09-13T18:34:08.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.310+0000 7fb871e48640 1 -- 172.21.15.38:0/3075699141 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c19b1c0 con 0x7fb86c102fb0 2024-09-13T18:34:08.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.312+0000 7fb871e48640 1 -- 172.21.15.38:0/3075699141 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c1086d0 con 0x7fb86c102fb0 2024-09-13T18:34:08.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.312+0000 7fb868ff9640 1 -- 172.21.15.38:0/3075699141 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb860005020 con 0x7fb86c102fb0 2024-09-13T18:34:08.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.312+0000 7fb868ff9640 1 --2- 172.21.15.38:0/3075699141 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb85406cc60 0x7fb85406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.312+0000 7fb868ff9640 1 -- 172.21.15.38:0/3075699141 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fb860014070 con 0x7fb86c102fb0 2024-09-13T18:34:08.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.312+0000 7fb86b7fe640 1 --2- 172.21.15.38:0/3075699141 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb85406cc60 0x7fb85406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.316 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.313+0000 7fb86b7fe640 1 --2- 172.21.15.38:0/3075699141 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb85406cc60 0x7fb85406f120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb85c000c00 tx=0x7fb85c031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.319 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.317+0000 7fb868ff9640 1 -- 172.21.15.38:0/3075699141 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb860056a70 con 0x7fb86c102fb0 2024-09-13T18:34:08.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.517+0000 7fb871e48640 1 -- 172.21.15.38:0/3075699141 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb86c19b460 con 0x7fb85406cc60 2024-09-13T18:34:08.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.518+0000 7fb868ff9640 1 -- 172.21.15.38:0/3075699141 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb86c19b460 con 0x7fb85406cc60 2024-09-13T18:34:08.521 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:34:08.521 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:34:08.521 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:34:08.521 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:34:08.521 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:34:08.521 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr", 2024-09-13T18:34:08.521 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-13T18:34:08.521 INFO:teuthology.orchestra.run.smithi038.stdout: "mon" 2024-09-13T18:34:08.521 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:34:08.522 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "8/23 daemons upgraded", 2024-09-13T18:34:08.522 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T18:34:08.522 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:34:08.522 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:34:08.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.521+0000 7fb871e48640 1 -- 172.21.15.38:0/3075699141 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb85406cc60 msgr2=0x7fb85406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.521+0000 7fb871e48640 1 --2- 172.21.15.38:0/3075699141 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb85406cc60 0x7fb85406f120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb85c000c00 tx=0x7fb85c031400 comp rx=0 tx=0).stop 2024-09-13T18:34:08.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.521+0000 7fb871e48640 1 -- 172.21.15.38:0/3075699141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c102fb0 msgr2=0x7fb86c195af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.521+0000 7fb871e48640 1 --2- 172.21.15.38:0/3075699141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c102fb0 0x7fb86c195af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb86000e970 tx=0x7fb86000ee30 comp rx=0 tx=0).stop 2024-09-13T18:34:08.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.521+0000 7fb871e48640 1 -- 172.21.15.38:0/3075699141 shutdown_connections 2024-09-13T18:34:08.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.521+0000 7fb871e48640 1 --2- 172.21.15.38:0/3075699141 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb86c102fb0 0x7fb86c195af0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.521+0000 7fb871e48640 1 --2- 172.21.15.38:0/3075699141 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb85406cc60 0x7fb85406f120 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.521+0000 7fb871e48640 1 --2- 172.21.15.38:0/3075699141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb86c100680 0x7fb86c1955b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.521+0000 7fb871e48640 1 -- 172.21.15.38:0/3075699141 >> 172.21.15.38:0/3075699141 conn(0x7fb86c0fa280 msgr2=0x7fb86c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.521+0000 7fb871e48640 1 -- 172.21.15.38:0/3075699141 shutdown_connections 2024-09-13T18:34:08.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.521+0000 7fb871e48640 1 -- 172.21.15.38:0/3075699141 wait complete. 2024-09-13T18:34:08.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.606+0000 7f8002acf640 1 -- 172.21.15.38:0/291549505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ffc0feaf0 msgr2=0x7f7ffc0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.606+0000 7f8002acf640 1 --2- 172.21.15.38:0/291549505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ffc0feaf0 0x7f7ffc0feef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009880 tx=0x7f7fe402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.606+0000 7f8002acf640 1 -- 172.21.15.38:0/291549505 shutdown_connections 2024-09-13T18:34:08.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.606+0000 7f8002acf640 1 --2- 172.21.15.38:0/291549505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ffc0ffcf0 0x7f7ffc100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.606+0000 7f8002acf640 1 --2- 172.21.15.38:0/291549505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ffc0feaf0 0x7f7ffc0feef0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.606+0000 7f8002acf640 1 -- 172.21.15.38:0/291549505 >> 172.21.15.38:0/291549505 conn(0x7f7ffc0fa280 msgr2=0x7f7ffc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.606+0000 7f8002acf640 1 -- 172.21.15.38:0/291549505 shutdown_connections 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.606+0000 7f8002acf640 1 -- 172.21.15.38:0/291549505 wait complete. 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.606+0000 7f8002acf640 1 Processor -- start 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.607+0000 7f8002acf640 1 -- start start 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.607+0000 7f8002acf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ffc0feaf0 0x7f7ffc1955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.607+0000 7f8002acf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ffc0ffcf0 0x7f7ffc195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.607+0000 7f8002acf640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc1960e0 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.607+0000 7f8002acf640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc196250 con 0x7f7ffc0feaf0 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.607+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ffc0ffcf0 0x7f7ffc195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.607+0000 7f7ffbfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ffc0ffcf0 0x7f7ffc195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:45586/0 (socket says 172.21.15.38:45586) 2024-09-13T18:34:08.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.607+0000 7f7ffbfff640 1 -- 172.21.15.38:0/4044357767 learned_addr learned my addr 172.21.15.38:0/4044357767 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.607+0000 7f800086b640 1 --2- 172.21.15.38:0/4044357767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ffc0feaf0 0x7f7ffc1955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.607+0000 7f7ffbfff640 1 -- 172.21.15.38:0/4044357767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ffc0feaf0 msgr2=0x7f7ffc1955d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.607+0000 7f7ffbfff640 1 --2- 172.21.15.38:0/4044357767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ffc0feaf0 0x7f7ffc1955d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.607+0000 7f7ffbfff640 1 -- 172.21.15.38:0/4044357767 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4009560 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.608+0000 7f7ffbfff640 1 --2- 172.21.15.38:0/4044357767 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ffc0ffcf0 0x7f7ffc195b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00d900 tx=0x7f7fec00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.608+0000 7f7ff9ffb640 1 -- 172.21.15.38:0/4044357767 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fec009c00 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.608+0000 7f7ff9ffb640 1 -- 172.21.15.38:0/4044357767 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fec00b660 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.608+0000 7f8002acf640 1 -- 172.21.15.38:0/4044357767 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc19acf0 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.608+0000 7f7ff9ffb640 1 -- 172.21.15.38:0/4044357767 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fec00f5f0 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.608+0000 7f8002acf640 1 -- 172.21.15.38:0/4044357767 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc19b240 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.609+0000 7f8002acf640 1 -- 172.21.15.38:0/4044357767 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ffc1075a0 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.610+0000 7f7ff9ffb640 1 -- 172.21.15.38:0/4044357767 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7fec00f820 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.610+0000 7f7ff9ffb640 1 --2- 172.21.15.38:0/4044357767 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7fe806cc50 0x7f7fe806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:08.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.611+0000 7f7ff9ffb640 1 -- 172.21.15.38:0/4044357767 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f7fec08c310 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.611+0000 7f800086b640 1 --2- 172.21.15.38:0/4044357767 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7fe806cc50 0x7f7fe806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:08.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.611+0000 7f800086b640 1 --2- 172.21.15.38:0/4044357767 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7fe806cc50 0x7f7fe806f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4000c00 tx=0x7f7fe4031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:08.618 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.615+0000 7f7ff9ffb640 1 -- 172.21.15.38:0/4044357767 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7fec0563a0 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.860+0000 7f8002acf640 1 -- 172.21.15.38:0/4044357767 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7ffc107730 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.860+0000 7f7ff9ffb640 1 -- 172.21.15.38:0/4044357767 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7fec0599c0 con 0x7f7ffc0ffcf0 2024-09-13T18:34:08.863 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:34:08.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.862+0000 7f8002acf640 1 -- 172.21.15.38:0/4044357767 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7fe806cc50 msgr2=0x7f7fe806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.862+0000 7f8002acf640 1 --2- 172.21.15.38:0/4044357767 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7fe806cc50 0x7f7fe806f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4000c00 tx=0x7f7fe4031400 comp rx=0 tx=0).stop 2024-09-13T18:34:08.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.862+0000 7f8002acf640 1 -- 172.21.15.38:0/4044357767 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ffc0ffcf0 msgr2=0x7f7ffc195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:08.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.862+0000 7f8002acf640 1 --2- 172.21.15.38:0/4044357767 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ffc0ffcf0 0x7f7ffc195b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00d900 tx=0x7f7fec00ddc0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.862+0000 7f8002acf640 1 -- 172.21.15.38:0/4044357767 shutdown_connections 2024-09-13T18:34:08.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.863+0000 7f8002acf640 1 --2- 172.21.15.38:0/4044357767 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ffc0ffcf0 0x7f7ffc195b10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.863+0000 7f8002acf640 1 --2- 172.21.15.38:0/4044357767 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7fe806cc50 0x7f7fe806f110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.863+0000 7f8002acf640 1 --2- 172.21.15.38:0/4044357767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ffc0feaf0 0x7f7ffc1955d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:08.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.863+0000 7f8002acf640 1 -- 172.21.15.38:0/4044357767 >> 172.21.15.38:0/4044357767 conn(0x7f7ffc0fa280 msgr2=0x7f7ffc0fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:08.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.863+0000 7f8002acf640 1 -- 172.21.15.38:0/4044357767 shutdown_connections 2024-09-13T18:34:08.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:08.863+0000 7f8002acf640 1 -- 172.21.15.38:0/4044357767 wait complete. 2024-09-13T18:34:09.053 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:08 smithi038 ceph-mon[91522]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:09.053 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:08 smithi038 ceph-mon[91522]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:09.053 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:08 smithi038 ceph-mon[91522]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:09.053 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:08 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2610394102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:09.053 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:08 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:09.053 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:08 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T18:34:09.053 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:08 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:34:09.053 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:08 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3578791326' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:34:09.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:08 smithi149 ceph-mon[76906]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:09.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:08 smithi149 ceph-mon[76906]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:09.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:08 smithi149 ceph-mon[76906]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:09.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:08 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2610394102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:09.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:08 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:09.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:08 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T18:34:09.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:08 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:34:09.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:08 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3578791326' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:34:09.942 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:09 smithi038 ceph-mon[91522]: Upgrade: Updating osd.2 2024-09-13T18:34:09.943 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:09 smithi038 ceph-mon[91522]: Deploying daemon osd.2 on smithi038 2024-09-13T18:34:09.943 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:09 smithi038 ceph-mon[91522]: pgmap v118: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:34:09.943 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:09 smithi038 ceph-mon[91522]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:09.943 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:09 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/4044357767' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:34:10.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:09 smithi149 ceph-mon[76906]: Upgrade: Updating osd.2 2024-09-13T18:34:10.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:09 smithi149 ceph-mon[76906]: Deploying daemon osd.2 on smithi038 2024-09-13T18:34:10.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:09 smithi149 ceph-mon[76906]: pgmap v118: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:34:10.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:09 smithi149 ceph-mon[76906]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:10.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:09 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/4044357767' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:34:11.245 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:10 smithi038 systemd[1]: Stopping Ceph osd.2 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:34:11.581 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:11 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2[61365]: 2024-09-13T18:34:11.238+0000 7f1b8d2a6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:34:11.581 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:11 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2[61365]: 2024-09-13T18:34:11.238+0000 7f1b8d2a6640 -1 osd.2 73 *** Got signal Terminated *** 2024-09-13T18:34:11.581 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:11 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2[61365]: 2024-09-13T18:34:11.238+0000 7f1b8d2a6640 -1 osd.2 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:34:12.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:11 smithi038 ceph-mon[91522]: pgmap v119: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:34:12.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:11 smithi038 ceph-mon[91522]: osd.2 marked itself down and dead 2024-09-13T18:34:12.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:11 smithi149 ceph-mon[76906]: pgmap v119: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:34:12.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:11 smithi149 ceph-mon[76906]: osd.2 marked itself down and dead 2024-09-13T18:34:12.419 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:12 smithi038 podman[111769]: 2024-09-13 18:34:12.144758556 +0000 UTC m=+1.018093863 container died e44cdda01aee65d1c9773c22ef5f2ce00ccb3706e52e6736e92cd41e800d4555 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-13T18:34:12.816 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:12 smithi038 podman[111769]: 2024-09-13 18:34:12.514407307 +0000 UTC m=+1.387742604 container cleanup e44cdda01aee65d1c9773c22ef5f2ce00ccb3706e52e6736e92cd41e800d4555 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=reef-e4e227b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T18:34:12.817 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:12 smithi038 bash[111769]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2 2024-09-13T18:34:13.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:12 smithi038 ceph-mon[91522]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T18:34:13.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:12 smithi038 ceph-mon[91522]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T18:34:13.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:12 smithi038 ceph-mon[91522]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T18:34:13.081 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:12 smithi038 podman[111787]: 2024-09-13 18:34:12.815640487 +0000 UTC m=+0.664335564 container remove e44cdda01aee65d1c9773c22ef5f2ce00ccb3706e52e6736e92cd41e800d4555 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-e4e227b) 2024-09-13T18:34:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:12 smithi149 ceph-mon[76906]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T18:34:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:12 smithi149 ceph-mon[76906]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T18:34:13.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:12 smithi149 ceph-mon[76906]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T18:34:13.430 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:13 smithi038 podman[111874]: 2024-09-13 18:34:13.059102171 +0000 UTC m=+0.016983220 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:34:13.430 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:13 smithi038 podman[111874]: 2024-09-13 18:34:13.183571916 +0000 UTC m=+0.141452948 container create 83ac369901d86cb79eba6310d9e622bfe29e4caab8c77c6a0c59cc86771b268b (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T18:34:13.430 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:13 smithi038 podman[111874]: 2024-09-13 18:34:13.428369254 +0000 UTC m=+0.386250297 container init 83ac369901d86cb79eba6310d9e622bfe29e4caab8c77c6a0c59cc86771b268b (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:34:13.735 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:13 smithi038 podman[111874]: 2024-09-13 18:34:13.432013667 +0000 UTC m=+0.389894709 container start 83ac369901d86cb79eba6310d9e622bfe29e4caab8c77c6a0c59cc86771b268b (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:34:13.735 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:13 smithi038 podman[111874]: 2024-09-13 18:34:13.536662225 +0000 UTC m=+0.494543257 container attach 83ac369901d86cb79eba6310d9e622bfe29e4caab8c77c6a0c59cc86771b268b (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T18:34:13.735 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:13 smithi038 podman[111874]: 2024-09-13 18:34:13.634588474 +0000 UTC m=+0.592469513 container died 83ac369901d86cb79eba6310d9e622bfe29e4caab8c77c6a0c59cc86771b268b (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-13T18:34:14.009 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:13 smithi038 ceph-mon[91522]: pgmap v121: 65 pgs: 11 peering, 8 stale+active+clean, 46 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-13T18:34:14.009 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:13 smithi038 ceph-mon[91522]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-13T18:34:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:13 smithi149 ceph-mon[76906]: pgmap v121: 65 pgs: 11 peering, 8 stale+active+clean, 46 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-13T18:34:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:13 smithi149 ceph-mon[76906]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-13T18:34:14.569 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:14 smithi038 podman[111897]: 2024-09-13 18:34:14.30759368 +0000 UTC m=+0.666337687 container remove 83ac369901d86cb79eba6310d9e622bfe29e4caab8c77c6a0c59cc86771b268b (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T18:34:14.569 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:14 smithi038 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-13T18:34:14.569 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:14 smithi038 systemd[1]: Stopped Ceph osd.2 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:34:14.570 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:14 smithi038 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.2.service: Consumed 57.391s CPU time. 2024-09-13T18:34:14.831 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:14 smithi038 systemd[1]: Starting Ceph osd.2 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:34:14.831 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:14 smithi038 podman[111995]: 2024-09-13 18:34:14.683862388 +0000 UTC m=+0.016324518 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:34:14.831 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:14 smithi038 podman[111995]: 2024-09-13 18:34:14.817153965 +0000 UTC m=+0.149616087 container create 12723720e34f9c67fc1ee90a62d4dafaac7b63da7de05c6f96e6838292965b45 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T18:34:15.174 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:14 smithi038 ceph-mon[91522]: Health check failed: Degraded data redundancy: 32/282 objects degraded (11.348%), 8 pgs degraded (PG_DEGRADED) 2024-09-13T18:34:15.175 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 podman[111995]: 2024-09-13 18:34:15.072463491 +0000 UTC m=+0.404925614 container init 12723720e34f9c67fc1ee90a62d4dafaac7b63da7de05c6f96e6838292965b45 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-13T18:34:15.175 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 podman[111995]: 2024-09-13 18:34:15.07582577 +0000 UTC m=+0.408287901 container start 12723720e34f9c67fc1ee90a62d4dafaac7b63da7de05c6f96e6838292965b45 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T18:34:15.175 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 podman[111995]: 2024-09-13 18:34:15.172383822 +0000 UTC m=+0.504845965 container attach 12723720e34f9c67fc1ee90a62d4dafaac7b63da7de05c6f96e6838292965b45 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T18:34:15.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:14 smithi149 ceph-mon[76906]: Health check failed: Degraded data redundancy: 32/282 objects degraded (11.348%), 8 pgs degraded (PG_DEGRADED) 2024-09-13T18:34:15.440 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate[112009]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:34:15.440 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 bash[111995]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:34:15.441 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate[112009]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T18:34:15.441 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 bash[111995]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T18:34:15.441 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate[112009]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T18:34:15.441 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 bash[111995]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T18:34:15.441 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate[112009]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T18:34:15.441 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 bash[111995]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T18:34:15.441 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate[112009]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T18:34:15.441 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 bash[111995]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T18:34:15.441 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate[112009]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:34:15.441 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 bash[111995]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:34:15.441 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate[112009]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T18:34:15.441 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 bash[111995]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T18:34:15.737 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:15 smithi038 podman[111995]: 2024-09-13 18:34:15.4386476 +0000 UTC m=+0.771109733 container died 12723720e34f9c67fc1ee90a62d4dafaac7b63da7de05c6f96e6838292965b45 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:34:16.028 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:15 smithi038 ceph-mon[91522]: pgmap v123: 65 pgs: 10 active+undersized, 11 peering, 8 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/282 objects degraded (11.348%) 2024-09-13T18:34:16.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:15 smithi149 ceph-mon[76906]: pgmap v123: 65 pgs: 10 active+undersized, 11 peering, 8 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/282 objects degraded (11.348%) 2024-09-13T18:34:16.331 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:16 smithi038 podman[112129]: 2024-09-13 18:34:16.026695468 +0000 UTC m=+0.578888570 container remove 12723720e34f9c67fc1ee90a62d4dafaac7b63da7de05c6f96e6838292965b45 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T18:34:16.331 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:16 smithi038 podman[112189]: 2024-09-13 18:34:16.140669775 +0000 UTC m=+0.016559388 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:34:16.331 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:16 smithi038 podman[112189]: 2024-09-13 18:34:16.252567626 +0000 UTC m=+0.128457238 container create 090af670cd3d34d0799f3933d9820953cca0d2a8da8789f7c1102de47dd2240a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-13T18:34:16.831 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:16 smithi038 podman[112189]: 2024-09-13 18:34:16.497096657 +0000 UTC m=+0.372986272 container init 090af670cd3d34d0799f3933d9820953cca0d2a8da8789f7c1102de47dd2240a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T18:34:16.832 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:16 smithi038 podman[112189]: 2024-09-13 18:34:16.500404543 +0000 UTC m=+0.376294156 container start 090af670cd3d34d0799f3933d9820953cca0d2a8da8789f7c1102de47dd2240a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T18:34:16.832 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:16 smithi038 bash[112189]: 090af670cd3d34d0799f3933d9820953cca0d2a8da8789f7c1102de47dd2240a 2024-09-13T18:34:16.832 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:16 smithi038 systemd[1]: Started Ceph osd.2 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:34:17.331 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:17 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2[112205]: 2024-09-13T18:34:17.038+0000 7f529ef69640 -1 Falling back to public interface 2024-09-13T18:34:17.973 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:17 smithi038 ceph-mon[91522]: pgmap v124: 65 pgs: 10 active+undersized, 11 peering, 8 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/282 objects degraded (11.348%) 2024-09-13T18:34:17.973 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:17.973 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:17.973 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:34:18.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:17 smithi149 ceph-mon[76906]: pgmap v124: 65 pgs: 10 active+undersized, 11 peering, 8 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 32/282 objects degraded (11.348%) 2024-09-13T18:34:18.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:18.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:34:19.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:18 smithi149 ceph-mon[76906]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T18:34:19.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:18 smithi038 ceph-mon[91522]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-13T18:34:19.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:19 smithi149 ceph-mon[76906]: pgmap v125: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/282 objects degraded (16.667%) 2024-09-13T18:34:19.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:19 smithi038 ceph-mon[91522]: pgmap v125: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/282 objects degraded (16.667%) 2024-09-13T18:34:20.989 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:20 smithi038 ceph-mon[91522]: Health check update: Degraded data redundancy: 47/282 objects degraded (16.667%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T18:34:21.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:20 smithi149 ceph-mon[76906]: Health check update: Degraded data redundancy: 47/282 objects degraded (16.667%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T18:34:21.960 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:21 smithi038 ceph-mon[91522]: pgmap v126: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/282 objects degraded (16.667%) 2024-09-13T18:34:21.960 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:21.960 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:34:22.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:21 smithi149 ceph-mon[76906]: pgmap v126: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/282 objects degraded (16.667%) 2024-09-13T18:34:22.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:22.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:34:22.331 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:21 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2[112205]: 2024-09-13T18:34:21.957+0000 7f529ef69640 -1 osd.2 73 log_to_monitors true 2024-09-13T18:34:22.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:22 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:22.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:22 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:22.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:22 smithi038 ceph-mon[91522]: from='osd.2 [v2:172.21.15.38:6818/1124081148,v1:172.21.15.38:6819/1124081148]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T18:34:22.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:22 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:22.904 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:22 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:23.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:22 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:23.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:22 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:23.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:22 smithi149 ceph-mon[76906]: from='osd.2 [v2:172.21.15.38:6818/1124081148,v1:172.21.15.38:6819/1124081148]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T18:34:23.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:22 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:23.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:22 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:23.831 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:34:23 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2[112205]: 2024-09-13T18:34:23.512+0000 7f5292cfa640 -1 osd.2 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:34:23.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:23 smithi038 ceph-mon[91522]: pgmap v127: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/282 objects degraded (16.667%) 2024-09-13T18:34:23.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:23 smithi038 ceph-mon[91522]: from='osd.2 [v2:172.21.15.38:6818/1124081148,v1:172.21.15.38:6819/1124081148]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T18:34:23.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:23 smithi038 ceph-mon[91522]: osdmap e76: 6 total, 5 up, 6 in 2024-09-13T18:34:23.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:23 smithi038 ceph-mon[91522]: from='osd.2 [v2:172.21.15.38:6818/1124081148,v1:172.21.15.38:6819/1124081148]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-13T18:34:23.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:23 smithi038 ceph-mon[91522]: from='osd.2 [v2:172.21.15.38:6818/1124081148,v1:172.21.15.38:6819/1124081148]' entity='osd.2' 2024-09-13T18:34:24.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:23 smithi149 ceph-mon[76906]: pgmap v127: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/282 objects degraded (16.667%) 2024-09-13T18:34:24.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:23 smithi149 ceph-mon[76906]: from='osd.2 [v2:172.21.15.38:6818/1124081148,v1:172.21.15.38:6819/1124081148]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T18:34:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:23 smithi149 ceph-mon[76906]: osdmap e76: 6 total, 5 up, 6 in 2024-09-13T18:34:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:23 smithi149 ceph-mon[76906]: from='osd.2 [v2:172.21.15.38:6818/1124081148,v1:172.21.15.38:6819/1124081148]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi038", "root=default"]}]: dispatch 2024-09-13T18:34:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:23 smithi149 ceph-mon[76906]: from='osd.2 [v2:172.21.15.38:6818/1124081148,v1:172.21.15.38:6819/1124081148]' entity='osd.2' 2024-09-13T18:34:25.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:24 smithi149 ceph-mon[76906]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T18:34:25.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:24 smithi149 ceph-mon[76906]: osd.2 [v2:172.21.15.38:6818/1124081148,v1:172.21.15.38:6819/1124081148] boot 2024-09-13T18:34:25.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:24 smithi149 ceph-mon[76906]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T18:34:25.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:24 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:34:25.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:24 smithi038 ceph-mon[91522]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T18:34:25.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:24 smithi038 ceph-mon[91522]: osd.2 [v2:172.21.15.38:6818/1124081148,v1:172.21.15.38:6819/1124081148] boot 2024-09-13T18:34:25.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:24 smithi038 ceph-mon[91522]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T18:34:25.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:24 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T18:34:26.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:25 smithi149 ceph-mon[76906]: pgmap v129: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 47/282 objects degraded (16.667%) 2024-09-13T18:34:26.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:25 smithi149 ceph-mon[76906]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T18:34:26.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:25 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:26.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:25 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:26.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:25 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:34:26.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:25 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:34:26.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:25 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:26.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:25 smithi038 ceph-mon[91522]: pgmap v129: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 47/282 objects degraded (16.667%) 2024-09-13T18:34:26.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:25 smithi038 ceph-mon[91522]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T18:34:26.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:25 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:26.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:25 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:26.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:25 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:34:26.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:25 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:34:26.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:25 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:27.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:34:27.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:27.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:27.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:27.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T18:34:27.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:26 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T18:34:27.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:26 smithi149 ceph-mon[76906]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T18:34:27.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:34:27.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:27.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:27.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:27.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T18:34:27.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:26 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T18:34:27.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:26 smithi038 ceph-mon[91522]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T18:34:28.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:27 smithi149 ceph-mon[76906]: pgmap v132: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 47/282 objects degraded (16.667%) 2024-09-13T18:34:28.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:27 smithi038 ceph-mon[91522]: pgmap v132: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 47/282 objects degraded (16.667%) 2024-09-13T18:34:29.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:28 smithi038 ceph-mon[91522]: Health check update: Degraded data redundancy: 14/282 objects degraded (4.965%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T18:34:29.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:28 smithi149 ceph-mon[76906]: Health check update: Degraded data redundancy: 14/282 objects degraded (4.965%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T18:34:30.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:29 smithi149 ceph-mon[76906]: pgmap v133: 65 pgs: 7 active+undersized, 3 active+undersized+degraded, 55 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 14/282 objects degraded (4.965%) 2024-09-13T18:34:30.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:29 smithi038 ceph-mon[91522]: pgmap v133: 65 pgs: 7 active+undersized, 3 active+undersized+degraded, 55 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 14/282 objects degraded (4.965%) 2024-09-13T18:34:31.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:30 smithi149 ceph-mon[76906]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/282 objects degraded (4.965%), 3 pgs degraded) 2024-09-13T18:34:31.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:30 smithi149 ceph-mon[76906]: Cluster is now healthy 2024-09-13T18:34:31.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:30 smithi038 ceph-mon[91522]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/282 objects degraded (4.965%), 3 pgs degraded) 2024-09-13T18:34:31.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:30 smithi038 ceph-mon[91522]: Cluster is now healthy 2024-09-13T18:34:32.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:31 smithi149 ceph-mon[76906]: pgmap v134: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 800 B/s rd, 2 op/s 2024-09-13T18:34:32.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:31 smithi038 ceph-mon[91522]: pgmap v134: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 800 B/s rd, 2 op/s 2024-09-13T18:34:34.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:33 smithi149 ceph-mon[76906]: pgmap v135: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-13T18:34:34.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:33 smithi038 ceph-mon[91522]: pgmap v135: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 2 op/s 2024-09-13T18:34:36.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:35 smithi149 ceph-mon[76906]: pgmap v136: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-13T18:34:36.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:35 smithi038 ceph-mon[91522]: pgmap v136: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-13T18:34:37.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:37 smithi038 ceph-mon[91522]: pgmap v137: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-13T18:34:37.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:37 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:37.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:37 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:34:37.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:37 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:37 smithi149 ceph-mon[76906]: pgmap v137: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-13T18:34:38.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:37 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:38.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:37 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:34:38.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:37 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:38.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.950+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/2374108599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b740feaf0 msgr2=0x7f2b740feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.950+0000 7f2b7ab7e640 1 --2- 172.21.15.38:0/2374108599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b740feaf0 0x7f2b740feef0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009880 tx=0x7f2b6802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.950+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/2374108599 shutdown_connections 2024-09-13T18:34:38.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.950+0000 7f2b7ab7e640 1 --2- 172.21.15.38:0/2374108599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b740ffcf0 0x7f2b74100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.950+0000 7f2b7ab7e640 1 --2- 172.21.15.38:0/2374108599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b740feaf0 0x7f2b740feef0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.950+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/2374108599 >> 172.21.15.38:0/2374108599 conn(0x7f2b740fa280 msgr2=0x7f2b740fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:38.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.950+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/2374108599 shutdown_connections 2024-09-13T18:34:38.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.950+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/2374108599 wait complete. 2024-09-13T18:34:38.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.951+0000 7f2b7ab7e640 1 Processor -- start 2024-09-13T18:34:38.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.951+0000 7f2b7ab7e640 1 -- start start 2024-09-13T18:34:38.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.951+0000 7f2b7ab7e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b740feaf0 0x7f2b74197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.951+0000 7f2b7ab7e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b740ffcf0 0x7f2b74197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.951+0000 7f2b7ab7e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b74198350 con 0x7f2b740feaf0 2024-09-13T18:34:38.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.951+0000 7f2b7ab7e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b741984c0 con 0x7f2b740ffcf0 2024-09-13T18:34:38.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.951+0000 7f2b7891a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b740feaf0 0x7f2b74197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.951+0000 7f2b7891a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b740feaf0 0x7f2b74197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55820/0 (socket says 172.21.15.38:55820) 2024-09-13T18:34:38.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.951+0000 7f2b7891a640 1 -- 172.21.15.38:0/777782715 learned_addr learned my addr 172.21.15.38:0/777782715 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:38.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.952+0000 7f2b73fff640 1 --2- 172.21.15.38:0/777782715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b740ffcf0 0x7f2b74197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.952+0000 7f2b7891a640 1 -- 172.21.15.38:0/777782715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b740ffcf0 msgr2=0x7f2b74197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:38.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.952+0000 7f2b7891a640 1 --2- 172.21.15.38:0/777782715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b740ffcf0 0x7f2b74197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:38.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.952+0000 7f2b7891a640 1 -- 172.21.15.38:0/777782715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b68009560 con 0x7f2b740feaf0 2024-09-13T18:34:38.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.952+0000 7f2b7891a640 1 --2- 172.21.15.38:0/777782715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b740feaf0 0x7f2b74197840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2b68005520 tx=0x7f2b68005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:38.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.952+0000 7f2b71ffb640 1 -- 172.21.15.38:0/777782715 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b68004aa0 con 0x7f2b740feaf0 2024-09-13T18:34:38.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.952+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/777782715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7419ce90 con 0x7f2b740feaf0 2024-09-13T18:34:38.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.952+0000 7f2b71ffb640 1 -- 172.21.15.38:0/777782715 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b68004c00 con 0x7f2b740feaf0 2024-09-13T18:34:38.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.952+0000 7f2b71ffb640 1 -- 172.21.15.38:0/777782715 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b68031920 con 0x7f2b740feaf0 2024-09-13T18:34:38.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.953+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/777782715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7419d300 con 0x7f2b740feaf0 2024-09-13T18:34:38.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.954+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/777782715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b741075c0 con 0x7f2b740feaf0 2024-09-13T18:34:38.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.954+0000 7f2b71ffb640 1 -- 172.21.15.38:0/777782715 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2b68031b90 con 0x7f2b740feaf0 2024-09-13T18:34:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.954+0000 7f2b71ffb640 1 --2- 172.21.15.38:0/777782715 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2b6406cc50 0x7f2b6406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.955+0000 7f2b71ffb640 1 -- 172.21.15.38:0/777782715 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f2b680ad810 con 0x7f2b740feaf0 2024-09-13T18:34:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.955+0000 7f2b73fff640 1 --2- 172.21.15.38:0/777782715 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2b6406cc50 0x7f2b6406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:38.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.955+0000 7f2b73fff640 1 --2- 172.21.15.38:0/777782715 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2b6406cc50 0x7f2b6406f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b60005fd0 tx=0x7f2b60005850 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:38.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:38.959+0000 7f2b71ffb640 1 -- 172.21.15.38:0/777782715 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2b680778a0 con 0x7f2b740feaf0 2024-09-13T18:34:39.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.190+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/777782715 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b74068340 con 0x7f2b6406cc50 2024-09-13T18:34:39.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.191+0000 7f2b71ffb640 1 -- 172.21.15.38:0/777782715 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2b74068340 con 0x7f2b6406cc50 2024-09-13T18:34:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.193+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/777782715 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2b6406cc50 msgr2=0x7f2b6406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.193+0000 7f2b7ab7e640 1 --2- 172.21.15.38:0/777782715 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2b6406cc50 0x7f2b6406f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b60005fd0 tx=0x7f2b60005850 comp rx=0 tx=0).stop 2024-09-13T18:34:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.193+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/777782715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b740feaf0 msgr2=0x7f2b74197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.193+0000 7f2b7ab7e640 1 --2- 172.21.15.38:0/777782715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b740feaf0 0x7f2b74197840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2b68005520 tx=0x7f2b68005550 comp rx=0 tx=0).stop 2024-09-13T18:34:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.193+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/777782715 shutdown_connections 2024-09-13T18:34:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.193+0000 7f2b7ab7e640 1 --2- 172.21.15.38:0/777782715 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2b6406cc50 0x7f2b6406f110 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.193+0000 7f2b7ab7e640 1 --2- 172.21.15.38:0/777782715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b740ffcf0 0x7f2b74197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.193+0000 7f2b7ab7e640 1 --2- 172.21.15.38:0/777782715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2b740feaf0 0x7f2b74197840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.193+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/777782715 >> 172.21.15.38:0/777782715 conn(0x7f2b740fa280 msgr2=0x7f2b74067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.193+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/777782715 shutdown_connections 2024-09-13T18:34:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.193+0000 7f2b7ab7e640 1 -- 172.21.15.38:0/777782715 wait complete. 2024-09-13T18:34:39.205 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:34:39.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.279+0000 7f01d8680640 1 -- 172.21.15.38:0/1088269275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01d00fea80 msgr2=0x7f01d00fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.279+0000 7f01d8680640 1 --2- 172.21.15.38:0/1088269275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01d00fea80 0x7f01d00fee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009c20 tx=0x7f01cc02a970 comp rx=0 tx=0).stop 2024-09-13T18:34:39.284 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.279+0000 7f01d8680640 1 -- 172.21.15.38:0/1088269275 shutdown_connections 2024-09-13T18:34:39.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.279+0000 7f01d8680640 1 --2- 172.21.15.38:0/1088269275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d00ffc80 0x7f01d0100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.279+0000 7f01d8680640 1 --2- 172.21.15.38:0/1088269275 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01d00fea80 0x7f01d00fee80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.279+0000 7f01d8680640 1 -- 172.21.15.38:0/1088269275 >> 172.21.15.38:0/1088269275 conn(0x7f01d00fa230 msgr2=0x7f01d00fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:39.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.279+0000 7f01d8680640 1 -- 172.21.15.38:0/1088269275 shutdown_connections 2024-09-13T18:34:39.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.279+0000 7f01d8680640 1 -- 172.21.15.38:0/1088269275 wait complete. 2024-09-13T18:34:39.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.279+0000 7f01d8680640 1 Processor -- start 2024-09-13T18:34:39.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d8680640 1 -- start start 2024-09-13T18:34:39.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d8680640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01d00fea80 0x7f01d0194440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d8680640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d00ffc80 0x7f01d0194980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d8680640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0194ec0 con 0x7f01d00fea80 2024-09-13T18:34:39.285 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d8680640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0195030 con 0x7f01d00ffc80 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d641c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01d00fea80 0x7f01d0194440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d641c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01d00fea80 0x7f01d0194440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55838/0 (socket says 172.21.15.38:55838) 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d641c640 1 -- 172.21.15.38:0/3744251456 learned_addr learned my addr 172.21.15.38:0/3744251456 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d5c1b640 1 --2- 172.21.15.38:0/3744251456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d00ffc80 0x7f01d0194980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d641c640 1 -- 172.21.15.38:0/3744251456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d00ffc80 msgr2=0x7f01d0194980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d641c640 1 --2- 172.21.15.38:0/3744251456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d00ffc80 0x7f01d0194980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d641c640 1 -- 172.21.15.38:0/3744251456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc009900 con 0x7f01d00fea80 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.280+0000 7f01d641c640 1 --2- 172.21.15.38:0/3744251456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01d00fea80 0x7f01d0194440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f01cc02fb90 tx=0x7f01cc02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.281+0000 7f01c77fe640 1 -- 172.21.15.38:0/3744251456 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01cc040070 con 0x7f01d00fea80 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.281+0000 7f01c77fe640 1 -- 172.21.15.38:0/3744251456 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f01cc02f970 con 0x7f01d00fea80 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.281+0000 7f01d8680640 1 -- 172.21.15.38:0/3744251456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d0068450 con 0x7f01d00fea80 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.281+0000 7f01c77fe640 1 -- 172.21.15.38:0/3744251456 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01cc03a5c0 con 0x7f01d00fea80 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.281+0000 7f01d8680640 1 -- 172.21.15.38:0/3744251456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d0068970 con 0x7f01d00fea80 2024-09-13T18:34:39.286 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.282+0000 7f01d8680640 1 -- 172.21.15.38:0/3744251456 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d0107530 con 0x7f01d00fea80 2024-09-13T18:34:39.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.282+0000 7f01c77fe640 1 -- 172.21.15.38:0/3744251456 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f01cc00a040 con 0x7f01d00fea80 2024-09-13T18:34:39.287 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.283+0000 7f01c77fe640 1 --2- 172.21.15.38:0/3744251456 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f01bc06cc50 0x7f01bc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.283+0000 7f01c77fe640 1 -- 172.21.15.38:0/3744251456 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f01cc02c040 con 0x7f01d00fea80 2024-09-13T18:34:39.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.283+0000 7f01d5c1b640 1 --2- 172.21.15.38:0/3744251456 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f01bc06cc50 0x7f01bc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.284+0000 7f01d5c1b640 1 --2- 172.21.15.38:0/3744251456 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f01bc06cc50 0x7f01bc06f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f01d0195960 tx=0x7f01c0005cc0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:39.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.287+0000 7f01c77fe640 1 -- 172.21.15.38:0/3744251456 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f01cc079830 con 0x7f01d00fea80 2024-09-13T18:34:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.480+0000 7f01d8680640 1 -- 172.21.15.38:0/3744251456 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f01d0068fd0 con 0x7f01bc06cc50 2024-09-13T18:34:39.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.482+0000 7f01c77fe640 1 -- 172.21.15.38:0/3744251456 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f01d0068fd0 con 0x7f01bc06cc50 2024-09-13T18:34:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.484+0000 7f01d8680640 1 -- 172.21.15.38:0/3744251456 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f01bc06cc50 msgr2=0x7f01bc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.484+0000 7f01d8680640 1 --2- 172.21.15.38:0/3744251456 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f01bc06cc50 0x7f01bc06f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f01d0195960 tx=0x7f01c0005cc0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.484+0000 7f01d8680640 1 -- 172.21.15.38:0/3744251456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01d00fea80 msgr2=0x7f01d0194440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.484+0000 7f01d8680640 1 --2- 172.21.15.38:0/3744251456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01d00fea80 0x7f01d0194440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f01cc02fb90 tx=0x7f01cc02f5f0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.484+0000 7f01d8680640 1 -- 172.21.15.38:0/3744251456 shutdown_connections 2024-09-13T18:34:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.484+0000 7f01d8680640 1 --2- 172.21.15.38:0/3744251456 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f01bc06cc50 0x7f01bc06f110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.484+0000 7f01d8680640 1 --2- 172.21.15.38:0/3744251456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01d00ffc80 0x7f01d0194980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.484+0000 7f01d8680640 1 --2- 172.21.15.38:0/3744251456 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01d00fea80 0x7f01d0194440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.484+0000 7f01d8680640 1 -- 172.21.15.38:0/3744251456 >> 172.21.15.38:0/3744251456 conn(0x7f01d00fa230 msgr2=0x7f01d0102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.484+0000 7f01d8680640 1 -- 172.21.15.38:0/3744251456 shutdown_connections 2024-09-13T18:34:39.487 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.484+0000 7f01d8680640 1 -- 172.21.15.38:0/3744251456 wait complete. 2024-09-13T18:34:39.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.567+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/1688790582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0103010 msgr2=0x7fc6e0105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.567+0000 7fc6e4ad8640 1 --2- 172.21.15.38:0/1688790582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0103010 0x7fc6e0105400 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009880 tx=0x7fc6d402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.567+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/1688790582 shutdown_connections 2024-09-13T18:34:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.567+0000 7fc6e4ad8640 1 --2- 172.21.15.38:0/1688790582 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0103010 0x7fc6e0105400 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.567+0000 7fc6e4ad8640 1 --2- 172.21.15.38:0/1688790582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e01006e0 0x7fc6e0102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.567+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/1688790582 >> 172.21.15.38:0/1688790582 conn(0x7fc6e00fa280 msgr2=0x7fc6e00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.567+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/1688790582 shutdown_connections 2024-09-13T18:34:39.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.568+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/1688790582 wait complete. 2024-09-13T18:34:39.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.568+0000 7fc6e4ad8640 1 Processor -- start 2024-09-13T18:34:39.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.568+0000 7fc6e4ad8640 1 -- start start 2024-09-13T18:34:39.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.568+0000 7fc6e4ad8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e01006e0 0x7fc6e01955c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.568+0000 7fc6e4ad8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0103010 0x7fc6e0195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.569+0000 7fc6e4ad8640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e01960d0 con 0x7fc6e0103010 2024-09-13T18:34:39.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.569+0000 7fc6e4ad8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0196240 con 0x7fc6e01006e0 2024-09-13T18:34:39.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.569+0000 7fc6ddd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0103010 0x7fc6e0195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.569+0000 7fc6ddd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0103010 0x7fc6e0195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55864/0 (socket says 172.21.15.38:55864) 2024-09-13T18:34:39.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.569+0000 7fc6ddd9b640 1 -- 172.21.15.38:0/3265010812 learned_addr learned my addr 172.21.15.38:0/3265010812 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:39.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.569+0000 7fc6de59c640 1 --2- 172.21.15.38:0/3265010812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e01006e0 0x7fc6e01955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.569+0000 7fc6ddd9b640 1 -- 172.21.15.38:0/3265010812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e01006e0 msgr2=0x7fc6e01955c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.569+0000 7fc6ddd9b640 1 --2- 172.21.15.38:0/3265010812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e01006e0 0x7fc6e01955c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.569+0000 7fc6ddd9b640 1 -- 172.21.15.38:0/3265010812 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d4009560 con 0x7fc6e0103010 2024-09-13T18:34:39.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.569+0000 7fc6ddd9b640 1 --2- 172.21.15.38:0/3265010812 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0103010 0x7fc6e0195b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40055a0 tx=0x7fc6d40055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:39.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.576+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/3265010812 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d4004aa0 con 0x7fc6e0103010 2024-09-13T18:34:39.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.576+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/3265010812 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6d4005d50 con 0x7fc6e0103010 2024-09-13T18:34:39.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.576+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/3265010812 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d4031820 con 0x7fc6e0103010 2024-09-13T18:34:39.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.576+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/3265010812 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e019ac90 con 0x7fc6e0103010 2024-09-13T18:34:39.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.576+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/3265010812 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e019b1e0 con 0x7fc6e0103010 2024-09-13T18:34:39.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.577+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/3265010812 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e0108650 con 0x7fc6e0103010 2024-09-13T18:34:39.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.577+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/3265010812 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc6d4004c00 con 0x7fc6e0103010 2024-09-13T18:34:39.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.578+0000 7fc6cf7fe640 1 --2- 172.21.15.38:0/3265010812 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc6c806cc50 0x7fc6c806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.578+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/3265010812 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fc6d40ad520 con 0x7fc6e0103010 2024-09-13T18:34:39.580 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.578+0000 7fc6de59c640 1 --2- 172.21.15.38:0/3265010812 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc6c806cc50 0x7fc6c806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.581 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.578+0000 7fc6de59c640 1 --2- 172.21.15.38:0/3265010812 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc6c806cc50 0x7fc6c806f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009bd0 tx=0x7fc6d0005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:39.584 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.582+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/3265010812 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc6d4077660 con 0x7fc6e0103010 2024-09-13T18:34:39.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.763+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/3265010812 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6e0103ad0 con 0x7fc6c806cc50 2024-09-13T18:34:39.766 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:39 smithi038 ceph-mon[91522]: pgmap v138: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-13T18:34:39.775 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.772+0000 7fc6cf7fe640 1 -- 172.21.15.38:0/3265010812 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc6e0103ad0 con 0x7fc6c806cc50 2024-09-13T18:34:39.775 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:34:39.775 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (10m) 18s ago 12m 24.1M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:34:39.775 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (12m) 18s ago 12m 8350k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:34:39.775 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (11m) 108s ago 11m 7972k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:34:39.775 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (116s) 18s ago 12m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:34:39.775 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (111s) 108s ago 11m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:34:39.775 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (10m) 18s ago 12m 87.8M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (6m) 18s ago 6m 156M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (6m) 18s ago 6m 98.3M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (6m) 108s ago 6m 25.8M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (6m) 108s ago 6m 25.4M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (3m) 18s ago 13m 491M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (2m) 108s ago 11m 438M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (2m) 18s ago 13m 47.4M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (2m) 108s ago 11m 27.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (12m) 18s ago 12m 15.3M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (11m) 108s ago 11m 15.7M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (92s) 18s ago 10m 131M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (57s) 18s ago 10m 95.5M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 b2f99a2919b9 2024-09-13T18:34:39.776 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (23s) 18s ago 9m 11.2M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 090af670cd3d 2024-09-13T18:34:39.777 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (9m) 108s ago 9m 281M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 33a68d3f4510 2024-09-13T18:34:39.777 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (8m) 108s ago 8m 267M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:34:39.777 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (8m) 108s ago 8m 227M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:34:39.777 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (2m) 18s ago 11m 60.7M - 2.43.0 a07b618ecd1d c04b1dcdc8c3 2024-09-13T18:34:39.777 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.774+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/3265010812 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc6c806cc50 msgr2=0x7fc6c806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.774+0000 7fc6e4ad8640 1 --2- 172.21.15.38:0/3265010812 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc6c806cc50 0x7fc6c806f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009bd0 tx=0x7fc6d0005f90 comp rx=0 tx=0).stop 2024-09-13T18:34:39.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.774+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/3265010812 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0103010 msgr2=0x7fc6e0195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.774+0000 7fc6e4ad8640 1 --2- 172.21.15.38:0/3265010812 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0103010 0x7fc6e0195b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40055a0 tx=0x7fc6d40055d0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.774+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/3265010812 shutdown_connections 2024-09-13T18:34:39.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.774+0000 7fc6e4ad8640 1 --2- 172.21.15.38:0/3265010812 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e0103010 0x7fc6e0195b00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.775+0000 7fc6e4ad8640 1 --2- 172.21.15.38:0/3265010812 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc6c806cc50 0x7fc6c806f110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.775+0000 7fc6e4ad8640 1 --2- 172.21.15.38:0/3265010812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e01006e0 0x7fc6e01955c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.775+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/3265010812 >> 172.21.15.38:0/3265010812 conn(0x7fc6e00fa280 msgr2=0x7fc6e00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:39.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.775+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/3265010812 shutdown_connections 2024-09-13T18:34:39.778 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.775+0000 7fc6e4ad8640 1 -- 172.21.15.38:0/3265010812 wait complete. 2024-09-13T18:34:39.841 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:39 smithi149 ceph-mon[76906]: pgmap v138: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-13T18:34:39.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.857+0000 7f7d44b6e640 1 -- 172.21.15.38:0/662090991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d40100d90 msgr2=0x7f7d40101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.857+0000 7f7d44b6e640 1 --2- 172.21.15.38:0/662090991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d40100d90 0x7f7d40101210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009880 tx=0x7f7d3002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.860 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.857+0000 7f7d44b6e640 1 -- 172.21.15.38:0/662090991 shutdown_connections 2024-09-13T18:34:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.857+0000 7f7d44b6e640 1 --2- 172.21.15.38:0/662090991 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d40100d90 0x7f7d40101210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.857+0000 7f7d44b6e640 1 --2- 172.21.15.38:0/662090991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d400ffb90 0x7f7d400fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.857+0000 7f7d44b6e640 1 -- 172.21.15.38:0/662090991 >> 172.21.15.38:0/662090991 conn(0x7f7d400fb320 msgr2=0x7f7d400fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.857+0000 7f7d44b6e640 1 -- 172.21.15.38:0/662090991 shutdown_connections 2024-09-13T18:34:39.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.857+0000 7f7d44b6e640 1 -- 172.21.15.38:0/662090991 wait complete. 2024-09-13T18:34:39.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.858+0000 7f7d44b6e640 1 Processor -- start 2024-09-13T18:34:39.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.858+0000 7f7d44b6e640 1 -- start start 2024-09-13T18:34:39.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.858+0000 7f7d44b6e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d400ffb90 0x7f7d40195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.858+0000 7f7d44b6e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d40100d90 0x7f7d40195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d44b6e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d40196040 con 0x7f7d400ffb90 2024-09-13T18:34:39.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d44b6e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d401961b0 con 0x7f7d40100d90 2024-09-13T18:34:39.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d3e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d400ffb90 0x7f7d40195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.863 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d3e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d400ffb90 0x7f7d40195530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55868/0 (socket says 172.21.15.38:55868) 2024-09-13T18:34:39.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d3e59c640 1 -- 172.21.15.38:0/1763896960 learned_addr learned my addr 172.21.15.38:0/1763896960 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:39.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d3dd9b640 1 --2- 172.21.15.38:0/1763896960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d40100d90 0x7f7d40195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d3e59c640 1 -- 172.21.15.38:0/1763896960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d40100d90 msgr2=0x7f7d40195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:39.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d3e59c640 1 --2- 172.21.15.38:0/1763896960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d40100d90 0x7f7d40195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:39.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d3e59c640 1 -- 172.21.15.38:0/1763896960 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d30009560 con 0x7f7d400ffb90 2024-09-13T18:34:39.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d3dd9b640 1 --2- 172.21.15.38:0/1763896960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d40100d90 0x7f7d40195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:34:39.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d3e59c640 1 --2- 172.21.15.38:0/1763896960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d400ffb90 0x7f7d40195530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800d720 tx=0x7f7d2800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:39.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d377fe640 1 -- 172.21.15.38:0/1763896960 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d280041f0 con 0x7f7d400ffb90 2024-09-13T18:34:39.864 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d377fe640 1 -- 172.21.15.38:0/1763896960 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d28004350 con 0x7f7d400ffb90 2024-09-13T18:34:39.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d44b6e640 1 -- 172.21.15.38:0/1763896960 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4019abe0 con 0x7f7d400ffb90 2024-09-13T18:34:39.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d377fe640 1 -- 172.21.15.38:0/1763896960 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d28003d40 con 0x7f7d400ffb90 2024-09-13T18:34:39.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.859+0000 7f7d44b6e640 1 -- 172.21.15.38:0/1763896960 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4019b130 con 0x7f7d400ffb90 2024-09-13T18:34:39.865 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.860+0000 7f7d44b6e640 1 -- 172.21.15.38:0/1763896960 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4018f5d0 con 0x7f7d400ffb90 2024-09-13T18:34:39.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.861+0000 7f7d377fe640 1 -- 172.21.15.38:0/1763896960 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7d28009820 con 0x7f7d400ffb90 2024-09-13T18:34:39.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.861+0000 7f7d377fe640 1 --2- 172.21.15.38:0/1763896960 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7d2c06cc60 0x7f7d2c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:39.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.861+0000 7f7d377fe640 1 -- 172.21.15.38:0/1763896960 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f7d2808c0a0 con 0x7f7d400ffb90 2024-09-13T18:34:39.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.861+0000 7f7d3dd9b640 1 --2- 172.21.15.38:0/1763896960 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7d2c06cc60 0x7f7d2c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:39.866 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.862+0000 7f7d3dd9b640 1 --2- 172.21.15.38:0/1763896960 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7d2c06cc60 0x7f7d2c06f120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d401969e0 tx=0x7f7d30031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:39.868 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:39.866+0000 7f7d377fe640 1 -- 172.21.15.38:0/1763896960 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7d28056090 con 0x7f7d400ffb90 2024-09-13T18:34:40.106 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.104+0000 7f7d44b6e640 1 -- 172.21.15.38:0/1763896960 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7d40108880 con 0x7f7d400ffb90 2024-09-13T18:34:40.107 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.104+0000 7f7d377fe640 1 -- 172.21.15.38:0/1763896960 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f7d280596b0 con 0x7f7d400ffb90 2024-09-13T18:34:40.107 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:34:40.107 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:34:40.107 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:34:40.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 3, 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 3 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 7, 2024-09-13T18:34:40.108 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 7 2024-09-13T18:34:40.109 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:34:40.109 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:34:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.107+0000 7f7d44b6e640 1 -- 172.21.15.38:0/1763896960 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7d2c06cc60 msgr2=0x7f7d2c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.107+0000 7f7d44b6e640 1 --2- 172.21.15.38:0/1763896960 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7d2c06cc60 0x7f7d2c06f120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d401969e0 tx=0x7f7d30031400 comp rx=0 tx=0).stop 2024-09-13T18:34:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.107+0000 7f7d44b6e640 1 -- 172.21.15.38:0/1763896960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d400ffb90 msgr2=0x7f7d40195530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.107+0000 7f7d44b6e640 1 --2- 172.21.15.38:0/1763896960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d400ffb90 0x7f7d40195530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800d720 tx=0x7f7d2800dbe0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.107+0000 7f7d44b6e640 1 -- 172.21.15.38:0/1763896960 shutdown_connections 2024-09-13T18:34:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.107+0000 7f7d44b6e640 1 --2- 172.21.15.38:0/1763896960 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7d2c06cc60 0x7f7d2c06f120 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.107+0000 7f7d44b6e640 1 --2- 172.21.15.38:0/1763896960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d40100d90 0x7f7d40195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.107+0000 7f7d44b6e640 1 --2- 172.21.15.38:0/1763896960 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d400ffb90 0x7f7d40195530 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.107+0000 7f7d44b6e640 1 -- 172.21.15.38:0/1763896960 >> 172.21.15.38:0/1763896960 conn(0x7f7d400fb320 msgr2=0x7f7d401044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.107+0000 7f7d44b6e640 1 -- 172.21.15.38:0/1763896960 shutdown_connections 2024-09-13T18:34:40.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.107+0000 7f7d44b6e640 1 -- 172.21.15.38:0/1763896960 wait complete. 2024-09-13T18:34:40.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.190+0000 7f82793a3640 1 -- 172.21.15.38:0/1301267411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274100680 msgr2=0x7f8274102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.190+0000 7f82793a3640 1 --2- 172.21.15.38:0/1301267411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274100680 0x7f8274102a70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f82640098b0 tx=0x7f826402a4d0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.190+0000 7f82793a3640 1 -- 172.21.15.38:0/1301267411 shutdown_connections 2024-09-13T18:34:40.193 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.190+0000 7f82793a3640 1 --2- 172.21.15.38:0/1301267411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8274102fb0 0x7f82741053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.190+0000 7f82793a3640 1 --2- 172.21.15.38:0/1301267411 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274100680 0x7f8274102a70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.190+0000 7f82793a3640 1 -- 172.21.15.38:0/1301267411 >> 172.21.15.38:0/1301267411 conn(0x7f82740fa280 msgr2=0x7f82740fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:40.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.191+0000 7f82793a3640 1 -- 172.21.15.38:0/1301267411 shutdown_connections 2024-09-13T18:34:40.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.191+0000 7f82793a3640 1 -- 172.21.15.38:0/1301267411 wait complete. 2024-09-13T18:34:40.194 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.191+0000 7f82793a3640 1 Processor -- start 2024-09-13T18:34:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.191+0000 7f82793a3640 1 -- start start 2024-09-13T18:34:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.191+0000 7f82793a3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274100680 0x7f82741955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.191+0000 7f82793a3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8274102fb0 0x7f8274195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.195 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.191+0000 7f82793a3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82741960e0 con 0x7f8274100680 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.191+0000 7f82793a3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8274196250 con 0x7f8274102fb0 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f8272ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274100680 0x7f82741955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f8272ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274100680 0x7f82741955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55890/0 (socket says 172.21.15.38:55890) 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f8272ffd640 1 -- 172.21.15.38:0/3794564307 learned_addr learned my addr 172.21.15.38:0/3794564307 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f82727fc640 1 --2- 172.21.15.38:0/3794564307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8274102fb0 0x7f8274195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f8272ffd640 1 -- 172.21.15.38:0/3794564307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8274102fb0 msgr2=0x7f8274195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f8272ffd640 1 --2- 172.21.15.38:0/3794564307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8274102fb0 0x7f8274195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f8272ffd640 1 -- 172.21.15.38:0/3794564307 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8264009560 con 0x7f8274100680 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f8272ffd640 1 --2- 172.21.15.38:0/3794564307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274100680 0x7f82741955d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8264006010 tx=0x7f82640055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f825bfff640 1 -- 172.21.15.38:0/3794564307 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8264004b60 con 0x7f8274100680 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f825bfff640 1 -- 172.21.15.38:0/3794564307 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8264004cc0 con 0x7f8274100680 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f825bfff640 1 -- 172.21.15.38:0/3794564307 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82640319d0 con 0x7f8274100680 2024-09-13T18:34:40.196 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f82793a3640 1 -- 172.21.15.38:0/3794564307 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827419ac90 con 0x7f8274100680 2024-09-13T18:34:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.192+0000 7f82793a3640 1 -- 172.21.15.38:0/3794564307 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827419b180 con 0x7f8274100680 2024-09-13T18:34:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.193+0000 7f82793a3640 1 -- 172.21.15.38:0/3794564307 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82741086f0 con 0x7f8274100680 2024-09-13T18:34:40.197 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.194+0000 7f825bfff640 1 -- 172.21.15.38:0/3794564307 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8264003ce0 con 0x7f8274100680 2024-09-13T18:34:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.194+0000 7f825bfff640 1 --2- 172.21.15.38:0/3794564307 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f825c06cc50 0x7f825c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.194+0000 7f825bfff640 1 -- 172.21.15.38:0/3794564307 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f82640ad7b0 con 0x7f8274100680 2024-09-13T18:34:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.194+0000 7f82727fc640 1 --2- 172.21.15.38:0/3794564307 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f825c06cc50 0x7f825c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.195+0000 7f82727fc640 1 --2- 172.21.15.38:0/3794564307 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f825c06cc50 0x7f825c06f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8274196af0 tx=0x7f826800b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:40.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.199+0000 7f825bfff640 1 -- 172.21.15.38:0/3794564307 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8264077870 con 0x7f8274100680 2024-09-13T18:34:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.406+0000 7f82793a3640 1 -- 172.21.15.38:0/3794564307 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f827419b370 con 0x7f8274100680 2024-09-13T18:34:40.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.407+0000 7f825bfff640 1 -- 172.21.15.38:0/3794564307 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7f827419b370 con 0x7f8274100680 2024-09-13T18:34:40.409 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:34:40.410 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:34:40.410 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:34:40.410 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:34:40.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:34:40.410 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:34:40.410 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:34:40.410 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:34:40.410 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:34:40.410 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:34:40.410 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:34:40.410 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:34:40.410 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:34:40.411 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:34:40.412 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.409+0000 7f82793a3640 1 -- 172.21.15.38:0/3794564307 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f825c06cc50 msgr2=0x7f825c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.409+0000 7f82793a3640 1 --2- 172.21.15.38:0/3794564307 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f825c06cc50 0x7f825c06f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8274196af0 tx=0x7f826800b390 comp rx=0 tx=0).stop 2024-09-13T18:34:40.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.409+0000 7f82793a3640 1 -- 172.21.15.38:0/3794564307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274100680 msgr2=0x7f82741955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.409+0000 7f82793a3640 1 --2- 172.21.15.38:0/3794564307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274100680 0x7f82741955d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8264006010 tx=0x7f82640055a0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.409+0000 7f82793a3640 1 -- 172.21.15.38:0/3794564307 shutdown_connections 2024-09-13T18:34:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.409+0000 7f82793a3640 1 --2- 172.21.15.38:0/3794564307 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f825c06cc50 0x7f825c06f110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.409+0000 7f82793a3640 1 --2- 172.21.15.38:0/3794564307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8274102fb0 0x7f8274195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.409+0000 7f82793a3640 1 --2- 172.21.15.38:0/3794564307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8274100680 0x7f82741955d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.409+0000 7f82793a3640 1 -- 172.21.15.38:0/3794564307 >> 172.21.15.38:0/3794564307 conn(0x7f82740fa280 msgr2=0x7f82740fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.409+0000 7f82793a3640 1 -- 172.21.15.38:0/3794564307 shutdown_connections 2024-09-13T18:34:40.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.409+0000 7f82793a3640 1 -- 172.21.15.38:0/3794564307 wait complete. 2024-09-13T18:34:40.498 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.494+0000 7f7247af3640 1 -- 172.21.15.38:0/2306814553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72400fed60 msgr2=0x7f72400ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.494+0000 7f7247af3640 1 --2- 172.21.15.38:0/2306814553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72400fed60 0x7f72400ff1c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7230009880 tx=0x7f723002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.494+0000 7f7247af3640 1 -- 172.21.15.38:0/2306814553 shutdown_connections 2024-09-13T18:34:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.494+0000 7f7247af3640 1 --2- 172.21.15.38:0/2306814553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72400fed60 0x7f72400ff1c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.494+0000 7f7247af3640 1 --2- 172.21.15.38:0/2306814553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72400fe420 0x7f72400fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.494+0000 7f7247af3640 1 -- 172.21.15.38:0/2306814553 >> 172.21.15.38:0/2306814553 conn(0x7f72400fa250 msgr2=0x7f72400fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.495+0000 7f7247af3640 1 -- 172.21.15.38:0/2306814553 shutdown_connections 2024-09-13T18:34:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.495+0000 7f7247af3640 1 -- 172.21.15.38:0/2306814553 wait complete. 2024-09-13T18:34:40.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.495+0000 7f7247af3640 1 Processor -- start 2024-09-13T18:34:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.495+0000 7f7247af3640 1 -- start start 2024-09-13T18:34:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.495+0000 7f7247af3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72400fe420 0x7f7240197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.495+0000 7f7247af3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72400fed60 0x7f7240197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.495+0000 7f7247af3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7240198220 con 0x7f72400fed60 2024-09-13T18:34:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.495+0000 7f7247af3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7240198390 con 0x7f72400fe420 2024-09-13T18:34:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f724508e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72400fed60 0x7f7240197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f724508e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72400fed60 0x7f7240197c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55904/0 (socket says 172.21.15.38:55904) 2024-09-13T18:34:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f724508e640 1 -- 172.21.15.38:0/2115877080 learned_addr learned my addr 172.21.15.38:0/2115877080 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f724588f640 1 --2- 172.21.15.38:0/2115877080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72400fe420 0x7f7240197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f724508e640 1 -- 172.21.15.38:0/2115877080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72400fe420 msgr2=0x7f7240197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f724508e640 1 --2- 172.21.15.38:0/2115877080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72400fe420 0x7f7240197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.501 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f724508e640 1 -- 172.21.15.38:0/2115877080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230009560 con 0x7f72400fed60 2024-09-13T18:34:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f724508e640 1 --2- 172.21.15.38:0/2115877080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72400fed60 0x7f7240197c50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7230006010 tx=0x7f7230005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f7236ffd640 1 -- 172.21.15.38:0/2115877080 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7230004b20 con 0x7f72400fed60 2024-09-13T18:34:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f7247af3640 1 -- 172.21.15.38:0/2115877080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724019cdd0 con 0x7f72400fed60 2024-09-13T18:34:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f7236ffd640 1 -- 172.21.15.38:0/2115877080 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7230004c80 con 0x7f72400fed60 2024-09-13T18:34:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f7236ffd640 1 -- 172.21.15.38:0/2115877080 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72300319f0 con 0x7f72400fed60 2024-09-13T18:34:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.496+0000 7f7247af3640 1 -- 172.21.15.38:0/2115877080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724019d340 con 0x7f72400fed60 2024-09-13T18:34:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.497+0000 7f7247af3640 1 -- 172.21.15.38:0/2115877080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f724010a850 con 0x7f72400fed60 2024-09-13T18:34:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.498+0000 7f7236ffd640 1 -- 172.21.15.38:0/2115877080 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7230003d00 con 0x7f72400fed60 2024-09-13T18:34:40.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.498+0000 7f7236ffd640 1 --2- 172.21.15.38:0/2115877080 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f722c06cc50 0x7f722c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.499+0000 7f7236ffd640 1 -- 172.21.15.38:0/2115877080 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f72300ad880 con 0x7f72400fed60 2024-09-13T18:34:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.499+0000 7f724588f640 1 --2- 172.21.15.38:0/2115877080 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f722c06cc50 0x7f722c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.499+0000 7f724588f640 1 --2- 172.21.15.38:0/2115877080 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f722c06cc50 0x7f722c06f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f723c005fd0 tx=0x7f723c005850 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:40.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.503+0000 7f7236ffd640 1 -- 172.21.15.38:0/2115877080 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f72300777f0 con 0x7f72400fed60 2024-09-13T18:34:40.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.691+0000 7f7247af3640 1 -- 172.21.15.38:0/2115877080 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7240108170 con 0x7f722c06cc50 2024-09-13T18:34:40.694 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:40 smithi038 ceph-mon[91522]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:40.694 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:40 smithi038 ceph-mon[91522]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:40.694 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:40 smithi038 ceph-mon[91522]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:40.694 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:40 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1763896960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:40.695 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:40 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3794564307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:34:40.695 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.692+0000 7f7236ffd640 1 -- 172.21.15.38:0/2115877080 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7240108170 con 0x7f722c06cc50 2024-09-13T18:34:40.696 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:34:40.696 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:34:40.696 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:34:40.696 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:34:40.696 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:34:40.697 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr", 2024-09-13T18:34:40.697 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-13T18:34:40.697 INFO:teuthology.orchestra.run.smithi038.stdout: "mon" 2024-09-13T18:34:40.697 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:34:40.697 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "9/23 daemons upgraded", 2024-09-13T18:34:40.697 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T18:34:40.697 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:34:40.697 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:34:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.694+0000 7f7247af3640 1 -- 172.21.15.38:0/2115877080 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f722c06cc50 msgr2=0x7f722c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.694+0000 7f7247af3640 1 --2- 172.21.15.38:0/2115877080 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f722c06cc50 0x7f722c06f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f723c005fd0 tx=0x7f723c005850 comp rx=0 tx=0).stop 2024-09-13T18:34:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.694+0000 7f7247af3640 1 -- 172.21.15.38:0/2115877080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72400fed60 msgr2=0x7f7240197c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.694+0000 7f7247af3640 1 --2- 172.21.15.38:0/2115877080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72400fed60 0x7f7240197c50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7230006010 tx=0x7f7230005610 comp rx=0 tx=0).stop 2024-09-13T18:34:40.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.694+0000 7f7247af3640 1 -- 172.21.15.38:0/2115877080 shutdown_connections 2024-09-13T18:34:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.695+0000 7f7247af3640 1 --2- 172.21.15.38:0/2115877080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f72400fed60 0x7f7240197c50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.695+0000 7f7247af3640 1 --2- 172.21.15.38:0/2115877080 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f722c06cc50 0x7f722c06f110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.695+0000 7f7247af3640 1 --2- 172.21.15.38:0/2115877080 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72400fe420 0x7f7240197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.695+0000 7f7247af3640 1 -- 172.21.15.38:0/2115877080 >> 172.21.15.38:0/2115877080 conn(0x7f72400fa250 msgr2=0x7f7240106a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.695+0000 7f7247af3640 1 -- 172.21.15.38:0/2115877080 shutdown_connections 2024-09-13T18:34:40.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.695+0000 7f7247af3640 1 -- 172.21.15.38:0/2115877080 wait complete. 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.778+0000 7f93faa57640 1 -- 172.21.15.38:0/2146085989 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f40ffb80 msgr2=0x7f93f40fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.778+0000 7f93faa57640 1 --2- 172.21.15.38:0/2146085989 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f40ffb80 0x7f93f40fff80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f93e4009880 tx=0x7f93e402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.778+0000 7f93faa57640 1 -- 172.21.15.38:0/2146085989 shutdown_connections 2024-09-13T18:34:40.781 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.778+0000 7f93faa57640 1 --2- 172.21.15.38:0/2146085989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93f4100d80 0x7f93f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.778+0000 7f93faa57640 1 --2- 172.21.15.38:0/2146085989 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f40ffb80 0x7f93f40fff80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.778+0000 7f93faa57640 1 -- 172.21.15.38:0/2146085989 >> 172.21.15.38:0/2146085989 conn(0x7f93f40fb310 msgr2=0x7f93f40fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:40.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.778+0000 7f93faa57640 1 -- 172.21.15.38:0/2146085989 shutdown_connections 2024-09-13T18:34:40.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.778+0000 7f93faa57640 1 -- 172.21.15.38:0/2146085989 wait complete. 2024-09-13T18:34:40.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.779+0000 7f93faa57640 1 Processor -- start 2024-09-13T18:34:40.782 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.779+0000 7f93faa57640 1 -- start start 2024-09-13T18:34:40.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.779+0000 7f93faa57640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f40ffb80 0x7f93f41977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.779+0000 7f93faa57640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93f4100d80 0x7f93f4197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.779+0000 7f93faa57640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f41982d0 con 0x7f93f40ffb80 2024-09-13T18:34:40.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.779+0000 7f93faa57640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f4198440 con 0x7f93f4100d80 2024-09-13T18:34:40.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.779+0000 7f93f3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f40ffb80 0x7f93f41977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.779+0000 7f93f3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f40ffb80 0x7f93f41977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55916/0 (socket says 172.21.15.38:55916) 2024-09-13T18:34:40.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.779+0000 7f93f3fff640 1 -- 172.21.15.38:0/1809280103 learned_addr learned my addr 172.21.15.38:0/1809280103 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:34:40.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.780+0000 7f93f37fe640 1 --2- 172.21.15.38:0/1809280103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93f4100d80 0x7f93f4197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.780+0000 7f93f3fff640 1 -- 172.21.15.38:0/1809280103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93f4100d80 msgr2=0x7f93f4197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:40.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.780+0000 7f93f3fff640 1 --2- 172.21.15.38:0/1809280103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93f4100d80 0x7f93f4197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:40.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.780+0000 7f93f3fff640 1 -- 172.21.15.38:0/1809280103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4009560 con 0x7f93f40ffb80 2024-09-13T18:34:40.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.780+0000 7f93f3fff640 1 --2- 172.21.15.38:0/1809280103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f40ffb80 0x7f93f41977c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f93e4005520 tx=0x7f93e4005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:40.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.780+0000 7f93f17fa640 1 -- 172.21.15.38:0/1809280103 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e4004aa0 con 0x7f93f40ffb80 2024-09-13T18:34:40.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.780+0000 7f93faa57640 1 -- 172.21.15.38:0/1809280103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f419ce30 con 0x7f93f40ffb80 2024-09-13T18:34:40.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.780+0000 7f93f17fa640 1 -- 172.21.15.38:0/1809280103 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f93e4004c00 con 0x7f93f40ffb80 2024-09-13T18:34:40.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.780+0000 7f93f17fa640 1 -- 172.21.15.38:0/1809280103 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93e4031920 con 0x7f93f40ffb80 2024-09-13T18:34:40.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.780+0000 7f93faa57640 1 -- 172.21.15.38:0/1809280103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f419d320 con 0x7f93f40ffb80 2024-09-13T18:34:40.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.781+0000 7f93faa57640 1 -- 172.21.15.38:0/1809280103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f41056c0 con 0x7f93f40ffb80 2024-09-13T18:34:40.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.782+0000 7f93f17fa640 1 -- 172.21.15.38:0/1809280103 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f93e4031bb0 con 0x7f93f40ffb80 2024-09-13T18:34:40.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.782+0000 7f93f17fa640 1 --2- 172.21.15.38:0/1809280103 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f93dc06cc50 0x7f93dc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:34:40.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.783+0000 7f93f17fa640 1 -- 172.21.15.38:0/1809280103 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f93e40ad740 con 0x7f93f40ffb80 2024-09-13T18:34:40.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.783+0000 7f93f37fe640 1 --2- 172.21.15.38:0/1809280103 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f93dc06cc50 0x7f93dc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:34:40.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.783+0000 7f93f37fe640 1 --2- 172.21.15.38:0/1809280103 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f93dc06cc50 0x7f93dc06f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f93f4198c90 tx=0x7f93e800b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:34:40.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:40.787+0000 7f93f17fa640 1 -- 172.21.15.38:0/1809280103 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f93e4077880 con 0x7f93f40ffb80 2024-09-13T18:34:41.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:40 smithi149 ceph-mon[76906]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:41.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:40 smithi149 ceph-mon[76906]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:41.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:40 smithi149 ceph-mon[76906]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:41.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:40 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1763896960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:41.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:40 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3794564307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:34:41.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.028+0000 7f93faa57640 1 -- 172.21.15.38:0/1809280103 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f93f402c480 con 0x7f93f40ffb80 2024-09-13T18:34:41.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.028+0000 7f93f17fa640 1 -- 172.21.15.38:0/1809280103 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f93e4031e60 con 0x7f93f40ffb80 2024-09-13T18:34:41.031 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:34:41.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.030+0000 7f93faa57640 1 -- 172.21.15.38:0/1809280103 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f93dc06cc50 msgr2=0x7f93dc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.030+0000 7f93faa57640 1 --2- 172.21.15.38:0/1809280103 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f93dc06cc50 0x7f93dc06f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f93f4198c90 tx=0x7f93e800b390 comp rx=0 tx=0).stop 2024-09-13T18:34:41.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.030+0000 7f93faa57640 1 -- 172.21.15.38:0/1809280103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f40ffb80 msgr2=0x7f93f41977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:34:41.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.030+0000 7f93faa57640 1 --2- 172.21.15.38:0/1809280103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f40ffb80 0x7f93f41977c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f93e4005520 tx=0x7f93e4005550 comp rx=0 tx=0).stop 2024-09-13T18:34:41.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.031+0000 7f93faa57640 1 -- 172.21.15.38:0/1809280103 shutdown_connections 2024-09-13T18:34:41.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.031+0000 7f93faa57640 1 --2- 172.21.15.38:0/1809280103 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f93dc06cc50 0x7f93dc06f110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.031+0000 7f93faa57640 1 --2- 172.21.15.38:0/1809280103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93f4100d80 0x7f93f4197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.031+0000 7f93faa57640 1 --2- 172.21.15.38:0/1809280103 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f93f40ffb80 0x7f93f41977c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:34:41.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.031+0000 7f93faa57640 1 -- 172.21.15.38:0/1809280103 >> 172.21.15.38:0/1809280103 conn(0x7f93f40fb310 msgr2=0x7f93f4072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:34:41.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.031+0000 7f93faa57640 1 -- 172.21.15.38:0/1809280103 shutdown_connections 2024-09-13T18:34:41.034 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:34:41.031+0000 7f93faa57640 1 -- 172.21.15.38:0/1809280103 wait complete. 2024-09-13T18:34:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:41 smithi149 ceph-mon[76906]: pgmap v139: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:34:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:41 smithi149 ceph-mon[76906]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T18:34:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:41 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T18:34:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:41 smithi149 ceph-mon[76906]: Upgrade: osd.3 is safe to restart 2024-09-13T18:34:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:41 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1809280103' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:34:41.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:41 smithi038 ceph-mon[91522]: pgmap v139: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:34:41.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:41 smithi038 ceph-mon[91522]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:34:41.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T18:34:41.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:41 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T18:34:41.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:41 smithi038 ceph-mon[91522]: Upgrade: osd.3 is safe to restart 2024-09-13T18:34:41.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:41 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1809280103' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:34:43.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:43 smithi038 ceph-mon[91522]: Upgrade: Updating osd.3 2024-09-13T18:34:43.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:43.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T18:34:43.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:34:43.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:43 smithi038 ceph-mon[91522]: Deploying daemon osd.3 on smithi149 2024-09-13T18:34:43.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:43 smithi038 ceph-mon[91522]: pgmap v140: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:34:43.509 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:43 smithi149 ceph-mon[76906]: Upgrade: Updating osd.3 2024-09-13T18:34:43.509 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:43.509 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T18:34:43.509 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:34:43.509 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:43 smithi149 ceph-mon[76906]: Deploying daemon osd.3 on smithi149 2024-09-13T18:34:43.510 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:43 smithi149 ceph-mon[76906]: pgmap v140: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:34:45.167 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:44 smithi149 systemd[1]: Stopping Ceph osd.3 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:34:45.466 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:45 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[41836]: 2024-09-13T18:34:45.227+0000 7f6d4abe0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:34:45.467 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:45 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[41836]: 2024-09-13T18:34:45.227+0000 7f6d4abe0640 -1 osd.3 78 *** Got signal Terminated *** 2024-09-13T18:34:45.467 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:45 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[41836]: 2024-09-13T18:34:45.227+0000 7f6d4abe0640 -1 osd.3 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:34:45.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:45 smithi149 ceph-mon[76906]: pgmap v141: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-13T18:34:45.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:45 smithi149 ceph-mon[76906]: osd.3 marked itself down and dead 2024-09-13T18:34:45.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:45 smithi038 ceph-mon[91522]: pgmap v141: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-13T18:34:45.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:45 smithi038 ceph-mon[91522]: osd.3 marked itself down and dead 2024-09-13T18:34:46.272 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:46 smithi149 podman[84750]: 2024-09-13 18:34:46.012098643 +0000 UTC m=+0.915285739 container died 33a68d3f4510da754ad4605d27d34c25eeccc9184062a491171dbb3b3711f9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=reef-e4e227b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T18:34:46.672 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:46 smithi149 ceph-mon[76906]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T18:34:46.672 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:46 smithi149 ceph-mon[76906]: osdmap e79: 6 total, 5 up, 6 in 2024-09-13T18:34:46.673 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:46 smithi149 podman[84750]: 2024-09-13 18:34:46.360493315 +0000 UTC m=+1.263680408 container cleanup 33a68d3f4510da754ad4605d27d34c25eeccc9184062a491171dbb3b3711f9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=reef-e4e227b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T18:34:46.673 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:46 smithi149 bash[84750]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3 2024-09-13T18:34:46.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:46 smithi038 ceph-mon[91522]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T18:34:46.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:46 smithi038 ceph-mon[91522]: osdmap e79: 6 total, 5 up, 6 in 2024-09-13T18:34:47.019 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:46 smithi149 podman[84775]: 2024-09-13 18:34:46.670600623 +0000 UTC m=+0.653969339 container remove 33a68d3f4510da754ad4605d27d34c25eeccc9184062a491171dbb3b3711f9e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=reef-e4e227b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-13T18:34:47.325 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:47 smithi149 podman[84867]: 2024-09-13 18:34:46.922512457 +0000 UTC m=+0.016046996 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:34:47.325 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:47 smithi149 podman[84867]: 2024-09-13 18:34:47.029715405 +0000 UTC m=+0.123249936 container create be9581233bd5965830896f8aa341210391c0bcac6ab012983dd7b699f97dd910 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-13T18:34:47.325 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:47 smithi149 podman[84867]: 2024-09-13 18:34:47.248872004 +0000 UTC m=+0.342406530 container init be9581233bd5965830896f8aa341210391c0bcac6ab012983dd7b699f97dd910 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:34:47.326 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:47 smithi149 podman[84867]: 2024-09-13 18:34:47.252154602 +0000 UTC m=+0.345689128 container start be9581233bd5965830896f8aa341210391c0bcac6ab012983dd7b699f97dd910 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T18:34:47.326 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:47 smithi149 podman[84867]: 2024-09-13 18:34:47.32360737 +0000 UTC m=+0.417141904 container attach be9581233bd5965830896f8aa341210391c0bcac6ab012983dd7b699f97dd910 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T18:34:47.728 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:47 smithi149 ceph-mon[76906]: pgmap v143: 65 pgs: 14 stale+active+clean, 51 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T18:34:47.728 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:47 smithi149 ceph-mon[76906]: osdmap e80: 6 total, 5 up, 6 in 2024-09-13T18:34:47.729 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:47 smithi149 podman[84867]: 2024-09-13 18:34:47.437337244 +0000 UTC m=+0.530871785 container died be9581233bd5965830896f8aa341210391c0bcac6ab012983dd7b699f97dd910 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T18:34:47.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:47 smithi038 ceph-mon[91522]: pgmap v143: 65 pgs: 14 stale+active+clean, 51 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T18:34:47.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:47 smithi038 ceph-mon[91522]: osdmap e80: 6 total, 5 up, 6 in 2024-09-13T18:34:48.270 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 podman[84890]: 2024-09-13 18:34:48.002418239 +0000 UTC m=+0.555730738 container remove be9581233bd5965830896f8aa341210391c0bcac6ab012983dd7b699f97dd910 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:34:48.270 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-13T18:34:48.270 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 systemd[1]: Stopped Ceph osd.3 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:34:48.270 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 19.222s CPU time. 2024-09-13T18:34:48.270 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 systemd[1]: Starting Ceph osd.3 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:34:48.732 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:48 smithi149 ceph-mon[76906]: Health check failed: Degraded data redundancy: 33/282 objects degraded (11.702%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T18:34:48.733 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 podman[84991]: 2024-09-13 18:34:48.332766811 +0000 UTC m=+0.016001995 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:34:48.733 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 podman[84991]: 2024-09-13 18:34:48.436970705 +0000 UTC m=+0.120205882 container create 42ea0680107fa9d263b4b7af66c3f47373cd961956fc0c9bed8d96c273f15f5f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T18:34:48.733 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 podman[84991]: 2024-09-13 18:34:48.672721462 +0000 UTC m=+0.355956633 container init 42ea0680107fa9d263b4b7af66c3f47373cd961956fc0c9bed8d96c273f15f5f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:34:48.733 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 podman[84991]: 2024-09-13 18:34:48.67630131 +0000 UTC m=+0.359536485 container start 42ea0680107fa9d263b4b7af66c3f47373cd961956fc0c9bed8d96c273f15f5f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T18:34:48.733 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 podman[84991]: 2024-09-13 18:34:48.730979678 +0000 UTC m=+0.414214856 container attach 42ea0680107fa9d263b4b7af66c3f47373cd961956fc0c9bed8d96c273f15f5f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0) 2024-09-13T18:34:48.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:48 smithi038 ceph-mon[91522]: Health check failed: Degraded data redundancy: 33/282 objects degraded (11.702%), 10 pgs degraded (PG_DEGRADED) 2024-09-13T18:34:48.998 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate[85006]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:34:48.999 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 bash[84991]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:34:48.999 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate[85006]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T18:34:48.999 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 bash[84991]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T18:34:48.999 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate[85006]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T18:34:48.999 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 bash[84991]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T18:34:49.269 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate[85006]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T18:34:49.269 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:48 smithi149 bash[84991]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T18:34:49.270 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:49 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate[85006]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T18:34:49.270 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:49 smithi149 bash[84991]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T18:34:49.270 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:49 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate[85006]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:34:49.270 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:49 smithi149 bash[84991]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:34:49.270 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:49 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate[85006]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T18:34:49.270 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:49 smithi149 bash[84991]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T18:34:49.270 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:49 smithi149 podman[84991]: 2024-09-13 18:34:49.023942407 +0000 UTC m=+0.707177589 container died 42ea0680107fa9d263b4b7af66c3f47373cd961956fc0c9bed8d96c273f15f5f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T18:34:49.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:49 smithi149 ceph-mon[76906]: pgmap v145: 65 pgs: 10 active+undersized, 5 stale+active+clean, 10 active+undersized+degraded, 40 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 33/282 objects degraded (11.702%) 2024-09-13T18:34:49.770 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:49 smithi149 podman[85122]: 2024-09-13 18:34:49.563370275 +0000 UTC m=+0.533709443 container remove 42ea0680107fa9d263b4b7af66c3f47373cd961956fc0c9bed8d96c273f15f5f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T18:34:49.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:49 smithi038 ceph-mon[91522]: pgmap v145: 65 pgs: 10 active+undersized, 5 stale+active+clean, 10 active+undersized+degraded, 40 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 33/282 objects degraded (11.702%) 2024-09-13T18:34:50.029 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:49 smithi149 podman[85182]: 2024-09-13 18:34:49.671356183 +0000 UTC m=+0.015910215 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:34:50.029 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:49 smithi149 podman[85182]: 2024-09-13 18:34:49.772546619 +0000 UTC m=+0.117100648 container create e4321b085347c98d8a2b8b42dcf0b1637af4ee932684b712bd3141db0003fdd2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:34:50.029 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:50 smithi149 podman[85182]: 2024-09-13 18:34:50.027641334 +0000 UTC m=+0.372195361 container init e4321b085347c98d8a2b8b42dcf0b1637af4ee932684b712bd3141db0003fdd2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T18:34:50.520 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:50 smithi149 podman[85182]: 2024-09-13 18:34:50.03099467 +0000 UTC m=+0.375548700 container start e4321b085347c98d8a2b8b42dcf0b1637af4ee932684b712bd3141db0003fdd2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:34:50.520 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:50 smithi149 ceph-osd[85201]: -- 172.21.15.149:0/3192496505 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f685e0d1e0 con 0x55f686b8c000 2024-09-13T18:34:50.520 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:50 smithi149 bash[85182]: e4321b085347c98d8a2b8b42dcf0b1637af4ee932684b712bd3141db0003fdd2 2024-09-13T18:34:50.520 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:50 smithi149 systemd[1]: Started Ceph osd.3 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:34:50.934 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:50 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[85197]: 2024-09-13T18:34:50.574+0000 7f8e31f22640 -1 Falling back to public interface 2024-09-13T18:34:51.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:51.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:51.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:34:51.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:51 smithi149 ceph-mon[76906]: pgmap v146: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 50/282 objects degraded (17.730%) 2024-09-13T18:34:51.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:51.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:51.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:34:51.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:51 smithi038 ceph-mon[91522]: pgmap v146: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 50/282 objects degraded (17.730%) 2024-09-13T18:34:52.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:52 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:52.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:52 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:34:53.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:52 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:53.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:52 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:34:53.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:53 smithi149 ceph-mon[76906]: pgmap v147: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 50/282 objects degraded (17.730%) 2024-09-13T18:34:53.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:53 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:53.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:53 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:53.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:53 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:53.954 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:53 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:54.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:53 smithi038 ceph-mon[91522]: pgmap v147: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 50/282 objects degraded (17.730%) 2024-09-13T18:34:54.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:53 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:54.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:53 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:54.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:53 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:54.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:53 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:56.020 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:55 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[85197]: 2024-09-13T18:34:55.688+0000 7f8e31f22640 -1 osd.3 78 log_to_monitors true 2024-09-13T18:34:56.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:55 smithi149 ceph-mon[76906]: pgmap v148: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 50/282 objects degraded (17.730%) 2024-09-13T18:34:56.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:55 smithi149 ceph-mon[76906]: Health check update: Degraded data redundancy: 50/282 objects degraded (17.730%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T18:34:56.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:55 smithi149 ceph-mon[76906]: from='osd.3 [v2:172.21.15.149:6800/3674321522,v1:172.21.15.149:6801/3674321522]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T18:34:56.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:55 smithi149 ceph-mon[76906]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T18:34:56.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:55 smithi038 ceph-mon[91522]: pgmap v148: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 50/282 objects degraded (17.730%) 2024-09-13T18:34:56.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:55 smithi038 ceph-mon[91522]: Health check update: Degraded data redundancy: 50/282 objects degraded (17.730%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T18:34:56.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:55 smithi038 ceph-mon[91522]: from='osd.3 [v2:172.21.15.149:6800/3674321522,v1:172.21.15.149:6801/3674321522]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T18:34:56.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:55 smithi038 ceph-mon[91522]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T18:34:56.769 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[85197]: 2024-09-13T18:34:56.673+0000 7f8e25cb3640 -1 osd.3 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:34:57.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T18:34:57.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: osdmap e81: 6 total, 5 up, 6 in 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='osd.3 [v2:172.21.15.149:6800/3674321522,v1:172.21.15.149:6801/3674321522]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T18:34:57.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:56 smithi038 ceph-mon[91522]: from='osd.3 ' entity='osd.3' 2024-09-13T18:34:57.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T18:34:57.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: osdmap e81: 6 total, 5 up, 6 in 2024-09-13T18:34:57.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='osd.3 [v2:172.21.15.149:6800/3674321522,v1:172.21.15.149:6801/3674321522]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:34:57.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:34:57.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:57.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:57.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:34:57.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:34:57.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:34:57.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:34:57.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:57.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:57.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:34:57.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T18:34:57.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:56 smithi149 ceph-mon[76906]: from='osd.3 ' entity='osd.3' 2024-09-13T18:34:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:57 smithi038 ceph-mon[91522]: pgmap v150: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 206 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 50/282 objects degraded (17.730%) 2024-09-13T18:34:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:57 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T18:34:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:57 smithi038 ceph-mon[91522]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-13T18:34:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:57 smithi038 ceph-mon[91522]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T18:34:58.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:57 smithi038 ceph-mon[91522]: osd.3 [v2:172.21.15.149:6800/3674321522,v1:172.21.15.149:6801/3674321522] boot 2024-09-13T18:34:58.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:57 smithi038 ceph-mon[91522]: osdmap e82: 6 total, 6 up, 6 in 2024-09-13T18:34:58.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:57 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:34:58.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:57 smithi149 ceph-mon[76906]: pgmap v150: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 206 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 50/282 objects degraded (17.730%) 2024-09-13T18:34:58.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:57 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T18:34:58.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:57 smithi149 ceph-mon[76906]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-13T18:34:58.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:57 smithi149 ceph-mon[76906]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T18:34:58.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:57 smithi149 ceph-mon[76906]: osd.3 [v2:172.21.15.149:6800/3674321522,v1:172.21.15.149:6801/3674321522] boot 2024-09-13T18:34:58.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:57 smithi149 ceph-mon[76906]: osdmap e82: 6 total, 6 up, 6 in 2024-09-13T18:34:58.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:57 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T18:34:59.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:59 smithi038 ceph-mon[91522]: pgmap v152: 65 pgs: 3 peering, 16 active+undersized, 14 active+undersized+degraded, 32 active+clean; 206 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 46/282 objects degraded (16.312%) 2024-09-13T18:34:59.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:34:59 smithi038 ceph-mon[91522]: osdmap e83: 6 total, 6 up, 6 in 2024-09-13T18:35:00.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:59 smithi149 ceph-mon[76906]: pgmap v152: 65 pgs: 3 peering, 16 active+undersized, 14 active+undersized+degraded, 32 active+clean; 206 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 46/282 objects degraded (16.312%) 2024-09-13T18:35:00.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:34:59 smithi149 ceph-mon[76906]: osdmap e83: 6 total, 6 up, 6 in 2024-09-13T18:35:01.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:00 smithi149 ceph-mon[76906]: Health check update: Degraded data redundancy: 46/282 objects degraded (16.312%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T18:35:01.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:00 smithi038 ceph-mon[91522]: Health check update: Degraded data redundancy: 46/282 objects degraded (16.312%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T18:35:02.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:01 smithi149 ceph-mon[76906]: pgmap v154: 65 pgs: 3 peering, 11 active+undersized, 11 active+undersized+degraded, 40 active+clean; 206 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 37/282 objects degraded (13.121%) 2024-09-13T18:35:02.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:01 smithi038 ceph-mon[91522]: pgmap v154: 65 pgs: 3 peering, 11 active+undersized, 11 active+undersized+degraded, 40 active+clean; 206 MiB data, 986 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 37/282 objects degraded (13.121%) 2024-09-13T18:35:03.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:02 smithi149 ceph-mon[76906]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/282 objects degraded (13.121%), 11 pgs degraded) 2024-09-13T18:35:03.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:02 smithi149 ceph-mon[76906]: Cluster is now healthy 2024-09-13T18:35:03.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:02 smithi038 ceph-mon[91522]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/282 objects degraded (13.121%), 11 pgs degraded) 2024-09-13T18:35:03.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:02 smithi038 ceph-mon[91522]: Cluster is now healthy 2024-09-13T18:35:04.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:03 smithi149 ceph-mon[76906]: pgmap v155: 65 pgs: 3 peering, 62 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 3 op/s 2024-09-13T18:35:04.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:03 smithi038 ceph-mon[91522]: pgmap v155: 65 pgs: 3 peering, 62 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 3 op/s 2024-09-13T18:35:06.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:05 smithi149 ceph-mon[76906]: pgmap v156: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:35:06.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:05 smithi038 ceph-mon[91522]: pgmap v156: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:35:07.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:07 smithi038 ceph-mon[91522]: pgmap v157: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-09-13T18:35:07.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:07.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:35:08.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:07 smithi149 ceph-mon[76906]: pgmap v157: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-09-13T18:35:08.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:08.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:35:09.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:09 smithi038 ceph-mon[91522]: pgmap v158: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:35:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:09 smithi149 ceph-mon[76906]: pgmap v158: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:35:11.130 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.127+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/1914504143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6f0102f60 msgr2=0x7fe6f0105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.127+0000 7fe6f6f7a640 1 --2- 172.21.15.38:0/1914504143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6f0102f60 0x7fe6f0105350 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0098b0 tx=0x7fe6dc02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.127+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/1914504143 shutdown_connections 2024-09-13T18:35:11.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.128+0000 7fe6f6f7a640 1 --2- 172.21.15.38:0/1914504143 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6f0102f60 0x7fe6f0105350 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.128+0000 7fe6f6f7a640 1 --2- 172.21.15.38:0/1914504143 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f0100630 0x7fe6f0102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.128+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/1914504143 >> 172.21.15.38:0/1914504143 conn(0x7fe6f00fa250 msgr2=0x7fe6f00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.128+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/1914504143 shutdown_connections 2024-09-13T18:35:11.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.128+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/1914504143 wait complete. 2024-09-13T18:35:11.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.128+0000 7fe6f6f7a640 1 Processor -- start 2024-09-13T18:35:11.131 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.128+0000 7fe6f6f7a640 1 -- start start 2024-09-13T18:35:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.128+0000 7fe6f6f7a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f0100630 0x7fe6f01956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.128+0000 7fe6f6f7a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6f0102f60 0x7fe6f0195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.129+0000 7fe6f6f7a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f01961b0 con 0x7fe6f0102f60 2024-09-13T18:35:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.129+0000 7fe6f6f7a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0196320 con 0x7fe6f0100630 2024-09-13T18:35:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.129+0000 7fe6effff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6f0102f60 0x7fe6f0195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.133 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.129+0000 7fe6effff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6f0102f60 0x7fe6f0195be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38688/0 (socket says 172.21.15.38:38688) 2024-09-13T18:35:11.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.129+0000 7fe6effff640 1 -- 172.21.15.38:0/2704085094 learned_addr learned my addr 172.21.15.38:0/2704085094 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:11.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.129+0000 7fe6f4d16640 1 --2- 172.21.15.38:0/2704085094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f0100630 0x7fe6f01956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.129+0000 7fe6effff640 1 -- 172.21.15.38:0/2704085094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f0100630 msgr2=0x7fe6f01956a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.129+0000 7fe6effff640 1 --2- 172.21.15.38:0/2704085094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f0100630 0x7fe6f01956a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.129+0000 7fe6effff640 1 -- 172.21.15.38:0/2704085094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc009560 con 0x7fe6f0102f60 2024-09-13T18:35:11.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.129+0000 7fe6effff640 1 --2- 172.21.15.38:0/2704085094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6f0102f60 0x7fe6f0195be0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc005610 tx=0x7fe6dc005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.129+0000 7fe6edffb640 1 -- 172.21.15.38:0/2704085094 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6dc004b20 con 0x7fe6f0102f60 2024-09-13T18:35:11.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.130+0000 7fe6edffb640 1 -- 172.21.15.38:0/2704085094 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe6dc004c80 con 0x7fe6f0102f60 2024-09-13T18:35:11.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.130+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/2704085094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f019ad60 con 0x7fe6f0102f60 2024-09-13T18:35:11.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.130+0000 7fe6edffb640 1 -- 172.21.15.38:0/2704085094 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6dc031a50 con 0x7fe6f0102f60 2024-09-13T18:35:11.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.130+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/2704085094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f019b2d0 con 0x7fe6f0102f60 2024-09-13T18:35:11.134 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.131+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/2704085094 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f01086d0 con 0x7fe6f0102f60 2024-09-13T18:35:11.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.131+0000 7fe6edffb640 1 -- 172.21.15.38:0/2704085094 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe6dc031cc0 con 0x7fe6f0102f60 2024-09-13T18:35:11.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.132+0000 7fe6edffb640 1 --2- 172.21.15.38:0/2704085094 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe6e006cc50 0x7fe6e006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.135 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.132+0000 7fe6edffb640 1 -- 172.21.15.38:0/2704085094 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fe6dc0ad7c0 con 0x7fe6f0102f60 2024-09-13T18:35:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.132+0000 7fe6f4d16640 1 --2- 172.21.15.38:0/2704085094 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe6e006cc50 0x7fe6e006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.136 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.133+0000 7fe6f4d16640 1 --2- 172.21.15.38:0/2704085094 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe6e006cc50 0x7fe6e006f110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009990 tx=0x7fe6e4009110 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.139 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.136+0000 7fe6edffb640 1 -- 172.21.15.38:0/2704085094 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe6dc0777d0 con 0x7fe6f0102f60 2024-09-13T18:35:11.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.324+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/2704085094 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6f0103a20 con 0x7fe6e006cc50 2024-09-13T18:35:11.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.325+0000 7fe6edffb640 1 -- 172.21.15.38:0/2704085094 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe6f0103a20 con 0x7fe6e006cc50 2024-09-13T18:35:11.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.327+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/2704085094 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe6e006cc50 msgr2=0x7fe6e006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.327+0000 7fe6f6f7a640 1 --2- 172.21.15.38:0/2704085094 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe6e006cc50 0x7fe6e006f110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009990 tx=0x7fe6e4009110 comp rx=0 tx=0).stop 2024-09-13T18:35:11.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.327+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/2704085094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6f0102f60 msgr2=0x7fe6f0195be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.327+0000 7fe6f6f7a640 1 --2- 172.21.15.38:0/2704085094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6f0102f60 0x7fe6f0195be0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc005610 tx=0x7fe6dc005640 comp rx=0 tx=0).stop 2024-09-13T18:35:11.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.327+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/2704085094 shutdown_connections 2024-09-13T18:35:11.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.327+0000 7fe6f6f7a640 1 --2- 172.21.15.38:0/2704085094 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe6f0102f60 0x7fe6f0195be0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.327+0000 7fe6f6f7a640 1 --2- 172.21.15.38:0/2704085094 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe6e006cc50 0x7fe6e006f110 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.330 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.327+0000 7fe6f6f7a640 1 --2- 172.21.15.38:0/2704085094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6f0100630 0x7fe6f01956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.327+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/2704085094 >> 172.21.15.38:0/2704085094 conn(0x7fe6f00fa250 msgr2=0x7fe6f00fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.327+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/2704085094 shutdown_connections 2024-09-13T18:35:11.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.328+0000 7fe6f6f7a640 1 -- 172.21.15.38:0/2704085094 wait complete. 2024-09-13T18:35:11.339 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:35:11.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.412+0000 7f41127c3640 1 -- 172.21.15.38:0/3443565265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f410c100630 msgr2=0x7f410c102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.412+0000 7f41127c3640 1 --2- 172.21.15.38:0/3443565265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f410c100630 0x7f410c102a20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0098b0 tx=0x7f40fc02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.412+0000 7f41127c3640 1 -- 172.21.15.38:0/3443565265 shutdown_connections 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.412+0000 7f41127c3640 1 --2- 172.21.15.38:0/3443565265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f410c102f60 0x7f410c105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.412+0000 7f41127c3640 1 --2- 172.21.15.38:0/3443565265 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f410c100630 0x7f410c102a20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.412+0000 7f41127c3640 1 -- 172.21.15.38:0/3443565265 >> 172.21.15.38:0/3443565265 conn(0x7f410c0fa250 msgr2=0x7f410c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.412+0000 7f41127c3640 1 -- 172.21.15.38:0/3443565265 shutdown_connections 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.413+0000 7f41127c3640 1 -- 172.21.15.38:0/3443565265 wait complete. 2024-09-13T18:35:11.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.413+0000 7f41127c3640 1 Processor -- start 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.413+0000 7f41127c3640 1 -- start start 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.413+0000 7f41127c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f410c100630 0x7f410c195560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f41127c3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f410c102f60 0x7f410c195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f41127c3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c196070 con 0x7f410c100630 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f41127c3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c1961e0 con 0x7f410c102f60 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f410bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f410c100630 0x7f410c195560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.419 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f410bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f410c100630 0x7f410c195560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38716/0 (socket says 172.21.15.38:38716) 2024-09-13T18:35:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f410bfff640 1 -- 172.21.15.38:0/344298256 learned_addr learned my addr 172.21.15.38:0/344298256 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f410b7fe640 1 --2- 172.21.15.38:0/344298256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f410c102f60 0x7f410c195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f410bfff640 1 -- 172.21.15.38:0/344298256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f410c102f60 msgr2=0x7f410c195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f410bfff640 1 --2- 172.21.15.38:0/344298256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f410c102f60 0x7f410c195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f410bfff640 1 -- 172.21.15.38:0/344298256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc009560 con 0x7f410c100630 2024-09-13T18:35:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f410bfff640 1 --2- 172.21.15.38:0/344298256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f410c100630 0x7f410c195560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f40fc006010 tx=0x7f40fc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f41097fa640 1 -- 172.21.15.38:0/344298256 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40fc004b60 con 0x7f410c100630 2024-09-13T18:35:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.414+0000 7f41097fa640 1 -- 172.21.15.38:0/344298256 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f40fc004cc0 con 0x7f410c100630 2024-09-13T18:35:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.415+0000 7f41127c3640 1 -- 172.21.15.38:0/344298256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410c19ac20 con 0x7f410c100630 2024-09-13T18:35:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.415+0000 7f41127c3640 1 -- 172.21.15.38:0/344298256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c19b110 con 0x7f410c100630 2024-09-13T18:35:11.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.415+0000 7f41097fa640 1 -- 172.21.15.38:0/344298256 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40fc0319d0 con 0x7f410c100630 2024-09-13T18:35:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.416+0000 7f41127c3640 1 -- 172.21.15.38:0/344298256 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410c108680 con 0x7f410c100630 2024-09-13T18:35:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.416+0000 7f41097fa640 1 -- 172.21.15.38:0/344298256 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f40fc003ce0 con 0x7f410c100630 2024-09-13T18:35:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.417+0000 7f41097fa640 1 --2- 172.21.15.38:0/344298256 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f40f406cc50 0x7f40f406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.417+0000 7f41097fa640 1 -- 172.21.15.38:0/344298256 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f40fc0ad700 con 0x7f410c100630 2024-09-13T18:35:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.417+0000 7f410b7fe640 1 --2- 172.21.15.38:0/344298256 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f40f406cc50 0x7f40f406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.417+0000 7f410b7fe640 1 --2- 172.21.15.38:0/344298256 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f40f406cc50 0x7f40f406f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f410c196a80 tx=0x7f410000b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.421+0000 7f41097fa640 1 -- 172.21.15.38:0/344298256 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f40fc077840 con 0x7f410c100630 2024-09-13T18:35:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.612+0000 7f41127c3640 1 -- 172.21.15.38:0/344298256 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f410c19b380 con 0x7f40f406cc50 2024-09-13T18:35:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.613+0000 7f41097fa640 1 -- 172.21.15.38:0/344298256 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f410c19b380 con 0x7f40f406cc50 2024-09-13T18:35:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.615+0000 7f41127c3640 1 -- 172.21.15.38:0/344298256 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f40f406cc50 msgr2=0x7f40f406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.615+0000 7f41127c3640 1 --2- 172.21.15.38:0/344298256 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f40f406cc50 0x7f40f406f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f410c196a80 tx=0x7f410000b390 comp rx=0 tx=0).stop 2024-09-13T18:35:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.615+0000 7f41127c3640 1 -- 172.21.15.38:0/344298256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f410c100630 msgr2=0x7f410c195560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.615+0000 7f41127c3640 1 --2- 172.21.15.38:0/344298256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f410c100630 0x7f410c195560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f40fc006010 tx=0x7f40fc0055a0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.615+0000 7f41127c3640 1 -- 172.21.15.38:0/344298256 shutdown_connections 2024-09-13T18:35:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.615+0000 7f41127c3640 1 --2- 172.21.15.38:0/344298256 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f40f406cc50 0x7f40f406f110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.615+0000 7f41127c3640 1 --2- 172.21.15.38:0/344298256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f410c102f60 0x7f410c195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.615+0000 7f41127c3640 1 --2- 172.21.15.38:0/344298256 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f410c100630 0x7f410c195560 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.615+0000 7f41127c3640 1 -- 172.21.15.38:0/344298256 >> 172.21.15.38:0/344298256 conn(0x7f410c0fa250 msgr2=0x7f410c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.615+0000 7f41127c3640 1 -- 172.21.15.38:0/344298256 shutdown_connections 2024-09-13T18:35:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.615+0000 7f41127c3640 1 -- 172.21.15.38:0/344298256 wait complete. 2024-09-13T18:35:11.713 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.709+0000 7fd303213640 1 -- 172.21.15.38:0/336356768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2fc0ffca0 msgr2=0x7fd2fc100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.709+0000 7fd303213640 1 --2- 172.21.15.38:0/336356768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2fc0ffca0 0x7fd2fc100120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009880 tx=0x7fd2ec02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.709+0000 7fd303213640 1 -- 172.21.15.38:0/336356768 shutdown_connections 2024-09-13T18:35:11.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.709+0000 7fd303213640 1 --2- 172.21.15.38:0/336356768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2fc0ffca0 0x7fd2fc100120 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.709+0000 7fd303213640 1 --2- 172.21.15.38:0/336356768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0feaa0 0x7fd2fc0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.709+0000 7fd303213640 1 -- 172.21.15.38:0/336356768 >> 172.21.15.38:0/336356768 conn(0x7fd2fc0fa250 msgr2=0x7fd2fc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.709+0000 7fd303213640 1 -- 172.21.15.38:0/336356768 shutdown_connections 2024-09-13T18:35:11.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.709+0000 7fd303213640 1 -- 172.21.15.38:0/336356768 wait complete. 2024-09-13T18:35:11.715 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:11 smithi038 ceph-mon[91522]: pgmap v159: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-09-13T18:35:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.710+0000 7fd303213640 1 Processor -- start 2024-09-13T18:35:11.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.710+0000 7fd303213640 1 -- start start 2024-09-13T18:35:11.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.710+0000 7fd303213640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2fc0feaa0 0x7fd2fc195580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.710+0000 7fd303213640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0ffca0 0x7fd2fc195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.710+0000 7fd303213640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc196090 con 0x7fd2fc0feaa0 2024-09-13T18:35:11.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.710+0000 7fd303213640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc196200 con 0x7fd2fc0ffca0 2024-09-13T18:35:11.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.710+0000 7fd300faf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2fc0feaa0 0x7fd2fc195580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.710+0000 7fd300faf640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2fc0feaa0 0x7fd2fc195580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38732/0 (socket says 172.21.15.38:38732) 2024-09-13T18:35:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.710+0000 7fd300faf640 1 -- 172.21.15.38:0/1158521661 learned_addr learned my addr 172.21.15.38:0/1158521661 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.710+0000 7fd2fbfff640 1 --2- 172.21.15.38:0/1158521661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0ffca0 0x7fd2fc195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.711+0000 7fd300faf640 1 -- 172.21.15.38:0/1158521661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0ffca0 msgr2=0x7fd2fc195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.711+0000 7fd300faf640 1 --2- 172.21.15.38:0/1158521661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0ffca0 0x7fd2fc195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.711+0000 7fd300faf640 1 -- 172.21.15.38:0/1158521661 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec009560 con 0x7fd2fc0feaa0 2024-09-13T18:35:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.711+0000 7fd300faf640 1 --2- 172.21.15.38:0/1158521661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2fc0feaa0 0x7fd2fc195580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400e970 tx=0x7fd2e400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.711+0000 7fd2f9ffb640 1 -- 172.21.15.38:0/1158521661 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2e40096e0 con 0x7fd2fc0feaa0 2024-09-13T18:35:11.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.711+0000 7fd303213640 1 -- 172.21.15.38:0/1158521661 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc19aca0 con 0x7fd2fc0feaa0 2024-09-13T18:35:11.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.711+0000 7fd2f9ffb640 1 -- 172.21.15.38:0/1158521661 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd2e40044d0 con 0x7fd2fc0feaa0 2024-09-13T18:35:11.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.711+0000 7fd2f9ffb640 1 -- 172.21.15.38:0/1158521661 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2e4003e70 con 0x7fd2fc0feaa0 2024-09-13T18:35:11.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.711+0000 7fd303213640 1 -- 172.21.15.38:0/1158521661 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc19b220 con 0x7fd2fc0feaa0 2024-09-13T18:35:11.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.712+0000 7fd303213640 1 -- 172.21.15.38:0/1158521661 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc107570 con 0x7fd2fc0feaa0 2024-09-13T18:35:11.722 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.713+0000 7fd2f9ffb640 1 -- 172.21.15.38:0/1158521661 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd2e400cc90 con 0x7fd2fc0feaa0 2024-09-13T18:35:11.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.713+0000 7fd2f9ffb640 1 --2- 172.21.15.38:0/1158521661 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2e806cc50 0x7fd2e806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.713+0000 7fd2f9ffb640 1 -- 172.21.15.38:0/1158521661 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fd2e4014070 con 0x7fd2fc0feaa0 2024-09-13T18:35:11.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.713+0000 7fd2fbfff640 1 --2- 172.21.15.38:0/1158521661 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2e806cc50 0x7fd2e806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.723 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.714+0000 7fd2fbfff640 1 --2- 172.21.15.38:0/1158521661 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2e806cc50 0x7fd2e806f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc196aa0 tx=0x7fd2ec031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.718+0000 7fd2f9ffb640 1 -- 172.21.15.38:0/1158521661 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd2e4056b20 con 0x7fd2fc0feaa0 2024-09-13T18:35:11.901 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.898+0000 7fd303213640 1 -- 172.21.15.38:0/1158521661 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2fc19b4d0 con 0x7fd2e806cc50 2024-09-13T18:35:11.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.908+0000 7fd2f9ffb640 1 -- 172.21.15.38:0/1158521661 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fd2fc19b4d0 con 0x7fd2e806cc50 2024-09-13T18:35:11.911 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:35:11.911 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (11m) 50s ago 12m 24.1M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:35:11.911 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (13m) 50s ago 13m 8350k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:35:11.911 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (12m) 19s ago 12m 8132k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:35:11.911 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (2m) 50s ago 13m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:35:11.911 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (2m) 19s ago 12m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:35:11.911 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (11m) 50s ago 12m 87.8M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:35:11.912 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (7m) 50s ago 7m 156M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:35:11.912 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (7m) 50s ago 7m 98.3M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:35:11.912 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (7m) 19s ago 7m 25.9M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:35:11.912 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (7m) 19s ago 7m 25.7M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:35:11.912 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (4m) 50s ago 14m 491M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:35:11.912 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (3m) 19s ago 11m 440M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:35:11.912 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (2m) 50s ago 14m 47.4M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:35:11.912 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (2m) 19s ago 11m 38.5M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:35:11.912 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (13m) 50s ago 13m 15.3M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:35:11.912 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (11m) 19s ago 11m 15.3M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:35:11.912 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (2m) 50s ago 11m 131M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:35:11.913 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (89s) 50s ago 10m 95.5M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 b2f99a2919b9 2024-09-13T18:35:11.913 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (55s) 50s ago 10m 11.2M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 090af670cd3d 2024-09-13T18:35:11.913 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (22s) 19s ago 9m 14.9M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 e4321b085347 2024-09-13T18:35:11.913 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (9m) 19s ago 9m 348M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f 04df01ab7865 2024-09-13T18:35:11.913 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (8m) 19s ago 8m 260M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:35:11.913 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (3m) 50s ago 12m 60.7M - 2.43.0 a07b618ecd1d c04b1dcdc8c3 2024-09-13T18:35:11.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.910+0000 7fd303213640 1 -- 172.21.15.38:0/1158521661 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2e806cc50 msgr2=0x7fd2e806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.910+0000 7fd303213640 1 --2- 172.21.15.38:0/1158521661 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2e806cc50 0x7fd2e806f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc196aa0 tx=0x7fd2ec031400 comp rx=0 tx=0).stop 2024-09-13T18:35:11.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.910+0000 7fd303213640 1 -- 172.21.15.38:0/1158521661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2fc0feaa0 msgr2=0x7fd2fc195580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.910+0000 7fd303213640 1 --2- 172.21.15.38:0/1158521661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2fc0feaa0 0x7fd2fc195580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400e970 tx=0x7fd2e400ee30 comp rx=0 tx=0).stop 2024-09-13T18:35:11.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.910+0000 7fd303213640 1 -- 172.21.15.38:0/1158521661 shutdown_connections 2024-09-13T18:35:11.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.910+0000 7fd303213640 1 --2- 172.21.15.38:0/1158521661 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2e806cc50 0x7fd2e806f110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.910+0000 7fd303213640 1 --2- 172.21.15.38:0/1158521661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2fc0ffca0 0x7fd2fc195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.910+0000 7fd303213640 1 --2- 172.21.15.38:0/1158521661 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd2fc0feaa0 0x7fd2fc195580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.910+0000 7fd303213640 1 -- 172.21.15.38:0/1158521661 >> 172.21.15.38:0/1158521661 conn(0x7fd2fc0fa250 msgr2=0x7fd2fc0fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.910+0000 7fd303213640 1 -- 172.21.15.38:0/1158521661 shutdown_connections 2024-09-13T18:35:11.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.910+0000 7fd303213640 1 -- 172.21.15.38:0/1158521661 wait complete. 2024-09-13T18:35:11.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.993+0000 7fed27db7640 1 -- 172.21.15.38:0/2132557716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed20100d90 msgr2=0x7fed20101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.993+0000 7fed27db7640 1 --2- 172.21.15.38:0/2132557716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed20100d90 0x7fed20101210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fed10009880 tx=0x7fed1002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.993+0000 7fed27db7640 1 -- 172.21.15.38:0/2132557716 shutdown_connections 2024-09-13T18:35:11.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.993+0000 7fed27db7640 1 --2- 172.21.15.38:0/2132557716 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed20100d90 0x7fed20101210 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.993+0000 7fed27db7640 1 --2- 172.21.15.38:0/2132557716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed200ffb90 0x7fed200fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.993+0000 7fed27db7640 1 -- 172.21.15.38:0/2132557716 >> 172.21.15.38:0/2132557716 conn(0x7fed200fb320 msgr2=0x7fed200fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:11.996 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.993+0000 7fed27db7640 1 -- 172.21.15.38:0/2132557716 shutdown_connections 2024-09-13T18:35:11.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.993+0000 7fed27db7640 1 -- 172.21.15.38:0/2132557716 wait complete. 2024-09-13T18:35:11.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.994+0000 7fed27db7640 1 Processor -- start 2024-09-13T18:35:11.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.994+0000 7fed27db7640 1 -- start start 2024-09-13T18:35:11.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.994+0000 7fed27db7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed200ffb90 0x7fed201955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.994+0000 7fed27db7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed20100d90 0x7fed20195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:11.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.994+0000 7fed27db7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed201960e0 con 0x7fed200ffb90 2024-09-13T18:35:11.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.994+0000 7fed27db7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed20196250 con 0x7fed20100d90 2024-09-13T18:35:11.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.994+0000 7fed25b53640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed200ffb90 0x7fed201955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.994+0000 7fed25b53640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed200ffb90 0x7fed201955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38754/0 (socket says 172.21.15.38:38754) 2024-09-13T18:35:11.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.994+0000 7fed25b53640 1 -- 172.21.15.38:0/3835460829 learned_addr learned my addr 172.21.15.38:0/3835460829 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:11.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.995+0000 7fed25352640 1 --2- 172.21.15.38:0/3835460829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed20100d90 0x7fed20195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:11.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.995+0000 7fed25b53640 1 -- 172.21.15.38:0/3835460829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed20100d90 msgr2=0x7fed20195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:11.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.995+0000 7fed25b53640 1 --2- 172.21.15.38:0/3835460829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed20100d90 0x7fed20195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:11.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.995+0000 7fed25b53640 1 -- 172.21.15.38:0/3835460829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009560 con 0x7fed200ffb90 2024-09-13T18:35:11.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.995+0000 7fed25b53640 1 --2- 172.21.15.38:0/3835460829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed200ffb90 0x7fed201955d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00d900 tx=0x7fed1c00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:11.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.995+0000 7fed16ffd640 1 -- 172.21.15.38:0/3835460829 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1c009c00 con 0x7fed200ffb90 2024-09-13T18:35:11.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.995+0000 7fed16ffd640 1 -- 172.21.15.38:0/3835460829 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fed1c009d60 con 0x7fed200ffb90 2024-09-13T18:35:11.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.995+0000 7fed27db7640 1 -- 172.21.15.38:0/3835460829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2019acf0 con 0x7fed200ffb90 2024-09-13T18:35:11.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.995+0000 7fed16ffd640 1 -- 172.21.15.38:0/3835460829 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1c00f5f0 con 0x7fed200ffb90 2024-09-13T18:35:11.999 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.995+0000 7fed27db7640 1 -- 172.21.15.38:0/3835460829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2019b240 con 0x7fed200ffb90 2024-09-13T18:35:12.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.997+0000 7fed27db7640 1 -- 172.21.15.38:0/3835460829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed200fff90 con 0x7fed200ffb90 2024-09-13T18:35:12.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.997+0000 7fed16ffd640 1 -- 172.21.15.38:0/3835460829 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fed1c010460 con 0x7fed200ffb90 2024-09-13T18:35:12.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.997+0000 7fed16ffd640 1 --2- 172.21.15.38:0/3835460829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fed0c06cc50 0x7fed0c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.998+0000 7fed16ffd640 1 -- 172.21.15.38:0/3835460829 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fed1c08c350 con 0x7fed200ffb90 2024-09-13T18:35:12.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.998+0000 7fed25352640 1 --2- 172.21.15.38:0/3835460829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fed0c06cc50 0x7fed0c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:11.998+0000 7fed25352640 1 --2- 172.21.15.38:0/3835460829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fed0c06cc50 0x7fed0c06f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed10000c00 tx=0x7fed10004f60 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:12.004 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.002+0000 7fed16ffd640 1 -- 172.21.15.38:0/3835460829 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fed1c056490 con 0x7fed200ffb90 2024-09-13T18:35:12.018 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:11 smithi149 ceph-mon[76906]: pgmap v159: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-09-13T18:35:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.239+0000 7fed27db7640 1 -- 172.21.15.38:0/3835460829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed2002c4d0 con 0x7fed200ffb90 2024-09-13T18:35:12.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.240+0000 7fed16ffd640 1 -- 172.21.15.38:0/3835460829 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fed1c059ab0 con 0x7fed200ffb90 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 2, 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 4 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:35:12.243 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:35:12.244 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:35:12.244 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 6, 2024-09-13T18:35:12.244 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 8 2024-09-13T18:35:12.244 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:35:12.244 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:35:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.242+0000 7fed27db7640 1 -- 172.21.15.38:0/3835460829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fed0c06cc50 msgr2=0x7fed0c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.242+0000 7fed27db7640 1 --2- 172.21.15.38:0/3835460829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fed0c06cc50 0x7fed0c06f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed10000c00 tx=0x7fed10004f60 comp rx=0 tx=0).stop 2024-09-13T18:35:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.242+0000 7fed27db7640 1 -- 172.21.15.38:0/3835460829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed200ffb90 msgr2=0x7fed201955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.242+0000 7fed27db7640 1 --2- 172.21.15.38:0/3835460829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed200ffb90 0x7fed201955d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00d900 tx=0x7fed1c00ddc0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.242+0000 7fed27db7640 1 -- 172.21.15.38:0/3835460829 shutdown_connections 2024-09-13T18:35:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.242+0000 7fed27db7640 1 --2- 172.21.15.38:0/3835460829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fed0c06cc50 0x7fed0c06f110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.242+0000 7fed27db7640 1 --2- 172.21.15.38:0/3835460829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed20100d90 0x7fed20195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.242+0000 7fed27db7640 1 --2- 172.21.15.38:0/3835460829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed200ffb90 0x7fed201955d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.242+0000 7fed27db7640 1 -- 172.21.15.38:0/3835460829 >> 172.21.15.38:0/3835460829 conn(0x7fed200fb320 msgr2=0x7fed20104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.242+0000 7fed27db7640 1 -- 172.21.15.38:0/3835460829 shutdown_connections 2024-09-13T18:35:12.245 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.242+0000 7fed27db7640 1 -- 172.21.15.38:0/3835460829 wait complete. 2024-09-13T18:35:12.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.326+0000 7fd4b8807640 1 -- 172.21.15.38:0/3412672813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b40feaa0 msgr2=0x7fd4b40feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.326+0000 7fd4b8807640 1 --2- 172.21.15.38:0/3412672813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b40feaa0 0x7fd4b40feea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009880 tx=0x7fd4a402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.326+0000 7fd4b8807640 1 -- 172.21.15.38:0/3412672813 shutdown_connections 2024-09-13T18:35:12.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.326+0000 7fd4b8807640 1 --2- 172.21.15.38:0/3412672813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4b40ffca0 0x7fd4b4100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.326+0000 7fd4b8807640 1 --2- 172.21.15.38:0/3412672813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b40feaa0 0x7fd4b40feea0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.326+0000 7fd4b8807640 1 -- 172.21.15.38:0/3412672813 >> 172.21.15.38:0/3412672813 conn(0x7fd4b40fa250 msgr2=0x7fd4b40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.326+0000 7fd4b8807640 1 -- 172.21.15.38:0/3412672813 shutdown_connections 2024-09-13T18:35:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.326+0000 7fd4b8807640 1 -- 172.21.15.38:0/3412672813 wait complete. 2024-09-13T18:35:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.327+0000 7fd4b8807640 1 Processor -- start 2024-09-13T18:35:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.327+0000 7fd4b8807640 1 -- start start 2024-09-13T18:35:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.327+0000 7fd4b8807640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4b40feaa0 0x7fd4b4197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.332 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.327+0000 7fd4b8807640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b40ffca0 0x7fd4b4197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.327+0000 7fd4b8807640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b4198270 con 0x7fd4b40ffca0 2024-09-13T18:35:12.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.327+0000 7fd4b8807640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b41983e0 con 0x7fd4b40feaa0 2024-09-13T18:35:12.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4b1d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b40ffca0 0x7fd4b4197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4b1d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b40ffca0 0x7fd4b4197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57802/0 (socket says 172.21.15.38:57802) 2024-09-13T18:35:12.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4b1d9b640 1 -- 172.21.15.38:0/694518170 learned_addr learned my addr 172.21.15.38:0/694518170 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:12.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4b259c640 1 --2- 172.21.15.38:0/694518170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4b40feaa0 0x7fd4b4197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4b1d9b640 1 -- 172.21.15.38:0/694518170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4b40feaa0 msgr2=0x7fd4b4197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4b1d9b640 1 --2- 172.21.15.38:0/694518170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4b40feaa0 0x7fd4b4197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4b1d9b640 1 -- 172.21.15.38:0/694518170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a4009560 con 0x7fd4b40ffca0 2024-09-13T18:35:12.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4b1d9b640 1 --2- 172.21.15.38:0/694518170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b40ffca0 0x7fd4b4197ca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800e9a0 tx=0x7fd4a800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:12.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4a37fe640 1 -- 172.21.15.38:0/694518170 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4a800cd50 con 0x7fd4b40ffca0 2024-09-13T18:35:12.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4b8807640 1 -- 172.21.15.38:0/694518170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b419ce80 con 0x7fd4b40ffca0 2024-09-13T18:35:12.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4a37fe640 1 -- 172.21.15.38:0/694518170 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd4a800ceb0 con 0x7fd4b40ffca0 2024-09-13T18:35:12.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4a37fe640 1 -- 172.21.15.38:0/694518170 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4a8010430 con 0x7fd4b40ffca0 2024-09-13T18:35:12.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.328+0000 7fd4b8807640 1 -- 172.21.15.38:0/694518170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b419d420 con 0x7fd4b40ffca0 2024-09-13T18:35:12.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.330+0000 7fd4b8807640 1 -- 172.21.15.38:0/694518170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b40feea0 con 0x7fd4b40ffca0 2024-09-13T18:35:12.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.330+0000 7fd4a37fe640 1 -- 172.21.15.38:0/694518170 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd4a8005020 con 0x7fd4b40ffca0 2024-09-13T18:35:12.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.331+0000 7fd4a37fe640 1 --2- 172.21.15.38:0/694518170 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd49c06cc60 0x7fd49c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.331+0000 7fd4a37fe640 1 -- 172.21.15.38:0/694518170 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fd4a8014070 con 0x7fd4b40ffca0 2024-09-13T18:35:12.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.331+0000 7fd4b259c640 1 --2- 172.21.15.38:0/694518170 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd49c06cc60 0x7fd49c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.331+0000 7fd4b259c640 1 --2- 172.21.15.38:0/694518170 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd49c06cc60 0x7fd49c06f120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4000c00 tx=0x7fd4a4031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:12.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.335+0000 7fd4a37fe640 1 -- 172.21.15.38:0/694518170 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd4a8056b30 con 0x7fd4b40ffca0 2024-09-13T18:35:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.541+0000 7fd4b8807640 1 -- 172.21.15.38:0/694518170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4b4107570 con 0x7fd4b40ffca0 2024-09-13T18:35:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.541+0000 7fd4a37fe640 1 -- 172.21.15.38:0/694518170 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7fd4a805a150 con 0x7fd4b40ffca0 2024-09-13T18:35:12.544 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:35:12.544 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:35:12.544 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:35:12.544 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:35:12.545 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:35:12.546 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:35:12.547 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:35:12.547 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:35:12.547 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:35:12.547 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:35:12.547 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:35:12.547 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:35:12.547 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:35:12.548 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:35:12.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.544+0000 7fd4b8807640 1 -- 172.21.15.38:0/694518170 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd49c06cc60 msgr2=0x7fd49c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.544+0000 7fd4b8807640 1 --2- 172.21.15.38:0/694518170 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd49c06cc60 0x7fd49c06f120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4000c00 tx=0x7fd4a4031400 comp rx=0 tx=0).stop 2024-09-13T18:35:12.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.544+0000 7fd4b8807640 1 -- 172.21.15.38:0/694518170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b40ffca0 msgr2=0x7fd4b4197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.544+0000 7fd4b8807640 1 --2- 172.21.15.38:0/694518170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b40ffca0 0x7fd4b4197ca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800e9a0 tx=0x7fd4a800eda0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.544+0000 7fd4b8807640 1 -- 172.21.15.38:0/694518170 shutdown_connections 2024-09-13T18:35:12.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.544+0000 7fd4b8807640 1 --2- 172.21.15.38:0/694518170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4b40ffca0 0x7fd4b4197ca0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.544+0000 7fd4b8807640 1 --2- 172.21.15.38:0/694518170 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd49c06cc60 0x7fd49c06f120 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.544+0000 7fd4b8807640 1 --2- 172.21.15.38:0/694518170 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4b40feaa0 0x7fd4b4197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.544+0000 7fd4b8807640 1 -- 172.21.15.38:0/694518170 >> 172.21.15.38:0/694518170 conn(0x7fd4b40fa250 msgr2=0x7fd4b40fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:12.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.544+0000 7fd4b8807640 1 -- 172.21.15.38:0/694518170 shutdown_connections 2024-09-13T18:35:12.549 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.544+0000 7fd4b8807640 1 -- 172.21.15.38:0/694518170 wait complete. 2024-09-13T18:35:12.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.629+0000 7f18499b3640 1 -- 172.21.15.38:0/984843307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18440fed60 msgr2=0x7f18440ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.629+0000 7f18499b3640 1 --2- 172.21.15.38:0/984843307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18440fed60 0x7f18440ff1e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1838009880 tx=0x7f183802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.629+0000 7f18499b3640 1 -- 172.21.15.38:0/984843307 shutdown_connections 2024-09-13T18:35:12.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.629+0000 7f18499b3640 1 --2- 172.21.15.38:0/984843307 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18440fed60 0x7f18440ff1e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.629+0000 7f18499b3640 1 --2- 172.21.15.38:0/984843307 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1844100020 0x7f1844100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.632 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.629+0000 7f18499b3640 1 -- 172.21.15.38:0/984843307 >> 172.21.15.38:0/984843307 conn(0x7f18440f99c0 msgr2=0x7f18440fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:12.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.629+0000 7f18499b3640 1 -- 172.21.15.38:0/984843307 shutdown_connections 2024-09-13T18:35:12.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.629+0000 7f18499b3640 1 -- 172.21.15.38:0/984843307 wait complete. 2024-09-13T18:35:12.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.630+0000 7f18499b3640 1 Processor -- start 2024-09-13T18:35:12.633 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.630+0000 7f18499b3640 1 -- start start 2024-09-13T18:35:12.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.630+0000 7f18499b3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18440fed60 0x7f18441955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.630+0000 7f18499b3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1844100020 0x7f1844195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.630+0000 7f18499b3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18441960f0 con 0x7f1844100020 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.630+0000 7f18499b3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1844196260 con 0x7f18440fed60 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.630+0000 7f18427fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1844100020 0x7f1844195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.630+0000 7f18427fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1844100020 0x7f1844195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57808/0 (socket says 172.21.15.38:57808) 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.630+0000 7f18427fc640 1 -- 172.21.15.38:0/1163402923 learned_addr learned my addr 172.21.15.38:0/1163402923 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.630+0000 7f1842ffd640 1 --2- 172.21.15.38:0/1163402923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18440fed60 0x7f18441955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.631+0000 7f18427fc640 1 -- 172.21.15.38:0/1163402923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18440fed60 msgr2=0x7f18441955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.631+0000 7f18427fc640 1 --2- 172.21.15.38:0/1163402923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18440fed60 0x7f18441955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.631+0000 7f18427fc640 1 -- 172.21.15.38:0/1163402923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1838009560 con 0x7f1844100020 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.631+0000 7f1842ffd640 1 --2- 172.21.15.38:0/1163402923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18440fed60 0x7f18441955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.631+0000 7f18427fc640 1 --2- 172.21.15.38:0/1163402923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1844100020 0x7f1844195b20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1838006010 tx=0x7f18380056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.631+0000 7f18489b1640 1 -- 172.21.15.38:0/1163402923 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1838004c60 con 0x7f1844100020 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.631+0000 7f18489b1640 1 -- 172.21.15.38:0/1163402923 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1838031a00 con 0x7f1844100020 2024-09-13T18:35:12.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.631+0000 7f18489b1640 1 -- 172.21.15.38:0/1163402923 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1838003bc0 con 0x7f1844100020 2024-09-13T18:35:12.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.631+0000 7f18499b3640 1 -- 172.21.15.38:0/1163402923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184419ac30 con 0x7f1844100020 2024-09-13T18:35:12.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.631+0000 7f18499b3640 1 -- 172.21.15.38:0/1163402923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184419b1a0 con 0x7f1844100020 2024-09-13T18:35:12.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.632+0000 7f18499b3640 1 -- 172.21.15.38:0/1163402923 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1844107530 con 0x7f1844100020 2024-09-13T18:35:12.636 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.633+0000 7f18489b1640 1 -- 172.21.15.38:0/1163402923 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1838003d20 con 0x7f1844100020 2024-09-13T18:35:12.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.633+0000 7f18489b1640 1 --2- 172.21.15.38:0/1163402923 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f182c06cc50 0x7f182c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.633+0000 7f18489b1640 1 -- 172.21.15.38:0/1163402923 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f18380ad7e0 con 0x7f1844100020 2024-09-13T18:35:12.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.633+0000 7f1842ffd640 1 --2- 172.21.15.38:0/1163402923 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f182c06cc50 0x7f182c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.634+0000 7f1842ffd640 1 --2- 172.21.15.38:0/1163402923 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f182c06cc50 0x7f182c06f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18440681d0 tx=0x7f1834005d30 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:12.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.638+0000 7f18489b1640 1 -- 172.21.15.38:0/1163402923 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1838077870 con 0x7f1844100020 2024-09-13T18:35:12.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.824+0000 7f18499b3640 1 -- 172.21.15.38:0/1163402923 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f184419b3e0 con 0x7f182c06cc50 2024-09-13T18:35:12.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.825+0000 7f18489b1640 1 -- 172.21.15.38:0/1163402923 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f184419b3e0 con 0x7f182c06cc50 2024-09-13T18:35:12.827 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:35:12.828 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:35:12.828 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:35:12.828 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:35:12.828 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:35:12.828 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr", 2024-09-13T18:35:12.828 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-13T18:35:12.828 INFO:teuthology.orchestra.run.smithi038.stdout: "mon" 2024-09-13T18:35:12.828 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:35:12.828 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "10/23 daemons upgraded", 2024-09-13T18:35:12.828 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T18:35:12.828 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:35:12.828 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:35:12.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.827+0000 7f18499b3640 1 -- 172.21.15.38:0/1163402923 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f182c06cc50 msgr2=0x7f182c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.827+0000 7f18499b3640 1 --2- 172.21.15.38:0/1163402923 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f182c06cc50 0x7f182c06f110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18440681d0 tx=0x7f1834005d30 comp rx=0 tx=0).stop 2024-09-13T18:35:12.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.827+0000 7f18499b3640 1 -- 172.21.15.38:0/1163402923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1844100020 msgr2=0x7f1844195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.827+0000 7f18499b3640 1 --2- 172.21.15.38:0/1163402923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1844100020 0x7f1844195b20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1838006010 tx=0x7f18380056e0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.827+0000 7f18499b3640 1 -- 172.21.15.38:0/1163402923 shutdown_connections 2024-09-13T18:35:12.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.827+0000 7f18499b3640 1 --2- 172.21.15.38:0/1163402923 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1844100020 0x7f1844195b20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.827+0000 7f18499b3640 1 --2- 172.21.15.38:0/1163402923 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f182c06cc50 0x7f182c06f110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.827+0000 7f18499b3640 1 --2- 172.21.15.38:0/1163402923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18440fed60 0x7f18441955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.827+0000 7f18499b3640 1 -- 172.21.15.38:0/1163402923 >> 172.21.15.38:0/1163402923 conn(0x7f18440f99c0 msgr2=0x7f18440fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:12.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.828+0000 7f18499b3640 1 -- 172.21.15.38:0/1163402923 shutdown_connections 2024-09-13T18:35:12.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.828+0000 7f18499b3640 1 -- 172.21.15.38:0/1163402923 wait complete. 2024-09-13T18:35:12.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.911+0000 7f6931734640 1 -- 172.21.15.38:0/612137814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f692c100d90 msgr2=0x7f692c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.911+0000 7f6931734640 1 --2- 172.21.15.38:0/612137814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f692c100d90 0x7f692c101210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6920009880 tx=0x7f692002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.911+0000 7f6931734640 1 -- 172.21.15.38:0/612137814 shutdown_connections 2024-09-13T18:35:12.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.911+0000 7f6931734640 1 --2- 172.21.15.38:0/612137814 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f692c100d90 0x7f692c101210 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.911+0000 7f6931734640 1 --2- 172.21.15.38:0/612137814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0ffb90 0x7f692c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.911+0000 7f6931734640 1 -- 172.21.15.38:0/612137814 >> 172.21.15.38:0/612137814 conn(0x7f692c0fb320 msgr2=0x7f692c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:12.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.911+0000 7f6931734640 1 -- 172.21.15.38:0/612137814 shutdown_connections 2024-09-13T18:35:12.914 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.911+0000 7f6931734640 1 -- 172.21.15.38:0/612137814 wait complete. 2024-09-13T18:35:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:12 smithi038 ceph-mon[91522]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:12 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:12 smithi038 ceph-mon[91522]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:12 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T18:35:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:12 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T18:35:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:12 smithi038 ceph-mon[91522]: Upgrade: osd.4 is safe to restart 2024-09-13T18:35:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:12 smithi038 ceph-mon[91522]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:12 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3835460829' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:35:12.915 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:12 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/694518170' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:35:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.912+0000 7f6931734640 1 Processor -- start 2024-09-13T18:35:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.912+0000 7f6931734640 1 -- start start 2024-09-13T18:35:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.912+0000 7f6931734640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0ffb90 0x7f692c195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.912+0000 7f6931734640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f692c100d90 0x7f692c195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.912+0000 7f6931734640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c195fb0 con 0x7f692c100d90 2024-09-13T18:35:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.912+0000 7f6931734640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c196120 con 0x7f692c0ffb90 2024-09-13T18:35:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.912+0000 7f692a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f692c100d90 0x7f692c195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.912+0000 7f692a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f692c100d90 0x7f692c195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57830/0 (socket says 172.21.15.38:57830) 2024-09-13T18:35:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.912+0000 7f692a7fc640 1 -- 172.21.15.38:0/3573461502 learned_addr learned my addr 172.21.15.38:0/3573461502 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.913+0000 7f692affd640 1 --2- 172.21.15.38:0/3573461502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0ffb90 0x7f692c195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.913+0000 7f692a7fc640 1 -- 172.21.15.38:0/3573461502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0ffb90 msgr2=0x7f692c195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.913+0000 7f692a7fc640 1 --2- 172.21.15.38:0/3573461502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0ffb90 0x7f692c195530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.913+0000 7f692a7fc640 1 -- 172.21.15.38:0/3573461502 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920009560 con 0x7f692c100d90 2024-09-13T18:35:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.913+0000 7f692affd640 1 --2- 172.21.15.38:0/3573461502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0ffb90 0x7f692c195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.913+0000 7f692a7fc640 1 --2- 172.21.15.38:0/3573461502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f692c100d90 0x7f692c195a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f69200099a0 tx=0x7f69200056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.913+0000 7f6913fff640 1 -- 172.21.15.38:0/3573461502 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6920004b20 con 0x7f692c100d90 2024-09-13T18:35:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.913+0000 7f6931734640 1 -- 172.21.15.38:0/3573461502 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c19aba0 con 0x7f692c100d90 2024-09-13T18:35:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.913+0000 7f6913fff640 1 -- 172.21.15.38:0/3573461502 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6920004c80 con 0x7f692c100d90 2024-09-13T18:35:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.913+0000 7f6913fff640 1 -- 172.21.15.38:0/3573461502 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6920031a00 con 0x7f692c100d90 2024-09-13T18:35:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.913+0000 7f6931734640 1 -- 172.21.15.38:0/3573461502 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c19b0c0 con 0x7f692c100d90 2024-09-13T18:35:12.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.914+0000 7f6931734640 1 -- 172.21.15.38:0/3573461502 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692c18f5d0 con 0x7f692c100d90 2024-09-13T18:35:12.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.916+0000 7f6913fff640 1 -- 172.21.15.38:0/3573461502 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6920031cc0 con 0x7f692c100d90 2024-09-13T18:35:12.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.916+0000 7f6913fff640 1 --2- 172.21.15.38:0/3573461502 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f691406cc60 0x7f691406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:12.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.916+0000 7f6913fff640 1 -- 172.21.15.38:0/3573461502 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f69200adf40 con 0x7f692c100d90 2024-09-13T18:35:12.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.917+0000 7f692affd640 1 --2- 172.21.15.38:0/3573461502 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f691406cc60 0x7f691406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:12.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.917+0000 7f692affd640 1 --2- 172.21.15.38:0/3573461502 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f691406cc60 0x7f691406f120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f692c100bf0 tx=0x7f691c00a5e0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:12.924 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:12.919+0000 7f6913fff640 1 -- 172.21.15.38:0/3573461502 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6920077f30 con 0x7f692c100d90 2024-09-13T18:35:13.001 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:12 smithi149 ceph-mon[76906]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:13.001 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:12 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:13.002 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:12 smithi149 ceph-mon[76906]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:13.002 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:12 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T18:35:13.002 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:12 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T18:35:13.002 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:12 smithi149 ceph-mon[76906]: Upgrade: osd.4 is safe to restart 2024-09-13T18:35:13.002 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:12 smithi149 ceph-mon[76906]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:13.002 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:12 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3835460829' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:35:13.002 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:12 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/694518170' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:35:13.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.157+0000 7f6931734640 1 -- 172.21.15.38:0/3573461502 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f692c108830 con 0x7f692c100d90 2024-09-13T18:35:13.160 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.158+0000 7f6913fff640 1 -- 172.21.15.38:0/3573461502 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6920040090 con 0x7f692c100d90 2024-09-13T18:35:13.161 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:35:13.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.160+0000 7f6931734640 1 -- 172.21.15.38:0/3573461502 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f691406cc60 msgr2=0x7f691406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:13.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.160+0000 7f6931734640 1 --2- 172.21.15.38:0/3573461502 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f691406cc60 0x7f691406f120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f692c100bf0 tx=0x7f691c00a5e0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.160+0000 7f6931734640 1 -- 172.21.15.38:0/3573461502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f692c100d90 msgr2=0x7f692c195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:13.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.160+0000 7f6931734640 1 --2- 172.21.15.38:0/3573461502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f692c100d90 0x7f692c195a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f69200099a0 tx=0x7f69200056e0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.160+0000 7f6931734640 1 -- 172.21.15.38:0/3573461502 shutdown_connections 2024-09-13T18:35:13.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.160+0000 7f6931734640 1 --2- 172.21.15.38:0/3573461502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f692c100d90 0x7f692c195a70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.160+0000 7f6931734640 1 --2- 172.21.15.38:0/3573461502 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f691406cc60 0x7f691406f120 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.160+0000 7f6931734640 1 --2- 172.21.15.38:0/3573461502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0ffb90 0x7f692c195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:13.163 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.160+0000 7f6931734640 1 -- 172.21.15.38:0/3573461502 >> 172.21.15.38:0/3573461502 conn(0x7f692c0fb320 msgr2=0x7f692c1044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:13.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.160+0000 7f6931734640 1 -- 172.21.15.38:0/3573461502 shutdown_connections 2024-09-13T18:35:13.164 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:13.160+0000 7f6931734640 1 -- 172.21.15.38:0/3573461502 wait complete. 2024-09-13T18:35:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:13 smithi149 ceph-mon[76906]: pgmap v160: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-13T18:35:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:13 smithi149 ceph-mon[76906]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:14.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:14.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T18:35:14.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:35:14.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:13 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3573461502' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:35:14.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:13 smithi038 ceph-mon[91522]: pgmap v160: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-13T18:35:14.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:13 smithi038 ceph-mon[91522]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:14.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:14.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T18:35:14.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:35:14.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:13 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3573461502' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:35:14.914 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:14 smithi149 ceph-mon[76906]: Upgrade: Updating osd.4 2024-09-13T18:35:14.914 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:14 smithi149 ceph-mon[76906]: Deploying daemon osd.4 on smithi149 2024-09-13T18:35:15.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:14 smithi038 ceph-mon[91522]: Upgrade: Updating osd.4 2024-09-13T18:35:15.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:14 smithi038 ceph-mon[91522]: Deploying daemon osd.4 on smithi149 2024-09-13T18:35:15.963 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:15 smithi149 ceph-mon[76906]: pgmap v161: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-13T18:35:16.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:15 smithi038 ceph-mon[91522]: pgmap v161: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-13T18:35:16.224 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:15 smithi149 systemd[1]: Stopping Ceph osd.4 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:35:16.519 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:16 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[48231]: 2024-09-13T18:35:16.221+0000 7f9c6b394640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:35:16.520 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:16 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[48231]: 2024-09-13T18:35:16.221+0000 7f9c6b394640 -1 osd.4 83 *** Got signal Terminated *** 2024-09-13T18:35:16.520 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:16 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[48231]: 2024-09-13T18:35:16.221+0000 7f9c6b394640 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:35:17.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:16 smithi149 ceph-mon[76906]: osd.4 marked itself down and dead 2024-09-13T18:35:17.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:16 smithi038 ceph-mon[91522]: osd.4 marked itself down and dead 2024-09-13T18:35:17.406 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:17 smithi149 podman[89774]: 2024-09-13 18:35:17.065204539 +0000 UTC m=+0.940948739 container died 04df01ab78656cf2b7d5a45eaf9843e798cc2c3dc19bdd68f8beebb448dbb0bc (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=reef-e4e227b, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T18:35:17.406 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:17 smithi149 podman[89774]: 2024-09-13 18:35:17.404300449 +0000 UTC m=+1.280044646 container cleanup 04df01ab78656cf2b7d5a45eaf9843e798cc2c3dc19bdd68f8beebb448dbb0bc (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-e4e227b, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T18:35:17.769 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:17 smithi149 bash[89774]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4 2024-09-13T18:35:17.769 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:17 smithi149 podman[89800]: 2024-09-13 18:35:17.606238956 +0000 UTC m=+0.539554609 container remove 04df01ab78656cf2b7d5a45eaf9843e798cc2c3dc19bdd68f8beebb448dbb0bc (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-e4e227b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T18:35:17.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:17 smithi149 ceph-mon[76906]: pgmap v162: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:35:17.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:17 smithi149 ceph-mon[76906]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T18:35:17.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:17 smithi149 ceph-mon[76906]: osdmap e84: 6 total, 5 up, 6 in 2024-09-13T18:35:18.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:17 smithi038 ceph-mon[91522]: pgmap v162: 65 pgs: 65 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:35:18.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:17 smithi038 ceph-mon[91522]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T18:35:18.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:17 smithi038 ceph-mon[91522]: osdmap e84: 6 total, 5 up, 6 in 2024-09-13T18:35:18.311 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:18 smithi149 podman[89888]: 2024-09-13 18:35:17.927038922 +0000 UTC m=+0.016069526 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:35:18.311 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:18 smithi149 podman[89888]: 2024-09-13 18:35:18.057199181 +0000 UTC m=+0.146229775 container create f95deace64cbf00813e89b354196c8a44426a64b06613804c979d6596dad9637 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T18:35:18.311 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:18 smithi149 podman[89888]: 2024-09-13 18:35:18.309374404 +0000 UTC m=+0.398404998 container init f95deace64cbf00813e89b354196c8a44426a64b06613804c979d6596dad9637 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:35:18.646 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:18 smithi149 podman[89888]: 2024-09-13 18:35:18.312892476 +0000 UTC m=+0.401923079 container start f95deace64cbf00813e89b354196c8a44426a64b06613804c979d6596dad9637 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T18:35:18.646 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:18 smithi149 podman[89888]: 2024-09-13 18:35:18.409685757 +0000 UTC m=+0.498716373 container attach f95deace64cbf00813e89b354196c8a44426a64b06613804c979d6596dad9637 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T18:35:18.647 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:18 smithi149 podman[89888]: 2024-09-13 18:35:18.504158409 +0000 UTC m=+0.593189015 container died f95deace64cbf00813e89b354196c8a44426a64b06613804c979d6596dad9637 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:35:19.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:18 smithi149 ceph-mon[76906]: osdmap e85: 6 total, 5 up, 6 in 2024-09-13T18:35:19.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:18 smithi038 ceph-mon[91522]: osdmap e85: 6 total, 5 up, 6 in 2024-09-13T18:35:19.508 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:19 smithi149 podman[89912]: 2024-09-13 18:35:19.072185523 +0000 UTC m=+0.562006312 container remove f95deace64cbf00813e89b354196c8a44426a64b06613804c979d6596dad9637 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:35:19.508 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:19 smithi149 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-13T18:35:19.508 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:19 smithi149 systemd[1]: Stopped Ceph osd.4 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:35:19.508 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:19 smithi149 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.4.service: Consumed 1min 7.783s CPU time. 2024-09-13T18:35:19.508 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:19 smithi149 systemd[1]: Starting Ceph osd.4 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:35:19.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:19 smithi149 ceph-mon[76906]: pgmap v165: 65 pgs: 1 active+undersized, 5 peering, 4 stale+active+clean, 55 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:35:19.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:19 smithi149 ceph-mon[76906]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-13T18:35:19.769 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:19 smithi149 podman[90008]: 2024-09-13 18:35:19.408691607 +0000 UTC m=+0.015947005 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:35:19.770 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:19 smithi149 podman[90008]: 2024-09-13 18:35:19.523062792 +0000 UTC m=+0.130318189 container create 141525fcca7c932851a9e235882c2e0768440e993bcd1ba2efdd25bc4965314e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T18:35:20.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:19 smithi038 ceph-mon[91522]: pgmap v165: 65 pgs: 1 active+undersized, 5 peering, 4 stale+active+clean, 55 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T18:35:20.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:19 smithi038 ceph-mon[91522]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-13T18:35:20.147 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:19 smithi149 podman[90008]: 2024-09-13 18:35:19.842958467 +0000 UTC m=+0.450213864 container init 141525fcca7c932851a9e235882c2e0768440e993bcd1ba2efdd25bc4965314e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:35:20.147 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:19 smithi149 podman[90008]: 2024-09-13 18:35:19.846412819 +0000 UTC m=+0.453668220 container start 141525fcca7c932851a9e235882c2e0768440e993bcd1ba2efdd25bc4965314e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T18:35:20.148 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:19 smithi149 podman[90008]: 2024-09-13 18:35:19.92649591 +0000 UTC m=+0.533751325 container attach 141525fcca7c932851a9e235882c2e0768440e993bcd1ba2efdd25bc4965314e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T18:35:20.482 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate[90024]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:35:20.482 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 bash[90008]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:35:20.482 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate[90024]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T18:35:20.483 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 bash[90008]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T18:35:20.483 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate[90024]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T18:35:20.483 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 bash[90008]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T18:35:20.483 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate[90024]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T18:35:20.483 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 bash[90008]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T18:35:20.483 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate[90024]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T18:35:20.483 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 bash[90008]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T18:35:20.483 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate[90024]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:35:20.483 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 bash[90008]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:35:20.483 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate[90024]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T18:35:20.483 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 bash[90008]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T18:35:20.483 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 podman[90008]: 2024-09-13 18:35:20.194285982 +0000 UTC m=+0.801541393 container died 141525fcca7c932851a9e235882c2e0768440e993bcd1ba2efdd25bc4965314e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-13T18:35:20.757 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:20 smithi149 ceph-mon[76906]: Health check failed: Degraded data redundancy: 18/282 objects degraded (6.383%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T18:35:21.019 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 podman[90156]: 2024-09-13 18:35:20.75528786 +0000 UTC m=+0.555119535 container remove 141525fcca7c932851a9e235882c2e0768440e993bcd1ba2efdd25bc4965314e (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T18:35:21.020 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 podman[90216]: 2024-09-13 18:35:20.939466196 +0000 UTC m=+0.092836459 container create c6ec97a4d9ff15851d3401caf1c5b00c20968676b20c79fdf983e3a24ce45f6b (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T18:35:21.020 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:20 smithi149 podman[90216]: 2024-09-13 18:35:20.862267687 +0000 UTC m=+0.015637955 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:35:21.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:20 smithi038 ceph-mon[91522]: Health check failed: Degraded data redundancy: 18/282 objects degraded (6.383%), 7 pgs degraded (PG_DEGRADED) 2024-09-13T18:35:21.519 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:21 smithi149 podman[90216]: 2024-09-13 18:35:21.191581014 +0000 UTC m=+0.344951276 container init c6ec97a4d9ff15851d3401caf1c5b00c20968676b20c79fdf983e3a24ce45f6b (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:35:21.520 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:21 smithi149 podman[90216]: 2024-09-13 18:35:21.194763286 +0000 UTC m=+0.348133549 container start c6ec97a4d9ff15851d3401caf1c5b00c20968676b20c79fdf983e3a24ce45f6b (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T18:35:21.520 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:21 smithi149 ceph-osd[90235]: -- 172.21.15.149:0/1888964558 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ad7b6271e0 con 0x55ad7c3a6000 2024-09-13T18:35:21.520 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:21 smithi149 bash[90216]: c6ec97a4d9ff15851d3401caf1c5b00c20968676b20c79fdf983e3a24ce45f6b 2024-09-13T18:35:21.520 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:21 smithi149 systemd[1]: Started Ceph osd.4 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:35:22.019 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:21 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:35:21.730+0000 7f00108f5640 -1 Falling back to public interface 2024-09-13T18:35:22.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:21 smithi149 ceph-mon[76906]: pgmap v166: 65 pgs: 11 active+undersized, 5 peering, 1 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 18/282 objects degraded (6.383%) 2024-09-13T18:35:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:35:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:35:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:21 smithi038 ceph-mon[91522]: pgmap v166: 65 pgs: 11 active+undersized, 5 peering, 1 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 18/282 objects degraded (6.383%) 2024-09-13T18:35:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:35:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:35:22.785 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:22 smithi149 ceph-mon[76906]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-13T18:35:23.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:22 smithi038 ceph-mon[91522]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-13T18:35:24.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:23 smithi149 ceph-mon[76906]: pgmap v167: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s; 45/282 objects degraded (15.957%) 2024-09-13T18:35:24.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:23 smithi038 ceph-mon[91522]: pgmap v167: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s; 45/282 objects degraded (15.957%) 2024-09-13T18:35:25.250 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:25 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:25.250 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:25 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:25.251 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:25 smithi149 ceph-mon[76906]: pgmap v168: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 45/282 objects degraded (15.957%) 2024-09-13T18:35:25.251 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:25 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:25.251 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:25 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:25.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:25 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:25.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:25 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:25.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:25 smithi038 ceph-mon[91522]: pgmap v168: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 45/282 objects degraded (15.957%) 2024-09-13T18:35:25.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:25 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:25.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:25 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:27.020 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:26 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:35:26.896+0000 7f00108f5640 -1 osd.4 83 log_to_monitors true 2024-09-13T18:35:27.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:27 smithi149 ceph-mon[76906]: pgmap v169: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 45/282 objects degraded (15.957%) 2024-09-13T18:35:27.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:27 smithi149 ceph-mon[76906]: from='osd.4 [v2:172.21.15.149:6808/275970326,v1:172.21.15.149:6809/275970326]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:35:27.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:27 smithi149 ceph-mon[76906]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:35:27.770 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:35:27 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:35:27.508+0000 7f000868e640 -1 osd.4 83 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:35:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:27 smithi038 ceph-mon[91522]: pgmap v169: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 206 MiB data, 991 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 45/282 objects degraded (15.957%) 2024-09-13T18:35:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:27 smithi038 ceph-mon[91522]: from='osd.4 [v2:172.21.15.149:6808/275970326,v1:172.21.15.149:6809/275970326]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:35:27.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:27 smithi038 ceph-mon[91522]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T18:35:28.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T18:35:28.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: osdmap e86: 6 total, 5 up, 6 in 2024-09-13T18:35:28.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='osd.4 [v2:172.21.15.149:6808/275970326,v1:172.21.15.149:6809/275970326]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:35:28.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:35:28.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:28.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:28.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:35:28.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:35:28.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:28.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:35:28.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:35:28.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:35:28.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:35:28.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T18:35:28.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T18:35:28.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:28 smithi149 ceph-mon[76906]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-13T18:35:28.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T18:35:28.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: osdmap e86: 6 total, 5 up, 6 in 2024-09-13T18:35:28.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='osd.4 [v2:172.21.15.149:6808/275970326,v1:172.21.15.149:6809/275970326]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:35:28.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:35:28.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:28.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:28.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:35:28.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:35:28.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:28.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:35:28.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:35:28.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:35:28.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:35:28.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T18:35:28.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T18:35:28.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:28 smithi038 ceph-mon[91522]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-13T18:35:29.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:29 smithi149 ceph-mon[76906]: pgmap v171: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 45/282 objects degraded (15.957%) 2024-09-13T18:35:29.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:29 smithi149 ceph-mon[76906]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T18:35:29.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:29 smithi149 ceph-mon[76906]: osd.4 [v2:172.21.15.149:6808/275970326,v1:172.21.15.149:6809/275970326] boot 2024-09-13T18:35:29.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:29 smithi149 ceph-mon[76906]: osdmap e87: 6 total, 6 up, 6 in 2024-09-13T18:35:29.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:29 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:35:29.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:29 smithi149 ceph-mon[76906]: osdmap e88: 6 total, 6 up, 6 in 2024-09-13T18:35:29.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:29 smithi038 ceph-mon[91522]: pgmap v171: 65 pgs: 18 active+undersized, 14 active+undersized+degraded, 33 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 45/282 objects degraded (15.957%) 2024-09-13T18:35:29.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:29 smithi038 ceph-mon[91522]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T18:35:29.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:29 smithi038 ceph-mon[91522]: osd.4 [v2:172.21.15.149:6808/275970326,v1:172.21.15.149:6809/275970326] boot 2024-09-13T18:35:29.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:29 smithi038 ceph-mon[91522]: osdmap e87: 6 total, 6 up, 6 in 2024-09-13T18:35:29.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:29 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T18:35:29.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:29 smithi038 ceph-mon[91522]: osdmap e88: 6 total, 6 up, 6 in 2024-09-13T18:35:30.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:30 smithi038 ceph-mon[91522]: Health check update: Degraded data redundancy: 29/282 objects degraded (10.284%), 8 pgs degraded (PG_DEGRADED) 2024-09-13T18:35:31.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:30 smithi149 ceph-mon[76906]: Health check update: Degraded data redundancy: 29/282 objects degraded (10.284%), 8 pgs degraded (PG_DEGRADED) 2024-09-13T18:35:31.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:31 smithi038 ceph-mon[91522]: pgmap v174: 65 pgs: 14 peering, 10 active+undersized, 8 active+undersized+degraded, 33 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 29/282 objects degraded (10.284%) 2024-09-13T18:35:32.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:31 smithi149 ceph-mon[76906]: pgmap v174: 65 pgs: 14 peering, 10 active+undersized, 8 active+undersized+degraded, 33 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 29/282 objects degraded (10.284%) 2024-09-13T18:35:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:33 smithi038 ceph-mon[91522]: pgmap v175: 65 pgs: 14 peering, 4 active+undersized, 2 active+undersized+degraded, 45 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 3/282 objects degraded (1.064%) 2024-09-13T18:35:34.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:33 smithi149 ceph-mon[76906]: pgmap v175: 65 pgs: 14 peering, 4 active+undersized, 2 active+undersized+degraded, 45 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 3/282 objects degraded (1.064%) 2024-09-13T18:35:35.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:34 smithi149 ceph-mon[76906]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/282 objects degraded (1.064%), 2 pgs degraded) 2024-09-13T18:35:35.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:34 smithi149 ceph-mon[76906]: Cluster is now healthy 2024-09-13T18:35:35.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:34 smithi038 ceph-mon[91522]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/282 objects degraded (1.064%), 2 pgs degraded) 2024-09-13T18:35:35.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:34 smithi038 ceph-mon[91522]: Cluster is now healthy 2024-09-13T18:35:36.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:35 smithi149 ceph-mon[76906]: pgmap v176: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-13T18:35:36.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:35 smithi038 ceph-mon[91522]: pgmap v176: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-13T18:35:37.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:37 smithi038 ceph-mon[91522]: pgmap v177: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-13T18:35:37.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:37 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:37.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:37 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:35:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:37 smithi149 ceph-mon[76906]: pgmap v177: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-13T18:35:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:37 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:38.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:37 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:35:39.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:39 smithi149 ceph-mon[76906]: pgmap v178: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-13T18:35:39.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:39 smithi038 ceph-mon[91522]: pgmap v178: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-13T18:35:41.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:41 smithi038 ceph-mon[91522]: pgmap v179: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-13T18:35:42.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:41 smithi149 ceph-mon[76906]: pgmap v179: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-13T18:35:43.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:42 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:43.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:42 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:43.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.257+0000 7f304ff06640 1 -- 172.21.15.38:0/863501606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3048072f10 msgr2=0x7f3048073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.257+0000 7f304ff06640 1 --2- 172.21.15.38:0/863501606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3048072f10 0x7f3048073370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3038009880 tx=0x7f303802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.257+0000 7f304ff06640 1 -- 172.21.15.38:0/863501606 shutdown_connections 2024-09-13T18:35:43.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.257+0000 7f304ff06640 1 --2- 172.21.15.38:0/863501606 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3048072f10 0x7f3048073370 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.257+0000 7f304ff06640 1 --2- 172.21.15.38:0/863501606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30480744e0 0x7f3048072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.257+0000 7f304ff06640 1 -- 172.21.15.38:0/863501606 >> 172.21.15.38:0/863501606 conn(0x7f30480fb320 msgr2=0x7f30480fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.258+0000 7f304ff06640 1 -- 172.21.15.38:0/863501606 shutdown_connections 2024-09-13T18:35:43.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.258+0000 7f304ff06640 1 -- 172.21.15.38:0/863501606 wait complete. 2024-09-13T18:35:43.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.258+0000 7f304ff06640 1 Processor -- start 2024-09-13T18:35:43.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.258+0000 7f304ff06640 1 -- start start 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.258+0000 7f304ff06640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3048072f10 0x7f304819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.258+0000 7f304ff06640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30480744e0 0x7f304819c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.258+0000 7f304ff06640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304819c630 con 0x7f3048072f10 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.258+0000 7f304ff06640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304819c7a0 con 0x7f30480744e0 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.259+0000 7f304dca2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3048072f10 0x7f304819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.259+0000 7f304dca2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3048072f10 0x7f304819bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48542/0 (socket says 172.21.15.38:48542) 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.259+0000 7f304dca2640 1 -- 172.21.15.38:0/3091371487 learned_addr learned my addr 172.21.15.38:0/3091371487 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.259+0000 7f304d4a1640 1 --2- 172.21.15.38:0/3091371487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30480744e0 0x7f304819c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.259+0000 7f304dca2640 1 -- 172.21.15.38:0/3091371487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30480744e0 msgr2=0x7f304819c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.259+0000 7f304dca2640 1 --2- 172.21.15.38:0/3091371487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30480744e0 0x7f304819c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.259+0000 7f304dca2640 1 -- 172.21.15.38:0/3091371487 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3038009560 con 0x7f3048072f10 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.259+0000 7f304dca2640 1 --2- 172.21.15.38:0/3091371487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3048072f10 0x7f304819bb20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f304400e9a0 tx=0x7f304400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.259+0000 7f303effd640 1 -- 172.21.15.38:0/3091371487 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f304400cc90 con 0x7f3048072f10 2024-09-13T18:35:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.259+0000 7f303effd640 1 -- 172.21.15.38:0/3091371487 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f304400cdf0 con 0x7f3048072f10 2024-09-13T18:35:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.259+0000 7f304ff06640 1 -- 172.21.15.38:0/3091371487 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30481a1240 con 0x7f3048072f10 2024-09-13T18:35:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.259+0000 7f303effd640 1 -- 172.21.15.38:0/3091371487 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3044010430 con 0x7f3048072f10 2024-09-13T18:35:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.260+0000 7f304ff06640 1 -- 172.21.15.38:0/3091371487 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30481a1810 con 0x7f3048072f10 2024-09-13T18:35:43.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.261+0000 7f304ff06640 1 -- 172.21.15.38:0/3091371487 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304810ec70 con 0x7f3048072f10 2024-09-13T18:35:43.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.261+0000 7f303effd640 1 -- 172.21.15.38:0/3091371487 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f30440046c0 con 0x7f3048072f10 2024-09-13T18:35:43.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.262+0000 7f303effd640 1 --2- 172.21.15.38:0/3091371487 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f303406cc60 0x7f303406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.262+0000 7f303effd640 1 -- 172.21.15.38:0/3091371487 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f3044014070 con 0x7f3048072f10 2024-09-13T18:35:43.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.262+0000 7f304d4a1640 1 --2- 172.21.15.38:0/3091371487 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f303406cc60 0x7f303406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.265 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.262+0000 7f304d4a1640 1 --2- 172.21.15.38:0/3091371487 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f303406cc60 0x7f303406f120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f304819d040 tx=0x7f3038031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.266+0000 7f303effd640 1 -- 172.21.15.38:0/3091371487 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3044056a40 con 0x7f3048072f10 2024-09-13T18:35:43.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.453+0000 7f304ff06640 1 -- 172.21.15.38:0/3091371487 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3048102c40 con 0x7f303406cc60 2024-09-13T18:35:43.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.454+0000 7f303effd640 1 -- 172.21.15.38:0/3091371487 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f3048102c40 con 0x7f303406cc60 2024-09-13T18:35:43.458 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.456+0000 7f304ff06640 1 -- 172.21.15.38:0/3091371487 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f303406cc60 msgr2=0x7f303406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.456+0000 7f304ff06640 1 --2- 172.21.15.38:0/3091371487 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f303406cc60 0x7f303406f120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f304819d040 tx=0x7f3038031400 comp rx=0 tx=0).stop 2024-09-13T18:35:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.456+0000 7f304ff06640 1 -- 172.21.15.38:0/3091371487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3048072f10 msgr2=0x7f304819bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.456+0000 7f304ff06640 1 --2- 172.21.15.38:0/3091371487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3048072f10 0x7f304819bb20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f304400e9a0 tx=0x7f304400ee60 comp rx=0 tx=0).stop 2024-09-13T18:35:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.456+0000 7f304ff06640 1 -- 172.21.15.38:0/3091371487 shutdown_connections 2024-09-13T18:35:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.456+0000 7f304ff06640 1 --2- 172.21.15.38:0/3091371487 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f303406cc60 0x7f303406f120 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.456+0000 7f304ff06640 1 --2- 172.21.15.38:0/3091371487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30480744e0 0x7f304819c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.456+0000 7f304ff06640 1 --2- 172.21.15.38:0/3091371487 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3048072f10 0x7f304819bb20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.456+0000 7f304ff06640 1 -- 172.21.15.38:0/3091371487 >> 172.21.15.38:0/3091371487 conn(0x7f30480fb320 msgr2=0x7f3048101520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.456+0000 7f304ff06640 1 -- 172.21.15.38:0/3091371487 shutdown_connections 2024-09-13T18:35:43.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.456+0000 7f304ff06640 1 -- 172.21.15.38:0/3091371487 wait complete. 2024-09-13T18:35:43.467 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:35:43.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.539+0000 7fbf03f4f640 1 -- 172.21.15.38:0/438352919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0feaf0 msgr2=0x7fbefc0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.539+0000 7fbf03f4f640 1 --2- 172.21.15.38:0/438352919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0feaf0 0x7fbefc0feef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009880 tx=0x7fbef802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.539+0000 7fbf03f4f640 1 -- 172.21.15.38:0/438352919 shutdown_connections 2024-09-13T18:35:43.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.539+0000 7fbf03f4f640 1 --2- 172.21.15.38:0/438352919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbefc0ffcf0 0x7fbefc100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.539+0000 7fbf03f4f640 1 --2- 172.21.15.38:0/438352919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0feaf0 0x7fbefc0feef0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.539+0000 7fbf03f4f640 1 -- 172.21.15.38:0/438352919 >> 172.21.15.38:0/438352919 conn(0x7fbefc0fa280 msgr2=0x7fbefc0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.540+0000 7fbf03f4f640 1 -- 172.21.15.38:0/438352919 shutdown_connections 2024-09-13T18:35:43.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.540+0000 7fbf03f4f640 1 -- 172.21.15.38:0/438352919 wait complete. 2024-09-13T18:35:43.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.540+0000 7fbf03f4f640 1 Processor -- start 2024-09-13T18:35:43.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf03f4f640 1 -- start start 2024-09-13T18:35:43.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf03f4f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0feaf0 0x7fbefc195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf03f4f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbefc0ffcf0 0x7fbefc195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf03f4f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc196110 con 0x7fbefc0feaf0 2024-09-13T18:35:43.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf03f4f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc196280 con 0x7fbefc0ffcf0 2024-09-13T18:35:43.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf01ceb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0feaf0 0x7fbefc195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf01ceb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0feaf0 0x7fbefc195600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48562/0 (socket says 172.21.15.38:48562) 2024-09-13T18:35:43.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf01ceb640 1 -- 172.21.15.38:0/3856194308 learned_addr learned my addr 172.21.15.38:0/3856194308 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:43.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf014ea640 1 --2- 172.21.15.38:0/3856194308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbefc0ffcf0 0x7fbefc195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf01ceb640 1 -- 172.21.15.38:0/3856194308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbefc0ffcf0 msgr2=0x7fbefc195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf01ceb640 1 --2- 172.21.15.38:0/3856194308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbefc0ffcf0 0x7fbefc195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf01ceb640 1 -- 172.21.15.38:0/3856194308 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8009560 con 0x7fbefc0feaf0 2024-09-13T18:35:43.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.541+0000 7fbf014ea640 1 --2- 172.21.15.38:0/3856194308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbefc0ffcf0 0x7fbefc195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:43.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.542+0000 7fbf01ceb640 1 --2- 172.21.15.38:0/3856194308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0feaf0 0x7fbefc195600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbef80055a0 tx=0x7fbef80055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.542+0000 7fbef2ffd640 1 -- 172.21.15.38:0/3856194308 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbef8004aa0 con 0x7fbefc0feaf0 2024-09-13T18:35:43.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.542+0000 7fbef2ffd640 1 -- 172.21.15.38:0/3856194308 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbef8005d50 con 0x7fbefc0feaf0 2024-09-13T18:35:43.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.542+0000 7fbf03f4f640 1 -- 172.21.15.38:0/3856194308 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc19acc0 con 0x7fbefc0feaf0 2024-09-13T18:35:43.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.542+0000 7fbef2ffd640 1 -- 172.21.15.38:0/3856194308 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbef8031840 con 0x7fbefc0feaf0 2024-09-13T18:35:43.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.542+0000 7fbf03f4f640 1 -- 172.21.15.38:0/3856194308 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc19b1b0 con 0x7fbefc0feaf0 2024-09-13T18:35:43.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.543+0000 7fbf03f4f640 1 -- 172.21.15.38:0/3856194308 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbefc1086c0 con 0x7fbefc0feaf0 2024-09-13T18:35:43.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.543+0000 7fbef2ffd640 1 -- 172.21.15.38:0/3856194308 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbef8004c00 con 0x7fbefc0feaf0 2024-09-13T18:35:43.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.544+0000 7fbef2ffd640 1 --2- 172.21.15.38:0/3856194308 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbee806cc50 0x7fbee806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.544+0000 7fbef2ffd640 1 -- 172.21.15.38:0/3856194308 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fbef80ad5b0 con 0x7fbefc0feaf0 2024-09-13T18:35:43.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.544+0000 7fbf014ea640 1 --2- 172.21.15.38:0/3856194308 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbee806cc50 0x7fbee806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.548 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.545+0000 7fbf014ea640 1 --2- 172.21.15.38:0/3856194308 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbee806cc50 0x7fbee806f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbefc196b20 tx=0x7fbeec005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.552 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.548+0000 7fbef2ffd640 1 -- 172.21.15.38:0/3856194308 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbef80776f0 con 0x7fbefc0feaf0 2024-09-13T18:35:43.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.743+0000 7fbf03f4f640 1 -- 172.21.15.38:0/3856194308 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbefc104640 con 0x7fbee806cc50 2024-09-13T18:35:43.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.745+0000 7fbef2ffd640 1 -- 172.21.15.38:0/3856194308 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fbefc104640 con 0x7fbee806cc50 2024-09-13T18:35:43.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.747+0000 7fbf03f4f640 1 -- 172.21.15.38:0/3856194308 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbee806cc50 msgr2=0x7fbee806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.747+0000 7fbf03f4f640 1 --2- 172.21.15.38:0/3856194308 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbee806cc50 0x7fbee806f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbefc196b20 tx=0x7fbeec005f90 comp rx=0 tx=0).stop 2024-09-13T18:35:43.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.747+0000 7fbf03f4f640 1 -- 172.21.15.38:0/3856194308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0feaf0 msgr2=0x7fbefc195600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.747+0000 7fbf03f4f640 1 --2- 172.21.15.38:0/3856194308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0feaf0 0x7fbefc195600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbef80055a0 tx=0x7fbef80055d0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.747+0000 7fbf03f4f640 1 -- 172.21.15.38:0/3856194308 shutdown_connections 2024-09-13T18:35:43.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.747+0000 7fbf03f4f640 1 --2- 172.21.15.38:0/3856194308 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbee806cc50 0x7fbee806f110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.747+0000 7fbf03f4f640 1 --2- 172.21.15.38:0/3856194308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbefc0ffcf0 0x7fbefc195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.747+0000 7fbf03f4f640 1 --2- 172.21.15.38:0/3856194308 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbefc0feaf0 0x7fbefc195600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.747+0000 7fbf03f4f640 1 -- 172.21.15.38:0/3856194308 >> 172.21.15.38:0/3856194308 conn(0x7fbefc0fa280 msgr2=0x7fbefc102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.751 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.747+0000 7fbf03f4f640 1 -- 172.21.15.38:0/3856194308 shutdown_connections 2024-09-13T18:35:43.752 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.747+0000 7fbf03f4f640 1 -- 172.21.15.38:0/3856194308 wait complete. 2024-09-13T18:35:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:43 smithi038 ceph-mon[91522]: pgmap v180: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-13T18:35:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T18:35:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:43 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T18:35:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:43 smithi038 ceph-mon[91522]: Upgrade: osd.5 is safe to restart 2024-09-13T18:35:43.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.831+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1632376693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fec1006e0 msgr2=0x7f6fec102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.831+0000 7f6ff0caa640 1 --2- 172.21.15.38:0/1632376693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fec1006e0 0x7f6fec102ad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009880 tx=0x7f6fdc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.831+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1632376693 shutdown_connections 2024-09-13T18:35:43.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.831+0000 7f6ff0caa640 1 --2- 172.21.15.38:0/1632376693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fec103010 0x7f6fec105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.831+0000 7f6ff0caa640 1 --2- 172.21.15.38:0/1632376693 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fec1006e0 0x7f6fec102ad0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.831+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1632376693 >> 172.21.15.38:0/1632376693 conn(0x7f6fec0fa280 msgr2=0x7f6fec0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.831+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1632376693 shutdown_connections 2024-09-13T18:35:43.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.831+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1632376693 wait complete. 2024-09-13T18:35:43.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.832+0000 7f6ff0caa640 1 Processor -- start 2024-09-13T18:35:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.832+0000 7f6ff0caa640 1 -- start start 2024-09-13T18:35:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.832+0000 7f6ff0caa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fec1006e0 0x7f6fec1955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.832+0000 7f6ff0caa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fec103010 0x7f6fec195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.832+0000 7f6ff0caa640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec1960e0 con 0x7f6fec103010 2024-09-13T18:35:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.832+0000 7f6ff0caa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec196250 con 0x7f6fec1006e0 2024-09-13T18:35:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.832+0000 7f6fe9d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fec103010 0x7f6fec195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.832+0000 7f6fe9d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fec103010 0x7f6fec195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48572/0 (socket says 172.21.15.38:48572) 2024-09-13T18:35:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.832+0000 7f6fe9d9b640 1 -- 172.21.15.38:0/1174066253 learned_addr learned my addr 172.21.15.38:0/1174066253 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.832+0000 7f6fea59c640 1 --2- 172.21.15.38:0/1174066253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fec1006e0 0x7f6fec1955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.833+0000 7f6fe9d9b640 1 -- 172.21.15.38:0/1174066253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fec1006e0 msgr2=0x7f6fec1955d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.833+0000 7f6fe9d9b640 1 --2- 172.21.15.38:0/1174066253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fec1006e0 0x7f6fec1955d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.833+0000 7f6fe9d9b640 1 -- 172.21.15.38:0/1174066253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc009560 con 0x7f6fec103010 2024-09-13T18:35:43.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.833+0000 7f6fe9d9b640 1 --2- 172.21.15.38:0/1174066253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fec103010 0x7f6fec195b10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000e9a0 tx=0x7f6fe000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.833+0000 7f6fdb7fe640 1 -- 172.21.15.38:0/1174066253 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe000cc90 con 0x7f6fec103010 2024-09-13T18:35:43.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.833+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1174066253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fec19aca0 con 0x7f6fec103010 2024-09-13T18:35:43.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.833+0000 7f6fdb7fe640 1 -- 172.21.15.38:0/1174066253 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6fe000cdf0 con 0x7f6fec103010 2024-09-13T18:35:43.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.833+0000 7f6fdb7fe640 1 -- 172.21.15.38:0/1174066253 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe0010430 con 0x7f6fec103010 2024-09-13T18:35:43.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.833+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1174066253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fec19b1f0 con 0x7f6fec103010 2024-09-13T18:35:43.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.834+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1174066253 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fec108680 con 0x7f6fec103010 2024-09-13T18:35:43.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.835+0000 7f6fdb7fe640 1 -- 172.21.15.38:0/1174066253 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6fe00046c0 con 0x7f6fec103010 2024-09-13T18:35:43.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.835+0000 7f6fdb7fe640 1 --2- 172.21.15.38:0/1174066253 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6fd406cc50 0x7f6fd406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.835+0000 7f6fdb7fe640 1 -- 172.21.15.38:0/1174066253 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f6fe0014070 con 0x7f6fec103010 2024-09-13T18:35:43.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.835+0000 7f6fea59c640 1 --2- 172.21.15.38:0/1174066253 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6fd406cc50 0x7f6fd406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.836+0000 7f6fea59c640 1 --2- 172.21.15.38:0/1174066253 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6fd406cc50 0x7f6fd406f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc000c00 tx=0x7f6fdc031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.843 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:43.839+0000 7f6fdb7fe640 1 -- 172.21.15.38:0/1174066253 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6fe0056b20 con 0x7f6fec103010 2024-09-13T18:35:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:43 smithi149 ceph-mon[76906]: pgmap v180: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-13T18:35:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T18:35:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:43 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T18:35:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:43 smithi149 ceph-mon[76906]: Upgrade: osd.5 is safe to restart 2024-09-13T18:35:44.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.021+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1174066253 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fec103ab0 con 0x7f6fd406cc50 2024-09-13T18:35:44.033 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.030+0000 7f6fdb7fe640 1 -- 172.21.15.38:0/1174066253 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f6fec103ab0 con 0x7f6fd406cc50 2024-09-13T18:35:44.034 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:35:44.034 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (11m) 82s ago 13m 24.1M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:35:44.034 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (13m) 82s ago 13m 8350k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:35:44.034 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (12m) 19s ago 12m 8170k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:35:44.034 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (3m) 82s ago 13m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:35:44.034 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (2m) 19s ago 12m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:35:44.034 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (11m) 82s ago 13m 87.8M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:35:44.034 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (7m) 82s ago 7m 156M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:35:44.034 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (7m) 82s ago 7m 98.3M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:35:44.034 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (7m) 19s ago 7m 25.5M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:35:44.034 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (7m) 19s ago 7m 25.5M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (4m) 82s ago 14m 491M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (3m) 19s ago 12m 440M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (3m) 82s ago 14m 47.4M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (3m) 19s ago 12m 39.9M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (13m) 82s ago 13m 15.3M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (12m) 19s ago 12m 15.3M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (2m) 82s ago 11m 131M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (2m) 82s ago 11m 95.5M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 b2f99a2919b9 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (87s) 82s ago 10m 11.2M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 090af670cd3d 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (54s) 19s ago 10m 105M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 e4321b085347 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (23s) 19s ago 9m 14.3M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 c6ec97a4d9ff 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (9m) 19s ago 9m 260M 4096M 18.2.4-845-ge4e227b3 67ddd33fa72f f4846885d8ca 2024-09-13T18:35:44.035 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (3m) 82s ago 12m 60.7M - 2.43.0 a07b618ecd1d c04b1dcdc8c3 2024-09-13T18:35:44.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.032+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1174066253 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6fd406cc50 msgr2=0x7f6fd406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.032+0000 7f6ff0caa640 1 --2- 172.21.15.38:0/1174066253 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6fd406cc50 0x7f6fd406f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc000c00 tx=0x7f6fdc031400 comp rx=0 tx=0).stop 2024-09-13T18:35:44.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.032+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1174066253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fec103010 msgr2=0x7f6fec195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.032+0000 7f6ff0caa640 1 --2- 172.21.15.38:0/1174066253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fec103010 0x7f6fec195b10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000e9a0 tx=0x7f6fe000ee60 comp rx=0 tx=0).stop 2024-09-13T18:35:44.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.032+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1174066253 shutdown_connections 2024-09-13T18:35:44.036 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.032+0000 7f6ff0caa640 1 --2- 172.21.15.38:0/1174066253 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6fec103010 0x7f6fec195b10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.032+0000 7f6ff0caa640 1 --2- 172.21.15.38:0/1174066253 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6fd406cc50 0x7f6fd406f110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.032+0000 7f6ff0caa640 1 --2- 172.21.15.38:0/1174066253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fec1006e0 0x7f6fec1955d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.032+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1174066253 >> 172.21.15.38:0/1174066253 conn(0x7f6fec0fa280 msgr2=0x7f6fec0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.032+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1174066253 shutdown_connections 2024-09-13T18:35:44.037 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.032+0000 7f6ff0caa640 1 -- 172.21.15.38:0/1174066253 wait complete. 2024-09-13T18:35:44.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.116+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/3007582728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb540ffb90 msgr2=0x7fcb540fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.116+0000 7fcb5b5a1640 1 --2- 172.21.15.38:0/3007582728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb540ffb90 0x7fcb540fff90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009880 tx=0x7fcb5002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.116+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/3007582728 shutdown_connections 2024-09-13T18:35:44.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.116+0000 7fcb5b5a1640 1 --2- 172.21.15.38:0/3007582728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb54100d90 0x7fcb54101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.116+0000 7fcb5b5a1640 1 --2- 172.21.15.38:0/3007582728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb540ffb90 0x7fcb540fff90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.116+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/3007582728 >> 172.21.15.38:0/3007582728 conn(0x7fcb540fb320 msgr2=0x7fcb540fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.116+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/3007582728 shutdown_connections 2024-09-13T18:35:44.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.116+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/3007582728 wait complete. 2024-09-13T18:35:44.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.117+0000 7fcb5b5a1640 1 Processor -- start 2024-09-13T18:35:44.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.117+0000 7fcb5b5a1640 1 -- start start 2024-09-13T18:35:44.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.117+0000 7fcb5b5a1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb540ffb90 0x7fcb54195500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.117+0000 7fcb5b5a1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb54100d90 0x7fcb54195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.117+0000 7fcb5b5a1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb54196010 con 0x7fcb540ffb90 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.117+0000 7fcb5b5a1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb54196180 con 0x7fcb54100d90 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.117+0000 7fcb5933d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb540ffb90 0x7fcb54195500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.117+0000 7fcb5933d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb540ffb90 0x7fcb54195500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48598/0 (socket says 172.21.15.38:48598) 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.117+0000 7fcb5933d640 1 -- 172.21.15.38:0/276964901 learned_addr learned my addr 172.21.15.38:0/276964901 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.117+0000 7fcb58b3c640 1 --2- 172.21.15.38:0/276964901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb54100d90 0x7fcb54195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.118+0000 7fcb5933d640 1 -- 172.21.15.38:0/276964901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb54100d90 msgr2=0x7fcb54195a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.118+0000 7fcb5933d640 1 --2- 172.21.15.38:0/276964901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb54100d90 0x7fcb54195a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.118+0000 7fcb5933d640 1 -- 172.21.15.38:0/276964901 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb50009560 con 0x7fcb540ffb90 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.118+0000 7fcb5933d640 1 --2- 172.21.15.38:0/276964901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb540ffb90 0x7fcb54195500 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcb500055a0 tx=0x7fcb500055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.118+0000 7fcb4a7fc640 1 -- 172.21.15.38:0/276964901 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb50004aa0 con 0x7fcb540ffb90 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.118+0000 7fcb4a7fc640 1 -- 172.21.15.38:0/276964901 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb50005d50 con 0x7fcb540ffb90 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.118+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/276964901 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5419abc0 con 0x7fcb540ffb90 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.118+0000 7fcb4a7fc640 1 -- 172.21.15.38:0/276964901 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb50031840 con 0x7fcb540ffb90 2024-09-13T18:35:44.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.118+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/276964901 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5419b0b0 con 0x7fcb540ffb90 2024-09-13T18:35:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.119+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/276964901 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5418f5d0 con 0x7fcb540ffb90 2024-09-13T18:35:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.120+0000 7fcb4a7fc640 1 -- 172.21.15.38:0/276964901 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcb50004c00 con 0x7fcb540ffb90 2024-09-13T18:35:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.121+0000 7fcb4a7fc640 1 --2- 172.21.15.38:0/276964901 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcb4006cc50 0x7fcb4006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.121+0000 7fcb4a7fc640 1 -- 172.21.15.38:0/276964901 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fcb500ad670 con 0x7fcb540ffb90 2024-09-13T18:35:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.121+0000 7fcb58b3c640 1 --2- 172.21.15.38:0/276964901 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcb4006cc50 0x7fcb4006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.125 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.121+0000 7fcb58b3c640 1 --2- 172.21.15.38:0/276964901 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcb4006cc50 0x7fcb4006f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb54196a20 tx=0x7fcb44005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.128 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.125+0000 7fcb4a7fc640 1 -- 172.21.15.38:0/276964901 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcb50077730 con 0x7fcb540ffb90 2024-09-13T18:35:44.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.371+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/276964901 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb5402c560 con 0x7fcb540ffb90 2024-09-13T18:35:44.375 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.372+0000 7fcb4a7fc640 1 -- 172.21.15.38:0/276964901 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fcb5007ad50 con 0x7fcb540ffb90 2024-09-13T18:35:44.375 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:35:44.375 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 1, 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 5 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:35:44.376 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:35:44.377 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 5, 2024-09-13T18:35:44.377 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 9 2024-09-13T18:35:44.377 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:35:44.377 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:35:44.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.374+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/276964901 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcb4006cc50 msgr2=0x7fcb4006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.374+0000 7fcb5b5a1640 1 --2- 172.21.15.38:0/276964901 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcb4006cc50 0x7fcb4006f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb54196a20 tx=0x7fcb44005f90 comp rx=0 tx=0).stop 2024-09-13T18:35:44.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.374+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/276964901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb540ffb90 msgr2=0x7fcb54195500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.374+0000 7fcb5b5a1640 1 --2- 172.21.15.38:0/276964901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb540ffb90 0x7fcb54195500 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcb500055a0 tx=0x7fcb500055d0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.374+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/276964901 shutdown_connections 2024-09-13T18:35:44.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.374+0000 7fcb5b5a1640 1 --2- 172.21.15.38:0/276964901 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcb4006cc50 0x7fcb4006f110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.374+0000 7fcb5b5a1640 1 --2- 172.21.15.38:0/276964901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb54100d90 0x7fcb54195a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.374+0000 7fcb5b5a1640 1 --2- 172.21.15.38:0/276964901 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb540ffb90 0x7fcb54195500 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.374+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/276964901 >> 172.21.15.38:0/276964901 conn(0x7fcb540fb320 msgr2=0x7fcb541044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.374+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/276964901 shutdown_connections 2024-09-13T18:35:44.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.374+0000 7fcb5b5a1640 1 -- 172.21.15.38:0/276964901 wait complete. 2024-09-13T18:35:44.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.457+0000 7f9d1716e640 1 -- 172.21.15.38:0/359596784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d10100d80 msgr2=0x7f9d10101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.457+0000 7f9d1716e640 1 --2- 172.21.15.38:0/359596784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d10100d80 0x7f9d10101200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009880 tx=0x7f9cf802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.458+0000 7f9d1716e640 1 -- 172.21.15.38:0/359596784 shutdown_connections 2024-09-13T18:35:44.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.458+0000 7f9d1716e640 1 --2- 172.21.15.38:0/359596784 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d10100d80 0x7f9d10101200 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.458+0000 7f9d1716e640 1 --2- 172.21.15.38:0/359596784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d100ffb80 0x7f9d100fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.458+0000 7f9d1716e640 1 -- 172.21.15.38:0/359596784 >> 172.21.15.38:0/359596784 conn(0x7f9d100fb330 msgr2=0x7f9d100fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.458+0000 7f9d1716e640 1 -- 172.21.15.38:0/359596784 shutdown_connections 2024-09-13T18:35:44.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.458+0000 7f9d1716e640 1 -- 172.21.15.38:0/359596784 wait complete. 2024-09-13T18:35:44.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.458+0000 7f9d1716e640 1 Processor -- start 2024-09-13T18:35:44.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.458+0000 7f9d1716e640 1 -- start start 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.458+0000 7f9d1716e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d100ffb80 0x7f9d10195520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d1716e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d10100d80 0x7f9d10195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d1716e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10195fa0 con 0x7f9d100ffb80 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d1716e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10196110 con 0x7f9d10100d80 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d14f0a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d100ffb80 0x7f9d10195520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d14f0a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d100ffb80 0x7f9d10195520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48620/0 (socket says 172.21.15.38:48620) 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d14f0a640 1 -- 172.21.15.38:0/3318679398 learned_addr learned my addr 172.21.15.38:0/3318679398 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d0ffff640 1 --2- 172.21.15.38:0/3318679398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d10100d80 0x7f9d10195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d14f0a640 1 -- 172.21.15.38:0/3318679398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d10100d80 msgr2=0x7f9d10195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d14f0a640 1 --2- 172.21.15.38:0/3318679398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d10100d80 0x7f9d10195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d14f0a640 1 -- 172.21.15.38:0/3318679398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf8009560 con 0x7f9d100ffb80 2024-09-13T18:35:44.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d14f0a640 1 --2- 172.21.15.38:0/3318679398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d100ffb80 0x7f9d10195520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000cc30 tx=0x7f9d0000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d0dffb640 1 -- 172.21.15.38:0/3318679398 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d00003b40 con 0x7f9d100ffb80 2024-09-13T18:35:44.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d1716e640 1 -- 172.21.15.38:0/3318679398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1019abf0 con 0x7f9d100ffb80 2024-09-13T18:35:44.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d0dffb640 1 -- 172.21.15.38:0/3318679398 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9d0000ce70 con 0x7f9d100ffb80 2024-09-13T18:35:44.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.459+0000 7f9d0dffb640 1 -- 172.21.15.38:0/3318679398 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d0000f640 con 0x7f9d100ffb80 2024-09-13T18:35:44.465 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.460+0000 7f9d1716e640 1 -- 172.21.15.38:0/3318679398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1019b0f0 con 0x7f9d100ffb80 2024-09-13T18:35:44.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.461+0000 7f9d1716e640 1 -- 172.21.15.38:0/3318679398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d10108630 con 0x7f9d100ffb80 2024-09-13T18:35:44.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.461+0000 7f9d0dffb640 1 -- 172.21.15.38:0/3318679398 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9d00004000 con 0x7f9d100ffb80 2024-09-13T18:35:44.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.461+0000 7f9d0dffb640 1 --2- 172.21.15.38:0/3318679398 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9cfc06cc50 0x7f9cfc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.462+0000 7f9d0dffb640 1 -- 172.21.15.38:0/3318679398 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f9d0008c8e0 con 0x7f9d100ffb80 2024-09-13T18:35:44.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.462+0000 7f9d0ffff640 1 --2- 172.21.15.38:0/3318679398 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9cfc06cc50 0x7f9cfc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.466 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.462+0000 7f9d0ffff640 1 --2- 172.21.15.38:0/3318679398 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9cfc06cc50 0x7f9cfc06f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d10196a40 tx=0x7f9cf8031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.469 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.466+0000 7f9d0dffb640 1 -- 172.21.15.38:0/3318679398 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9d000568f0 con 0x7f9d100ffb80 2024-09-13T18:35:44.663 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:44 smithi149 ceph-mon[76906]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:44.663 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:44 smithi149 ceph-mon[76906]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:44.663 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:44 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:44.663 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:44 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T18:35:44.664 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:44 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:35:44.664 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:44 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/276964901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:35:44.677 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.674+0000 7f9d1716e640 1 -- 172.21.15.38:0/3318679398 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9d1019b340 con 0x7f9d100ffb80 2024-09-13T18:35:44.678 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:44 smithi038 ceph-mon[91522]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:44.678 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:44 smithi038 ceph-mon[91522]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:44.678 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:44 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:44.678 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:44 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T18:35:44.678 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:44 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:35:44.678 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:44 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/276964901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:35:44.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.674+0000 7f9d0dffb640 1 -- 172.21.15.38:0/3318679398 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1870 (secure 0 0 0) 0x7f9d00059f10 con 0x7f9d100ffb80 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout:e18 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 18 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:28:03.378050+0000 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:35:44.679 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 47 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:35:44.680 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:35:44.681 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:35:44.681 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:35:44.681 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:35:44.681 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:35:44.681 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:35:44.681 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:35:44.681 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:35:44.681 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:14492} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/4022520279,v1:172.21.15.38:6827/4022520279] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:35:44.681 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:35:44.681 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:24283} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.149:6826/3095156708,v1:172.21.15.149:6827/3095156708] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:35:44.681 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:35:44.681 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:35:44.682 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 18 2024-09-13T18:35:44.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.676+0000 7f9d1716e640 1 -- 172.21.15.38:0/3318679398 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9cfc06cc50 msgr2=0x7f9cfc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.676+0000 7f9d1716e640 1 --2- 172.21.15.38:0/3318679398 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9cfc06cc50 0x7f9cfc06f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d10196a40 tx=0x7f9cf8031400 comp rx=0 tx=0).stop 2024-09-13T18:35:44.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.676+0000 7f9d1716e640 1 -- 172.21.15.38:0/3318679398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d100ffb80 msgr2=0x7f9d10195520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.676+0000 7f9d1716e640 1 --2- 172.21.15.38:0/3318679398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d100ffb80 0x7f9d10195520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000cc30 tx=0x7f9d0000a620 comp rx=0 tx=0).stop 2024-09-13T18:35:44.682 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.676+0000 7f9d1716e640 1 -- 172.21.15.38:0/3318679398 shutdown_connections 2024-09-13T18:35:44.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.676+0000 7f9d1716e640 1 --2- 172.21.15.38:0/3318679398 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9cfc06cc50 0x7f9cfc06f110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.676+0000 7f9d1716e640 1 --2- 172.21.15.38:0/3318679398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d10100d80 0x7f9d10195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.676+0000 7f9d1716e640 1 --2- 172.21.15.38:0/3318679398 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9d100ffb80 0x7f9d10195520 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.676+0000 7f9d1716e640 1 -- 172.21.15.38:0/3318679398 >> 172.21.15.38:0/3318679398 conn(0x7f9d100fb330 msgr2=0x7f9d10103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.676+0000 7f9d1716e640 1 -- 172.21.15.38:0/3318679398 shutdown_connections 2024-09-13T18:35:44.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.676+0000 7f9d1716e640 1 -- 172.21.15.38:0/3318679398 wait complete. 2024-09-13T18:35:44.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.761+0000 7fd319e69640 1 -- 172.21.15.38:0/3417816594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd314100630 msgr2=0x7fd314102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.761+0000 7fd319e69640 1 --2- 172.21.15.38:0/3417816594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd314100630 0x7fd314102a20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd3040098b0 tx=0x7fd30402a4d0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.761+0000 7fd319e69640 1 -- 172.21.15.38:0/3417816594 shutdown_connections 2024-09-13T18:35:44.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.761+0000 7fd319e69640 1 --2- 172.21.15.38:0/3417816594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314102f60 0x7fd314105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.767 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.761+0000 7fd319e69640 1 --2- 172.21.15.38:0/3417816594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd314100630 0x7fd314102a20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.761+0000 7fd319e69640 1 -- 172.21.15.38:0/3417816594 >> 172.21.15.38:0/3417816594 conn(0x7fd3140fa250 msgr2=0x7fd3140fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.761+0000 7fd319e69640 1 -- 172.21.15.38:0/3417816594 shutdown_connections 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.761+0000 7fd319e69640 1 -- 172.21.15.38:0/3417816594 wait complete. 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.762+0000 7fd319e69640 1 Processor -- start 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.762+0000 7fd319e69640 1 -- start start 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.762+0000 7fd319e69640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314100630 0x7fd314195560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.762+0000 7fd319e69640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd314102f60 0x7fd314195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.762+0000 7fd319e69640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd314196070 con 0x7fd314102f60 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.762+0000 7fd319e69640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3141961e0 con 0x7fd314100630 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.762+0000 7fd312ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd314102f60 0x7fd314195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.762+0000 7fd312ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd314102f60 0x7fd314195aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48648/0 (socket says 172.21.15.38:48648) 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.762+0000 7fd312ffd640 1 -- 172.21.15.38:0/2960996070 learned_addr learned my addr 172.21.15.38:0/2960996070 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:44.768 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.762+0000 7fd3137fe640 1 --2- 172.21.15.38:0/2960996070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314100630 0x7fd314195560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.763+0000 7fd312ffd640 1 -- 172.21.15.38:0/2960996070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314100630 msgr2=0x7fd314195560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.763+0000 7fd312ffd640 1 --2- 172.21.15.38:0/2960996070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314100630 0x7fd314195560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.763+0000 7fd312ffd640 1 -- 172.21.15.38:0/2960996070 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd304009560 con 0x7fd314102f60 2024-09-13T18:35:44.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.763+0000 7fd312ffd640 1 --2- 172.21.15.38:0/2960996070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd314102f60 0x7fd314195aa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd30800c920 tx=0x7fd30800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.763+0000 7fd310ff9640 1 -- 172.21.15.38:0/2960996070 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd308007b80 con 0x7fd314102f60 2024-09-13T18:35:44.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.763+0000 7fd319e69640 1 -- 172.21.15.38:0/2960996070 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31419ac80 con 0x7fd314102f60 2024-09-13T18:35:44.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.763+0000 7fd310ff9640 1 -- 172.21.15.38:0/2960996070 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd308007ce0 con 0x7fd314102f60 2024-09-13T18:35:44.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.763+0000 7fd310ff9640 1 -- 172.21.15.38:0/2960996070 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd30800f450 con 0x7fd314102f60 2024-09-13T18:35:44.769 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.763+0000 7fd319e69640 1 -- 172.21.15.38:0/2960996070 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31419b250 con 0x7fd314102f60 2024-09-13T18:35:44.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.764+0000 7fd319e69640 1 -- 172.21.15.38:0/2960996070 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd314108680 con 0x7fd314102f60 2024-09-13T18:35:44.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.764+0000 7fd310ff9640 1 -- 172.21.15.38:0/2960996070 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd3080046c0 con 0x7fd314102f60 2024-09-13T18:35:44.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.765+0000 7fd310ff9640 1 --2- 172.21.15.38:0/2960996070 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2fc06cc50 0x7fd2fc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.765+0000 7fd310ff9640 1 -- 172.21.15.38:0/2960996070 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fd30808c260 con 0x7fd314102f60 2024-09-13T18:35:44.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.765+0000 7fd3137fe640 1 --2- 172.21.15.38:0/2960996070 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2fc06cc50 0x7fd2fc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.770 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.766+0000 7fd3137fe640 1 --2- 172.21.15.38:0/2960996070 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2fc06cc50 0x7fd2fc06f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd304000c00 tx=0x7fd304031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.769+0000 7fd310ff9640 1 -- 172.21.15.38:0/2960996070 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd3080563a0 con 0x7fd314102f60 2024-09-13T18:35:44.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.957+0000 7fd319e69640 1 -- 172.21.15.38:0/2960996070 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3141039e0 con 0x7fd2fc06cc50 2024-09-13T18:35:44.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.959+0000 7fd310ff9640 1 -- 172.21.15.38:0/2960996070 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd3141039e0 con 0x7fd2fc06cc50 2024-09-13T18:35:44.962 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:35:44.962 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:35:44.962 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:35:44.962 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:35:44.962 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:35:44.962 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr", 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi038.stdout: "mon" 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "11/23 daemons upgraded", 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:35:44.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.961+0000 7fd319e69640 1 -- 172.21.15.38:0/2960996070 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2fc06cc50 msgr2=0x7fd2fc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.961+0000 7fd319e69640 1 --2- 172.21.15.38:0/2960996070 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2fc06cc50 0x7fd2fc06f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd304000c00 tx=0x7fd304031400 comp rx=0 tx=0).stop 2024-09-13T18:35:44.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.961+0000 7fd319e69640 1 -- 172.21.15.38:0/2960996070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd314102f60 msgr2=0x7fd314195aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.961+0000 7fd319e69640 1 --2- 172.21.15.38:0/2960996070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd314102f60 0x7fd314195aa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd30800c920 tx=0x7fd30800cde0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.961+0000 7fd319e69640 1 -- 172.21.15.38:0/2960996070 shutdown_connections 2024-09-13T18:35:44.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.961+0000 7fd319e69640 1 --2- 172.21.15.38:0/2960996070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd314102f60 0x7fd314195aa0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.961+0000 7fd319e69640 1 --2- 172.21.15.38:0/2960996070 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd2fc06cc50 0x7fd2fc06f110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.961+0000 7fd319e69640 1 --2- 172.21.15.38:0/2960996070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd314100630 0x7fd314195560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.961+0000 7fd319e69640 1 -- 172.21.15.38:0/2960996070 >> 172.21.15.38:0/2960996070 conn(0x7fd3140fa250 msgr2=0x7fd3140fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.961+0000 7fd319e69640 1 -- 172.21.15.38:0/2960996070 shutdown_connections 2024-09-13T18:35:44.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:44.961+0000 7fd319e69640 1 -- 172.21.15.38:0/2960996070 wait complete. 2024-09-13T18:35:45.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.045+0000 7fdaa6527640 1 -- 172.21.15.38:0/975740641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa00ffcf0 msgr2=0x7fdaa0100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.045+0000 7fdaa6527640 1 --2- 172.21.15.38:0/975740641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa00ffcf0 0x7fdaa0100170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda94009880 tx=0x7fda9402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.045+0000 7fdaa6527640 1 -- 172.21.15.38:0/975740641 shutdown_connections 2024-09-13T18:35:45.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.045+0000 7fdaa6527640 1 --2- 172.21.15.38:0/975740641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa00ffcf0 0x7fdaa0100170 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.045+0000 7fdaa6527640 1 --2- 172.21.15.38:0/975740641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdaa00feaf0 0x7fdaa00feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.045+0000 7fdaa6527640 1 -- 172.21.15.38:0/975740641 >> 172.21.15.38:0/975740641 conn(0x7fdaa00fa280 msgr2=0x7fdaa00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:45.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.045+0000 7fdaa6527640 1 -- 172.21.15.38:0/975740641 shutdown_connections 2024-09-13T18:35:45.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.045+0000 7fdaa6527640 1 -- 172.21.15.38:0/975740641 wait complete. 2024-09-13T18:35:45.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.045+0000 7fdaa6527640 1 Processor -- start 2024-09-13T18:35:45.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fdaa6527640 1 -- start start 2024-09-13T18:35:45.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fdaa6527640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa00feaf0 0x7fdaa01955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fdaa6527640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdaa00ffcf0 0x7fdaa0195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fdaa6527640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa01960b0 con 0x7fdaa00feaf0 2024-09-13T18:35:45.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fdaa6527640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0196220 con 0x7fdaa00ffcf0 2024-09-13T18:35:45.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fda9ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa00feaf0 0x7fdaa01955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fda9ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa00feaf0 0x7fdaa01955a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48666/0 (socket says 172.21.15.38:48666) 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fda9ffff640 1 -- 172.21.15.38:0/3661324897 learned_addr learned my addr 172.21.15.38:0/3661324897 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fda9f7fe640 1 --2- 172.21.15.38:0/3661324897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdaa00ffcf0 0x7fdaa0195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fda9ffff640 1 -- 172.21.15.38:0/3661324897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdaa00ffcf0 msgr2=0x7fdaa0195ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fda9ffff640 1 --2- 172.21.15.38:0/3661324897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdaa00ffcf0 0x7fdaa0195ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fda9ffff640 1 -- 172.21.15.38:0/3661324897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94009560 con 0x7fdaa00feaf0 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fda9f7fe640 1 --2- 172.21.15.38:0/3661324897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdaa00ffcf0 0x7fdaa0195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.046+0000 7fda9ffff640 1 --2- 172.21.15.38:0/3661324897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa00feaf0 0x7fdaa01955a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda9000e970 tx=0x7fda9000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.047+0000 7fda9d7fa640 1 -- 172.21.15.38:0/3661324897 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda900096e0 con 0x7fdaa00feaf0 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.047+0000 7fda9d7fa640 1 -- 172.21.15.38:0/3661324897 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda900044d0 con 0x7fdaa00feaf0 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.047+0000 7fdaa6527640 1 -- 172.21.15.38:0/3661324897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa019acc0 con 0x7fdaa00feaf0 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.047+0000 7fda9d7fa640 1 -- 172.21.15.38:0/3661324897 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda90003e70 con 0x7fdaa00feaf0 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.047+0000 7fdaa6527640 1 -- 172.21.15.38:0/3661324897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa019b1c0 con 0x7fdaa00feaf0 2024-09-13T18:35:45.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.048+0000 7fdaa6527640 1 -- 172.21.15.38:0/3661324897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa01075c0 con 0x7fdaa00feaf0 2024-09-13T18:35:45.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.048+0000 7fda9d7fa640 1 -- 172.21.15.38:0/3661324897 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fda9000cc90 con 0x7fdaa00feaf0 2024-09-13T18:35:45.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.049+0000 7fda9d7fa640 1 --2- 172.21.15.38:0/3661324897 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fda8806cc50 0x7fda8806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.049+0000 7fda9d7fa640 1 -- 172.21.15.38:0/3661324897 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fda90014070 con 0x7fdaa00feaf0 2024-09-13T18:35:45.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.049+0000 7fda9f7fe640 1 --2- 172.21.15.38:0/3661324897 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fda8806cc50 0x7fda8806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.050+0000 7fda9f7fe640 1 --2- 172.21.15.38:0/3661324897 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fda8806cc50 0x7fda8806f110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0196ac0 tx=0x7fda94031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.053+0000 7fda9d7fa640 1 -- 172.21.15.38:0/3661324897 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fda90056c10 con 0x7fdaa00feaf0 2024-09-13T18:35:45.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.302+0000 7fdaa6527640 1 -- 172.21.15.38:0/3661324897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdaa01077c0 con 0x7fdaa00feaf0 2024-09-13T18:35:45.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.303+0000 7fda9d7fa640 1 -- 172.21.15.38:0/3661324897 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fda9005a230 con 0x7fdaa00feaf0 2024-09-13T18:35:45.306 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:35:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.306+0000 7fdaa6527640 1 -- 172.21.15.38:0/3661324897 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fda8806cc50 msgr2=0x7fda8806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.306+0000 7fdaa6527640 1 --2- 172.21.15.38:0/3661324897 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fda8806cc50 0x7fda8806f110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0196ac0 tx=0x7fda94031400 comp rx=0 tx=0).stop 2024-09-13T18:35:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.306+0000 7fdaa6527640 1 -- 172.21.15.38:0/3661324897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa00feaf0 msgr2=0x7fdaa01955a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.306+0000 7fdaa6527640 1 --2- 172.21.15.38:0/3661324897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa00feaf0 0x7fdaa01955a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda9000e970 tx=0x7fda9000ee30 comp rx=0 tx=0).stop 2024-09-13T18:35:45.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.306+0000 7fdaa6527640 1 -- 172.21.15.38:0/3661324897 shutdown_connections 2024-09-13T18:35:45.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.306+0000 7fdaa6527640 1 --2- 172.21.15.38:0/3661324897 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fda8806cc50 0x7fda8806f110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.306+0000 7fdaa6527640 1 --2- 172.21.15.38:0/3661324897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdaa00ffcf0 0x7fdaa0195ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.306+0000 7fdaa6527640 1 --2- 172.21.15.38:0/3661324897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdaa00feaf0 0x7fdaa01955a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.306+0000 7fdaa6527640 1 -- 172.21.15.38:0/3661324897 >> 172.21.15.38:0/3661324897 conn(0x7fdaa00fa280 msgr2=0x7fdaa00fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:45.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.306+0000 7fdaa6527640 1 -- 172.21.15.38:0/3661324897 shutdown_connections 2024-09-13T18:35:45.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:35:45.306+0000 7fdaa6527640 1 -- 172.21.15.38:0/3661324897 wait complete. 2024-09-13T18:35:45.744 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:45 smithi149 ceph-mon[76906]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:45.745 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:45 smithi149 ceph-mon[76906]: Upgrade: Updating osd.5 2024-09-13T18:35:45.745 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:45 smithi149 ceph-mon[76906]: Deploying daemon osd.5 on smithi149 2024-09-13T18:35:45.745 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:45 smithi149 ceph-mon[76906]: pgmap v181: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-13T18:35:45.745 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:45 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3318679398' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:35:45.745 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:45 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3661324897' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:35:46.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:45 smithi038 ceph-mon[91522]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:46.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:45 smithi038 ceph-mon[91522]: Upgrade: Updating osd.5 2024-09-13T18:35:46.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:45 smithi038 ceph-mon[91522]: Deploying daemon osd.5 on smithi149 2024-09-13T18:35:46.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:45 smithi038 ceph-mon[91522]: pgmap v181: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-13T18:35:46.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:45 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3318679398' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:35:46.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:45 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3661324897' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:35:47.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:46 smithi149 ceph-mon[76906]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:47.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:46 smithi038 ceph-mon[91522]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:35:47.338 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:47 smithi149 systemd[1]: Stopping Ceph osd.5 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:35:47.641 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:47 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[54713]: 2024-09-13T18:35:47.334+0000 7f8971445640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:35:47.642 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:47 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[54713]: 2024-09-13T18:35:47.334+0000 7f8971445640 -1 osd.5 88 *** Got signal Terminated *** 2024-09-13T18:35:47.642 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:47 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[54713]: 2024-09-13T18:35:47.334+0000 7f8971445640 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:35:48.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:47 smithi149 ceph-mon[76906]: pgmap v182: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:35:48.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:47 smithi149 ceph-mon[76906]: osd.5 marked itself down and dead 2024-09-13T18:35:48.086 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:47 smithi038 ceph-mon[91522]: pgmap v182: 65 pgs: 65 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:35:48.086 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:47 smithi038 ceph-mon[91522]: osd.5 marked itself down and dead 2024-09-13T18:35:48.496 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:48 smithi149 podman[94782]: 2024-09-13 18:35:48.193142506 +0000 UTC m=+0.980589584 container died f4846885d8ca5c452a35ac5baf410910001cb80011c40361ffffbc27b8ccdbe2 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=reef-e4e227b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T18:35:48.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:48 smithi149 ceph-mon[76906]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T18:35:48.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:48 smithi149 ceph-mon[76906]: osdmap e89: 6 total, 5 up, 6 in 2024-09-13T18:35:48.770 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:48 smithi149 podman[94782]: 2024-09-13 18:35:48.593778379 +0000 UTC m=+1.381225447 container cleanup f4846885d8ca5c452a35ac5baf410910001cb80011c40361ffffbc27b8ccdbe2 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-e4e227b) 2024-09-13T18:35:48.770 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:48 smithi149 bash[94782]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5 2024-09-13T18:35:49.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:48 smithi038 ceph-mon[91522]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T18:35:49.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:48 smithi038 ceph-mon[91522]: osdmap e89: 6 total, 5 up, 6 in 2024-09-13T18:35:49.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:48 smithi149 podman[94800]: 2024-09-13 18:35:48.878625011 +0000 UTC m=+0.681194720 container remove f4846885d8ca5c452a35ac5baf410910001cb80011c40361ffffbc27b8ccdbe2 (image=quay.ceph.io/ceph-ci/ceph@sha256:94ec087b0651344ea44bf4ca432cec3d5bcba32599243d0588e250fe952c8322, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=reef-e4e227b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-13T18:35:49.550 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:49 smithi149 podman[94886]: 2024-09-13 18:35:49.194440842 +0000 UTC m=+0.015796907 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:35:49.550 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:49 smithi149 podman[94886]: 2024-09-13 18:35:49.295995584 +0000 UTC m=+0.117351648 container create 1584148c928a2306a0100b13441e69283014baf8ee7e22960abc29f4e5c2a51f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T18:35:49.550 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:49 smithi149 podman[94886]: 2024-09-13 18:35:49.548452194 +0000 UTC m=+0.369808259 container init 1584148c928a2306a0100b13441e69283014baf8ee7e22960abc29f4e5c2a51f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:35:50.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:49 smithi149 ceph-mon[76906]: pgmap v184: 65 pgs: 5 peering, 10 stale+active+clean, 50 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:35:50.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:49 smithi149 ceph-mon[76906]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T18:35:50.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:49 smithi149 ceph-mon[76906]: osdmap e90: 6 total, 5 up, 6 in 2024-09-13T18:35:50.020 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:49 smithi149 podman[94886]: 2024-09-13 18:35:49.551949194 +0000 UTC m=+0.373305262 container start 1584148c928a2306a0100b13441e69283014baf8ee7e22960abc29f4e5c2a51f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T18:35:50.020 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:49 smithi149 podman[94886]: 2024-09-13 18:35:49.640030368 +0000 UTC m=+0.461386451 container attach 1584148c928a2306a0100b13441e69283014baf8ee7e22960abc29f4e5c2a51f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T18:35:50.021 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:49 smithi149 podman[94886]: 2024-09-13 18:35:49.741090077 +0000 UTC m=+0.562446146 container died 1584148c928a2306a0100b13441e69283014baf8ee7e22960abc29f4e5c2a51f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:35:50.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:49 smithi038 ceph-mon[91522]: pgmap v184: 65 pgs: 5 peering, 10 stale+active+clean, 50 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:35:50.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:49 smithi038 ceph-mon[91522]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T18:35:50.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:49 smithi038 ceph-mon[91522]: osdmap e90: 6 total, 5 up, 6 in 2024-09-13T18:35:50.697 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:50 smithi149 podman[94908]: 2024-09-13 18:35:50.302078536 +0000 UTC m=+0.555284651 container remove 1584148c928a2306a0100b13441e69283014baf8ee7e22960abc29f4e5c2a51f (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:35:50.697 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:50 smithi149 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-13T18:35:50.697 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:50 smithi149 systemd[1]: Stopped Ceph osd.5 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:35:50.698 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:50 smithi149 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 5.258s CPU time. 2024-09-13T18:35:50.698 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:50 smithi149 systemd[1]: Starting Ceph osd.5 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:35:51.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:50 smithi149 ceph-mon[76906]: Health check failed: Degraded data redundancy: 4/282 objects degraded (1.418%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T18:35:51.020 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:50 smithi149 podman[95008]: 2024-09-13 18:35:50.642766344 +0000 UTC m=+0.015847933 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:35:51.020 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:50 smithi149 podman[95008]: 2024-09-13 18:35:50.76162726 +0000 UTC m=+0.134708843 container create 87c041d3b4e62f8160ed1806b906b7954c3f9632d874fff9c31dd6afe99c88f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:35:51.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:50 smithi038 ceph-mon[91522]: Health check failed: Degraded data redundancy: 4/282 objects degraded (1.418%), 2 pgs degraded (PG_DEGRADED) 2024-09-13T18:35:51.392 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 podman[95008]: 2024-09-13 18:35:51.047426834 +0000 UTC m=+0.420508417 container init 87c041d3b4e62f8160ed1806b906b7954c3f9632d874fff9c31dd6afe99c88f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:35:51.392 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 podman[95008]: 2024-09-13 18:35:51.050970896 +0000 UTC m=+0.424052480 container start 87c041d3b4e62f8160ed1806b906b7954c3f9632d874fff9c31dd6afe99c88f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T18:35:51.392 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 podman[95008]: 2024-09-13 18:35:51.1307669 +0000 UTC m=+0.503848500 container attach 87c041d3b4e62f8160ed1806b906b7954c3f9632d874fff9c31dd6afe99c88f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:35:51.699 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate[95023]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:35:51.699 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 bash[95008]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:35:51.699 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate[95023]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T18:35:51.699 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 bash[95008]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T18:35:51.699 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate[95023]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T18:35:51.699 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 bash[95008]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T18:35:51.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate[95023]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T18:35:51.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 bash[95008]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T18:35:51.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate[95023]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T18:35:51.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 bash[95008]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T18:35:51.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate[95023]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:35:51.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 bash[95008]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:35:51.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate[95023]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T18:35:51.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 bash[95008]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T18:35:51.700 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:51 smithi149 podman[95008]: 2024-09-13 18:35:51.440472548 +0000 UTC m=+0.813554134 container died 87c041d3b4e62f8160ed1806b906b7954c3f9632d874fff9c31dd6afe99c88f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T18:35:52.003 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:51 smithi149 ceph-mon[76906]: pgmap v186: 65 pgs: 6 active+undersized, 5 peering, 7 stale+active+clean, 2 active+undersized+degraded, 45 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 4/282 objects degraded (1.418%) 2024-09-13T18:35:52.003 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:52.003 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:35:52.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:51 smithi038 ceph-mon[91522]: pgmap v186: 65 pgs: 6 active+undersized, 5 peering, 7 stale+active+clean, 2 active+undersized+degraded, 45 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 4/282 objects degraded (1.418%) 2024-09-13T18:35:52.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:52.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:35:52.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:52 smithi149 podman[95145]: 2024-09-13 18:35:52.001380159 +0000 UTC m=+0.554225763 container remove 87c041d3b4e62f8160ed1806b906b7954c3f9632d874fff9c31dd6afe99c88f7 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-activate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T18:35:52.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:52 smithi149 podman[95205]: 2024-09-13 18:35:52.202196818 +0000 UTC m=+0.109556659 container create 6faab71ae8a99b9dc6b17761d9400713563e0d0448912eef615ca3a901cdaacd (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:35:52.270 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:52 smithi149 podman[95205]: 2024-09-13 18:35:52.108937848 +0000 UTC m=+0.016297689 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:35:52.769 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:52 smithi149 podman[95205]: 2024-09-13 18:35:52.479717669 +0000 UTC m=+0.387077514 container init 6faab71ae8a99b9dc6b17761d9400713563e0d0448912eef615ca3a901cdaacd (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:35:52.770 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:52 smithi149 podman[95205]: 2024-09-13 18:35:52.482782715 +0000 UTC m=+0.390142565 container start 6faab71ae8a99b9dc6b17761d9400713563e0d0448912eef615ca3a901cdaacd (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T18:35:52.770 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:52 smithi149 ceph-osd[95224]: -- 172.21.15.149:0/3982055416 <== mon.1 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f98df371e0 con 0x55f98ded5c00 2024-09-13T18:35:52.770 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:52 smithi149 bash[95205]: 6faab71ae8a99b9dc6b17761d9400713563e0d0448912eef615ca3a901cdaacd 2024-09-13T18:35:52.770 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:52 smithi149 systemd[1]: Started Ceph osd.5 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:35:53.281 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:53 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:35:53.026+0000 7f9b82eaa640 -1 Falling back to public interface 2024-09-13T18:35:53.988 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:53 smithi149 ceph-mon[76906]: pgmap v187: 65 pgs: 10 active+undersized, 5 peering, 4 stale+active+clean, 8 active+undersized+degraded, 38 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 27/282 objects degraded (9.574%) 2024-09-13T18:35:53.988 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:53 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:53.988 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:53 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:53.988 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:53 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:35:54.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:53 smithi038 ceph-mon[91522]: pgmap v187: 65 pgs: 10 active+undersized, 5 peering, 4 stale+active+clean, 8 active+undersized+degraded, 38 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 27/282 objects degraded (9.574%) 2024-09-13T18:35:54.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:53 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:54.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:53 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:54.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:53 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:35:54.878 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:54 smithi149 ceph-mon[76906]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-13T18:35:55.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:54 smithi038 ceph-mon[91522]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-13T18:35:55.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:55 smithi038 ceph-mon[91522]: pgmap v188: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 41/282 objects degraded (14.539%) 2024-09-13T18:35:55.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:55 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:55.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:55 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:56.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:55 smithi149 ceph-mon[76906]: pgmap v188: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 41/282 objects degraded (14.539%) 2024-09-13T18:35:56.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:55 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:56.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:55 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:57.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:57.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:57.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:57.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:35:58.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:57 smithi149 ceph-mon[76906]: pgmap v189: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 41/282 objects degraded (14.539%) 2024-09-13T18:35:58.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:57 smithi149 ceph-mon[76906]: from='osd.5 [v2:172.21.15.149:6816/3302600515,v1:172.21.15.149:6817/3302600515]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:35:58.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:57 smithi149 ceph-mon[76906]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:35:58.270 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:57 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:35:57.943+0000 7f9b82eaa640 -1 osd.5 88 log_to_monitors true 2024-09-13T18:35:58.270 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:35:57 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:35:57.980+0000 7f9b7ac43640 -1 osd.5 88 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:35:58.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:57 smithi038 ceph-mon[91522]: pgmap v189: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 929 MiB used, 536 GiB / 536 GiB avail; 41/282 objects degraded (14.539%) 2024-09-13T18:35:58.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:57 smithi038 ceph-mon[91522]: from='osd.5 [v2:172.21.15.149:6816/3302600515,v1:172.21.15.149:6817/3302600515]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:35:58.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:57 smithi038 ceph-mon[91522]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T18:35:59.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:58 smithi149 ceph-mon[76906]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T18:35:59.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:58 smithi149 ceph-mon[76906]: osdmap e91: 6 total, 5 up, 6 in 2024-09-13T18:35:59.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:58 smithi149 ceph-mon[76906]: from='osd.5 [v2:172.21.15.149:6816/3302600515,v1:172.21.15.149:6817/3302600515]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:35:59.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:58 smithi149 ceph-mon[76906]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:35:59.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:58 smithi149 ceph-mon[76906]: pgmap v191: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 41/282 objects degraded (14.539%) 2024-09-13T18:35:59.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:58 smithi038 ceph-mon[91522]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T18:35:59.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:58 smithi038 ceph-mon[91522]: osdmap e91: 6 total, 5 up, 6 in 2024-09-13T18:35:59.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:58 smithi038 ceph-mon[91522]: from='osd.5 [v2:172.21.15.149:6816/3302600515,v1:172.21.15.149:6817/3302600515]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:35:59.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:58 smithi038 ceph-mon[91522]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-09-13T18:35:59.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:58 smithi038 ceph-mon[91522]: pgmap v191: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 41/282 objects degraded (14.539%) 2024-09-13T18:36:00.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T18:36:00.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: osd.5 [v2:172.21.15.149:6816/3302600515,v1:172.21.15.149:6817/3302600515] boot 2024-09-13T18:36:00.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: osdmap e92: 6 total, 6 up, 6 in 2024-09-13T18:36:00.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:36:00.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:00.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:00.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:00.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:00.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: Upgrade: Setting container_image for all osd 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T18:36:00.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T18:36:00.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T18:36:00.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T18:36:00.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T18:36:00.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T18:36:00.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T18:36:00.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T18:36:00.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-13T18:36:00.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:00.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-13T18:36:00.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:35:59 smithi149 ceph-mon[76906]: osdmap e93: 6 total, 6 up, 6 in 2024-09-13T18:36:00.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T18:36:00.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: osd.5 [v2:172.21.15.149:6816/3302600515,v1:172.21.15.149:6817/3302600515] boot 2024-09-13T18:36:00.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: osdmap e92: 6 total, 6 up, 6 in 2024-09-13T18:36:00.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T18:36:00.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:00.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:00.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:00.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:00.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:00.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:00.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: Upgrade: Setting container_image for all osd 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T18:36:00.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T18:36:00.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T18:36:00.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T18:36:00.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T18:36:00.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-13T18:36:00.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:00.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-13T18:36:00.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:35:59 smithi038 ceph-mon[91522]: osdmap e93: 6 total, 6 up, 6 in 2024-09-13T18:36:01.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T18:36:01.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-13T18:36:01.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: fsmap cephfs:2 {0=cephfs.smithi038.dtnkqo=up:active,1=cephfs.smithi149.doanhj=up:active} 2024-09-13T18:36:01.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:01.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:01.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:01.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:01.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: pgmap v194: 65 pgs: 3 peering, 12 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 41/282 objects degraded (14.539%) 2024-09-13T18:36:01.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:01.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.271 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: Upgrade: Scaling down filesystem cephfs 2024-09-13T18:36:01.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:01.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T18:36:01.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: Health check update: Degraded data redundancy: 41/282 objects degraded (14.539%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T18:36:01.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: stopping daemon mds.cephfs.smithi149.doanhj 2024-09-13T18:36:01.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T18:36:01.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: mds.? [v2:172.21.15.149:6826/3061943000,v1:172.21.15.149:6827/3061943000] up:boot 2024-09-13T18:36:01.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: mds.? [v2:172.21.15.38:6826/2694903367,v1:172.21.15.38:6827/2694903367] up:boot 2024-09-13T18:36:01.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T18:36:01.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: fsmap cephfs:2 {0=cephfs.smithi038.dtnkqo=up:active,1=cephfs.smithi149.doanhj=up:stopping} 2 up:standby 2024-09-13T18:36:01.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:36:01.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:36:01.274 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:01.274 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:01.274 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:01.274 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:01.274 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:01.274 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.274 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.275 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.275 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.275 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:00 smithi149 ceph-mon[76906]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T18:36:01.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T18:36:01.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-13T18:36:01.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: fsmap cephfs:2 {0=cephfs.smithi038.dtnkqo=up:active,1=cephfs.smithi149.doanhj=up:active} 2024-09-13T18:36:01.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:01.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: pgmap v194: 65 pgs: 3 peering, 12 active+undersized, 14 active+undersized+degraded, 36 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 41/282 objects degraded (14.539%) 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: Upgrade: Scaling down filesystem cephfs 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: Health check update: Degraded data redundancy: 41/282 objects degraded (14.539%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T18:36:01.333 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: stopping daemon mds.cephfs.smithi149.doanhj 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: mds.? [v2:172.21.15.149:6826/3061943000,v1:172.21.15.149:6827/3061943000] up:boot 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: mds.? [v2:172.21.15.38:6826/2694903367,v1:172.21.15.38:6827/2694903367] up:boot 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: fsmap cephfs:2 {0=cephfs.smithi038.dtnkqo=up:active,1=cephfs.smithi149.doanhj=up:stopping} 2 up:standby 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.334 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.335 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.335 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:01.335 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:00 smithi038 ceph-mon[91522]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T18:36:03.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:02 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:03.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:02 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:04.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:03 smithi149 ceph-mon[76906]: pgmap v195: 65 pgs: 3 peering, 10 active+undersized, 9 active+undersized+degraded, 43 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 23/282 objects degraded (8.156%) 2024-09-13T18:36:04.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:03 smithi038 ceph-mon[91522]: pgmap v195: 65 pgs: 3 peering, 10 active+undersized, 9 active+undersized+degraded, 43 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 23/282 objects degraded (8.156%) 2024-09-13T18:36:05.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:04 smithi149 ceph-mon[76906]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/282 objects degraded (8.156%), 9 pgs degraded) 2024-09-13T18:36:05.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:04 smithi149 ceph-mon[76906]: Cluster is now healthy 2024-09-13T18:36:05.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:04 smithi038 ceph-mon[91522]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/282 objects degraded (8.156%), 9 pgs degraded) 2024-09-13T18:36:05.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:04 smithi038 ceph-mon[91522]: Cluster is now healthy 2024-09-13T18:36:06.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:05 smithi149 ceph-mon[76906]: pgmap v196: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 474 B/s wr, 0 op/s 2024-09-13T18:36:06.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:05 smithi038 ceph-mon[91522]: pgmap v196: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 474 B/s wr, 0 op/s 2024-09-13T18:36:07.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:07 smithi038 ceph-mon[91522]: pgmap v197: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 383 B/s wr, 0 op/s 2024-09-13T18:36:07.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:07.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:36:08.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:07 smithi149 ceph-mon[76906]: pgmap v197: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 383 B/s wr, 0 op/s 2024-09-13T18:36:08.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:08.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:36:09.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:09 smithi038 ceph-mon[91522]: pgmap v198: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 324 B/s wr, 0 op/s 2024-09-13T18:36:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:09 smithi149 ceph-mon[76906]: pgmap v198: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 324 B/s wr, 0 op/s 2024-09-13T18:36:11.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:11 smithi149 ceph-mon[76906]: pgmap v199: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 367 B/s wr, 0 op/s 2024-09-13T18:36:11.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:11 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:11.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:11 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:11.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:11 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:11.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:11 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:11.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:11 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:11.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:11 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:11.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:11 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:11.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:11 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:11.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:11 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:11.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:11 smithi149 ceph-mon[76906]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T18:36:11.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:11 smithi038 ceph-mon[91522]: pgmap v199: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 367 B/s wr, 0 op/s 2024-09-13T18:36:11.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:11 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:11 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:11 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:11 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:11 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:11 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:11 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:11 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:11 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:11.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:11 smithi038 ceph-mon[91522]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T18:36:13.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:12 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:13.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:12 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:13 smithi149 ceph-mon[76906]: pgmap v200: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T18:36:14.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:13 smithi038 ceph-mon[91522]: pgmap v200: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T18:36:15.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.405+0000 7f88fdc21640 1 -- 172.21.15.38:0/133892254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f80ffb90 msgr2=0x7f88f80fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.405+0000 7f88fdc21640 1 --2- 172.21.15.38:0/133892254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f80ffb90 0x7f88f80fff90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009880 tx=0x7f88e802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.405+0000 7f88fdc21640 1 -- 172.21.15.38:0/133892254 shutdown_connections 2024-09-13T18:36:15.408 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.405+0000 7f88fdc21640 1 --2- 172.21.15.38:0/133892254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88f8100d90 0x7f88f8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.405+0000 7f88fdc21640 1 --2- 172.21.15.38:0/133892254 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f80ffb90 0x7f88f80fff90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.405+0000 7f88fdc21640 1 -- 172.21.15.38:0/133892254 >> 172.21.15.38:0/133892254 conn(0x7f88f80fb320 msgr2=0x7f88f80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.405+0000 7f88fdc21640 1 -- 172.21.15.38:0/133892254 shutdown_connections 2024-09-13T18:36:15.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.405+0000 7f88fdc21640 1 -- 172.21.15.38:0/133892254 wait complete. 2024-09-13T18:36:15.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.406+0000 7f88fdc21640 1 Processor -- start 2024-09-13T18:36:15.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.406+0000 7f88fdc21640 1 -- start start 2024-09-13T18:36:15.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.406+0000 7f88fdc21640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88f80ffb90 0x7f88f8074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.406+0000 7f88fdc21640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f8100d90 0x7f88f80728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.406+0000 7f88fdc21640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8072de0 con 0x7f88f8100d90 2024-09-13T18:36:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.406+0000 7f88fdc21640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8072f50 con 0x7f88f80ffb90 2024-09-13T18:36:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.406+0000 7f88effff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f8100d90 0x7f88f80728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.406+0000 7f88effff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f8100d90 0x7f88f80728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52418/0 (socket says 172.21.15.38:52418) 2024-09-13T18:36:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.406+0000 7f88effff640 1 -- 172.21.15.38:0/1981357175 learned_addr learned my addr 172.21.15.38:0/1981357175 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.407+0000 7f88f77fe640 1 --2- 172.21.15.38:0/1981357175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88f80ffb90 0x7f88f8074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.407+0000 7f88effff640 1 -- 172.21.15.38:0/1981357175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88f80ffb90 msgr2=0x7f88f8074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.407+0000 7f88effff640 1 --2- 172.21.15.38:0/1981357175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88f80ffb90 0x7f88f8074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.407+0000 7f88effff640 1 -- 172.21.15.38:0/1981357175 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8009560 con 0x7f88f8100d90 2024-09-13T18:36:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.407+0000 7f88effff640 1 --2- 172.21.15.38:0/1981357175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f8100d90 0x7f88f80728a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f88e000b420 tx=0x7f88e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.407+0000 7f88f57fa640 1 -- 172.21.15.38:0/1981357175 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88e0011800 con 0x7f88f8100d90 2024-09-13T18:36:15.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.407+0000 7f88f57fa640 1 -- 172.21.15.38:0/1981357175 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88e0011e00 con 0x7f88f8100d90 2024-09-13T18:36:15.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.407+0000 7f88fdc21640 1 -- 172.21.15.38:0/1981357175 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f8073230 con 0x7f88f8100d90 2024-09-13T18:36:15.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.407+0000 7f88f57fa640 1 -- 172.21.15.38:0/1981357175 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88e000f2e0 con 0x7f88f8100d90 2024-09-13T18:36:15.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.407+0000 7f88fdc21640 1 -- 172.21.15.38:0/1981357175 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f819d6d0 con 0x7f88f8100d90 2024-09-13T18:36:15.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.408+0000 7f88fdc21640 1 -- 172.21.15.38:0/1981357175 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f81086c0 con 0x7f88f8100d90 2024-09-13T18:36:15.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.409+0000 7f88f57fa640 1 -- 172.21.15.38:0/1981357175 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f88e0010380 con 0x7f88f8100d90 2024-09-13T18:36:15.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.409+0000 7f88f57fa640 1 --2- 172.21.15.38:0/1981357175 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f88e406cc50 0x7f88e406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.409+0000 7f88f57fa640 1 -- 172.21.15.38:0/1981357175 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f88e008bee0 con 0x7f88f8100d90 2024-09-13T18:36:15.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.410+0000 7f88f77fe640 1 --2- 172.21.15.38:0/1981357175 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f88e406cc50 0x7f88e406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.410+0000 7f88f77fe640 1 --2- 172.21.15.38:0/1981357175 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f88e406cc50 0x7f88e406f110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f88e8000c00 tx=0x7f88e8031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.414+0000 7f88f57fa640 1 -- 172.21.15.38:0/1981357175 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f88e0055f70 con 0x7f88f8100d90 2024-09-13T18:36:15.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.605+0000 7f88fdc21640 1 -- 172.21.15.38:0/1981357175 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88f81056e0 con 0x7f88e406cc50 2024-09-13T18:36:15.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.606+0000 7f88f57fa640 1 -- 172.21.15.38:0/1981357175 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f88f81056e0 con 0x7f88e406cc50 2024-09-13T18:36:15.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.608+0000 7f88fdc21640 1 -- 172.21.15.38:0/1981357175 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f88e406cc50 msgr2=0x7f88e406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.608+0000 7f88fdc21640 1 --2- 172.21.15.38:0/1981357175 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f88e406cc50 0x7f88e406f110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f88e8000c00 tx=0x7f88e8031400 comp rx=0 tx=0).stop 2024-09-13T18:36:15.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.608+0000 7f88fdc21640 1 -- 172.21.15.38:0/1981357175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f8100d90 msgr2=0x7f88f80728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.608+0000 7f88fdc21640 1 --2- 172.21.15.38:0/1981357175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f8100d90 0x7f88f80728a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f88e000b420 tx=0x7f88e000b8e0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.608+0000 7f88fdc21640 1 -- 172.21.15.38:0/1981357175 shutdown_connections 2024-09-13T18:36:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.608+0000 7f88fdc21640 1 --2- 172.21.15.38:0/1981357175 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88f8100d90 0x7f88f80728a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.608+0000 7f88fdc21640 1 --2- 172.21.15.38:0/1981357175 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f88e406cc50 0x7f88e406f110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.608+0000 7f88fdc21640 1 --2- 172.21.15.38:0/1981357175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88f80ffb90 0x7f88f8074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.608+0000 7f88fdc21640 1 -- 172.21.15.38:0/1981357175 >> 172.21.15.38:0/1981357175 conn(0x7f88f80fb320 msgr2=0x7f88f8103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.608+0000 7f88fdc21640 1 -- 172.21.15.38:0/1981357175 shutdown_connections 2024-09-13T18:36:15.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.608+0000 7f88fdc21640 1 -- 172.21.15.38:0/1981357175 wait complete. 2024-09-13T18:36:15.620 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:36:15.697 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.695+0000 7f887bfb3640 1 -- 172.21.15.38:0/605429772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88740ffb90 msgr2=0x7f88740fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.695+0000 7f887bfb3640 1 --2- 172.21.15.38:0/605429772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88740ffb90 0x7f88740fff90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8868009880 tx=0x7f886802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.695+0000 7f887bfb3640 1 -- 172.21.15.38:0/605429772 shutdown_connections 2024-09-13T18:36:15.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.695+0000 7f887bfb3640 1 --2- 172.21.15.38:0/605429772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8874100d90 0x7f8874101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.695+0000 7f887bfb3640 1 --2- 172.21.15.38:0/605429772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f88740ffb90 0x7f88740fff90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.698 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.695+0000 7f887bfb3640 1 -- 172.21.15.38:0/605429772 >> 172.21.15.38:0/605429772 conn(0x7f88740fb320 msgr2=0x7f88740fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.698 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:15 smithi038 ceph-mon[91522]: pgmap v201: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T18:36:15.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.695+0000 7f887bfb3640 1 -- 172.21.15.38:0/605429772 shutdown_connections 2024-09-13T18:36:15.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.695+0000 7f887bfb3640 1 -- 172.21.15.38:0/605429772 wait complete. 2024-09-13T18:36:15.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.695+0000 7f887bfb3640 1 Processor -- start 2024-09-13T18:36:15.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.695+0000 7f887bfb3640 1 -- start start 2024-09-13T18:36:15.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.696+0000 7f887bfb3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88740ffb90 0x7f8874074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.696+0000 7f887bfb3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8874100d90 0x7f88740728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.696+0000 7f887bfb3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8874072de0 con 0x7f8874100d90 2024-09-13T18:36:15.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.696+0000 7f887bfb3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8874072f50 con 0x7f88740ffb90 2024-09-13T18:36:15.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.696+0000 7f887954e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8874100d90 0x7f88740728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.696+0000 7f887954e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8874100d90 0x7f88740728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52434/0 (socket says 172.21.15.38:52434) 2024-09-13T18:36:15.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.696+0000 7f887954e640 1 -- 172.21.15.38:0/2168926288 learned_addr learned my addr 172.21.15.38:0/2168926288 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:15.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.696+0000 7f8879d4f640 1 --2- 172.21.15.38:0/2168926288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88740ffb90 0x7f8874074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.696+0000 7f887954e640 1 -- 172.21.15.38:0/2168926288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88740ffb90 msgr2=0x7f8874074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.696+0000 7f887954e640 1 --2- 172.21.15.38:0/2168926288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88740ffb90 0x7f8874074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.696+0000 7f887954e640 1 -- 172.21.15.38:0/2168926288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868009560 con 0x7f8874100d90 2024-09-13T18:36:15.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.696+0000 7f887954e640 1 --2- 172.21.15.38:0/2168926288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8874100d90 0x7f88740728a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f887000d8d0 tx=0x7f887000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.701 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.697+0000 7f8866ffd640 1 -- 172.21.15.38:0/2168926288 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f887000bea0 con 0x7f8874100d90 2024-09-13T18:36:15.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.697+0000 7f8866ffd640 1 -- 172.21.15.38:0/2168926288 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8870009c00 con 0x7f8874100d90 2024-09-13T18:36:15.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.697+0000 7f887bfb3640 1 -- 172.21.15.38:0/2168926288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8874073230 con 0x7f8874100d90 2024-09-13T18:36:15.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.697+0000 7f8866ffd640 1 -- 172.21.15.38:0/2168926288 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f887000f680 con 0x7f8874100d90 2024-09-13T18:36:15.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.697+0000 7f887bfb3640 1 -- 172.21.15.38:0/2168926288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887419d560 con 0x7f8874100d90 2024-09-13T18:36:15.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.698+0000 7f887bfb3640 1 -- 172.21.15.38:0/2168926288 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887418f5d0 con 0x7f8874100d90 2024-09-13T18:36:15.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.699+0000 7f8866ffd640 1 -- 172.21.15.38:0/2168926288 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8870010460 con 0x7f8874100d90 2024-09-13T18:36:15.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.699+0000 7f8866ffd640 1 --2- 172.21.15.38:0/2168926288 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f886006cc60 0x7f886006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.699+0000 7f8866ffd640 1 -- 172.21.15.38:0/2168926288 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f887008c410 con 0x7f8874100d90 2024-09-13T18:36:15.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.699+0000 7f8879d4f640 1 --2- 172.21.15.38:0/2168926288 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f886006cc60 0x7f886006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.700+0000 7f8879d4f640 1 --2- 172.21.15.38:0/2168926288 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f886006cc60 0x7f886006f120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8868000c00 tx=0x7f8868005d90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.706 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.704+0000 7f8866ffd640 1 -- 172.21.15.38:0/2168926288 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8870059eb0 con 0x7f8874100d90 2024-09-13T18:36:15.899 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.897+0000 7f887bfb3640 1 -- 172.21.15.38:0/2168926288 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f887402c480 con 0x7f886006cc60 2024-09-13T18:36:15.900 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.898+0000 7f8866ffd640 1 -- 172.21.15.38:0/2168926288 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f887402c480 con 0x7f886006cc60 2024-09-13T18:36:15.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.900+0000 7f887bfb3640 1 -- 172.21.15.38:0/2168926288 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f886006cc60 msgr2=0x7f886006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.900+0000 7f887bfb3640 1 --2- 172.21.15.38:0/2168926288 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f886006cc60 0x7f886006f120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8868000c00 tx=0x7f8868005d90 comp rx=0 tx=0).stop 2024-09-13T18:36:15.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.900+0000 7f887bfb3640 1 -- 172.21.15.38:0/2168926288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8874100d90 msgr2=0x7f88740728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.900+0000 7f887bfb3640 1 --2- 172.21.15.38:0/2168926288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8874100d90 0x7f88740728a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f887000d8d0 tx=0x7f887000dd90 comp rx=0 tx=0).stop 2024-09-13T18:36:15.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.900+0000 7f887bfb3640 1 -- 172.21.15.38:0/2168926288 shutdown_connections 2024-09-13T18:36:15.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.900+0000 7f887bfb3640 1 --2- 172.21.15.38:0/2168926288 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8874100d90 0x7f88740728a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.900+0000 7f887bfb3640 1 --2- 172.21.15.38:0/2168926288 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f886006cc60 0x7f886006f120 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.900+0000 7f887bfb3640 1 --2- 172.21.15.38:0/2168926288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88740ffb90 0x7f8874074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.900+0000 7f887bfb3640 1 -- 172.21.15.38:0/2168926288 >> 172.21.15.38:0/2168926288 conn(0x7f88740fb320 msgr2=0x7f88741044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.900+0000 7f887bfb3640 1 -- 172.21.15.38:0/2168926288 shutdown_connections 2024-09-13T18:36:15.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.901+0000 7f887bfb3640 1 -- 172.21.15.38:0/2168926288 wait complete. 2024-09-13T18:36:15.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.984+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/199281897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c78102fb0 msgr2=0x7f4c781053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.984+0000 7f4c7ce4c640 1 --2- 172.21.15.38:0/199281897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c78102fb0 0x7f4c781053a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0098b0 tx=0x7f4c6c02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.985+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/199281897 shutdown_connections 2024-09-13T18:36:15.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.985+0000 7f4c7ce4c640 1 --2- 172.21.15.38:0/199281897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c78102fb0 0x7f4c781053a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.985+0000 7f4c7ce4c640 1 --2- 172.21.15.38:0/199281897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c78100680 0x7f4c78102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.985+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/199281897 >> 172.21.15.38:0/199281897 conn(0x7f4c780fa280 msgr2=0x7f4c780fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.985+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/199281897 shutdown_connections 2024-09-13T18:36:15.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.985+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/199281897 wait complete. 2024-09-13T18:36:15.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.985+0000 7f4c7ce4c640 1 Processor -- start 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.986+0000 7f4c7ce4c640 1 -- start start 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.986+0000 7f4c7ce4c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c78100680 0x7f4c781955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.986+0000 7f4c7ce4c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c78102fb0 0x7f4c78195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.986+0000 7f4c7ce4c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c781960f0 con 0x7f4c78100680 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.986+0000 7f4c7ce4c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78196260 con 0x7f4c78102fb0 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.986+0000 7f4c7659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c78100680 0x7f4c781955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.986+0000 7f4c7659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c78100680 0x7f4c781955e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52446/0 (socket says 172.21.15.38:52446) 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.986+0000 7f4c7659c640 1 -- 172.21.15.38:0/425586634 learned_addr learned my addr 172.21.15.38:0/425586634 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.986+0000 7f4c75d9b640 1 --2- 172.21.15.38:0/425586634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c78102fb0 0x7f4c78195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.986+0000 7f4c7659c640 1 -- 172.21.15.38:0/425586634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c78102fb0 msgr2=0x7f4c78195b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.986+0000 7f4c7659c640 1 --2- 172.21.15.38:0/425586634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c78102fb0 0x7f4c78195b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.986+0000 7f4c7659c640 1 -- 172.21.15.38:0/425586634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c009560 con 0x7f4c78100680 2024-09-13T18:36:15.990 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.987+0000 7f4c7659c640 1 --2- 172.21.15.38:0/425586634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c78100680 0x7f4c781955e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800d720 tx=0x7f4c6800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.987+0000 7f4c677fe640 1 -- 172.21.15.38:0/425586634 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c680051f0 con 0x7f4c78100680 2024-09-13T18:36:15.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.987+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/425586634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7819ad00 con 0x7f4c78100680 2024-09-13T18:36:15.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.987+0000 7f4c677fe640 1 -- 172.21.15.38:0/425586634 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c68009820 con 0x7f4c78100680 2024-09-13T18:36:15.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.987+0000 7f4c677fe640 1 -- 172.21.15.38:0/425586634 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c68004d40 con 0x7f4c78100680 2024-09-13T18:36:15.991 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.987+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/425586634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7819b1c0 con 0x7f4c78100680 2024-09-13T18:36:15.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.988+0000 7f4c677fe640 1 -- 172.21.15.38:0/425586634 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4c68009990 con 0x7f4c78100680 2024-09-13T18:36:15.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.988+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/425586634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c781086c0 con 0x7f4c78100680 2024-09-13T18:36:15.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.989+0000 7f4c677fe640 1 --2- 172.21.15.38:0/425586634 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4c6006cc50 0x7f4c6006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.989+0000 7f4c677fe640 1 -- 172.21.15.38:0/425586634 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f4c6808c130 con 0x7f4c78100680 2024-09-13T18:36:15.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.989+0000 7f4c75d9b640 1 --2- 172.21.15.38:0/425586634 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4c6006cc50 0x7f4c6006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.992 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.989+0000 7f4c75d9b640 1 --2- 172.21.15.38:0/425586634 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4c6006cc50 0x7f4c6006f110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c006010 tx=0x7f4c6c031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.995 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:15.993+0000 7f4c677fe640 1 -- 172.21.15.38:0/425586634 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4c680561f0 con 0x7f4c78100680 2024-09-13T18:36:16.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:15 smithi149 ceph-mon[76906]: pgmap v201: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T18:36:16.173 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.170+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/425586634 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c7819b3b0 con 0x7f4c6006cc50 2024-09-13T18:36:16.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.180+0000 7f4c677fe640 1 -- 172.21.15.38:0/425586634 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f4c7819b3b0 con 0x7f4c6006cc50 2024-09-13T18:36:16.182 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:36:16.182 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (12m) 114s ago 13m 24.1M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:36:16.182 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (14m) 114s ago 14m 8350k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:36:16.182 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (13m) 20s ago 13m 8212k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (3m) 114s ago 14m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (3m) 20s ago 13m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (12m) 114s ago 13m 87.8M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (8m) 114s ago 8m 156M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (8m) 114s ago 8m 98.3M - 18.2.4-845-ge4e227b3 67ddd33fa72f 7d41c7cf7076 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (8m) 20s ago 8m 25.7M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (8m) 20s ago 8m 25.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (5m) 114s ago 15m 491M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (4m) 20s ago 12m 440M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (4m) 114s ago 15m 47.4M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (3m) 20s ago 12m 41.1M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (14m) 114s ago 14m 15.3M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:36:16.183 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (13m) 20s ago 13m 15.5M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:36:16.184 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (3m) 114s ago 12m 131M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:36:16.184 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (2m) 114s ago 11m 95.5M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 b2f99a2919b9 2024-09-13T18:36:16.184 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (2m) 114s ago 11m 11.2M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 090af670cd3d 2024-09-13T18:36:16.184 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (86s) 20s ago 10m 106M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 e4321b085347 2024-09-13T18:36:16.184 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (55s) 20s ago 10m 98.6M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 c6ec97a4d9ff 2024-09-13T18:36:16.184 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (24s) 20s ago 9m 11.2M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 6faab71ae8a9 2024-09-13T18:36:16.184 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (4m) 114s ago 13m 60.7M - 2.43.0 a07b618ecd1d c04b1dcdc8c3 2024-09-13T18:36:16.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.182+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/425586634 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4c6006cc50 msgr2=0x7f4c6006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.182+0000 7f4c7ce4c640 1 --2- 172.21.15.38:0/425586634 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4c6006cc50 0x7f4c6006f110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c006010 tx=0x7f4c6c031400 comp rx=0 tx=0).stop 2024-09-13T18:36:16.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.182+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/425586634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c78100680 msgr2=0x7f4c781955e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.182+0000 7f4c7ce4c640 1 --2- 172.21.15.38:0/425586634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c78100680 0x7f4c781955e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800d720 tx=0x7f4c6800dbe0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.182+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/425586634 shutdown_connections 2024-09-13T18:36:16.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.182+0000 7f4c7ce4c640 1 --2- 172.21.15.38:0/425586634 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4c6006cc50 0x7f4c6006f110 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.182+0000 7f4c7ce4c640 1 --2- 172.21.15.38:0/425586634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c78102fb0 0x7f4c78195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.182+0000 7f4c7ce4c640 1 --2- 172.21.15.38:0/425586634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4c78100680 0x7f4c781955e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.182+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/425586634 >> 172.21.15.38:0/425586634 conn(0x7f4c780fa280 msgr2=0x7f4c780fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.182+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/425586634 shutdown_connections 2024-09-13T18:36:16.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.182+0000 7f4c7ce4c640 1 -- 172.21.15.38:0/425586634 wait complete. 2024-09-13T18:36:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.265+0000 7ff14cef3640 1 -- 172.21.15.38:0/255423298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1481006d0 msgr2=0x7ff148102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.265+0000 7ff14cef3640 1 --2- 172.21.15.38:0/255423298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1481006d0 0x7ff148102ac0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff138009880 tx=0x7ff13802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.265+0000 7ff14cef3640 1 -- 172.21.15.38:0/255423298 shutdown_connections 2024-09-13T18:36:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.265+0000 7ff14cef3640 1 --2- 172.21.15.38:0/255423298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff148103000 0x7ff1481053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.265+0000 7ff14cef3640 1 --2- 172.21.15.38:0/255423298 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1481006d0 0x7ff148102ac0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.265+0000 7ff14cef3640 1 -- 172.21.15.38:0/255423298 >> 172.21.15.38:0/255423298 conn(0x7ff1480fa250 msgr2=0x7ff1480fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.268 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.265+0000 7ff14cef3640 1 -- 172.21.15.38:0/255423298 shutdown_connections 2024-09-13T18:36:16.269 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.265+0000 7ff14cef3640 1 -- 172.21.15.38:0/255423298 wait complete. 2024-09-13T18:36:16.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.266+0000 7ff14cef3640 1 Processor -- start 2024-09-13T18:36:16.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.266+0000 7ff14cef3640 1 -- start start 2024-09-13T18:36:16.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.266+0000 7ff14cef3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1481006d0 0x7ff148197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.266+0000 7ff14cef3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff148103000 0x7ff148197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.270 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.266+0000 7ff14cef3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff148198250 con 0x7ff1481006d0 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.266+0000 7ff14cef3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1481983c0 con 0x7ff148103000 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.267+0000 7ff14659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1481006d0 0x7ff148197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.267+0000 7ff14659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1481006d0 0x7ff148197740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52452/0 (socket says 172.21.15.38:52452) 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.267+0000 7ff14659c640 1 -- 172.21.15.38:0/3871770167 learned_addr learned my addr 172.21.15.38:0/3871770167 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.267+0000 7ff145d9b640 1 --2- 172.21.15.38:0/3871770167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff148103000 0x7ff148197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.267+0000 7ff14659c640 1 -- 172.21.15.38:0/3871770167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff148103000 msgr2=0x7ff148197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.267+0000 7ff14659c640 1 --2- 172.21.15.38:0/3871770167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff148103000 0x7ff148197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.267+0000 7ff14659c640 1 -- 172.21.15.38:0/3871770167 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138009560 con 0x7ff1481006d0 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.267+0000 7ff14659c640 1 --2- 172.21.15.38:0/3871770167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1481006d0 0x7ff148197740 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff138006010 tx=0x7ff138005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.267+0000 7ff1377fe640 1 -- 172.21.15.38:0/3871770167 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff138004b20 con 0x7ff1481006d0 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.267+0000 7ff14cef3640 1 -- 172.21.15.38:0/3871770167 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14819ce00 con 0x7ff1481006d0 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.267+0000 7ff1377fe640 1 -- 172.21.15.38:0/3871770167 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff138004c80 con 0x7ff1481006d0 2024-09-13T18:36:16.271 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.267+0000 7ff1377fe640 1 -- 172.21.15.38:0/3871770167 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1380319f0 con 0x7ff1481006d0 2024-09-13T18:36:16.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.268+0000 7ff14cef3640 1 -- 172.21.15.38:0/3871770167 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14819d2f0 con 0x7ff1481006d0 2024-09-13T18:36:16.272 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.269+0000 7ff14cef3640 1 -- 172.21.15.38:0/3871770167 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff148100ab0 con 0x7ff1481006d0 2024-09-13T18:36:16.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.269+0000 7ff1377fe640 1 -- 172.21.15.38:0/3871770167 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff138003d00 con 0x7ff1481006d0 2024-09-13T18:36:16.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.270+0000 7ff1377fe640 1 --2- 172.21.15.38:0/3871770167 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff13006cc50 0x7ff13006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.270+0000 7ff1377fe640 1 -- 172.21.15.38:0/3871770167 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6417+0+0 (secure 0 0 0) 0x7ff1380ad680 con 0x7ff1481006d0 2024-09-13T18:36:16.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.270+0000 7ff145d9b640 1 --2- 172.21.15.38:0/3871770167 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff13006cc50 0x7ff13006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.273 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.270+0000 7ff145d9b640 1 --2- 172.21.15.38:0/3871770167 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff13006cc50 0x7ff13006f110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff148198c60 tx=0x7ff13c00b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.274+0000 7ff1377fe640 1 -- 172.21.15.38:0/3871770167 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff1380777c0 con 0x7ff1481006d0 2024-09-13T18:36:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.519+0000 7ff14cef3640 1 -- 172.21.15.38:0/3871770167 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff148108690 con 0x7ff1481006d0 2024-09-13T18:36:16.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.520+0000 7ff1377fe640 1 -- 172.21.15.38:0/3871770167 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7ff13807ade0 con 0x7ff1481006d0 2024-09-13T18:36:16.523 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:36:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:36:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:36:16.523 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:36:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:36:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:36:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:36:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:36:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T18:36:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:36:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:36:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4 2024-09-13T18:36:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:36:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:36:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 4, 2024-09-13T18:36:16.524 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 10 2024-09-13T18:36:16.525 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:36:16.525 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:36:16.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.522+0000 7ff14cef3640 1 -- 172.21.15.38:0/3871770167 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff13006cc50 msgr2=0x7ff13006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.522+0000 7ff14cef3640 1 --2- 172.21.15.38:0/3871770167 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff13006cc50 0x7ff13006f110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff148198c60 tx=0x7ff13c00b390 comp rx=0 tx=0).stop 2024-09-13T18:36:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.522+0000 7ff14cef3640 1 -- 172.21.15.38:0/3871770167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1481006d0 msgr2=0x7ff148197740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.522+0000 7ff14cef3640 1 --2- 172.21.15.38:0/3871770167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1481006d0 0x7ff148197740 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff138006010 tx=0x7ff138005610 comp rx=0 tx=0).stop 2024-09-13T18:36:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.522+0000 7ff14cef3640 1 -- 172.21.15.38:0/3871770167 shutdown_connections 2024-09-13T18:36:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.522+0000 7ff14cef3640 1 --2- 172.21.15.38:0/3871770167 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff13006cc50 0x7ff13006f110 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.522+0000 7ff14cef3640 1 --2- 172.21.15.38:0/3871770167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff148103000 0x7ff148197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.522+0000 7ff14cef3640 1 --2- 172.21.15.38:0/3871770167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1481006d0 0x7ff148197740 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.522+0000 7ff14cef3640 1 -- 172.21.15.38:0/3871770167 >> 172.21.15.38:0/3871770167 conn(0x7ff1480fa250 msgr2=0x7ff1480ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.522+0000 7ff14cef3640 1 -- 172.21.15.38:0/3871770167 shutdown_connections 2024-09-13T18:36:16.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.522+0000 7ff14cef3640 1 -- 172.21.15.38:0/3871770167 wait complete. 2024-09-13T18:36:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.606+0000 7fd76689b640 1 -- 172.21.15.38:0/2043522861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd760100d90 msgr2=0x7fd760101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.606+0000 7fd76689b640 1 --2- 172.21.15.38:0/2043522861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd760100d90 0x7fd760101210 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd754009880 tx=0x7fd75402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.606+0000 7fd76689b640 1 -- 172.21.15.38:0/2043522861 shutdown_connections 2024-09-13T18:36:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.606+0000 7fd76689b640 1 --2- 172.21.15.38:0/2043522861 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd760100d90 0x7fd760101210 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.606+0000 7fd76689b640 1 --2- 172.21.15.38:0/2043522861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7600ffb90 0x7fd7600fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.606+0000 7fd76689b640 1 -- 172.21.15.38:0/2043522861 >> 172.21.15.38:0/2043522861 conn(0x7fd7600fb320 msgr2=0x7fd7600fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.606+0000 7fd76689b640 1 -- 172.21.15.38:0/2043522861 shutdown_connections 2024-09-13T18:36:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.606+0000 7fd76689b640 1 -- 172.21.15.38:0/2043522861 wait complete. 2024-09-13T18:36:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.606+0000 7fd76689b640 1 Processor -- start 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.607+0000 7fd76689b640 1 -- start start 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.607+0000 7fd76689b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7600ffb90 0x7fd7601955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.607+0000 7fd76689b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd760100d90 0x7fd760195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.607+0000 7fd76689b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7601960e0 con 0x7fd760100d90 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.607+0000 7fd76689b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd760196250 con 0x7fd7600ffb90 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.607+0000 7fd75f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd760100d90 0x7fd760195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.607+0000 7fd75f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd760100d90 0x7fd760195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52468/0 (socket says 172.21.15.38:52468) 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.607+0000 7fd75f7fe640 1 -- 172.21.15.38:0/1046173636 learned_addr learned my addr 172.21.15.38:0/1046173636 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.607+0000 7fd75ffff640 1 --2- 172.21.15.38:0/1046173636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7600ffb90 0x7fd7601955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.607+0000 7fd75f7fe640 1 -- 172.21.15.38:0/1046173636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7600ffb90 msgr2=0x7fd7601955d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.607+0000 7fd75f7fe640 1 --2- 172.21.15.38:0/1046173636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7600ffb90 0x7fd7601955d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.607+0000 7fd75f7fe640 1 -- 172.21.15.38:0/1046173636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd754009560 con 0x7fd760100d90 2024-09-13T18:36:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.608+0000 7fd75f7fe640 1 --2- 172.21.15.38:0/1046173636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd760100d90 0x7fd760195b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd7540099a0 tx=0x7fd7540055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.608+0000 7fd75d7fa640 1 -- 172.21.15.38:0/1046173636 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd754004aa0 con 0x7fd760100d90 2024-09-13T18:36:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.608+0000 7fd76689b640 1 -- 172.21.15.38:0/1046173636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76019ac90 con 0x7fd760100d90 2024-09-13T18:36:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.608+0000 7fd75d7fa640 1 -- 172.21.15.38:0/1046173636 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd754004c00 con 0x7fd760100d90 2024-09-13T18:36:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.608+0000 7fd75d7fa640 1 -- 172.21.15.38:0/1046173636 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7540318f0 con 0x7fd760100d90 2024-09-13T18:36:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.608+0000 7fd76689b640 1 -- 172.21.15.38:0/1046173636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76019b200 con 0x7fd760100d90 2024-09-13T18:36:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.609+0000 7fd76689b640 1 -- 172.21.15.38:0/1046173636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76018f5f0 con 0x7fd760100d90 2024-09-13T18:36:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.609+0000 7fd75d7fa640 1 -- 172.21.15.38:0/1046173636 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd754031bb0 con 0x7fd760100d90 2024-09-13T18:36:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.610+0000 7fd75d7fa640 1 --2- 172.21.15.38:0/1046173636 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd74806cc50 0x7fd74806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.610+0000 7fd75d7fa640 1 -- 172.21.15.38:0/1046173636 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fd7540ad740 con 0x7fd760100d90 2024-09-13T18:36:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.610+0000 7fd75ffff640 1 --2- 172.21.15.38:0/1046173636 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd74806cc50 0x7fd74806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.610+0000 7fd75ffff640 1 --2- 172.21.15.38:0/1046173636 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd74806cc50 0x7fd74806f110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd750005fd0 tx=0x7fd75000b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.614+0000 7fd75d7fa640 1 -- 172.21.15.38:0/1046173636 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd754077800 con 0x7fd760100d90 2024-09-13T18:36:16.829 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.827+0000 7fd76689b640 1 -- 172.21.15.38:0/1046173636 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd7601088e0 con 0x7fd760100d90 2024-09-13T18:36:16.830 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:16 smithi038 ceph-mon[91522]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:16.830 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:16 smithi038 ceph-mon[91522]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:16.830 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:16 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3871770167' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:16.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.827+0000 7fd75d7fa640 1 -- 172.21.15.38:0/1046173636 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1857 (secure 0 0 0) 0x7fd754031e60 con 0x7fd760100d90 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout:e20 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 20 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:36:00.604402+0000 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:36:16.831 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 0 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 1 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484,1=24275} 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:36:16.832 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:36:16.833 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:36:16.833 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:36:16.833 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:36:16.833 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:36:16.833 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:36:16.833 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:36:16.833 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:36:16.833 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{1:24275} state up:stopping seq 4 join_fscid=1 addr [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:36:16.833 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:36:16.833 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:36:16.834 INFO:teuthology.orchestra.run.smithi038.stdout:Standby daemons: 2024-09-13T18:36:16.834 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:36:16.834 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{-1:34318} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/2694903367,v1:172.21.15.38:6827/2694903367] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:36:16.834 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{-1:44263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/3061943000,v1:172.21.15.149:6827/3061943000] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:36:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 20 2024-09-13T18:36:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.830+0000 7fd76689b640 1 -- 172.21.15.38:0/1046173636 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd74806cc50 msgr2=0x7fd74806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.830+0000 7fd76689b640 1 --2- 172.21.15.38:0/1046173636 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd74806cc50 0x7fd74806f110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd750005fd0 tx=0x7fd75000b390 comp rx=0 tx=0).stop 2024-09-13T18:36:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.830+0000 7fd76689b640 1 -- 172.21.15.38:0/1046173636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd760100d90 msgr2=0x7fd760195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.830+0000 7fd76689b640 1 --2- 172.21.15.38:0/1046173636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd760100d90 0x7fd760195b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd7540099a0 tx=0x7fd7540055a0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.830+0000 7fd76689b640 1 -- 172.21.15.38:0/1046173636 shutdown_connections 2024-09-13T18:36:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.830+0000 7fd76689b640 1 --2- 172.21.15.38:0/1046173636 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd760100d90 0x7fd760195b10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.830+0000 7fd76689b640 1 --2- 172.21.15.38:0/1046173636 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd74806cc50 0x7fd74806f110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.830+0000 7fd76689b640 1 --2- 172.21.15.38:0/1046173636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7600ffb90 0x7fd7601955d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.830+0000 7fd76689b640 1 -- 172.21.15.38:0/1046173636 >> 172.21.15.38:0/1046173636 conn(0x7fd7600fb320 msgr2=0x7fd760104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.830+0000 7fd76689b640 1 -- 172.21.15.38:0/1046173636 shutdown_connections 2024-09-13T18:36:16.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.830+0000 7fd76689b640 1 -- 172.21.15.38:0/1046173636 wait complete. 2024-09-13T18:36:16.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.915+0000 7ff852209640 1 -- 172.21.15.38:0/2819377801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff84c100e30 msgr2=0x7ff84c1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.915+0000 7ff852209640 1 --2- 172.21.15.38:0/2819377801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff84c100e30 0x7ff84c1012b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff840009880 tx=0x7ff84002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.915+0000 7ff852209640 1 -- 172.21.15.38:0/2819377801 shutdown_connections 2024-09-13T18:36:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.915+0000 7ff852209640 1 --2- 172.21.15.38:0/2819377801 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff84c100e30 0x7ff84c1012b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.915+0000 7ff852209640 1 --2- 172.21.15.38:0/2819377801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff84c0fde50 0x7ff84c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.915+0000 7ff852209640 1 -- 172.21.15.38:0/2819377801 >> 172.21.15.38:0/2819377801 conn(0x7ff84c0f99c0 msgr2=0x7ff84c0fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.915+0000 7ff852209640 1 -- 172.21.15.38:0/2819377801 shutdown_connections 2024-09-13T18:36:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.915+0000 7ff852209640 1 -- 172.21.15.38:0/2819377801 wait complete. 2024-09-13T18:36:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.916+0000 7ff852209640 1 Processor -- start 2024-09-13T18:36:16.920 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.916+0000 7ff852209640 1 -- start start 2024-09-13T18:36:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.916+0000 7ff852209640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff84c0fde50 0x7ff84c1954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.916+0000 7ff852209640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff84c100e30 0x7ff84c195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.916+0000 7ff852209640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c195ff0 con 0x7ff84c0fde50 2024-09-13T18:36:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.916+0000 7ff852209640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c196160 con 0x7ff84c100e30 2024-09-13T18:36:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.916+0000 7ff84b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff84c0fde50 0x7ff84c1954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.917+0000 7ff84b7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff84c0fde50 0x7ff84c1954e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52482/0 (socket says 172.21.15.38:52482) 2024-09-13T18:36:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.917+0000 7ff84b7fe640 1 -- 172.21.15.38:0/3584765896 learned_addr learned my addr 172.21.15.38:0/3584765896 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.917+0000 7ff84affd640 1 --2- 172.21.15.38:0/3584765896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff84c100e30 0x7ff84c195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.917+0000 7ff84b7fe640 1 -- 172.21.15.38:0/3584765896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff84c100e30 msgr2=0x7ff84c195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.917+0000 7ff84b7fe640 1 --2- 172.21.15.38:0/3584765896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff84c100e30 0x7ff84c195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.917+0000 7ff84b7fe640 1 -- 172.21.15.38:0/3584765896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840009560 con 0x7ff84c0fde50 2024-09-13T18:36:16.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.917+0000 7ff84b7fe640 1 --2- 172.21.15.38:0/3584765896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff84c0fde50 0x7ff84c1954e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00d720 tx=0x7ff83c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.917+0000 7ff848ff9640 1 -- 172.21.15.38:0/3584765896 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff83c0041f0 con 0x7ff84c0fde50 2024-09-13T18:36:16.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.917+0000 7ff848ff9640 1 -- 172.21.15.38:0/3584765896 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff83c004350 con 0x7ff84c0fde50 2024-09-13T18:36:16.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.917+0000 7ff852209640 1 -- 172.21.15.38:0/3584765896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84c19ac00 con 0x7ff84c0fde50 2024-09-13T18:36:16.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.917+0000 7ff848ff9640 1 -- 172.21.15.38:0/3584765896 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff83c003d40 con 0x7ff84c0fde50 2024-09-13T18:36:16.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.917+0000 7ff852209640 1 -- 172.21.15.38:0/3584765896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84c19b150 con 0x7ff84c0fde50 2024-09-13T18:36:16.922 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.918+0000 7ff852209640 1 -- 172.21.15.38:0/3584765896 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84c108630 con 0x7ff84c0fde50 2024-09-13T18:36:16.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.919+0000 7ff848ff9640 1 -- 172.21.15.38:0/3584765896 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff83c009820 con 0x7ff84c0fde50 2024-09-13T18:36:16.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.919+0000 7ff848ff9640 1 --2- 172.21.15.38:0/3584765896 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff83406cc50 0x7ff83406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.919+0000 7ff848ff9640 1 -- 172.21.15.38:0/3584765896 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6417+0+0 (secure 0 0 0) 0x7ff83c08bfe0 con 0x7ff84c0fde50 2024-09-13T18:36:16.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.919+0000 7ff84affd640 1 --2- 172.21.15.38:0/3584765896 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff83406cc50 0x7ff83406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.923 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.920+0000 7ff84affd640 1 --2- 172.21.15.38:0/3584765896 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff83406cc50 0x7ff83406f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff84c196a00 tx=0x7ff840031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.926 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:16.924+0000 7ff848ff9640 1 -- 172.21.15.38:0/3584765896 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff83c0560c0 con 0x7ff84c0fde50 2024-09-13T18:36:17.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:16 smithi149 ceph-mon[76906]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:17.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:16 smithi149 ceph-mon[76906]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:17.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:16 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3871770167' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:17.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.108+0000 7ff852209640 1 -- 172.21.15.38:0/3584765896 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff84c105780 con 0x7ff83406cc50 2024-09-13T18:36:17.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.110+0000 7ff848ff9640 1 -- 172.21.15.38:0/3584765896 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff84c105780 con 0x7ff83406cc50 2024-09-13T18:36:17.112 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:36:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:36:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:36:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:36:17.112 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:36:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr", 2024-09-13T18:36:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-13T18:36:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "osd", 2024-09-13T18:36:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "mon" 2024-09-13T18:36:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:36:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "12/23 daemons upgraded", 2024-09-13T18:36:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T18:36:17.113 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:36:17.113 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:36:17.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.111+0000 7ff852209640 1 -- 172.21.15.38:0/3584765896 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff83406cc50 msgr2=0x7ff83406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.111+0000 7ff852209640 1 --2- 172.21.15.38:0/3584765896 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff83406cc50 0x7ff83406f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff84c196a00 tx=0x7ff840031400 comp rx=0 tx=0).stop 2024-09-13T18:36:17.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.111+0000 7ff852209640 1 -- 172.21.15.38:0/3584765896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff84c0fde50 msgr2=0x7ff84c1954e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.111+0000 7ff852209640 1 --2- 172.21.15.38:0/3584765896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff84c0fde50 0x7ff84c1954e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00d720 tx=0x7ff83c00dbe0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.111+0000 7ff852209640 1 -- 172.21.15.38:0/3584765896 shutdown_connections 2024-09-13T18:36:17.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.111+0000 7ff852209640 1 --2- 172.21.15.38:0/3584765896 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff83406cc50 0x7ff83406f110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.111+0000 7ff852209640 1 --2- 172.21.15.38:0/3584765896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff84c100e30 0x7ff84c195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.111+0000 7ff852209640 1 --2- 172.21.15.38:0/3584765896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff84c0fde50 0x7ff84c1954e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.111+0000 7ff852209640 1 -- 172.21.15.38:0/3584765896 >> 172.21.15.38:0/3584765896 conn(0x7ff84c0f99c0 msgr2=0x7ff84c104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.112+0000 7ff852209640 1 -- 172.21.15.38:0/3584765896 shutdown_connections 2024-09-13T18:36:17.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.112+0000 7ff852209640 1 -- 172.21.15.38:0/3584765896 wait complete. 2024-09-13T18:36:17.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.195+0000 7fcce38c1640 1 -- 172.21.15.38:0/701415390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccdc0fed60 msgr2=0x7fccdc0ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.195+0000 7fcce38c1640 1 --2- 172.21.15.38:0/701415390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccdc0fed60 0x7fccdc0ff1c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009880 tx=0x7fcccc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.195+0000 7fcce38c1640 1 -- 172.21.15.38:0/701415390 shutdown_connections 2024-09-13T18:36:17.198 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.195+0000 7fcce38c1640 1 --2- 172.21.15.38:0/701415390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccdc0fed60 0x7fccdc0ff1c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.195+0000 7fcce38c1640 1 --2- 172.21.15.38:0/701415390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccdc0fe420 0x7fccdc0fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.195+0000 7fcce38c1640 1 -- 172.21.15.38:0/701415390 >> 172.21.15.38:0/701415390 conn(0x7fccdc0fa250 msgr2=0x7fccdc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.196+0000 7fcce38c1640 1 -- 172.21.15.38:0/701415390 shutdown_connections 2024-09-13T18:36:17.199 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.196+0000 7fcce38c1640 1 -- 172.21.15.38:0/701415390 wait complete. 2024-09-13T18:36:17.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.196+0000 7fcce38c1640 1 Processor -- start 2024-09-13T18:36:17.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.196+0000 7fcce38c1640 1 -- start start 2024-09-13T18:36:17.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce38c1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccdc0fe420 0x7fccdc1976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce38c1640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccdc0fed60 0x7fccdc197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce38c1640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc198200 con 0x7fccdc0fed60 2024-09-13T18:36:17.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce38c1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc198370 con 0x7fccdc0fe420 2024-09-13T18:36:17.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce0e5c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccdc0fed60 0x7fccdc197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce0e5c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccdc0fed60 0x7fccdc197c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:52488/0 (socket says 172.21.15.38:52488) 2024-09-13T18:36:17.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce0e5c640 1 -- 172.21.15.38:0/2619657235 learned_addr learned my addr 172.21.15.38:0/2619657235 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:17.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce165d640 1 --2- 172.21.15.38:0/2619657235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccdc0fe420 0x7fccdc1976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce0e5c640 1 -- 172.21.15.38:0/2619657235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccdc0fe420 msgr2=0x7fccdc1976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.201 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce0e5c640 1 --2- 172.21.15.38:0/2619657235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccdc0fe420 0x7fccdc1976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce0e5c640 1 -- 172.21.15.38:0/2619657235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc009560 con 0x7fccdc0fed60 2024-09-13T18:36:17.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce0e5c640 1 --2- 172.21.15.38:0/2619657235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccdc0fed60 0x7fccdc197c30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0099a0 tx=0x7fcccc0055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fccd27fc640 1 -- 172.21.15.38:0/2619657235 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcccc004aa0 con 0x7fccdc0fed60 2024-09-13T18:36:17.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fccd27fc640 1 -- 172.21.15.38:0/2619657235 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcccc004c00 con 0x7fccdc0fed60 2024-09-13T18:36:17.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fccd27fc640 1 -- 172.21.15.38:0/2619657235 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcccc031950 con 0x7fccdc0fed60 2024-09-13T18:36:17.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.197+0000 7fcce38c1640 1 -- 172.21.15.38:0/2619657235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc19cdb0 con 0x7fccdc0fed60 2024-09-13T18:36:17.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.198+0000 7fcce38c1640 1 -- 172.21.15.38:0/2619657235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc19d320 con 0x7fccdc0fed60 2024-09-13T18:36:17.202 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.198+0000 7fcce38c1640 1 -- 172.21.15.38:0/2619657235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc10a830 con 0x7fccdc0fed60 2024-09-13T18:36:17.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.199+0000 7fccd27fc640 1 -- 172.21.15.38:0/2619657235 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcccc031bc0 con 0x7fccdc0fed60 2024-09-13T18:36:17.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.200+0000 7fccd27fc640 1 --2- 172.21.15.38:0/2619657235 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fccc806cc60 0x7fccc806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.200+0000 7fccd27fc640 1 -- 172.21.15.38:0/2619657235 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fcccc0ad700 con 0x7fccdc0fed60 2024-09-13T18:36:17.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.200+0000 7fcce165d640 1 --2- 172.21.15.38:0/2619657235 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fccc806cc60 0x7fccc806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.203 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.200+0000 7fcce165d640 1 --2- 172.21.15.38:0/2619657235 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fccc806cc60 0x7fccc806f120 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fccd800bbe0 tx=0x7fccd800b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.206 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.204+0000 7fccd27fc640 1 -- 172.21.15.38:0/2619657235 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcccc077840 con 0x7fccdc0fed60 2024-09-13T18:36:17.443 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.440+0000 7fcce38c1640 1 -- 172.21.15.38:0/2619657235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fccdc10a9c0 con 0x7fccdc0fed60 2024-09-13T18:36:17.444 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.441+0000 7fccd27fc640 1 -- 172.21.15.38:0/2619657235 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fcccc07ae60 con 0x7fccdc0fed60 2024-09-13T18:36:17.444 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:36:17.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.443+0000 7fcce38c1640 1 -- 172.21.15.38:0/2619657235 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fccc806cc60 msgr2=0x7fccc806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.443+0000 7fcce38c1640 1 --2- 172.21.15.38:0/2619657235 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fccc806cc60 0x7fccc806f120 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fccd800bbe0 tx=0x7fccd800b390 comp rx=0 tx=0).stop 2024-09-13T18:36:17.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.443+0000 7fcce38c1640 1 -- 172.21.15.38:0/2619657235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccdc0fed60 msgr2=0x7fccdc197c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.443+0000 7fcce38c1640 1 --2- 172.21.15.38:0/2619657235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccdc0fed60 0x7fccdc197c30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0099a0 tx=0x7fcccc0055c0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.443+0000 7fcce38c1640 1 -- 172.21.15.38:0/2619657235 shutdown_connections 2024-09-13T18:36:17.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.443+0000 7fcce38c1640 1 --2- 172.21.15.38:0/2619657235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccdc0fed60 0x7fccdc197c30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.443+0000 7fcce38c1640 1 --2- 172.21.15.38:0/2619657235 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fccc806cc60 0x7fccc806f120 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.443+0000 7fcce38c1640 1 --2- 172.21.15.38:0/2619657235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fccdc0fe420 0x7fccdc1976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.443+0000 7fcce38c1640 1 -- 172.21.15.38:0/2619657235 >> 172.21.15.38:0/2619657235 conn(0x7fccdc0fa250 msgr2=0x7fccdc106a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.443+0000 7fcce38c1640 1 -- 172.21.15.38:0/2619657235 shutdown_connections 2024-09-13T18:36:17.446 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:17.443+0000 7fcce38c1640 1 -- 172.21.15.38:0/2619657235 wait complete. 2024-09-13T18:36:17.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:17 smithi038 ceph-mon[91522]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:17.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:17 smithi038 ceph-mon[91522]: pgmap v202: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T18:36:17.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:17 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1046173636' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:36:17.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:17 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2619657235' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:36:18.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:17 smithi149 ceph-mon[76906]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:17 smithi149 ceph-mon[76906]: pgmap v202: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-13T18:36:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:17 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1046173636' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:36:18.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:17 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2619657235' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:36:19.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:18 smithi149 ceph-mon[76906]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:19.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:18 smithi038 ceph-mon[91522]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:20.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:19 smithi149 ceph-mon[76906]: pgmap v203: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T18:36:20.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:19 smithi038 ceph-mon[91522]: pgmap v203: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T18:36:22.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:21 smithi149 ceph-mon[76906]: pgmap v204: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T18:36:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:21 smithi149 ceph-mon[76906]: daemon mds.cephfs.smithi149.doanhj finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-13T18:36:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:36:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:21 smithi038 ceph-mon[91522]: pgmap v204: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T18:36:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:21 smithi038 ceph-mon[91522]: daemon mds.cephfs.smithi149.doanhj finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-13T18:36:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:36:23.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:22 smithi149 ceph-mon[76906]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T18:36:23.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:22 smithi149 ceph-mon[76906]: mds.1 [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] down:stopped 2024-09-13T18:36:23.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:22 smithi149 ceph-mon[76906]: fsmap cephfs:1 {0=cephfs.smithi038.dtnkqo=up:active} 2 up:standby 2024-09-13T18:36:23.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:22 smithi038 ceph-mon[91522]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T18:36:23.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:22 smithi038 ceph-mon[91522]: mds.1 [v2:172.21.15.149:6824/443686826,v1:172.21.15.149:6825/443686826] down:stopped 2024-09-13T18:36:23.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:22 smithi038 ceph-mon[91522]: fsmap cephfs:1 {0=cephfs.smithi038.dtnkqo=up:active} 2 up:standby 2024-09-13T18:36:24.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:23 smithi149 ceph-mon[76906]: pgmap v205: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T18:36:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:23 smithi149 ceph-mon[76906]: mds.? [v2:172.21.15.149:6824/522640114,v1:172.21.15.149:6825/522640114] up:boot 2024-09-13T18:36:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:23 smithi149 ceph-mon[76906]: fsmap cephfs:1 {0=cephfs.smithi038.dtnkqo=up:active} 3 up:standby 2024-09-13T18:36:24.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:23 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:36:24.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:23 smithi038 ceph-mon[91522]: pgmap v205: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T18:36:24.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:23 smithi038 ceph-mon[91522]: mds.? [v2:172.21.15.149:6824/522640114,v1:172.21.15.149:6825/522640114] up:boot 2024-09-13T18:36:24.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:23 smithi038 ceph-mon[91522]: fsmap cephfs:1 {0=cephfs.smithi038.dtnkqo=up:active} 3 up:standby 2024-09-13T18:36:24.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:23 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:36:25.983 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:25 smithi038 ceph-mon[91522]: pgmap v206: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T18:36:26.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:25 smithi149 ceph-mon[76906]: pgmap v206: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T18:36:28.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:27 smithi149 ceph-mon[76906]: pgmap v207: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T18:36:28.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:27 smithi038 ceph-mon[91522]: pgmap v207: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T18:36:30.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:29 smithi149 ceph-mon[76906]: pgmap v208: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T18:36:30.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:29 smithi038 ceph-mon[91522]: pgmap v208: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-13T18:36:31.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:31 smithi038 ceph-mon[91522]: pgmap v209: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:31.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:31 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:31.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:31 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:31.771 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:31 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:31.772 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:31 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:31.772 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:31 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:31.772 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:31 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:31.772 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:31 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:31.772 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:31 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:31.772 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:31 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:31.772 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:31 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi038.ubvgaq"]}]: dispatch 2024-09-13T18:36:32.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:31 smithi149 ceph-mon[76906]: pgmap v209: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:32.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:31 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:32.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:31 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:32.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:31 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:32.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:31 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:32.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:31 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:32.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:31 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:32.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:31 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:32.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:31 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:32.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:31 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:32.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:31 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi038.ubvgaq"]}]: dispatch 2024-09-13T18:36:33.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:32 smithi149 ceph-mon[76906]: Upgrade: It appears safe to stop mds.cephfs.smithi038.ubvgaq 2024-09-13T18:36:33.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:32 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:33.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:32 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.ubvgaq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:36:33.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:32 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:33.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:32 smithi038 ceph-mon[91522]: Upgrade: It appears safe to stop mds.cephfs.smithi038.ubvgaq 2024-09-13T18:36:33.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:32 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:33.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:32 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.ubvgaq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:36:33.037 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:32 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:34.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:33 smithi149 ceph-mon[76906]: pgmap v210: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:34.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:33 smithi149 ceph-mon[76906]: Upgrade: Updating mds.cephfs.smithi038.ubvgaq 2024-09-13T18:36:34.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:33 smithi149 ceph-mon[76906]: Deploying daemon mds.cephfs.smithi038.ubvgaq on smithi038 2024-09-13T18:36:34.045 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:33 smithi038 ceph-mon[91522]: pgmap v210: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:34.045 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:33 smithi038 ceph-mon[91522]: Upgrade: Updating mds.cephfs.smithi038.ubvgaq 2024-09-13T18:36:34.045 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:33 smithi038 ceph-mon[91522]: Deploying daemon mds.cephfs.smithi038.ubvgaq on smithi038 2024-09-13T18:36:36.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:35 smithi149 ceph-mon[76906]: pgmap v211: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:36.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:35 smithi149 ceph-mon[76906]: osdmap e94: 6 total, 6 up, 6 in 2024-09-13T18:36:36.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:35 smithi149 ceph-mon[76906]: fsmap cephfs:1 {0=cephfs.smithi038.dtnkqo=up:active} 2 up:standby 2024-09-13T18:36:36.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:35 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:36:36.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:35 smithi038 ceph-mon[91522]: pgmap v211: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:36.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:35 smithi038 ceph-mon[91522]: osdmap e94: 6 total, 6 up, 6 in 2024-09-13T18:36:36.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:35 smithi038 ceph-mon[91522]: fsmap cephfs:1 {0=cephfs.smithi038.dtnkqo=up:active} 2 up:standby 2024-09-13T18:36:36.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:35 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:36:37.013 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:36:37.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:36:37.959 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:37 smithi038 ceph-mon[91522]: pgmap v213: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:37 smithi149 ceph-mon[76906]: pgmap v213: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:39 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:39 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:39.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:39 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:39.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:39 smithi149 ceph-mon[76906]: pgmap v214: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:39.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:39 smithi149 ceph-mon[76906]: mds.? [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] up:boot 2024-09-13T18:36:39.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:39 smithi149 ceph-mon[76906]: fsmap cephfs:1 {0=cephfs.smithi038.dtnkqo=up:active} 3 up:standby 2024-09-13T18:36:39.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:39 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:36:39.317 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:39 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:39.317 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:39 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:39.317 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:39 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:39.317 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:39 smithi038 ceph-mon[91522]: pgmap v214: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:39.317 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:39 smithi038 ceph-mon[91522]: mds.? [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] up:boot 2024-09-13T18:36:39.317 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:39 smithi038 ceph-mon[91522]: fsmap cephfs:1 {0=cephfs.smithi038.dtnkqo=up:active} 3 up:standby 2024-09-13T18:36:39.317 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:39 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:36:41.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:41 smithi149 ceph-mon[76906]: pgmap v215: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:41.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:41 smithi038 ceph-mon[91522]: pgmap v215: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:43.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:43 smithi149 ceph-mon[76906]: pgmap v216: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:43.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:43.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:43 smithi038 ceph-mon[91522]: pgmap v216: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:45.014 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:44 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:45.737 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:44 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:45.737 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:44 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:45.738 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:44 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:46.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:45 smithi149 ceph-mon[76906]: pgmap v217: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:46.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:45 smithi038 ceph-mon[91522]: pgmap v217: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:47.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.532+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2674857397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62e80feaf0 msgr2=0x7f62e80feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.532+0000 7f62ecbfc640 1 --2- 172.21.15.38:0/2674857397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62e80feaf0 0x7f62e80feef0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009880 tx=0x7f62d802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.532+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2674857397 shutdown_connections 2024-09-13T18:36:47.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.532+0000 7f62ecbfc640 1 --2- 172.21.15.38:0/2674857397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62e80ffcf0 0x7f62e8100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.532+0000 7f62ecbfc640 1 --2- 172.21.15.38:0/2674857397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62e80feaf0 0x7f62e80feef0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.532+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2674857397 >> 172.21.15.38:0/2674857397 conn(0x7f62e80fa280 msgr2=0x7f62e80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:47.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.532+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2674857397 shutdown_connections 2024-09-13T18:36:47.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.532+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2674857397 wait complete. 2024-09-13T18:36:47.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62ecbfc640 1 Processor -- start 2024-09-13T18:36:47.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62ecbfc640 1 -- start start 2024-09-13T18:36:47.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62ecbfc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62e80feaf0 0x7f62e8102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62ecbfc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62e80ffcf0 0x7f62e81010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62ecbfc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8101610 con 0x7f62e80ffcf0 2024-09-13T18:36:47.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62ecbfc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8101780 con 0x7f62e80feaf0 2024-09-13T18:36:47.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62e5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62e80ffcf0 0x7f62e81010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62e5d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62e80ffcf0 0x7f62e81010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57370/0 (socket says 172.21.15.38:57370) 2024-09-13T18:36:47.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62e5d9b640 1 -- 172.21.15.38:0/2617114794 learned_addr learned my addr 172.21.15.38:0/2617114794 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:47.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62e659c640 1 --2- 172.21.15.38:0/2617114794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62e80feaf0 0x7f62e8102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62e5d9b640 1 -- 172.21.15.38:0/2617114794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62e80feaf0 msgr2=0x7f62e8102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62e5d9b640 1 --2- 172.21.15.38:0/2617114794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62e80feaf0 0x7f62e8102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.533+0000 7f62e5d9b640 1 -- 172.21.15.38:0/2617114794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d8009560 con 0x7f62e80ffcf0 2024-09-13T18:36:47.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.534+0000 7f62e659c640 1 --2- 172.21.15.38:0/2617114794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62e80feaf0 0x7f62e8102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:47.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.534+0000 7f62e5d9b640 1 --2- 172.21.15.38:0/2617114794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62e80ffcf0 0x7f62e81010d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00cc60 tx=0x7f62dc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.534+0000 7f62d77fe640 1 -- 172.21.15.38:0/2617114794 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62dc004b20 con 0x7f62e80ffcf0 2024-09-13T18:36:47.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.534+0000 7f62d77fe640 1 -- 172.21.15.38:0/2617114794 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f62dc004c80 con 0x7f62e80ffcf0 2024-09-13T18:36:47.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.534+0000 7f62d77fe640 1 -- 172.21.15.38:0/2617114794 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62dc00f680 con 0x7f62e80ffcf0 2024-09-13T18:36:47.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.534+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2617114794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e8101a60 con 0x7f62e80ffcf0 2024-09-13T18:36:47.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.534+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2617114794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e819d630 con 0x7f62e80ffcf0 2024-09-13T18:36:47.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.535+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2617114794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e81075a0 con 0x7f62e80ffcf0 2024-09-13T18:36:47.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.536+0000 7f62d77fe640 1 -- 172.21.15.38:0/2617114794 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f62dc005550 con 0x7f62e80ffcf0 2024-09-13T18:36:47.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.536+0000 7f62d77fe640 1 --2- 172.21.15.38:0/2617114794 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f62d006cc50 0x7f62d006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.536+0000 7f62d77fe640 1 -- 172.21.15.38:0/2617114794 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f62dc08c6f0 con 0x7f62e80ffcf0 2024-09-13T18:36:47.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.536+0000 7f62e659c640 1 --2- 172.21.15.38:0/2617114794 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f62d006cc50 0x7f62d006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.537+0000 7f62e659c640 1 --2- 172.21.15.38:0/2617114794 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f62d006cc50 0x7f62d006f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f62d8031460 tx=0x7f62d8005de0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.541+0000 7f62d77fe640 1 -- 172.21.15.38:0/2617114794 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f62dc056780 con 0x7f62e80ffcf0 2024-09-13T18:36:47.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.732+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2617114794 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62e80fc4a0 con 0x7f62d006cc50 2024-09-13T18:36:47.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.733+0000 7f62d77fe640 1 -- 172.21.15.38:0/2617114794 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f62e80fc4a0 con 0x7f62d006cc50 2024-09-13T18:36:47.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.735+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2617114794 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f62d006cc50 msgr2=0x7f62d006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.737 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.735+0000 7f62ecbfc640 1 --2- 172.21.15.38:0/2617114794 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f62d006cc50 0x7f62d006f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f62d8031460 tx=0x7f62d8005de0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.735+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2617114794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62e80ffcf0 msgr2=0x7f62e81010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.735+0000 7f62ecbfc640 1 --2- 172.21.15.38:0/2617114794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62e80ffcf0 0x7f62e81010d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00cc60 tx=0x7f62dc00a620 comp rx=0 tx=0).stop 2024-09-13T18:36:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.735+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2617114794 shutdown_connections 2024-09-13T18:36:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.735+0000 7f62ecbfc640 1 --2- 172.21.15.38:0/2617114794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62e80ffcf0 0x7f62e81010d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.735+0000 7f62ecbfc640 1 --2- 172.21.15.38:0/2617114794 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f62d006cc50 0x7f62d006f110 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.735+0000 7f62ecbfc640 1 --2- 172.21.15.38:0/2617114794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62e80feaf0 0x7f62e8102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.735+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2617114794 >> 172.21.15.38:0/2617114794 conn(0x7f62e80fa280 msgr2=0x7f62e80fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.735+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2617114794 shutdown_connections 2024-09-13T18:36:47.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.735+0000 7f62ecbfc640 1 -- 172.21.15.38:0/2617114794 wait complete. 2024-09-13T18:36:47.746 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:36:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.820+0000 7ffb3d061640 1 -- 172.21.15.38:0/1137330184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb38100630 msgr2=0x7ffb38102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.820+0000 7ffb3d061640 1 --2- 172.21.15.38:0/1137330184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb38100630 0x7ffb38102a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffb200098b0 tx=0x7ffb2002a4d0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.820+0000 7ffb3d061640 1 -- 172.21.15.38:0/1137330184 shutdown_connections 2024-09-13T18:36:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.820+0000 7ffb3d061640 1 --2- 172.21.15.38:0/1137330184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb38102f60 0x7ffb38105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.820+0000 7ffb3d061640 1 --2- 172.21.15.38:0/1137330184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb38100630 0x7ffb38102a20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.820+0000 7ffb3d061640 1 -- 172.21.15.38:0/1137330184 >> 172.21.15.38:0/1137330184 conn(0x7ffb380fa250 msgr2=0x7ffb380fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.820+0000 7ffb3d061640 1 -- 172.21.15.38:0/1137330184 shutdown_connections 2024-09-13T18:36:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.820+0000 7ffb3d061640 1 -- 172.21.15.38:0/1137330184 wait complete. 2024-09-13T18:36:47.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.821+0000 7ffb3d061640 1 Processor -- start 2024-09-13T18:36:47.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.821+0000 7ffb3d061640 1 -- start start 2024-09-13T18:36:47.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.821+0000 7ffb3d061640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb38100630 0x7ffb380fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.821+0000 7ffb3d061640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb38102f60 0x7ffb380fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.821+0000 7ffb3d061640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380feb20 con 0x7ffb38100630 2024-09-13T18:36:47.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.821+0000 7ffb3d061640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380fec90 con 0x7ffb38102f60 2024-09-13T18:36:47.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.821+0000 7ffb36d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb38100630 0x7ffb380fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.821+0000 7ffb36d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb38100630 0x7ffb380fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57386/0 (socket says 172.21.15.38:57386) 2024-09-13T18:36:47.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.821+0000 7ffb36d9d640 1 -- 172.21.15.38:0/3202580845 learned_addr learned my addr 172.21.15.38:0/3202580845 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:47.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.822+0000 7ffb3659c640 1 --2- 172.21.15.38:0/3202580845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb38102f60 0x7ffb380fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.822+0000 7ffb36d9d640 1 -- 172.21.15.38:0/3202580845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb38102f60 msgr2=0x7ffb380fe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.822+0000 7ffb36d9d640 1 --2- 172.21.15.38:0/3202580845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb38102f60 0x7ffb380fe5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.822+0000 7ffb36d9d640 1 -- 172.21.15.38:0/3202580845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb20009560 con 0x7ffb38100630 2024-09-13T18:36:47.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.822+0000 7ffb36d9d640 1 --2- 172.21.15.38:0/3202580845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb38100630 0x7ffb380fff90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffb20006010 tx=0x7ffb200055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.822+0000 7ffb2ffff640 1 -- 172.21.15.38:0/3202580845 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb20004aa0 con 0x7ffb38100630 2024-09-13T18:36:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.822+0000 7ffb3d061640 1 -- 172.21.15.38:0/3202580845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb380fef10 con 0x7ffb38100630 2024-09-13T18:36:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.822+0000 7ffb2ffff640 1 -- 172.21.15.38:0/3202580845 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb20004c00 con 0x7ffb38100630 2024-09-13T18:36:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.822+0000 7ffb2ffff640 1 -- 172.21.15.38:0/3202580845 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb20031a30 con 0x7ffb38100630 2024-09-13T18:36:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.822+0000 7ffb3d061640 1 -- 172.21.15.38:0/3202580845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3819d5e0 con 0x7ffb38100630 2024-09-13T18:36:47.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.823+0000 7ffb3d061640 1 -- 172.21.15.38:0/3202580845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb38100a10 con 0x7ffb38100630 2024-09-13T18:36:47.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.824+0000 7ffb2ffff640 1 -- 172.21.15.38:0/3202580845 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffb20031cf0 con 0x7ffb38100630 2024-09-13T18:36:47.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.824+0000 7ffb2ffff640 1 --2- 172.21.15.38:0/3202580845 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ffb2406cc60 0x7ffb2406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.824+0000 7ffb2ffff640 1 -- 172.21.15.38:0/3202580845 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6417+0+0 (secure 0 0 0) 0x7ffb200ad890 con 0x7ffb38100630 2024-09-13T18:36:47.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.824+0000 7ffb3659c640 1 --2- 172.21.15.38:0/3202580845 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ffb2406cc60 0x7ffb2406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.828 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.825+0000 7ffb3659c640 1 --2- 172.21.15.38:0/3202580845 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ffb2406cc60 0x7ffb2406f120 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffb28005fd0 tx=0x7ffb28005850 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:47.829+0000 7ffb2ffff640 1 -- 172.21.15.38:0/3202580845 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffb200778a0 con 0x7ffb38100630 2024-09-13T18:36:47.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:47 smithi038 ceph-mon[91522]: pgmap v218: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:47.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:47.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:47.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:47.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:47.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:47.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:47.992 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:47.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:47.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:47.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:47.993 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi038.dtnkqo"]}]: dispatch 2024-09-13T18:36:48.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.020+0000 7ffb3d061640 1 -- 172.21.15.38:0/3202580845 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb381039e0 con 0x7ffb2406cc60 2024-09-13T18:36:48.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.021+0000 7ffb2ffff640 1 -- 172.21.15.38:0/3202580845 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ffb381039e0 con 0x7ffb2406cc60 2024-09-13T18:36:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.023+0000 7ffb3d061640 1 -- 172.21.15.38:0/3202580845 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ffb2406cc60 msgr2=0x7ffb2406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.023+0000 7ffb3d061640 1 --2- 172.21.15.38:0/3202580845 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ffb2406cc60 0x7ffb2406f120 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffb28005fd0 tx=0x7ffb28005850 comp rx=0 tx=0).stop 2024-09-13T18:36:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.023+0000 7ffb3d061640 1 -- 172.21.15.38:0/3202580845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb38100630 msgr2=0x7ffb380fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.023+0000 7ffb3d061640 1 --2- 172.21.15.38:0/3202580845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb38100630 0x7ffb380fff90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffb20006010 tx=0x7ffb200055a0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.026 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.023+0000 7ffb3d061640 1 -- 172.21.15.38:0/3202580845 shutdown_connections 2024-09-13T18:36:48.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.023+0000 7ffb3d061640 1 --2- 172.21.15.38:0/3202580845 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ffb2406cc60 0x7ffb2406f120 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.023+0000 7ffb3d061640 1 --2- 172.21.15.38:0/3202580845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb38102f60 0x7ffb380fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.024+0000 7ffb3d061640 1 --2- 172.21.15.38:0/3202580845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb38100630 0x7ffb380fff90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.024+0000 7ffb3d061640 1 -- 172.21.15.38:0/3202580845 >> 172.21.15.38:0/3202580845 conn(0x7ffb380fa250 msgr2=0x7ffb380fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.024+0000 7ffb3d061640 1 -- 172.21.15.38:0/3202580845 shutdown_connections 2024-09-13T18:36:48.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.024+0000 7ffb3d061640 1 -- 172.21.15.38:0/3202580845 wait complete. 2024-09-13T18:36:48.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.107+0000 7f7c59557640 1 -- 172.21.15.38:0/3857803859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c540fee30 msgr2=0x7f7c540ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.107+0000 7f7c59557640 1 --2- 172.21.15.38:0/3857803859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c540fee30 0x7f7c540ff290 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009880 tx=0x7f7c4802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.107+0000 7f7c59557640 1 -- 172.21.15.38:0/3857803859 shutdown_connections 2024-09-13T18:36:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.107+0000 7f7c59557640 1 --2- 172.21.15.38:0/3857803859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c540fee30 0x7f7c540ff290 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.107+0000 7f7c59557640 1 --2- 172.21.15.38:0/3857803859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c540fe4f0 0x7f7c540fe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.108+0000 7f7c59557640 1 -- 172.21.15.38:0/3857803859 >> 172.21.15.38:0/3857803859 conn(0x7f7c540fa280 msgr2=0x7f7c540fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.108+0000 7f7c59557640 1 -- 172.21.15.38:0/3857803859 shutdown_connections 2024-09-13T18:36:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.108+0000 7f7c59557640 1 -- 172.21.15.38:0/3857803859 wait complete. 2024-09-13T18:36:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.108+0000 7f7c59557640 1 Processor -- start 2024-09-13T18:36:48.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.108+0000 7f7c59557640 1 -- start start 2024-09-13T18:36:48.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.108+0000 7f7c59557640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c540fe4f0 0x7f7c541977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.108+0000 7f7c59557640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c540fee30 0x7f7c54197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c59557640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c541982b0 con 0x7f7c540fe4f0 2024-09-13T18:36:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c59557640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54198420 con 0x7f7c540fee30 2024-09-13T18:36:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c52ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c540fe4f0 0x7f7c541977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c52ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c540fe4f0 0x7f7c541977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57396/0 (socket says 172.21.15.38:57396) 2024-09-13T18:36:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c52ffd640 1 -- 172.21.15.38:0/3844816754 learned_addr learned my addr 172.21.15.38:0/3844816754 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c527fc640 1 --2- 172.21.15.38:0/3844816754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c540fee30 0x7f7c54197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c52ffd640 1 -- 172.21.15.38:0/3844816754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c540fee30 msgr2=0x7f7c54197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c52ffd640 1 --2- 172.21.15.38:0/3844816754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c540fee30 0x7f7c54197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c52ffd640 1 -- 172.21.15.38:0/3844816754 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c48009560 con 0x7f7c540fe4f0 2024-09-13T18:36:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c52ffd640 1 --2- 172.21.15.38:0/3844816754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c540fe4f0 0x7f7c541977a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400d720 tx=0x7f7c4400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c3bfff640 1 -- 172.21.15.38:0/3844816754 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c440051f0 con 0x7f7c540fe4f0 2024-09-13T18:36:48.114 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c3bfff640 1 -- 172.21.15.38:0/3844816754 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7c44009820 con 0x7f7c540fe4f0 2024-09-13T18:36:48.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c59557640 1 -- 172.21.15.38:0/3844816754 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5419cec0 con 0x7f7c540fe4f0 2024-09-13T18:36:48.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.109+0000 7f7c3bfff640 1 -- 172.21.15.38:0/3844816754 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c44004d40 con 0x7f7c540fe4f0 2024-09-13T18:36:48.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.110+0000 7f7c59557640 1 -- 172.21.15.38:0/3844816754 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5419d380 con 0x7f7c540fe4f0 2024-09-13T18:36:48.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.110+0000 7f7c59557640 1 -- 172.21.15.38:0/3844816754 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c540fe8f0 con 0x7f7c540fe4f0 2024-09-13T18:36:48.115 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.111+0000 7f7c3bfff640 1 -- 172.21.15.38:0/3844816754 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7c44009990 con 0x7f7c540fe4f0 2024-09-13T18:36:48.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.111+0000 7f7c3bfff640 1 --2- 172.21.15.38:0/3844816754 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7c3c06cc50 0x7f7c3c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.112+0000 7f7c3bfff640 1 -- 172.21.15.38:0/3844816754 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f7c4408c120 con 0x7f7c540fe4f0 2024-09-13T18:36:48.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.112+0000 7f7c527fc640 1 --2- 172.21.15.38:0/3844816754 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7c3c06cc50 0x7f7c3c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.112+0000 7f7c527fc640 1 --2- 172.21.15.38:0/3844816754 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7c3c06cc50 0x7f7c3c06f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7c54198cc0 tx=0x7f7c48031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.116+0000 7f7c3bfff640 1 -- 172.21.15.38:0/3844816754 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7c440561b0 con 0x7f7c540fe4f0 2024-09-13T18:36:48.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:47 smithi149 ceph-mon[76906]: pgmap v218: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:36:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:36:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi038.dtnkqo"]}]: dispatch 2024-09-13T18:36:48.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.298+0000 7f7c59557640 1 -- 172.21.15.38:0/3844816754 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c54108240 con 0x7f7c3c06cc50 2024-09-13T18:36:48.311 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.309+0000 7f7c3bfff640 1 -- 172.21.15.38:0/3844816754 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7c54108240 con 0x7f7c3c06cc50 2024-09-13T18:36:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:36:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (13m) 5s ago 14m 24.9M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:36:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (14m) 5s ago 14m 8539k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:36:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (13m) 52s ago 13m 8212k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:36:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (4m) 5s ago 14m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:36:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (4m) 52s ago 13m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:36:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (12m) 5s ago 14m 87.6M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:36:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (8m) 5s ago 8m 155M - 18.2.4-845-ge4e227b3 67ddd33fa72f 6c7c0a00283c 2024-09-13T18:36:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (10s) 5s ago 8m 11.7M - 18.2.4-860-g6c6b083f 8a91f241d7d4 710abbbd3193 2024-09-13T18:36:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (8m) 52s ago 8m 25.7M - 18.2.4-845-ge4e227b3 67ddd33fa72f eb5d3e32d9bc 2024-09-13T18:36:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (8m) 52s ago 8m 25.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:36:48.312 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (5m) 5s ago 15m 498M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:36:48.313 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (4m) 52s ago 13m 440M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:36:48.313 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (4m) 5s ago 16m 53.6M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:36:48.313 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (4m) 52s ago 13m 41.1M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:36:48.313 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (14m) 5s ago 14m 15.7M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:36:48.313 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (13m) 52s ago 13m 15.5M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:36:48.313 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (3m) 5s ago 12m 133M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:36:48.313 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (3m) 5s ago 12m 98.3M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 b2f99a2919b9 2024-09-13T18:36:48.313 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (2m) 5s ago 11m 96.2M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 090af670cd3d 2024-09-13T18:36:48.313 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (118s) 52s ago 11m 106M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 e4321b085347 2024-09-13T18:36:48.313 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (87s) 52s ago 10m 98.6M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 c6ec97a4d9ff 2024-09-13T18:36:48.313 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (56s) 52s ago 10m 11.2M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 6faab71ae8a9 2024-09-13T18:36:48.313 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (4m) 5s ago 13m 66.8M - 2.43.0 a07b618ecd1d c04b1dcdc8c3 2024-09-13T18:36:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.311+0000 7f7c59557640 1 -- 172.21.15.38:0/3844816754 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7c3c06cc50 msgr2=0x7f7c3c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.311+0000 7f7c59557640 1 --2- 172.21.15.38:0/3844816754 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7c3c06cc50 0x7f7c3c06f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7c54198cc0 tx=0x7f7c48031400 comp rx=0 tx=0).stop 2024-09-13T18:36:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.311+0000 7f7c59557640 1 -- 172.21.15.38:0/3844816754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c540fe4f0 msgr2=0x7f7c541977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.311+0000 7f7c59557640 1 --2- 172.21.15.38:0/3844816754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c540fe4f0 0x7f7c541977a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400d720 tx=0x7f7c4400dbe0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.311+0000 7f7c59557640 1 -- 172.21.15.38:0/3844816754 shutdown_connections 2024-09-13T18:36:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.311+0000 7f7c59557640 1 --2- 172.21.15.38:0/3844816754 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f7c3c06cc50 0x7f7c3c06f110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.311+0000 7f7c59557640 1 --2- 172.21.15.38:0/3844816754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c540fee30 0x7f7c54197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.311+0000 7f7c59557640 1 --2- 172.21.15.38:0/3844816754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c540fe4f0 0x7f7c541977a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.311+0000 7f7c59557640 1 -- 172.21.15.38:0/3844816754 >> 172.21.15.38:0/3844816754 conn(0x7f7c540fa280 msgr2=0x7f7c54106b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.311+0000 7f7c59557640 1 -- 172.21.15.38:0/3844816754 shutdown_connections 2024-09-13T18:36:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.311+0000 7f7c59557640 1 -- 172.21.15.38:0/3844816754 wait complete. 2024-09-13T18:36:48.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.394+0000 7fd16900d640 1 -- 172.21.15.38:0/4065228268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd164102f40 msgr2=0x7fd164105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.394+0000 7fd16900d640 1 --2- 172.21.15.38:0/4065228268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd164102f40 0x7fd164105330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd1580098b0 tx=0x7fd15802a4d0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.394+0000 7fd16900d640 1 -- 172.21.15.38:0/4065228268 shutdown_connections 2024-09-13T18:36:48.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.394+0000 7fd16900d640 1 --2- 172.21.15.38:0/4065228268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd164102f40 0x7fd164105330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.394+0000 7fd16900d640 1 --2- 172.21.15.38:0/4065228268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd164100610 0x7fd164102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.397 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.394+0000 7fd16900d640 1 -- 172.21.15.38:0/4065228268 >> 172.21.15.38:0/4065228268 conn(0x7fd1640fa230 msgr2=0x7fd1640fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.394+0000 7fd16900d640 1 -- 172.21.15.38:0/4065228268 shutdown_connections 2024-09-13T18:36:48.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.394+0000 7fd16900d640 1 -- 172.21.15.38:0/4065228268 wait complete. 2024-09-13T18:36:48.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.395+0000 7fd16900d640 1 Processor -- start 2024-09-13T18:36:48.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.395+0000 7fd16900d640 1 -- start start 2024-09-13T18:36:48.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.395+0000 7fd16900d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd164100610 0x7fd1640fff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.395+0000 7fd16900d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd164102f40 0x7fd1640fe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.395+0000 7fd16900d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1640feb00 con 0x7fd164100610 2024-09-13T18:36:48.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.395+0000 7fd16900d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1640fec70 con 0x7fd164102f40 2024-09-13T18:36:48.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.395+0000 7fd162d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd164100610 0x7fd1640fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.396+0000 7fd162d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd164100610 0x7fd1640fff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57424/0 (socket says 172.21.15.38:57424) 2024-09-13T18:36:48.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.396+0000 7fd162d9d640 1 -- 172.21.15.38:0/4137853834 learned_addr learned my addr 172.21.15.38:0/4137853834 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:48.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.396+0000 7fd16259c640 1 --2- 172.21.15.38:0/4137853834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd164102f40 0x7fd1640fe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.396+0000 7fd162d9d640 1 -- 172.21.15.38:0/4137853834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd164102f40 msgr2=0x7fd1640fe5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.396+0000 7fd162d9d640 1 --2- 172.21.15.38:0/4137853834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd164102f40 0x7fd1640fe5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.396+0000 7fd162d9d640 1 -- 172.21.15.38:0/4137853834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd158009560 con 0x7fd164100610 2024-09-13T18:36:48.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.396+0000 7fd162d9d640 1 --2- 172.21.15.38:0/4137853834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd164100610 0x7fd1640fff70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd15400e970 tx=0x7fd15400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.396+0000 7fd14bfff640 1 -- 172.21.15.38:0/4137853834 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd15400cc90 con 0x7fd164100610 2024-09-13T18:36:48.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.396+0000 7fd14bfff640 1 -- 172.21.15.38:0/4137853834 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd15400cdf0 con 0x7fd164100610 2024-09-13T18:36:48.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.396+0000 7fd16900d640 1 -- 172.21.15.38:0/4137853834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1640fef50 con 0x7fd164100610 2024-09-13T18:36:48.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.396+0000 7fd14bfff640 1 -- 172.21.15.38:0/4137853834 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd154010430 con 0x7fd164100610 2024-09-13T18:36:48.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.396+0000 7fd16900d640 1 -- 172.21.15.38:0/4137853834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16419d5f0 con 0x7fd164100610 2024-09-13T18:36:48.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.397+0000 7fd16900d640 1 -- 172.21.15.38:0/4137853834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd164109020 con 0x7fd164100610 2024-09-13T18:36:48.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.398+0000 7fd14bfff640 1 -- 172.21.15.38:0/4137853834 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd1540046c0 con 0x7fd164100610 2024-09-13T18:36:48.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.398+0000 7fd14bfff640 1 --2- 172.21.15.38:0/4137853834 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd14c06cc50 0x7fd14c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.398+0000 7fd14bfff640 1 -- 172.21.15.38:0/4137853834 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fd154014070 con 0x7fd164100610 2024-09-13T18:36:48.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.398+0000 7fd16259c640 1 --2- 172.21.15.38:0/4137853834 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd14c06cc50 0x7fd14c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.399+0000 7fd16259c640 1 --2- 172.21.15.38:0/4137853834 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd14c06cc50 0x7fd14c06f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd158006010 tx=0x7fd158005d50 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.403+0000 7fd14bfff640 1 -- 172.21.15.38:0/4137853834 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd164109020 con 0x7fd164100610 2024-09-13T18:36:48.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.650+0000 7fd16900d640 1 -- 172.21.15.38:0/4137853834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd164109020 con 0x7fd164100610 2024-09-13T18:36:48.653 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.650+0000 7fd14bfff640 1 -- 172.21.15.38:0/4137853834 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+838 (secure 0 0 0) 0x7fd164109020 con 0x7fd164100610 2024-09-13T18:36:48.653 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:36:48.653 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:36:48.653 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:36:48.653 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:36:48.653 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:36:48.653 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 3, 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 1 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 3, 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 11 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:36:48.654 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:36:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.653+0000 7fd16900d640 1 -- 172.21.15.38:0/4137853834 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd14c06cc50 msgr2=0x7fd14c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.653+0000 7fd16900d640 1 --2- 172.21.15.38:0/4137853834 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd14c06cc50 0x7fd14c06f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd158006010 tx=0x7fd158005d50 comp rx=0 tx=0).stop 2024-09-13T18:36:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.653+0000 7fd16900d640 1 -- 172.21.15.38:0/4137853834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd164100610 msgr2=0x7fd1640fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.653+0000 7fd16900d640 1 --2- 172.21.15.38:0/4137853834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd164100610 0x7fd1640fff70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd15400e970 tx=0x7fd15400ed70 comp rx=0 tx=0).stop 2024-09-13T18:36:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.653+0000 7fd16900d640 1 -- 172.21.15.38:0/4137853834 shutdown_connections 2024-09-13T18:36:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.653+0000 7fd16900d640 1 --2- 172.21.15.38:0/4137853834 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd14c06cc50 0x7fd14c06f110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.653+0000 7fd16900d640 1 --2- 172.21.15.38:0/4137853834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd164102f40 0x7fd1640fe5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.653+0000 7fd16900d640 1 --2- 172.21.15.38:0/4137853834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd164100610 0x7fd1640fff70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.653+0000 7fd16900d640 1 -- 172.21.15.38:0/4137853834 >> 172.21.15.38:0/4137853834 conn(0x7fd1640fa230 msgr2=0x7fd1640fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.653+0000 7fd16900d640 1 -- 172.21.15.38:0/4137853834 shutdown_connections 2024-09-13T18:36:48.656 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.653+0000 7fd16900d640 1 -- 172.21.15.38:0/4137853834 wait complete. 2024-09-13T18:36:48.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.743+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/2622250834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a88103070 msgr2=0x7f5a88105460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.743+0000 7f5a8eb7f640 1 --2- 172.21.15.38:0/2622250834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a88103070 0x7f5a88105460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009880 tx=0x7f5a7c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.743+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/2622250834 shutdown_connections 2024-09-13T18:36:48.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.743+0000 7f5a8eb7f640 1 --2- 172.21.15.38:0/2622250834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a88103070 0x7f5a88105460 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.743+0000 7f5a8eb7f640 1 --2- 172.21.15.38:0/2622250834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a88100740 0x7f5a88102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.743+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/2622250834 >> 172.21.15.38:0/2622250834 conn(0x7f5a880fa280 msgr2=0x7f5a880fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.743+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/2622250834 shutdown_connections 2024-09-13T18:36:48.747 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.743+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/2622250834 wait complete. 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.743+0000 7f5a8eb7f640 1 Processor -- start 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.743+0000 7f5a8eb7f640 1 -- start start 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.743+0000 7f5a8eb7f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a88100740 0x7f5a881955e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.743+0000 7f5a8eb7f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a88103070 0x7f5a88195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a8eb7f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a881960f0 con 0x7f5a88103070 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a8eb7f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a88196260 con 0x7f5a88100740 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a88103070 0x7f5a88195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a87fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a88103070 0x7f5a88195b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57434/0 (socket says 172.21.15.38:57434) 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a87fff640 1 -- 172.21.15.38:0/501438988 learned_addr learned my addr 172.21.15.38:0/501438988 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a8c91b640 1 --2- 172.21.15.38:0/501438988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a88100740 0x7f5a881955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a87fff640 1 -- 172.21.15.38:0/501438988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a88100740 msgr2=0x7f5a881955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a87fff640 1 --2- 172.21.15.38:0/501438988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a88100740 0x7f5a881955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.748 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a87fff640 1 -- 172.21.15.38:0/501438988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c009560 con 0x7f5a88103070 2024-09-13T18:36:48.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a87fff640 1 --2- 172.21.15.38:0/501438988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a88103070 0x7f5a88195b20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c004c60 tx=0x7f5a7c004c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a85ffb640 1 -- 172.21.15.38:0/501438988 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a7c0053a0 con 0x7f5a88103070 2024-09-13T18:36:48.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/501438988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8819aca0 con 0x7f5a88103070 2024-09-13T18:36:48.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a85ffb640 1 -- 172.21.15.38:0/501438988 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5a7c005d50 con 0x7f5a88103070 2024-09-13T18:36:48.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.744+0000 7f5a85ffb640 1 -- 172.21.15.38:0/501438988 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a7c031840 con 0x7f5a88103070 2024-09-13T18:36:48.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.745+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/501438988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8819b190 con 0x7f5a88103070 2024-09-13T18:36:48.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.746+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/501438988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a881086c0 con 0x7f5a88103070 2024-09-13T18:36:48.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.746+0000 7f5a85ffb640 1 -- 172.21.15.38:0/501438988 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5a7c005500 con 0x7f5a88103070 2024-09-13T18:36:48.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.747+0000 7f5a85ffb640 1 --2- 172.21.15.38:0/501438988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5a7006cc50 0x7f5a7006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.747+0000 7f5a85ffb640 1 -- 172.21.15.38:0/501438988 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f5a7c0ad6f0 con 0x7f5a88103070 2024-09-13T18:36:48.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.747+0000 7f5a8c91b640 1 --2- 172.21.15.38:0/501438988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5a7006cc50 0x7f5a7006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.750 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.747+0000 7f5a8c91b640 1 --2- 172.21.15.38:0/501438988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5a7006cc50 0x7f5a7006f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009b60 tx=0x7f5a78005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.751+0000 7f5a85ffb640 1 -- 172.21.15.38:0/501438988 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5a7c077700 con 0x7f5a88103070 2024-09-13T18:36:48.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:48 smithi038 ceph-mon[91522]: Upgrade: It appears safe to stop mds.cephfs.smithi038.dtnkqo 2024-09-13T18:36:48.910 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:48 smithi038 ceph-mon[91522]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:48.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:48 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:48.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:48 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.dtnkqo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:36:48.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:48 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:48.911 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:48 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/4137853834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.966+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/501438988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5a8819b550 con 0x7f5a88103070 2024-09-13T18:36:48.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.966+0000 7f5a85ffb640 1 -- 172.21.15.38:0/501438988 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f5a7c07ad20 con 0x7f5a88103070 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi038.stdout:e24 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:36:48.970 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 21 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi038.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:36:21.675987+0000 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:36:48.971 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 0 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 1 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:in 0 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=14484} 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 1 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:36:48.972 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:36:48.973 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:36:48.973 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:36:48.973 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:36:48.973 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:36:48.973 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.38:6828/1171569676,v1:172.21.15.38:6829/1171569676] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:36:48.973 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:36:48.973 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:36:48.973 INFO:teuthology.orchestra.run.smithi038.stdout:Standby daemons: 2024-09-13T18:36:48.973 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:36:48.973 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{-1:34352} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:36:48.973 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{-1:44263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/3061943000,v1:172.21.15.149:6827/3061943000] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:36:48.973 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{-1:44297} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/522640114,v1:172.21.15.149:6825/522640114] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:36:48.974 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 24 2024-09-13T18:36:48.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.969+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/501438988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5a7006cc50 msgr2=0x7f5a7006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.969+0000 7f5a8eb7f640 1 --2- 172.21.15.38:0/501438988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5a7006cc50 0x7f5a7006f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009b60 tx=0x7f5a78005f90 comp rx=0 tx=0).stop 2024-09-13T18:36:48.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.969+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/501438988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a88103070 msgr2=0x7f5a88195b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.969+0000 7f5a8eb7f640 1 --2- 172.21.15.38:0/501438988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a88103070 0x7f5a88195b20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c004c60 tx=0x7f5a7c004c90 comp rx=0 tx=0).stop 2024-09-13T18:36:48.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.969+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/501438988 shutdown_connections 2024-09-13T18:36:48.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.969+0000 7f5a8eb7f640 1 --2- 172.21.15.38:0/501438988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a88103070 0x7f5a88195b20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.969+0000 7f5a8eb7f640 1 --2- 172.21.15.38:0/501438988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5a7006cc50 0x7f5a7006f110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.969+0000 7f5a8eb7f640 1 --2- 172.21.15.38:0/501438988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a88100740 0x7f5a881955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.969+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/501438988 >> 172.21.15.38:0/501438988 conn(0x7f5a880fa280 msgr2=0x7f5a880fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.969+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/501438988 shutdown_connections 2024-09-13T18:36:48.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:48.969+0000 7f5a8eb7f640 1 -- 172.21.15.38:0/501438988 wait complete. 2024-09-13T18:36:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.057+0000 7f45281eb640 1 -- 172.21.15.38:0/1613662267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4520072f10 msgr2=0x7f4520073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.057+0000 7f45281eb640 1 --2- 172.21.15.38:0/1613662267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4520072f10 0x7f4520073370 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4510009880 tx=0x7f451002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.057+0000 7f45281eb640 1 -- 172.21.15.38:0/1613662267 shutdown_connections 2024-09-13T18:36:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.057+0000 7f45281eb640 1 --2- 172.21.15.38:0/1613662267 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4520072f10 0x7f4520073370 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.057+0000 7f45281eb640 1 --2- 172.21.15.38:0/1613662267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45200744e0 0x7f4520072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.057+0000 7f45281eb640 1 -- 172.21.15.38:0/1613662267 >> 172.21.15.38:0/1613662267 conn(0x7f45200fb320 msgr2=0x7f45200fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.060 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.057+0000 7f45281eb640 1 -- 172.21.15.38:0/1613662267 shutdown_connections 2024-09-13T18:36:49.061 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.057+0000 7f45281eb640 1 -- 172.21.15.38:0/1613662267 wait complete. 2024-09-13T18:36:49.062 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f45281eb640 1 Processor -- start 2024-09-13T18:36:49.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f45281eb640 1 -- start start 2024-09-13T18:36:49.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f45281eb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4520072f10 0x7f452019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f45281eb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45200744e0 0x7f452019c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f45281eb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452019c630 con 0x7f45200744e0 2024-09-13T18:36:49.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f45281eb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452019c7a0 con 0x7f4520072f10 2024-09-13T18:36:49.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f4525786640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45200744e0 0x7f452019c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f4525786640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45200744e0 0x7f452019c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57450/0 (socket says 172.21.15.38:57450) 2024-09-13T18:36:49.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f4525786640 1 -- 172.21.15.38:0/3467003932 learned_addr learned my addr 172.21.15.38:0/3467003932 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:49.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f4525f87640 1 --2- 172.21.15.38:0/3467003932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4520072f10 0x7f452019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f4525786640 1 -- 172.21.15.38:0/3467003932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4520072f10 msgr2=0x7f452019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f4525786640 1 --2- 172.21.15.38:0/3467003932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4520072f10 0x7f452019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f4525786640 1 -- 172.21.15.38:0/3467003932 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510009560 con 0x7f45200744e0 2024-09-13T18:36:49.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.058+0000 7f4525f87640 1 --2- 172.21.15.38:0/3467003932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4520072f10 0x7f452019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:49.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.059+0000 7f4525786640 1 --2- 172.21.15.38:0/3467003932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45200744e0 0x7f452019c060 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4510006010 tx=0x7f4510005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.059+0000 7f4516ffd640 1 -- 172.21.15.38:0/3467003932 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4510004b20 con 0x7f45200744e0 2024-09-13T18:36:49.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.059+0000 7f4516ffd640 1 -- 172.21.15.38:0/3467003932 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4510004c80 con 0x7f45200744e0 2024-09-13T18:36:49.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.059+0000 7f45281eb640 1 -- 172.21.15.38:0/3467003932 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45201a11e0 con 0x7f45200744e0 2024-09-13T18:36:49.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.059+0000 7f4516ffd640 1 -- 172.21.15.38:0/3467003932 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45100319f0 con 0x7f45200744e0 2024-09-13T18:36:49.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.059+0000 7f45281eb640 1 -- 172.21.15.38:0/3467003932 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45201a1750 con 0x7f45200744e0 2024-09-13T18:36:49.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.060+0000 7f45281eb640 1 -- 172.21.15.38:0/3467003932 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452010ec70 con 0x7f45200744e0 2024-09-13T18:36:49.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.060+0000 7f4516ffd640 1 -- 172.21.15.38:0/3467003932 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4510003d00 con 0x7f45200744e0 2024-09-13T18:36:49.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.061+0000 7f4516ffd640 1 --2- 172.21.15.38:0/3467003932 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f450c06cc50 0x7f450c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.061+0000 7f4516ffd640 1 -- 172.21.15.38:0/3467003932 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6417+0+0 (secure 0 0 0) 0x7f45100ad7f0 con 0x7f45200744e0 2024-09-13T18:36:49.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.061+0000 7f4525f87640 1 --2- 172.21.15.38:0/3467003932 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f450c06cc50 0x7f450c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.065 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.061+0000 7f4525f87640 1 --2- 172.21.15.38:0/3467003932 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f450c06cc50 0x7f450c06f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f451c0058c0 tx=0x7f451c005850 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.065+0000 7f4516ffd640 1 -- 172.21.15.38:0/3467003932 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4510077800 con 0x7f45200744e0 2024-09-13T18:36:49.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.251+0000 7f45281eb640 1 -- 172.21.15.38:0/3467003932 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4520102c40 con 0x7f450c06cc50 2024-09-13T18:36:49.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.252+0000 7f4516ffd640 1 -- 172.21.15.38:0/3467003932 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4520102c40 con 0x7f450c06cc50 2024-09-13T18:36:49.255 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:36:49.255 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:36:49.255 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:36:49.255 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:36:49.255 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:36:49.255 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr", 2024-09-13T18:36:49.255 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-13T18:36:49.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd", 2024-09-13T18:36:49.256 INFO:teuthology.orchestra.run.smithi038.stdout: "mon" 2024-09-13T18:36:49.256 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:36:49.256 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "13/23 daemons upgraded", 2024-09-13T18:36:49.256 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T18:36:49.256 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:36:49.256 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:36:49.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.254+0000 7f45281eb640 1 -- 172.21.15.38:0/3467003932 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f450c06cc50 msgr2=0x7f450c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.254+0000 7f45281eb640 1 --2- 172.21.15.38:0/3467003932 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f450c06cc50 0x7f450c06f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f451c0058c0 tx=0x7f451c005850 comp rx=0 tx=0).stop 2024-09-13T18:36:49.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.254+0000 7f45281eb640 1 -- 172.21.15.38:0/3467003932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45200744e0 msgr2=0x7f452019c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.254+0000 7f45281eb640 1 --2- 172.21.15.38:0/3467003932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45200744e0 0x7f452019c060 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4510006010 tx=0x7f4510005610 comp rx=0 tx=0).stop 2024-09-13T18:36:49.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.254+0000 7f45281eb640 1 -- 172.21.15.38:0/3467003932 shutdown_connections 2024-09-13T18:36:49.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.254+0000 7f45281eb640 1 --2- 172.21.15.38:0/3467003932 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45200744e0 0x7f452019c060 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.254+0000 7f45281eb640 1 --2- 172.21.15.38:0/3467003932 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f450c06cc50 0x7f450c06f110 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.254+0000 7f45281eb640 1 --2- 172.21.15.38:0/3467003932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4520072f10 0x7f452019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.254+0000 7f45281eb640 1 -- 172.21.15.38:0/3467003932 >> 172.21.15.38:0/3467003932 conn(0x7f45200fb320 msgr2=0x7f4520101520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.255+0000 7f45281eb640 1 -- 172.21.15.38:0/3467003932 shutdown_connections 2024-09-13T18:36:49.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.255+0000 7f45281eb640 1 -- 172.21.15.38:0/3467003932 wait complete. 2024-09-13T18:36:49.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:48 smithi149 ceph-mon[76906]: Upgrade: It appears safe to stop mds.cephfs.smithi038.dtnkqo 2024-09-13T18:36:49.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:48 smithi149 ceph-mon[76906]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:49.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:48 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:49.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:48 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi038.dtnkqo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:36:49.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:48 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:36:49.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:48 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/4137853834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:36:49.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.339+0000 7fbd3db93640 1 -- 172.21.15.38:0/1320748654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd380ffb90 msgr2=0x7fbd380fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.339+0000 7fbd3db93640 1 --2- 172.21.15.38:0/1320748654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd380ffb90 0x7fbd380fff90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009880 tx=0x7fbd2802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.339+0000 7fbd3db93640 1 -- 172.21.15.38:0/1320748654 shutdown_connections 2024-09-13T18:36:49.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.339+0000 7fbd3db93640 1 --2- 172.21.15.38:0/1320748654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38100d90 0x7fbd38101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.339+0000 7fbd3db93640 1 --2- 172.21.15.38:0/1320748654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd380ffb90 0x7fbd380fff90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.339+0000 7fbd3db93640 1 -- 172.21.15.38:0/1320748654 >> 172.21.15.38:0/1320748654 conn(0x7fbd380fb320 msgr2=0x7fbd380fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.339+0000 7fbd3db93640 1 -- 172.21.15.38:0/1320748654 shutdown_connections 2024-09-13T18:36:49.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.339+0000 7fbd3db93640 1 -- 172.21.15.38:0/1320748654 wait complete. 2024-09-13T18:36:49.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.340+0000 7fbd3db93640 1 Processor -- start 2024-09-13T18:36:49.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.340+0000 7fbd3db93640 1 -- start start 2024-09-13T18:36:49.343 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.340+0000 7fbd3db93640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd380ffb90 0x7fbd38195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.340+0000 7fbd3db93640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38100d90 0x7fbd38195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.340+0000 7fbd3db93640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd38196040 con 0x7fbd380ffb90 2024-09-13T18:36:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.340+0000 7fbd3db93640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd381961b0 con 0x7fbd38100d90 2024-09-13T18:36:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.340+0000 7fbd377fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd380ffb90 0x7fbd38195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.340+0000 7fbd377fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd380ffb90 0x7fbd38195530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57470/0 (socket says 172.21.15.38:57470) 2024-09-13T18:36:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.340+0000 7fbd377fe640 1 -- 172.21.15.38:0/4102223409 learned_addr learned my addr 172.21.15.38:0/4102223409 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:36:49.344 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.340+0000 7fbd2effd640 1 --2- 172.21.15.38:0/4102223409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38100d90 0x7fbd38195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.341+0000 7fbd377fe640 1 -- 172.21.15.38:0/4102223409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38100d90 msgr2=0x7fbd38195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.341+0000 7fbd377fe640 1 --2- 172.21.15.38:0/4102223409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38100d90 0x7fbd38195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.341+0000 7fbd377fe640 1 -- 172.21.15.38:0/4102223409 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd28009560 con 0x7fbd380ffb90 2024-09-13T18:36:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.341+0000 7fbd2effd640 1 --2- 172.21.15.38:0/4102223409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38100d90 0x7fbd38195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.341+0000 7fbd377fe640 1 --2- 172.21.15.38:0/4102223409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd380ffb90 0x7fbd38195530 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbd28005520 tx=0x7fbd28005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.341+0000 7fbd357fa640 1 -- 172.21.15.38:0/4102223409 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd28004aa0 con 0x7fbd380ffb90 2024-09-13T18:36:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.341+0000 7fbd357fa640 1 -- 172.21.15.38:0/4102223409 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd28004c00 con 0x7fbd380ffb90 2024-09-13T18:36:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.341+0000 7fbd3db93640 1 -- 172.21.15.38:0/4102223409 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3819abf0 con 0x7fbd380ffb90 2024-09-13T18:36:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.341+0000 7fbd357fa640 1 -- 172.21.15.38:0/4102223409 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd28031920 con 0x7fbd380ffb90 2024-09-13T18:36:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.341+0000 7fbd3db93640 1 -- 172.21.15.38:0/4102223409 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3819b0e0 con 0x7fbd380ffb90 2024-09-13T18:36:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.342+0000 7fbd3db93640 1 -- 172.21.15.38:0/4102223409 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd38108640 con 0x7fbd380ffb90 2024-09-13T18:36:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.343+0000 7fbd357fa640 1 -- 172.21.15.38:0/4102223409 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbd28031be0 con 0x7fbd380ffb90 2024-09-13T18:36:49.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.343+0000 7fbd357fa640 1 --2- 172.21.15.38:0/4102223409 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbd2406cc50 0x7fbd2406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.344+0000 7fbd357fa640 1 -- 172.21.15.38:0/4102223409 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6417+0+0 (secure 0 0 0) 0x7fbd280ad840 con 0x7fbd380ffb90 2024-09-13T18:36:49.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.344+0000 7fbd2effd640 1 --2- 172.21.15.38:0/4102223409 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbd2406cc50 0x7fbd2406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.347 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.344+0000 7fbd2effd640 1 --2- 172.21.15.38:0/4102223409 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbd2406cc50 0x7fbd2406f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbd38196a50 tx=0x7fbd2000b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.352 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.348+0000 7fbd357fa640 1 -- 172.21.15.38:0/4102223409 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbd28077900 con 0x7fbd380ffb90 2024-09-13T18:36:49.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.592+0000 7fbd3db93640 1 -- 172.21.15.38:0/4102223409 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbd381087d0 con 0x7fbd380ffb90 2024-09-13T18:36:49.594 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.592+0000 7fbd357fa640 1 -- 172.21.15.38:0/4102223409 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbd2807af20 con 0x7fbd380ffb90 2024-09-13T18:36:49.595 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:36:49.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.594+0000 7fbd3db93640 1 -- 172.21.15.38:0/4102223409 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbd2406cc50 msgr2=0x7fbd2406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.594+0000 7fbd3db93640 1 --2- 172.21.15.38:0/4102223409 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbd2406cc50 0x7fbd2406f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbd38196a50 tx=0x7fbd2000b390 comp rx=0 tx=0).stop 2024-09-13T18:36:49.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.594+0000 7fbd3db93640 1 -- 172.21.15.38:0/4102223409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd380ffb90 msgr2=0x7fbd38195530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.594+0000 7fbd3db93640 1 --2- 172.21.15.38:0/4102223409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd380ffb90 0x7fbd38195530 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbd28005520 tx=0x7fbd28005550 comp rx=0 tx=0).stop 2024-09-13T18:36:49.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.594+0000 7fbd3db93640 1 -- 172.21.15.38:0/4102223409 shutdown_connections 2024-09-13T18:36:49.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.594+0000 7fbd3db93640 1 --2- 172.21.15.38:0/4102223409 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbd2406cc50 0x7fbd2406f110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.594+0000 7fbd3db93640 1 --2- 172.21.15.38:0/4102223409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd38100d90 0x7fbd38195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.597 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.594+0000 7fbd3db93640 1 --2- 172.21.15.38:0/4102223409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbd380ffb90 0x7fbd38195530 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.594+0000 7fbd3db93640 1 -- 172.21.15.38:0/4102223409 >> 172.21.15.38:0/4102223409 conn(0x7fbd380fb320 msgr2=0x7fbd38103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.594+0000 7fbd3db93640 1 -- 172.21.15.38:0/4102223409 shutdown_connections 2024-09-13T18:36:49.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:36:49.594+0000 7fbd3db93640 1 -- 172.21.15.38:0/4102223409 wait complete. 2024-09-13T18:36:49.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:49 smithi038 ceph-mon[91522]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:49.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:49 smithi038 ceph-mon[91522]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:49.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:49 smithi038 ceph-mon[91522]: pgmap v219: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:49.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:49 smithi038 ceph-mon[91522]: Upgrade: Updating mds.cephfs.smithi038.dtnkqo 2024-09-13T18:36:49.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:49 smithi038 ceph-mon[91522]: Deploying daemon mds.cephfs.smithi038.dtnkqo on smithi038 2024-09-13T18:36:49.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:49 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/501438988' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:36:49.866 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:49 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/4102223409' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:36:50.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:49 smithi149 ceph-mon[76906]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:50.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:49 smithi149 ceph-mon[76906]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:50.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:49 smithi149 ceph-mon[76906]: pgmap v219: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:50.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:49 smithi149 ceph-mon[76906]: Upgrade: Updating mds.cephfs.smithi038.dtnkqo 2024-09-13T18:36:50.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:49 smithi149 ceph-mon[76906]: Deploying daemon mds.cephfs.smithi038.dtnkqo on smithi038 2024-09-13T18:36:50.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:49 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/501438988' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:36:50.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:49 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/4102223409' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:36:50.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:50 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038[91518]: 2024-09-13T18:36:50.313+0000 7ff3ca53e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:36:50.769 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:36:50 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[85197]: 2024-09-13T18:36:50.341+0000 7f8e10c7c640 -1 bdev(0x55f685e44e00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 9 2024-09-13T18:36:50.769 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:36:50 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[85197]: 2024-09-13T18:36:50.341+0000 7f8e0f479640 -1 bdev(0x55f685e44e00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 8 2024-09-13T18:36:51.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:50 smithi149 ceph-mon[76906]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:51.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:50 smithi149 ceph-mon[76906]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T18:36:51.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:50 smithi149 ceph-mon[76906]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:36:51.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:50 smithi149 ceph-mon[76906]: osdmap e95: 6 total, 6 up, 6 in 2024-09-13T18:36:51.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:50 smithi149 ceph-mon[76906]: Standby daemon mds.cephfs.smithi038.ubvgaq assigned to filesystem cephfs as rank 0 2024-09-13T18:36:51.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:50 smithi149 ceph-mon[76906]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T18:36:51.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:50 smithi149 ceph-mon[76906]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T18:36:51.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:50 smithi149 ceph-mon[76906]: fsmap cephfs:1/1 {0=cephfs.smithi038.ubvgaq=up:replay} 2 up:standby 2024-09-13T18:36:51.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:50 smithi038 ceph-mon[91522]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:36:51.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:50 smithi038 ceph-mon[91522]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T18:36:51.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:50 smithi038 ceph-mon[91522]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:36:51.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:50 smithi038 ceph-mon[91522]: osdmap e95: 6 total, 6 up, 6 in 2024-09-13T18:36:51.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:50 smithi038 ceph-mon[91522]: Standby daemon mds.cephfs.smithi038.ubvgaq assigned to filesystem cephfs as rank 0 2024-09-13T18:36:51.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:50 smithi038 ceph-mon[91522]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T18:36:51.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:50 smithi038 ceph-mon[91522]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T18:36:51.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:50 smithi038 ceph-mon[91522]: fsmap cephfs:1/1 {0=cephfs.smithi038.ubvgaq=up:replay} 2 up:standby 2024-09-13T18:36:52.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:51 smithi149 ceph-mon[76906]: pgmap v221: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:52.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:52.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:36:52.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:51 smithi038 ceph-mon[91522]: pgmap v221: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:36:52.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:36:52.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:36:53.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:52 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dtnkqo"}]: dispatch 2024-09-13T18:36:53.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:52 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dtnkqo"}]: dispatch 2024-09-13T18:36:54.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:53 smithi149 ceph-mon[76906]: pgmap v222: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 0 op/s 2024-09-13T18:36:54.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:53 smithi038 ceph-mon[91522]: pgmap v222: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 0 op/s 2024-09-13T18:36:56.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:55 smithi149 ceph-mon[76906]: pgmap v223: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-13T18:36:56.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:55 smithi038 ceph-mon[91522]: pgmap v223: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-13T18:36:58.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:57 smithi149 ceph-mon[76906]: pgmap v224: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-13T18:36:58.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:57 smithi038 ceph-mon[91522]: pgmap v224: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-13T18:36:58.974 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:58 smithi038 ceph-mon[91522]: reconnect by client.24319 v1:172.21.15.38:0/3203947527 after 0 2024-09-13T18:36:58.975 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:58 smithi038 ceph-mon[91522]: reconnect by client.24323 v1:192.168.0.1:0/3153087224 after 0.000999981 2024-09-13T18:36:58.975 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:58 smithi038 ceph-mon[91522]: mds.? [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] up:reconnect 2024-09-13T18:36:58.975 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:58 smithi038 ceph-mon[91522]: fsmap cephfs:1/1 {0=cephfs.smithi038.ubvgaq=up:reconnect} 2 up:standby 2024-09-13T18:36:58.975 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:58 smithi038 ceph-mon[91522]: mds.? [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] up:rejoin 2024-09-13T18:36:58.975 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:58 smithi038 ceph-mon[91522]: fsmap cephfs:1/1 {0=cephfs.smithi038.ubvgaq=up:rejoin} 2 up:standby 2024-09-13T18:36:59.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:58 smithi149 ceph-mon[76906]: reconnect by client.24319 v1:172.21.15.38:0/3203947527 after 0 2024-09-13T18:36:59.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:58 smithi149 ceph-mon[76906]: reconnect by client.24323 v1:192.168.0.1:0/3153087224 after 0.000999981 2024-09-13T18:36:59.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:58 smithi149 ceph-mon[76906]: mds.? [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] up:reconnect 2024-09-13T18:36:59.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:58 smithi149 ceph-mon[76906]: fsmap cephfs:1/1 {0=cephfs.smithi038.ubvgaq=up:reconnect} 2 up:standby 2024-09-13T18:36:59.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:58 smithi149 ceph-mon[76906]: mds.? [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] up:rejoin 2024-09-13T18:36:59.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:58 smithi149 ceph-mon[76906]: fsmap cephfs:1/1 {0=cephfs.smithi038.ubvgaq=up:rejoin} 2 up:standby 2024-09-13T18:36:59.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:59 smithi038 ceph-mon[91522]: pgmap v225: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-13T18:36:59.914 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:36:59 smithi038 ceph-mon[91522]: daemon mds.cephfs.smithi038.ubvgaq is now active in filesystem cephfs as rank 0 2024-09-13T18:37:00.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:59 smithi149 ceph-mon[76906]: pgmap v225: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-13T18:37:00.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:36:59 smithi149 ceph-mon[76906]: daemon mds.cephfs.smithi038.ubvgaq is now active in filesystem cephfs as rank 0 2024-09-13T18:37:01.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:00 smithi038 ceph-mon[91522]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T18:37:01.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:00 smithi038 ceph-mon[91522]: Cluster is now healthy 2024-09-13T18:37:01.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:00 smithi038 ceph-mon[91522]: mds.? [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] up:active 2024-09-13T18:37:01.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:00 smithi038 ceph-mon[91522]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 2 up:standby 2024-09-13T18:37:01.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:01.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:01.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:00 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:01.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:00 smithi149 ceph-mon[76906]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T18:37:01.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:00 smithi149 ceph-mon[76906]: Cluster is now healthy 2024-09-13T18:37:01.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:00 smithi149 ceph-mon[76906]: mds.? [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] up:active 2024-09-13T18:37:01.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:00 smithi149 ceph-mon[76906]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 2 up:standby 2024-09-13T18:37:01.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:01.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:01.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:00 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:02.189 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:01 smithi038 ceph-mon[91522]: pgmap v226: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-13T18:37:02.189 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:01 smithi038 ceph-mon[91522]: mds.? [v2:172.21.15.38:6828/3278914810,v1:172.21.15.38:6829/3278914810] up:boot 2024-09-13T18:37:02.189 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:01 smithi038 ceph-mon[91522]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 3 up:standby 2024-09-13T18:37:02.189 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:01 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dtnkqo"}]: dispatch 2024-09-13T18:37:02.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:01 smithi149 ceph-mon[76906]: pgmap v226: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-13T18:37:02.193 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:01 smithi149 ceph-mon[76906]: mds.? [v2:172.21.15.38:6828/3278914810,v1:172.21.15.38:6829/3278914810] up:boot 2024-09-13T18:37:02.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:01 smithi149 ceph-mon[76906]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 3 up:standby 2024-09-13T18:37:02.194 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:01 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi038.dtnkqo"}]: dispatch 2024-09-13T18:37:03.949 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:03 smithi038 ceph-mon[91522]: pgmap v227: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T18:37:04.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:03 smithi149 ceph-mon[76906]: pgmap v227: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 6 op/s 2024-09-13T18:37:06.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:05 smithi149 ceph-mon[76906]: pgmap v228: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 426 B/s wr, 8 op/s 2024-09-13T18:37:06.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:06.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:06.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:05 smithi038 ceph-mon[91522]: pgmap v228: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 426 B/s wr, 8 op/s 2024-09-13T18:37:06.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:06.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:07.262 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:07.262 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:07.263 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:06 smithi149 ceph-mon[76906]: pgmap v229: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 7.9 MiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T18:37:07.263 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:07.263 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:37:07.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:07.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:07.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:06 smithi038 ceph-mon[91522]: pgmap v229: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 7.9 MiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T18:37:07.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:07.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:37:09.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:09 smithi149 ceph-mon[76906]: pgmap v230: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-09-13T18:37:09.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:09 smithi038 ceph-mon[91522]: pgmap v230: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-09-13T18:37:11.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:11 smithi149 ceph-mon[76906]: pgmap v231: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-09-13T18:37:11.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:11 smithi038 ceph-mon[91522]: pgmap v231: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-09-13T18:37:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:13 smithi149 ceph-mon[76906]: pgmap v232: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2024-09-13T18:37:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:37:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:14.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi149.doanhj"]}]: dispatch 2024-09-13T18:37:14.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:13 smithi038 ceph-mon[91522]: pgmap v232: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2024-09-13T18:37:14.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:14.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:14.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:14.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:37:14.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:14.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:14.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:14.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:14.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:14.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:14.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi149.doanhj"]}]: dispatch 2024-09-13T18:37:15.063 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:14 smithi149 ceph-mon[76906]: Upgrade: It appears safe to stop mds.cephfs.smithi149.doanhj 2024-09-13T18:37:15.063 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:14 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:15.063 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:14 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.doanhj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:37:15.063 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:14 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:15.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:14 smithi038 ceph-mon[91522]: Upgrade: It appears safe to stop mds.cephfs.smithi149.doanhj 2024-09-13T18:37:15.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:14 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:15.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:14 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.doanhj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:37:15.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:14 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:16.071 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:15 smithi149 ceph-mon[76906]: pgmap v233: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-13T18:37:16.072 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:15 smithi149 ceph-mon[76906]: Upgrade: Updating mds.cephfs.smithi149.doanhj 2024-09-13T18:37:16.072 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:15 smithi149 ceph-mon[76906]: Deploying daemon mds.cephfs.smithi149.doanhj on smithi149 2024-09-13T18:37:16.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:15 smithi038 ceph-mon[91522]: pgmap v233: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-09-13T18:37:16.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:15 smithi038 ceph-mon[91522]: Upgrade: Updating mds.cephfs.smithi149.doanhj 2024-09-13T18:37:16.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:15 smithi038 ceph-mon[91522]: Deploying daemon mds.cephfs.smithi149.doanhj on smithi149 2024-09-13T18:37:17.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:17 smithi038 ceph-mon[91522]: osdmap e96: 6 total, 6 up, 6 in 2024-09-13T18:37:17.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:17 smithi038 ceph-mon[91522]: pgmap v235: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s wr, 2 op/s 2024-09-13T18:37:17.585 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:17 smithi038 ceph-mon[91522]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 2 up:standby 2024-09-13T18:37:17.736 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:17 smithi149 ceph-mon[76906]: osdmap e96: 6 total, 6 up, 6 in 2024-09-13T18:37:17.736 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:17 smithi149 ceph-mon[76906]: pgmap v235: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s wr, 2 op/s 2024-09-13T18:37:17.736 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:17 smithi149 ceph-mon[76906]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 2 up:standby 2024-09-13T18:37:18.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:18 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:37:18.714 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:18 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:37:19.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:19 smithi149 ceph-mon[76906]: pgmap v236: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:19.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:19 smithi038 ceph-mon[91522]: pgmap v236: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:19.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.684+0000 7f100817e640 1 -- 172.21.15.38:0/3357107186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10000ffb90 msgr2=0x7f10000fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.684+0000 7f100817e640 1 --2- 172.21.15.38:0/3357107186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10000ffb90 0x7f10000fff90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009880 tx=0x7f0ffc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.684+0000 7f100817e640 1 -- 172.21.15.38:0/3357107186 shutdown_connections 2024-09-13T18:37:19.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.684+0000 7f100817e640 1 --2- 172.21.15.38:0/3357107186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1000100d90 0x7f1000101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.684+0000 7f100817e640 1 --2- 172.21.15.38:0/3357107186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f10000ffb90 0x7f10000fff90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.684+0000 7f100817e640 1 -- 172.21.15.38:0/3357107186 >> 172.21.15.38:0/3357107186 conn(0x7f10000fb320 msgr2=0x7f10000fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.684+0000 7f100817e640 1 -- 172.21.15.38:0/3357107186 shutdown_connections 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.684+0000 7f100817e640 1 -- 172.21.15.38:0/3357107186 wait complete. 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.684+0000 7f100817e640 1 Processor -- start 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.685+0000 7f100817e640 1 -- start start 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.685+0000 7f100817e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10000ffb90 0x7f1000195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.685+0000 7f100817e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1000100d90 0x7f1000195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.685+0000 7f100817e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1000196040 con 0x7f1000100d90 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.685+0000 7f100817e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10001961b0 con 0x7f10000ffb90 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.685+0000 7f1005719640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1000100d90 0x7f1000195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.685+0000 7f1005719640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1000100d90 0x7f1000195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40642/0 (socket says 172.21.15.38:40642) 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.685+0000 7f1005719640 1 -- 172.21.15.38:0/1356252076 learned_addr learned my addr 172.21.15.38:0/1356252076 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.685+0000 7f1005f1a640 1 --2- 172.21.15.38:0/1356252076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10000ffb90 0x7f1000195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.685+0000 7f1005719640 1 -- 172.21.15.38:0/1356252076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10000ffb90 msgr2=0x7f1000195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.685+0000 7f1005719640 1 --2- 172.21.15.38:0/1356252076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10000ffb90 0x7f1000195530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.685+0000 7f1005719640 1 -- 172.21.15.38:0/1356252076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc009560 con 0x7f1000100d90 2024-09-13T18:37:19.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.686+0000 7f1005719640 1 --2- 172.21.15.38:0/1356252076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1000100d90 0x7f1000195a70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000e9a0 tx=0x7f0ff000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.686+0000 7f0ff6ffd640 1 -- 172.21.15.38:0/1356252076 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff000cc90 con 0x7f1000100d90 2024-09-13T18:37:19.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.686+0000 7f100817e640 1 -- 172.21.15.38:0/1356252076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100019ac50 con 0x7f1000100d90 2024-09-13T18:37:19.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.686+0000 7f0ff6ffd640 1 -- 172.21.15.38:0/1356252076 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ff000cdf0 con 0x7f1000100d90 2024-09-13T18:37:19.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.686+0000 7f0ff6ffd640 1 -- 172.21.15.38:0/1356252076 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff0018770 con 0x7f1000100d90 2024-09-13T18:37:19.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.686+0000 7f100817e640 1 -- 172.21.15.38:0/1356252076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100019b220 con 0x7f1000100d90 2024-09-13T18:37:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.687+0000 7f100817e640 1 -- 172.21.15.38:0/1356252076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1000108640 con 0x7f1000100d90 2024-09-13T18:37:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.687+0000 7f0ff6ffd640 1 -- 172.21.15.38:0/1356252076 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0ff0010b60 con 0x7f1000100d90 2024-09-13T18:37:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.688+0000 7f0ff6ffd640 1 --2- 172.21.15.38:0/1356252076 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f0fec06cc50 0x7f0fec06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.688+0000 7f0ff6ffd640 1 -- 172.21.15.38:0/1356252076 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f0ff0014070 con 0x7f1000100d90 2024-09-13T18:37:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.688+0000 7f1005f1a640 1 --2- 172.21.15.38:0/1356252076 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f0fec06cc50 0x7f0fec06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.691 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.688+0000 7f1005f1a640 1 --2- 172.21.15.38:0/1356252076 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f0fec06cc50 0x7f0fec06f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc000c00 tx=0x7f0ffc031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.694 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.692+0000 7f0ff6ffd640 1 -- 172.21.15.38:0/1356252076 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0ff0052e20 con 0x7f1000100d90 2024-09-13T18:37:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.878+0000 7f100817e640 1 -- 172.21.15.38:0/1356252076 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f100019b470 con 0x7f0fec06cc50 2024-09-13T18:37:19.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.879+0000 7f0ff6ffd640 1 -- 172.21.15.38:0/1356252076 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f100019b470 con 0x7f0fec06cc50 2024-09-13T18:37:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.881+0000 7f100817e640 1 -- 172.21.15.38:0/1356252076 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f0fec06cc50 msgr2=0x7f0fec06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.881+0000 7f100817e640 1 --2- 172.21.15.38:0/1356252076 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f0fec06cc50 0x7f0fec06f110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc000c00 tx=0x7f0ffc031400 comp rx=0 tx=0).stop 2024-09-13T18:37:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.881+0000 7f100817e640 1 -- 172.21.15.38:0/1356252076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1000100d90 msgr2=0x7f1000195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.881+0000 7f100817e640 1 --2- 172.21.15.38:0/1356252076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1000100d90 0x7f1000195a70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000e9a0 tx=0x7f0ff000ee60 comp rx=0 tx=0).stop 2024-09-13T18:37:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.882+0000 7f100817e640 1 -- 172.21.15.38:0/1356252076 shutdown_connections 2024-09-13T18:37:19.884 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.882+0000 7f100817e640 1 --2- 172.21.15.38:0/1356252076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1000100d90 0x7f1000195a70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.882+0000 7f100817e640 1 --2- 172.21.15.38:0/1356252076 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f0fec06cc50 0x7f0fec06f110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.882+0000 7f100817e640 1 --2- 172.21.15.38:0/1356252076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10000ffb90 0x7f1000195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.882+0000 7f100817e640 1 -- 172.21.15.38:0/1356252076 >> 172.21.15.38:0/1356252076 conn(0x7f10000fb320 msgr2=0x7f1000103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.882+0000 7f100817e640 1 -- 172.21.15.38:0/1356252076 shutdown_connections 2024-09-13T18:37:19.885 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.882+0000 7f100817e640 1 -- 172.21.15.38:0/1356252076 wait complete. 2024-09-13T18:37:19.893 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:37:19.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.966+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/740310428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fb8103050 msgr2=0x7f3fb8105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.966+0000 7f3fbdb7d640 1 --2- 172.21.15.38:0/740310428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fb8103050 0x7f3fb8105440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009880 tx=0x7f3fa002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.966+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/740310428 shutdown_connections 2024-09-13T18:37:19.969 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.966+0000 7f3fbdb7d640 1 --2- 172.21.15.38:0/740310428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fb8103050 0x7f3fb8105440 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.966+0000 7f3fbdb7d640 1 --2- 172.21.15.38:0/740310428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fb8100720 0x7f3fb8102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.966+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/740310428 >> 172.21.15.38:0/740310428 conn(0x7f3fb80fa280 msgr2=0x7f3fb80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.967+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/740310428 shutdown_connections 2024-09-13T18:37:19.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.967+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/740310428 wait complete. 2024-09-13T18:37:19.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.967+0000 7f3fbdb7d640 1 Processor -- start 2024-09-13T18:37:19.971 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.967+0000 7f3fbdb7d640 1 -- start start 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.968+0000 7f3fbdb7d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fb8100720 0x7f3fb81955b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.968+0000 7f3fbdb7d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fb8103050 0x7f3fb8195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.968+0000 7f3fbdb7d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb81960c0 con 0x7f3fb8100720 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.968+0000 7f3fbdb7d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8196230 con 0x7f3fb8103050 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.968+0000 7f3fb77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fb8100720 0x7f3fb81955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.968+0000 7f3fb77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fb8100720 0x7f3fb81955b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40672/0 (socket says 172.21.15.38:40672) 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.968+0000 7f3fb77fe640 1 -- 172.21.15.38:0/2494569413 learned_addr learned my addr 172.21.15.38:0/2494569413 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.968+0000 7f3faeffd640 1 --2- 172.21.15.38:0/2494569413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fb8103050 0x7f3fb8195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.968+0000 7f3fb77fe640 1 -- 172.21.15.38:0/2494569413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fb8103050 msgr2=0x7f3fb8195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.968+0000 7f3fb77fe640 1 --2- 172.21.15.38:0/2494569413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fb8103050 0x7f3fb8195af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.968+0000 7f3fb77fe640 1 -- 172.21.15.38:0/2494569413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa0009560 con 0x7f3fb8100720 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.968+0000 7f3faeffd640 1 --2- 172.21.15.38:0/2494569413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fb8103050 0x7f3fb8195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:19.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.969+0000 7f3fb77fe640 1 --2- 172.21.15.38:0/2494569413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fb8100720 0x7f3fb81955b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800d900 tx=0x7f3fa800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.969+0000 7f3fb57fa640 1 -- 172.21.15.38:0/2494569413 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa8009c00 con 0x7f3fb8100720 2024-09-13T18:37:19.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.969+0000 7f3fb57fa640 1 -- 172.21.15.38:0/2494569413 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3fa80044c0 con 0x7f3fb8100720 2024-09-13T18:37:19.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.969+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/2494569413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb819acd0 con 0x7f3fb8100720 2024-09-13T18:37:19.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.969+0000 7f3fb57fa640 1 -- 172.21.15.38:0/2494569413 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa80049d0 con 0x7f3fb8100720 2024-09-13T18:37:19.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.969+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/2494569413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb819b1c0 con 0x7f3fb8100720 2024-09-13T18:37:19.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.970+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/2494569413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb8108690 con 0x7f3fb8100720 2024-09-13T18:37:19.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.971+0000 7f3fb57fa640 1 -- 172.21.15.38:0/2494569413 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3fa80050b0 con 0x7f3fb8100720 2024-09-13T18:37:19.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.971+0000 7f3fb57fa640 1 --2- 172.21.15.38:0/2494569413 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f3fa406cc50 0x7f3fa406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.972+0000 7f3fb57fa640 1 -- 172.21.15.38:0/2494569413 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f3fa808c440 con 0x7f3fb8100720 2024-09-13T18:37:19.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.972+0000 7f3faeffd640 1 --2- 172.21.15.38:0/2494569413 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f3fa406cc50 0x7f3fa406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.972+0000 7f3faeffd640 1 --2- 172.21.15.38:0/2494569413 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f3fa406cc50 0x7f3fa406f110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0031460 tx=0x7f3fa0005de0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:19.976+0000 7f3fb57fa640 1 -- 172.21.15.38:0/2494569413 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3fa8056400 con 0x7f3fb8100720 2024-09-13T18:37:20.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.165+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/2494569413 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fb819b440 con 0x7f3fa406cc50 2024-09-13T18:37:20.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.166+0000 7f3fb57fa640 1 -- 172.21.15.38:0/2494569413 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3fb819b440 con 0x7f3fa406cc50 2024-09-13T18:37:20.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.168+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/2494569413 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f3fa406cc50 msgr2=0x7f3fa406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.168+0000 7f3fbdb7d640 1 --2- 172.21.15.38:0/2494569413 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f3fa406cc50 0x7f3fa406f110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0031460 tx=0x7f3fa0005de0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.168+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/2494569413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fb8100720 msgr2=0x7f3fb81955b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.168+0000 7f3fbdb7d640 1 --2- 172.21.15.38:0/2494569413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fb8100720 0x7f3fb81955b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800d900 tx=0x7f3fa800ddc0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.168+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/2494569413 shutdown_connections 2024-09-13T18:37:20.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.168+0000 7f3fbdb7d640 1 --2- 172.21.15.38:0/2494569413 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f3fa406cc50 0x7f3fa406f110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.168+0000 7f3fbdb7d640 1 --2- 172.21.15.38:0/2494569413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fb8103050 0x7f3fb8195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.168+0000 7f3fbdb7d640 1 --2- 172.21.15.38:0/2494569413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3fb8100720 0x7f3fb81955b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.168+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/2494569413 >> 172.21.15.38:0/2494569413 conn(0x7f3fb80fa280 msgr2=0x7f3fb80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:20.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.168+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/2494569413 shutdown_connections 2024-09-13T18:37:20.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.168+0000 7f3fbdb7d640 1 -- 172.21.15.38:0/2494569413 wait complete. 2024-09-13T18:37:20.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.251+0000 7fe1c6614640 1 -- 172.21.15.38:0/2049229324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c0103050 msgr2=0x7fe1c0105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.251+0000 7fe1c6614640 1 --2- 172.21.15.38:0/2049229324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c0103050 0x7fe1c0105440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009880 tx=0x7fe1b402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.252+0000 7fe1c6614640 1 -- 172.21.15.38:0/2049229324 shutdown_connections 2024-09-13T18:37:20.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.252+0000 7fe1c6614640 1 --2- 172.21.15.38:0/2049229324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c0103050 0x7fe1c0105440 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.252+0000 7fe1c6614640 1 --2- 172.21.15.38:0/2049229324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1c0100720 0x7fe1c0102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.258 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.252+0000 7fe1c6614640 1 -- 172.21.15.38:0/2049229324 >> 172.21.15.38:0/2049229324 conn(0x7fe1c00fa280 msgr2=0x7fe1c00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.252+0000 7fe1c6614640 1 -- 172.21.15.38:0/2049229324 shutdown_connections 2024-09-13T18:37:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.252+0000 7fe1c6614640 1 -- 172.21.15.38:0/2049229324 wait complete. 2024-09-13T18:37:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.252+0000 7fe1c6614640 1 Processor -- start 2024-09-13T18:37:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.252+0000 7fe1c6614640 1 -- start start 2024-09-13T18:37:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.253+0000 7fe1c6614640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c0100720 0x7fe1c0100080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.253+0000 7fe1c6614640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1c0103050 0x7fe1c00fe6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.253+0000 7fe1c6614640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00fec10 con 0x7fe1c0100720 2024-09-13T18:37:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.253+0000 7fe1c6614640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00fed80 con 0x7fe1c0103050 2024-09-13T18:37:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.253+0000 7fe1bffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c0100720 0x7fe1c0100080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.253+0000 7fe1bffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c0100720 0x7fe1c0100080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40690/0 (socket says 172.21.15.38:40690) 2024-09-13T18:37:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.253+0000 7fe1bffff640 1 -- 172.21.15.38:0/121283264 learned_addr learned my addr 172.21.15.38:0/121283264 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:20.260 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.253+0000 7fe1bf7fe640 1 --2- 172.21.15.38:0/121283264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1c0103050 0x7fe1c00fe6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.253+0000 7fe1bffff640 1 -- 172.21.15.38:0/121283264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1c0103050 msgr2=0x7fe1c00fe6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.253+0000 7fe1bffff640 1 --2- 172.21.15.38:0/121283264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1c0103050 0x7fe1c00fe6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.253+0000 7fe1bffff640 1 -- 172.21.15.38:0/121283264 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b4009560 con 0x7fe1c0100720 2024-09-13T18:37:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.254+0000 7fe1bffff640 1 --2- 172.21.15.38:0/121283264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c0100720 0x7fe1c0100080 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000d8d0 tx=0x7fe1b000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.254+0000 7fe1bd7fa640 1 -- 172.21.15.38:0/121283264 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1b000bea0 con 0x7fe1c0100720 2024-09-13T18:37:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.254+0000 7fe1bd7fa640 1 -- 172.21.15.38:0/121283264 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1b0009c00 con 0x7fe1c0100720 2024-09-13T18:37:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.254+0000 7fe1c6614640 1 -- 172.21.15.38:0/121283264 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c00ff060 con 0x7fe1c0100720 2024-09-13T18:37:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.254+0000 7fe1bd7fa640 1 -- 172.21.15.38:0/121283264 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1b000f680 con 0x7fe1c0100720 2024-09-13T18:37:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.254+0000 7fe1c6614640 1 -- 172.21.15.38:0/121283264 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c019d610 con 0x7fe1c0100720 2024-09-13T18:37:20.261 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.255+0000 7fe1c6614640 1 -- 172.21.15.38:0/121283264 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c0109060 con 0x7fe1c0100720 2024-09-13T18:37:20.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.256+0000 7fe1bd7fa640 1 -- 172.21.15.38:0/121283264 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe1b0010460 con 0x7fe1c0100720 2024-09-13T18:37:20.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.256+0000 7fe1bd7fa640 1 --2- 172.21.15.38:0/121283264 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe1a806cc50 0x7fe1a806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.256+0000 7fe1bd7fa640 1 -- 172.21.15.38:0/121283264 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fe1b008c2d0 con 0x7fe1c0100720 2024-09-13T18:37:20.262 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.257+0000 7fe1bf7fe640 1 --2- 172.21.15.38:0/121283264 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe1a806cc50 0x7fe1a806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.257+0000 7fe1bf7fe640 1 --2- 172.21.15.38:0/121283264 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe1a806cc50 0x7fe1a806f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4000c00 tx=0x7fe1b4031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.263 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.261+0000 7fe1bd7fa640 1 -- 172.21.15.38:0/121283264 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe1c0109060 con 0x7fe1c0100720 2024-09-13T18:37:20.447 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.444+0000 7fe1c6614640 1 -- 172.21.15.38:0/121283264 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1c0108ff0 con 0x7fe1a806cc50 2024-09-13T18:37:20.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.453+0000 7fe1bd7fa640 1 -- 172.21.15.38:0/121283264 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fe1c0108ff0 con 0x7fe1a806cc50 2024-09-13T18:37:20.456 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:37:20.456 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (13m) 15s ago 14m 24.9M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:37:20.456 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (15m) 15s ago 15m 8564k - 18.2.4-845-ge4e227b3 67ddd33fa72f 785ca9a1a7d5 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (14m) 85s ago 14m 8212k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (4m) 15s ago 15m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (4m) 85s ago 14m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (13m) 15s ago 14m 89.1M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (20s) 15s ago 9m 13.0M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1ed3b623871d 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (42s) 15s ago 9m 83.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 710abbbd3193 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 starting - - - - 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (9m) 85s ago 9m 25.6M - 18.2.4-845-ge4e227b3 67ddd33fa72f d72571e7b301 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (6m) 15s ago 16m 498M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (5m) 85s ago 14m 440M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (5m) 15s ago 16m 51.9M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (4m) 85s ago 13m 41.1M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (15m) 15s ago 15m 15.4M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:37:20.457 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (14m) 85s ago 14m 15.5M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:37:20.458 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (4m) 15s ago 13m 137M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:37:20.458 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (3m) 15s ago 12m 107M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 b2f99a2919b9 2024-09-13T18:37:20.458 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (3m) 15s ago 12m 103M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 090af670cd3d 2024-09-13T18:37:20.458 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (2m) 85s ago 11m 106M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 e4321b085347 2024-09-13T18:37:20.458 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (119s) 85s ago 11m 98.6M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 c6ec97a4d9ff 2024-09-13T18:37:20.458 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (88s) 85s ago 11m 11.2M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 6faab71ae8a9 2024-09-13T18:37:20.458 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (5m) 15s ago 14m 66.9M - 2.43.0 a07b618ecd1d c04b1dcdc8c3 2024-09-13T18:37:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.456+0000 7fe1c6614640 1 -- 172.21.15.38:0/121283264 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe1a806cc50 msgr2=0x7fe1a806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.456+0000 7fe1c6614640 1 --2- 172.21.15.38:0/121283264 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe1a806cc50 0x7fe1a806f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4000c00 tx=0x7fe1b4031400 comp rx=0 tx=0).stop 2024-09-13T18:37:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.456+0000 7fe1c6614640 1 -- 172.21.15.38:0/121283264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c0100720 msgr2=0x7fe1c0100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.456+0000 7fe1c6614640 1 --2- 172.21.15.38:0/121283264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c0100720 0x7fe1c0100080 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000d8d0 tx=0x7fe1b000dd90 comp rx=0 tx=0).stop 2024-09-13T18:37:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.456+0000 7fe1c6614640 1 -- 172.21.15.38:0/121283264 shutdown_connections 2024-09-13T18:37:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.456+0000 7fe1c6614640 1 --2- 172.21.15.38:0/121283264 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe1a806cc50 0x7fe1a806f110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.456+0000 7fe1c6614640 1 --2- 172.21.15.38:0/121283264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1c0103050 0x7fe1c00fe6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.456+0000 7fe1c6614640 1 --2- 172.21.15.38:0/121283264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe1c0100720 0x7fe1c0100080 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.456+0000 7fe1c6614640 1 -- 172.21.15.38:0/121283264 >> 172.21.15.38:0/121283264 conn(0x7fe1c00fa280 msgr2=0x7fe1c00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.456+0000 7fe1c6614640 1 -- 172.21.15.38:0/121283264 shutdown_connections 2024-09-13T18:37:20.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.456+0000 7fe1c6614640 1 -- 172.21.15.38:0/121283264 wait complete. 2024-09-13T18:37:20.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.539+0000 7f1adfdbc640 1 -- 172.21.15.38:0/3729393878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80ffb90 msgr2=0x7f1ad80fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.539+0000 7f1adfdbc640 1 --2- 172.21.15.38:0/3729393878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80ffb90 0x7f1ad80fff90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009880 tx=0x7f1ad402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.542 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.539+0000 7f1adfdbc640 1 -- 172.21.15.38:0/3729393878 shutdown_connections 2024-09-13T18:37:20.542 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:20 smithi038 ceph-mon[91522]: mds.? [v2:172.21.15.149:6824/248866776,v1:172.21.15.149:6825/248866776] up:boot 2024-09-13T18:37:20.542 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:20 smithi038 ceph-mon[91522]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 3 up:standby 2024-09-13T18:37:20.542 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:37:20.543 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:20.543 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:20.543 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:20.543 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:20 smithi038 ceph-mon[91522]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:20.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.539+0000 7f1adfdbc640 1 --2- 172.21.15.38:0/3729393878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad8100d90 0x7f1ad8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.539+0000 7f1adfdbc640 1 --2- 172.21.15.38:0/3729393878 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad80ffb90 0x7f1ad80fff90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.544 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.539+0000 7f1adfdbc640 1 -- 172.21.15.38:0/3729393878 >> 172.21.15.38:0/3729393878 conn(0x7f1ad80fb320 msgr2=0x7f1ad80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.539+0000 7f1adfdbc640 1 -- 172.21.15.38:0/3729393878 shutdown_connections 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.539+0000 7f1adfdbc640 1 -- 172.21.15.38:0/3729393878 wait complete. 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.540+0000 7f1adfdbc640 1 Processor -- start 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.540+0000 7f1adfdbc640 1 -- start start 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.540+0000 7f1adfdbc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80ffb90 0x7f1ad8074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.540+0000 7f1adfdbc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad8100d90 0x7f1ad80728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.540+0000 7f1adfdbc640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8072de0 con 0x7f1ad8100d90 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.540+0000 7f1adfdbc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8072f50 con 0x7f1ad80ffb90 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.540+0000 7f1add357640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad8100d90 0x7f1ad80728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1addb58640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80ffb90 0x7f1ad8074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1add357640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad8100d90 0x7f1ad80728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40722/0 (socket says 172.21.15.38:40722) 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1add357640 1 -- 172.21.15.38:0/1098563457 learned_addr learned my addr 172.21.15.38:0/1098563457 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1add357640 1 -- 172.21.15.38:0/1098563457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80ffb90 msgr2=0x7f1ad8074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1add357640 1 --2- 172.21.15.38:0/1098563457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80ffb90 0x7f1ad8074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1add357640 1 -- 172.21.15.38:0/1098563457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4009560 con 0x7f1ad8100d90 2024-09-13T18:37:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1addb58640 1 --2- 172.21.15.38:0/1098563457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80ffb90 0x7f1ad8074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1add357640 1 --2- 172.21.15.38:0/1098563457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad8100d90 0x7f1ad80728a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800e970 tx=0x7f1ac800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1aceffd640 1 -- 172.21.15.38:0/1098563457 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ac800cc90 con 0x7f1ad8100d90 2024-09-13T18:37:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1aceffd640 1 -- 172.21.15.38:0/1098563457 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1ac800cdf0 con 0x7f1ad8100d90 2024-09-13T18:37:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1adfdbc640 1 -- 172.21.15.38:0/1098563457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad8073230 con 0x7f1ad8100d90 2024-09-13T18:37:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1aceffd640 1 -- 172.21.15.38:0/1098563457 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ac8010430 con 0x7f1ad8100d90 2024-09-13T18:37:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.541+0000 7f1adfdbc640 1 -- 172.21.15.38:0/1098563457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad819d5e0 con 0x7f1ad8100d90 2024-09-13T18:37:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.542+0000 7f1adfdbc640 1 -- 172.21.15.38:0/1098563457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad818f5f0 con 0x7f1ad8100d90 2024-09-13T18:37:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.543+0000 7f1aceffd640 1 -- 172.21.15.38:0/1098563457 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1ac80046c0 con 0x7f1ad8100d90 2024-09-13T18:37:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.543+0000 7f1aceffd640 1 --2- 172.21.15.38:0/1098563457 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1ac406cc50 0x7f1ac406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.544+0000 7f1aceffd640 1 -- 172.21.15.38:0/1098563457 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f1ac8014070 con 0x7f1ad8100d90 2024-09-13T18:37:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.544+0000 7f1addb58640 1 --2- 172.21.15.38:0/1098563457 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1ac406cc50 0x7f1ac406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.544+0000 7f1addb58640 1 --2- 172.21.15.38:0/1098563457 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1ac406cc50 0x7f1ac406f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4000c00 tx=0x7f1ad4031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.550 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.548+0000 7f1aceffd640 1 -- 172.21.15.38:0/1098563457 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1ac8056a90 con 0x7f1ad8100d90 2024-09-13T18:37:20.669 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:20 smithi149 ceph-mon[76906]: mds.? [v2:172.21.15.149:6824/248866776,v1:172.21.15.149:6825/248866776] up:boot 2024-09-13T18:37:20.669 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:20 smithi149 ceph-mon[76906]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 3 up:standby 2024-09-13T18:37:20.669 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:37:20.669 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:20.669 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:20.669 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:20.669 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:20 smithi149 ceph-mon[76906]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:20.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.789+0000 7f1adfdbc640 1 -- 172.21.15.38:0/1098563457 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1ad8108660 con 0x7f1ad8100d90 2024-09-13T18:37:20.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.790+0000 7f1aceffd640 1 -- 172.21.15.38:0/1098563457 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+838 (secure 0 0 0) 0x7f1ac805a0b0 con 0x7f1ad8100d90 2024-09-13T18:37:20.792 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:37:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:37:20.792 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 1, 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 3 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:37:20.793 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-845-ge4e227b3 (e4e227b37858f5109138494e01e5ba1ba7b8ffe8) reef (stable)": 1, 2024-09-13T18:37:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 13 2024-09-13T18:37:20.794 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:37:20.794 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:37:20.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.792+0000 7f1adfdbc640 1 -- 172.21.15.38:0/1098563457 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1ac406cc50 msgr2=0x7f1ac406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.794 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.792+0000 7f1adfdbc640 1 --2- 172.21.15.38:0/1098563457 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1ac406cc50 0x7f1ac406f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4000c00 tx=0x7f1ad4031400 comp rx=0 tx=0).stop 2024-09-13T18:37:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.792+0000 7f1adfdbc640 1 -- 172.21.15.38:0/1098563457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad8100d90 msgr2=0x7f1ad80728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.792+0000 7f1adfdbc640 1 --2- 172.21.15.38:0/1098563457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad8100d90 0x7f1ad80728a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800e970 tx=0x7f1ac800ed70 comp rx=0 tx=0).stop 2024-09-13T18:37:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.792+0000 7f1adfdbc640 1 -- 172.21.15.38:0/1098563457 shutdown_connections 2024-09-13T18:37:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.792+0000 7f1adfdbc640 1 --2- 172.21.15.38:0/1098563457 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ad8100d90 0x7f1ad80728a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.792+0000 7f1adfdbc640 1 --2- 172.21.15.38:0/1098563457 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f1ac406cc50 0x7f1ac406f110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.792+0000 7f1adfdbc640 1 --2- 172.21.15.38:0/1098563457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ad80ffb90 0x7f1ad8074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.792+0000 7f1adfdbc640 1 -- 172.21.15.38:0/1098563457 >> 172.21.15.38:0/1098563457 conn(0x7f1ad80fb320 msgr2=0x7f1ad81044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.792+0000 7f1adfdbc640 1 -- 172.21.15.38:0/1098563457 shutdown_connections 2024-09-13T18:37:20.795 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.792+0000 7f1adfdbc640 1 -- 172.21.15.38:0/1098563457 wait complete. 2024-09-13T18:37:20.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.875+0000 7f659868f640 1 -- 172.21.15.38:0/399533173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65900fde50 msgr2=0x7f65900fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.879 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.875+0000 7f659868f640 1 --2- 172.21.15.38:0/399533173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65900fde50 0x7f65900fe250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f658c009880 tx=0x7f658c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.875+0000 7f659868f640 1 -- 172.21.15.38:0/399533173 shutdown_connections 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.875+0000 7f659868f640 1 --2- 172.21.15.38:0/399533173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6590100e30 0x7f65901012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.875+0000 7f659868f640 1 --2- 172.21.15.38:0/399533173 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65900fde50 0x7f65900fe250 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.875+0000 7f659868f640 1 -- 172.21.15.38:0/399533173 >> 172.21.15.38:0/399533173 conn(0x7f65900f99c0 msgr2=0x7f65900fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.875+0000 7f659868f640 1 -- 172.21.15.38:0/399533173 shutdown_connections 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.875+0000 7f659868f640 1 -- 172.21.15.38:0/399533173 wait complete. 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.876+0000 7f659868f640 1 Processor -- start 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.876+0000 7f659868f640 1 -- start start 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.876+0000 7f659868f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65900fde50 0x7f6590195520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.876+0000 7f659868f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6590100e30 0x7f6590195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.876+0000 7f659868f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590196030 con 0x7f65900fde50 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.876+0000 7f659868f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65901961a0 con 0x7f6590100e30 2024-09-13T18:37:20.880 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.876+0000 7f659642b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65900fde50 0x7f6590195520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.876+0000 7f659642b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65900fde50 0x7f6590195520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40744/0 (socket says 172.21.15.38:40744) 2024-09-13T18:37:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.876+0000 7f659642b640 1 -- 172.21.15.38:0/3389135323 learned_addr learned my addr 172.21.15.38:0/3389135323 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.876+0000 7f6595c2a640 1 --2- 172.21.15.38:0/3389135323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6590100e30 0x7f6590195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.877+0000 7f659642b640 1 -- 172.21.15.38:0/3389135323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6590100e30 msgr2=0x7f6590195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.877+0000 7f659642b640 1 --2- 172.21.15.38:0/3389135323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6590100e30 0x7f6590195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.877+0000 7f659642b640 1 -- 172.21.15.38:0/3389135323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c009560 con 0x7f65900fde50 2024-09-13T18:37:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.877+0000 7f659642b640 1 --2- 172.21.15.38:0/3389135323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65900fde50 0x7f6590195520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f658c004650 tx=0x7f658c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.877+0000 7f65837fe640 1 -- 172.21.15.38:0/3389135323 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f658c004aa0 con 0x7f65900fde50 2024-09-13T18:37:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.877+0000 7f65837fe640 1 -- 172.21.15.38:0/3389135323 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f658c005d50 con 0x7f65900fde50 2024-09-13T18:37:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.877+0000 7f659868f640 1 -- 172.21.15.38:0/3389135323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659019abe0 con 0x7f65900fde50 2024-09-13T18:37:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.877+0000 7f65837fe640 1 -- 172.21.15.38:0/3389135323 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f658c031950 con 0x7f65900fde50 2024-09-13T18:37:20.881 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.877+0000 7f659868f640 1 -- 172.21.15.38:0/3389135323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659019b0d0 con 0x7f65900fde50 2024-09-13T18:37:20.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.878+0000 7f659868f640 1 -- 172.21.15.38:0/3389135323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6590108630 con 0x7f65900fde50 2024-09-13T18:37:20.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.879+0000 7f65837fe640 1 -- 172.21.15.38:0/3389135323 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f658c003c20 con 0x7f65900fde50 2024-09-13T18:37:20.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.879+0000 7f65837fe640 1 --2- 172.21.15.38:0/3389135323 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f657c06cc60 0x7f657c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.882 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.879+0000 7f65837fe640 1 -- 172.21.15.38:0/3389135323 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f658c0ad6c0 con 0x7f65900fde50 2024-09-13T18:37:20.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.879+0000 7f6595c2a640 1 --2- 172.21.15.38:0/3389135323 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f657c06cc60 0x7f657c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.883 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.880+0000 7f6595c2a640 1 --2- 172.21.15.38:0/3389135323 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f657c06cc60 0x7f657c06f120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6590196a40 tx=0x7f6584005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.886 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:20.884+0000 7f65837fe640 1 -- 172.21.15.38:0/3389135323 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f658c077730 con 0x7f65900fde50 2024-09-13T18:37:21.095 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.093+0000 7f659868f640 1 -- 172.21.15.38:0/3389135323 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f659019b2f0 con 0x7f65900fde50 2024-09-13T18:37:21.096 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.093+0000 7f65837fe640 1 -- 172.21.15.38:0/3389135323 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1849 (secure 0 0 0) 0x7f658c07ad50 con 0x7f65900fde50 2024-09-13T18:37:21.096 INFO:teuthology.orchestra.run.smithi038.stdout:e32 2024-09-13T18:37:21.096 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:37:21.096 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:37:21.096 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 29 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:36:59.904752+0000 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:37:21.097 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 95 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 1 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:in 0 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=34352} 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 1 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:37:21.098 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:37:21.099 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:37:21.099 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:37:21.099 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:34352} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:37:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:37:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:37:21.099 INFO:teuthology.orchestra.run.smithi038.stdout:Standby daemons: 2024-09-13T18:37:21.099 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:37:21.099 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{-1:34384} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.38:6828/3278914810,v1:172.21.15.38:6829/3278914810] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:37:21.099 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{-1:44263} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/3061943000,v1:172.21.15.149:6827/3061943000] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:37:21.099 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{-1:44325} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/248866776,v1:172.21.15.149:6825/248866776] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:37:21.100 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 32 2024-09-13T18:37:21.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.095+0000 7f659868f640 1 -- 172.21.15.38:0/3389135323 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f657c06cc60 msgr2=0x7f657c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.095+0000 7f659868f640 1 --2- 172.21.15.38:0/3389135323 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f657c06cc60 0x7f657c06f120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6590196a40 tx=0x7f6584005f90 comp rx=0 tx=0).stop 2024-09-13T18:37:21.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.095+0000 7f659868f640 1 -- 172.21.15.38:0/3389135323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65900fde50 msgr2=0x7f6590195520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.095+0000 7f659868f640 1 --2- 172.21.15.38:0/3389135323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65900fde50 0x7f6590195520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f658c004650 tx=0x7f658c0055a0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.095+0000 7f659868f640 1 -- 172.21.15.38:0/3389135323 shutdown_connections 2024-09-13T18:37:21.100 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.095+0000 7f659868f640 1 --2- 172.21.15.38:0/3389135323 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f657c06cc60 0x7f657c06f120 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.095+0000 7f659868f640 1 --2- 172.21.15.38:0/3389135323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6590100e30 0x7f6590195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.095+0000 7f659868f640 1 --2- 172.21.15.38:0/3389135323 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f65900fde50 0x7f6590195520 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.095+0000 7f659868f640 1 -- 172.21.15.38:0/3389135323 >> 172.21.15.38:0/3389135323 conn(0x7f65900f99c0 msgr2=0x7f6590104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:21.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.096+0000 7f659868f640 1 -- 172.21.15.38:0/3389135323 shutdown_connections 2024-09-13T18:37:21.101 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.096+0000 7f659868f640 1 -- 172.21.15.38:0/3389135323 wait complete. 2024-09-13T18:37:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.180+0000 7f4dd3432640 1 -- 172.21.15.38:0/3870975321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dcc100d90 msgr2=0x7f4dcc101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.180+0000 7f4dd3432640 1 --2- 172.21.15.38:0/3870975321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dcc100d90 0x7f4dcc101210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009880 tx=0x7f4dbc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.180+0000 7f4dd3432640 1 -- 172.21.15.38:0/3870975321 shutdown_connections 2024-09-13T18:37:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.180+0000 7f4dd3432640 1 --2- 172.21.15.38:0/3870975321 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dcc100d90 0x7f4dcc101210 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.180+0000 7f4dd3432640 1 --2- 172.21.15.38:0/3870975321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dcc0ffb90 0x7f4dcc0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.180+0000 7f4dd3432640 1 -- 172.21.15.38:0/3870975321 >> 172.21.15.38:0/3870975321 conn(0x7f4dcc0fb360 msgr2=0x7f4dcc0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.180+0000 7f4dd3432640 1 -- 172.21.15.38:0/3870975321 shutdown_connections 2024-09-13T18:37:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.180+0000 7f4dd3432640 1 -- 172.21.15.38:0/3870975321 wait complete. 2024-09-13T18:37:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd3432640 1 Processor -- start 2024-09-13T18:37:21.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd3432640 1 -- start start 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd3432640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dcc0ffb90 0x7f4dcc195550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd3432640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dcc100d90 0x7f4dcc195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd3432640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc196060 con 0x7f4dcc0ffb90 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd3432640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc1961d0 con 0x7f4dcc100d90 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd11ce640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dcc0ffb90 0x7f4dcc195550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd11ce640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dcc0ffb90 0x7f4dcc195550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40752/0 (socket says 172.21.15.38:40752) 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd11ce640 1 -- 172.21.15.38:0/690563370 learned_addr learned my addr 172.21.15.38:0/690563370 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd09cd640 1 --2- 172.21.15.38:0/690563370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dcc100d90 0x7f4dcc195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd11ce640 1 -- 172.21.15.38:0/690563370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dcc100d90 msgr2=0x7f4dcc195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd11ce640 1 --2- 172.21.15.38:0/690563370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dcc100d90 0x7f4dcc195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd11ce640 1 -- 172.21.15.38:0/690563370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc009560 con 0x7f4dcc0ffb90 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.181+0000 7f4dd09cd640 1 --2- 172.21.15.38:0/690563370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dcc100d90 0x7f4dcc195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:21.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.182+0000 7f4dd11ce640 1 --2- 172.21.15.38:0/690563370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dcc0ffb90 0x7f4dcc195550 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800d900 tx=0x7f4dc800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:21.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.182+0000 7f4dc27fc640 1 -- 172.21.15.38:0/690563370 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc8009c00 con 0x7f4dcc0ffb90 2024-09-13T18:37:21.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.182+0000 7f4dc27fc640 1 -- 172.21.15.38:0/690563370 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4dc8009d60 con 0x7f4dcc0ffb90 2024-09-13T18:37:21.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.182+0000 7f4dd3432640 1 -- 172.21.15.38:0/690563370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dcc19ac70 con 0x7f4dcc0ffb90 2024-09-13T18:37:21.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.182+0000 7f4dc27fc640 1 -- 172.21.15.38:0/690563370 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc800f5f0 con 0x7f4dcc0ffb90 2024-09-13T18:37:21.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.182+0000 7f4dd3432640 1 -- 172.21.15.38:0/690563370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc19b1c0 con 0x7f4dcc0ffb90 2024-09-13T18:37:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.183+0000 7f4dd3432640 1 -- 172.21.15.38:0/690563370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dcc18f5f0 con 0x7f4dcc0ffb90 2024-09-13T18:37:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.183+0000 7f4dc27fc640 1 -- 172.21.15.38:0/690563370 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4dc8010460 con 0x7f4dcc0ffb90 2024-09-13T18:37:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.184+0000 7f4dc27fc640 1 --2- 172.21.15.38:0/690563370 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4db806cc60 0x7f4db806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.184+0000 7f4dc27fc640 1 -- 172.21.15.38:0/690563370 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f4dc808c450 con 0x7f4dcc0ffb90 2024-09-13T18:37:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.184+0000 7f4dd09cd640 1 --2- 172.21.15.38:0/690563370 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4db806cc60 0x7f4db806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.185+0000 7f4dd09cd640 1 --2- 172.21.15.38:0/690563370 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4db806cc60 0x7f4db806f120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc031460 tx=0x7f4dbc000bc0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:21.191 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.188+0000 7f4dc27fc640 1 -- 172.21.15.38:0/690563370 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4dc8056490 con 0x7f4dcc0ffb90 2024-09-13T18:37:21.381 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.378+0000 7f4dd3432640 1 -- 172.21.15.38:0/690563370 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dcc02c550 con 0x7f4db806cc60 2024-09-13T18:37:21.381 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:21 smithi038 ceph-mon[91522]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:21.381 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:21 smithi038 ceph-mon[91522]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:21.381 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:21 smithi038 ceph-mon[91522]: pgmap v237: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:21.381 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:21 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1098563457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:21.382 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:21 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3389135323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:37:21.382 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.380+0000 7f4dc27fc640 1 -- 172.21.15.38:0/690563370 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4dcc02c550 con 0x7f4db806cc60 2024-09-13T18:37:21.382 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:37:21.382 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:37:21.382 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:37:21.382 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:37:21.382 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:37:21.383 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr", 2024-09-13T18:37:21.383 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-13T18:37:21.383 INFO:teuthology.orchestra.run.smithi038.stdout: "osd", 2024-09-13T18:37:21.383 INFO:teuthology.orchestra.run.smithi038.stdout: "mon" 2024-09-13T18:37:21.383 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:37:21.383 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "14/23 daemons upgraded", 2024-09-13T18:37:21.383 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T18:37:21.383 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:37:21.383 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:37:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.381+0000 7f4dd3432640 1 -- 172.21.15.38:0/690563370 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4db806cc60 msgr2=0x7f4db806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.381+0000 7f4dd3432640 1 --2- 172.21.15.38:0/690563370 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4db806cc60 0x7f4db806f120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc031460 tx=0x7f4dbc000bc0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.381+0000 7f4dd3432640 1 -- 172.21.15.38:0/690563370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dcc0ffb90 msgr2=0x7f4dcc195550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.384 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.381+0000 7f4dd3432640 1 --2- 172.21.15.38:0/690563370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dcc0ffb90 0x7f4dcc195550 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800d900 tx=0x7f4dc800ddc0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.382+0000 7f4dd3432640 1 -- 172.21.15.38:0/690563370 shutdown_connections 2024-09-13T18:37:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.382+0000 7f4dd3432640 1 --2- 172.21.15.38:0/690563370 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4db806cc60 0x7f4db806f120 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.382+0000 7f4dd3432640 1 --2- 172.21.15.38:0/690563370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dcc100d90 0x7f4dcc195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.382+0000 7f4dd3432640 1 --2- 172.21.15.38:0/690563370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4dcc0ffb90 0x7f4dcc195550 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.382+0000 7f4dd3432640 1 -- 172.21.15.38:0/690563370 >> 172.21.15.38:0/690563370 conn(0x7f4dcc0fb360 msgr2=0x7f4dcc1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.382+0000 7f4dd3432640 1 -- 172.21.15.38:0/690563370 shutdown_connections 2024-09-13T18:37:21.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.382+0000 7f4dd3432640 1 -- 172.21.15.38:0/690563370 wait complete. 2024-09-13T18:37:21.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.465+0000 7f74816d9640 1 -- 172.21.15.38:0/2898512836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c0ffb80 msgr2=0x7f747c0fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.465+0000 7f74816d9640 1 --2- 172.21.15.38:0/2898512836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c0ffb80 0x7f747c0fff80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f746c009880 tx=0x7f746c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.465+0000 7f74816d9640 1 -- 172.21.15.38:0/2898512836 shutdown_connections 2024-09-13T18:37:21.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.465+0000 7f74816d9640 1 --2- 172.21.15.38:0/2898512836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f747c100d80 0x7f747c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.465+0000 7f74816d9640 1 --2- 172.21.15.38:0/2898512836 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c0ffb80 0x7f747c0fff80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.465+0000 7f74816d9640 1 -- 172.21.15.38:0/2898512836 >> 172.21.15.38:0/2898512836 conn(0x7f747c0fb330 msgr2=0x7f747c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:21.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.465+0000 7f74816d9640 1 -- 172.21.15.38:0/2898512836 shutdown_connections 2024-09-13T18:37:21.471 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.465+0000 7f74816d9640 1 -- 172.21.15.38:0/2898512836 wait complete. 2024-09-13T18:37:21.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.466+0000 7f74816d9640 1 Processor -- start 2024-09-13T18:37:21.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.466+0000 7f74816d9640 1 -- start start 2024-09-13T18:37:21.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.466+0000 7f74816d9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f747c0ffb80 0x7f747c195540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.466+0000 7f74816d9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c100d80 0x7f747c195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.466+0000 7f74816d9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c196050 con 0x7f747c100d80 2024-09-13T18:37:21.473 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.466+0000 7f74816d9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c1961c0 con 0x7f747c0ffb80 2024-09-13T18:37:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.466+0000 7f747a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c100d80 0x7f747c195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.466+0000 7f747a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c100d80 0x7f747c195a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:40776/0 (socket says 172.21.15.38:40776) 2024-09-13T18:37:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.466+0000 7f747a7fc640 1 -- 172.21.15.38:0/2287936677 learned_addr learned my addr 172.21.15.38:0/2287936677 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.466+0000 7f747affd640 1 --2- 172.21.15.38:0/2287936677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f747c0ffb80 0x7f747c195540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.467+0000 7f747a7fc640 1 -- 172.21.15.38:0/2287936677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f747c0ffb80 msgr2=0x7f747c195540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.467+0000 7f747a7fc640 1 --2- 172.21.15.38:0/2287936677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f747c0ffb80 0x7f747c195540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.467+0000 7f747a7fc640 1 -- 172.21.15.38:0/2287936677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c009560 con 0x7f747c100d80 2024-09-13T18:37:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.467+0000 7f747a7fc640 1 --2- 172.21.15.38:0/2287936677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c100d80 0x7f747c195a80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f747000d720 tx=0x7f747000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.467+0000 7f7463fff640 1 -- 172.21.15.38:0/2287936677 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74700051f0 con 0x7f747c100d80 2024-09-13T18:37:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.467+0000 7f74816d9640 1 -- 172.21.15.38:0/2287936677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c19ac60 con 0x7f747c100d80 2024-09-13T18:37:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.467+0000 7f7463fff640 1 -- 172.21.15.38:0/2287936677 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7470009820 con 0x7f747c100d80 2024-09-13T18:37:21.474 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.467+0000 7f7463fff640 1 -- 172.21.15.38:0/2287936677 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7470004d40 con 0x7f747c100d80 2024-09-13T18:37:21.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.467+0000 7f74816d9640 1 -- 172.21.15.38:0/2287936677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c19b230 con 0x7f747c100d80 2024-09-13T18:37:21.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.468+0000 7f74816d9640 1 -- 172.21.15.38:0/2287936677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c108650 con 0x7f747c100d80 2024-09-13T18:37:21.475 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.469+0000 7f7463fff640 1 -- 172.21.15.38:0/2287936677 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7470009990 con 0x7f747c100d80 2024-09-13T18:37:21.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.469+0000 7f7463fff640 1 --2- 172.21.15.38:0/2287936677 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f746406cc50 0x7f746406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.469+0000 7f7463fff640 1 -- 172.21.15.38:0/2287936677 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f747008c170 con 0x7f747c100d80 2024-09-13T18:37:21.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.469+0000 7f747affd640 1 --2- 172.21.15.38:0/2287936677 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f746406cc50 0x7f746406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.476 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.470+0000 7f747affd640 1 --2- 172.21.15.38:0/2287936677 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f746406cc50 0x7f746406f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f746c000c00 tx=0x7f746c031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:21.477 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.474+0000 7f7463fff640 1 -- 172.21.15.38:0/2287936677 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f74700561e0 con 0x7f747c100d80 2024-09-13T18:37:21.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:21 smithi149 ceph-mon[76906]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:21.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:21 smithi149 ceph-mon[76906]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:21.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:21 smithi149 ceph-mon[76906]: pgmap v237: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:21.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:21 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1098563457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:21.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:21 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3389135323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:37:21.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.731+0000 7f74816d9640 1 -- 172.21.15.38:0/2287936677 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f747c1087e0 con 0x7f747c100d80 2024-09-13T18:37:21.733 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.731+0000 7f7463fff640 1 -- 172.21.15.38:0/2287936677 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7470009c40 con 0x7f747c100d80 2024-09-13T18:37:21.734 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.733+0000 7f74816d9640 1 -- 172.21.15.38:0/2287936677 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f746406cc50 msgr2=0x7f746406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.733+0000 7f74816d9640 1 --2- 172.21.15.38:0/2287936677 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f746406cc50 0x7f746406f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f746c000c00 tx=0x7f746c031400 comp rx=0 tx=0).stop 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.733+0000 7f74816d9640 1 -- 172.21.15.38:0/2287936677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c100d80 msgr2=0x7f747c195a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.733+0000 7f74816d9640 1 --2- 172.21.15.38:0/2287936677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c100d80 0x7f747c195a80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f747000d720 tx=0x7f747000dbe0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.733+0000 7f74816d9640 1 -- 172.21.15.38:0/2287936677 shutdown_connections 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.733+0000 7f74816d9640 1 --2- 172.21.15.38:0/2287936677 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f747c100d80 0x7f747c195a80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.733+0000 7f74816d9640 1 --2- 172.21.15.38:0/2287936677 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f746406cc50 0x7f746406f110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.733+0000 7f74816d9640 1 --2- 172.21.15.38:0/2287936677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f747c0ffb80 0x7f747c195540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.733+0000 7f74816d9640 1 -- 172.21.15.38:0/2287936677 >> 172.21.15.38:0/2287936677 conn(0x7f747c0fb330 msgr2=0x7f747c103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.733+0000 7f74816d9640 1 -- 172.21.15.38:0/2287936677 shutdown_connections 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:21.733+0000 7f74816d9640 1 -- 172.21.15.38:0/2287936677 wait complete. 2024-09-13T18:37:22.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:22 smithi149 ceph-mon[76906]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:22.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:22 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:37:22.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:22 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2287936677' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:37:22.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:22 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:22.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:22 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:22.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:22 smithi038 ceph-mon[91522]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:22.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:22 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:37:22.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:22 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2287936677' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:37:22.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:22 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:22.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:22 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:23.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:23 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:23.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:23 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:23.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:23 smithi149 ceph-mon[76906]: pgmap v238: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:23.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:23 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:23.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:23 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:23.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:23 smithi038 ceph-mon[91522]: pgmap v238: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:25.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:25 smithi149 ceph-mon[76906]: pgmap v239: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:25.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:25 smithi038 ceph-mon[91522]: pgmap v239: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:26.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:37:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:26 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi149.zdzwzb"]}]: dispatch 2024-09-13T18:37:26.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:26 smithi149 ceph-mon[76906]: Upgrade: It appears safe to stop mds.cephfs.smithi149.zdzwzb 2024-09-13T18:37:26.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:26.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:26.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:26.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:37:26.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:26.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:26.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:26.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:26.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:26.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:26.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:26 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi149.zdzwzb"]}]: dispatch 2024-09-13T18:37:26.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:26 smithi038 ceph-mon[91522]: Upgrade: It appears safe to stop mds.cephfs.smithi149.zdzwzb 2024-09-13T18:37:27.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:27 smithi149 ceph-mon[76906]: pgmap v240: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:27.692 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:27 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:27.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:27 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.zdzwzb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:37:27.693 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:27 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:27 smithi038 ceph-mon[91522]: pgmap v240: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:27 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:27 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi149.zdzwzb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:37:27.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:27 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:28.663 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:28 smithi149 ceph-mon[76906]: Upgrade: Updating mds.cephfs.smithi149.zdzwzb 2024-09-13T18:37:28.663 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:28 smithi149 ceph-mon[76906]: Deploying daemon mds.cephfs.smithi149.zdzwzb on smithi149 2024-09-13T18:37:28.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:28 smithi038 ceph-mon[91522]: Upgrade: Updating mds.cephfs.smithi149.zdzwzb 2024-09-13T18:37:28.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:28 smithi038 ceph-mon[91522]: Deploying daemon mds.cephfs.smithi149.zdzwzb on smithi149 2024-09-13T18:37:30.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:29 smithi149 ceph-mon[76906]: pgmap v241: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:30.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:29 smithi149 ceph-mon[76906]: osdmap e97: 6 total, 6 up, 6 in 2024-09-13T18:37:30.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:29 smithi149 ceph-mon[76906]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 2 up:standby 2024-09-13T18:37:30.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:29 smithi038 ceph-mon[91522]: pgmap v241: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:30.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:29 smithi038 ceph-mon[91522]: osdmap e97: 6 total, 6 up, 6 in 2024-09-13T18:37:30.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:29 smithi038 ceph-mon[91522]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 2 up:standby 2024-09-13T18:37:31.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:30 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:37:31.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:30 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:37:32.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:31 smithi149 ceph-mon[76906]: pgmap v243: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:32.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:31 smithi038 ceph-mon[91522]: pgmap v243: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:34.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:33 smithi149 ceph-mon[76906]: pgmap v244: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:34.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:33 smithi038 ceph-mon[91522]: pgmap v244: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:35.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:34 smithi149 ceph-mon[76906]: mds.? [v2:172.21.15.149:6826/3248503653,v1:172.21.15.149:6827/3248503653] up:boot 2024-09-13T18:37:35.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:34 smithi149 ceph-mon[76906]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 3 up:standby 2024-09-13T18:37:35.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:34 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:37:35.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:34 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:35.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:34 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:35.253 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:34 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:35.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:34 smithi038 ceph-mon[91522]: mds.? [v2:172.21.15.149:6826/3248503653,v1:172.21.15.149:6827/3248503653] up:boot 2024-09-13T18:37:35.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:34 smithi038 ceph-mon[91522]: fsmap cephfs:1 {0=cephfs.smithi038.ubvgaq=up:active} 3 up:standby 2024-09-13T18:37:35.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:34 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:37:35.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:34 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:35.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:34 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:35.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:34 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:36.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:35 smithi149 ceph-mon[76906]: pgmap v245: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:36.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:35 smithi038 ceph-mon[91522]: pgmap v245: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:37.232 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:37:37.233 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:37.233 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:37.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:37:37.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:37.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:37 smithi149 ceph-mon[76906]: pgmap v246: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:37 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:37 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:38.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:37 smithi038 ceph-mon[91522]: pgmap v246: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:38.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:37 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:38.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:37 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:39.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:38 smithi149 ceph-mon[76906]: pgmap v247: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:39.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:38 smithi038 ceph-mon[91522]: pgmap v247: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:41.769 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[85197]: 2024-09-13T18:37:41.648+0000 7f8e0f479640 -1 bdev(0x55f685e44e00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2024-09-13T18:37:41.770 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[85197]: 2024-09-13T18:37:41.648+0000 7f8e10c7c640 -1 bdev(0x55f685e44e00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 4 2024-09-13T18:37:41.770 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[85197]: 2024-09-13T18:37:41.649+0000 7f8e0bc72640 -1 bdev(0x55f685e44e00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 9 2024-09-13T18:37:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:41.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:37:41.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:41.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: pgmap v248: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:41.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:41.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:41.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:41.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:41.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:41.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:41.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: Upgrade: Setting container_image for all mds 2024-09-13T18:37:41.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:41.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi038.dtnkqo"}]: dispatch 2024-09-13T18:37:41.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi038.dtnkqo"}]': finished 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi038.ubvgaq"}]': finished 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.doanhj"}]': finished 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.zdzwzb"}]': finished 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: daemon mds.cephfs.smithi038.dtnkqo assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi038.dtnkqo=up:starting} 2 up:standby 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:41.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: daemon mds.cephfs.smithi038.dtnkqo is now active in filesystem cephfs as rank 1 2024-09-13T18:37:41.773 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-13T18:37:41.773 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:41 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-13T18:37:41.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:41.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:41.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:41.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:37:41.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:41.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: pgmap v248: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail 2024-09-13T18:37:41.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:41.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:41.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:41.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:41.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:41.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:41.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: Upgrade: Setting container_image for all mds 2024-09-13T18:37:41.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:41.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi038.dtnkqo"}]: dispatch 2024-09-13T18:37:41.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi038.dtnkqo"}]': finished 2024-09-13T18:37:41.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi038.ubvgaq"}]: dispatch 2024-09-13T18:37:41.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi038.ubvgaq"}]': finished 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.doanhj"}]: dispatch 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.doanhj"}]': finished 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.zdzwzb"}]: dispatch 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi149.zdzwzb"}]': finished 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: daemon mds.cephfs.smithi038.dtnkqo assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi038.dtnkqo=up:starting} 2 up:standby 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: daemon mds.cephfs.smithi038.dtnkqo is now active in filesystem cephfs as rank 1 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-13T18:37:41.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:41 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-13T18:37:43.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:42 smithi149 ceph-mon[76906]: mds.? [v2:172.21.15.38:6828/3278914810,v1:172.21.15.38:6829/3278914810] up:active 2024-09-13T18:37:43.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:42 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-13T18:37:43.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:42 smithi149 ceph-mon[76906]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi038.dtnkqo=up:active} 2 up:standby 2024-09-13T18:37:43.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:42 smithi149 ceph-mon[76906]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi038.dtnkqo=up:active} 2 up:standby-replay 2024-09-13T18:37:43.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:42 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:43.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:42 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:43.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:42 smithi149 ceph-mon[76906]: Upgrade: Setting container_image for all rgw 2024-09-13T18:37:43.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:42 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:43.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:42 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:43.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:42 smithi149 ceph-mon[76906]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T18:37:43.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:42 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:43.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:42 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:43.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:42 smithi038 ceph-mon[91522]: mds.? [v2:172.21.15.38:6828/3278914810,v1:172.21.15.38:6829/3278914810] up:active 2024-09-13T18:37:43.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:42 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-13T18:37:43.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:42 smithi038 ceph-mon[91522]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi038.dtnkqo=up:active} 2 up:standby 2024-09-13T18:37:43.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:42 smithi038 ceph-mon[91522]: fsmap cephfs:2 {0=cephfs.smithi038.ubvgaq=up:active,1=cephfs.smithi038.dtnkqo=up:active} 2 up:standby-replay 2024-09-13T18:37:43.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:42 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:43.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:42 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:43.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:42 smithi038 ceph-mon[91522]: Upgrade: Setting container_image for all rgw 2024-09-13T18:37:43.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:42 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:43.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:42 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:43.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:42 smithi038 ceph-mon[91522]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T18:37:43.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:42 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:43.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:42 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:43 smithi038 ceph-mon[91522]: pgmap v249: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 85 B/s rd, 0 op/s 2024-09-13T18:37:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi038", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T18:37:43.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:43 smithi149 ceph-mon[76906]: pgmap v249: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 85 B/s rd, 0 op/s 2024-09-13T18:37:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi038", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T18:37:44.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:44.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:44 smithi038 ceph-mon[91522]: Upgrade: Updating ceph-exporter.smithi038 (1/2) 2024-09-13T18:37:44.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:44 smithi038 ceph-mon[91522]: Deploying daemon ceph-exporter.smithi038 on smithi038 2024-09-13T18:37:45.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:44 smithi149 ceph-mon[76906]: Upgrade: Updating ceph-exporter.smithi038 (1/2) 2024-09-13T18:37:45.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:44 smithi149 ceph-mon[76906]: Deploying daemon ceph-exporter.smithi038 on smithi038 2024-09-13T18:37:46.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:45 smithi149 ceph-mon[76906]: pgmap v250: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 4.5 MiB/s rd, 6 op/s 2024-09-13T18:37:46.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:45 smithi038 ceph-mon[91522]: pgmap v250: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 4.5 MiB/s rd, 6 op/s 2024-09-13T18:37:48.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:47 smithi149 ceph-mon[76906]: pgmap v251: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 9.2 MiB/s rd, 9 op/s 2024-09-13T18:37:48.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:48.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:47 smithi038 ceph-mon[91522]: pgmap v251: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 9.2 MiB/s rd, 9 op/s 2024-09-13T18:37:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:48.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:49.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:49 smithi038 ceph-mon[91522]: Upgrade: Updating ceph-exporter.smithi149 (2/2) 2024-09-13T18:37:49.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:49 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:49.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:49 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T18:37:49.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:49 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:49.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:49 smithi038 ceph-mon[91522]: Deploying daemon ceph-exporter.smithi149 on smithi149 2024-09-13T18:37:49.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:49 smithi038 ceph-mon[91522]: pgmap v252: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 85 B/s wr, 11 op/s 2024-09-13T18:37:49.644 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:49 smithi149 ceph-mon[76906]: Upgrade: Updating ceph-exporter.smithi149 (2/2) 2024-09-13T18:37:49.644 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:49 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:49.644 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:49 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi149", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-13T18:37:49.644 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:49 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:37:49.644 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:49 smithi149 ceph-mon[76906]: Deploying daemon ceph-exporter.smithi149 on smithi149 2024-09-13T18:37:49.644 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:49 smithi149 ceph-mon[76906]: pgmap v252: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 85 B/s wr, 11 op/s 2024-09-13T18:37:51.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:51 smithi149 ceph-mon[76906]: pgmap v253: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-13T18:37:51.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:51 smithi038 ceph-mon[91522]: pgmap v253: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-13T18:37:51.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.829+0000 7ff35312d640 1 -- 172.21.15.38:0/2268172754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff34c0fe470 msgr2=0x7ff34c0fe870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.829+0000 7ff35312d640 1 --2- 172.21.15.38:0/2268172754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff34c0fe470 0x7ff34c0fe870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009c20 tx=0x7ff33c02a970 comp rx=0 tx=0).stop 2024-09-13T18:37:51.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.829+0000 7ff35312d640 1 -- 172.21.15.38:0/2268172754 shutdown_connections 2024-09-13T18:37:51.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.829+0000 7ff35312d640 1 --2- 172.21.15.38:0/2268172754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff34c0fedb0 0x7ff34c0ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.829+0000 7ff35312d640 1 --2- 172.21.15.38:0/2268172754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff34c0fe470 0x7ff34c0fe870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.829+0000 7ff35312d640 1 -- 172.21.15.38:0/2268172754 >> 172.21.15.38:0/2268172754 conn(0x7ff34c0fa280 msgr2=0x7ff34c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:51.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.829+0000 7ff35312d640 1 -- 172.21.15.38:0/2268172754 shutdown_connections 2024-09-13T18:37:51.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.829+0000 7ff35312d640 1 -- 172.21.15.38:0/2268172754 wait complete. 2024-09-13T18:37:51.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.830+0000 7ff35312d640 1 Processor -- start 2024-09-13T18:37:51.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.830+0000 7ff35312d640 1 -- start start 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.830+0000 7ff35312d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff34c0fe470 0x7ff34c197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.830+0000 7ff35312d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff34c0fedb0 0x7ff34c197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.830+0000 7ff35312d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c198290 con 0x7ff34c0fedb0 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.830+0000 7ff35312d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c198400 con 0x7ff34c0fe470 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.830+0000 7ff34bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff34c0fedb0 0x7ff34c197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.830+0000 7ff34bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff34c0fedb0 0x7ff34c197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47336/0 (socket says 172.21.15.38:47336) 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.830+0000 7ff34bfff640 1 -- 172.21.15.38:0/528465682 learned_addr learned my addr 172.21.15.38:0/528465682 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.830+0000 7ff350ec9640 1 --2- 172.21.15.38:0/528465682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff34c0fe470 0x7ff34c197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.831+0000 7ff34bfff640 1 -- 172.21.15.38:0/528465682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff34c0fe470 msgr2=0x7ff34c197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.831+0000 7ff34bfff640 1 --2- 172.21.15.38:0/528465682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff34c0fe470 0x7ff34c197780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.831+0000 7ff34bfff640 1 -- 172.21.15.38:0/528465682 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c009900 con 0x7ff34c0fedb0 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.831+0000 7ff34bfff640 1 --2- 172.21.15.38:0/528465682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff34c0fedb0 0x7ff34c197cc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff33400e9a0 tx=0x7ff33400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:51.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.831+0000 7ff349ffb640 1 -- 172.21.15.38:0/528465682 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff33400cd50 con 0x7ff34c0fedb0 2024-09-13T18:37:51.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.831+0000 7ff349ffb640 1 -- 172.21.15.38:0/528465682 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff33400ceb0 con 0x7ff34c0fedb0 2024-09-13T18:37:51.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.831+0000 7ff35312d640 1 -- 172.21.15.38:0/528465682 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34c19cea0 con 0x7ff34c0fedb0 2024-09-13T18:37:51.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.831+0000 7ff349ffb640 1 -- 172.21.15.38:0/528465682 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff334010430 con 0x7ff34c0fedb0 2024-09-13T18:37:51.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.831+0000 7ff35312d640 1 -- 172.21.15.38:0/528465682 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c19d3c0 con 0x7ff34c0fedb0 2024-09-13T18:37:51.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.832+0000 7ff35312d640 1 -- 172.21.15.38:0/528465682 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c0fe870 con 0x7ff34c0fedb0 2024-09-13T18:37:51.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.833+0000 7ff349ffb640 1 -- 172.21.15.38:0/528465682 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff334005020 con 0x7ff34c0fedb0 2024-09-13T18:37:51.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.833+0000 7ff349ffb640 1 --2- 172.21.15.38:0/528465682 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff33806cc50 0x7ff33806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:51.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.833+0000 7ff349ffb640 1 -- 172.21.15.38:0/528465682 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7ff334014070 con 0x7ff34c0fedb0 2024-09-13T18:37:51.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.833+0000 7ff350ec9640 1 --2- 172.21.15.38:0/528465682 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff33806cc50 0x7ff33806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:51.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.834+0000 7ff350ec9640 1 --2- 172.21.15.38:0/528465682 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff33806cc50 0x7ff33806f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff33c006010 tx=0x7ff33c03d040 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:51.840 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:51.838+0000 7ff349ffb640 1 -- 172.21.15.38:0/528465682 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff334056af0 con 0x7ff34c0fedb0 2024-09-13T18:37:52.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.024+0000 7ff35312d640 1 -- 172.21.15.38:0/528465682 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff34c1081c0 con 0x7ff33806cc50 2024-09-13T18:37:52.028 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.026+0000 7ff349ffb640 1 -- 172.21.15.38:0/528465682 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7ff34c1081c0 con 0x7ff33806cc50 2024-09-13T18:37:52.030 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.028+0000 7ff35312d640 1 -- 172.21.15.38:0/528465682 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff33806cc50 msgr2=0x7ff33806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.028+0000 7ff35312d640 1 --2- 172.21.15.38:0/528465682 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff33806cc50 0x7ff33806f110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff33c006010 tx=0x7ff33c03d040 comp rx=0 tx=0).stop 2024-09-13T18:37:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.028+0000 7ff35312d640 1 -- 172.21.15.38:0/528465682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff34c0fedb0 msgr2=0x7ff34c197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.028+0000 7ff35312d640 1 --2- 172.21.15.38:0/528465682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff34c0fedb0 0x7ff34c197cc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff33400e9a0 tx=0x7ff33400eda0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.028+0000 7ff35312d640 1 -- 172.21.15.38:0/528465682 shutdown_connections 2024-09-13T18:37:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.028+0000 7ff35312d640 1 --2- 172.21.15.38:0/528465682 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff34c0fedb0 0x7ff34c197cc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.028+0000 7ff35312d640 1 --2- 172.21.15.38:0/528465682 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff33806cc50 0x7ff33806f110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.028+0000 7ff35312d640 1 --2- 172.21.15.38:0/528465682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff34c0fe470 0x7ff34c197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.028+0000 7ff35312d640 1 -- 172.21.15.38:0/528465682 >> 172.21.15.38:0/528465682 conn(0x7ff34c0fa280 msgr2=0x7ff34c106aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.028+0000 7ff35312d640 1 -- 172.21.15.38:0/528465682 shutdown_connections 2024-09-13T18:37:52.031 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.028+0000 7ff35312d640 1 -- 172.21.15.38:0/528465682 wait complete. 2024-09-13T18:37:52.039 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:37:52.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.113+0000 7f76ea453640 1 -- 172.21.15.38:0/1174023559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76e4100d90 msgr2=0x7f76e4101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.113+0000 7f76ea453640 1 --2- 172.21.15.38:0/1174023559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76e4100d90 0x7f76e4101210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009880 tx=0x7f76d802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.113+0000 7f76ea453640 1 -- 172.21.15.38:0/1174023559 shutdown_connections 2024-09-13T18:37:52.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.113+0000 7f76ea453640 1 --2- 172.21.15.38:0/1174023559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76e4100d90 0x7f76e4101210 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.113+0000 7f76ea453640 1 --2- 172.21.15.38:0/1174023559 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76e40ffb90 0x7f76e40fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.113+0000 7f76ea453640 1 -- 172.21.15.38:0/1174023559 >> 172.21.15.38:0/1174023559 conn(0x7f76e40fb320 msgr2=0x7f76e40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.113+0000 7f76ea453640 1 -- 172.21.15.38:0/1174023559 shutdown_connections 2024-09-13T18:37:52.116 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.113+0000 7f76ea453640 1 -- 172.21.15.38:0/1174023559 wait complete. 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.114+0000 7f76ea453640 1 Processor -- start 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.114+0000 7f76ea453640 1 -- start start 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.114+0000 7f76ea453640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76e40ffb90 0x7f76e4195530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.114+0000 7f76ea453640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76e4100d90 0x7f76e4195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.114+0000 7f76ea453640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4196040 con 0x7f76e4100d90 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.114+0000 7f76ea453640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e41961b0 con 0x7f76e40ffb90 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.114+0000 7f76e37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76e4100d90 0x7f76e4195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.114+0000 7f76e37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76e4100d90 0x7f76e4195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47356/0 (socket says 172.21.15.38:47356) 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.114+0000 7f76e37fe640 1 -- 172.21.15.38:0/2113725409 learned_addr learned my addr 172.21.15.38:0/2113725409 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.114+0000 7f76e3fff640 1 --2- 172.21.15.38:0/2113725409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76e40ffb90 0x7f76e4195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.115+0000 7f76e37fe640 1 -- 172.21.15.38:0/2113725409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76e40ffb90 msgr2=0x7f76e4195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.115+0000 7f76e37fe640 1 --2- 172.21.15.38:0/2113725409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76e40ffb90 0x7f76e4195530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.115+0000 7f76e37fe640 1 -- 172.21.15.38:0/2113725409 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8009560 con 0x7f76e4100d90 2024-09-13T18:37:52.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.115+0000 7f76e37fe640 1 --2- 172.21.15.38:0/2113725409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76e4100d90 0x7f76e4195a70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f76d80099a0 tx=0x7f76d80055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.115+0000 7f76e17fa640 1 -- 172.21.15.38:0/2113725409 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76d8004aa0 con 0x7f76e4100d90 2024-09-13T18:37:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.115+0000 7f76e17fa640 1 -- 172.21.15.38:0/2113725409 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f76d8004c00 con 0x7f76e4100d90 2024-09-13T18:37:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.115+0000 7f76ea453640 1 -- 172.21.15.38:0/2113725409 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e419abf0 con 0x7f76e4100d90 2024-09-13T18:37:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.115+0000 7f76e17fa640 1 -- 172.21.15.38:0/2113725409 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76d8031950 con 0x7f76e4100d90 2024-09-13T18:37:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.115+0000 7f76ea453640 1 -- 172.21.15.38:0/2113725409 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e419b0e0 con 0x7f76e4100d90 2024-09-13T18:37:52.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.116+0000 7f76ea453640 1 -- 172.21.15.38:0/2113725409 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e4108640 con 0x7f76e4100d90 2024-09-13T18:37:52.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.117+0000 7f76e17fa640 1 -- 172.21.15.38:0/2113725409 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f76d8031c10 con 0x7f76e4100d90 2024-09-13T18:37:52.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.117+0000 7f76e17fa640 1 --2- 172.21.15.38:0/2113725409 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f76cc06cc60 0x7f76cc06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.118+0000 7f76e17fa640 1 -- 172.21.15.38:0/2113725409 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f76d80ad8d0 con 0x7f76e4100d90 2024-09-13T18:37:52.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.118+0000 7f76e3fff640 1 --2- 172.21.15.38:0/2113725409 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f76cc06cc60 0x7f76cc06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.118+0000 7f76e3fff640 1 --2- 172.21.15.38:0/2113725409 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f76cc06cc60 0x7f76cc06f120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76d4005d00 tx=0x7f76d4005c50 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.124 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.122+0000 7f76e17fa640 1 -- 172.21.15.38:0/2113725409 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f76d8077890 con 0x7f76e4100d90 2024-09-13T18:37:52.313 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.311+0000 7f76ea453640 1 -- 172.21.15.38:0/2113725409 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76e419b2d0 con 0x7f76cc06cc60 2024-09-13T18:37:52.314 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.312+0000 7f76e17fa640 1 -- 172.21.15.38:0/2113725409 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f76e419b2d0 con 0x7f76cc06cc60 2024-09-13T18:37:52.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.314+0000 7f76ea453640 1 -- 172.21.15.38:0/2113725409 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f76cc06cc60 msgr2=0x7f76cc06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.314+0000 7f76ea453640 1 --2- 172.21.15.38:0/2113725409 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f76cc06cc60 0x7f76cc06f120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76d4005d00 tx=0x7f76d4005c50 comp rx=0 tx=0).stop 2024-09-13T18:37:52.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.314+0000 7f76ea453640 1 -- 172.21.15.38:0/2113725409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76e4100d90 msgr2=0x7f76e4195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.314+0000 7f76ea453640 1 --2- 172.21.15.38:0/2113725409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76e4100d90 0x7f76e4195a70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f76d80099a0 tx=0x7f76d80055c0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.314+0000 7f76ea453640 1 -- 172.21.15.38:0/2113725409 shutdown_connections 2024-09-13T18:37:52.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.314+0000 7f76ea453640 1 --2- 172.21.15.38:0/2113725409 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76e4100d90 0x7f76e4195a70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.314+0000 7f76ea453640 1 --2- 172.21.15.38:0/2113725409 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f76cc06cc60 0x7f76cc06f120 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.314+0000 7f76ea453640 1 --2- 172.21.15.38:0/2113725409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76e40ffb90 0x7f76e4195530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.314+0000 7f76ea453640 1 -- 172.21.15.38:0/2113725409 >> 172.21.15.38:0/2113725409 conn(0x7f76e40fb320 msgr2=0x7f76e4103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.314+0000 7f76ea453640 1 -- 172.21.15.38:0/2113725409 shutdown_connections 2024-09-13T18:37:52.317 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.314+0000 7f76ea453640 1 -- 172.21.15.38:0/2113725409 wait complete. 2024-09-13T18:37:52.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.398+0000 7f84713c3640 1 -- 172.21.15.38:0/3705558328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f846c100070 msgr2=0x7f846c100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.398+0000 7f84713c3640 1 --2- 172.21.15.38:0/3705558328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f846c100070 0x7f846c100470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f845c009880 tx=0x7f845c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.398+0000 7f84713c3640 1 -- 172.21.15.38:0/3705558328 shutdown_connections 2024-09-13T18:37:52.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.398+0000 7f84713c3640 1 --2- 172.21.15.38:0/3705558328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c0fed20 0x7f846c0ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.398+0000 7f84713c3640 1 --2- 172.21.15.38:0/3705558328 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f846c100070 0x7f846c100470 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.398+0000 7f84713c3640 1 -- 172.21.15.38:0/3705558328 >> 172.21.15.38:0/3705558328 conn(0x7f846c0f99c0 msgr2=0x7f846c0fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.398+0000 7f84713c3640 1 -- 172.21.15.38:0/3705558328 shutdown_connections 2024-09-13T18:37:52.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.398+0000 7f84713c3640 1 -- 172.21.15.38:0/3705558328 wait complete. 2024-09-13T18:37:52.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.399+0000 7f84713c3640 1 Processor -- start 2024-09-13T18:37:52.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.399+0000 7f84713c3640 1 -- start start 2024-09-13T18:37:52.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.399+0000 7f84713c3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c0fed20 0x7f846c102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.399+0000 7f84713c3640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f846c100070 0x7f846c101110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.399+0000 7f84713c3640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c102f90 con 0x7f846c100070 2024-09-13T18:37:52.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.399+0000 7f84713c3640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c101650 con 0x7f846c0fed20 2024-09-13T18:37:52.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.399+0000 7f846a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f846c100070 0x7f846c101110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.399+0000 7f846a7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f846c100070 0x7f846c101110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53380/0 (socket says 172.21.15.38:53380) 2024-09-13T18:37:52.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.399+0000 7f846a7fc640 1 -- 172.21.15.38:0/1326666462 learned_addr learned my addr 172.21.15.38:0/1326666462 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:52.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.400+0000 7f846affd640 1 --2- 172.21.15.38:0/1326666462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c0fed20 0x7f846c102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.400+0000 7f846a7fc640 1 -- 172.21.15.38:0/1326666462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c0fed20 msgr2=0x7f846c102a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.400+0000 7f846a7fc640 1 --2- 172.21.15.38:0/1326666462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c0fed20 0x7f846c102a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.400+0000 7f846a7fc640 1 -- 172.21.15.38:0/1326666462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c009560 con 0x7f846c100070 2024-09-13T18:37:52.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.400+0000 7f846a7fc640 1 --2- 172.21.15.38:0/1326666462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f846c100070 0x7f846c101110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f846000c8a0 tx=0x7f846000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.400+0000 7f8453fff640 1 -- 172.21.15.38:0/1326666462 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8460007b80 con 0x7f846c100070 2024-09-13T18:37:52.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.400+0000 7f84713c3640 1 -- 172.21.15.38:0/1326666462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846c1018d0 con 0x7f846c100070 2024-09-13T18:37:52.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.400+0000 7f8453fff640 1 -- 172.21.15.38:0/1326666462 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8460007ce0 con 0x7f846c100070 2024-09-13T18:37:52.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.400+0000 7f8453fff640 1 -- 172.21.15.38:0/1326666462 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8460018770 con 0x7f846c100070 2024-09-13T18:37:52.404 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.400+0000 7f84713c3640 1 -- 172.21.15.38:0/1326666462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c101ea0 con 0x7f846c100070 2024-09-13T18:37:52.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.401+0000 7f84713c3640 1 -- 172.21.15.38:0/1326666462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846c107530 con 0x7f846c100070 2024-09-13T18:37:52.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.402+0000 7f8453fff640 1 -- 172.21.15.38:0/1326666462 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f84600189e0 con 0x7f846c100070 2024-09-13T18:37:52.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.402+0000 7f8453fff640 1 --2- 172.21.15.38:0/1326666462 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f845406cc60 0x7f845406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.402+0000 7f8453fff640 1 -- 172.21.15.38:0/1326666462 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f846008c890 con 0x7f846c100070 2024-09-13T18:37:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.402+0000 7f846affd640 1 --2- 172.21.15.38:0/1326666462 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f845406cc60 0x7f845406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.403+0000 7f846affd640 1 --2- 172.21.15.38:0/1326666462 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f845406cc60 0x7f845406f120 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f845c000c00 tx=0x7f845c004400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.407+0000 7f8453fff640 1 -- 172.21.15.38:0/1326666462 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8460056850 con 0x7f846c100070 2024-09-13T18:37:52.590 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.587+0000 7f84713c3640 1 -- 172.21.15.38:0/1326666462 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f846c19d5e0 con 0x7f845406cc60 2024-09-13T18:37:52.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.597+0000 7f8453fff640 1 -- 172.21.15.38:0/1326666462 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f846c19d5e0 con 0x7f845406cc60 2024-09-13T18:37:52.599 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:37:52.599 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (14m) 47s ago 15m 24.9M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 starting - - - - 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (14m) 16s ago 14m 8342k - 18.2.4-845-ge4e227b3 67ddd33fa72f 9f4c882ecba2 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (5m) 47s ago 15m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (5m) 16s ago 14m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (13m) 47s ago 15m 89.1M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (52s) 47s ago 9m 13.0M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1ed3b623871d 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (75s) 47s ago 10m 83.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 710abbbd3193 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (33s) 16s ago 10m 13.7M - 18.2.4-860-g6c6b083f 8a91f241d7d4 df31d6b56cc0 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (19s) 16s ago 9m 12.6M - 18.2.4-860-g6c6b083f 8a91f241d7d4 8f450c446d4a 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (6m) 47s ago 16m 498M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (5m) 16s ago 14m 441M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (5m) 47s ago 17m 51.9M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:37:52.600 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (5m) 16s ago 14m 39.5M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:37:52.601 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (15m) 47s ago 15m 15.4M - 1.5.0 0da6a335fe13 58ac2e4fb881 2024-09-13T18:37:52.601 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (14m) 16s ago 14m 15.5M - 1.5.0 0da6a335fe13 7cfb19544b3a 2024-09-13T18:37:52.601 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (4m) 47s ago 13m 137M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:37:52.601 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (4m) 47s ago 13m 107M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 b2f99a2919b9 2024-09-13T18:37:52.601 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (3m) 47s ago 12m 103M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 090af670cd3d 2024-09-13T18:37:52.601 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (3m) 16s ago 12m 118M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 e4321b085347 2024-09-13T18:37:52.601 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (2m) 16s ago 11m 101M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 c6ec97a4d9ff 2024-09-13T18:37:52.601 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (2m) 16s ago 11m 97.0M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 6faab71ae8a9 2024-09-13T18:37:52.601 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (5m) 47s ago 15m 66.9M - 2.43.0 a07b618ecd1d c04b1dcdc8c3 2024-09-13T18:37:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.599+0000 7f84713c3640 1 -- 172.21.15.38:0/1326666462 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f845406cc60 msgr2=0x7f845406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.599+0000 7f84713c3640 1 --2- 172.21.15.38:0/1326666462 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f845406cc60 0x7f845406f120 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f845c000c00 tx=0x7f845c004400 comp rx=0 tx=0).stop 2024-09-13T18:37:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.599+0000 7f84713c3640 1 -- 172.21.15.38:0/1326666462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f846c100070 msgr2=0x7f846c101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.599+0000 7f84713c3640 1 --2- 172.21.15.38:0/1326666462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f846c100070 0x7f846c101110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f846000c8a0 tx=0x7f846000cd60 comp rx=0 tx=0).stop 2024-09-13T18:37:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.599+0000 7f84713c3640 1 -- 172.21.15.38:0/1326666462 shutdown_connections 2024-09-13T18:37:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.599+0000 7f84713c3640 1 --2- 172.21.15.38:0/1326666462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f846c100070 0x7f846c101110 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.602 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.599+0000 7f84713c3640 1 --2- 172.21.15.38:0/1326666462 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f845406cc60 0x7f845406f120 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.599+0000 7f84713c3640 1 --2- 172.21.15.38:0/1326666462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846c0fed20 0x7f846c102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.599+0000 7f84713c3640 1 -- 172.21.15.38:0/1326666462 >> 172.21.15.38:0/1326666462 conn(0x7f846c0f99c0 msgr2=0x7f846c0fb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.599+0000 7f84713c3640 1 -- 172.21.15.38:0/1326666462 shutdown_connections 2024-09-13T18:37:52.603 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.599+0000 7f84713c3640 1 -- 172.21.15.38:0/1326666462 wait complete. 2024-09-13T18:37:52.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.682+0000 7fe977bca640 1 -- 172.21.15.38:0/3023631965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe970067bc0 msgr2=0x7fe9700fe210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.682+0000 7fe977bca640 1 --2- 172.21.15.38:0/3023631965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe970067bc0 0x7fe9700fe210 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009880 tx=0x7fe96c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.682+0000 7fe977bca640 1 -- 172.21.15.38:0/3023631965 shutdown_connections 2024-09-13T18:37:52.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.682+0000 7fe977bca640 1 --2- 172.21.15.38:0/3023631965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe970068050 0x7fe9700fe750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.682+0000 7fe977bca640 1 --2- 172.21.15.38:0/3023631965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe970067bc0 0x7fe9700fe210 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.682+0000 7fe977bca640 1 -- 172.21.15.38:0/3023631965 >> 172.21.15.38:0/3023631965 conn(0x7fe9700f99c0 msgr2=0x7fe9700fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.685 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:52 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:37:52.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.682+0000 7fe977bca640 1 -- 172.21.15.38:0/3023631965 shutdown_connections 2024-09-13T18:37:52.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.682+0000 7fe977bca640 1 -- 172.21.15.38:0/3023631965 wait complete. 2024-09-13T18:37:52.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.683+0000 7fe977bca640 1 Processor -- start 2024-09-13T18:37:52.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.683+0000 7fe977bca640 1 -- start start 2024-09-13T18:37:52.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.683+0000 7fe977bca640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe970067bc0 0x7fe9701011d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.683+0000 7fe977bca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe970068050 0x7fe97019a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.683+0000 7fe977bca640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97019a920 con 0x7fe970068050 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.683+0000 7fe977bca640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97019aa90 con 0x7fe970067bc0 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.683+0000 7fe975165640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe970068050 0x7fe97019a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.683+0000 7fe975165640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe970068050 0x7fe97019a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53396/0 (socket says 172.21.15.38:53396) 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.683+0000 7fe975165640 1 -- 172.21.15.38:0/1147941514 learned_addr learned my addr 172.21.15.38:0/1147941514 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.683+0000 7fe975966640 1 --2- 172.21.15.38:0/1147941514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe970067bc0 0x7fe9701011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.684+0000 7fe975165640 1 -- 172.21.15.38:0/1147941514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe970067bc0 msgr2=0x7fe9701011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.684+0000 7fe975165640 1 --2- 172.21.15.38:0/1147941514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe970067bc0 0x7fe9701011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.684+0000 7fe975165640 1 -- 172.21.15.38:0/1147941514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c009560 con 0x7fe970068050 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.684+0000 7fe975165640 1 --2- 172.21.15.38:0/1147941514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe970068050 0x7fe97019a350 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe96000b3d0 tx=0x7fe96000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.684+0000 7fe966ffd640 1 -- 172.21.15.38:0/1147941514 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe960011800 con 0x7fe970068050 2024-09-13T18:37:52.688 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.684+0000 7fe966ffd640 1 -- 172.21.15.38:0/1147941514 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe960011e00 con 0x7fe970068050 2024-09-13T18:37:52.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.684+0000 7fe977bca640 1 -- 172.21.15.38:0/1147941514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97019ad70 con 0x7fe970068050 2024-09-13T18:37:52.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.684+0000 7fe977bca640 1 -- 172.21.15.38:0/1147941514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97019b340 con 0x7fe970068050 2024-09-13T18:37:52.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.684+0000 7fe966ffd640 1 -- 172.21.15.38:0/1147941514 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe96000f2e0 con 0x7fe970068050 2024-09-13T18:37:52.689 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.685+0000 7fe977bca640 1 -- 172.21.15.38:0/1147941514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe970107670 con 0x7fe970068050 2024-09-13T18:37:52.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.686+0000 7fe966ffd640 1 -- 172.21.15.38:0/1147941514 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe960010380 con 0x7fe970068050 2024-09-13T18:37:52.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.686+0000 7fe966ffd640 1 --2- 172.21.15.38:0/1147941514 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe95c06cc50 0x7fe95c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:52.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.686+0000 7fe975966640 1 --2- 172.21.15.38:0/1147941514 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe95c06cc50 0x7fe95c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:52.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.686+0000 7fe966ffd640 1 -- 172.21.15.38:0/1147941514 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fe96008c280 con 0x7fe970068050 2024-09-13T18:37:52.690 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.687+0000 7fe975966640 1 --2- 172.21.15.38:0/1147941514 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe95c06cc50 0x7fe95c06f110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009230 tx=0x7fe96c031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:52.693 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.691+0000 7fe966ffd640 1 -- 172.21.15.38:0/1147941514 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe9600562c0 con 0x7fe970068050 2024-09-13T18:37:52.933 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.931+0000 7fe977bca640 1 -- 172.21.15.38:0/1147941514 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe970107850 con 0x7fe970068050 2024-09-13T18:37:52.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.931+0000 7fe966ffd640 1 -- 172.21.15.38:0/1147941514 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fe9600598e0 con 0x7fe970068050 2024-09-13T18:37:52.934 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:37:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:37:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:37:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:37:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:37:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:37:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:37:52.934 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:37:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T18:37:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:37:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:37:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 4 2024-09-13T18:37:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:37:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:37:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 14 2024-09-13T18:37:52.935 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:37:52.935 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:37:52.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.933+0000 7fe977bca640 1 -- 172.21.15.38:0/1147941514 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe95c06cc50 msgr2=0x7fe95c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.933+0000 7fe977bca640 1 --2- 172.21.15.38:0/1147941514 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe95c06cc50 0x7fe95c06f110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009230 tx=0x7fe96c031400 comp rx=0 tx=0).stop 2024-09-13T18:37:52.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.933+0000 7fe977bca640 1 -- 172.21.15.38:0/1147941514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe970068050 msgr2=0x7fe97019a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:52.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.933+0000 7fe977bca640 1 --2- 172.21.15.38:0/1147941514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe970068050 0x7fe97019a350 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe96000b3d0 tx=0x7fe96000b890 comp rx=0 tx=0).stop 2024-09-13T18:37:52.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.933+0000 7fe977bca640 1 -- 172.21.15.38:0/1147941514 shutdown_connections 2024-09-13T18:37:52.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.933+0000 7fe977bca640 1 --2- 172.21.15.38:0/1147941514 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe970068050 0x7fe97019a350 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.933+0000 7fe977bca640 1 --2- 172.21.15.38:0/1147941514 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe95c06cc50 0x7fe95c06f110 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.933+0000 7fe977bca640 1 --2- 172.21.15.38:0/1147941514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe970067bc0 0x7fe9701011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:52.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.933+0000 7fe977bca640 1 -- 172.21.15.38:0/1147941514 >> 172.21.15.38:0/1147941514 conn(0x7fe9700f99c0 msgr2=0x7fe970103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:52.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.934+0000 7fe977bca640 1 -- 172.21.15.38:0/1147941514 shutdown_connections 2024-09-13T18:37:52.936 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:52.934+0000 7fe977bca640 1 -- 172.21.15.38:0/1147941514 wait complete. 2024-09-13T18:37:53.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:52 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:37:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.017+0000 7ff6c1653640 1 -- 172.21.15.38:0/1077302292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6bc0ffca0 msgr2=0x7ff6bc100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.017+0000 7ff6c1653640 1 --2- 172.21.15.38:0/1077302292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6bc0ffca0 0x7ff6bc100120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009880 tx=0x7ff6b002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.017+0000 7ff6c1653640 1 -- 172.21.15.38:0/1077302292 shutdown_connections 2024-09-13T18:37:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.017+0000 7ff6c1653640 1 --2- 172.21.15.38:0/1077302292 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6bc0ffca0 0x7ff6bc100120 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.021 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.017+0000 7ff6c1653640 1 --2- 172.21.15.38:0/1077302292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6bc0feaa0 0x7ff6bc0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.017+0000 7ff6c1653640 1 -- 172.21.15.38:0/1077302292 >> 172.21.15.38:0/1077302292 conn(0x7ff6bc0fa250 msgr2=0x7ff6bc0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.017+0000 7ff6c1653640 1 -- 172.21.15.38:0/1077302292 shutdown_connections 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.017+0000 7ff6c1653640 1 -- 172.21.15.38:0/1077302292 wait complete. 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6c1653640 1 Processor -- start 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6c1653640 1 -- start start 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6c1653640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6bc0feaa0 0x7ff6bc068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6c1653640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6bc0ffca0 0x7ff6bc19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6c1653640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc19a890 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6c1653640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc19a9d0 con 0x7ff6bc0feaa0 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6ba7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6bc0ffca0 0x7ff6bc19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6ba7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6bc0ffca0 0x7ff6bc19a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53420/0 (socket says 172.21.15.38:53420) 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6ba7fc640 1 -- 172.21.15.38:0/4159454907 learned_addr learned my addr 172.21.15.38:0/4159454907 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:53.022 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6baffd640 1 --2- 172.21.15.38:0/4159454907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6bc0feaa0 0x7ff6bc068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6ba7fc640 1 -- 172.21.15.38:0/4159454907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6bc0feaa0 msgr2=0x7ff6bc068fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6ba7fc640 1 --2- 172.21.15.38:0/4159454907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6bc0feaa0 0x7ff6bc068fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.018+0000 7ff6ba7fc640 1 -- 172.21.15.38:0/4159454907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b0009560 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.019+0000 7ff6ba7fc640 1 --2- 172.21.15.38:0/4159454907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6bc0ffca0 0x7ff6bc19a2c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0031460 tx=0x7ff6b00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.019+0000 7ff6a3fff640 1 -- 172.21.15.38:0/4159454907 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6b0004aa0 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.019+0000 7ff6a3fff640 1 -- 172.21.15.38:0/4159454907 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff6b0004c00 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.019+0000 7ff6c1653640 1 -- 172.21.15.38:0/4159454907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc19ac20 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.019+0000 7ff6a3fff640 1 -- 172.21.15.38:0/4159454907 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6b00319c0 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.023 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.019+0000 7ff6c1653640 1 -- 172.21.15.38:0/4159454907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc19b190 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.020+0000 7ff6c1653640 1 -- 172.21.15.38:0/4159454907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6bc18e500 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.020+0000 7ff6a3fff640 1 -- 172.21.15.38:0/4159454907 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff6b0003c90 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.021+0000 7ff6a3fff640 1 --2- 172.21.15.38:0/4159454907 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff6a406cc50 0x7ff6a406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.021+0000 7ff6a3fff640 1 -- 172.21.15.38:0/4159454907 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7ff6b00ad760 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.024 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.021+0000 7ff6baffd640 1 --2- 172.21.15.38:0/4159454907 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff6a406cc50 0x7ff6a406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.025 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.021+0000 7ff6baffd640 1 --2- 172.21.15.38:0/4159454907 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff6a406cc50 0x7ff6a406f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0ffb00 tx=0x7ff6ac005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.027 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.025+0000 7ff6a3fff640 1 -- 172.21.15.38:0/4159454907 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff6b00777d0 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.235 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.233+0000 7ff6c1653640 1 -- 172.21.15.38:0/4159454907 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff6bc1077f0 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.233+0000 7ff6a3fff640 1 -- 172.21.15.38:0/4159454907 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1871 (secure 0 0 0) 0x7ff6b007adf0 con 0x7ff6bc0ffca0 2024-09-13T18:37:53.236 INFO:teuthology.orchestra.run.smithi038.stdout:e37 2024-09-13T18:37:53.236 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:37:53.236 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:37:53.236 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:37:53.237 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:37:53.237 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:37:53.237 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:37:53.237 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 37 2024-09-13T18:37:53.237 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:37:53.237 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:37:53.237 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:37:41.633234+0000 2024-09-13T18:37:53.237 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:37:53.237 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:37:53.237 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:37:53.237 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:37:53.237 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 95 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=34352,1=34384} 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:37:53.238 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:37:53.239 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:37:53.239 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:37:53.239 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:37:53.239 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:34352} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:37:53.239 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{0:44325} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/248866776,v1:172.21.15.149:6825/248866776] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:37:53.239 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{1:34384} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.38:6828/3278914810,v1:172.21.15.38:6829/3278914810] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:37:53.239 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:44353} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/3248503653,v1:172.21.15.149:6827/3248503653] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:37:53.239 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:37:53.239 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:37:53.240 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 37 2024-09-13T18:37:53.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.235+0000 7ff6c1653640 1 -- 172.21.15.38:0/4159454907 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff6a406cc50 msgr2=0x7ff6a406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.235+0000 7ff6c1653640 1 --2- 172.21.15.38:0/4159454907 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff6a406cc50 0x7ff6a406f110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0ffb00 tx=0x7ff6ac005f90 comp rx=0 tx=0).stop 2024-09-13T18:37:53.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.235+0000 7ff6c1653640 1 -- 172.21.15.38:0/4159454907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6bc0ffca0 msgr2=0x7ff6bc19a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.235+0000 7ff6c1653640 1 --2- 172.21.15.38:0/4159454907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6bc0ffca0 0x7ff6bc19a2c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0031460 tx=0x7ff6b00055a0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.235+0000 7ff6c1653640 1 -- 172.21.15.38:0/4159454907 shutdown_connections 2024-09-13T18:37:53.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.236+0000 7ff6c1653640 1 --2- 172.21.15.38:0/4159454907 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6bc0ffca0 0x7ff6bc19a2c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.236+0000 7ff6c1653640 1 --2- 172.21.15.38:0/4159454907 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7ff6a406cc50 0x7ff6a406f110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.236+0000 7ff6c1653640 1 --2- 172.21.15.38:0/4159454907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6bc0feaa0 0x7ff6bc068fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.236+0000 7ff6c1653640 1 -- 172.21.15.38:0/4159454907 >> 172.21.15.38:0/4159454907 conn(0x7ff6bc0fa250 msgr2=0x7ff6bc1033b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:53.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.236+0000 7ff6c1653640 1 -- 172.21.15.38:0/4159454907 shutdown_connections 2024-09-13T18:37:53.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.236+0000 7ff6c1653640 1 -- 172.21.15.38:0/4159454907 wait complete. 2024-09-13T18:37:53.323 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.320+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/2051397858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df40fe420 msgr2=0x7f4df40fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.320+0000 7f4dfc1fe640 1 --2- 172.21.15.38:0/2051397858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df40fe420 0x7f4df40fe820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009880 tx=0x7f4df002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.320+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/2051397858 shutdown_connections 2024-09-13T18:37:53.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.320+0000 7f4dfc1fe640 1 --2- 172.21.15.38:0/2051397858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4df40fed60 0x7f4df40ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.320+0000 7f4dfc1fe640 1 --2- 172.21.15.38:0/2051397858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df40fe420 0x7f4df40fe820 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.320+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/2051397858 >> 172.21.15.38:0/2051397858 conn(0x7f4df40fa250 msgr2=0x7f4df40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:53.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.320+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/2051397858 shutdown_connections 2024-09-13T18:37:53.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.320+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/2051397858 wait complete. 2024-09-13T18:37:53.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.321+0000 7f4dfc1fe640 1 Processor -- start 2024-09-13T18:37:53.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.321+0000 7f4dfc1fe640 1 -- start start 2024-09-13T18:37:53.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.321+0000 7f4dfc1fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4df40fe420 0x7f4df41976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.324 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.321+0000 7f4dfc1fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df40fed60 0x7f4df4197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.321+0000 7f4dfc1fe640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df4198160 con 0x7f4df40fed60 2024-09-13T18:37:53.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.321+0000 7f4dfc1fe640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df41982d0 con 0x7f4df40fe420 2024-09-13T18:37:53.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.321+0000 7f4df9799640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df40fed60 0x7f4df4197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.321+0000 7f4df9799640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df40fed60 0x7f4df4197c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53436/0 (socket says 172.21.15.38:53436) 2024-09-13T18:37:53.325 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.321+0000 7f4df9799640 1 -- 172.21.15.38:0/1902207286 learned_addr learned my addr 172.21.15.38:0/1902207286 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:53.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.322+0000 7f4df9f9a640 1 --2- 172.21.15.38:0/1902207286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4df40fe420 0x7f4df41976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.322+0000 7f4df9799640 1 -- 172.21.15.38:0/1902207286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4df40fe420 msgr2=0x7f4df41976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.326 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.322+0000 7f4df9799640 1 --2- 172.21.15.38:0/1902207286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4df40fe420 0x7f4df41976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.322+0000 7f4df9799640 1 -- 172.21.15.38:0/1902207286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df0009560 con 0x7f4df40fed60 2024-09-13T18:37:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.322+0000 7f4df9f9a640 1 --2- 172.21.15.38:0/1902207286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4df40fe420 0x7f4df41976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.322+0000 7f4df9799640 1 --2- 172.21.15.38:0/1902207286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df40fed60 0x7f4df4197c20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c8a0 tx=0x7f4de400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.322+0000 7f4deaffd640 1 -- 172.21.15.38:0/1902207286 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4de4007b80 con 0x7f4df40fed60 2024-09-13T18:37:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.322+0000 7f4deaffd640 1 -- 172.21.15.38:0/1902207286 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4de4007ce0 con 0x7f4df40fed60 2024-09-13T18:37:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.322+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/1902207286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df419cdb0 con 0x7f4df40fed60 2024-09-13T18:37:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.322+0000 7f4deaffd640 1 -- 172.21.15.38:0/1902207286 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4de4018770 con 0x7f4df40fed60 2024-09-13T18:37:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.322+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/1902207286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df419d330 con 0x7f4df40fed60 2024-09-13T18:37:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.323+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/1902207286 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df410a830 con 0x7f4df40fed60 2024-09-13T18:37:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.324+0000 7f4deaffd640 1 -- 172.21.15.38:0/1902207286 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4de400f450 con 0x7f4df40fed60 2024-09-13T18:37:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.324+0000 7f4deaffd640 1 --2- 172.21.15.38:0/1902207286 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4de006cc50 0x7f4de006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.324+0000 7f4deaffd640 1 -- 172.21.15.38:0/1902207286 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f4de408c810 con 0x7f4df40fed60 2024-09-13T18:37:53.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.324+0000 7f4df9f9a640 1 --2- 172.21.15.38:0/1902207286 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4de006cc50 0x7f4de006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.328 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.325+0000 7f4df9f9a640 1 --2- 172.21.15.38:0/1902207286 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4de006cc50 0x7f4de006f110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4df0031460 tx=0x7f4df0005de0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.331 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.328+0000 7f4deaffd640 1 -- 172.21.15.38:0/1902207286 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4de405a2e0 con 0x7f4df40fed60 2024-09-13T18:37:53.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.517+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/1902207286 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4df419d5d0 con 0x7f4de006cc50 2024-09-13T18:37:53.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.519+0000 7f4deaffd640 1 -- 172.21.15.38:0/1902207286 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f4df419d5d0 con 0x7f4de006cc50 2024-09-13T18:37:53.521 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:37:53.521 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:37:53.521 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:37:53.522 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:37:53.522 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:37:53.522 INFO:teuthology.orchestra.run.smithi038.stdout: "osd", 2024-09-13T18:37:53.522 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr", 2024-09-13T18:37:53.522 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-13T18:37:53.522 INFO:teuthology.orchestra.run.smithi038.stdout: "mon", 2024-09-13T18:37:53.522 INFO:teuthology.orchestra.run.smithi038.stdout: "mds" 2024-09-13T18:37:53.522 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:37:53.522 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "16/23 daemons upgraded", 2024-09-13T18:37:53.522 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-13T18:37:53.522 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:37:53.522 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:37:53.524 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.521+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/1902207286 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4de006cc50 msgr2=0x7f4de006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.521+0000 7f4dfc1fe640 1 --2- 172.21.15.38:0/1902207286 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4de006cc50 0x7f4de006f110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4df0031460 tx=0x7f4df0005de0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.522+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/1902207286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df40fed60 msgr2=0x7f4df4197c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.522+0000 7f4dfc1fe640 1 --2- 172.21.15.38:0/1902207286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df40fed60 0x7f4df4197c20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c8a0 tx=0x7f4de400cd60 comp rx=0 tx=0).stop 2024-09-13T18:37:53.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.522+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/1902207286 shutdown_connections 2024-09-13T18:37:53.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.522+0000 7f4dfc1fe640 1 --2- 172.21.15.38:0/1902207286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4df40fed60 0x7f4df4197c20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.522+0000 7f4dfc1fe640 1 --2- 172.21.15.38:0/1902207286 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4de006cc50 0x7f4de006f110 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.522+0000 7f4dfc1fe640 1 --2- 172.21.15.38:0/1902207286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4df40fe420 0x7f4df41976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.522+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/1902207286 >> 172.21.15.38:0/1902207286 conn(0x7f4df40fa250 msgr2=0x7f4df4106a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:53.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.522+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/1902207286 shutdown_connections 2024-09-13T18:37:53.525 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.522+0000 7f4dfc1fe640 1 -- 172.21.15.38:0/1902207286 wait complete. 2024-09-13T18:37:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.606+0000 7fc681527640 1 -- 172.21.15.38:0/3115969473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc67c0ffb80 msgr2=0x7fc67c0fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.606+0000 7fc681527640 1 --2- 172.21.15.38:0/3115969473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc67c0ffb80 0x7fc67c0fff80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009880 tx=0x7fc66c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.606+0000 7fc681527640 1 -- 172.21.15.38:0/3115969473 shutdown_connections 2024-09-13T18:37:53.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.606+0000 7fc681527640 1 --2- 172.21.15.38:0/3115969473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc67c100d80 0x7fc67c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.606+0000 7fc681527640 1 --2- 172.21.15.38:0/3115969473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc67c0ffb80 0x7fc67c0fff80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.606+0000 7fc681527640 1 -- 172.21.15.38:0/3115969473 >> 172.21.15.38:0/3115969473 conn(0x7fc67c0fb330 msgr2=0x7fc67c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.606+0000 7fc681527640 1 -- 172.21.15.38:0/3115969473 shutdown_connections 2024-09-13T18:37:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.606+0000 7fc681527640 1 -- 172.21.15.38:0/3115969473 wait complete. 2024-09-13T18:37:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.607+0000 7fc681527640 1 Processor -- start 2024-09-13T18:37:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.607+0000 7fc681527640 1 -- start start 2024-09-13T18:37:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.607+0000 7fc681527640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc67c0ffb80 0x7fc67c195520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.607+0000 7fc681527640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc67c100d80 0x7fc67c195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.607+0000 7fc681527640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c195fa0 con 0x7fc67c0ffb80 2024-09-13T18:37:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.607+0000 7fc681527640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c196110 con 0x7fc67c100d80 2024-09-13T18:37:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.607+0000 7fc67affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc67c0ffb80 0x7fc67c195520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.607+0000 7fc67affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc67c0ffb80 0x7fc67c195520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53442/0 (socket says 172.21.15.38:53442) 2024-09-13T18:37:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.607+0000 7fc67affd640 1 -- 172.21.15.38:0/2765251020 learned_addr learned my addr 172.21.15.38:0/2765251020 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:37:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.607+0000 7fc67a7fc640 1 --2- 172.21.15.38:0/2765251020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc67c100d80 0x7fc67c195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.608+0000 7fc67affd640 1 -- 172.21.15.38:0/2765251020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc67c100d80 msgr2=0x7fc67c195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.608+0000 7fc67affd640 1 --2- 172.21.15.38:0/2765251020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc67c100d80 0x7fc67c195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.612 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.608+0000 7fc67affd640 1 -- 172.21.15.38:0/2765251020 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66c009560 con 0x7fc67c0ffb80 2024-09-13T18:37:53.613 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.608+0000 7fc67affd640 1 --2- 172.21.15.38:0/2765251020 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc67c0ffb80 0x7fc67c195520 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc66c005610 tx=0x7fc66c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.608+0000 7fc663fff640 1 -- 172.21.15.38:0/2765251020 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc66c004b20 con 0x7fc67c0ffb80 2024-09-13T18:37:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.608+0000 7fc663fff640 1 -- 172.21.15.38:0/2765251020 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc66c004c80 con 0x7fc67c0ffb80 2024-09-13T18:37:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.608+0000 7fc681527640 1 -- 172.21.15.38:0/2765251020 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67c19ab90 con 0x7fc67c0ffb80 2024-09-13T18:37:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.608+0000 7fc681527640 1 -- 172.21.15.38:0/2765251020 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67c19b030 con 0x7fc67c0ffb80 2024-09-13T18:37:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.608+0000 7fc663fff640 1 -- 172.21.15.38:0/2765251020 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc66c031a80 con 0x7fc67c0ffb80 2024-09-13T18:37:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.609+0000 7fc681527640 1 -- 172.21.15.38:0/2765251020 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc668005280 con 0x7fc67c0ffb80 2024-09-13T18:37:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.610+0000 7fc663fff640 1 -- 172.21.15.38:0/2765251020 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc66c031cb0 con 0x7fc67c0ffb80 2024-09-13T18:37:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.610+0000 7fc663fff640 1 --2- 172.21.15.38:0/2765251020 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc66406cc50 0x7fc66406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.610+0000 7fc663fff640 1 -- 172.21.15.38:0/2765251020 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fc66c0ad8b0 con 0x7fc67c0ffb80 2024-09-13T18:37:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.610+0000 7fc67a7fc640 1 --2- 172.21.15.38:0/2765251020 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc66406cc50 0x7fc66406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:53.614 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.611+0000 7fc67a7fc640 1 --2- 172.21.15.38:0/2765251020 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc66406cc50 0x7fc66406f110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc67c196a40 tx=0x7fc67000a2d0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:53.617 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.614+0000 7fc663fff640 1 -- 172.21.15.38:0/2765251020 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc66c077870 con 0x7fc67c0ffb80 2024-09-13T18:37:53.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:53 smithi038 ceph-mon[91522]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:53.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:53 smithi038 ceph-mon[91522]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:53.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:53 smithi038 ceph-mon[91522]: pgmap v254: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 13 op/s 2024-09-13T18:37:53.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:53 smithi038 ceph-mon[91522]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:53.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:53 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1147941514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:53.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:53 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/4159454907' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:37:53.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.853+0000 7fc681527640 1 -- 172.21.15.38:0/2765251020 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc6680050f0 con 0x7fc67c0ffb80 2024-09-13T18:37:53.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.854+0000 7fc663fff640 1 -- 172.21.15.38:0/2765251020 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc66c07ae90 con 0x7fc67c0ffb80 2024-09-13T18:37:53.856 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:37:53.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.856+0000 7fc681527640 1 -- 172.21.15.38:0/2765251020 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc66406cc50 msgr2=0x7fc66406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.856+0000 7fc681527640 1 --2- 172.21.15.38:0/2765251020 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc66406cc50 0x7fc66406f110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc67c196a40 tx=0x7fc67000a2d0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.856+0000 7fc681527640 1 -- 172.21.15.38:0/2765251020 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc67c0ffb80 msgr2=0x7fc67c195520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:53.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.856+0000 7fc681527640 1 --2- 172.21.15.38:0/2765251020 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc67c0ffb80 0x7fc67c195520 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc66c005610 tx=0x7fc66c005640 comp rx=0 tx=0).stop 2024-09-13T18:37:53.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.856+0000 7fc681527640 1 -- 172.21.15.38:0/2765251020 shutdown_connections 2024-09-13T18:37:53.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.856+0000 7fc681527640 1 --2- 172.21.15.38:0/2765251020 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc66406cc50 0x7fc66406f110 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.856+0000 7fc681527640 1 --2- 172.21.15.38:0/2765251020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc67c100d80 0x7fc67c195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.856+0000 7fc681527640 1 --2- 172.21.15.38:0/2765251020 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc67c0ffb80 0x7fc67c195520 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:53.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.856+0000 7fc681527640 1 -- 172.21.15.38:0/2765251020 >> 172.21.15.38:0/2765251020 conn(0x7fc67c0fb330 msgr2=0x7fc67c103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:53.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.856+0000 7fc681527640 1 -- 172.21.15.38:0/2765251020 shutdown_connections 2024-09-13T18:37:53.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:37:53.856+0000 7fc681527640 1 -- 172.21.15.38:0/2765251020 wait complete. 2024-09-13T18:37:54.001 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:53 smithi149 ceph-mon[76906]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:54.001 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:53 smithi149 ceph-mon[76906]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:54.001 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:53 smithi149 ceph-mon[76906]: pgmap v254: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 13 op/s 2024-09-13T18:37:54.001 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:53 smithi149 ceph-mon[76906]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:54.002 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:53 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1147941514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:37:54.002 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:53 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/4159454907' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:37:54.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:54 smithi038 ceph-mon[91522]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:54.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:54 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2765251020' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:37:54.985 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:54 smithi149 ceph-mon[76906]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:37:54.986 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:54 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2765251020' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:37:55.675 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:55 smithi149 ceph-mon[76906]: pgmap v255: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 14 op/s 2024-09-13T18:37:55.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:55 smithi038 ceph-mon[91522]: pgmap v255: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 14 op/s 2024-09-13T18:37:57.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:57.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:57.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:56 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:57.268 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:57.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:57.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:56 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:37:58.157 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:57 smithi149 ceph-mon[76906]: pgmap v256: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-13T18:37:58.157 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:57 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:58.157 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:57 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:58.176 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:57 smithi038 ceph-mon[91522]: pgmap v256: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-13T18:37:58.176 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:57 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:58.176 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:57 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:59.699 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:59.699 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:59 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:59.699 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:37:59 smithi038 ceph-mon[91522]: pgmap v257: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 7.6 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T18:37:59.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:59.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:59 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:37:59.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:37:59 smithi149 ceph-mon[76906]: pgmap v257: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 7.6 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T18:38:01.371 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:01 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:01.372 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:01 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:01.372 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:01 smithi149 ceph-mon[76906]: pgmap v258: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 85 B/s wr, 4 op/s 2024-09-13T18:38:01.372 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:01 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:01.372 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:01 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:01.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:01 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:01.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:01 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:01.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:01 smithi038 ceph-mon[91522]: pgmap v258: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 85 B/s wr, 4 op/s 2024-09-13T18:38:01.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:01 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:01.459 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:01 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:02.506 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:02 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:02.506 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:02 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:02.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:02 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:02.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:02 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:03.664 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:03 smithi038 ceph-mon[91522]: pgmap v259: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3 op/s 2024-09-13T18:38:03.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:03 smithi149 ceph-mon[76906]: pgmap v259: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3 op/s 2024-09-13T18:38:05.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:38:05.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:38:05.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:05.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi038"}]: dispatch 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi038"}]': finished 2024-09-13T18:38:05.521 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi149"}]: dispatch 2024-09-13T18:38:05.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi149"}]': finished 2024-09-13T18:38:05.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: Upgrade: Setting container_image for all iscsi 2024-09-13T18:38:05.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: Upgrade: Setting container_image for all nfs 2024-09-13T18:38:05.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: Upgrade: Setting container_image for all nvmeof 2024-09-13T18:38:05.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.522 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:05 smithi149 ceph-mon[76906]: pgmap v260: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:05.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:38:05.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:38:05.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:05.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi038"}]: dispatch 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi038"}]': finished 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi149"}]: dispatch 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi149"}]': finished 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.583 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: Upgrade: Setting container_image for all iscsi 2024-09-13T18:38:05.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: Upgrade: Setting container_image for all nfs 2024-09-13T18:38:05.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:05.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: Upgrade: Setting container_image for all nvmeof 2024-09-13T18:38:05.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:05.584 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:05 smithi038 ceph-mon[91522]: pgmap v260: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:06.688 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:06 smithi038 ceph-mon[91522]: Upgrade: Updating node-exporter.smithi038 (1/2) 2024-09-13T18:38:06.688 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:06 smithi038 ceph-mon[91522]: Deploying daemon node-exporter.smithi038 on smithi038 2024-09-13T18:38:06.688 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:38:07.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:06 smithi149 ceph-mon[76906]: Upgrade: Updating node-exporter.smithi038 (1/2) 2024-09-13T18:38:07.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:06 smithi149 ceph-mon[76906]: Deploying daemon node-exporter.smithi038 on smithi038 2024-09-13T18:38:07.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:38:07.893 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:07 smithi038 ceph-mon[91522]: pgmap v261: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:08.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:07 smithi149 ceph-mon[76906]: pgmap v261: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:09.378 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:09 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:09.378 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:09 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:09.378 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:09 smithi149 ceph-mon[76906]: pgmap v262: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:09.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:09 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:09.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:09 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:09.582 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:09 smithi038 ceph-mon[91522]: pgmap v262: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:10.431 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:10 smithi149 ceph-mon[76906]: Upgrade: Updating node-exporter.smithi149 (2/2) 2024-09-13T18:38:10.432 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:10 smithi149 ceph-mon[76906]: Deploying daemon node-exporter.smithi149 on smithi149 2024-09-13T18:38:10.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:10 smithi038 ceph-mon[91522]: Upgrade: Updating node-exporter.smithi149 (2/2) 2024-09-13T18:38:10.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:10 smithi038 ceph-mon[91522]: Deploying daemon node-exporter.smithi149 on smithi149 2024-09-13T18:38:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:11 smithi149 ceph-mon[76906]: pgmap v263: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:38:12.042 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:11 smithi038 ceph-mon[91522]: pgmap v263: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:38:13.009 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:12 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:13.009 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:12 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:13.009 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:12 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:13.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:12 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:13.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:12 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:13.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:12 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:13.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:13 smithi038 ceph-mon[91522]: pgmap v264: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:13.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:13.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:13 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:13.898 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:13 smithi149 ceph-mon[76906]: pgmap v264: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:13.899 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:13.899 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:13 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:15.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:15 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:15.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:15 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:15.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:15 smithi149 ceph-mon[76906]: pgmap v265: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:15.527 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:15 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:15.527 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:15 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:15.527 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:15 smithi038 ceph-mon[91522]: pgmap v265: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:17.384 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:17.384 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:17.384 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:17 smithi038 ceph-mon[91522]: pgmap v266: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:17.384 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:17.384 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:17 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:17.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:17.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:17.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:17 smithi149 ceph-mon[76906]: pgmap v266: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:17.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:17.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:17 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:18.406 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:18 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:18.406 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:18 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:18.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:18 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:18.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:18 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:19.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:19 smithi038 ceph-mon[91522]: pgmap v267: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:19.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:19 smithi149 ceph-mon[76906]: pgmap v267: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:21.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:21.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:21.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:38:21.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:38:21.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:21.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:21.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.084 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.084 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.084 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.084 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.084 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.084 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.084 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:20 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.243 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:21.244 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:21.244 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:38:21.244 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:38:21.244 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:21.244 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:21.244 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.244 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.244 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.244 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.244 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.244 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.244 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.245 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.245 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.245 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.245 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.245 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:21.245 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:20 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:22.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:21 smithi149 ceph-mon[76906]: pgmap v268: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:38:22.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:38:22.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:21 smithi038 ceph-mon[91522]: pgmap v268: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:38:22.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:38:23.189 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:22 smithi038 ceph-mon[91522]: Upgrade: Updating prometheus.smithi038 2024-09-13T18:38:23.189 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:22 smithi038 ceph-mon[91522]: Deploying daemon prometheus.smithi038 on smithi038 2024-09-13T18:38:23.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:22 smithi149 ceph-mon[76906]: Upgrade: Updating prometheus.smithi038 2024-09-13T18:38:23.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:22 smithi149 ceph-mon[76906]: Deploying daemon prometheus.smithi038 on smithi038 2024-09-13T18:38:23.961 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.957+0000 7f4107d4e640 1 -- 172.21.15.38:0/3137344544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41000fde70 msgr2=0x7f41000fe270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.957+0000 7f4107d4e640 1 --2- 172.21.15.38:0/3137344544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41000fde70 0x7f41000fe270 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009880 tx=0x7f40fc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.957+0000 7f4107d4e640 1 -- 172.21.15.38:0/3137344544 shutdown_connections 2024-09-13T18:38:23.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.957+0000 7f4107d4e640 1 --2- 172.21.15.38:0/3137344544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4100100ef0 0x7f4100101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.957+0000 7f4107d4e640 1 --2- 172.21.15.38:0/3137344544 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f41000fde70 0x7f41000fe270 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.957+0000 7f4107d4e640 1 -- 172.21.15.38:0/3137344544 >> 172.21.15.38:0/3137344544 conn(0x7f41000f99c0 msgr2=0x7f41000fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.957+0000 7f4107d4e640 1 -- 172.21.15.38:0/3137344544 shutdown_connections 2024-09-13T18:38:23.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.957+0000 7f4107d4e640 1 -- 172.21.15.38:0/3137344544 wait complete. 2024-09-13T18:38:23.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.958+0000 7f4107d4e640 1 Processor -- start 2024-09-13T18:38:23.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.958+0000 7f4107d4e640 1 -- start start 2024-09-13T18:38:23.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.958+0000 7f4107d4e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41000fde70 0x7f4100195570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.963 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.958+0000 7f4107d4e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4100100ef0 0x7f4100195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.958+0000 7f4107d4e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4100196080 con 0x7f4100100ef0 2024-09-13T18:38:23.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.958+0000 7f4107d4e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41001961f0 con 0x7f41000fde70 2024-09-13T18:38:23.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.958+0000 7f41052e9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4100100ef0 0x7f4100195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.959+0000 7f41052e9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4100100ef0 0x7f4100195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55574/0 (socket says 172.21.15.38:55574) 2024-09-13T18:38:23.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.959+0000 7f41052e9640 1 -- 172.21.15.38:0/3734761043 learned_addr learned my addr 172.21.15.38:0/3734761043 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:23.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.959+0000 7f4105aea640 1 --2- 172.21.15.38:0/3734761043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41000fde70 0x7f4100195570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.959+0000 7f41052e9640 1 -- 172.21.15.38:0/3734761043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41000fde70 msgr2=0x7f4100195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.959+0000 7f41052e9640 1 --2- 172.21.15.38:0/3734761043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41000fde70 0x7f4100195570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.959+0000 7f41052e9640 1 -- 172.21.15.38:0/3734761043 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc009560 con 0x7f4100100ef0 2024-09-13T18:38:23.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.959+0000 7f41052e9640 1 --2- 172.21.15.38:0/3734761043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4100100ef0 0x7f4100195ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f40f000d720 tx=0x7f40f000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.959+0000 7f40f6ffd640 1 -- 172.21.15.38:0/3734761043 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f00051f0 con 0x7f4100100ef0 2024-09-13T18:38:23.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.959+0000 7f40f6ffd640 1 -- 172.21.15.38:0/3734761043 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f40f0009820 con 0x7f4100100ef0 2024-09-13T18:38:23.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.959+0000 7f4107d4e640 1 -- 172.21.15.38:0/3734761043 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410019ac90 con 0x7f4100100ef0 2024-09-13T18:38:23.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.959+0000 7f40f6ffd640 1 -- 172.21.15.38:0/3734761043 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f0004d40 con 0x7f4100100ef0 2024-09-13T18:38:23.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.959+0000 7f4107d4e640 1 -- 172.21.15.38:0/3734761043 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410019b260 con 0x7f4100100ef0 2024-09-13T18:38:23.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.961+0000 7f4107d4e640 1 -- 172.21.15.38:0/3734761043 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4100108660 con 0x7f4100100ef0 2024-09-13T18:38:23.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.961+0000 7f40f6ffd640 1 -- 172.21.15.38:0/3734761043 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f40f0009990 con 0x7f4100100ef0 2024-09-13T18:38:23.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.962+0000 7f40f6ffd640 1 --2- 172.21.15.38:0/3734761043 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f40ec06cc50 0x7f40ec06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.962+0000 7f40f6ffd640 1 -- 172.21.15.38:0/3734761043 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f40f008c0c0 con 0x7f4100100ef0 2024-09-13T18:38:23.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.962+0000 7f4105aea640 1 --2- 172.21.15.38:0/3734761043 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f40ec06cc50 0x7f40ec06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.966 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.962+0000 7f4105aea640 1 --2- 172.21.15.38:0/3734761043 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f40ec06cc50 0x7f40ec06f110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f40fc000c00 tx=0x7f40fc031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.970 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:23.966+0000 7f40f6ffd640 1 -- 172.21.15.38:0/3734761043 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f40f00561b0 con 0x7f4100100ef0 2024-09-13T18:38:24.161 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.158+0000 7f4107d4e640 1 -- 172.21.15.38:0/3734761043 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4100105840 con 0x7f40ec06cc50 2024-09-13T18:38:24.162 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:23 smithi038 ceph-mon[91522]: pgmap v269: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:24.162 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.159+0000 7f40f6ffd640 1 -- 172.21.15.38:0/3734761043 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f4100105840 con 0x7f40ec06cc50 2024-09-13T18:38:24.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.161+0000 7f4107d4e640 1 -- 172.21.15.38:0/3734761043 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f40ec06cc50 msgr2=0x7f40ec06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.161+0000 7f4107d4e640 1 --2- 172.21.15.38:0/3734761043 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f40ec06cc50 0x7f40ec06f110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f40fc000c00 tx=0x7f40fc031400 comp rx=0 tx=0).stop 2024-09-13T18:38:24.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.161+0000 7f4107d4e640 1 -- 172.21.15.38:0/3734761043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4100100ef0 msgr2=0x7f4100195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.161+0000 7f4107d4e640 1 --2- 172.21.15.38:0/3734761043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4100100ef0 0x7f4100195ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f40f000d720 tx=0x7f40f000dbe0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.161+0000 7f4107d4e640 1 -- 172.21.15.38:0/3734761043 shutdown_connections 2024-09-13T18:38:24.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.161+0000 7f4107d4e640 1 --2- 172.21.15.38:0/3734761043 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4100100ef0 0x7f4100195ab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.161+0000 7f4107d4e640 1 --2- 172.21.15.38:0/3734761043 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f40ec06cc50 0x7f40ec06f110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.165 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.161+0000 7f4107d4e640 1 --2- 172.21.15.38:0/3734761043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41000fde70 0x7f4100195570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.161+0000 7f4107d4e640 1 -- 172.21.15.38:0/3734761043 >> 172.21.15.38:0/3734761043 conn(0x7f41000f99c0 msgr2=0x7f4100104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.161+0000 7f4107d4e640 1 -- 172.21.15.38:0/3734761043 shutdown_connections 2024-09-13T18:38:24.166 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.161+0000 7f4107d4e640 1 -- 172.21.15.38:0/3734761043 wait complete. 2024-09-13T18:38:24.173 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:38:24.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.247+0000 7f4f5751b640 1 -- 172.21.15.38:0/1843330167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50103050 msgr2=0x7f4f50105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.247+0000 7f4f5751b640 1 --2- 172.21.15.38:0/1843330167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50103050 0x7f4f50105440 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009880 tx=0x7f4f4002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.253 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.248+0000 7f4f5751b640 1 -- 172.21.15.38:0/1843330167 shutdown_connections 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.248+0000 7f4f5751b640 1 --2- 172.21.15.38:0/1843330167 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50103050 0x7f4f50105440 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.248+0000 7f4f5751b640 1 --2- 172.21.15.38:0/1843330167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f50100720 0x7f4f50102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.248+0000 7f4f5751b640 1 -- 172.21.15.38:0/1843330167 >> 172.21.15.38:0/1843330167 conn(0x7f4f500fa280 msgr2=0x7f4f500fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.248+0000 7f4f5751b640 1 -- 172.21.15.38:0/1843330167 shutdown_connections 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.248+0000 7f4f5751b640 1 -- 172.21.15.38:0/1843330167 wait complete. 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.248+0000 7f4f5751b640 1 Processor -- start 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.248+0000 7f4f5751b640 1 -- start start 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f5751b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f50100720 0x7f4f50100080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f5751b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50103050 0x7f4f500fe6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f5751b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500fec10 con 0x7f4f50103050 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f5751b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500fed80 con 0x7f4f50100720 2024-09-13T18:38:24.254 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f54ab6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50103050 0x7f4f500fe6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f54ab6640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50103050 0x7f4f500fe6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55596/0 (socket says 172.21.15.38:55596) 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f54ab6640 1 -- 172.21.15.38:0/2655682997 learned_addr learned my addr 172.21.15.38:0/2655682997 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f552b7640 1 --2- 172.21.15.38:0/2655682997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f50100720 0x7f4f50100080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f54ab6640 1 -- 172.21.15.38:0/2655682997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f50100720 msgr2=0x7f4f50100080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f54ab6640 1 --2- 172.21.15.38:0/2655682997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f50100720 0x7f4f50100080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f54ab6640 1 -- 172.21.15.38:0/2655682997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f40009560 con 0x7f4f50103050 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f54ab6640 1 --2- 172.21.15.38:0/2655682997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50103050 0x7f4f500fe6d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4f400054f0 tx=0x7f4f40005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f467fc640 1 -- 172.21.15.38:0/2655682997 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f40004aa0 con 0x7f4f50103050 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f467fc640 1 -- 172.21.15.38:0/2655682997 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f40004c00 con 0x7f4f50103050 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f5751b640 1 -- 172.21.15.38:0/2655682997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f500ff000 con 0x7f4f50103050 2024-09-13T18:38:24.255 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.249+0000 7f4f467fc640 1 -- 172.21.15.38:0/2655682997 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f400319f0 con 0x7f4f50103050 2024-09-13T18:38:24.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.250+0000 7f4f5751b640 1 -- 172.21.15.38:0/2655682997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f500ff4f0 con 0x7f4f50103050 2024-09-13T18:38:24.256 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.251+0000 7f4f5751b640 1 -- 172.21.15.38:0/2655682997 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f50108690 con 0x7f4f50103050 2024-09-13T18:38:24.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.251+0000 7f4f467fc640 1 -- 172.21.15.38:0/2655682997 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4f40003c90 con 0x7f4f50103050 2024-09-13T18:38:24.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.252+0000 7f4f467fc640 1 --2- 172.21.15.38:0/2655682997 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4f3c06cc50 0x7f4f3c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.252+0000 7f4f467fc640 1 -- 172.21.15.38:0/2655682997 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f4f400ad730 con 0x7f4f50103050 2024-09-13T18:38:24.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.252+0000 7f4f552b7640 1 --2- 172.21.15.38:0/2655682997 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4f3c06cc50 0x7f4f3c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.257 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.252+0000 7f4f552b7640 1 --2- 172.21.15.38:0/2655682997 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4f3c06cc50 0x7f4f3c06f110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00bbe0 tx=0x7f4f4c00b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.259 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.256+0000 7f4f467fc640 1 -- 172.21.15.38:0/2655682997 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4f40077780 con 0x7f4f50103050 2024-09-13T18:38:24.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:23 smithi149 ceph-mon[76906]: pgmap v269: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:24.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.444+0000 7f4f5751b640 1 -- 172.21.15.38:0/2655682997 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f50103b10 con 0x7f4f3c06cc50 2024-09-13T18:38:24.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.445+0000 7f4f467fc640 1 -- 172.21.15.38:0/2655682997 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f4f50103b10 con 0x7f4f3c06cc50 2024-09-13T18:38:24.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.447+0000 7f4f5751b640 1 -- 172.21.15.38:0/2655682997 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4f3c06cc50 msgr2=0x7f4f3c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.447+0000 7f4f5751b640 1 --2- 172.21.15.38:0/2655682997 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4f3c06cc50 0x7f4f3c06f110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00bbe0 tx=0x7f4f4c00b390 comp rx=0 tx=0).stop 2024-09-13T18:38:24.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.447+0000 7f4f5751b640 1 -- 172.21.15.38:0/2655682997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50103050 msgr2=0x7f4f500fe6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.447+0000 7f4f5751b640 1 --2- 172.21.15.38:0/2655682997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50103050 0x7f4f500fe6d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4f400054f0 tx=0x7f4f40005520 comp rx=0 tx=0).stop 2024-09-13T18:38:24.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.447+0000 7f4f5751b640 1 -- 172.21.15.38:0/2655682997 shutdown_connections 2024-09-13T18:38:24.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.447+0000 7f4f5751b640 1 --2- 172.21.15.38:0/2655682997 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4f50103050 0x7f4f500fe6d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.447+0000 7f4f5751b640 1 --2- 172.21.15.38:0/2655682997 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4f3c06cc50 0x7f4f3c06f110 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.447+0000 7f4f5751b640 1 --2- 172.21.15.38:0/2655682997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f50100720 0x7f4f50100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.447+0000 7f4f5751b640 1 -- 172.21.15.38:0/2655682997 >> 172.21.15.38:0/2655682997 conn(0x7f4f500fa280 msgr2=0x7f4f500fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.448+0000 7f4f5751b640 1 -- 172.21.15.38:0/2655682997 shutdown_connections 2024-09-13T18:38:24.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.448+0000 7f4f5751b640 1 -- 172.21.15.38:0/2655682997 wait complete. 2024-09-13T18:38:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.531+0000 7f82b4837640 1 -- 172.21.15.38:0/2499808926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b0102f60 msgr2=0x7f82b0105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.531+0000 7f82b4837640 1 --2- 172.21.15.38:0/2499808926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b0102f60 0x7f82b0105350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f82a40098b0 tx=0x7f82a402a4d0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.532+0000 7f82b4837640 1 -- 172.21.15.38:0/2499808926 shutdown_connections 2024-09-13T18:38:24.535 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.532+0000 7f82b4837640 1 --2- 172.21.15.38:0/2499808926 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b0102f60 0x7f82b0105350 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.532+0000 7f82b4837640 1 --2- 172.21.15.38:0/2499808926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b0100630 0x7f82b0102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.532+0000 7f82b4837640 1 -- 172.21.15.38:0/2499808926 >> 172.21.15.38:0/2499808926 conn(0x7f82b00fa250 msgr2=0x7f82b00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.532+0000 7f82b4837640 1 -- 172.21.15.38:0/2499808926 shutdown_connections 2024-09-13T18:38:24.536 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.532+0000 7f82b4837640 1 -- 172.21.15.38:0/2499808926 wait complete. 2024-09-13T18:38:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.532+0000 7f82b4837640 1 Processor -- start 2024-09-13T18:38:24.537 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.532+0000 7f82b4837640 1 -- start start 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82b4837640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b0100630 0x7f82b01955b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82b4837640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b0102f60 0x7f82b0195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82b4837640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b01960c0 con 0x7f82b0102f60 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82b4837640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b0196230 con 0x7f82b0100630 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82add9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b0102f60 0x7f82b0195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82add9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b0102f60 0x7f82b0195af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55612/0 (socket says 172.21.15.38:55612) 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82add9b640 1 -- 172.21.15.38:0/3628031916 learned_addr learned my addr 172.21.15.38:0/3628031916 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82ae59c640 1 --2- 172.21.15.38:0/3628031916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b0100630 0x7f82b01955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82add9b640 1 -- 172.21.15.38:0/3628031916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b0100630 msgr2=0x7f82b01955b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82add9b640 1 --2- 172.21.15.38:0/3628031916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b0100630 0x7f82b01955b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.538 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82add9b640 1 -- 172.21.15.38:0/3628031916 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a4009560 con 0x7f82b0102f60 2024-09-13T18:38:24.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82add9b640 1 --2- 172.21.15.38:0/3628031916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b0102f60 0x7f82b0195af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f82a4004650 tx=0x7f82a40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f829f7fe640 1 -- 172.21.15.38:0/3628031916 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82a4004aa0 con 0x7f82b0102f60 2024-09-13T18:38:24.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f82b4837640 1 -- 172.21.15.38:0/3628031916 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b019ac70 con 0x7f82b0102f60 2024-09-13T18:38:24.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.533+0000 7f829f7fe640 1 -- 172.21.15.38:0/3628031916 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f82a4005d50 con 0x7f82b0102f60 2024-09-13T18:38:24.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.534+0000 7f829f7fe640 1 -- 172.21.15.38:0/3628031916 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82a40318f0 con 0x7f82b0102f60 2024-09-13T18:38:24.539 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.534+0000 7f82b4837640 1 -- 172.21.15.38:0/3628031916 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b019b1e0 con 0x7f82b0102f60 2024-09-13T18:38:24.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.535+0000 7f82b4837640 1 -- 172.21.15.38:0/3628031916 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b0108670 con 0x7f82b0102f60 2024-09-13T18:38:24.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.535+0000 7f829f7fe640 1 -- 172.21.15.38:0/3628031916 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f82a4004c00 con 0x7f82b0102f60 2024-09-13T18:38:24.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.536+0000 7f829f7fe640 1 --2- 172.21.15.38:0/3628031916 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f829806cc50 0x7f829806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.536+0000 7f829f7fe640 1 -- 172.21.15.38:0/3628031916 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f82a40ad730 con 0x7f82b0102f60 2024-09-13T18:38:24.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.536+0000 7f82ae59c640 1 --2- 172.21.15.38:0/3628031916 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f829806cc50 0x7f829806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.540 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.536+0000 7f82ae59c640 1 --2- 172.21.15.38:0/3628031916 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f829806cc50 0x7f829806f110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009bd0 tx=0x7f82a0005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.543 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.540+0000 7f829f7fe640 1 -- 172.21.15.38:0/3628031916 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f82a4077700 con 0x7f82b0102f60 2024-09-13T18:38:24.725 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.722+0000 7f82b4837640 1 -- 172.21.15.38:0/3628031916 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f82b01039a0 con 0x7f829806cc50 2024-09-13T18:38:24.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.731+0000 7f829f7fe640 1 -- 172.21.15.38:0/3628031916 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f82b01039a0 con 0x7f829806cc50 2024-09-13T18:38:24.735 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:38:24.735 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (14m) 8s ago 16m 24.4M - 0.25.0 c8568f914cd2 3948d40f2ce3 2024-09-13T18:38:24.735 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (38s) 8s ago 16m 7516k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ee2ab4027fb4 2024-09-13T18:38:24.735 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (29s) 11s ago 15m 7499k - 18.2.4-860-g6c6b083f 8a91f241d7d4 74bef92b9a16 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (5m) 8s ago 16m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (5m) 11s ago 15m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (14m) 8s ago 15m 87.8M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (84s) 8s ago 10m 18.3M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1ed3b623871d 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (107s) 8s ago 10m 83.5M - 18.2.4-860-g6c6b083f 8a91f241d7d4 710abbbd3193 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (65s) 11s ago 10m 84.9M - 18.2.4-860-g6c6b083f 8a91f241d7d4 df31d6b56cc0 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (51s) 11s ago 10m 16.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 8f450c446d4a 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (7m) 8s ago 17m 501M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (6m) 11s ago 15m 441M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (6m) 8s ago 17m 55.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (5m) 11s ago 15m 39.0M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (17s) 8s ago 16m 8368k - 1.5.0 0da6a335fe13 4d79b13b34ff 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (13s) 11s ago 15m 3363k - 1.5.0 0da6a335fe13 a970c2754c12 2024-09-13T18:38:24.736 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (5m) 8s ago 14m 135M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:38:24.737 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (4m) 8s ago 13m 109M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 b2f99a2919b9 2024-09-13T18:38:24.737 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (4m) 8s ago 13m 105M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 090af670cd3d 2024-09-13T18:38:24.737 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (3m) 11s ago 12m 121M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 e4321b085347 2024-09-13T18:38:24.737 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (3m) 11s ago 12m 102M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 c6ec97a4d9ff 2024-09-13T18:38:24.737 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (2m) 11s ago 12m 98.2M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 6faab71ae8a9 2024-09-13T18:38:24.737 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (6m) 8s ago 15m 66.9M - 2.43.0 a07b618ecd1d c04b1dcdc8c3 2024-09-13T18:38:24.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.734+0000 7f82b4837640 1 -- 172.21.15.38:0/3628031916 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f829806cc50 msgr2=0x7f829806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.734+0000 7f82b4837640 1 --2- 172.21.15.38:0/3628031916 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f829806cc50 0x7f829806f110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009bd0 tx=0x7f82a0005f90 comp rx=0 tx=0).stop 2024-09-13T18:38:24.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.734+0000 7f82b4837640 1 -- 172.21.15.38:0/3628031916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b0102f60 msgr2=0x7f82b0195af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.734+0000 7f82b4837640 1 --2- 172.21.15.38:0/3628031916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b0102f60 0x7f82b0195af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f82a4004650 tx=0x7f82a40055a0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.734+0000 7f82b4837640 1 -- 172.21.15.38:0/3628031916 shutdown_connections 2024-09-13T18:38:24.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.734+0000 7f82b4837640 1 --2- 172.21.15.38:0/3628031916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f82b0102f60 0x7f82b0195af0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.734+0000 7f82b4837640 1 --2- 172.21.15.38:0/3628031916 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f829806cc50 0x7f829806f110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.734+0000 7f82b4837640 1 --2- 172.21.15.38:0/3628031916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82b0100630 0x7f82b01955b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.734+0000 7f82b4837640 1 -- 172.21.15.38:0/3628031916 >> 172.21.15.38:0/3628031916 conn(0x7f82b00fa250 msgr2=0x7f82b00fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.734+0000 7f82b4837640 1 -- 172.21.15.38:0/3628031916 shutdown_connections 2024-09-13T18:38:24.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.734+0000 7f82b4837640 1 -- 172.21.15.38:0/3628031916 wait complete. 2024-09-13T18:38:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.817+0000 7f748a8fb640 1 -- 172.21.15.38:0/3835122654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7484100630 msgr2=0x7f7484102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.817+0000 7f748a8fb640 1 --2- 172.21.15.38:0/3835122654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7484100630 0x7f7484102a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f74740098b0 tx=0x7f747402a4d0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.817+0000 7f748a8fb640 1 -- 172.21.15.38:0/3835122654 shutdown_connections 2024-09-13T18:38:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.817+0000 7f748a8fb640 1 --2- 172.21.15.38:0/3835122654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7484102f60 0x7f7484105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.817+0000 7f748a8fb640 1 --2- 172.21.15.38:0/3835122654 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7484100630 0x7f7484102a20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.817+0000 7f748a8fb640 1 -- 172.21.15.38:0/3835122654 >> 172.21.15.38:0/3835122654 conn(0x7f74840fa250 msgr2=0x7f74840fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.818+0000 7f748a8fb640 1 -- 172.21.15.38:0/3835122654 shutdown_connections 2024-09-13T18:38:24.822 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.818+0000 7f748a8fb640 1 -- 172.21.15.38:0/3835122654 wait complete. 2024-09-13T18:38:24.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.818+0000 7f748a8fb640 1 Processor -- start 2024-09-13T18:38:24.823 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.818+0000 7f748a8fb640 1 -- start start 2024-09-13T18:38:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.819+0000 7f748a8fb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7484100630 0x7f7484195590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.819+0000 7f748a8fb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7484102f60 0x7f7484195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.819+0000 7f748a8fb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74841960a0 con 0x7f7484100630 2024-09-13T18:38:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.819+0000 7f748a8fb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7484196210 con 0x7f7484102f60 2024-09-13T18:38:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.819+0000 7f7483fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7484100630 0x7f7484195590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.819+0000 7f7483fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7484100630 0x7f7484195590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55620/0 (socket says 172.21.15.38:55620) 2024-09-13T18:38:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.819+0000 7f7483fff640 1 -- 172.21.15.38:0/106655187 learned_addr learned my addr 172.21.15.38:0/106655187 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.819+0000 7f74837fe640 1 --2- 172.21.15.38:0/106655187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7484102f60 0x7f7484195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.819+0000 7f7483fff640 1 -- 172.21.15.38:0/106655187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7484102f60 msgr2=0x7f7484195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.819+0000 7f7483fff640 1 --2- 172.21.15.38:0/106655187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7484102f60 0x7f7484195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.819+0000 7f7483fff640 1 -- 172.21.15.38:0/106655187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474009560 con 0x7f7484100630 2024-09-13T18:38:24.825 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.820+0000 7f7483fff640 1 --2- 172.21.15.38:0/106655187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7484100630 0x7f7484195590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7474006010 tx=0x7f74740055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.820+0000 7f74817fa640 1 -- 172.21.15.38:0/106655187 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7474004aa0 con 0x7f7484100630 2024-09-13T18:38:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.820+0000 7f74817fa640 1 -- 172.21.15.38:0/106655187 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7474004c00 con 0x7f7484100630 2024-09-13T18:38:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.820+0000 7f748a8fb640 1 -- 172.21.15.38:0/106655187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748419ac50 con 0x7f7484100630 2024-09-13T18:38:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.820+0000 7f74817fa640 1 -- 172.21.15.38:0/106655187 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7474031860 con 0x7f7484100630 2024-09-13T18:38:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.820+0000 7f748a8fb640 1 -- 172.21.15.38:0/106655187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748419b140 con 0x7f7484100630 2024-09-13T18:38:24.826 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.821+0000 7f748a8fb640 1 -- 172.21.15.38:0/106655187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7484108680 con 0x7f7484100630 2024-09-13T18:38:24.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.822+0000 7f74817fa640 1 -- 172.21.15.38:0/106655187 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7474003b90 con 0x7f7484100630 2024-09-13T18:38:24.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.822+0000 7f74817fa640 1 --2- 172.21.15.38:0/106655187 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f746c06cc50 0x7f746c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:24.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.822+0000 7f74817fa640 1 -- 172.21.15.38:0/106655187 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f74740ad740 con 0x7f7484100630 2024-09-13T18:38:24.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.823+0000 7f74837fe640 1 --2- 172.21.15.38:0/106655187 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f746c06cc50 0x7f746c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:24.827 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.823+0000 7f74837fe640 1 --2- 172.21.15.38:0/106655187 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f746c06cc50 0x7f746c06f110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7484196ab0 tx=0x7f7478005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:24.830 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:24.827+0000 7f74817fa640 1 -- 172.21.15.38:0/106655187 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7474077780 con 0x7f7484100630 2024-09-13T18:38:25.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.078+0000 7f748a8fb640 1 -- 172.21.15.38:0/106655187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f748419b3b0 con 0x7f7484100630 2024-09-13T18:38:25.083 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.079+0000 7f74817fa640 1 -- 172.21.15.38:0/106655187 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f747407ada0 con 0x7f7484100630 2024-09-13T18:38:25.083 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:38:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:38:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:38:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:38:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:38:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:38:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:38:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:38:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T18:38:25.084 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:38:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:38:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 4 2024-09-13T18:38:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:38:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:38:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 14 2024-09-13T18:38:25.085 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:38:25.085 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:38:25.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.081+0000 7f748a8fb640 1 -- 172.21.15.38:0/106655187 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f746c06cc50 msgr2=0x7f746c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.081+0000 7f748a8fb640 1 --2- 172.21.15.38:0/106655187 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f746c06cc50 0x7f746c06f110 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7484196ab0 tx=0x7f7478005f90 comp rx=0 tx=0).stop 2024-09-13T18:38:25.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.081+0000 7f748a8fb640 1 -- 172.21.15.38:0/106655187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7484100630 msgr2=0x7f7484195590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.081+0000 7f748a8fb640 1 --2- 172.21.15.38:0/106655187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7484100630 0x7f7484195590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7474006010 tx=0x7f74740055a0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.081+0000 7f748a8fb640 1 -- 172.21.15.38:0/106655187 shutdown_connections 2024-09-13T18:38:25.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.081+0000 7f748a8fb640 1 --2- 172.21.15.38:0/106655187 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f746c06cc50 0x7f746c06f110 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.081+0000 7f748a8fb640 1 --2- 172.21.15.38:0/106655187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7484102f60 0x7f7484195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.081+0000 7f748a8fb640 1 --2- 172.21.15.38:0/106655187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7484100630 0x7f7484195590 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.086 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.082+0000 7f748a8fb640 1 -- 172.21.15.38:0/106655187 >> 172.21.15.38:0/106655187 conn(0x7f74840fa250 msgr2=0x7f74840fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:25.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.082+0000 7f748a8fb640 1 -- 172.21.15.38:0/106655187 shutdown_connections 2024-09-13T18:38:25.087 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.082+0000 7f748a8fb640 1 -- 172.21.15.38:0/106655187 wait complete. 2024-09-13T18:38:25.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.170+0000 7f311517d640 1 -- 172.21.15.38:0/3512422237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3110100d90 msgr2=0x7f3110101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.170+0000 7f311517d640 1 --2- 172.21.15.38:0/3512422237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3110100d90 0x7f3110101210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3100009880 tx=0x7f310002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.170+0000 7f311517d640 1 -- 172.21.15.38:0/3512422237 shutdown_connections 2024-09-13T18:38:25.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.170+0000 7f311517d640 1 --2- 172.21.15.38:0/3512422237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3110100d90 0x7f3110101210 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.170+0000 7f311517d640 1 --2- 172.21.15.38:0/3512422237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31100ffb90 0x7f31100fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.170+0000 7f311517d640 1 -- 172.21.15.38:0/3512422237 >> 172.21.15.38:0/3512422237 conn(0x7f31100fb320 msgr2=0x7f31100fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:25.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.170+0000 7f311517d640 1 -- 172.21.15.38:0/3512422237 shutdown_connections 2024-09-13T18:38:25.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.170+0000 7f311517d640 1 -- 172.21.15.38:0/3512422237 wait complete. 2024-09-13T18:38:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.171+0000 7f311517d640 1 Processor -- start 2024-09-13T18:38:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.171+0000 7f311517d640 1 -- start start 2024-09-13T18:38:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.171+0000 7f311517d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31100ffb90 0x7f3110074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.171+0000 7f311517d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3110100d90 0x7f31100728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.171+0000 7f311517d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3110072de0 con 0x7f31100ffb90 2024-09-13T18:38:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.171+0000 7f311517d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3110072f50 con 0x7f3110100d90 2024-09-13T18:38:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.171+0000 7f310ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31100ffb90 0x7f3110074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.171+0000 7f310ed9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31100ffb90 0x7f3110074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55634/0 (socket says 172.21.15.38:55634) 2024-09-13T18:38:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.171+0000 7f310ed9d640 1 -- 172.21.15.38:0/3783277387 learned_addr learned my addr 172.21.15.38:0/3783277387 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.171+0000 7f310e59c640 1 --2- 172.21.15.38:0/3783277387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3110100d90 0x7f31100728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.172+0000 7f310ed9d640 1 -- 172.21.15.38:0/3783277387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3110100d90 msgr2=0x7f31100728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.176 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.172+0000 7f310ed9d640 1 --2- 172.21.15.38:0/3783277387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3110100d90 0x7f31100728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.172+0000 7f310ed9d640 1 -- 172.21.15.38:0/3783277387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100009560 con 0x7f31100ffb90 2024-09-13T18:38:25.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.172+0000 7f310ed9d640 1 --2- 172.21.15.38:0/3783277387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31100ffb90 0x7f3110074250 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f310400d8d0 tx=0x7f310400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:25.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.172+0000 7f30f7fff640 1 -- 172.21.15.38:0/3783277387 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3104009a30 con 0x7f31100ffb90 2024-09-13T18:38:25.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.172+0000 7f311517d640 1 -- 172.21.15.38:0/3783277387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3110073230 con 0x7f31100ffb90 2024-09-13T18:38:25.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.172+0000 7f30f7fff640 1 -- 172.21.15.38:0/3783277387 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3104009b90 con 0x7f31100ffb90 2024-09-13T18:38:25.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.172+0000 7f30f7fff640 1 -- 172.21.15.38:0/3783277387 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f310400f5f0 con 0x7f31100ffb90 2024-09-13T18:38:25.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.172+0000 7f311517d640 1 -- 172.21.15.38:0/3783277387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311019d570 con 0x7f31100ffb90 2024-09-13T18:38:25.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.173+0000 7f311517d640 1 -- 172.21.15.38:0/3783277387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3110108660 con 0x7f31100ffb90 2024-09-13T18:38:25.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.174+0000 7f30f7fff640 1 -- 172.21.15.38:0/3783277387 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3104009d00 con 0x7f31100ffb90 2024-09-13T18:38:25.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.175+0000 7f30f7fff640 1 --2- 172.21.15.38:0/3783277387 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f30f806cc60 0x7f30f806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.175+0000 7f30f7fff640 1 -- 172.21.15.38:0/3783277387 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f310408c3f0 con 0x7f31100ffb90 2024-09-13T18:38:25.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.175+0000 7f310e59c640 1 --2- 172.21.15.38:0/3783277387 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f30f806cc60 0x7f30f806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.179 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.175+0000 7f310e59c640 1 --2- 172.21.15.38:0/3783277387 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f30f806cc60 0x7f30f806f120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3110073fd0 tx=0x7f3100031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:25.182 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.179+0000 7f30f7fff640 1 -- 172.21.15.38:0/3783277387 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3104056460 con 0x7f31100ffb90 2024-09-13T18:38:25.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:24 smithi149 ceph-mon[76906]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:25.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:24 smithi149 ceph-mon[76906]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:25.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:24 smithi149 ceph-mon[76906]: pgmap v270: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:25.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:24 smithi149 ceph-mon[76906]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:25.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:24 smithi038 ceph-mon[91522]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:25.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:24 smithi038 ceph-mon[91522]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:25.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:24 smithi038 ceph-mon[91522]: pgmap v270: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:25.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:24 smithi038 ceph-mon[91522]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:25.405 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.402+0000 7f311517d640 1 -- 172.21.15.38:0/3783277387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f311019d8b0 con 0x7f31100ffb90 2024-09-13T18:38:25.406 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.402+0000 7f30f7fff640 1 -- 172.21.15.38:0/3783277387 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1871 (secure 0 0 0) 0x7f3104059a80 con 0x7f31100ffb90 2024-09-13T18:38:25.406 INFO:teuthology.orchestra.run.smithi038.stdout:e37 2024-09-13T18:38:25.406 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:38:25.406 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:38:25.406 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:38:25.406 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:38:25.406 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 37 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:37:41.633234+0000 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:38:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:38:25.408 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 95 2024-09-13T18:38:25.408 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:38:25.408 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:38:25.408 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:38:25.408 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=34352,1=34384} 2024-09-13T18:38:25.408 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:38:25.408 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:38:25.408 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:38:25.408 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:38:25.408 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:38:25.408 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:38:25.408 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:38:25.409 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:38:25.409 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:38:25.409 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:34352} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:38:25.409 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{0:44325} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/248866776,v1:172.21.15.149:6825/248866776] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:38:25.409 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{1:34384} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.38:6828/3278914810,v1:172.21.15.38:6829/3278914810] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:38:25.409 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:44353} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/3248503653,v1:172.21.15.149:6827/3248503653] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:38:25.409 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:38:25.409 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:38:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 37 2024-09-13T18:38:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.405+0000 7f311517d640 1 -- 172.21.15.38:0/3783277387 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f30f806cc60 msgr2=0x7f30f806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.405+0000 7f311517d640 1 --2- 172.21.15.38:0/3783277387 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f30f806cc60 0x7f30f806f120 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3110073fd0 tx=0x7f3100031400 comp rx=0 tx=0).stop 2024-09-13T18:38:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.405+0000 7f311517d640 1 -- 172.21.15.38:0/3783277387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31100ffb90 msgr2=0x7f3110074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.405+0000 7f311517d640 1 --2- 172.21.15.38:0/3783277387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31100ffb90 0x7f3110074250 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f310400d8d0 tx=0x7f310400dd90 comp rx=0 tx=0).stop 2024-09-13T18:38:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.405+0000 7f311517d640 1 -- 172.21.15.38:0/3783277387 shutdown_connections 2024-09-13T18:38:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.405+0000 7f311517d640 1 --2- 172.21.15.38:0/3783277387 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f30f806cc60 0x7f30f806f120 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.405+0000 7f311517d640 1 --2- 172.21.15.38:0/3783277387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3110100d90 0x7f31100728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.405+0000 7f311517d640 1 --2- 172.21.15.38:0/3783277387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f31100ffb90 0x7f3110074250 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.405+0000 7f311517d640 1 -- 172.21.15.38:0/3783277387 >> 172.21.15.38:0/3783277387 conn(0x7f31100fb320 msgr2=0x7f3110103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:25.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.405+0000 7f311517d640 1 -- 172.21.15.38:0/3783277387 shutdown_connections 2024-09-13T18:38:25.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.405+0000 7f311517d640 1 -- 172.21.15.38:0/3783277387 wait complete. 2024-09-13T18:38:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.496+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2735286380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d080feaa0 msgr2=0x7f8d080feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.496+0000 7f8d0fb6b640 1 --2- 172.21.15.38:0/2735286380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d080feaa0 0x7f8d080feea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8d04009880 tx=0x7f8d0402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.496+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2735286380 shutdown_connections 2024-09-13T18:38:25.499 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.496+0000 7f8d0fb6b640 1 --2- 172.21.15.38:0/2735286380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d080ffca0 0x7f8d08100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.496+0000 7f8d0fb6b640 1 --2- 172.21.15.38:0/2735286380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d080feaa0 0x7f8d080feea0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.496+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2735286380 >> 172.21.15.38:0/2735286380 conn(0x7f8d080fa250 msgr2=0x7f8d080fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.496+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2735286380 shutdown_connections 2024-09-13T18:38:25.500 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.496+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2735286380 wait complete. 2024-09-13T18:38:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.496+0000 7f8d0fb6b640 1 Processor -- start 2024-09-13T18:38:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.496+0000 7f8d0fb6b640 1 -- start start 2024-09-13T18:38:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0fb6b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d080feaa0 0x7f8d08102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0fb6b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d080ffca0 0x7f8d08101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0fb6b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081015c0 con 0x7f8d080feaa0 2024-09-13T18:38:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0fb6b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08101730 con 0x7f8d080ffca0 2024-09-13T18:38:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0d907640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d080feaa0 0x7f8d08102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0d907640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d080feaa0 0x7f8d08102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55656/0 (socket says 172.21.15.38:55656) 2024-09-13T18:38:25.502 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0d907640 1 -- 172.21.15.38:0/2162794127 learned_addr learned my addr 172.21.15.38:0/2162794127 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:25.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0d106640 1 --2- 172.21.15.38:0/2162794127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d080ffca0 0x7f8d08101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0d907640 1 -- 172.21.15.38:0/2162794127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d080ffca0 msgr2=0x7f8d08101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0d907640 1 --2- 172.21.15.38:0/2162794127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d080ffca0 0x7f8d08101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0d907640 1 -- 172.21.15.38:0/2162794127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d04009560 con 0x7f8d080feaa0 2024-09-13T18:38:25.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0d907640 1 --2- 172.21.15.38:0/2162794127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d080feaa0 0x7f8d08102a30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8d040054f0 tx=0x7f8d04005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:25.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8cfeffd640 1 -- 172.21.15.38:0/2162794127 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d04004aa0 con 0x7f8d080feaa0 2024-09-13T18:38:25.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8cfeffd640 1 -- 172.21.15.38:0/2162794127 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d04004c00 con 0x7f8d080feaa0 2024-09-13T18:38:25.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.497+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2162794127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d081019b0 con 0x7f8d080feaa0 2024-09-13T18:38:25.503 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.498+0000 7f8cfeffd640 1 -- 172.21.15.38:0/2162794127 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d040319f0 con 0x7f8d080feaa0 2024-09-13T18:38:25.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.498+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2162794127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0819d5d0 con 0x7f8d080feaa0 2024-09-13T18:38:25.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.499+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2162794127 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d080feea0 con 0x7f8d080feaa0 2024-09-13T18:38:25.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.499+0000 7f8cfeffd640 1 -- 172.21.15.38:0/2162794127 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8d04003c90 con 0x7f8d080feaa0 2024-09-13T18:38:25.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.499+0000 7f8cfeffd640 1 --2- 172.21.15.38:0/2162794127 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f8cf406cc50 0x7f8cf406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.500+0000 7f8cfeffd640 1 -- 172.21.15.38:0/2162794127 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f8d040ad8e0 con 0x7f8d080feaa0 2024-09-13T18:38:25.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.500+0000 7f8d0d106640 1 --2- 172.21.15.38:0/2162794127 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f8cf406cc50 0x7f8cf406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.505 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.500+0000 7f8d0d106640 1 --2- 172.21.15.38:0/2162794127 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f8cf406cc50 0x7f8cf406f110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8005fd0 tx=0x7f8cf8005850 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:25.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.505+0000 7f8cfeffd640 1 -- 172.21.15.38:0/2162794127 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8d04077800 con 0x7f8d080feaa0 2024-09-13T18:38:25.699 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.695+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2162794127 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d08068c10 con 0x7f8cf406cc50 2024-09-13T18:38:25.700 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.697+0000 7f8cfeffd640 1 -- 172.21.15.38:0/2162794127 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f8d08068c10 con 0x7f8cf406cc50 2024-09-13T18:38:25.700 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:38:25.700 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:38:25.700 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:38:25.700 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:38:25.701 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:38:25.701 INFO:teuthology.orchestra.run.smithi038.stdout: "osd", 2024-09-13T18:38:25.701 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph-exporter", 2024-09-13T18:38:25.701 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr", 2024-09-13T18:38:25.701 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-13T18:38:25.701 INFO:teuthology.orchestra.run.smithi038.stdout: "mon", 2024-09-13T18:38:25.701 INFO:teuthology.orchestra.run.smithi038.stdout: "mds" 2024-09-13T18:38:25.701 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:38:25.701 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "18/23 daemons upgraded", 2024-09-13T18:38:25.701 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-13T18:38:25.701 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:38:25.701 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:38:25.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.699+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2162794127 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f8cf406cc50 msgr2=0x7f8cf406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.699+0000 7f8d0fb6b640 1 --2- 172.21.15.38:0/2162794127 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f8cf406cc50 0x7f8cf406f110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8005fd0 tx=0x7f8cf8005850 comp rx=0 tx=0).stop 2024-09-13T18:38:25.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.699+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2162794127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d080feaa0 msgr2=0x7f8d08102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.699+0000 7f8d0fb6b640 1 --2- 172.21.15.38:0/2162794127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d080feaa0 0x7f8d08102a30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8d040054f0 tx=0x7f8d04005520 comp rx=0 tx=0).stop 2024-09-13T18:38:25.702 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.699+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2162794127 shutdown_connections 2024-09-13T18:38:25.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.699+0000 7f8d0fb6b640 1 --2- 172.21.15.38:0/2162794127 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f8cf406cc50 0x7f8cf406f110 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.699+0000 7f8d0fb6b640 1 --2- 172.21.15.38:0/2162794127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d080ffca0 0x7f8d08101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.699+0000 7f8d0fb6b640 1 --2- 172.21.15.38:0/2162794127 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8d080feaa0 0x7f8d08102a30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.699+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2162794127 >> 172.21.15.38:0/2162794127 conn(0x7f8d080fa250 msgr2=0x7f8d08068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:25.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.699+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2162794127 shutdown_connections 2024-09-13T18:38:25.703 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.699+0000 7f8d0fb6b640 1 -- 172.21.15.38:0/2162794127 wait complete. 2024-09-13T18:38:25.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.784+0000 7fea2af5b640 1 -- 172.21.15.38:0/3999449149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea240feaf0 msgr2=0x7fea240feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.784+0000 7fea2af5b640 1 --2- 172.21.15.38:0/3999449149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea240feaf0 0x7fea240feef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fea18009880 tx=0x7fea1802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.784+0000 7fea2af5b640 1 -- 172.21.15.38:0/3999449149 shutdown_connections 2024-09-13T18:38:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.784+0000 7fea2af5b640 1 --2- 172.21.15.38:0/3999449149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea240ffcf0 0x7fea24100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.784+0000 7fea2af5b640 1 --2- 172.21.15.38:0/3999449149 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea240feaf0 0x7fea240feef0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.784+0000 7fea2af5b640 1 -- 172.21.15.38:0/3999449149 >> 172.21.15.38:0/3999449149 conn(0x7fea240fa280 msgr2=0x7fea240fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.784+0000 7fea2af5b640 1 -- 172.21.15.38:0/3999449149 shutdown_connections 2024-09-13T18:38:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.784+0000 7fea2af5b640 1 -- 172.21.15.38:0/3999449149 wait complete. 2024-09-13T18:38:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea2af5b640 1 Processor -- start 2024-09-13T18:38:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea2af5b640 1 -- start start 2024-09-13T18:38:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea2af5b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea240feaf0 0x7fea240687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea2af5b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea240ffcf0 0x7fea2419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea2af5b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2419a900 con 0x7fea240ffcf0 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea2af5b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2419aa70 con 0x7fea240feaf0 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea23fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea240ffcf0 0x7fea2419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea23fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea240ffcf0 0x7fea2419a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55674/0 (socket says 172.21.15.38:55674) 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea23fff640 1 -- 172.21.15.38:0/3055314205 learned_addr learned my addr 172.21.15.38:0/3055314205 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea28cf7640 1 --2- 172.21.15.38:0/3055314205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea240feaf0 0x7fea240687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea23fff640 1 -- 172.21.15.38:0/3055314205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea240feaf0 msgr2=0x7fea240687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea23fff640 1 --2- 172.21.15.38:0/3055314205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea240feaf0 0x7fea240687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.785+0000 7fea23fff640 1 -- 172.21.15.38:0/3055314205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea18009560 con 0x7fea240ffcf0 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.786+0000 7fea23fff640 1 --2- 172.21.15.38:0/3055314205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea240ffcf0 0x7fea2419a330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fea1000b420 tx=0x7fea1000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.786+0000 7fea21ffb640 1 -- 172.21.15.38:0/3055314205 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea10011800 con 0x7fea240ffcf0 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.786+0000 7fea21ffb640 1 -- 172.21.15.38:0/3055314205 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fea10011e00 con 0x7fea240ffcf0 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.786+0000 7fea21ffb640 1 -- 172.21.15.38:0/3055314205 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea1000f2e0 con 0x7fea240ffcf0 2024-09-13T18:38:25.791 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.786+0000 7fea2af5b640 1 -- 172.21.15.38:0/3055314205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2419ad50 con 0x7fea240ffcf0 2024-09-13T18:38:25.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.786+0000 7fea2af5b640 1 -- 172.21.15.38:0/3055314205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2419b320 con 0x7fea240ffcf0 2024-09-13T18:38:25.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.787+0000 7fea2af5b640 1 -- 172.21.15.38:0/3055314205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea24107620 con 0x7fea240ffcf0 2024-09-13T18:38:25.792 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.787+0000 7fea21ffb640 1 -- 172.21.15.38:0/3055314205 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fea10010380 con 0x7fea240ffcf0 2024-09-13T18:38:25.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.788+0000 7fea21ffb640 1 --2- 172.21.15.38:0/3055314205 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fea1406cc50 0x7fea1406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.788+0000 7fea28cf7640 1 --2- 172.21.15.38:0/3055314205 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fea1406cc50 0x7fea1406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.788+0000 7fea21ffb640 1 -- 172.21.15.38:0/3055314205 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fea1008bf30 con 0x7fea240ffcf0 2024-09-13T18:38:25.793 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.789+0000 7fea28cf7640 1 --2- 172.21.15.38:0/3055314205 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fea1406cc50 0x7fea1406f110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fea18009230 tx=0x7fea18031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:25.796 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:25.792+0000 7fea21ffb640 1 -- 172.21.15.38:0/3055314205 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fea100bfe20 con 0x7fea240ffcf0 2024-09-13T18:38:26.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.042+0000 7fea2af5b640 1 -- 172.21.15.38:0/3055314205 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fea241077b0 con 0x7fea240ffcf0 2024-09-13T18:38:26.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.042+0000 7fea21ffb640 1 -- 172.21.15.38:0/3055314205 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fea10055f70 con 0x7fea240ffcf0 2024-09-13T18:38:26.046 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:38:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.044+0000 7fea2af5b640 1 -- 172.21.15.38:0/3055314205 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fea1406cc50 msgr2=0x7fea1406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.044+0000 7fea2af5b640 1 --2- 172.21.15.38:0/3055314205 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fea1406cc50 0x7fea1406f110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fea18009230 tx=0x7fea18031400 comp rx=0 tx=0).stop 2024-09-13T18:38:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.044+0000 7fea2af5b640 1 -- 172.21.15.38:0/3055314205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea240ffcf0 msgr2=0x7fea2419a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.044+0000 7fea2af5b640 1 --2- 172.21.15.38:0/3055314205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea240ffcf0 0x7fea2419a330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fea1000b420 tx=0x7fea1000b8e0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.044+0000 7fea2af5b640 1 -- 172.21.15.38:0/3055314205 shutdown_connections 2024-09-13T18:38:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.044+0000 7fea2af5b640 1 --2- 172.21.15.38:0/3055314205 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea240ffcf0 0x7fea2419a330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.044+0000 7fea2af5b640 1 --2- 172.21.15.38:0/3055314205 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fea1406cc50 0x7fea1406f110 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.044+0000 7fea2af5b640 1 --2- 172.21.15.38:0/3055314205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea240feaf0 0x7fea240687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.044+0000 7fea2af5b640 1 -- 172.21.15.38:0/3055314205 >> 172.21.15.38:0/3055314205 conn(0x7fea240fa280 msgr2=0x7fea24102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:26.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.044+0000 7fea2af5b640 1 -- 172.21.15.38:0/3055314205 shutdown_connections 2024-09-13T18:38:26.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:26.044+0000 7fea2af5b640 1 -- 172.21.15.38:0/3055314205 wait complete. 2024-09-13T18:38:26.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:25 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/106655187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:26.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:25 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3783277387' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:38:26.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:25 smithi149 ceph-mon[76906]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:26.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:25 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/106655187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:26.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:25 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3783277387' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:38:26.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:25 smithi038 ceph-mon[91522]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:27.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:27 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3055314205' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:38:27.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:27 smithi038 ceph-mon[91522]: pgmap v271: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:27.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:27 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3055314205' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:38:27.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:27 smithi149 ceph-mon[76906]: pgmap v271: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:28.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:28.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:28.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:28 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:28.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:28.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:28.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:28 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:29.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:29 smithi149 ceph-mon[76906]: pgmap v272: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:29.581 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:29 smithi038 ceph-mon[91522]: pgmap v272: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:31.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:31 smithi149 ceph-mon[76906]: pgmap v273: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:38:31.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:31 smithi038 ceph-mon[91522]: pgmap v273: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:38:32.659 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:32 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:32.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:32 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:32.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:32 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:32.660 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:32 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:33.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:32 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:33.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:32 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:33.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:32 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:33.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:32 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:33.765 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:33 smithi038 ceph-mon[91522]: pgmap v274: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:34.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:33 smithi149 ceph-mon[76906]: pgmap v274: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:35.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:35 smithi038 ceph-mon[91522]: pgmap v275: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:35.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:35 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:35.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:35 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:35.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:35 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:38:35.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:35 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:38:35.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:35 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:36.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:35 smithi149 ceph-mon[76906]: pgmap v275: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:36.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:35 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:36.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:35 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:36.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:35 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:38:36.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:35 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:38:36.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:35 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:36.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:38:36.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:38:36.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:36.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.771 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.772 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:38:36.933 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:38:36.933 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T18:38:36.933 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:36.933 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.933 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:36.934 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:38:38.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:37 smithi149 ceph-mon[76906]: pgmap v276: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:38.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:37 smithi149 ceph-mon[76906]: Upgrade: Updating alertmanager.smithi038 2024-09-13T18:38:38.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:37 smithi149 ceph-mon[76906]: Deploying daemon alertmanager.smithi038 on smithi038 2024-09-13T18:38:38.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:37 smithi038 ceph-mon[91522]: pgmap v276: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:38.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:37 smithi038 ceph-mon[91522]: Upgrade: Updating alertmanager.smithi038 2024-09-13T18:38:38.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:37 smithi038 ceph-mon[91522]: Deploying daemon alertmanager.smithi038 on smithi038 2024-09-13T18:38:40.005 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:39 smithi038 ceph-mon[91522]: pgmap v277: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:40.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:39 smithi149 ceph-mon[76906]: pgmap v277: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:41.788 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:41 smithi038 ceph-mon[91522]: pgmap v278: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:38:42.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:41 smithi149 ceph-mon[76906]: pgmap v278: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:38:44.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:43 smithi149 ceph-mon[76906]: pgmap v279: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:44.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:44.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:44.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:43 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:44.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:43 smithi038 ceph-mon[91522]: pgmap v279: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:44.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:44.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:44.332 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:43 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:46.272 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:45 smithi149 ceph-mon[76906]: pgmap v280: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:46.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:45 smithi038 ceph-mon[91522]: pgmap v280: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:47 smithi038 ceph-mon[91522]: pgmap v281: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:47 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:48.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:47 smithi149 ceph-mon[76906]: pgmap v281: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:48.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:47 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:50.087 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:49 smithi038 ceph-mon[91522]: pgmap v282: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:50.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:49 smithi149 ceph-mon[76906]: pgmap v282: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: pgmap v283: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:38:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:38:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:38:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.021 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.022 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.022 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.022 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.022 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:38:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: pgmap v283: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:38:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:38:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:38:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T18:38:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:52.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.083 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:52.084 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:38:53.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:52 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T18:38:53.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:52 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T18:38:54.251 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:53 smithi038 ceph-mon[91522]: pgmap v284: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:54.251 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:53 smithi038 ceph-mon[91522]: Upgrade: Updating grafana.smithi038 2024-09-13T18:38:54.252 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:53 smithi038 ceph-mon[91522]: Deploying daemon grafana.smithi038 on smithi038 2024-09-13T18:38:54.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:53 smithi149 ceph-mon[76906]: pgmap v284: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:54.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:53 smithi149 ceph-mon[76906]: Upgrade: Updating grafana.smithi038 2024-09-13T18:38:54.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:53 smithi149 ceph-mon[76906]: Deploying daemon grafana.smithi038 on smithi038 2024-09-13T18:38:56.066 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:55 smithi038 ceph-mon[91522]: pgmap v285: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:56.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.135+0000 7fa325185640 1 -- 172.21.15.38:0/2083386392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa320100d80 msgr2=0x7fa320101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:56.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.135+0000 7fa325185640 1 --2- 172.21.15.38:0/2083386392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa320100d80 0x7fa320101200 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa314009880 tx=0x7fa31402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.135+0000 7fa325185640 1 -- 172.21.15.38:0/2083386392 shutdown_connections 2024-09-13T18:38:56.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.135+0000 7fa325185640 1 --2- 172.21.15.38:0/2083386392 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa320100d80 0x7fa320101200 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.135+0000 7fa325185640 1 --2- 172.21.15.38:0/2083386392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3200ffb80 0x7fa3200fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.135+0000 7fa325185640 1 -- 172.21.15.38:0/2083386392 >> 172.21.15.38:0/2083386392 conn(0x7fa3200fb330 msgr2=0x7fa3200fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:56.140 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.135+0000 7fa325185640 1 -- 172.21.15.38:0/2083386392 shutdown_connections 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.135+0000 7fa325185640 1 -- 172.21.15.38:0/2083386392 wait complete. 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.136+0000 7fa325185640 1 Processor -- start 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.136+0000 7fa325185640 1 -- start start 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.137+0000 7fa325185640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3200ffb80 0x7fa320195540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.137+0000 7fa325185640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa320100d80 0x7fa320195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.137+0000 7fa325185640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa320196050 con 0x7fa320100d80 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.137+0000 7fa325185640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3201961c0 con 0x7fa3200ffb80 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.137+0000 7fa31e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa320100d80 0x7fa320195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.137+0000 7fa31e59c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa320100d80 0x7fa320195a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38054/0 (socket says 172.21.15.38:38054) 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.137+0000 7fa31e59c640 1 -- 172.21.15.38:0/3639277287 learned_addr learned my addr 172.21.15.38:0/3639277287 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.137+0000 7fa31ed9d640 1 --2- 172.21.15.38:0/3639277287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3200ffb80 0x7fa320195540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.137+0000 7fa31e59c640 1 -- 172.21.15.38:0/3639277287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3200ffb80 msgr2=0x7fa320195540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:56.141 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.137+0000 7fa31e59c640 1 --2- 172.21.15.38:0/3639277287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3200ffb80 0x7fa320195540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.137+0000 7fa31e59c640 1 -- 172.21.15.38:0/3639277287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa314009560 con 0x7fa320100d80 2024-09-13T18:38:56.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.137+0000 7fa31e59c640 1 --2- 172.21.15.38:0/3639277287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa320100d80 0x7fa320195a80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa314006010 tx=0x7fa314005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:56.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.138+0000 7fa307fff640 1 -- 172.21.15.38:0/3639277287 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa314004b20 con 0x7fa320100d80 2024-09-13T18:38:56.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.138+0000 7fa307fff640 1 -- 172.21.15.38:0/3639277287 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa314004c80 con 0x7fa320100d80 2024-09-13T18:38:56.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.138+0000 7fa325185640 1 -- 172.21.15.38:0/3639277287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32019ac00 con 0x7fa320100d80 2024-09-13T18:38:56.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.138+0000 7fa307fff640 1 -- 172.21.15.38:0/3639277287 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3140319f0 con 0x7fa320100d80 2024-09-13T18:38:56.142 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.138+0000 7fa325185640 1 -- 172.21.15.38:0/3639277287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32019b170 con 0x7fa320100d80 2024-09-13T18:38:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.139+0000 7fa325185640 1 -- 172.21.15.38:0/3639277287 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32018f5e0 con 0x7fa320100d80 2024-09-13T18:38:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.139+0000 7fa307fff640 1 -- 172.21.15.38:0/3639277287 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa314003d00 con 0x7fa320100d80 2024-09-13T18:38:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.140+0000 7fa307fff640 1 --2- 172.21.15.38:0/3639277287 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa30806cc50 0x7fa30806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.140+0000 7fa307fff640 1 -- 172.21.15.38:0/3639277287 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fa3140ad6e0 con 0x7fa320100d80 2024-09-13T18:38:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.140+0000 7fa31ed9d640 1 --2- 172.21.15.38:0/3639277287 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa30806cc50 0x7fa30806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:56.143 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.140+0000 7fa31ed9d640 1 --2- 172.21.15.38:0/3639277287 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa30806cc50 0x7fa30806f110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa310005fd0 tx=0x7fa31000b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:56.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.144+0000 7fa307fff640 1 -- 172.21.15.38:0/3639277287 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa3140777d0 con 0x7fa320100d80 2024-09-13T18:38:56.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:55 smithi149 ceph-mon[76906]: pgmap v285: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:38:56.354 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.351+0000 7fa325185640 1 -- 172.21.15.38:0/3639277287 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa32002c4f0 con 0x7fa30806cc50 2024-09-13T18:38:56.355 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.353+0000 7fa307fff640 1 -- 172.21.15.38:0/3639277287 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7fa32002c4f0 con 0x7fa30806cc50 2024-09-13T18:38:56.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.354+0000 7fa325185640 1 -- 172.21.15.38:0/3639277287 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa30806cc50 msgr2=0x7fa30806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:56.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.354+0000 7fa325185640 1 --2- 172.21.15.38:0/3639277287 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa30806cc50 0x7fa30806f110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa310005fd0 tx=0x7fa31000b390 comp rx=0 tx=0).stop 2024-09-13T18:38:56.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.354+0000 7fa325185640 1 -- 172.21.15.38:0/3639277287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa320100d80 msgr2=0x7fa320195a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:56.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.354+0000 7fa325185640 1 --2- 172.21.15.38:0/3639277287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa320100d80 0x7fa320195a80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa314006010 tx=0x7fa314005610 comp rx=0 tx=0).stop 2024-09-13T18:38:56.357 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.355+0000 7fa325185640 1 -- 172.21.15.38:0/3639277287 shutdown_connections 2024-09-13T18:38:56.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.355+0000 7fa325185640 1 --2- 172.21.15.38:0/3639277287 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa320100d80 0x7fa320195a80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.355+0000 7fa325185640 1 --2- 172.21.15.38:0/3639277287 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa30806cc50 0x7fa30806f110 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.355+0000 7fa325185640 1 --2- 172.21.15.38:0/3639277287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3200ffb80 0x7fa320195540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.355+0000 7fa325185640 1 -- 172.21.15.38:0/3639277287 >> 172.21.15.38:0/3639277287 conn(0x7fa3200fb330 msgr2=0x7fa3201044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:56.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.355+0000 7fa325185640 1 -- 172.21.15.38:0/3639277287 shutdown_connections 2024-09-13T18:38:56.358 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.355+0000 7fa325185640 1 -- 172.21.15.38:0/3639277287 wait complete. 2024-09-13T18:38:56.366 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:38:56.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.456+0000 7f34b90bb640 1 -- 172.21.15.38:0/840259416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34b40ffb90 msgr2=0x7f34b40fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:56.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.456+0000 7f34b90bb640 1 --2- 172.21.15.38:0/840259416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34b40ffb90 0x7f34b40fff90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009880 tx=0x7f34a402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.456+0000 7f34b90bb640 1 -- 172.21.15.38:0/840259416 shutdown_connections 2024-09-13T18:38:56.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.456+0000 7f34b90bb640 1 --2- 172.21.15.38:0/840259416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b4100d90 0x7f34b4101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.459 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.456+0000 7f34b90bb640 1 --2- 172.21.15.38:0/840259416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34b40ffb90 0x7f34b40fff90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.456+0000 7f34b90bb640 1 -- 172.21.15.38:0/840259416 >> 172.21.15.38:0/840259416 conn(0x7f34b40fb320 msgr2=0x7f34b40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:56.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.456+0000 7f34b90bb640 1 -- 172.21.15.38:0/840259416 shutdown_connections 2024-09-13T18:38:56.460 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.456+0000 7f34b90bb640 1 -- 172.21.15.38:0/840259416 wait complete. 2024-09-13T18:38:56.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.457+0000 7f34b90bb640 1 Processor -- start 2024-09-13T18:38:56.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.457+0000 7f34b90bb640 1 -- start start 2024-09-13T18:38:56.461 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.457+0000 7f34b90bb640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34b40ffb90 0x7f34b41977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.457+0000 7f34b90bb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b4100d90 0x7f34b4197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.457+0000 7f34b90bb640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b41982d0 con 0x7f34b40ffb90 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.457+0000 7f34b90bb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b4198440 con 0x7f34b4100d90 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.458+0000 7f34b2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34b40ffb90 0x7f34b41977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.458+0000 7f34b2d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34b40ffb90 0x7f34b41977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38078/0 (socket says 172.21.15.38:38078) 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.458+0000 7f34b2d9d640 1 -- 172.21.15.38:0/2620914738 learned_addr learned my addr 172.21.15.38:0/2620914738 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.458+0000 7f34b259c640 1 --2- 172.21.15.38:0/2620914738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b4100d90 0x7f34b4197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.458+0000 7f34b2d9d640 1 -- 172.21.15.38:0/2620914738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b4100d90 msgr2=0x7f34b4197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.458+0000 7f34b2d9d640 1 --2- 172.21.15.38:0/2620914738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b4100d90 0x7f34b4197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.458+0000 7f34b2d9d640 1 -- 172.21.15.38:0/2620914738 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a4009560 con 0x7f34b40ffb90 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.458+0000 7f34b2d9d640 1 --2- 172.21.15.38:0/2620914738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34b40ffb90 0x7f34b41977c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f34a4005520 tx=0x7f34a4005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.458+0000 7f349bfff640 1 -- 172.21.15.38:0/2620914738 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34a4004aa0 con 0x7f34b40ffb90 2024-09-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.458+0000 7f349bfff640 1 -- 172.21.15.38:0/2620914738 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34a4004c00 con 0x7f34b40ffb90 2024-09-13T18:38:56.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.458+0000 7f34b90bb640 1 -- 172.21.15.38:0/2620914738 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b419ce80 con 0x7f34b40ffb90 2024-09-13T18:38:56.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.459+0000 7f349bfff640 1 -- 172.21.15.38:0/2620914738 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34a4031920 con 0x7f34b40ffb90 2024-09-13T18:38:56.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.459+0000 7f34b90bb640 1 -- 172.21.15.38:0/2620914738 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b419d370 con 0x7f34b40ffb90 2024-09-13T18:38:56.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.460+0000 7f34b90bb640 1 -- 172.21.15.38:0/2620914738 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b41056d0 con 0x7f34b40ffb90 2024-09-13T18:38:56.463 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.460+0000 7f349bfff640 1 -- 172.21.15.38:0/2620914738 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f34a4031b90 con 0x7f34b40ffb90 2024-09-13T18:38:56.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.461+0000 7f349bfff640 1 --2- 172.21.15.38:0/2620914738 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f349c06cc50 0x7f349c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:56.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.461+0000 7f349bfff640 1 -- 172.21.15.38:0/2620914738 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f34a40ad7b0 con 0x7f34b40ffb90 2024-09-13T18:38:56.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.461+0000 7f34b259c640 1 --2- 172.21.15.38:0/2620914738 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f349c06cc50 0x7f349c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:56.464 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.462+0000 7f34b259c640 1 --2- 172.21.15.38:0/2620914738 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f349c06cc50 0x7f349c06f110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f34b4198ce0 tx=0x7f34a800b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:56.468 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.466+0000 7f349bfff640 1 -- 172.21.15.38:0/2620914738 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f34a40778a0 con 0x7f34b40ffb90 2024-09-13T18:38:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.660+0000 7f34b90bb640 1 -- 172.21.15.38:0/2620914738 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f34b402c4f0 con 0x7f349c06cc50 2024-09-13T18:38:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.662+0000 7f349bfff640 1 -- 172.21.15.38:0/2620914738 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f34b402c4f0 con 0x7f349c06cc50 2024-09-13T18:38:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.665+0000 7f34b90bb640 1 -- 172.21.15.38:0/2620914738 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f349c06cc50 msgr2=0x7f349c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.665+0000 7f34b90bb640 1 --2- 172.21.15.38:0/2620914738 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f349c06cc50 0x7f349c06f110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f34b4198ce0 tx=0x7f34a800b390 comp rx=0 tx=0).stop 2024-09-13T18:38:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.665+0000 7f34b90bb640 1 -- 172.21.15.38:0/2620914738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34b40ffb90 msgr2=0x7f34b41977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.665+0000 7f34b90bb640 1 --2- 172.21.15.38:0/2620914738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34b40ffb90 0x7f34b41977c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f34a4005520 tx=0x7f34a4005550 comp rx=0 tx=0).stop 2024-09-13T18:38:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.665+0000 7f34b90bb640 1 -- 172.21.15.38:0/2620914738 shutdown_connections 2024-09-13T18:38:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.665+0000 7f34b90bb640 1 --2- 172.21.15.38:0/2620914738 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f349c06cc50 0x7f349c06f110 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.665+0000 7f34b90bb640 1 --2- 172.21.15.38:0/2620914738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34b4100d90 0x7f34b4197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.665+0000 7f34b90bb640 1 --2- 172.21.15.38:0/2620914738 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f34b40ffb90 0x7f34b41977c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.665+0000 7f34b90bb640 1 -- 172.21.15.38:0/2620914738 >> 172.21.15.38:0/2620914738 conn(0x7f34b40fb320 msgr2=0x7f34b4072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.665+0000 7f34b90bb640 1 -- 172.21.15.38:0/2620914738 shutdown_connections 2024-09-13T18:38:56.669 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.665+0000 7f34b90bb640 1 -- 172.21.15.38:0/2620914738 wait complete. 2024-09-13T18:38:56.753 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.750+0000 7f74f290c640 1 -- 172.21.15.38:0/227723107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74ec1006e0 msgr2=0x7f74ec102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:56.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.751+0000 7f74f290c640 1 --2- 172.21.15.38:0/227723107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74ec1006e0 0x7f74ec102ad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009880 tx=0x7f74dc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.751+0000 7f74f290c640 1 -- 172.21.15.38:0/227723107 shutdown_connections 2024-09-13T18:38:56.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.751+0000 7f74f290c640 1 --2- 172.21.15.38:0/227723107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74ec103010 0x7f74ec105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.751+0000 7f74f290c640 1 --2- 172.21.15.38:0/227723107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74ec1006e0 0x7f74ec102ad0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.751+0000 7f74f290c640 1 -- 172.21.15.38:0/227723107 >> 172.21.15.38:0/227723107 conn(0x7f74ec0fa280 msgr2=0x7f74ec0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:56.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.751+0000 7f74f290c640 1 -- 172.21.15.38:0/227723107 shutdown_connections 2024-09-13T18:38:56.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.751+0000 7f74f290c640 1 -- 172.21.15.38:0/227723107 wait complete. 2024-09-13T18:38:56.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.751+0000 7f74f290c640 1 Processor -- start 2024-09-13T18:38:56.754 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.751+0000 7f74f290c640 1 -- start start 2024-09-13T18:38:56.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.752+0000 7f74f290c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74ec1006e0 0x7f74ec0ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:56.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.752+0000 7f74f290c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74ec103010 0x7f74ec0fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:56.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.752+0000 7f74f290c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0febd0 con 0x7f74ec1006e0 2024-09-13T18:38:56.755 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.752+0000 7f74f290c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0fed40 con 0x7f74ec103010 2024-09-13T18:38:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.752+0000 7f74ebfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74ec1006e0 0x7f74ec0ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.752+0000 7f74ebfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74ec1006e0 0x7f74ec0ffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38082/0 (socket says 172.21.15.38:38082) 2024-09-13T18:38:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.752+0000 7f74ebfff640 1 -- 172.21.15.38:0/1746161557 learned_addr learned my addr 172.21.15.38:0/1746161557 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.752+0000 7f74eb7fe640 1 --2- 172.21.15.38:0/1746161557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74ec103010 0x7f74ec0fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.752+0000 7f74ebfff640 1 -- 172.21.15.38:0/1746161557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74ec103010 msgr2=0x7f74ec0fe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.752+0000 7f74ebfff640 1 --2- 172.21.15.38:0/1746161557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74ec103010 0x7f74ec0fe690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.752+0000 7f74ebfff640 1 -- 172.21.15.38:0/1746161557 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc009560 con 0x7f74ec1006e0 2024-09-13T18:38:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.752+0000 7f74ebfff640 1 --2- 172.21.15.38:0/1746161557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74ec1006e0 0x7f74ec0ffff0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0099a0 tx=0x7f74dc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.753+0000 7f74e97fa640 1 -- 172.21.15.38:0/1746161557 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74dc004aa0 con 0x7f74ec1006e0 2024-09-13T18:38:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.753+0000 7f74f290c640 1 -- 172.21.15.38:0/1746161557 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec0ff020 con 0x7f74ec1006e0 2024-09-13T18:38:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.753+0000 7f74e97fa640 1 -- 172.21.15.38:0/1746161557 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74dc004c00 con 0x7f74ec1006e0 2024-09-13T18:38:56.756 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.753+0000 7f74e97fa640 1 -- 172.21.15.38:0/1746161557 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74dc0318f0 con 0x7f74ec1006e0 2024-09-13T18:38:56.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.753+0000 7f74f290c640 1 -- 172.21.15.38:0/1746161557 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec19d610 con 0x7f74ec1006e0 2024-09-13T18:38:56.757 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.754+0000 7f74f290c640 1 -- 172.21.15.38:0/1746161557 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec100ac0 con 0x7f74ec1006e0 2024-09-13T18:38:56.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.754+0000 7f74e97fa640 1 -- 172.21.15.38:0/1746161557 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f74dc031bb0 con 0x7f74ec1006e0 2024-09-13T18:38:56.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.755+0000 7f74e97fa640 1 --2- 172.21.15.38:0/1746161557 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f74d406cc60 0x7f74d406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:56.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.755+0000 7f74e97fa640 1 -- 172.21.15.38:0/1746161557 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f74dc0ad6d0 con 0x7f74ec1006e0 2024-09-13T18:38:56.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.755+0000 7f74eb7fe640 1 --2- 172.21.15.38:0/1746161557 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f74d406cc60 0x7f74d406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:56.758 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.755+0000 7f74eb7fe640 1 --2- 172.21.15.38:0/1746161557 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f74d406cc60 0x7f74d406f120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0ffd70 tx=0x7f74e0005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:56.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.759+0000 7f74e97fa640 1 -- 172.21.15.38:0/1746161557 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f74dc077740 con 0x7f74ec1006e0 2024-09-13T18:38:56.951 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.949+0000 7f74f290c640 1 -- 172.21.15.38:0/1746161557 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f74ec103ab0 con 0x7f74d406cc60 2024-09-13T18:38:56.962 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.959+0000 7f74e97fa640 1 -- 172.21.15.38:0/1746161557 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f74ec103ab0 con 0x7f74d406cc60 2024-09-13T18:38:56.962 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:38:56.962 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (14s) 9s ago 16m 16.6M - 0.25.0 c8568f914cd2 5df1cbc96260 2024-09-13T18:38:56.962 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (70s) 9s ago 16m 7604k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ee2ab4027fb4 2024-09-13T18:38:56.962 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (61s) 43s ago 15m 7499k - 18.2.4-860-g6c6b083f 8a91f241d7d4 74bef92b9a16 2024-09-13T18:38:56.962 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (6m) 9s ago 16m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:38:56.962 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (6m) 43s ago 15m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:38:56.962 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (15m) 9s ago 16m 87.8M - 9.4.7 954c08fa6188 82f4d5e1010a 2024-09-13T18:38:56.962 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (117s) 9s ago 11m 19.4M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1ed3b623871d 2024-09-13T18:38:56.962 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (2m) 9s ago 11m 83.8M - 18.2.4-860-g6c6b083f 8a91f241d7d4 710abbbd3193 2024-09-13T18:38:56.962 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (98s) 43s ago 11m 84.9M - 18.2.4-860-g6c6b083f 8a91f241d7d4 df31d6b56cc0 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (83s) 43s ago 10m 16.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 8f450c446d4a 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (8m) 9s ago 18m 503M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (6m) 43s ago 15m 441M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (6m) 9s ago 18m 57.5M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (6m) 43s ago 15m 39.0M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (49s) 9s ago 16m 8560k - 1.5.0 0da6a335fe13 4d79b13b34ff 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (45s) 43s ago 15m 3363k - 1.5.0 0da6a335fe13 a970c2754c12 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (5m) 9s ago 14m 135M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (5m) 9s ago 14m 110M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 b2f99a2919b9 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (4m) 9s ago 13m 106M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 090af670cd3d 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (4m) 43s ago 13m 121M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 e4321b085347 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (3m) 43s ago 13m 102M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 c6ec97a4d9ff 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (3m) 43s ago 12m 98.2M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 6faab71ae8a9 2024-09-13T18:38:56.963 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (30s) 9s ago 16m 49.1M - 2.43.0 a07b618ecd1d b0fec85ac4ae 2024-09-13T18:38:56.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.962+0000 7f74f290c640 1 -- 172.21.15.38:0/1746161557 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f74d406cc60 msgr2=0x7f74d406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:56.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.962+0000 7f74f290c640 1 --2- 172.21.15.38:0/1746161557 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f74d406cc60 0x7f74d406f120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0ffd70 tx=0x7f74e0005f90 comp rx=0 tx=0).stop 2024-09-13T18:38:56.964 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.962+0000 7f74f290c640 1 -- 172.21.15.38:0/1746161557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74ec1006e0 msgr2=0x7f74ec0ffff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.962+0000 7f74f290c640 1 --2- 172.21.15.38:0/1746161557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74ec1006e0 0x7f74ec0ffff0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0099a0 tx=0x7f74dc0055a0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.962+0000 7f74f290c640 1 -- 172.21.15.38:0/1746161557 shutdown_connections 2024-09-13T18:38:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.962+0000 7f74f290c640 1 --2- 172.21.15.38:0/1746161557 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f74d406cc60 0x7f74d406f120 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.962+0000 7f74f290c640 1 --2- 172.21.15.38:0/1746161557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74ec103010 0x7f74ec0fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.962+0000 7f74f290c640 1 --2- 172.21.15.38:0/1746161557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f74ec1006e0 0x7f74ec0ffff0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.962+0000 7f74f290c640 1 -- 172.21.15.38:0/1746161557 >> 172.21.15.38:0/1746161557 conn(0x7f74ec0fa280 msgr2=0x7f74ec0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.962+0000 7f74f290c640 1 -- 172.21.15.38:0/1746161557 shutdown_connections 2024-09-13T18:38:56.965 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:56.962+0000 7f74f290c640 1 -- 172.21.15.38:0/1746161557 wait complete. 2024-09-13T18:38:57.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.047+0000 7fc23d486640 1 -- 172.21.15.38:0/1536902350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc238102f60 msgr2=0x7fc238105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:57.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.047+0000 7fc23d486640 1 --2- 172.21.15.38:0/1536902350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc238102f60 0x7fc238105350 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc2200098b0 tx=0x7fc22002a4d0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.047+0000 7fc23d486640 1 -- 172.21.15.38:0/1536902350 shutdown_connections 2024-09-13T18:38:57.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.047+0000 7fc23d486640 1 --2- 172.21.15.38:0/1536902350 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc238102f60 0x7fc238105350 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.047+0000 7fc23d486640 1 --2- 172.21.15.38:0/1536902350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc238100630 0x7fc238102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.047+0000 7fc23d486640 1 -- 172.21.15.38:0/1536902350 >> 172.21.15.38:0/1536902350 conn(0x7fc2380fa250 msgr2=0x7fc2380fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:57.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.047+0000 7fc23d486640 1 -- 172.21.15.38:0/1536902350 shutdown_connections 2024-09-13T18:38:57.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.047+0000 7fc23d486640 1 -- 172.21.15.38:0/1536902350 wait complete. 2024-09-13T18:38:57.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.047+0000 7fc23d486640 1 Processor -- start 2024-09-13T18:38:57.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc23d486640 1 -- start start 2024-09-13T18:38:57.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc23d486640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc238100630 0x7fc238195590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:57.051 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc23d486640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc238102f60 0x7fc238195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:57.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc23d486640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2381960a0 con 0x7fc238100630 2024-09-13T18:38:57.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc23d486640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc238196210 con 0x7fc238102f60 2024-09-13T18:38:57.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc236ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc238100630 0x7fc238195590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:57.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc236ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc238100630 0x7fc238195590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38088/0 (socket says 172.21.15.38:38088) 2024-09-13T18:38:57.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc236ffd640 1 -- 172.21.15.38:0/2238526612 learned_addr learned my addr 172.21.15.38:0/2238526612 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:57.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc2367fc640 1 --2- 172.21.15.38:0/2238526612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc238102f60 0x7fc238195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:57.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc236ffd640 1 -- 172.21.15.38:0/2238526612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc238102f60 msgr2=0x7fc238195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:57.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc236ffd640 1 --2- 172.21.15.38:0/2238526612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc238102f60 0x7fc238195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc236ffd640 1 -- 172.21.15.38:0/2238526612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc220009560 con 0x7fc238100630 2024-09-13T18:38:57.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.048+0000 7fc236ffd640 1 --2- 172.21.15.38:0/2238526612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc238100630 0x7fc238195590 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc22800d900 tx=0x7fc22800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:57.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.049+0000 7fc22ffff640 1 -- 172.21.15.38:0/2238526612 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc228009c00 con 0x7fc238100630 2024-09-13T18:38:57.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.049+0000 7fc22ffff640 1 -- 172.21.15.38:0/2238526612 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc22800b660 con 0x7fc238100630 2024-09-13T18:38:57.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.049+0000 7fc23d486640 1 -- 172.21.15.38:0/2238526612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23819acb0 con 0x7fc238100630 2024-09-13T18:38:57.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.049+0000 7fc22ffff640 1 -- 172.21.15.38:0/2238526612 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc22800f5f0 con 0x7fc238100630 2024-09-13T18:38:57.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.049+0000 7fc23d486640 1 -- 172.21.15.38:0/2238526612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23819b200 con 0x7fc238100630 2024-09-13T18:38:57.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.050+0000 7fc23d486640 1 -- 172.21.15.38:0/2238526612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc238100a10 con 0x7fc238100630 2024-09-13T18:38:57.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.050+0000 7fc22ffff640 1 -- 172.21.15.38:0/2238526612 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc228010460 con 0x7fc238100630 2024-09-13T18:38:57.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.051+0000 7fc22ffff640 1 --2- 172.21.15.38:0/2238526612 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc22406cc60 0x7fc22406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:57.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.051+0000 7fc22ffff640 1 -- 172.21.15.38:0/2238526612 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fc22808c3f0 con 0x7fc238100630 2024-09-13T18:38:57.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.051+0000 7fc2367fc640 1 --2- 172.21.15.38:0/2238526612 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc22406cc60 0x7fc22406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:57.054 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.051+0000 7fc2367fc640 1 --2- 172.21.15.38:0/2238526612 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc22406cc60 0x7fc22406f120 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc220006010 tx=0x7fc220031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:57.057 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.055+0000 7fc22ffff640 1 -- 172.21.15.38:0/2238526612 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc228056460 con 0x7fc238100630 2024-09-13T18:38:57.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.298+0000 7fc23d486640 1 -- 172.21.15.38:0/2238526612 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc23819b3f0 con 0x7fc238100630 2024-09-13T18:38:57.301 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.298+0000 7fc22ffff640 1 -- 172.21.15.38:0/2238526612 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fc228059a80 con 0x7fc238100630 2024-09-13T18:38:57.301 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:38:57.301 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:38:57.301 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:38:57.301 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:38:57.301 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:38:57.301 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:38:57.301 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:38:57.301 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:38:57.301 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T18:38:57.301 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:38:57.301 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:38:57.302 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 4 2024-09-13T18:38:57.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:38:57.302 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:38:57.302 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 14 2024-09-13T18:38:57.302 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:38:57.302 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:38:57.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.301+0000 7fc23d486640 1 -- 172.21.15.38:0/2238526612 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc22406cc60 msgr2=0x7fc22406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:57.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.301+0000 7fc23d486640 1 --2- 172.21.15.38:0/2238526612 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc22406cc60 0x7fc22406f120 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc220006010 tx=0x7fc220031400 comp rx=0 tx=0).stop 2024-09-13T18:38:57.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.301+0000 7fc23d486640 1 -- 172.21.15.38:0/2238526612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc238100630 msgr2=0x7fc238195590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:57.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.301+0000 7fc23d486640 1 --2- 172.21.15.38:0/2238526612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc238100630 0x7fc238195590 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc22800d900 tx=0x7fc22800ddc0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.301+0000 7fc23d486640 1 -- 172.21.15.38:0/2238526612 shutdown_connections 2024-09-13T18:38:57.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.301+0000 7fc23d486640 1 --2- 172.21.15.38:0/2238526612 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc22406cc60 0x7fc22406f120 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.301+0000 7fc23d486640 1 --2- 172.21.15.38:0/2238526612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc238102f60 0x7fc238195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.301+0000 7fc23d486640 1 --2- 172.21.15.38:0/2238526612 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc238100630 0x7fc238195590 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.301+0000 7fc23d486640 1 -- 172.21.15.38:0/2238526612 >> 172.21.15.38:0/2238526612 conn(0x7fc2380fa250 msgr2=0x7fc2380fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:57.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.301+0000 7fc23d486640 1 -- 172.21.15.38:0/2238526612 shutdown_connections 2024-09-13T18:38:57.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.301+0000 7fc23d486640 1 -- 172.21.15.38:0/2238526612 wait complete. 2024-09-13T18:38:57.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.395+0000 7f7a04f02640 1 -- 172.21.15.38:0/3394719336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a00100dc0 msgr2=0x7f7a00103230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:57.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.395+0000 7f7a04f02640 1 --2- 172.21.15.38:0/3394719336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a00100dc0 0x7f7a00103230 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009c20 tx=0x7f79f802a970 comp rx=0 tx=0).stop 2024-09-13T18:38:57.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.395+0000 7f7a04f02640 1 -- 172.21.15.38:0/3394719336 shutdown_connections 2024-09-13T18:38:57.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.395+0000 7f7a04f02640 1 --2- 172.21.15.38:0/3394719336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a00100dc0 0x7f7a00103230 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.395+0000 7f7a04f02640 1 --2- 172.21.15.38:0/3394719336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a000fe470 0x7f7a00100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.395+0000 7f7a04f02640 1 -- 172.21.15.38:0/3394719336 >> 172.21.15.38:0/3394719336 conn(0x7f7a000fa280 msgr2=0x7f7a000fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:57.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.395+0000 7f7a04f02640 1 -- 172.21.15.38:0/3394719336 shutdown_connections 2024-09-13T18:38:57.398 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.395+0000 7f7a04f02640 1 -- 172.21.15.38:0/3394719336 wait complete. 2024-09-13T18:38:57.399 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.396+0000 7f7a04f02640 1 Processor -- start 2024-09-13T18:38:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.396+0000 7f7a04f02640 1 -- start start 2024-09-13T18:38:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.396+0000 7f7a04f02640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a000fe470 0x7f7a0019bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.396+0000 7f7a04f02640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a00100dc0 0x7f7a0019c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.396+0000 7f7a04f02640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0019c670 con 0x7f7a00100dc0 2024-09-13T18:38:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.396+0000 7f7a04f02640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0019c7e0 con 0x7f7a000fe470 2024-09-13T18:38:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.397+0000 7f79fdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a00100dc0 0x7f7a0019c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.397+0000 7f79fdd9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a00100dc0 0x7f7a0019c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38116/0 (socket says 172.21.15.38:38116) 2024-09-13T18:38:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.397+0000 7f79fdd9b640 1 -- 172.21.15.38:0/2900717844 learned_addr learned my addr 172.21.15.38:0/2900717844 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.397+0000 7f79fe59c640 1 --2- 172.21.15.38:0/2900717844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a000fe470 0x7f7a0019bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.397+0000 7f79fdd9b640 1 -- 172.21.15.38:0/2900717844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a000fe470 msgr2=0x7f7a0019bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.397+0000 7f79fdd9b640 1 --2- 172.21.15.38:0/2900717844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a000fe470 0x7f7a0019bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.400 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.397+0000 7f79fdd9b640 1 -- 172.21.15.38:0/2900717844 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f8009900 con 0x7f7a00100dc0 2024-09-13T18:38:57.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.397+0000 7f79fdd9b640 1 --2- 172.21.15.38:0/2900717844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a00100dc0 0x7f7a0019c0a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f79f802f5d0 tx=0x7f79f8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:57.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.398+0000 7f79ef7fe640 1 -- 172.21.15.38:0/2900717844 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79f802f9c0 con 0x7f7a00100dc0 2024-09-13T18:38:57.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.398+0000 7f7a04f02640 1 -- 172.21.15.38:0/2900717844 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a001a1220 con 0x7f7a00100dc0 2024-09-13T18:38:57.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.398+0000 7f79ef7fe640 1 -- 172.21.15.38:0/2900717844 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f79f8004040 con 0x7f7a00100dc0 2024-09-13T18:38:57.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.398+0000 7f79ef7fe640 1 -- 172.21.15.38:0/2900717844 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79f8030ce0 con 0x7f7a00100dc0 2024-09-13T18:38:57.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.398+0000 7f7a04f02640 1 -- 172.21.15.38:0/2900717844 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a001a1710 con 0x7f7a00100dc0 2024-09-13T18:38:57.401 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.399+0000 7f7a04f02640 1 -- 172.21.15.38:0/2900717844 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0010ec80 con 0x7f7a00100dc0 2024-09-13T18:38:57.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.399+0000 7f79ef7fe640 1 -- 172.21.15.38:0/2900717844 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f79f800a040 con 0x7f7a00100dc0 2024-09-13T18:38:57.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.400+0000 7f79ef7fe640 1 --2- 172.21.15.38:0/2900717844 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f79e806ccc0 0x7f79e806f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:57.402 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.400+0000 7f79ef7fe640 1 -- 172.21.15.38:0/2900717844 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f79f802c040 con 0x7f7a00100dc0 2024-09-13T18:38:57.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.400+0000 7f79fe59c640 1 --2- 172.21.15.38:0/2900717844 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f79e806ccc0 0x7f79e806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:57.403 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.401+0000 7f79fe59c640 1 --2- 172.21.15.38:0/2900717844 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f79e806ccc0 0x7f79e806f180 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f79f000bbe0 tx=0x7f79f000b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:57.407 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.405+0000 7f79ef7fe640 1 -- 172.21.15.38:0/2900717844 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f79f8077bb0 con 0x7f7a00100dc0 2024-09-13T18:38:57.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.632+0000 7f7a04f02640 1 -- 172.21.15.38:0/2900717844 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7a0010ee40 con 0x7f7a00100dc0 2024-09-13T18:38:57.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.632+0000 7f79ef7fe640 1 -- 172.21.15.38:0/2900717844 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1871 (secure 0 0 0) 0x7f79f807b1d0 con 0x7f7a00100dc0 2024-09-13T18:38:57.636 INFO:teuthology.orchestra.run.smithi038.stdout:e37 2024-09-13T18:38:57.636 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:38:57.636 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:38:57.636 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:38:57.637 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:38:57.637 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:38:57.637 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:38:57.637 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 37 2024-09-13T18:38:57.637 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:37:41.633234+0000 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 95 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:38:57.638 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=34352,1=34384} 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:34352} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{0:44325} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/248866776,v1:172.21.15.149:6825/248866776] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{1:34384} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.38:6828/3278914810,v1:172.21.15.38:6829/3278914810] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:38:57.639 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:44353} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/3248503653,v1:172.21.15.149:6827/3248503653] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:38:57.640 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:38:57.640 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:38:57.640 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 37 2024-09-13T18:38:57.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.634+0000 7f7a04f02640 1 -- 172.21.15.38:0/2900717844 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f79e806ccc0 msgr2=0x7f79e806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:57.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.635+0000 7f7a04f02640 1 --2- 172.21.15.38:0/2900717844 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f79e806ccc0 0x7f79e806f180 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f79f000bbe0 tx=0x7f79f000b390 comp rx=0 tx=0).stop 2024-09-13T18:38:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.635+0000 7f7a04f02640 1 -- 172.21.15.38:0/2900717844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a00100dc0 msgr2=0x7f7a0019c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.635+0000 7f7a04f02640 1 --2- 172.21.15.38:0/2900717844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a00100dc0 0x7f7a0019c0a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f79f802f5d0 tx=0x7f79f8004ab0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.635+0000 7f7a04f02640 1 -- 172.21.15.38:0/2900717844 shutdown_connections 2024-09-13T18:38:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.635+0000 7f7a04f02640 1 --2- 172.21.15.38:0/2900717844 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7a00100dc0 0x7f7a0019c0a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.635+0000 7f7a04f02640 1 --2- 172.21.15.38:0/2900717844 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f79e806ccc0 0x7f79e806f180 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.635+0000 7f7a04f02640 1 --2- 172.21.15.38:0/2900717844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a000fe470 0x7f7a0019bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.635+0000 7f7a04f02640 1 -- 172.21.15.38:0/2900717844 >> 172.21.15.38:0/2900717844 conn(0x7f7a000fa280 msgr2=0x7f7a000fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.635+0000 7f7a04f02640 1 -- 172.21.15.38:0/2900717844 shutdown_connections 2024-09-13T18:38:57.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.635+0000 7f7a04f02640 1 -- 172.21.15.38:0/2900717844 wait complete. 2024-09-13T18:38:57.734 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.732+0000 7f457b27f640 1 -- 172.21.15.38:0/3859824303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45741006e0 msgr2=0x7f4574102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.732+0000 7f457b27f640 1 --2- 172.21.15.38:0/3859824303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45741006e0 0x7f4574102ad0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4570009880 tx=0x7f457002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.732+0000 7f457b27f640 1 -- 172.21.15.38:0/3859824303 shutdown_connections 2024-09-13T18:38:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.732+0000 7f457b27f640 1 --2- 172.21.15.38:0/3859824303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4574103010 0x7f4574105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.732+0000 7f457b27f640 1 --2- 172.21.15.38:0/3859824303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45741006e0 0x7f4574102ad0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.732+0000 7f457b27f640 1 -- 172.21.15.38:0/3859824303 >> 172.21.15.38:0/3859824303 conn(0x7f45740fa280 msgr2=0x7f45740fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.732+0000 7f457b27f640 1 -- 172.21.15.38:0/3859824303 shutdown_connections 2024-09-13T18:38:57.735 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.732+0000 7f457b27f640 1 -- 172.21.15.38:0/3859824303 wait complete. 2024-09-13T18:38:57.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.732+0000 7f457b27f640 1 Processor -- start 2024-09-13T18:38:57.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.733+0000 7f457b27f640 1 -- start start 2024-09-13T18:38:57.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.733+0000 7f457b27f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45741006e0 0x7f45741955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:57.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.733+0000 7f457b27f640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4574103010 0x7f4574195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:57.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.733+0000 7f457b27f640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45741960e0 con 0x7f4574103010 2024-09-13T18:38:57.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.733+0000 7f457b27f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4574196250 con 0x7f45741006e0 2024-09-13T18:38:57.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.733+0000 7f457881a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4574103010 0x7f4574195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:57.738 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.733+0000 7f457881a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4574103010 0x7f4574195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38140/0 (socket says 172.21.15.38:38140) 2024-09-13T18:38:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.733+0000 7f457881a640 1 -- 172.21.15.38:0/885739811 learned_addr learned my addr 172.21.15.38:0/885739811 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.733+0000 7f457901b640 1 --2- 172.21.15.38:0/885739811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45741006e0 0x7f45741955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.733+0000 7f457881a640 1 -- 172.21.15.38:0/885739811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45741006e0 msgr2=0x7f45741955d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.733+0000 7f457881a640 1 --2- 172.21.15.38:0/885739811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45741006e0 0x7f45741955d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.733+0000 7f457881a640 1 -- 172.21.15.38:0/885739811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4570009560 con 0x7f4574103010 2024-09-13T18:38:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.734+0000 7f457881a640 1 --2- 172.21.15.38:0/885739811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4574103010 0x7f4574195b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f456400e9a0 tx=0x7f456400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.734+0000 7f456a7fc640 1 -- 172.21.15.38:0/885739811 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f456400cc90 con 0x7f4574103010 2024-09-13T18:38:57.739 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.734+0000 7f457b27f640 1 -- 172.21.15.38:0/885739811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457419aca0 con 0x7f4574103010 2024-09-13T18:38:57.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.734+0000 7f456a7fc640 1 -- 172.21.15.38:0/885739811 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f456400cdf0 con 0x7f4574103010 2024-09-13T18:38:57.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.734+0000 7f456a7fc640 1 -- 172.21.15.38:0/885739811 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4564010430 con 0x7f4574103010 2024-09-13T18:38:57.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.734+0000 7f457b27f640 1 -- 172.21.15.38:0/885739811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457419b1f0 con 0x7f4574103010 2024-09-13T18:38:57.740 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.735+0000 7f457b27f640 1 -- 172.21.15.38:0/885739811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4574108680 con 0x7f4574103010 2024-09-13T18:38:57.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.736+0000 7f456a7fc640 1 -- 172.21.15.38:0/885739811 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f45640046c0 con 0x7f4574103010 2024-09-13T18:38:57.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.736+0000 7f456a7fc640 1 --2- 172.21.15.38:0/885739811 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f456006cc50 0x7f456006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:57.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.737+0000 7f456a7fc640 1 -- 172.21.15.38:0/885739811 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f4564014070 con 0x7f4574103010 2024-09-13T18:38:57.741 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.737+0000 7f457901b640 1 --2- 172.21.15.38:0/885739811 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f456006cc50 0x7f456006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:57.743 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.737+0000 7f457901b640 1 --2- 172.21.15.38:0/885739811 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f456006cc50 0x7f456006f110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4570000c00 tx=0x7f4570031400 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:57.746 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.744+0000 7f456a7fc640 1 -- 172.21.15.38:0/885739811 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4564056ac0 con 0x7f4574103010 2024-09-13T18:38:57.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.949+0000 7f457b27f640 1 -- 172.21.15.38:0/885739811 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f457419b490 con 0x7f456006cc50 2024-09-13T18:38:57.953 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.950+0000 7f456a7fc640 1 -- 172.21.15.38:0/885739811 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f457419b490 con 0x7f456006cc50 2024-09-13T18:38:57.953 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:38:57.953 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256", 2024-09-13T18:38:57.953 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": true, 2024-09-13T18:38:57.953 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T18:38:57.953 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [ 2024-09-13T18:38:57.954 INFO:teuthology.orchestra.run.smithi038.stdout: "osd", 2024-09-13T18:38:57.954 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph-exporter", 2024-09-13T18:38:57.954 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr", 2024-09-13T18:38:57.954 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2024-09-13T18:38:57.954 INFO:teuthology.orchestra.run.smithi038.stdout: "mon", 2024-09-13T18:38:57.954 INFO:teuthology.orchestra.run.smithi038.stdout: "mds" 2024-09-13T18:38:57.954 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-09-13T18:38:57.954 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": "18/23 daemons upgraded", 2024-09-13T18:38:57.954 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "Currently upgrading grafana daemons", 2024-09-13T18:38:57.954 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:38:57.954 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:38:57.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.952+0000 7f457b27f640 1 -- 172.21.15.38:0/885739811 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f456006cc50 msgr2=0x7f456006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:57.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.952+0000 7f457b27f640 1 --2- 172.21.15.38:0/885739811 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f456006cc50 0x7f456006f110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4570000c00 tx=0x7f4570031400 comp rx=0 tx=0).stop 2024-09-13T18:38:57.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.952+0000 7f457b27f640 1 -- 172.21.15.38:0/885739811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4574103010 msgr2=0x7f4574195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:57.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.952+0000 7f457b27f640 1 --2- 172.21.15.38:0/885739811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4574103010 0x7f4574195b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f456400e9a0 tx=0x7f456400ee60 comp rx=0 tx=0).stop 2024-09-13T18:38:57.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.953+0000 7f457b27f640 1 -- 172.21.15.38:0/885739811 shutdown_connections 2024-09-13T18:38:57.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.953+0000 7f457b27f640 1 --2- 172.21.15.38:0/885739811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4574103010 0x7f4574195b10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.953+0000 7f457b27f640 1 --2- 172.21.15.38:0/885739811 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f456006cc50 0x7f456006f110 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.953+0000 7f457b27f640 1 --2- 172.21.15.38:0/885739811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45741006e0 0x7f45741955d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:57.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.953+0000 7f457b27f640 1 -- 172.21.15.38:0/885739811 >> 172.21.15.38:0/885739811 conn(0x7f45740fa280 msgr2=0x7f45740fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:57.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.953+0000 7f457b27f640 1 -- 172.21.15.38:0/885739811 shutdown_connections 2024-09-13T18:38:57.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:57.953+0000 7f457b27f640 1 -- 172.21.15.38:0/885739811 wait complete. 2024-09-13T18:38:58.041 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.038+0000 7f48969de640 1 -- 172.21.15.38:0/889393421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48900feaf0 msgr2=0x7f48900feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:58.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.038+0000 7f48969de640 1 --2- 172.21.15.38:0/889393421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48900feaf0 0x7f48900feef0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4880009880 tx=0x7f488002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.038+0000 7f48969de640 1 -- 172.21.15.38:0/889393421 shutdown_connections 2024-09-13T18:38:58.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.038+0000 7f48969de640 1 --2- 172.21.15.38:0/889393421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48900ffcf0 0x7f4890100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.038+0000 7f48969de640 1 --2- 172.21.15.38:0/889393421 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48900feaf0 0x7f48900feef0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.038+0000 7f48969de640 1 -- 172.21.15.38:0/889393421 >> 172.21.15.38:0/889393421 conn(0x7f48900fa280 msgr2=0x7f48900fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:58.042 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.038+0000 7f48969de640 1 -- 172.21.15.38:0/889393421 shutdown_connections 2024-09-13T18:38:58.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.038+0000 7f48969de640 1 -- 172.21.15.38:0/889393421 wait complete. 2024-09-13T18:38:58.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.039+0000 7f48969de640 1 Processor -- start 2024-09-13T18:38:58.046 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.040+0000 7f48969de640 1 -- start start 2024-09-13T18:38:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.040+0000 7f48969de640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48900feaf0 0x7f48901955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.040+0000 7f48969de640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48900ffcf0 0x7f4890195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.040+0000 7f48969de640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48901960e0 con 0x7f48900feaf0 2024-09-13T18:38:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.040+0000 7f48969de640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4890196250 con 0x7f48900ffcf0 2024-09-13T18:38:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.042+0000 7f488ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48900feaf0 0x7f48901955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:58.048 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.042+0000 7f488ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48900feaf0 0x7f48901955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38156/0 (socket says 172.21.15.38:38156) 2024-09-13T18:38:58.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.042+0000 7f488ffff640 1 -- 172.21.15.38:0/3612335829 learned_addr learned my addr 172.21.15.38:0/3612335829 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:38:58.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.042+0000 7f488f7fe640 1 --2- 172.21.15.38:0/3612335829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48900ffcf0 0x7f4890195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:58.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.042+0000 7f488ffff640 1 -- 172.21.15.38:0/3612335829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48900ffcf0 msgr2=0x7f4890195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:58.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.042+0000 7f488ffff640 1 --2- 172.21.15.38:0/3612335829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48900ffcf0 0x7f4890195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.042+0000 7f488ffff640 1 -- 172.21.15.38:0/3612335829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880009560 con 0x7f48900feaf0 2024-09-13T18:38:58.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.042+0000 7f488f7fe640 1 --2- 172.21.15.38:0/3612335829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48900ffcf0 0x7f4890195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:58.049 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.043+0000 7f488ffff640 1 --2- 172.21.15.38:0/3612335829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48900feaf0 0x7f48901955d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4880005610 tx=0x7f4880005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:58.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.043+0000 7f488d7fa640 1 -- 172.21.15.38:0/3612335829 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4880004b20 con 0x7f48900feaf0 2024-09-13T18:38:58.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.043+0000 7f488d7fa640 1 -- 172.21.15.38:0/3612335829 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4880004c80 con 0x7f48900feaf0 2024-09-13T18:38:58.050 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.043+0000 7f48969de640 1 -- 172.21.15.38:0/3612335829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489006a010 con 0x7f48900feaf0 2024-09-13T18:38:58.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.043+0000 7f48969de640 1 -- 172.21.15.38:0/3612335829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489006a500 con 0x7f48900feaf0 2024-09-13T18:38:58.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.043+0000 7f488d7fa640 1 -- 172.21.15.38:0/3612335829 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4880031af0 con 0x7f48900feaf0 2024-09-13T18:38:58.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.044+0000 7f48969de640 1 -- 172.21.15.38:0/3612335829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48901075a0 con 0x7f48900feaf0 2024-09-13T18:38:58.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.045+0000 7f488d7fa640 1 -- 172.21.15.38:0/3612335829 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f48800035f0 con 0x7f48900feaf0 2024-09-13T18:38:58.052 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.045+0000 7f488d7fa640 1 --2- 172.21.15.38:0/3612335829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f487806cc50 0x7f487806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:58.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.045+0000 7f488d7fa640 1 -- 172.21.15.38:0/3612335829 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f48800ad8d0 con 0x7f48900feaf0 2024-09-13T18:38:58.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.045+0000 7f488f7fe640 1 --2- 172.21.15.38:0/3612335829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f487806cc50 0x7f487806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:58.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.046+0000 7f488f7fe640 1 --2- 172.21.15.38:0/3612335829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f487806cc50 0x7f487806f110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4890196af0 tx=0x7f488400a2d0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:58.053 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.049+0000 7f488d7fa640 1 -- 172.21.15.38:0/3612335829 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4880077940 con 0x7f48900feaf0 2024-09-13T18:38:58.207 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:57 smithi038 ceph-mon[91522]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:58.207 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:57 smithi038 ceph-mon[91522]: pgmap v286: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:58.207 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:57 smithi038 ceph-mon[91522]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:58.207 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:57 smithi038 ceph-mon[91522]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:58.207 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:57 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2238526612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:58.207 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:57 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:58.207 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:57 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:58.207 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:57 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:58.207 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:57 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2900717844' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:38:58.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:57 smithi149 ceph-mon[76906]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:58.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:57 smithi149 ceph-mon[76906]: pgmap v286: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:38:58.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:57 smithi149 ceph-mon[76906]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:58.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:57 smithi149 ceph-mon[76906]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:58.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:57 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2238526612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:38:58.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:57 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:58.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:57 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:38:58.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:57 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:38:58.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:57 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2900717844' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:38:58.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.304+0000 7f48969de640 1 -- 172.21.15.38:0/3612335829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f489006ac00 con 0x7f48900feaf0 2024-09-13T18:38:58.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.305+0000 7f488d7fa640 1 -- 172.21.15.38:0/3612335829 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f488007af60 con 0x7f48900feaf0 2024-09-13T18:38:58.307 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:38:58.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.307+0000 7f48969de640 1 -- 172.21.15.38:0/3612335829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f487806cc50 msgr2=0x7f487806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:58.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.307+0000 7f48969de640 1 --2- 172.21.15.38:0/3612335829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f487806cc50 0x7f487806f110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4890196af0 tx=0x7f488400a2d0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.307+0000 7f48969de640 1 -- 172.21.15.38:0/3612335829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48900feaf0 msgr2=0x7f48901955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:58.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.307+0000 7f48969de640 1 --2- 172.21.15.38:0/3612335829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48900feaf0 0x7f48901955d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4880005610 tx=0x7f4880005640 comp rx=0 tx=0).stop 2024-09-13T18:38:58.309 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.307+0000 7f48969de640 1 -- 172.21.15.38:0/3612335829 shutdown_connections 2024-09-13T18:38:58.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.307+0000 7f48969de640 1 --2- 172.21.15.38:0/3612335829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f487806cc50 0x7f487806f110 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.307+0000 7f48969de640 1 --2- 172.21.15.38:0/3612335829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48900ffcf0 0x7f4890195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.307+0000 7f48969de640 1 --2- 172.21.15.38:0/3612335829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48900feaf0 0x7f48901955d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:58.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.307+0000 7f48969de640 1 -- 172.21.15.38:0/3612335829 >> 172.21.15.38:0/3612335829 conn(0x7f48900fa280 msgr2=0x7f48900fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:58.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.307+0000 7f48969de640 1 -- 172.21.15.38:0/3612335829 shutdown_connections 2024-09-13T18:38:58.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:38:58.307+0000 7f48969de640 1 -- 172.21.15.38:0/3612335829 wait complete. 2024-09-13T18:38:59.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:58 smithi149 ceph-mon[76906]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:59.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:58 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3612335829' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:38:59.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:58 smithi038 ceph-mon[91522]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:38:59.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:58 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3612335829' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:38:59.959 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:38:59 smithi038 ceph-mon[91522]: pgmap v287: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:00.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:38:59 smithi149 ceph-mon[76906]: pgmap v287: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:02.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:01 smithi149 ceph-mon[76906]: pgmap v288: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:39:02.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:01 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:02.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:01 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:01 smithi038 ceph-mon[91522]: pgmap v288: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:39:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:01 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:02.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:01 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:03.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:03 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:03.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:03 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:03.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:03 smithi149 ceph-mon[76906]: pgmap v289: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:03.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:03 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:03.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:03 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:03.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:03 smithi038 ceph-mon[91522]: pgmap v289: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:05.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:05 smithi038 ceph-mon[91522]: pgmap v290: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:05.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:05 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:06.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:05 smithi149 ceph-mon[76906]: pgmap v290: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:06.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:05 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:39:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:39:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T18:39:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T18:39:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:39:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.832 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.833 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: Upgrade: Finalizing container_image settings 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T18:39:06.834 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T18:39:06.835 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T18:39:06.836 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T18:39:06.836 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:06.836 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:06.836 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: Upgrade: Complete! 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:39:06.837 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:39:06.838 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:39:06.838 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:07.009 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:07.009 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:39:07.009 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:39:07.009 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:07.009 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T18:39:07.009 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T18:39:07.009 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:39:07.009 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.010 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: Upgrade: Finalizing container_image settings 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T18:39:07.011 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T18:39:07.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T18:39:07.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T18:39:07.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T18:39:07.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T18:39:07.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T18:39:07.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T18:39:07.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T18:39:07.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T18:39:07.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:07.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T18:39:07.012 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T18:39:07.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T18:39:07.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T18:39:07.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T18:39:07.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T18:39:07.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T18:39:07.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T18:39:07.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:07.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:07.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:07.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:07.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:07.013 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T18:39:07.014 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-09-13T18:39:07.014 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-09-13T18:39:07.014 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: Upgrade: Complete! 2024-09-13T18:39:07.014 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T18:39:07.014 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T18:39:07.014 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:39:07.014 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:39:07.014 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:39:07.014 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:07.014 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:39:07.014 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:39:07.015 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:39:07.015 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:07.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:07 smithi038 ceph-mon[91522]: pgmap v291: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:07.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:39:07.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:08.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:07 smithi149 ceph-mon[76906]: pgmap v291: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:08.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:39:08.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:39:09.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:09 smithi038 ceph-mon[91522]: pgmap v292: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:10.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:09 smithi149 ceph-mon[76906]: pgmap v292: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:11.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:11 smithi038 ceph-mon[91522]: pgmap v293: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:39:12.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:11 smithi149 ceph-mon[76906]: pgmap v293: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:39:13.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:13 smithi038 ceph-mon[91522]: pgmap v294: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:14.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:13 smithi149 ceph-mon[76906]: pgmap v294: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:15.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:15 smithi038 ceph-mon[91522]: pgmap v295: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:16.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:15 smithi149 ceph-mon[76906]: pgmap v295: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:18.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:17 smithi149 ceph-mon[76906]: pgmap v296: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:18.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:17 smithi038 ceph-mon[91522]: pgmap v296: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:19.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:19 smithi038 ceph-mon[91522]: pgmap v297: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:20.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:19 smithi149 ceph-mon[76906]: pgmap v297: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:21 smithi149 ceph-mon[76906]: pgmap v298: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:39:22.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:39:22.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:21 smithi038 ceph-mon[91522]: pgmap v298: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:39:22.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:39:24.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:23 smithi149 ceph-mon[76906]: pgmap v299: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:24.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:23 smithi038 ceph-mon[91522]: pgmap v299: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:26.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:25 smithi149 ceph-mon[76906]: pgmap v300: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:26.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:25 smithi038 ceph-mon[91522]: pgmap v300: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:28.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:27 smithi149 ceph-mon[76906]: pgmap v301: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:28.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:27 smithi038 ceph-mon[91522]: pgmap v301: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:28.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.406+0000 7fed019af640 1 -- 172.21.15.38:0/108514826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc100d90 msgr2=0x7fecfc101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:28.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.406+0000 7fed019af640 1 --2- 172.21.15.38:0/108514826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc100d90 0x7fecfc101210 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009880 tx=0x7fecf002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:39:28.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.406+0000 7fed019af640 1 -- 172.21.15.38:0/108514826 shutdown_connections 2024-09-13T18:39:28.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.406+0000 7fed019af640 1 --2- 172.21.15.38:0/108514826 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc100d90 0x7fecfc101210 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:28.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.406+0000 7fed019af640 1 --2- 172.21.15.38:0/108514826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecfc0ffb90 0x7fecfc0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:28.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.406+0000 7fed019af640 1 -- 172.21.15.38:0/108514826 >> 172.21.15.38:0/108514826 conn(0x7fecfc0fb320 msgr2=0x7fecfc0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:28.409 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.406+0000 7fed019af640 1 -- 172.21.15.38:0/108514826 shutdown_connections 2024-09-13T18:39:28.410 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.406+0000 7fed019af640 1 -- 172.21.15.38:0/108514826 wait complete. 2024-09-13T18:39:28.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.407+0000 7fed019af640 1 Processor -- start 2024-09-13T18:39:28.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.407+0000 7fed019af640 1 -- start start 2024-09-13T18:39:28.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.407+0000 7fed019af640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecfc0ffb90 0x7fecfc1955d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:28.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.407+0000 7fed019af640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc100d90 0x7fecfc195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:28.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.407+0000 7fed019af640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc1960e0 con 0x7fecfc100d90 2024-09-13T18:39:28.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.407+0000 7fed019af640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc196250 con 0x7fecfc0ffb90 2024-09-13T18:39:28.411 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.407+0000 7fecfa7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc100d90 0x7fecfc195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:28.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.407+0000 7fecfa7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc100d90 0x7fecfc195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47786/0 (socket says 172.21.15.38:47786) 2024-09-13T18:39:28.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.407+0000 7fecfa7fc640 1 -- 172.21.15.38:0/3452167829 learned_addr learned my addr 172.21.15.38:0/3452167829 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:39:28.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.408+0000 7fecfaffd640 1 --2- 172.21.15.38:0/3452167829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecfc0ffb90 0x7fecfc1955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:28.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.408+0000 7fecfa7fc640 1 -- 172.21.15.38:0/3452167829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecfc0ffb90 msgr2=0x7fecfc1955d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:28.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.408+0000 7fecfa7fc640 1 --2- 172.21.15.38:0/3452167829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecfc0ffb90 0x7fecfc1955d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:28.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.408+0000 7fecfa7fc640 1 -- 172.21.15.38:0/3452167829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0009560 con 0x7fecfc100d90 2024-09-13T18:39:28.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.408+0000 7fecfa7fc640 1 --2- 172.21.15.38:0/3452167829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc100d90 0x7fecfc195b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fecf0006010 tx=0x7fecf00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:28.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.408+0000 7fed009ad640 1 -- 172.21.15.38:0/3452167829 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf0004aa0 con 0x7fecfc100d90 2024-09-13T18:39:28.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.408+0000 7fed009ad640 1 -- 172.21.15.38:0/3452167829 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fecf0005d50 con 0x7fecfc100d90 2024-09-13T18:39:28.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.408+0000 7fed019af640 1 -- 172.21.15.38:0/3452167829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc19ac90 con 0x7fecfc100d90 2024-09-13T18:39:28.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.408+0000 7fed009ad640 1 -- 172.21.15.38:0/3452167829 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf0031860 con 0x7fecfc100d90 2024-09-13T18:39:28.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.409+0000 7fed019af640 1 -- 172.21.15.38:0/3452167829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc19b200 con 0x7fecfc100d90 2024-09-13T18:39:28.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.410+0000 7fed019af640 1 -- 172.21.15.38:0/3452167829 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecfc18f5f0 con 0x7fecfc100d90 2024-09-13T18:39:28.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.410+0000 7fed009ad640 1 -- 172.21.15.38:0/3452167829 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fecf0003b90 con 0x7fecfc100d90 2024-09-13T18:39:28.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.411+0000 7fed009ad640 1 --2- 172.21.15.38:0/3452167829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fece406cc60 0x7fece406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:28.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.411+0000 7fed009ad640 1 -- 172.21.15.38:0/3452167829 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fecf00ad620 con 0x7fecfc100d90 2024-09-13T18:39:28.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.411+0000 7fecfaffd640 1 --2- 172.21.15.38:0/3452167829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fece406cc60 0x7fece406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:28.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.412+0000 7fecfaffd640 1 --2- 172.21.15.38:0/3452167829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fece406cc60 0x7fece406f120 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fecfc100bf0 tx=0x7fecec005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:28.418 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.415+0000 7fed009ad640 1 -- 172.21.15.38:0/3452167829 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fecf00776b0 con 0x7fecfc100d90 2024-09-13T18:39:28.606 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.604+0000 7fed019af640 1 -- 172.21.15.38:0/3452167829 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fecfc02c4f0 con 0x7fece406cc60 2024-09-13T18:39:28.607 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.605+0000 7fed009ad640 1 -- 172.21.15.38:0/3452167829 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fecfc02c4f0 con 0x7fece406cc60 2024-09-13T18:39:28.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.607+0000 7fed019af640 1 -- 172.21.15.38:0/3452167829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fece406cc60 msgr2=0x7fece406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:28.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.607+0000 7fed019af640 1 --2- 172.21.15.38:0/3452167829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fece406cc60 0x7fece406f120 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fecfc100bf0 tx=0x7fecec005f90 comp rx=0 tx=0).stop 2024-09-13T18:39:28.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.607+0000 7fed019af640 1 -- 172.21.15.38:0/3452167829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc100d90 msgr2=0x7fecfc195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:28.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.607+0000 7fed019af640 1 --2- 172.21.15.38:0/3452167829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc100d90 0x7fecfc195b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fecf0006010 tx=0x7fecf00055a0 comp rx=0 tx=0).stop 2024-09-13T18:39:28.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.607+0000 7fed019af640 1 -- 172.21.15.38:0/3452167829 shutdown_connections 2024-09-13T18:39:28.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.607+0000 7fed019af640 1 --2- 172.21.15.38:0/3452167829 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fecfc100d90 0x7fecfc195b10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:28.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.607+0000 7fed019af640 1 --2- 172.21.15.38:0/3452167829 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fece406cc60 0x7fece406f120 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:28.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.607+0000 7fed019af640 1 --2- 172.21.15.38:0/3452167829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fecfc0ffb90 0x7fecfc1955d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:28.610 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.607+0000 7fed019af640 1 -- 172.21.15.38:0/3452167829 >> 172.21.15.38:0/3452167829 conn(0x7fecfc0fb320 msgr2=0x7fecfc104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:28.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.607+0000 7fed019af640 1 -- 172.21.15.38:0/3452167829 shutdown_connections 2024-09-13T18:39:28.611 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:28.607+0000 7fed019af640 1 -- 172.21.15.38:0/3452167829 wait complete. 2024-09-13T18:39:29.229 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph orch ps' 2024-09-13T18:39:29.486 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:39:29.950 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:29 smithi038 ceph-mon[91522]: pgmap v302: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:29.950 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:29 smithi038 ceph-mon[91522]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:39:30.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:29 smithi149 ceph-mon[76906]: pgmap v302: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:30.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:29 smithi149 ceph-mon[76906]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:39:31.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.139+0000 7fd323fca640 1 -- 172.21.15.38:0/3735614346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd31c0fe9f0 msgr2=0x7fd31c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.139+0000 7fd323fca640 1 --2- 172.21.15.38:0/3735614346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd31c0fe9f0 0x7fd31c0fee50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009880 tx=0x7fd30c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.140+0000 7fd323fca640 1 -- 172.21.15.38:0/3735614346 shutdown_connections 2024-09-13T18:39:31.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.140+0000 7fd323fca640 1 --2- 172.21.15.38:0/3735614346 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd31c0fe9f0 0x7fd31c0fee50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.140+0000 7fd323fca640 1 --2- 172.21.15.38:0/3735614346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd31c1049f0 0x7fd31c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.140+0000 7fd323fca640 1 -- 172.21.15.38:0/3735614346 >> 172.21.15.38:0/3735614346 conn(0x7fd31c0758a0 msgr2=0x7fd31c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.140+0000 7fd323fca640 1 -- 172.21.15.38:0/3735614346 shutdown_connections 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.140+0000 7fd323fca640 1 -- 172.21.15.38:0/3735614346 wait complete. 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.140+0000 7fd323fca640 1 Processor -- start 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.140+0000 7fd323fca640 1 -- start start 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd323fca640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd31c0fe9f0 0x7fd31c19b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd323fca640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd31c1049f0 0x7fd31c19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd323fca640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c195850 con 0x7fd31c0fe9f0 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd323fca640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c195990 con 0x7fd31c1049f0 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd321d66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd31c0fe9f0 0x7fd31c19b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd321d66640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd31c0fe9f0 0x7fd31c19b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47806/0 (socket says 172.21.15.38:47806) 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd321d66640 1 -- 172.21.15.38:0/3089057449 learned_addr learned my addr 172.21.15.38:0/3089057449 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd321565640 1 --2- 172.21.15.38:0/3089057449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd31c1049f0 0x7fd31c19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd321d66640 1 -- 172.21.15.38:0/3089057449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd31c1049f0 msgr2=0x7fd31c19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd321d66640 1 --2- 172.21.15.38:0/3089057449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd31c1049f0 0x7fd31c19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd321d66640 1 -- 172.21.15.38:0/3089057449 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c009560 con 0x7fd31c0fe9f0 2024-09-13T18:39:31.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd321565640 1 --2- 172.21.15.38:0/3089057449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd31c1049f0 0x7fd31c19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:31.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd321d66640 1 --2- 172.21.15.38:0/3089057449 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd31c0fe9f0 0x7fd31c19b7f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd31800e970 tx=0x7fd31800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd312ffd640 1 -- 172.21.15.38:0/3089057449 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd31800cc90 con 0x7fd31c0fe9f0 2024-09-13T18:39:31.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd312ffd640 1 -- 172.21.15.38:0/3089057449 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd31800cdf0 con 0x7fd31c0fe9f0 2024-09-13T18:39:31.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd323fca640 1 -- 172.21.15.38:0/3089057449 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c195c70 con 0x7fd31c0fe9f0 2024-09-13T18:39:31.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.141+0000 7fd312ffd640 1 -- 172.21.15.38:0/3089057449 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd318010430 con 0x7fd31c0fe9f0 2024-09-13T18:39:31.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.142+0000 7fd323fca640 1 -- 172.21.15.38:0/3089057449 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31c1961c0 con 0x7fd31c0fe9f0 2024-09-13T18:39:31.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.142+0000 7fd323fca640 1 -- 172.21.15.38:0/3089057449 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31c100130 con 0x7fd31c0fe9f0 2024-09-13T18:39:31.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.143+0000 7fd312ffd640 1 -- 172.21.15.38:0/3089057449 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd3180046c0 con 0x7fd31c0fe9f0 2024-09-13T18:39:31.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.143+0000 7fd312ffd640 1 --2- 172.21.15.38:0/3089057449 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd30806cc50 0x7fd30806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.144+0000 7fd312ffd640 1 -- 172.21.15.38:0/3089057449 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fd318014070 con 0x7fd31c0fe9f0 2024-09-13T18:39:31.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.144+0000 7fd321565640 1 --2- 172.21.15.38:0/3089057449 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd30806cc50 0x7fd30806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.148 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.144+0000 7fd321565640 1 --2- 172.21.15.38:0/3089057449 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd30806cc50 0x7fd30806f110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd31c1970a0 tx=0x7fd30c005a20 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.150 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.148+0000 7fd312ffd640 1 -- 172.21.15.38:0/3089057449 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd318056bf0 con 0x7fd31c0fe9f0 2024-09-13T18:39:31.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.330+0000 7fd323fca640 1 -- 172.21.15.38:0/3089057449 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd31c10bb40 con 0x7fd30806cc50 2024-09-13T18:39:31.342 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.340+0000 7fd312ffd640 1 -- 172.21.15.38:0/3089057449 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd31c10bb40 con 0x7fd30806cc50 2024-09-13T18:39:31.343 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:39:31.343 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (49s) 29s ago 17m 16.6M - 0.25.0 c8568f914cd2 5df1cbc96260 2024-09-13T18:39:31.343 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (105s) 29s ago 17m 7616k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ee2ab4027fb4 2024-09-13T18:39:31.343 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (95s) 77s ago 16m 7499k - 18.2.4-860-g6c6b083f 8a91f241d7d4 74bef92b9a16 2024-09-13T18:39:31.343 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (6m) 29s ago 17m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:39:31.343 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (6m) 77s ago 16m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:39:31.343 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (34s) 29s ago 16m 39.9M - 9.4.7 954c08fa6188 424d0065da48 2024-09-13T18:39:31.343 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (2m) 29s ago 11m 19.8M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1ed3b623871d 2024-09-13T18:39:31.343 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (2m) 29s ago 11m 83.5M - 18.2.4-860-g6c6b083f 8a91f241d7d4 710abbbd3193 2024-09-13T18:39:31.343 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (2m) 77s ago 11m 84.9M - 18.2.4-860-g6c6b083f 8a91f241d7d4 df31d6b56cc0 2024-09-13T18:39:31.343 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (117s) 77s ago 11m 16.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 8f450c446d4a 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (8m) 29s ago 18m 503M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (7m) 77s ago 16m 441M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (7m) 29s ago 18m 58.1M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (7m) 77s ago 16m 39.0M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (83s) 29s ago 17m 8480k - 1.5.0 0da6a335fe13 4d79b13b34ff 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (80s) 77s ago 16m 3363k - 1.5.0 0da6a335fe13 a970c2754c12 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (6m) 29s ago 15m 135M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (5m) 29s ago 14m 110M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 b2f99a2919b9 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (5m) 29s ago 14m 105M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 090af670cd3d 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (4m) 77s ago 14m 121M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 e4321b085347 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (4m) 77s ago 13m 102M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 c6ec97a4d9ff 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (3m) 77s ago 13m 98.2M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 6faab71ae8a9 2024-09-13T18:39:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (64s) 29s ago 16m 49.6M - 2.43.0 a07b618ecd1d b0fec85ac4ae 2024-09-13T18:39:31.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.342+0000 7fd323fca640 1 -- 172.21.15.38:0/3089057449 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd30806cc50 msgr2=0x7fd30806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.342+0000 7fd323fca640 1 --2- 172.21.15.38:0/3089057449 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd30806cc50 0x7fd30806f110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd31c1970a0 tx=0x7fd30c005a20 comp rx=0 tx=0).stop 2024-09-13T18:39:31.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.342+0000 7fd323fca640 1 -- 172.21.15.38:0/3089057449 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd31c0fe9f0 msgr2=0x7fd31c19b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.345 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.342+0000 7fd323fca640 1 --2- 172.21.15.38:0/3089057449 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd31c0fe9f0 0x7fd31c19b7f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd31800e970 tx=0x7fd31800ed70 comp rx=0 tx=0).stop 2024-09-13T18:39:31.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.342+0000 7fd323fca640 1 -- 172.21.15.38:0/3089057449 shutdown_connections 2024-09-13T18:39:31.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.342+0000 7fd323fca640 1 --2- 172.21.15.38:0/3089057449 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd30806cc50 0x7fd30806f110 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.342+0000 7fd323fca640 1 --2- 172.21.15.38:0/3089057449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd31c1049f0 0x7fd31c19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.342+0000 7fd323fca640 1 --2- 172.21.15.38:0/3089057449 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd31c0fe9f0 0x7fd31c19b7f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.342+0000 7fd323fca640 1 -- 172.21.15.38:0/3089057449 >> 172.21.15.38:0/3089057449 conn(0x7fd31c0758a0 msgr2=0x7fd31c0fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.342+0000 7fd323fca640 1 -- 172.21.15.38:0/3089057449 shutdown_connections 2024-09-13T18:39:31.346 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:31.342+0000 7fd323fca640 1 -- 172.21.15.38:0/3089057449 wait complete. 2024-09-13T18:39:31.971 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:31 smithi038 ceph-mon[91522]: pgmap v303: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:39:31.993 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph orch upgrade status' 2024-09-13T18:39:32.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:31 smithi149 ceph-mon[76906]: pgmap v303: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:39:32.205 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:39:32.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:32 smithi038 ceph-mon[91522]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:39:33.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:32 smithi149 ceph-mon[76906]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:39:33.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.805+0000 7fe9b46a0640 1 -- 172.21.15.38:0/908908869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac100750 msgr2=0x7fe9ac1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.805+0000 7fe9b46a0640 1 --2- 172.21.15.38:0/908908869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac100750 0x7fe9ac1047a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009880 tx=0x7fe99c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.805+0000 7fe9b46a0640 1 -- 172.21.15.38:0/908908869 shutdown_connections 2024-09-13T18:39:33.810 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.805+0000 7fe9b46a0640 1 --2- 172.21.15.38:0/908908869 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac100750 0x7fe9ac1047a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.805+0000 7fe9b46a0640 1 --2- 172.21.15.38:0/908908869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9ac0ffda0 0x7fe9ac100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.805+0000 7fe9b46a0640 1 -- 172.21.15.38:0/908908869 >> 172.21.15.38:0/908908869 conn(0x7fe9ac0fb840 msgr2=0x7fe9ac0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:33.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.805+0000 7fe9b46a0640 1 -- 172.21.15.38:0/908908869 shutdown_connections 2024-09-13T18:39:33.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.805+0000 7fe9b46a0640 1 -- 172.21.15.38:0/908908869 wait complete. 2024-09-13T18:39:33.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.805+0000 7fe9b46a0640 1 Processor -- start 2024-09-13T18:39:33.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.805+0000 7fe9b46a0640 1 -- start start 2024-09-13T18:39:33.811 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.806+0000 7fe9b46a0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac0ffda0 0x7fe9ac19b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.806+0000 7fe9b46a0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9ac100750 0x7fe9ac19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.806+0000 7fe9b46a0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac19c340 con 0x7fe9ac0ffda0 2024-09-13T18:39:33.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.806+0000 7fe9b46a0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac1958d0 con 0x7fe9ac100750 2024-09-13T18:39:33.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.806+0000 7fe9b243c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac0ffda0 0x7fe9ac19b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.806+0000 7fe9b243c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac0ffda0 0x7fe9ac19b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41760/0 (socket says 172.21.15.38:41760) 2024-09-13T18:39:33.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.806+0000 7fe9b243c640 1 -- 172.21.15.38:0/2781974033 learned_addr learned my addr 172.21.15.38:0/2781974033 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:39:33.812 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.806+0000 7fe9b1c3b640 1 --2- 172.21.15.38:0/2781974033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9ac100750 0x7fe9ac19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.806+0000 7fe9b243c640 1 -- 172.21.15.38:0/2781974033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9ac100750 msgr2=0x7fe9ac19bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.806+0000 7fe9b243c640 1 --2- 172.21.15.38:0/2781974033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9ac100750 0x7fe9ac19bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.806+0000 7fe9b243c640 1 -- 172.21.15.38:0/2781974033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c009560 con 0x7fe9ac0ffda0 2024-09-13T18:39:33.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.806+0000 7fe9b243c640 1 --2- 172.21.15.38:0/2781974033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac0ffda0 0x7fe9ac19b7e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800e970 tx=0x7fe9a800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:33.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.807+0000 7fe9a37fe640 1 -- 172.21.15.38:0/2781974033 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a800cc90 con 0x7fe9ac0ffda0 2024-09-13T18:39:33.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.807+0000 7fe9a37fe640 1 -- 172.21.15.38:0/2781974033 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe9a800cdf0 con 0x7fe9ac0ffda0 2024-09-13T18:39:33.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.807+0000 7fe9b46a0640 1 -- 172.21.15.38:0/2781974033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ac195bb0 con 0x7fe9ac0ffda0 2024-09-13T18:39:33.813 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.807+0000 7fe9a37fe640 1 -- 172.21.15.38:0/2781974033 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a8010430 con 0x7fe9ac0ffda0 2024-09-13T18:39:33.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.807+0000 7fe9b46a0640 1 -- 172.21.15.38:0/2781974033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac1960d0 con 0x7fe9ac0ffda0 2024-09-13T18:39:33.814 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.808+0000 7fe9b46a0640 1 -- 172.21.15.38:0/2781974033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ac101280 con 0x7fe9ac0ffda0 2024-09-13T18:39:33.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.808+0000 7fe9a37fe640 1 -- 172.21.15.38:0/2781974033 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe9a80046c0 con 0x7fe9ac0ffda0 2024-09-13T18:39:33.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.809+0000 7fe9a37fe640 1 --2- 172.21.15.38:0/2781974033 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe99806cc60 0x7fe99806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.809+0000 7fe9a37fe640 1 -- 172.21.15.38:0/2781974033 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fe9a8014070 con 0x7fe9ac0ffda0 2024-09-13T18:39:33.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.809+0000 7fe9b1c3b640 1 --2- 172.21.15.38:0/2781974033 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe99806cc60 0x7fe99806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.815 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.809+0000 7fe9b1c3b640 1 --2- 172.21.15.38:0/2781974033 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe99806cc60 0x7fe99806f120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe99c000c00 tx=0x7fe99c005a20 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:33.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:33.813+0000 7fe9a37fe640 1 -- 172.21.15.38:0/2781974033 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe9a8056a90 con 0x7fe9ac0ffda0 2024-09-13T18:39:33.831 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:33 smithi038 ceph-mon[91522]: pgmap v304: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:34.002 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.000+0000 7fe9b46a0640 1 -- 172.21.15.38:0/2781974033 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9ac108120 con 0x7fe99806cc60 2024-09-13T18:39:34.003 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.001+0000 7fe9a37fe640 1 -- 172.21.15.38:0/2781974033 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fe9ac108120 con 0x7fe99806cc60 2024-09-13T18:39:34.003 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:39:34.003 INFO:teuthology.orchestra.run.smithi038.stdout: "target_image": null, 2024-09-13T18:39:34.003 INFO:teuthology.orchestra.run.smithi038.stdout: "in_progress": false, 2024-09-13T18:39:34.004 INFO:teuthology.orchestra.run.smithi038.stdout: "which": "", 2024-09-13T18:39:34.004 INFO:teuthology.orchestra.run.smithi038.stdout: "services_complete": [], 2024-09-13T18:39:34.004 INFO:teuthology.orchestra.run.smithi038.stdout: "progress": null, 2024-09-13T18:39:34.004 INFO:teuthology.orchestra.run.smithi038.stdout: "message": "", 2024-09-13T18:39:34.004 INFO:teuthology.orchestra.run.smithi038.stdout: "is_paused": false 2024-09-13T18:39:34.004 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:39:34.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.003+0000 7fe9b46a0640 1 -- 172.21.15.38:0/2781974033 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe99806cc60 msgr2=0x7fe99806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.003+0000 7fe9b46a0640 1 --2- 172.21.15.38:0/2781974033 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe99806cc60 0x7fe99806f120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe99c000c00 tx=0x7fe99c005a20 comp rx=0 tx=0).stop 2024-09-13T18:39:34.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.003+0000 7fe9b46a0640 1 -- 172.21.15.38:0/2781974033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac0ffda0 msgr2=0x7fe9ac19b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.005 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.003+0000 7fe9b46a0640 1 --2- 172.21.15.38:0/2781974033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac0ffda0 0x7fe9ac19b7e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800e970 tx=0x7fe9a800ed70 comp rx=0 tx=0).stop 2024-09-13T18:39:34.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.003+0000 7fe9b46a0640 1 -- 172.21.15.38:0/2781974033 shutdown_connections 2024-09-13T18:39:34.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.003+0000 7fe9b46a0640 1 --2- 172.21.15.38:0/2781974033 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe99806cc60 0x7fe99806f120 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.003+0000 7fe9b46a0640 1 --2- 172.21.15.38:0/2781974033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9ac100750 0x7fe9ac19bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.003+0000 7fe9b46a0640 1 --2- 172.21.15.38:0/2781974033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe9ac0ffda0 0x7fe9ac19b7e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.003+0000 7fe9b46a0640 1 -- 172.21.15.38:0/2781974033 >> 172.21.15.38:0/2781974033 conn(0x7fe9ac0fb840 msgr2=0x7fe9ac0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:34.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.003+0000 7fe9b46a0640 1 -- 172.21.15.38:0/2781974033 shutdown_connections 2024-09-13T18:39:34.006 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:34.003+0000 7fe9b46a0640 1 -- 172.21.15.38:0/2781974033 wait complete. 2024-09-13T18:39:34.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:33 smithi149 ceph-mon[76906]: pgmap v304: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:34.730 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph health detail' 2024-09-13T18:39:34.945 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:39:36.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:35 smithi149 ceph-mon[76906]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:39:36.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:35 smithi149 ceph-mon[76906]: pgmap v305: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:36.026 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:35 smithi038 ceph-mon[91522]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:39:36.026 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:35 smithi038 ceph-mon[91522]: pgmap v305: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:36.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.512+0000 7f9fc7def640 1 -- 172.21.15.38:0/3252886188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc0100750 msgr2=0x7f9fc01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.512+0000 7f9fc7def640 1 --2- 172.21.15.38:0/3252886188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc0100750 0x7f9fc01047a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009880 tx=0x7f9fb002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.513+0000 7f9fc7def640 1 -- 172.21.15.38:0/3252886188 shutdown_connections 2024-09-13T18:39:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.513+0000 7f9fc7def640 1 --2- 172.21.15.38:0/3252886188 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc0100750 0x7f9fc01047a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.513+0000 7f9fc7def640 1 --2- 172.21.15.38:0/3252886188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc00ffda0 0x7f9fc0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.513+0000 7f9fc7def640 1 -- 172.21.15.38:0/3252886188 >> 172.21.15.38:0/3252886188 conn(0x7f9fc00fb840 msgr2=0x7f9fc00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.513+0000 7f9fc7def640 1 -- 172.21.15.38:0/3252886188 shutdown_connections 2024-09-13T18:39:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.513+0000 7f9fc7def640 1 -- 172.21.15.38:0/3252886188 wait complete. 2024-09-13T18:39:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.513+0000 7f9fc7def640 1 Processor -- start 2024-09-13T18:39:36.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.513+0000 7f9fc7def640 1 -- start start 2024-09-13T18:39:36.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc7def640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc00ffda0 0x7f9fc00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc7def640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc0100750 0x7f9fc0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc7def640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0074780 con 0x7f9fc0100750 2024-09-13T18:39:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc7def640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0073230 con 0x7f9fc00ffda0 2024-09-13T18:39:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc538a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc0100750 0x7f9fc0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc538a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc0100750 0x7f9fc0072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41788/0 (socket says 172.21.15.38:41788) 2024-09-13T18:39:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc538a640 1 -- 172.21.15.38:0/172334620 learned_addr learned my addr 172.21.15.38:0/172334620 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:39:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc5b8b640 1 --2- 172.21.15.38:0/172334620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc00ffda0 0x7f9fc00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc538a640 1 -- 172.21.15.38:0/172334620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc00ffda0 msgr2=0x7f9fc00727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc538a640 1 --2- 172.21.15.38:0/172334620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc00ffda0 0x7f9fc00727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc538a640 1 -- 172.21.15.38:0/172334620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0009560 con 0x7f9fc0100750 2024-09-13T18:39:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc5b8b640 1 --2- 172.21.15.38:0/172334620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc00ffda0 0x7f9fc00727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fc538a640 1 --2- 172.21.15.38:0/172334620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc0100750 0x7f9fc0072cf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0006010 tx=0x7f9fb00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:36.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.514+0000 7f9fb6ffd640 1 -- 172.21.15.38:0/172334620 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fb0004ba0 con 0x7f9fc0100750 2024-09-13T18:39:36.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.515+0000 7f9fb6ffd640 1 -- 172.21.15.38:0/172334620 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9fb0004d00 con 0x7f9fc0100750 2024-09-13T18:39:36.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.515+0000 7f9fc7def640 1 -- 172.21.15.38:0/172334620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc00734b0 con 0x7f9fc0100750 2024-09-13T18:39:36.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.515+0000 7f9fb6ffd640 1 -- 172.21.15.38:0/172334620 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fb0031910 con 0x7f9fc0100750 2024-09-13T18:39:36.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.515+0000 7f9fc7def640 1 -- 172.21.15.38:0/172334620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc01a1dd0 con 0x7f9fc0100750 2024-09-13T18:39:36.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.516+0000 7f9fc7def640 1 -- 172.21.15.38:0/172334620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc0101280 con 0x7f9fc0100750 2024-09-13T18:39:36.520 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.516+0000 7f9fb6ffd640 1 -- 172.21.15.38:0/172334620 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9fb0031af0 con 0x7f9fc0100750 2024-09-13T18:39:36.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.516+0000 7f9fb6ffd640 1 --2- 172.21.15.38:0/172334620 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9fac06cc50 0x7f9fac06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.517+0000 7f9fb6ffd640 1 -- 172.21.15.38:0/172334620 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f9fb00ad770 con 0x7f9fc0100750 2024-09-13T18:39:36.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.517+0000 7f9fc5b8b640 1 --2- 172.21.15.38:0/172334620 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9fac06cc50 0x7f9fac06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.521 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.517+0000 7f9fc5b8b640 1 --2- 172.21.15.38:0/172334620 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9fac06cc50 0x7f9fac06f110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00abe0 tx=0x7f9fbc00a5c0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:36.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.521+0000 7f9fb6ffd640 1 -- 172.21.15.38:0/172334620 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9fb00777b0 con 0x7f9fc0100750 2024-09-13T18:39:36.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.759+0000 7f9fc7def640 1 -- 172.21.15.38:0/172334620 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9fc0100180 con 0x7f9fc0100750 2024-09-13T18:39:36.762 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.760+0000 7f9fb6ffd640 1 -- 172.21.15.38:0/172334620 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9fb007add0 con 0x7f9fc0100750 2024-09-13T18:39:36.763 INFO:teuthology.orchestra.run.smithi038.stdout:HEALTH_OK 2024-09-13T18:39:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.762+0000 7f9fc7def640 1 -- 172.21.15.38:0/172334620 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9fac06cc50 msgr2=0x7f9fac06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.762+0000 7f9fc7def640 1 --2- 172.21.15.38:0/172334620 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9fac06cc50 0x7f9fac06f110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00abe0 tx=0x7f9fbc00a5c0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.762+0000 7f9fc7def640 1 -- 172.21.15.38:0/172334620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc0100750 msgr2=0x7f9fc0072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.765 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.762+0000 7f9fc7def640 1 --2- 172.21.15.38:0/172334620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc0100750 0x7f9fc0072cf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0006010 tx=0x7f9fb00056e0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.762+0000 7f9fc7def640 1 -- 172.21.15.38:0/172334620 shutdown_connections 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.762+0000 7f9fc7def640 1 --2- 172.21.15.38:0/172334620 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9fc0100750 0x7f9fc0072cf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.762+0000 7f9fc7def640 1 --2- 172.21.15.38:0/172334620 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f9fac06cc50 0x7f9fac06f110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.762+0000 7f9fc7def640 1 --2- 172.21.15.38:0/172334620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fc00ffda0 0x7f9fc00727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.762+0000 7f9fc7def640 1 -- 172.21.15.38:0/172334620 >> 172.21.15.38:0/172334620 conn(0x7f9fc00fb840 msgr2=0x7f9fc00fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.762+0000 7f9fc7def640 1 -- 172.21.15.38:0/172334620 shutdown_connections 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:36.762+0000 7f9fc7def640 1 -- 172.21.15.38:0/172334620 wait complete. 2024-09-13T18:39:37.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:39:37.075 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:39:37.409 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph versions' 2024-09-13T18:39:37.625 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:39:37.769 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:37 smithi149 ceph-mon[76906]: pgmap v306: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:37.770 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:37 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/172334620' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:39:37.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:37 smithi038 ceph-mon[91522]: pgmap v306: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:37.978 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:37 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/172334620' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T18:39:39.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.233+0000 7efc2145c640 1 -- 172.21.15.38:0/1691685902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc1c073200 msgr2=0x7efc1c10be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:39.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.233+0000 7efc2145c640 1 --2- 172.21.15.38:0/1691685902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc1c073200 0x7efc1c10be40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efc10009880 tx=0x7efc1002a530 comp rx=0 tx=0).stop 2024-09-13T18:39:39.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.233+0000 7efc2145c640 1 -- 172.21.15.38:0/1691685902 shutdown_connections 2024-09-13T18:39:39.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.233+0000 7efc2145c640 1 --2- 172.21.15.38:0/1691685902 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc1c073200 0x7efc1c10be40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.233+0000 7efc2145c640 1 --2- 172.21.15.38:0/1691685902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc1c0728e0 0x7efc1c072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.233+0000 7efc2145c640 1 -- 172.21.15.38:0/1691685902 >> 172.21.15.38:0/1691685902 conn(0x7efc1c0fb880 msgr2=0x7efc1c0fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:39.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.233+0000 7efc2145c640 1 -- 172.21.15.38:0/1691685902 shutdown_connections 2024-09-13T18:39:39.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.233+0000 7efc2145c640 1 -- 172.21.15.38:0/1691685902 wait complete. 2024-09-13T18:39:39.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.233+0000 7efc2145c640 1 Processor -- start 2024-09-13T18:39:39.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.234+0000 7efc2145c640 1 -- start start 2024-09-13T18:39:39.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.234+0000 7efc2145c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc1c0728e0 0x7efc1c19d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:39.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.234+0000 7efc2145c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc1c073200 0x7efc1c19dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:39.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.234+0000 7efc2145c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c19e470 con 0x7efc1c0728e0 2024-09-13T18:39:39.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.234+0000 7efc2145c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c197a90 con 0x7efc1c073200 2024-09-13T18:39:39.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.234+0000 7efc1affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc1c0728e0 0x7efc1c19d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:39.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.234+0000 7efc1affd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc1c0728e0 0x7efc1c19d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41794/0 (socket says 172.21.15.38:41794) 2024-09-13T18:39:39.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.234+0000 7efc1affd640 1 -- 172.21.15.38:0/977171406 learned_addr learned my addr 172.21.15.38:0/977171406 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:39:39.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.234+0000 7efc1a7fc640 1 --2- 172.21.15.38:0/977171406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc1c073200 0x7efc1c19dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:39.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.234+0000 7efc1affd640 1 -- 172.21.15.38:0/977171406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc1c073200 msgr2=0x7efc1c19dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:39.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.234+0000 7efc1affd640 1 --2- 172.21.15.38:0/977171406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc1c073200 0x7efc1c19dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.234+0000 7efc1affd640 1 -- 172.21.15.38:0/977171406 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc10009560 con 0x7efc1c0728e0 2024-09-13T18:39:39.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.235+0000 7efc1affd640 1 --2- 172.21.15.38:0/977171406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc1c0728e0 0x7efc1c19d9a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00cc60 tx=0x7efc0c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:39.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.235+0000 7efc03fff640 1 -- 172.21.15.38:0/977171406 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc0c00f450 con 0x7efc1c0728e0 2024-09-13T18:39:39.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.235+0000 7efc03fff640 1 -- 172.21.15.38:0/977171406 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efc0c00fa50 con 0x7efc1c0728e0 2024-09-13T18:39:39.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.235+0000 7efc2145c640 1 -- 172.21.15.38:0/977171406 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c197d70 con 0x7efc1c0728e0 2024-09-13T18:39:39.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.235+0000 7efc03fff640 1 -- 172.21.15.38:0/977171406 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc0c018b80 con 0x7efc1c0728e0 2024-09-13T18:39:39.240 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.235+0000 7efc2145c640 1 -- 172.21.15.38:0/977171406 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c198290 con 0x7efc1c0728e0 2024-09-13T18:39:39.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.236+0000 7efc2145c640 1 -- 172.21.15.38:0/977171406 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c073f90 con 0x7efc1c0728e0 2024-09-13T18:39:39.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.236+0000 7efc03fff640 1 -- 172.21.15.38:0/977171406 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efc0c018ce0 con 0x7efc1c0728e0 2024-09-13T18:39:39.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.237+0000 7efc03fff640 1 --2- 172.21.15.38:0/977171406 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7efc0406cc60 0x7efc0406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:39.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.237+0000 7efc03fff640 1 -- 172.21.15.38:0/977171406 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7efc0c08ca60 con 0x7efc1c0728e0 2024-09-13T18:39:39.241 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.237+0000 7efc1a7fc640 1 --2- 172.21.15.38:0/977171406 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7efc0406cc60 0x7efc0406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:39.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.237+0000 7efc1a7fc640 1 --2- 172.21.15.38:0/977171406 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7efc0406cc60 0x7efc0406f120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efc10000c00 tx=0x7efc10005a20 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:39.243 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.241+0000 7efc03fff640 1 -- 172.21.15.38:0/977171406 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efc0c056aa0 con 0x7efc1c0728e0 2024-09-13T18:39:39.479 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.477+0000 7efc2145c640 1 -- 172.21.15.38:0/977171406 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efc1c106730 con 0x7efc1c0728e0 2024-09-13T18:39:39.480 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.478+0000 7efc03fff640 1 -- 172.21.15.38:0/977171406 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7efc0c05a0c0 con 0x7efc1c0728e0 2024-09-13T18:39:39.481 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:39:39.481 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:39:39.481 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:39:39.481 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:39:39.481 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:39:39.481 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:39:39.481 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:39:39.481 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:39:39.481 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T18:39:39.482 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:39:39.482 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:39:39.482 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 4 2024-09-13T18:39:39.482 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:39:39.482 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:39:39.482 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 14 2024-09-13T18:39:39.482 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:39:39.482 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:39:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.480+0000 7efc2145c640 1 -- 172.21.15.38:0/977171406 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7efc0406cc60 msgr2=0x7efc0406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.480+0000 7efc2145c640 1 --2- 172.21.15.38:0/977171406 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7efc0406cc60 0x7efc0406f120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efc10000c00 tx=0x7efc10005a20 comp rx=0 tx=0).stop 2024-09-13T18:39:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.480+0000 7efc2145c640 1 -- 172.21.15.38:0/977171406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc1c0728e0 msgr2=0x7efc1c19d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.480+0000 7efc2145c640 1 --2- 172.21.15.38:0/977171406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc1c0728e0 0x7efc1c19d9a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00cc60 tx=0x7efc0c00a620 comp rx=0 tx=0).stop 2024-09-13T18:39:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.480+0000 7efc2145c640 1 -- 172.21.15.38:0/977171406 shutdown_connections 2024-09-13T18:39:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.480+0000 7efc2145c640 1 --2- 172.21.15.38:0/977171406 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7efc0406cc60 0x7efc0406f120 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.480+0000 7efc2145c640 1 --2- 172.21.15.38:0/977171406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc1c073200 0x7efc1c19dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.480+0000 7efc2145c640 1 --2- 172.21.15.38:0/977171406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efc1c0728e0 0x7efc1c19d9a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.483 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.480+0000 7efc2145c640 1 -- 172.21.15.38:0/977171406 >> 172.21.15.38:0/977171406 conn(0x7efc1c0fb880 msgr2=0x7efc1c104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:39.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.480+0000 7efc2145c640 1 -- 172.21.15.38:0/977171406 shutdown_connections 2024-09-13T18:39:39.484 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:39:39.480+0000 7efc2145c640 1 -- 172.21.15.38:0/977171406 wait complete. 2024-09-13T18:39:40.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:39 smithi149 ceph-mon[76906]: pgmap v307: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:40.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:39 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/977171406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:40.058 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:39 smithi038 ceph-mon[91522]: pgmap v307: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:40.058 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:39 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/977171406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:39:40.083 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-13T18:39:40.297 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:39:41.867 INFO:teuthology.orchestra.run.smithi038.stdout:wait for servicemap items w/ changing names to refresh 2024-09-13T18:39:42.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:41 smithi149 ceph-mon[76906]: pgmap v308: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:39:42.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:41 smithi038 ceph-mon[91522]: pgmap v308: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:39:42.491 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'sleep 60' 2024-09-13T18:39:42.709 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:39:43.964 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:43 smithi038 ceph-mon[91522]: pgmap v309: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:44.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:43 smithi149 ceph-mon[76906]: pgmap v309: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:46.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:45 smithi149 ceph-mon[76906]: pgmap v310: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:46.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:45 smithi038 ceph-mon[91522]: pgmap v310: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:48.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:47 smithi149 ceph-mon[76906]: pgmap v311: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:48.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:47 smithi038 ceph-mon[91522]: pgmap v311: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:50.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:49 smithi149 ceph-mon[76906]: pgmap v312: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:50.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:49 smithi038 ceph-mon[91522]: pgmap v312: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:52.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:51 smithi149 ceph-mon[76906]: pgmap v313: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:39:52.020 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:39:52.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:51 smithi038 ceph-mon[91522]: pgmap v313: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:39:52.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:39:54.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:53 smithi149 ceph-mon[76906]: pgmap v314: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:54.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:53 smithi038 ceph-mon[91522]: pgmap v314: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:56.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:55 smithi038 ceph-mon[91522]: pgmap v315: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:56.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:55 smithi149 ceph-mon[76906]: pgmap v315: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:39:58.072 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:57 smithi149 ceph-mon[76906]: pgmap v316: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:39:58.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:57 smithi038 ceph-mon[91522]: pgmap v316: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:00.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:39:59 smithi038 ceph-mon[91522]: pgmap v317: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:00.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:39:59 smithi149 ceph-mon[76906]: pgmap v317: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:01.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:00 smithi038 ceph-mon[91522]: overall HEALTH_OK 2024-09-13T18:40:01.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:00 smithi149 ceph-mon[76906]: overall HEALTH_OK 2024-09-13T18:40:02.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:01 smithi038 ceph-mon[91522]: pgmap v318: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:40:02.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:01 smithi149 ceph-mon[76906]: pgmap v318: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:40:04.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:03 smithi038 ceph-mon[91522]: pgmap v319: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:04.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:03 smithi149 ceph-mon[76906]: pgmap v319: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:06.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:05 smithi038 ceph-mon[91522]: pgmap v320: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:06.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:05 smithi149 ceph-mon[76906]: pgmap v320: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:07.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:40:07.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:40:07.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:40:07.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:40:07.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:06 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:40:07.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:40:07.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:40:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:40:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:40:07.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:06 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:40:08.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:07 smithi038 ceph-mon[91522]: pgmap v321: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:08.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:07 smithi149 ceph-mon[76906]: pgmap v321: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:10.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:09 smithi038 ceph-mon[91522]: pgmap v322: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:10.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:09 smithi149 ceph-mon[76906]: pgmap v322: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:12.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:11 smithi038 ceph-mon[91522]: pgmap v323: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:40:12.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:11 smithi149 ceph-mon[76906]: pgmap v323: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:40:14.085 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:13 smithi038 ceph-mon[91522]: pgmap v324: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:14.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:13 smithi149 ceph-mon[76906]: pgmap v324: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:16.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:15 smithi149 ceph-mon[76906]: pgmap v325: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:16.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:15 smithi038 ceph-mon[91522]: pgmap v325: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:18.195 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:17 smithi149 ceph-mon[76906]: pgmap v326: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:18.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:17 smithi038 ceph-mon[91522]: pgmap v326: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:20.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:19 smithi149 ceph-mon[76906]: pgmap v327: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:20.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:19 smithi038 ceph-mon[91522]: pgmap v327: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:22.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:21 smithi149 ceph-mon[76906]: pgmap v328: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:40:22.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:21 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:40:22.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:21 smithi038 ceph-mon[91522]: pgmap v328: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:40:22.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:21 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:40:24.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:23 smithi149 ceph-mon[76906]: pgmap v329: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:24.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:23 smithi038 ceph-mon[91522]: pgmap v329: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:26.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:25 smithi149 ceph-mon[76906]: pgmap v330: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:26.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:25 smithi038 ceph-mon[91522]: pgmap v330: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:28.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:27 smithi149 ceph-mon[76906]: pgmap v331: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:28.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:27 smithi038 ceph-mon[91522]: pgmap v331: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:30.273 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:29 smithi149 ceph-mon[76906]: pgmap v332: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:30.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:29 smithi038 ceph-mon[91522]: pgmap v332: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:32.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:31 smithi149 ceph-mon[76906]: pgmap v333: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:40:32.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:31 smithi038 ceph-mon[91522]: pgmap v333: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:40:34.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:33 smithi149 ceph-mon[76906]: pgmap v334: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:34.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:33 smithi038 ceph-mon[91522]: pgmap v334: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:36.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:35 smithi149 ceph-mon[76906]: pgmap v335: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:36.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:35 smithi038 ceph-mon[91522]: pgmap v335: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:37.233 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:36 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:40:37.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:36 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:40:38.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:37 smithi149 ceph-mon[76906]: pgmap v336: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:38.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:37 smithi038 ceph-mon[91522]: pgmap v336: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:40.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:39 smithi149 ceph-mon[76906]: pgmap v337: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:40.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:39 smithi038 ceph-mon[91522]: pgmap v337: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:42.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:41 smithi149 ceph-mon[76906]: pgmap v338: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:40:42.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:41 smithi038 ceph-mon[91522]: pgmap v338: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:40:44.215 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:43 smithi038 ceph-mon[91522]: pgmap v339: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:44.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:43 smithi149 ceph-mon[76906]: pgmap v339: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:44.985 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph orch ps' 2024-09-13T18:40:45.201 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:40:46.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:45 smithi149 ceph-mon[76906]: pgmap v340: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:46.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:45 smithi038 ceph-mon[91522]: pgmap v340: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:46.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.968+0000 7f83a5e59640 1 -- 172.21.15.38:0/3207721093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a00ffda0 msgr2=0x7f83a0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.968+0000 7f83a5e59640 1 --2- 172.21.15.38:0/3207721093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a00ffda0 0x7f83a0100180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8390009880 tx=0x7f839002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.986 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.968+0000 7f83a5e59640 1 -- 172.21.15.38:0/3207721093 shutdown_connections 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.968+0000 7f83a5e59640 1 --2- 172.21.15.38:0/3207721093 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a0100750 0x7f83a01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.968+0000 7f83a5e59640 1 --2- 172.21.15.38:0/3207721093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a00ffda0 0x7f83a0100180 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.968+0000 7f83a5e59640 1 -- 172.21.15.38:0/3207721093 >> 172.21.15.38:0/3207721093 conn(0x7f83a00fb840 msgr2=0x7f83a00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.968+0000 7f83a5e59640 1 -- 172.21.15.38:0/3207721093 shutdown_connections 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.968+0000 7f83a5e59640 1 -- 172.21.15.38:0/3207721093 wait complete. 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.969+0000 7f83a5e59640 1 Processor -- start 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.969+0000 7f83a5e59640 1 -- start start 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.969+0000 7f83a5e59640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a00ffda0 0x7f83a0197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.969+0000 7f83a5e59640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a0100750 0x7f83a0198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.969+0000 7f83a5e59640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a0198920 con 0x7f83a0100750 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.969+0000 7f83a5e59640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a019c690 con 0x7f83a00ffda0 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.969+0000 7f839effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a0100750 0x7f83a0198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.969+0000 7f839effd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a0100750 0x7f83a0198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44414/0 (socket says 172.21.15.38:44414) 2024-09-13T18:40:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.969+0000 7f839effd640 1 -- 172.21.15.38:0/1953674376 learned_addr learned my addr 172.21.15.38:0/1953674376 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:40:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.969+0000 7f839f7fe640 1 --2- 172.21.15.38:0/1953674376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a00ffda0 0x7f83a0197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.970+0000 7f839effd640 1 -- 172.21.15.38:0/1953674376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a00ffda0 msgr2=0x7f83a0197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.970+0000 7f839effd640 1 --2- 172.21.15.38:0/1953674376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a00ffda0 0x7f83a0197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.970+0000 7f839effd640 1 -- 172.21.15.38:0/1953674376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390009560 con 0x7f83a0100750 2024-09-13T18:40:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.970+0000 7f839effd640 1 --2- 172.21.15.38:0/1953674376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a0100750 0x7f83a0198290 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f839400b420 tx=0x7f839400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.970+0000 7f839cff9640 1 -- 172.21.15.38:0/1953674376 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8394011800 con 0x7f83a0100750 2024-09-13T18:40:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.970+0000 7f839cff9640 1 -- 172.21.15.38:0/1953674376 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8394011e00 con 0x7f83a0100750 2024-09-13T18:40:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.970+0000 7f83a5e59640 1 -- 172.21.15.38:0/1953674376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a019c970 con 0x7f83a0100750 2024-09-13T18:40:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.970+0000 7f839cff9640 1 -- 172.21.15.38:0/1953674376 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f839400f2e0 con 0x7f83a0100750 2024-09-13T18:40:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.970+0000 7f83a5e59640 1 -- 172.21.15.38:0/1953674376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a019cec0 con 0x7f83a0100750 2024-09-13T18:40:46.988 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.971+0000 7f83a5e59640 1 -- 172.21.15.38:0/1953674376 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a0101280 con 0x7f83a0100750 2024-09-13T18:40:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.972+0000 7f839cff9640 1 -- 172.21.15.38:0/1953674376 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8394010380 con 0x7f83a0100750 2024-09-13T18:40:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.972+0000 7f839cff9640 1 --2- 172.21.15.38:0/1953674376 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f838806cc50 0x7f838806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.972+0000 7f839cff9640 1 -- 172.21.15.38:0/1953674376 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f839408bf30 con 0x7f83a0100750 2024-09-13T18:40:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.972+0000 7f839f7fe640 1 --2- 172.21.15.38:0/1953674376 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f838806cc50 0x7f838806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.973+0000 7f839f7fe640 1 --2- 172.21.15.38:0/1953674376 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f838806cc50 0x7f838806f110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8390005ab0 tx=0x7f8390005a20 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:46.989 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:46.977+0000 7f839cff9640 1 -- 172.21.15.38:0/1953674376 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f83940bfe20 con 0x7f83a0100750 2024-09-13T18:40:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.157+0000 7f83a5e59640 1 -- 172.21.15.38:0/1953674376 --> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f83a0074080 con 0x7f838806cc50 2024-09-13T18:40:47.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.166+0000 7f839cff9640 1 -- 172.21.15.38:0/1953674376 <== mgr.14726 v2:172.21.15.38:6800/2361475536 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f83a0074080 con 0x7f838806cc50 2024-09-13T18:40:47.169 INFO:teuthology.orchestra.run.smithi038.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:40:47.169 INFO:teuthology.orchestra.run.smithi038.stdout:alertmanager.smithi038 smithi038 *:9093,9094 running (2m) 105s ago 18m 16.6M - 0.25.0 c8568f914cd2 5df1cbc96260 2024-09-13T18:40:47.169 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi038 smithi038 running (3m) 105s ago 18m 7616k - 18.2.4-860-g6c6b083f 8a91f241d7d4 ee2ab4027fb4 2024-09-13T18:40:47.169 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-exporter.smithi149 smithi149 running (2m) 2m ago 17m 7499k - 18.2.4-860-g6c6b083f 8a91f241d7d4 74bef92b9a16 2024-09-13T18:40:47.169 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi038 smithi038 running (8m) 105s ago 18m 6891k - 18.2.4-860-g6c6b083f 8a91f241d7d4 21e887520e27 2024-09-13T18:40:47.169 INFO:teuthology.orchestra.run.smithi038.stdout:crash.smithi149 smithi149 running (7m) 2m ago 17m 6899k - 18.2.4-860-g6c6b083f 8a91f241d7d4 83794b02fe76 2024-09-13T18:40:47.169 INFO:teuthology.orchestra.run.smithi038.stdout:grafana.smithi038 smithi038 *:3000 running (110s) 105s ago 18m 39.9M - 9.4.7 954c08fa6188 424d0065da48 2024-09-13T18:40:47.169 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.dtnkqo smithi038 running (3m) 105s ago 12m 19.8M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1ed3b623871d 2024-09-13T18:40:47.169 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi038.ubvgaq smithi038 running (4m) 105s ago 12m 83.5M - 18.2.4-860-g6c6b083f 8a91f241d7d4 710abbbd3193 2024-09-13T18:40:47.169 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.doanhj smithi149 running (3m) 2m ago 12m 84.9M - 18.2.4-860-g6c6b083f 8a91f241d7d4 df31d6b56cc0 2024-09-13T18:40:47.169 INFO:teuthology.orchestra.run.smithi038.stdout:mds.cephfs.smithi149.zdzwzb smithi149 running (3m) 2m ago 12m 16.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 8f450c446d4a 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi038.jeygoq smithi038 *:8443,9283,8765 running (9m) 105s ago 19m 503M - 18.2.4-860-g6c6b083f 8a91f241d7d4 7a67f1e3187f 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:mgr.smithi149.eabzne smithi149 *:8443,9283,8765 running (8m) 2m ago 17m 441M - 18.2.4-860-g6c6b083f 8a91f241d7d4 1302a471d6f8 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi038 smithi038 running (8m) 105s ago 20m 58.1M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 e7c5577a18c9 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:mon.smithi149 smithi149 running (8m) 2m ago 17m 39.0M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 66ddd3b39141 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi038 smithi038 *:9100 running (2m) 105s ago 18m 8480k - 1.5.0 0da6a335fe13 4d79b13b34ff 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:node-exporter.smithi149 smithi149 *:9100 running (2m) 2m ago 17m 3363k - 1.5.0 0da6a335fe13 a970c2754c12 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 smithi038 running (7m) 105s ago 16m 135M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 741f349e9433 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 smithi038 running (7m) 105s ago 16m 110M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 b2f99a2919b9 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 smithi038 running (6m) 105s ago 15m 105M 1217M 18.2.4-860-g6c6b083f 8a91f241d7d4 090af670cd3d 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:osd.3 smithi149 running (5m) 2m ago 15m 121M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 e4321b085347 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:osd.4 smithi149 running (5m) 2m ago 14m 102M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 c6ec97a4d9ff 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:osd.5 smithi149 running (4m) 2m ago 14m 98.2M 4096M 18.2.4-860-g6c6b083f 8a91f241d7d4 6faab71ae8a9 2024-09-13T18:40:47.170 INFO:teuthology.orchestra.run.smithi038.stdout:prometheus.smithi038 smithi038 *:9095 running (2m) 105s ago 17m 49.6M - 2.43.0 a07b618ecd1d b0fec85ac4ae 2024-09-13T18:40:47.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.168+0000 7f83a5e59640 1 -- 172.21.15.38:0/1953674376 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f838806cc50 msgr2=0x7f838806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.168+0000 7f83a5e59640 1 --2- 172.21.15.38:0/1953674376 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f838806cc50 0x7f838806f110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8390005ab0 tx=0x7f8390005a20 comp rx=0 tx=0).stop 2024-09-13T18:40:47.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.168+0000 7f83a5e59640 1 -- 172.21.15.38:0/1953674376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a0100750 msgr2=0x7f83a0198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.168+0000 7f83a5e59640 1 --2- 172.21.15.38:0/1953674376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a0100750 0x7f83a0198290 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f839400b420 tx=0x7f839400b8e0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.168+0000 7f83a5e59640 1 -- 172.21.15.38:0/1953674376 shutdown_connections 2024-09-13T18:40:47.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.168+0000 7f83a5e59640 1 --2- 172.21.15.38:0/1953674376 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f83a0100750 0x7f83a0198290 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.168+0000 7f83a5e59640 1 --2- 172.21.15.38:0/1953674376 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f838806cc50 0x7f838806f110 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.168+0000 7f83a5e59640 1 --2- 172.21.15.38:0/1953674376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a00ffda0 0x7f83a0197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.169+0000 7f83a5e59640 1 -- 172.21.15.38:0/1953674376 >> 172.21.15.38:0/1953674376 conn(0x7f83a00fb840 msgr2=0x7f83a00fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:47.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.169+0000 7f83a5e59640 1 -- 172.21.15.38:0/1953674376 shutdown_connections 2024-09-13T18:40:47.172 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:47.169+0000 7f83a5e59640 1 -- 172.21.15.38:0/1953674376 wait complete. 2024-09-13T18:40:47.986 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph versions' 2024-09-13T18:40:48.200 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:40:48.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:47 smithi149 ceph-mon[76906]: pgmap v341: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:48.321 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:47 smithi038 ceph-mon[91522]: pgmap v341: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:49.019 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:48 smithi149 ceph-mon[76906]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:40:49.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:48 smithi038 ceph-mon[91522]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:40:50.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:49 smithi038 ceph-mon[91522]: pgmap v342: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:50.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.132+0000 7fb563356640 1 -- 172.21.15.38:0/1307813274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb55c0ff3c0 msgr2=0x7fb55c103890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:50.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.132+0000 7fb563356640 1 --2- 172.21.15.38:0/1307813274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb55c0ff3c0 0x7fb55c103890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb550009880 tx=0x7fb55002a530 comp rx=0 tx=0).stop 2024-09-13T18:40:50.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.132+0000 7fb563356640 1 -- 172.21.15.38:0/1307813274 shutdown_connections 2024-09-13T18:40:50.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.132+0000 7fb563356640 1 --2- 172.21.15.38:0/1307813274 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb55c0ff3c0 0x7fb55c103890 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.132+0000 7fb563356640 1 --2- 172.21.15.38:0/1307813274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb55c0feaa0 0x7fb55c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.144 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.132+0000 7fb563356640 1 -- 172.21.15.38:0/1307813274 >> 172.21.15.38:0/1307813274 conn(0x7fb55c0758a0 msgr2=0x7fb55c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.132+0000 7fb563356640 1 -- 172.21.15.38:0/1307813274 shutdown_connections 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.132+0000 7fb563356640 1 -- 172.21.15.38:0/1307813274 wait complete. 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb563356640 1 Processor -- start 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb563356640 1 -- start start 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb563356640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb55c0feaa0 0x7fb55c19c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb563356640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb55c0ff3c0 0x7fb55c19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb563356640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c19cce0 con 0x7fb55c0feaa0 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb563356640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c1a0a50 con 0x7fb55c0ff3c0 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb5610f2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb55c0feaa0 0x7fb55c19c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb5610f2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb55c0feaa0 0x7fb55c19c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44426/0 (socket says 172.21.15.38:44426) 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb5610f2640 1 -- 172.21.15.38:0/1585013324 learned_addr learned my addr 172.21.15.38:0/1585013324 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb5608f1640 1 --2- 172.21.15.38:0/1585013324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb55c0ff3c0 0x7fb55c19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb5610f2640 1 -- 172.21.15.38:0/1585013324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb55c0ff3c0 msgr2=0x7fb55c19c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:50.145 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb5610f2640 1 --2- 172.21.15.38:0/1585013324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb55c0ff3c0 0x7fb55c19c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb5610f2640 1 -- 172.21.15.38:0/1585013324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550009560 con 0x7fb55c0feaa0 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.133+0000 7fb5610f2640 1 --2- 172.21.15.38:0/1585013324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb55c0feaa0 0x7fb55c19c110 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb55400b420 tx=0x7fb55400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.134+0000 7fb55a7fc640 1 -- 172.21.15.38:0/1585013324 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb554011800 con 0x7fb55c0feaa0 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.134+0000 7fb55a7fc640 1 -- 172.21.15.38:0/1585013324 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb554011e00 con 0x7fb55c0feaa0 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.134+0000 7fb563356640 1 -- 172.21.15.38:0/1585013324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c1a0d30 con 0x7fb55c0feaa0 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.134+0000 7fb55a7fc640 1 -- 172.21.15.38:0/1585013324 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb55400f2e0 con 0x7fb55c0feaa0 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.134+0000 7fb563356640 1 -- 172.21.15.38:0/1585013324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c1a1280 con 0x7fb55c0feaa0 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.135+0000 7fb563356640 1 -- 172.21.15.38:0/1585013324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c068510 con 0x7fb55c0feaa0 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.135+0000 7fb55a7fc640 1 -- 172.21.15.38:0/1585013324 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb554010380 con 0x7fb55c0feaa0 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.136+0000 7fb55a7fc640 1 --2- 172.21.15.38:0/1585013324 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb54406cc50 0x7fb54406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.136+0000 7fb5608f1640 1 --2- 172.21.15.38:0/1585013324 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb54406cc50 0x7fb54406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.136+0000 7fb55a7fc640 1 -- 172.21.15.38:0/1585013324 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fb55408c010 con 0x7fb55c0feaa0 2024-09-13T18:40:50.146 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.136+0000 7fb5608f1640 1 --2- 172.21.15.38:0/1585013324 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb54406cc50 0x7fb54406f110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb55c19d6c0 tx=0x7fb550005a20 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:50.147 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.140+0000 7fb55a7fc640 1 -- 172.21.15.38:0/1585013324 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb554055fd0 con 0x7fb55c0feaa0 2024-09-13T18:40:50.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:49 smithi149 ceph-mon[76906]: pgmap v342: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.382+0000 7fb563356640 1 -- 172.21.15.38:0/1585013324 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb55c0fef00 con 0x7fb55c0feaa0 2024-09-13T18:40:50.385 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.383+0000 7fb55a7fc640 1 -- 172.21.15.38:0/1585013324 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fb5540595f0 con 0x7fb55c0feaa0 2024-09-13T18:40:50.386 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-09-13T18:40:50.386 INFO:teuthology.orchestra.run.smithi038.stdout: "mon": { 2024-09-13T18:40:50.386 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:40:50.386 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:40:50.386 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": { 2024-09-13T18:40:50.386 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 2 2024-09-13T18:40:50.386 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:40:50.386 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": { 2024-09-13T18:40:50.386 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 6 2024-09-13T18:40:50.386 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:40:50.387 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2024-09-13T18:40:50.387 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 4 2024-09-13T18:40:50.387 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-09-13T18:40:50.387 INFO:teuthology.orchestra.run.smithi038.stdout: "overall": { 2024-09-13T18:40:50.387 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)": 14 2024-09-13T18:40:50.387 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-09-13T18:40:50.387 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-09-13T18:40:50.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.385+0000 7fb563356640 1 -- 172.21.15.38:0/1585013324 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb54406cc50 msgr2=0x7fb54406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:50.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.385+0000 7fb563356640 1 --2- 172.21.15.38:0/1585013324 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb54406cc50 0x7fb54406f110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb55c19d6c0 tx=0x7fb550005a20 comp rx=0 tx=0).stop 2024-09-13T18:40:50.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.385+0000 7fb563356640 1 -- 172.21.15.38:0/1585013324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb55c0feaa0 msgr2=0x7fb55c19c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:50.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.385+0000 7fb563356640 1 --2- 172.21.15.38:0/1585013324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb55c0feaa0 0x7fb55c19c110 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb55400b420 tx=0x7fb55400b8e0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.388 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.385+0000 7fb563356640 1 -- 172.21.15.38:0/1585013324 shutdown_connections 2024-09-13T18:40:50.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.385+0000 7fb563356640 1 --2- 172.21.15.38:0/1585013324 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb54406cc50 0x7fb54406f110 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.385+0000 7fb563356640 1 --2- 172.21.15.38:0/1585013324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb55c0ff3c0 0x7fb55c19c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.385+0000 7fb563356640 1 --2- 172.21.15.38:0/1585013324 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb55c0feaa0 0x7fb55c19c110 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.385+0000 7fb563356640 1 -- 172.21.15.38:0/1585013324 >> 172.21.15.38:0/1585013324 conn(0x7fb55c0758a0 msgr2=0x7fb55c10d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:50.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.385+0000 7fb563356640 1 -- 172.21.15.38:0/1585013324 shutdown_connections 2024-09-13T18:40:50.389 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:50.385+0000 7fb563356640 1 -- 172.21.15.38:0/1585013324 wait complete. 2024-09-13T18:40:51.031 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-13T18:40:51.241 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:40:51.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:50 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1585013324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:40:51.331 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:50 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1585013324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:40:52.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:51 smithi149 ceph-mon[76906]: pgmap v343: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:40:52.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:51 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:40:52.322 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:51 smithi038 ceph-mon[91522]: pgmap v343: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:40:52.323 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:51 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:40:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.814+0000 7faeb6bea640 1 -- 172.21.15.38:0/550012027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faeb0100c50 msgr2=0x7faeb0101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.814+0000 7faeb6bea640 1 --2- 172.21.15.38:0/550012027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faeb0100c50 0x7faeb0101030 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faea00098b0 tx=0x7faea002a4d0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.814+0000 7faeb6bea640 1 -- 172.21.15.38:0/550012027 shutdown_connections 2024-09-13T18:40:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.814+0000 7faeb6bea640 1 --2- 172.21.15.38:0/550012027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb0101600 0x7faeb0109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.814+0000 7faeb6bea640 1 --2- 172.21.15.38:0/550012027 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faeb0100c50 0x7faeb0101030 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.814+0000 7faeb6bea640 1 -- 172.21.15.38:0/550012027 >> 172.21.15.38:0/550012027 conn(0x7faeb00fa700 msgr2=0x7faeb00fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:52.834 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.814+0000 7faeb6bea640 1 -- 172.21.15.38:0/550012027 shutdown_connections 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.814+0000 7faeb6bea640 1 -- 172.21.15.38:0/550012027 wait complete. 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.815+0000 7faeb6bea640 1 Processor -- start 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.815+0000 7faeb6bea640 1 -- start start 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.815+0000 7faeb6bea640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb0100c50 0x7faeb019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.815+0000 7faeb6bea640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faeb0101600 0x7faeb019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.815+0000 7faeb6bea640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb019c470 con 0x7faeb0101600 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.815+0000 7faeb6bea640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb0195a00 con 0x7faeb0100c50 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.815+0000 7faeaffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faeb0101600 0x7faeb019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.815+0000 7faeaffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faeb0101600 0x7faeb019be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49584/0 (socket says 172.21.15.38:49584) 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.815+0000 7faeaffff640 1 -- 172.21.15.38:0/3952626311 learned_addr learned my addr 172.21.15.38:0/3952626311 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.815+0000 7faeb4986640 1 --2- 172.21.15.38:0/3952626311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb0100c50 0x7faeb019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.815+0000 7faeaffff640 1 -- 172.21.15.38:0/3952626311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb0100c50 msgr2=0x7faeb019b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.815+0000 7faeaffff640 1 --2- 172.21.15.38:0/3952626311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb0100c50 0x7faeb019b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.816+0000 7faeaffff640 1 -- 172.21.15.38:0/3952626311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea0009560 con 0x7faeb0101600 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.816+0000 7faeaffff640 1 --2- 172.21.15.38:0/3952626311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faeb0101600 0x7faeb019be50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faea400b420 tx=0x7faea400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.816+0000 7faeadffb640 1 -- 172.21.15.38:0/3952626311 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea4011800 con 0x7faeb0101600 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.816+0000 7faeadffb640 1 -- 172.21.15.38:0/3952626311 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faea4011e00 con 0x7faeb0101600 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.816+0000 7faeb6bea640 1 -- 172.21.15.38:0/3952626311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb0195ce0 con 0x7faeb0101600 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.816+0000 7faeadffb640 1 -- 172.21.15.38:0/3952626311 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea400f2e0 con 0x7faeb0101600 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.816+0000 7faeb6bea640 1 -- 172.21.15.38:0/3952626311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb0196230 con 0x7faeb0101600 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.817+0000 7faeb6bea640 1 -- 172.21.15.38:0/3952626311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb0068d30 con 0x7faeb0101600 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.818+0000 7faeadffb640 1 -- 172.21.15.38:0/3952626311 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faea4010380 con 0x7faeb0101600 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.818+0000 7faeadffb640 1 --2- 172.21.15.38:0/3952626311 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fae9806cc60 0x7fae9806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.818+0000 7faeadffb640 1 -- 172.21.15.38:0/3952626311 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7faea408bf30 con 0x7faeb0101600 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.818+0000 7faeb4986640 1 --2- 172.21.15.38:0/3952626311 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fae9806cc60 0x7fae9806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.819+0000 7faeb4986640 1 --2- 172.21.15.38:0/3952626311 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fae9806cc60 0x7fae9806f120 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faea0006010 tx=0x7faea0000bc0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:52.837 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:52.823+0000 7faeadffb640 1 -- 172.21.15.38:0/3952626311 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faea40bfe20 con 0x7faeb0101600 2024-09-13T18:40:53.063 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.061+0000 7faeb6bea640 1 -- 172.21.15.38:0/3952626311 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faeb01010b0 con 0x7faeb0101600 2024-09-13T18:40:53.064 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.061+0000 7faeadffb640 1 -- 172.21.15.38:0/3952626311 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7faea4055f70 con 0x7faeb0101600 2024-09-13T18:40:53.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.063+0000 7faeb6bea640 1 -- 172.21.15.38:0/3952626311 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fae9806cc60 msgr2=0x7fae9806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:53.066 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.063+0000 7faeb6bea640 1 --2- 172.21.15.38:0/3952626311 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fae9806cc60 0x7fae9806f120 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faea0006010 tx=0x7faea0000bc0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.063+0000 7faeb6bea640 1 -- 172.21.15.38:0/3952626311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faeb0101600 msgr2=0x7faeb019be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:53.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.063+0000 7faeb6bea640 1 --2- 172.21.15.38:0/3952626311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faeb0101600 0x7faeb019be50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faea400b420 tx=0x7faea400b8e0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.063+0000 7faeb6bea640 1 -- 172.21.15.38:0/3952626311 shutdown_connections 2024-09-13T18:40:53.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.063+0000 7faeb6bea640 1 --2- 172.21.15.38:0/3952626311 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7faeb0101600 0x7faeb019be50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.063+0000 7faeb6bea640 1 --2- 172.21.15.38:0/3952626311 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fae9806cc60 0x7fae9806f120 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.063+0000 7faeb6bea640 1 --2- 172.21.15.38:0/3952626311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb0100c50 0x7faeb019b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.063+0000 7faeb6bea640 1 -- 172.21.15.38:0/3952626311 >> 172.21.15.38:0/3952626311 conn(0x7faeb00fa700 msgr2=0x7faeb0101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:53.067 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.063+0000 7faeb6bea640 1 -- 172.21.15.38:0/3952626311 shutdown_connections 2024-09-13T18:40:53.068 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:53.063+0000 7faeb6bea640 1 -- 172.21.15.38:0/3952626311 wait complete. 2024-09-13T18:40:53.075 INFO:teuthology.orchestra.run.smithi038.stdout:true 2024-09-13T18:40:53.627 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -e sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-13T18:40:53.836 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:40:54.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:53 smithi149 ceph-mon[76906]: pgmap v344: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:54.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:53 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3952626311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:40:54.283 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:53 smithi038 ceph-mon[91522]: pgmap v344: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:54.283 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:53 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3952626311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:40:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.676+0000 7f665b317640 1 -- 172.21.15.38:0/251910059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6654101600 msgr2=0x7f6654109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.676+0000 7f665b317640 1 --2- 172.21.15.38:0/251910059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6654101600 0x7f6654109af0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f66440098b0 tx=0x7f664402a4d0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.676+0000 7f665b317640 1 -- 172.21.15.38:0/251910059 shutdown_connections 2024-09-13T18:40:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.676+0000 7f665b317640 1 --2- 172.21.15.38:0/251910059 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6654101600 0x7f6654109af0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.676+0000 7f665b317640 1 --2- 172.21.15.38:0/251910059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6654100c50 0x7f6654101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.676+0000 7f665b317640 1 -- 172.21.15.38:0/251910059 >> 172.21.15.38:0/251910059 conn(0x7f66540fa700 msgr2=0x7f66540fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:55.683 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.676+0000 7f665b317640 1 -- 172.21.15.38:0/251910059 shutdown_connections 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.676+0000 7f665b317640 1 -- 172.21.15.38:0/251910059 wait complete. 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f665b317640 1 Processor -- start 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f665b317640 1 -- start start 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f665b317640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6654100c50 0x7f665419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f665b317640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6654101600 0x7f665419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f665b317640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665419c370 con 0x7f6654101600 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f665b317640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6654195900 con 0x7f6654100c50 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f66588b2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6654101600 0x7f665419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f66588b2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6654101600 0x7f665419bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49606/0 (socket says 172.21.15.38:49606) 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f66588b2640 1 -- 172.21.15.38:0/3830368206 learned_addr learned my addr 172.21.15.38:0/3830368206 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f66590b3640 1 --2- 172.21.15.38:0/3830368206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6654100c50 0x7f665419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f66588b2640 1 -- 172.21.15.38:0/3830368206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6654100c50 msgr2=0x7f665419b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f66588b2640 1 --2- 172.21.15.38:0/3830368206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6654100c50 0x7f665419b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.677+0000 7f66588b2640 1 -- 172.21.15.38:0/3830368206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6644009560 con 0x7f6654101600 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.678+0000 7f66588b2640 1 --2- 172.21.15.38:0/3830368206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6654101600 0x7f665419bd50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6644009230 tx=0x7f66440055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.678+0000 7f664a7fc640 1 -- 172.21.15.38:0/3830368206 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6644004aa0 con 0x7f6654101600 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.678+0000 7f664a7fc640 1 -- 172.21.15.38:0/3830368206 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6644004c00 con 0x7f6654101600 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.678+0000 7f665b317640 1 -- 172.21.15.38:0/3830368206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6654195b80 con 0x7f6654101600 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.678+0000 7f664a7fc640 1 -- 172.21.15.38:0/3830368206 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66440318f0 con 0x7f6654101600 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.678+0000 7f665b317640 1 -- 172.21.15.38:0/3830368206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6654196070 con 0x7f6654101600 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.679+0000 7f665b317640 1 -- 172.21.15.38:0/3830368206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6654068d30 con 0x7f6654101600 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.679+0000 7f664a7fc640 1 -- 172.21.15.38:0/3830368206 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6644003b90 con 0x7f6654101600 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.680+0000 7f664a7fc640 1 --2- 172.21.15.38:0/3830368206 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f664006cc60 0x7f664006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.680+0000 7f664a7fc640 1 -- 172.21.15.38:0/3830368206 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f66440ad640 con 0x7f6654101600 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.680+0000 7f66590b3640 1 --2- 172.21.15.38:0/3830368206 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f664006cc60 0x7f664006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:55.685 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.681+0000 7f66590b3640 1 --2- 172.21.15.38:0/3830368206 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f664006cc60 0x7f664006f120 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6650005fd0 tx=0x7f6650005850 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:55.687 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.685+0000 7f664a7fc640 1 -- 172.21.15.38:0/3830368206 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6644077680 con 0x7f6654101600 2024-09-13T18:40:55.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.928+0000 7f665b317640 1 -- 172.21.15.38:0/3830368206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6654101030 con 0x7f6654101600 2024-09-13T18:40:55.931 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.929+0000 7f664a7fc640 1 -- 172.21.15.38:0/3830368206 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f664407aca0 con 0x7f6654101600 2024-09-13T18:40:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.931+0000 7f665b317640 1 -- 172.21.15.38:0/3830368206 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f664006cc60 msgr2=0x7f664006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.931+0000 7f665b317640 1 --2- 172.21.15.38:0/3830368206 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f664006cc60 0x7f664006f120 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6650005fd0 tx=0x7f6650005850 comp rx=0 tx=0).stop 2024-09-13T18:40:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.931+0000 7f665b317640 1 -- 172.21.15.38:0/3830368206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6654101600 msgr2=0x7f665419bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.931+0000 7f665b317640 1 --2- 172.21.15.38:0/3830368206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6654101600 0x7f665419bd50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6644009230 tx=0x7f66440055a0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.932+0000 7f665b317640 1 -- 172.21.15.38:0/3830368206 shutdown_connections 2024-09-13T18:40:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.932+0000 7f665b317640 1 --2- 172.21.15.38:0/3830368206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6654101600 0x7f665419bd50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.934 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.932+0000 7f665b317640 1 --2- 172.21.15.38:0/3830368206 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f664006cc60 0x7f664006f120 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.932+0000 7f665b317640 1 --2- 172.21.15.38:0/3830368206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6654100c50 0x7f665419b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.932+0000 7f665b317640 1 -- 172.21.15.38:0/3830368206 >> 172.21.15.38:0/3830368206 conn(0x7f66540fa700 msgr2=0x7f6654101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:55.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.932+0000 7f665b317640 1 -- 172.21.15.38:0/3830368206 shutdown_connections 2024-09-13T18:40:55.935 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:55.932+0000 7f665b317640 1 -- 172.21.15.38:0/3830368206 wait complete. 2024-09-13T18:40:55.943 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)" 2024-09-13T18:40:56.245 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:55 smithi038 ceph-mon[91522]: pgmap v345: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:56.245 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:55 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3830368206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:40:56.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:55 smithi149 ceph-mon[76906]: pgmap v345: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:40:56.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:55 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3830368206' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T18:40:56.570 DEBUG:teuthology.parallel:result is None 2024-09-13T18:40:56.571 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T18:40:56.583 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:40:56.583 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T18:40:56.795 INFO:teuthology.orchestra.run.smithi038.stderr:Inferring config /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/mon.smithi038/config 2024-09-13T18:40:58.168 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:57 smithi038 ceph-mon[91522]: pgmap v346: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:58.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:57 smithi149 ceph-mon[76906]: pgmap v346: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:40:58.365 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.363+0000 7fe78988e640 1 -- 172.21.15.38:0/143800936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7841049f0 msgr2=0x7fe784104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.363+0000 7fe78988e640 1 --2- 172.21.15.38:0/143800936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7841049f0 0x7fe784104dd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe774009880 tx=0x7fe77402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.363+0000 7fe78988e640 1 -- 172.21.15.38:0/143800936 shutdown_connections 2024-09-13T18:40:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.363+0000 7fe78988e640 1 --2- 172.21.15.38:0/143800936 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7840fe9f0 0x7fe7840fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.363+0000 7fe78988e640 1 --2- 172.21.15.38:0/143800936 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7841049f0 0x7fe784104dd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.363+0000 7fe78988e640 1 -- 172.21.15.38:0/143800936 >> 172.21.15.38:0/143800936 conn(0x7fe7840758a0 msgr2=0x7fe7840fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.363+0000 7fe78988e640 1 -- 172.21.15.38:0/143800936 shutdown_connections 2024-09-13T18:40:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.363+0000 7fe78988e640 1 -- 172.21.15.38:0/143800936 wait complete. 2024-09-13T18:40:58.366 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.363+0000 7fe78988e640 1 Processor -- start 2024-09-13T18:40:58.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe78988e640 1 -- start start 2024-09-13T18:40:58.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe78988e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7840fe9f0 0x7fe784105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe78988e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7841049f0 0x7fe784105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe78988e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7841078f0 con 0x7fe7840fe9f0 2024-09-13T18:40:58.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe78988e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7841063a0 con 0x7fe7841049f0 2024-09-13T18:40:58.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe782ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7840fe9f0 0x7fe784105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe782ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7840fe9f0 0x7fe784105920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49630/0 (socket says 172.21.15.38:49630) 2024-09-13T18:40:58.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe782ffd640 1 -- 172.21.15.38:0/3865901670 learned_addr learned my addr 172.21.15.38:0/3865901670 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:40:58.368 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe7827fc640 1 --2- 172.21.15.38:0/3865901670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7841049f0 0x7fe784105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe782ffd640 1 -- 172.21.15.38:0/3865901670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7841049f0 msgr2=0x7fe784105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe782ffd640 1 --2- 172.21.15.38:0/3865901670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7841049f0 0x7fe784105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe782ffd640 1 -- 172.21.15.38:0/3865901670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe774009560 con 0x7fe7840fe9f0 2024-09-13T18:40:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.364+0000 7fe782ffd640 1 --2- 172.21.15.38:0/3865901670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7840fe9f0 0x7fe784105920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe774006010 tx=0x7fe7740056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.365+0000 7fe78888c640 1 -- 172.21.15.38:0/3865901670 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe774004ba0 con 0x7fe7840fe9f0 2024-09-13T18:40:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.365+0000 7fe78888c640 1 -- 172.21.15.38:0/3865901670 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe774004d00 con 0x7fe7840fe9f0 2024-09-13T18:40:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.365+0000 7fe78988e640 1 -- 172.21.15.38:0/3865901670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe784106620 con 0x7fe7840fe9f0 2024-09-13T18:40:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.365+0000 7fe78888c640 1 -- 172.21.15.38:0/3865901670 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe774031910 con 0x7fe7840fe9f0 2024-09-13T18:40:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.365+0000 7fe78988e640 1 -- 172.21.15.38:0/3865901670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7841a1dd0 con 0x7fe7840fe9f0 2024-09-13T18:40:58.369 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.366+0000 7fe78988e640 1 -- 172.21.15.38:0/3865901670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe784100130 con 0x7fe7840fe9f0 2024-09-13T18:40:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.366+0000 7fe78888c640 1 -- 172.21.15.38:0/3865901670 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe774031b80 con 0x7fe7840fe9f0 2024-09-13T18:40:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.366+0000 7fe78888c640 1 --2- 172.21.15.38:0/3865901670 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe76c06cc50 0x7fe76c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.367+0000 7fe78888c640 1 -- 172.21.15.38:0/3865901670 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fe7740ad840 con 0x7fe7840fe9f0 2024-09-13T18:40:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.367+0000 7fe7827fc640 1 --2- 172.21.15.38:0/3865901670 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe76c06cc50 0x7fe76c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.370 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.367+0000 7fe7827fc640 1 --2- 172.21.15.38:0/3865901670 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe76c06cc50 0x7fe76c06f110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe778005e10 tx=0x7fe778005da0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:58.373 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.371+0000 7fe78888c640 1 -- 172.21.15.38:0/3865901670 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe774077800 con 0x7fe7840fe9f0 2024-09-13T18:40:58.578 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.576+0000 7fe78988e640 1 -- 172.21.15.38:0/3865901670 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe7840fee50 con 0x7fe7840fe9f0 2024-09-13T18:40:58.579 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.577+0000 7fe78888c640 1 -- 172.21.15.38:0/3865901670 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1871 (secure 0 0 0) 0x7fe77407ae20 con 0x7fe7840fe9f0 2024-09-13T18:40:58.579 INFO:teuthology.orchestra.run.smithi038.stdout:e37 2024-09-13T18:40:58.579 INFO:teuthology.orchestra.run.smithi038.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:40:58.579 INFO:teuthology.orchestra.run.smithi038.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:legacy client fscid: 1 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:fs_name cephfs 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 37 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-09-13T18:27:43.711588+0000 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-09-13T18:37:41.633234+0000 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:tableserver 0 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:root 0 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:session_timeout 60 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:session_autoclose 300 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:max_file_size 1099511627776 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:max_xattr_size 65536 2024-09-13T18:40:58.580 INFO:teuthology.orchestra.run.smithi038.stdout:required_client_features {} 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure 0 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:last_failure_osd_epoch 95 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:max_mds 2 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:in 0,1 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:up {0=34352,1=34384} 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:failed 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:damaged 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:stopped 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:data_pools [3] 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:metadata_pool 2 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:inline_data disabled 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:balancer 2024-09-13T18:40:58.581 INFO:teuthology.orchestra.run.smithi038.stdout:bal_rank_mask -1 2024-09-13T18:40:58.582 INFO:teuthology.orchestra.run.smithi038.stdout:standby_count_wanted 1 2024-09-13T18:40:58.582 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.ubvgaq{0:34352} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.38:6826/3497551055,v1:172.21.15.38:6827/3497551055] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:40:58.582 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.doanhj{0:44325} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.149:6824/248866776,v1:172.21.15.149:6825/248866776] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:40:58.582 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi038.dtnkqo{1:34384} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.38:6828/3278914810,v1:172.21.15.38:6829/3278914810] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:40:58.582 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.cephfs.smithi149.zdzwzb{1:44353} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.149:6826/3248503653,v1:172.21.15.149:6827/3248503653] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:40:58.582 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:40:58.582 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:40:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 37 2024-09-13T18:40:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.579+0000 7fe78988e640 1 -- 172.21.15.38:0/3865901670 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe76c06cc50 msgr2=0x7fe76c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.579+0000 7fe78988e640 1 --2- 172.21.15.38:0/3865901670 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe76c06cc50 0x7fe76c06f110 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe778005e10 tx=0x7fe778005da0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.579+0000 7fe78988e640 1 -- 172.21.15.38:0/3865901670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7840fe9f0 msgr2=0x7fe784105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.579+0000 7fe78988e640 1 --2- 172.21.15.38:0/3865901670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7840fe9f0 0x7fe784105920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe774006010 tx=0x7fe7740056e0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.579+0000 7fe78988e640 1 -- 172.21.15.38:0/3865901670 shutdown_connections 2024-09-13T18:40:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.579+0000 7fe78988e640 1 --2- 172.21.15.38:0/3865901670 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe76c06cc50 0x7fe76c06f110 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.579+0000 7fe78988e640 1 --2- 172.21.15.38:0/3865901670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7841049f0 0x7fe784105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.579+0000 7fe78988e640 1 --2- 172.21.15.38:0/3865901670 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe7840fe9f0 0x7fe784105920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.579+0000 7fe78988e640 1 -- 172.21.15.38:0/3865901670 >> 172.21.15.38:0/3865901670 conn(0x7fe7840758a0 msgr2=0x7fe784067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.579+0000 7fe78988e640 1 -- 172.21.15.38:0/3865901670 shutdown_connections 2024-09-13T18:40:58.583 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:58.579+0000 7fe78988e640 1 -- 172.21.15.38:0/3865901670 wait complete. 2024-09-13T18:40:59.235 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:58 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3865901670' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:40:59.257 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-13T18:40:59.268 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:59.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:58 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3865901670' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:40:59.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.372+0000 7f92a2d95640 1 -- 172.21.15.38:0/1319068100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f929c100c70 msgr2=0x7f929c101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.372+0000 7f92a2d95640 1 --2- 172.21.15.38:0/1319068100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f929c100c70 0x7f929c101050 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f92900098b0 tx=0x7f929002a560 comp rx=0 tx=0).stop 2024-09-13T18:40:59.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.372+0000 7f92a2d95640 1 -- 172.21.15.38:0/1319068100 shutdown_connections 2024-09-13T18:40:59.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.372+0000 7f92a2d95640 1 --2- 172.21.15.38:0/1319068100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f929c101590 0x7f929c109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.372+0000 7f92a2d95640 1 --2- 172.21.15.38:0/1319068100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f929c100c70 0x7f929c101050 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.372+0000 7f92a2d95640 1 -- 172.21.15.38:0/1319068100 >> 172.21.15.38:0/1319068100 conn(0x7f929c0fa620 msgr2=0x7f929c0fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:59.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.372+0000 7f92a2d95640 1 -- 172.21.15.38:0/1319068100 shutdown_connections 2024-09-13T18:40:59.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.372+0000 7f92a2d95640 1 -- 172.21.15.38:0/1319068100 wait complete. 2024-09-13T18:40:59.377 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.373+0000 7f92a2d95640 1 Processor -- start 2024-09-13T18:40:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.373+0000 7f92a2d95640 1 -- start start 2024-09-13T18:40:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.373+0000 7f92a2d95640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f929c100c70 0x7f929c19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.373+0000 7f92a2d95640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f929c101590 0x7f929c19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.373+0000 7f92a2d95640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c19c280 con 0x7f929c100c70 2024-09-13T18:40:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.373+0000 7f92a2d95640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c1957d0 con 0x7f929c101590 2024-09-13T18:40:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.373+0000 7f92a0b31640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f929c100c70 0x7f929c19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.373+0000 7f92a0b31640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f929c100c70 0x7f929c19b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49650/0 (socket says 172.21.15.38:49650) 2024-09-13T18:40:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.373+0000 7f92a0b31640 1 -- 172.21.15.38:0/2451646988 learned_addr learned my addr 172.21.15.38:0/2451646988 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:40:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.374+0000 7f92a0b31640 1 -- 172.21.15.38:0/2451646988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f929c101590 msgr2=0x7f929c19bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.374+0000 7f92a0b31640 1 --2- 172.21.15.38:0/2451646988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f929c101590 0x7f929c19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.374+0000 7f92a0b31640 1 -- 172.21.15.38:0/2451646988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290009560 con 0x7f929c100c70 2024-09-13T18:40:59.378 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.374+0000 7f92a0b31640 1 --2- 172.21.15.38:0/2451646988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f929c100c70 0x7f929c19b6f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9290006010 tx=0x7f9290005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:59.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.374+0000 7f9299ffb640 1 -- 172.21.15.38:0/2451646988 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9290004ba0 con 0x7f929c100c70 2024-09-13T18:40:59.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.374+0000 7f9299ffb640 1 -- 172.21.15.38:0/2451646988 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9290004d00 con 0x7f929c100c70 2024-09-13T18:40:59.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.374+0000 7f92a2d95640 1 -- 172.21.15.38:0/2451646988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c195a20 con 0x7f929c100c70 2024-09-13T18:40:59.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.374+0000 7f9299ffb640 1 -- 172.21.15.38:0/2451646988 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f929003c900 con 0x7f929c100c70 2024-09-13T18:40:59.379 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.374+0000 7f92a2d95640 1 -- 172.21.15.38:0/2451646988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c195f20 con 0x7f929c100c70 2024-09-13T18:40:59.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.375+0000 7f92a2d95640 1 -- 172.21.15.38:0/2451646988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c068850 con 0x7f929c100c70 2024-09-13T18:40:59.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.376+0000 7f9299ffb640 1 -- 172.21.15.38:0/2451646988 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9290003c90 con 0x7f929c100c70 2024-09-13T18:40:59.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.376+0000 7f9299ffb640 1 --2- 172.21.15.38:0/2451646988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f928c06cc90 0x7f928c06f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.376+0000 7f9299ffb640 1 -- 172.21.15.38:0/2451646988 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f92900ad780 con 0x7f929c100c70 2024-09-13T18:40:59.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.376+0000 7f929bfff640 1 --2- 172.21.15.38:0/2451646988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f928c06cc90 0x7f928c06f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.380 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.377+0000 7f929bfff640 1 --2- 172.21.15.38:0/2451646988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f928c06cc90 0x7f928c06f150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f929c196c40 tx=0x7f9288005c70 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:59.383 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.380+0000 7f9299ffb640 1 -- 172.21.15.38:0/2451646988 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f92900777c0 con 0x7f929c100c70 2024-09-13T18:40:59.555 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.552+0000 7f92a2d95640 1 -- 172.21.15.38:0/2451646988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f929c101050 con 0x7f929c100c70 2024-09-13T18:40:59.556 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.554+0000 7f9299ffb640 1 -- 172.21.15.38:0/2451646988 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16598 (secure 0 0 0) 0x7f929007ade0 con 0x7f929c100c70 2024-09-13T18:40:59.556 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:40:59.557 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":97,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","created":"2024-09-13T18:20:45.975848+0000","modified":"2024-09-13T18:37:28.933737+0000","last_up_change":"2024-09-13T18:35:58.959011+0000","last_in_change":"2024-09-13T18:26:05.887130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:25:13.672723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-09-13T18:27:42.648350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-09-13T18:27:43.137400+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8245ff4-3301-430c-a290-6000dfd0807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":59,"up_thru":92,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3683619056},{"type":"v1","addr":"172.21.15.38:6803","nonce":3683619056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3683619056},{"type":"v1","addr":"172.21.15.38:6805","nonce":3683619056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3683619056},{"type":"v1","addr":"172.21.15.38:6809","nonce":3683619056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3683619056},{"type":"v1","addr":"172.21.15.38:6807","nonce":3683619056}]},"public_addr":"172.21.15.38:6803/3683619056","cluster_addr":"172.21.15.38:6805/3683619056","heartbeat_back_addr":"172.21.15.38:6809/3683619056","heartbeat_front_addr":"172.21.15.38:6807/3683619056","state":["exists","up"]},{"osd":1,"uuid":"1518b6f4-6e5f-445f-b0cd-2ebaecb3c203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":68,"up_from":72,"up_thru":92,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3218305916},{"type":"v1","addr":"172.21.15.38:6811","nonce":3218305916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3218305916},{"type":"v1","addr":"172.21.15.38:6813","nonce":3218305916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":3218305916},{"type":"v1","addr":"172.21.15.38:6817","nonce":3218305916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3218305916},{"type":"v1","addr":"172.21.15.38:6815","nonce":3218305916}]},"public_addr":"172.21.15.38:6811/3218305916","cluster_addr":"172.21.15.38:6813/3218305916","heartbeat_back_addr":"172.21.15.38:6817/3218305916","heartbeat_front_addr":"172.21.15.38:6815/3218305916","state":["exists","up"]},{"osd":2,"uuid":"43ebe637-fa97-4ac6-b85e-01440f6ca6eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":73,"up_from":77,"up_thru":92,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1124081148},{"type":"v1","addr":"172.21.15.38:6819","nonce":1124081148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1124081148},{"type":"v1","addr":"172.21.15.38:6821","nonce":1124081148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1124081148},{"type":"v1","addr":"172.21.15.38:6825","nonce":1124081148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1124081148},{"type":"v1","addr":"172.21.15.38:6823","nonce":1124081148}]},"public_addr":"172.21.15.38:6819/1124081148","cluster_addr":"172.21.15.38:6821/1124081148","heartbeat_back_addr":"172.21.15.38:6825/1124081148","heartbeat_front_addr":"172.21.15.38:6823/1124081148","state":["exists","up"]},{"osd":3,"uuid":"5ffdedaf-95c7-45b3-9af6-36b5a74d60f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":78,"up_from":82,"up_thru":92,"down_at":79,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3674321522},{"type":"v1","addr":"172.21.15.149:6801","nonce":3674321522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3674321522},{"type":"v1","addr":"172.21.15.149:6803","nonce":3674321522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3674321522},{"type":"v1","addr":"172.21.15.149:6807","nonce":3674321522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3674321522},{"type":"v1","addr":"172.21.15.149:6805","nonce":3674321522}]},"public_addr":"172.21.15.149:6801/3674321522","cluster_addr":"172.21.15.149:6803/3674321522","heartbeat_back_addr":"172.21.15.149:6807/3674321522","heartbeat_front_addr":"172.21.15.149:6805/3674321522","state":["exists","up"]},{"osd":4,"uuid":"e91e0c22-0686-45ef-a8b3-a356ab76eb88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":83,"up_from":87,"up_thru":92,"down_at":84,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":275970326},{"type":"v1","addr":"172.21.15.149:6809","nonce":275970326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":275970326},{"type":"v1","addr":"172.21.15.149:6811","nonce":275970326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":275970326},{"type":"v1","addr":"172.21.15.149:6815","nonce":275970326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":275970326},{"type":"v1","addr":"172.21.15.149:6813","nonce":275970326}]},"public_addr":"172.21.15.149:6809/275970326","cluster_addr":"172.21.15.149:6811/275970326","heartbeat_back_addr":"172.21.15.149:6815/275970326","heartbeat_front_addr":"172.21.15.149:6813/275970326","state":["exists","up"]},{"osd":5,"uuid":"ad710f6e-dbff-455c-8a67-7aca4ab8a56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":88,"up_from":92,"up_thru":92,"down_at":89,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3302600515},{"type":"v1","addr":"172.21.15.149:6817","nonce":3302600515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":3302600515},{"type":"v1","addr":"172.21.15.149:6819","nonce":3302600515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":3302600515},{"type":"v1","addr":"172.21.15.149:6823","nonce":3302600515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3302600515},{"type":"v1","addr":"172.21.15.149:6821","nonce":3302600515}]},"public_addr":"172.21.15.149:6817/3302600515","cluster_addr":"172.21.15.149:6819/3302600515","heartbeat_back_addr":"172.21.15.149:6823/3302600515","heartbeat_front_addr":"172.21.15.149:6821/3302600515","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:11.540858+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.374275+0000","dead_epoch":68},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:10.472792+0000","dead_epoch":73},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:33.374560+0000","dead_epoch":78},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:58.381692+0000","dead_epoch":83},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:22.772809+0000","dead_epoch":88}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":3,"to":0}]},{"pgid":"2.12","mappings":[{"from":3,"to":2}]},{"pgid":"2.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.9","mappings":[{"from":4,"to":0}]},{"pgid":"3.a","mappings":[{"from":3,"to":0}]},{"pgid":"3.14","mappings":[{"from":4,"to":0}]},{"pgid":"3.16","mappings":[{"from":1,"to":0}]},{"pgid":"3.19","mappings":[{"from":1,"to":0}]},{"pgid":"3.1b","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6829/1171569676":"2024-09-14T18:36:50.313844+0000","172.21.15.38:6828/1171569676":"2024-09-14T18:36:50.313844+0000","172.21.15.38:0/1704785391":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6827/1032191718":"2024-09-14T18:27:59.313642+0000","172.21.15.38:0/2217216874":"2024-09-14T18:30:00.433046+0000","172.21.15.38:6826/1032191718":"2024-09-14T18:27:59.313642+0000","172.21.15.38:6800/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.38:6801/2302807265":"2024-09-14T18:30:00.433046+0000","172.21.15.149:0/1027981355":"2024-09-14T18:31:06.334407+0000","172.21.15.38:6801/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:0/3449425844":"2024-09-14T18:30:00.433046+0000","172.21.15.149:0/3464598559":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/1699958329":"2024-09-14T18:21:45.526804+0000","172.21.15.149:6829/2070517292":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/2793935378":"2024-09-14T18:21:07.813395+0000","172.21.15.149:0/3013293122":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/1884863821":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/2254155782":"2024-09-14T18:30:00.433046+0000","172.21.15.38:0/954446429":"2024-09-14T18:30:00.433046+0000","172.21.15.38:0/1436289281":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6800/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6800/1869434741":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/3719380288":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/1458254215":"2024-09-14T18:21:45.526804+0000","172.21.15.149:6828/2070517292":"2024-09-14T18:31:06.334407+0000","172.21.15.38:6801/1869434741":"2024-09-14T18:22:55.167215+0000","172.21.15.149:0/957353854":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/3421440666":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6801/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.149:0/3965866":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/133472565":"2024-09-14T18:21:45.526804+0000","172.21.15.149:0/3877995726":"2024-09-14T18:31:06.334407+0000","172.21.15.38:6800/2302807265":"2024-09-14T18:30:00.433046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.556+0000 7f92a2d95640 1 -- 172.21.15.38:0/2451646988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f928c06cc90 msgr2=0x7f928c06f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.556+0000 7f92a2d95640 1 --2- 172.21.15.38:0/2451646988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f928c06cc90 0x7f928c06f150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f929c196c40 tx=0x7f9288005c70 comp rx=0 tx=0).stop 2024-09-13T18:40:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.556+0000 7f92a2d95640 1 -- 172.21.15.38:0/2451646988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f929c100c70 msgr2=0x7f929c19b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.556+0000 7f92a2d95640 1 --2- 172.21.15.38:0/2451646988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f929c100c70 0x7f929c19b6f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9290006010 tx=0x7f9290005700 comp rx=0 tx=0).stop 2024-09-13T18:40:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.556+0000 7f92a2d95640 1 -- 172.21.15.38:0/2451646988 shutdown_connections 2024-09-13T18:40:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.556+0000 7f92a2d95640 1 --2- 172.21.15.38:0/2451646988 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f928c06cc90 0x7f928c06f150 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.556+0000 7f92a2d95640 1 --2- 172.21.15.38:0/2451646988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f929c101590 0x7f929c19bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.556+0000 7f92a2d95640 1 --2- 172.21.15.38:0/2451646988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f929c100c70 0x7f929c19b6f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.556+0000 7f92a2d95640 1 -- 172.21.15.38:0/2451646988 >> 172.21.15.38:0/2451646988 conn(0x7f929c0fa620 msgr2=0x7f929c101ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.556+0000 7f92a2d95640 1 -- 172.21.15.38:0/2451646988 shutdown_connections 2024-09-13T18:40:59.559 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.556+0000 7f92a2d95640 1 -- 172.21.15.38:0/2451646988 wait complete. 2024-09-13T18:40:59.570 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:25:13.672723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-09-13T18:27:42.648350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-09-13T18:27:43.137400+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:40:59.570 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:40:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.673+0000 7fc40ce87640 1 -- 172.21.15.38:0/1269645591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4080fe900 msgr2=0x7fc4080fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.673+0000 7fc40ce87640 1 --2- 172.21.15.38:0/1269645591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4080fe900 0x7fc4080fed60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009880 tx=0x7fc3f802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.673+0000 7fc40ce87640 1 -- 172.21.15.38:0/1269645591 shutdown_connections 2024-09-13T18:40:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.673+0000 7fc40ce87640 1 --2- 172.21.15.38:0/1269645591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc4080fe900 0x7fc4080fed60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.673+0000 7fc40ce87640 1 --2- 172.21.15.38:0/1269645591 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc408104910 0x7fc408104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.673+0000 7fc40ce87640 1 -- 172.21.15.38:0/1269645591 >> 172.21.15.38:0/1269645591 conn(0x7fc408075750 msgr2=0x7fc4080fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.673+0000 7fc40ce87640 1 -- 172.21.15.38:0/1269645591 shutdown_connections 2024-09-13T18:40:59.676 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.673+0000 7fc40ce87640 1 -- 172.21.15.38:0/1269645591 wait complete. 2024-09-13T18:40:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.674+0000 7fc40ce87640 1 Processor -- start 2024-09-13T18:40:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.674+0000 7fc40ce87640 1 -- start start 2024-09-13T18:40:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.674+0000 7fc40ce87640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4080fe900 0x7fc40819b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.674+0000 7fc40ce87640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc408104910 0x7fc40819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.674+0000 7fc40ce87640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4081957b0 con 0x7fc408104910 2024-09-13T18:40:59.678 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.674+0000 7fc40ce87640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc408195920 con 0x7fc4080fe900 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.674+0000 7fc405d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc408104910 0x7fc40819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.674+0000 7fc405d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc408104910 0x7fc40819bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49662/0 (socket says 172.21.15.38:49662) 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.674+0000 7fc405d9b640 1 -- 172.21.15.38:0/2850626599 learned_addr learned my addr 172.21.15.38:0/2850626599 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.674+0000 7fc40659c640 1 --2- 172.21.15.38:0/2850626599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4080fe900 0x7fc40819b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.675+0000 7fc405d9b640 1 -- 172.21.15.38:0/2850626599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4080fe900 msgr2=0x7fc40819b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.675+0000 7fc405d9b640 1 --2- 172.21.15.38:0/2850626599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4080fe900 0x7fc40819b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.675+0000 7fc405d9b640 1 -- 172.21.15.38:0/2850626599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f8009560 con 0x7fc408104910 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.675+0000 7fc40659c640 1 --2- 172.21.15.38:0/2850626599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4080fe900 0x7fc40819b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.675+0000 7fc405d9b640 1 --2- 172.21.15.38:0/2850626599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc408104910 0x7fc40819bc10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc3f802a9c0 tx=0x7fc3f80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.675+0000 7fc3ff7fe640 1 -- 172.21.15.38:0/2850626599 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f8004b60 con 0x7fc408104910 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.675+0000 7fc3ff7fe640 1 -- 172.21.15.38:0/2850626599 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc3f8004cc0 con 0x7fc408104910 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.675+0000 7fc40ce87640 1 -- 172.21.15.38:0/2850626599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc408195ba0 con 0x7fc408104910 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.675+0000 7fc3ff7fe640 1 -- 172.21.15.38:0/2850626599 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f8031950 con 0x7fc408104910 2024-09-13T18:40:59.679 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.675+0000 7fc40ce87640 1 -- 172.21.15.38:0/2850626599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4081960a0 con 0x7fc408104910 2024-09-13T18:40:59.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.676+0000 7fc40ce87640 1 -- 172.21.15.38:0/2850626599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc408100040 con 0x7fc408104910 2024-09-13T18:40:59.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.677+0000 7fc3ff7fe640 1 -- 172.21.15.38:0/2850626599 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc3f8003c20 con 0x7fc408104910 2024-09-13T18:40:59.680 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.677+0000 7fc3ff7fe640 1 --2- 172.21.15.38:0/2850626599 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc3f406cc50 0x7fc3f406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.677+0000 7fc3ff7fe640 1 -- 172.21.15.38:0/2850626599 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fc3f80ad790 con 0x7fc408104910 2024-09-13T18:40:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.677+0000 7fc40659c640 1 --2- 172.21.15.38:0/2850626599 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc3f406cc50 0x7fc3f406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.681 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.678+0000 7fc40659c640 1 --2- 172.21.15.38:0/2850626599 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc3f406cc50 0x7fc3f406f110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009b40 tx=0x7fc3f0005e50 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:59.684 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.681+0000 7fc3ff7fe640 1 -- 172.21.15.38:0/2850626599 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc3f8077750 con 0x7fc408104910 2024-09-13T18:40:59.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.851+0000 7fc40ce87640 1 -- 172.21.15.38:0/2850626599 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc40810ba60 con 0x7fc408104910 2024-09-13T18:40:59.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.852+0000 7fc3ff7fe640 1 -- 172.21.15.38:0/2850626599 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3f8004e30 con 0x7fc408104910 2024-09-13T18:40:59.854 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-09-13T18:40:59.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.854+0000 7fc40ce87640 1 -- 172.21.15.38:0/2850626599 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc3f406cc50 msgr2=0x7fc3f406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.854+0000 7fc40ce87640 1 --2- 172.21.15.38:0/2850626599 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc3f406cc50 0x7fc3f406f110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009b40 tx=0x7fc3f0005e50 comp rx=0 tx=0).stop 2024-09-13T18:40:59.856 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.854+0000 7fc40ce87640 1 -- 172.21.15.38:0/2850626599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc408104910 msgr2=0x7fc40819bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.854+0000 7fc40ce87640 1 --2- 172.21.15.38:0/2850626599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc408104910 0x7fc40819bc10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc3f802a9c0 tx=0x7fc3f80055a0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.854+0000 7fc40ce87640 1 -- 172.21.15.38:0/2850626599 shutdown_connections 2024-09-13T18:40:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.854+0000 7fc40ce87640 1 --2- 172.21.15.38:0/2850626599 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc408104910 0x7fc40819bc10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.854+0000 7fc40ce87640 1 --2- 172.21.15.38:0/2850626599 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc3f406cc50 0x7fc3f406f110 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.854+0000 7fc40ce87640 1 --2- 172.21.15.38:0/2850626599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4080fe900 0x7fc40819b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.854+0000 7fc40ce87640 1 -- 172.21.15.38:0/2850626599 >> 172.21.15.38:0/2850626599 conn(0x7fc408075750 msgr2=0x7fc4080fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.854+0000 7fc40ce87640 1 -- 172.21.15.38:0/2850626599 shutdown_connections 2024-09-13T18:40:59.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.854+0000 7fc40ce87640 1 -- 172.21.15.38:0/2850626599 wait complete. 2024-09-13T18:40:59.867 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-09-13T18:40:59.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.971+0000 7fcb21e2b640 1 -- 172.21.15.38:0/3040370168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1c100be0 msgr2=0x7fcb1c100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.971+0000 7fcb21e2b640 1 --2- 172.21.15.38:0/3040370168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1c100be0 0x7fcb1c100fc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009880 tx=0x7fcb0c02a530 comp rx=0 tx=0).stop 2024-09-13T18:40:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.971+0000 7fcb21e2b640 1 -- 172.21.15.38:0/3040370168 shutdown_connections 2024-09-13T18:40:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.971+0000 7fcb21e2b640 1 --2- 172.21.15.38:0/3040370168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb1c101500 0x7fcb1c1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.971+0000 7fcb21e2b640 1 --2- 172.21.15.38:0/3040370168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1c100be0 0x7fcb1c100fc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.971+0000 7fcb21e2b640 1 -- 172.21.15.38:0/3040370168 >> 172.21.15.38:0/3040370168 conn(0x7fcb1c0757b0 msgr2=0x7fcb1c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.971+0000 7fcb21e2b640 1 -- 172.21.15.38:0/3040370168 shutdown_connections 2024-09-13T18:40:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.971+0000 7fcb21e2b640 1 -- 172.21.15.38:0/3040370168 wait complete. 2024-09-13T18:40:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.971+0000 7fcb21e2b640 1 Processor -- start 2024-09-13T18:40:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.971+0000 7fcb21e2b640 1 -- start start 2024-09-13T18:40:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.972+0000 7fcb21e2b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb1c100be0 0x7fcb1c19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.972+0000 7fcb21e2b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1c101500 0x7fcb1c19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.972+0000 7fcb21e2b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c1957d0 con 0x7fcb1c101500 2024-09-13T18:40:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.972+0000 7fcb21e2b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c195940 con 0x7fcb1c100be0 2024-09-13T18:40:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.972+0000 7fcb12ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1c101500 0x7fcb1c19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.972+0000 7fcb12ffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1c101500 0x7fcb1c19bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49688/0 (socket says 172.21.15.38:49688) 2024-09-13T18:40:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.972+0000 7fcb12ffd640 1 -- 172.21.15.38:0/4021370713 learned_addr learned my addr 172.21.15.38:0/4021370713 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:40:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.972+0000 7fcb1b7fe640 1 --2- 172.21.15.38:0/4021370713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb1c100be0 0x7fcb1c19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.972+0000 7fcb12ffd640 1 -- 172.21.15.38:0/4021370713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb1c100be0 msgr2=0x7fcb1c19b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.972+0000 7fcb12ffd640 1 --2- 172.21.15.38:0/4021370713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb1c100be0 0x7fcb1c19b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.972+0000 7fcb12ffd640 1 -- 172.21.15.38:0/4021370713 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c009560 con 0x7fcb1c101500 2024-09-13T18:40:59.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.972+0000 7fcb12ffd640 1 --2- 172.21.15.38:0/4021370713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1c101500 0x7fcb1c19bc30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400d6d0 tx=0x7fcb0400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:59.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.973+0000 7fcb197fa640 1 -- 172.21.15.38:0/4021370713 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb040051f0 con 0x7fcb1c101500 2024-09-13T18:40:59.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.973+0000 7fcb197fa640 1 -- 172.21.15.38:0/4021370713 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb04009820 con 0x7fcb1c101500 2024-09-13T18:40:59.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.973+0000 7fcb21e2b640 1 -- 172.21.15.38:0/4021370713 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1c195c20 con 0x7fcb1c101500 2024-09-13T18:40:59.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.973+0000 7fcb197fa640 1 -- 172.21.15.38:0/4021370713 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb04004d00 con 0x7fcb1c101500 2024-09-13T18:40:59.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.973+0000 7fcb21e2b640 1 -- 172.21.15.38:0/4021370713 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1c196180 con 0x7fcb1c101500 2024-09-13T18:40:59.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.974+0000 7fcb21e2b640 1 -- 172.21.15.38:0/4021370713 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1c067d30 con 0x7fcb1c101500 2024-09-13T18:40:59.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.974+0000 7fcb197fa640 1 -- 172.21.15.38:0/4021370713 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcb04010460 con 0x7fcb1c101500 2024-09-13T18:40:59.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.975+0000 7fcb197fa640 1 --2- 172.21.15.38:0/4021370713 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcb0806cc70 0x7fcb0806f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.975+0000 7fcb197fa640 1 -- 172.21.15.38:0/4021370713 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fcb0408c090 con 0x7fcb1c101500 2024-09-13T18:40:59.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.975+0000 7fcb1b7fe640 1 --2- 172.21.15.38:0/4021370713 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcb0806cc70 0x7fcb0806f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.976+0000 7fcb1b7fe640 1 --2- 172.21.15.38:0/4021370713 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcb0806cc70 0x7fcb0806f130 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c000c00 tx=0x7fcb0c005d50 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:59.982 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:40:59.980+0000 7fcb197fa640 1 -- 172.21.15.38:0/4021370713 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcb04056140 con 0x7fcb1c101500 2024-09-13T18:41:00.154 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.152+0000 7fcb21e2b640 1 -- 172.21.15.38:0/4021370713 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fcb1c100fc0 con 0x7fcb1c101500 2024-09-13T18:41:00.155 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.153+0000 7fcb197fa640 1 -- 172.21.15.38:0/4021370713 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v97) v1 ==== 107+0+11 (secure 0 0 0) 0x7fcb040170b0 con 0x7fcb1c101500 2024-09-13T18:41:00.155 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-13T18:41:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.154+0000 7fcb21e2b640 1 -- 172.21.15.38:0/4021370713 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcb0806cc70 msgr2=0x7fcb0806f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.154+0000 7fcb21e2b640 1 --2- 172.21.15.38:0/4021370713 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcb0806cc70 0x7fcb0806f130 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c000c00 tx=0x7fcb0c005d50 comp rx=0 tx=0).stop 2024-09-13T18:41:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.154+0000 7fcb21e2b640 1 -- 172.21.15.38:0/4021370713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1c101500 msgr2=0x7fcb1c19bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.154+0000 7fcb21e2b640 1 --2- 172.21.15.38:0/4021370713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1c101500 0x7fcb1c19bc30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400d6d0 tx=0x7fcb0400db90 comp rx=0 tx=0).stop 2024-09-13T18:41:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.155+0000 7fcb21e2b640 1 -- 172.21.15.38:0/4021370713 shutdown_connections 2024-09-13T18:41:00.157 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.155+0000 7fcb21e2b640 1 --2- 172.21.15.38:0/4021370713 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1c101500 0x7fcb1c19bc30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.155+0000 7fcb21e2b640 1 --2- 172.21.15.38:0/4021370713 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fcb0806cc70 0x7fcb0806f130 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.155+0000 7fcb21e2b640 1 --2- 172.21.15.38:0/4021370713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb1c100be0 0x7fcb1c19b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.155+0000 7fcb21e2b640 1 -- 172.21.15.38:0/4021370713 >> 172.21.15.38:0/4021370713 conn(0x7fcb1c0757b0 msgr2=0x7fcb1c101ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.155+0000 7fcb21e2b640 1 -- 172.21.15.38:0/4021370713 shutdown_connections 2024-09-13T18:41:00.158 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.155+0000 7fcb21e2b640 1 -- 172.21.15.38:0/4021370713 wait complete. 2024-09-13T18:41:00.167 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:59 smithi038 ceph-mon[91522]: pgmap v347: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:41:00.167 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:59 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2451646988' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:41:00.167 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:40:59 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2850626599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:41:00.168 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-09-13T18:41:00.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:59 smithi149 ceph-mon[76906]: pgmap v347: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:41:00.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:59 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2451646988' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:41:00.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:40:59 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2850626599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:41:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.271+0000 7fe1162d7640 1 -- 172.21.15.38:0/4242556761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe110105a50 msgr2=0x7fe110105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.271+0000 7fe1162d7640 1 --2- 172.21.15.38:0/4242556761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe110105a50 0x7fe110105e30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe100009880 tx=0x7fe10002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.271+0000 7fe1162d7640 1 -- 172.21.15.38:0/4242556761 shutdown_connections 2024-09-13T18:41:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.271+0000 7fe1162d7640 1 --2- 172.21.15.38:0/4242556761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1100ffa40 0x7fe1100ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.271+0000 7fe1162d7640 1 --2- 172.21.15.38:0/4242556761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe110105a50 0x7fe110105e30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.274 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.271+0000 7fe1162d7640 1 -- 172.21.15.38:0/4242556761 >> 172.21.15.38:0/4242556761 conn(0x7fe1100fb740 msgr2=0x7fe1100fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.271+0000 7fe1162d7640 1 -- 172.21.15.38:0/4242556761 shutdown_connections 2024-09-13T18:41:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.271+0000 7fe1162d7640 1 -- 172.21.15.38:0/4242556761 wait complete. 2024-09-13T18:41:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.272+0000 7fe1162d7640 1 Processor -- start 2024-09-13T18:41:00.275 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.272+0000 7fe1162d7640 1 -- start start 2024-09-13T18:41:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.272+0000 7fe1162d7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1100ffa40 0x7fe11019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.276 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.272+0000 7fe1162d7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe110105a50 0x7fe11019bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.272+0000 7fe1162d7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101957a0 con 0x7fe110105a50 2024-09-13T18:41:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.272+0000 7fe1162d7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe110195910 con 0x7fe1100ffa40 2024-09-13T18:41:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.272+0000 7fe10f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe110105a50 0x7fe11019bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.272+0000 7fe10f7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe110105a50 0x7fe11019bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49714/0 (socket says 172.21.15.38:49714) 2024-09-13T18:41:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.272+0000 7fe10f7fe640 1 -- 172.21.15.38:0/2655227003 learned_addr learned my addr 172.21.15.38:0/2655227003 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.272+0000 7fe10ffff640 1 --2- 172.21.15.38:0/2655227003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1100ffa40 0x7fe11019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.277 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.273+0000 7fe10f7fe640 1 -- 172.21.15.38:0/2655227003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1100ffa40 msgr2=0x7fe11019b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.273+0000 7fe10f7fe640 1 --2- 172.21.15.38:0/2655227003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1100ffa40 0x7fe11019b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.273+0000 7fe10f7fe640 1 -- 172.21.15.38:0/2655227003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe100009560 con 0x7fe110105a50 2024-09-13T18:41:00.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.273+0000 7fe10f7fe640 1 --2- 172.21.15.38:0/2655227003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe110105a50 0x7fe11019bc00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe10400d6f0 tx=0x7fe10400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:00.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.273+0000 7fe10d7fa640 1 -- 172.21.15.38:0/2655227003 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe104009a30 con 0x7fe110105a50 2024-09-13T18:41:00.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.273+0000 7fe1162d7640 1 -- 172.21.15.38:0/2655227003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe110195bf0 con 0x7fe110105a50 2024-09-13T18:41:00.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.273+0000 7fe10d7fa640 1 -- 172.21.15.38:0/2655227003 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1040054c0 con 0x7fe110105a50 2024-09-13T18:41:00.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.273+0000 7fe10d7fa640 1 -- 172.21.15.38:0/2655227003 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe104004db0 con 0x7fe110105a50 2024-09-13T18:41:00.278 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.273+0000 7fe1162d7640 1 -- 172.21.15.38:0/2655227003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe110196150 con 0x7fe110105a50 2024-09-13T18:41:00.279 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.274+0000 7fe1162d7640 1 -- 172.21.15.38:0/2655227003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe110101180 con 0x7fe110105a50 2024-09-13T18:41:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.275+0000 7fe10d7fa640 1 -- 172.21.15.38:0/2655227003 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe104004f30 con 0x7fe110105a50 2024-09-13T18:41:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.275+0000 7fe10d7fa640 1 --2- 172.21.15.38:0/2655227003 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe0f806cbf0 0x7fe0f806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.275+0000 7fe10d7fa640 1 -- 172.21.15.38:0/2655227003 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fe10408c0c0 con 0x7fe110105a50 2024-09-13T18:41:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.275+0000 7fe10ffff640 1 --2- 172.21.15.38:0/2655227003 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe0f806cbf0 0x7fe0f806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.280 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.276+0000 7fe10ffff640 1 --2- 172.21.15.38:0/2655227003 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe0f806cbf0 0x7fe0f806f0b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe100000c00 tx=0x7fe1000058d0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:00.282 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.280+0000 7fe10d7fa640 1 -- 172.21.15.38:0/2655227003 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe104056130 con 0x7fe110105a50 2024-09-13T18:41:00.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.449+0000 7fe1162d7640 1 -- 172.21.15.38:0/2655227003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fe1100ffea0 con 0x7fe110105a50 2024-09-13T18:41:00.453 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.450+0000 7fe10d7fa640 1 -- 172.21.15.38:0/2655227003 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v97) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe104059750 con 0x7fe110105a50 2024-09-13T18:41:00.453 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-13T18:41:00.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.451+0000 7fe1162d7640 1 -- 172.21.15.38:0/2655227003 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe0f806cbf0 msgr2=0x7fe0f806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.451+0000 7fe1162d7640 1 --2- 172.21.15.38:0/2655227003 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe0f806cbf0 0x7fe0f806f0b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe100000c00 tx=0x7fe1000058d0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.455 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.452+0000 7fe1162d7640 1 -- 172.21.15.38:0/2655227003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe110105a50 msgr2=0x7fe11019bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.452+0000 7fe1162d7640 1 --2- 172.21.15.38:0/2655227003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe110105a50 0x7fe11019bc00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe10400d6f0 tx=0x7fe10400dbb0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.452+0000 7fe1162d7640 1 -- 172.21.15.38:0/2655227003 shutdown_connections 2024-09-13T18:41:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.452+0000 7fe1162d7640 1 --2- 172.21.15.38:0/2655227003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe110105a50 0x7fe11019bc00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.452+0000 7fe1162d7640 1 --2- 172.21.15.38:0/2655227003 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe0f806cbf0 0x7fe0f806f0b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.452+0000 7fe1162d7640 1 --2- 172.21.15.38:0/2655227003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1100ffa40 0x7fe11019b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.452+0000 7fe1162d7640 1 -- 172.21.15.38:0/2655227003 >> 172.21.15.38:0/2655227003 conn(0x7fe1100fb740 msgr2=0x7fe1100fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.452+0000 7fe1162d7640 1 -- 172.21.15.38:0/2655227003 shutdown_connections 2024-09-13T18:41:00.456 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.452+0000 7fe1162d7640 1 -- 172.21.15.38:0/2655227003 wait complete. 2024-09-13T18:41:00.466 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:00.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.565+0000 7f571fb7d640 1 -- 172.21.15.38:0/2950767916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5718101530 msgr2=0x7f5718109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.565+0000 7f571fb7d640 1 --2- 172.21.15.38:0/2950767916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5718101530 0x7f5718109a10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5708009880 tx=0x7f570802a530 comp rx=0 tx=0).stop 2024-09-13T18:41:00.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.565+0000 7f571fb7d640 1 -- 172.21.15.38:0/2950767916 shutdown_connections 2024-09-13T18:41:00.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.565+0000 7f571fb7d640 1 --2- 172.21.15.38:0/2950767916 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5718101530 0x7f5718109a10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.565+0000 7f571fb7d640 1 --2- 172.21.15.38:0/2950767916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5718100c10 0x7f5718100ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.565+0000 7f571fb7d640 1 -- 172.21.15.38:0/2950767916 >> 172.21.15.38:0/2950767916 conn(0x7f57180fa620 msgr2=0x7f57180fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:00.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.565+0000 7f571fb7d640 1 -- 172.21.15.38:0/2950767916 shutdown_connections 2024-09-13T18:41:00.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.565+0000 7f571fb7d640 1 -- 172.21.15.38:0/2950767916 wait complete. 2024-09-13T18:41:00.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571fb7d640 1 Processor -- start 2024-09-13T18:41:00.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571fb7d640 1 -- start start 2024-09-13T18:41:00.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571fb7d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5718100c10 0x7f57180fe860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571fb7d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5718101530 0x7f57180feda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571fb7d640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57180ff2e0 con 0x7f5718101530 2024-09-13T18:41:00.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571fb7d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57180ff420 con 0x7f5718100c10 2024-09-13T18:41:00.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571d118640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5718101530 0x7f57180feda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571d118640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5718101530 0x7f57180feda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49738/0 (socket says 172.21.15.38:49738) 2024-09-13T18:41:00.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571d118640 1 -- 172.21.15.38:0/1770992998 learned_addr learned my addr 172.21.15.38:0/1770992998 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:00.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571d919640 1 --2- 172.21.15.38:0/1770992998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5718100c10 0x7f57180fe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571d118640 1 -- 172.21.15.38:0/1770992998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5718100c10 msgr2=0x7f57180fe860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571d118640 1 --2- 172.21.15.38:0/1770992998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5718100c10 0x7f57180fe860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571d118640 1 -- 172.21.15.38:0/1770992998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5708009560 con 0x7f5718101530 2024-09-13T18:41:00.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.566+0000 7f571d919640 1 --2- 172.21.15.38:0/1770992998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5718100c10 0x7f57180fe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:00.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.567+0000 7f571d118640 1 --2- 172.21.15.38:0/1770992998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5718101530 0x7f57180feda0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5708006010 tx=0x7f5708005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:00.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.567+0000 7f570effd640 1 -- 172.21.15.38:0/1770992998 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5708004aa0 con 0x7f5718101530 2024-09-13T18:41:00.572 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.567+0000 7f570effd640 1 -- 172.21.15.38:0/1770992998 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5708004c00 con 0x7f5718101530 2024-09-13T18:41:00.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.567+0000 7f571fb7d640 1 -- 172.21.15.38:0/1770992998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57180ff6a0 con 0x7f5718101530 2024-09-13T18:41:00.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.567+0000 7f570effd640 1 -- 172.21.15.38:0/1770992998 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57080318b0 con 0x7f5718101530 2024-09-13T18:41:00.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.567+0000 7f571fb7d640 1 -- 172.21.15.38:0/1770992998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57181a1ef0 con 0x7f5718101530 2024-09-13T18:41:00.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.568+0000 7f571fb7d640 1 -- 172.21.15.38:0/1770992998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57180688b0 con 0x7f5718101530 2024-09-13T18:41:00.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.568+0000 7f570effd640 1 -- 172.21.15.38:0/1770992998 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f570802ad50 con 0x7f5718101530 2024-09-13T18:41:00.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.569+0000 7f570effd640 1 --2- 172.21.15.38:0/1770992998 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f570406cc50 0x7f570406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.569+0000 7f570effd640 1 -- 172.21.15.38:0/1770992998 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f57080ad4b0 con 0x7f5718101530 2024-09-13T18:41:00.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.569+0000 7f571d919640 1 --2- 172.21.15.38:0/1770992998 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f570406cc50 0x7f570406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.569+0000 7f571d919640 1 --2- 172.21.15.38:0/1770992998 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f570406cc50 0x7f570406f110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f571400abe0 tx=0x7f571400a5c0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:00.577 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.573+0000 7f570effd640 1 -- 172.21.15.38:0/1770992998 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5708077470 con 0x7f5718101530 2024-09-13T18:41:00.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.781+0000 7f571fb7d640 1 -- 172.21.15.38:0/1770992998 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5718104140 con 0x7f5718101530 2024-09-13T18:41:00.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.782+0000 7f570effd640 1 -- 172.21.15.38:0/1770992998 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4861 (secure 0 0 0) 0x7f570807aa90 con 0x7f5718101530 2024-09-13T18:41:00.786 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:00.786 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:37:41.633234+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34352,"mds_1":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34352":{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":26,"state":"up:active","state_seq":8,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34384":{"gid":34384,"name":"cephfs.smithi038.dtnkqo","rank":1,"incarnation":35,"state":"up:active","state_seq":12,"addr":"172.21.15.38:6829/3278914810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3278914810},{"type":"v1","addr":"172.21.15.38:6829","nonce":3278914810}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_44325":{"gid":44325,"name":"cephfs.smithi149.doanhj","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6825/248866776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":248866776},{"type":"v1","addr":"172.21.15.149:6825","nonce":248866776}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_44353":{"gid":44353,"name":"cephfs.smithi149.zdzwzb","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6827/3248503653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3248503653},{"type":"v1","addr":"172.21.15.149:6827","nonce":3248503653}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:00.786 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 37 2024-09-13T18:41:00.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.784+0000 7f571fb7d640 1 -- 172.21.15.38:0/1770992998 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f570406cc50 msgr2=0x7f570406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.784+0000 7f571fb7d640 1 --2- 172.21.15.38:0/1770992998 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f570406cc50 0x7f570406f110 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f571400abe0 tx=0x7f571400a5c0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.784+0000 7f571fb7d640 1 -- 172.21.15.38:0/1770992998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5718101530 msgr2=0x7f57180feda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.784+0000 7f571fb7d640 1 --2- 172.21.15.38:0/1770992998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5718101530 0x7f57180feda0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5708006010 tx=0x7f5708005610 comp rx=0 tx=0).stop 2024-09-13T18:41:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.784+0000 7f571fb7d640 1 -- 172.21.15.38:0/1770992998 shutdown_connections 2024-09-13T18:41:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.784+0000 7f571fb7d640 1 --2- 172.21.15.38:0/1770992998 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5718101530 0x7f57180feda0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.784+0000 7f571fb7d640 1 --2- 172.21.15.38:0/1770992998 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f570406cc50 0x7f570406f110 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.784+0000 7f571fb7d640 1 --2- 172.21.15.38:0/1770992998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5718100c10 0x7f57180fe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.784+0000 7f571fb7d640 1 -- 172.21.15.38:0/1770992998 >> 172.21.15.38:0/1770992998 conn(0x7f57180fa620 msgr2=0x7f5718101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.784+0000 7f571fb7d640 1 -- 172.21.15.38:0/1770992998 shutdown_connections 2024-09-13T18:41:00.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.784+0000 7f571fb7d640 1 -- 172.21.15.38:0/1770992998 wait complete. 2024-09-13T18:41:00.799 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 50} 2024-09-13T18:41:00.799 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-09-13T18:41:00.904 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.899+0000 7f4315696640 1 -- 172.21.15.38:0/2468825333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4310104910 msgr2=0x7f4310104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.899+0000 7f4315696640 1 --2- 172.21.15.38:0/2468825333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4310104910 0x7f4310104cf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4300009880 tx=0x7f430002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.899+0000 7f4315696640 1 -- 172.21.15.38:0/2468825333 shutdown_connections 2024-09-13T18:41:00.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.899+0000 7f4315696640 1 --2- 172.21.15.38:0/2468825333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43100fe900 0x7f43100fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.899+0000 7f4315696640 1 --2- 172.21.15.38:0/2468825333 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4310104910 0x7f4310104cf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.899+0000 7f4315696640 1 -- 172.21.15.38:0/2468825333 >> 172.21.15.38:0/2468825333 conn(0x7f4310075750 msgr2=0x7f43100fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:00.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.899+0000 7f4315696640 1 -- 172.21.15.38:0/2468825333 shutdown_connections 2024-09-13T18:41:00.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.899+0000 7f4315696640 1 -- 172.21.15.38:0/2468825333 wait complete. 2024-09-13T18:41:00.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.899+0000 7f4315696640 1 Processor -- start 2024-09-13T18:41:00.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f4315696640 1 -- start start 2024-09-13T18:41:00.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f4315696640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43100fe900 0x7f4310105830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f4315696640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4310104910 0x7f4310105d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f4315696640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43101062b0 con 0x7f4310104910 2024-09-13T18:41:00.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f4315696640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4310106420 con 0x7f43100fe900 2024-09-13T18:41:00.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f430e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4310104910 0x7f4310105d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f430e7fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4310104910 0x7f4310105d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49756/0 (socket says 172.21.15.38:49756) 2024-09-13T18:41:00.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f430e7fc640 1 -- 172.21.15.38:0/1446361499 learned_addr learned my addr 172.21.15.38:0/1446361499 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:00.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f430effd640 1 --2- 172.21.15.38:0/1446361499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43100fe900 0x7f4310105830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f430e7fc640 1 -- 172.21.15.38:0/1446361499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43100fe900 msgr2=0x7f4310105830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f430e7fc640 1 --2- 172.21.15.38:0/1446361499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43100fe900 0x7f4310105830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f430e7fc640 1 -- 172.21.15.38:0/1446361499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4300009560 con 0x7f4310104910 2024-09-13T18:41:00.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f430e7fc640 1 --2- 172.21.15.38:0/1446361499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4310104910 0x7f4310105d70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f430400c810 tx=0x7f430400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:00.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f42f7fff640 1 -- 172.21.15.38:0/1446361499 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43040041f0 con 0x7f4310104910 2024-09-13T18:41:00.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.900+0000 7f42f7fff640 1 -- 172.21.15.38:0/1446361499 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4304007e50 con 0x7f4310104910 2024-09-13T18:41:00.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.901+0000 7f4315696640 1 -- 172.21.15.38:0/1446361499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43101a1af0 con 0x7f4310104910 2024-09-13T18:41:00.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.901+0000 7f42f7fff640 1 -- 172.21.15.38:0/1446361499 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43040049d0 con 0x7f4310104910 2024-09-13T18:41:00.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.901+0000 7f4315696640 1 -- 172.21.15.38:0/1446361499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43101a1e60 con 0x7f4310104910 2024-09-13T18:41:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.902+0000 7f4315696640 1 -- 172.21.15.38:0/1446361499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4310100040 con 0x7f4310104910 2024-09-13T18:41:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.902+0000 7f42f7fff640 1 -- 172.21.15.38:0/1446361499 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f43040079b0 con 0x7f4310104910 2024-09-13T18:41:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.903+0000 7f42f7fff640 1 --2- 172.21.15.38:0/1446361499 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f42f806cc50 0x7f42f806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.903+0000 7f430effd640 1 --2- 172.21.15.38:0/1446361499 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f42f806cc50 0x7f42f806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.903+0000 7f42f7fff640 1 -- 172.21.15.38:0/1446361499 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f430408c3d0 con 0x7f4310104910 2024-09-13T18:41:00.908 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.903+0000 7f430effd640 1 --2- 172.21.15.38:0/1446361499 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f42f806cc50 0x7f42f806f110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4300006010 tx=0x7f4300000bc0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:00.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:00.907+0000 7f42f7fff640 1 -- 172.21.15.38:0/1446361499 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4304056410 con 0x7f4310104910 2024-09-13T18:41:01.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:00 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/4021370713' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T18:41:01.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:00 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2655227003' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T18:41:01.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:00 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1770992998' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:41:01.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.114+0000 7f4315696640 1 -- 172.21.15.38:0/1446361499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f431010bae0 con 0x7f4310104910 2024-09-13T18:41:01.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.114+0000 7f42f7fff640 1 -- 172.21.15.38:0/1446361499 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v37) v1 ==== 107+0+3284 (secure 0 0 0) 0x7f430401dcf0 con 0x7f4310104910 2024-09-13T18:41:01.118 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:01.118 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:00.285433+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14484,"mds_1":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi038.dtnkqo","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.38:6829/1171569676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1171569676},{"type":"v1","addr":"172.21.15.38:6829","nonce":1171569676}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24275":{"gid":24275,"name":"cephfs.smithi149.doanhj","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.149:6825/443686826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":443686826},{"type":"v1","addr":"172.21.15.149:6825","nonce":443686826}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:01.118 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 19 2024-09-13T18:41:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.116+0000 7f4315696640 1 -- 172.21.15.38:0/1446361499 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f42f806cc50 msgr2=0x7f42f806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.116+0000 7f4315696640 1 --2- 172.21.15.38:0/1446361499 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f42f806cc50 0x7f42f806f110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4300006010 tx=0x7f4300000bc0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.116+0000 7f4315696640 1 -- 172.21.15.38:0/1446361499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4310104910 msgr2=0x7f4310105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.116+0000 7f4315696640 1 --2- 172.21.15.38:0/1446361499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4310104910 0x7f4310105d70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f430400c810 tx=0x7f430400ccd0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.116+0000 7f4315696640 1 -- 172.21.15.38:0/1446361499 shutdown_connections 2024-09-13T18:41:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.116+0000 7f4315696640 1 --2- 172.21.15.38:0/1446361499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4310104910 0x7f4310105d70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.116+0000 7f4315696640 1 --2- 172.21.15.38:0/1446361499 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f42f806cc50 0x7f42f806f110 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.116+0000 7f4315696640 1 --2- 172.21.15.38:0/1446361499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43100fe900 0x7f4310105830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.116+0000 7f4315696640 1 -- 172.21.15.38:0/1446361499 >> 172.21.15.38:0/1446361499 conn(0x7f4310075750 msgr2=0x7f43100677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:01.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.116+0000 7f4315696640 1 -- 172.21.15.38:0/1446361499 shutdown_connections 2024-09-13T18:41:01.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.116+0000 7f4315696640 1 -- 172.21.15.38:0/1446361499 wait complete. 2024-09-13T18:41:01.131 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-13T18:41:01.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-09-13T18:41:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.231+0000 7f7592473640 1 -- 172.21.15.38:0/3526283797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f758c100bd0 msgr2=0x7f758c100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.231+0000 7f7592473640 1 --2- 172.21.15.38:0/3526283797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f758c100bd0 0x7f758c100fb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f757c009880 tx=0x7f757c02a530 comp rx=0 tx=0).stop 2024-09-13T18:41:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.231+0000 7f7592473640 1 -- 172.21.15.38:0/3526283797 shutdown_connections 2024-09-13T18:41:01.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.231+0000 7f7592473640 1 --2- 172.21.15.38:0/3526283797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f758c1014f0 0x7f758c1099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.231+0000 7f7592473640 1 --2- 172.21.15.38:0/3526283797 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f758c100bd0 0x7f758c100fb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.231+0000 7f7592473640 1 -- 172.21.15.38:0/3526283797 >> 172.21.15.38:0/3526283797 conn(0x7f758c075750 msgr2=0x7f758c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.231+0000 7f7592473640 1 -- 172.21.15.38:0/3526283797 shutdown_connections 2024-09-13T18:41:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.231+0000 7f7592473640 1 -- 172.21.15.38:0/3526283797 wait complete. 2024-09-13T18:41:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.231+0000 7f7592473640 1 Processor -- start 2024-09-13T18:41:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.232+0000 7f7592473640 1 -- start start 2024-09-13T18:41:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.232+0000 7f7592473640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f758c100bd0 0x7f758c19b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.232+0000 7f7592473640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f758c1014f0 0x7f758c19bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.232+0000 7f7592473640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c195800 con 0x7f758c100bd0 2024-09-13T18:41:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.232+0000 7f7592473640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c195970 con 0x7f758c1014f0 2024-09-13T18:41:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.232+0000 7f758bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f758c100bd0 0x7f758c19b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.232+0000 7f758bfff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f758c100bd0 0x7f758c19b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49764/0 (socket says 172.21.15.38:49764) 2024-09-13T18:41:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.232+0000 7f758bfff640 1 -- 172.21.15.38:0/2206017453 learned_addr learned my addr 172.21.15.38:0/2206017453 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.232+0000 7f758b7fe640 1 --2- 172.21.15.38:0/2206017453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f758c1014f0 0x7f758c19bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.232+0000 7f758bfff640 1 -- 172.21.15.38:0/2206017453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f758c1014f0 msgr2=0x7f758c19bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.232+0000 7f758bfff640 1 --2- 172.21.15.38:0/2206017453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f758c1014f0 0x7f758c19bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.232+0000 7f758bfff640 1 -- 172.21.15.38:0/2206017453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c009560 con 0x7f758c100bd0 2024-09-13T18:41:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.233+0000 7f758bfff640 1 --2- 172.21.15.38:0/2206017453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f758c100bd0 0x7f758c19b720 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f757c02aa50 tx=0x7f757c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.233+0000 7f75897fa640 1 -- 172.21.15.38:0/2206017453 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f757c004b60 con 0x7f758c100bd0 2024-09-13T18:41:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.233+0000 7f75897fa640 1 -- 172.21.15.38:0/2206017453 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f757c004cc0 con 0x7f758c100bd0 2024-09-13T18:41:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.233+0000 7f7592473640 1 -- 172.21.15.38:0/2206017453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c195bf0 con 0x7f758c100bd0 2024-09-13T18:41:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.233+0000 7f75897fa640 1 -- 172.21.15.38:0/2206017453 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f757c031950 con 0x7f758c100bd0 2024-09-13T18:41:01.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.233+0000 7f7592473640 1 -- 172.21.15.38:0/2206017453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758c1960f0 con 0x7f758c100bd0 2024-09-13T18:41:01.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.234+0000 7f7592473640 1 -- 172.21.15.38:0/2206017453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758c067d30 con 0x7f758c100bd0 2024-09-13T18:41:01.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.234+0000 7f75897fa640 1 -- 172.21.15.38:0/2206017453 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f757c02ad50 con 0x7f758c100bd0 2024-09-13T18:41:01.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.235+0000 7f75897fa640 1 --2- 172.21.15.38:0/2206017453 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f757406cc50 0x7f757406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.235+0000 7f75897fa640 1 -- 172.21.15.38:0/2206017453 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f757c0ad4c0 con 0x7f758c100bd0 2024-09-13T18:41:01.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.235+0000 7f758b7fe640 1 --2- 172.21.15.38:0/2206017453 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f757406cc50 0x7f757406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.235+0000 7f758b7fe640 1 --2- 172.21.15.38:0/2206017453 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f757406cc50 0x7f757406f110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f758c196c70 tx=0x7f7580005eb0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.239+0000 7f75897fa640 1 -- 172.21.15.38:0/2206017453 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f757c077480 con 0x7f758c100bd0 2024-09-13T18:41:01.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:00 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/4021370713' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T18:41:01.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:00 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2655227003' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T18:41:01.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:00 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1770992998' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:41:01.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.445+0000 7f7592473640 1 -- 172.21.15.38:0/2206017453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f758c100fb0 con 0x7f758c100bd0 2024-09-13T18:41:01.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.445+0000 7f75897fa640 1 -- 172.21.15.38:0/2206017453 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v37) v1 ==== 107+0+4846 (secure 0 0 0) 0x7f757c004e30 con 0x7f758c100bd0 2024-09-13T18:41:01.449 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:01.449 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34318,"name":"cephfs.smithi038.ubvgaq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6827/2694903367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2694903367},{"type":"v1","addr":"172.21.15.38:6827","nonce":2694903367}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:00.604402+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14484,"mds_1":24275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi038.dtnkqo","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.38:6829/1171569676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1171569676},{"type":"v1","addr":"172.21.15.38:6829","nonce":1171569676}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24275":{"gid":24275,"name":"cephfs.smithi149.doanhj","rank":1,"incarnation":6,"state":"up:stopping","state_seq":4,"addr":"172.21.15.149:6825/443686826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":443686826},{"type":"v1","addr":"172.21.15.149:6825","nonce":443686826}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:01.449 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 20 2024-09-13T18:41:01.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.447+0000 7f7592473640 1 -- 172.21.15.38:0/2206017453 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f757406cc50 msgr2=0x7f757406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.447+0000 7f7592473640 1 --2- 172.21.15.38:0/2206017453 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f757406cc50 0x7f757406f110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f758c196c70 tx=0x7f7580005eb0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.447+0000 7f7592473640 1 -- 172.21.15.38:0/2206017453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f758c100bd0 msgr2=0x7f758c19b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.447+0000 7f7592473640 1 --2- 172.21.15.38:0/2206017453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f758c100bd0 0x7f758c19b720 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f757c02aa50 tx=0x7f757c0055a0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.447+0000 7f7592473640 1 -- 172.21.15.38:0/2206017453 shutdown_connections 2024-09-13T18:41:01.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.447+0000 7f7592473640 1 --2- 172.21.15.38:0/2206017453 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f757406cc50 0x7f757406f110 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.448+0000 7f7592473640 1 --2- 172.21.15.38:0/2206017453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f758c1014f0 0x7f758c19bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.448+0000 7f7592473640 1 --2- 172.21.15.38:0/2206017453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f758c100bd0 0x7f758c19b720 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.448+0000 7f7592473640 1 -- 172.21.15.38:0/2206017453 >> 172.21.15.38:0/2206017453 conn(0x7f758c075750 msgr2=0x7f758c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:01.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.448+0000 7f7592473640 1 -- 172.21.15.38:0/2206017453 shutdown_connections 2024-09-13T18:41:01.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.448+0000 7f7592473640 1 -- 172.21.15.38:0/2206017453 wait complete. 2024-09-13T18:41:01.462 DEBUG:tasks.fs:max_mds reduced in epoch 20 2024-09-13T18:41:01.462 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-13T18:41:01.462 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-09-13T18:41:01.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.562+0000 7f4ed3de2640 1 -- 172.21.15.38:0/100702195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc0ff1d0 msgr2=0x7f4ecc10be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.562+0000 7f4ed3de2640 1 --2- 172.21.15.38:0/100702195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc0ff1d0 0x7f4ecc10be00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009880 tx=0x7f4ebc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.562+0000 7f4ed3de2640 1 -- 172.21.15.38:0/100702195 shutdown_connections 2024-09-13T18:41:01.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.562+0000 7f4ed3de2640 1 --2- 172.21.15.38:0/100702195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc0ff1d0 0x7f4ecc10be00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.562+0000 7f4ed3de2640 1 --2- 172.21.15.38:0/100702195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ecc0fe820 0x7f4ecc0fec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.562+0000 7f4ed3de2640 1 -- 172.21.15.38:0/100702195 >> 172.21.15.38:0/100702195 conn(0x7f4ecc0fa620 msgr2=0x7f4ecc0fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:01.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.562+0000 7f4ed3de2640 1 -- 172.21.15.38:0/100702195 shutdown_connections 2024-09-13T18:41:01.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.562+0000 7f4ed3de2640 1 -- 172.21.15.38:0/100702195 wait complete. 2024-09-13T18:41:01.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.563+0000 7f4ed3de2640 1 Processor -- start 2024-09-13T18:41:01.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.563+0000 7f4ed3de2640 1 -- start start 2024-09-13T18:41:01.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.563+0000 7f4ed3de2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ecc0fe820 0x7f4ecc19d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.563+0000 7f4ed3de2640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc0ff1d0 0x7f4ecc19deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.563+0000 7f4ed3de2640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc19e4d0 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.563+0000 7f4ed3de2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc197a50 con 0x7f4ecc0fe820 2024-09-13T18:41:01.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.563+0000 7f4ed137d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc0ff1d0 0x7f4ecc19deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.563+0000 7f4ed137d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc0ff1d0 0x7f4ecc19deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49792/0 (socket says 172.21.15.38:49792) 2024-09-13T18:41:01.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.563+0000 7f4ed137d640 1 -- 172.21.15.38:0/3366514285 learned_addr learned my addr 172.21.15.38:0/3366514285 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:01.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.563+0000 7f4ed1b7e640 1 --2- 172.21.15.38:0/3366514285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ecc0fe820 0x7f4ecc19d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.563+0000 7f4ed137d640 1 -- 172.21.15.38:0/3366514285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ecc0fe820 msgr2=0x7f4ecc19d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.563+0000 7f4ed137d640 1 --2- 172.21.15.38:0/3366514285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ecc0fe820 0x7f4ecc19d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.564+0000 7f4ed137d640 1 -- 172.21.15.38:0/3366514285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc009560 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.564+0000 7f4ed137d640 1 --2- 172.21.15.38:0/3366514285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc0ff1d0 0x7f4ecc19deb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc006010 tx=0x7f4ebc0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.564+0000 7f4ec2ffd640 1 -- 172.21.15.38:0/3366514285 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ebc004ba0 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.564+0000 7f4ec2ffd640 1 -- 172.21.15.38:0/3366514285 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4ebc004d00 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.564+0000 7f4ed3de2640 1 -- 172.21.15.38:0/3366514285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ecc197cd0 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.564+0000 7f4ec2ffd640 1 -- 172.21.15.38:0/3366514285 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ebc031910 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.564+0000 7f4ed3de2640 1 -- 172.21.15.38:0/3366514285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ecc1981d0 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.565+0000 7f4ed3de2640 1 -- 172.21.15.38:0/3366514285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc0688b0 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.565+0000 7f4ec2ffd640 1 -- 172.21.15.38:0/3366514285 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4ebc031af0 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.566+0000 7f4ec2ffd640 1 --2- 172.21.15.38:0/3366514285 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4eb806cc50 0x7f4eb806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.566+0000 7f4ec2ffd640 1 -- 172.21.15.38:0/3366514285 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f4ebc0ad7a0 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.566+0000 7f4ed1b7e640 1 --2- 172.21.15.38:0/3366514285 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4eb806cc50 0x7f4eb806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.566+0000 7f4ed1b7e640 1 --2- 172.21.15.38:0/3366514285 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4eb806cc50 0x7f4eb806f110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8005fd0 tx=0x7f4ec8005e20 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.573 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.570+0000 7f4ec2ffd640 1 -- 172.21.15.38:0/3366514285 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4ebc0777e0 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.785 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.782+0000 7f4ed3de2640 1 -- 172.21.15.38:0/3366514285 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f4ecc0fec00 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.782+0000 7f4ec2ffd640 1 -- 172.21.15.38:0/3366514285 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v37) v1 ==== 107+0+4051 (secure 0 0 0) 0x7f4ebc07ae00 con 0x7f4ecc0ff1d0 2024-09-13T18:41:01.786 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:01.786 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34318,"name":"cephfs.smithi038.ubvgaq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6827/2694903367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2694903367},{"type":"v1","addr":"172.21.15.38:6827","nonce":2694903367}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:21.675987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi038.dtnkqo","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.38:6829/1171569676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1171569676},{"type":"v1","addr":"172.21.15.38:6829","nonce":1171569676}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:01.786 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 21 2024-09-13T18:41:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.784+0000 7f4ed3de2640 1 -- 172.21.15.38:0/3366514285 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4eb806cc50 msgr2=0x7f4eb806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.784+0000 7f4ed3de2640 1 --2- 172.21.15.38:0/3366514285 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4eb806cc50 0x7f4eb806f110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8005fd0 tx=0x7f4ec8005e20 comp rx=0 tx=0).stop 2024-09-13T18:41:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.784+0000 7f4ed3de2640 1 -- 172.21.15.38:0/3366514285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc0ff1d0 msgr2=0x7f4ecc19deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.784+0000 7f4ed3de2640 1 --2- 172.21.15.38:0/3366514285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc0ff1d0 0x7f4ecc19deb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc006010 tx=0x7f4ebc0056e0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.784+0000 7f4ed3de2640 1 -- 172.21.15.38:0/3366514285 shutdown_connections 2024-09-13T18:41:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.784+0000 7f4ed3de2640 1 --2- 172.21.15.38:0/3366514285 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ecc0ff1d0 0x7f4ecc19deb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.784+0000 7f4ed3de2640 1 --2- 172.21.15.38:0/3366514285 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4eb806cc50 0x7f4eb806f110 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.788 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.784+0000 7f4ed3de2640 1 --2- 172.21.15.38:0/3366514285 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ecc0fe820 0x7f4ecc19d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.784+0000 7f4ed3de2640 1 -- 172.21.15.38:0/3366514285 >> 172.21.15.38:0/3366514285 conn(0x7f4ecc0fa620 msgr2=0x7f4ecc0fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:01.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.784+0000 7f4ed3de2640 1 -- 172.21.15.38:0/3366514285 shutdown_connections 2024-09-13T18:41:01.789 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.784+0000 7f4ed3de2640 1 -- 172.21.15.38:0/3366514285 wait complete. 2024-09-13T18:41:01.799 DEBUG:tasks.fs:max_mds reduced in epoch 21 2024-09-13T18:41:01.799 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-13T18:41:01.799 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-09-13T18:41:01.902 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.899+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2865742360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0104940 msgr2=0x7f2ee0104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.899+0000 7f2ee7c9c640 1 --2- 172.21.15.38:0/2865742360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0104940 0x7f2ee0104d20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009880 tx=0x7f2edc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.899+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2865742360 shutdown_connections 2024-09-13T18:41:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.899+0000 7f2ee7c9c640 1 --2- 172.21.15.38:0/2865742360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ee00fe930 0x7f2ee00fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.899+0000 7f2ee7c9c640 1 --2- 172.21.15.38:0/2865742360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0104940 0x7f2ee0104d20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.899+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2865742360 >> 172.21.15.38:0/2865742360 conn(0x7f2ee00fa5f0 msgr2=0x7f2ee00fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.899+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2865742360 shutdown_connections 2024-09-13T18:41:01.903 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.899+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2865742360 wait complete. 2024-09-13T18:41:01.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee7c9c640 1 Processor -- start 2024-09-13T18:41:01.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee7c9c640 1 -- start start 2024-09-13T18:41:01.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee7c9c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ee00fe930 0x7f2ee019b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee7c9c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0104940 0x7f2ee019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee7c9c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee01957c0 con 0x7f2ee0104940 2024-09-13T18:41:01.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee7c9c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee0195930 con 0x7f2ee00fe930 2024-09-13T18:41:01.905 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee5237640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0104940 0x7f2ee019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee5237640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0104940 0x7f2ee019bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49800/0 (socket says 172.21.15.38:49800) 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee5237640 1 -- 172.21.15.38:0/2504115720 learned_addr learned my addr 172.21.15.38:0/2504115720 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee5a38640 1 --2- 172.21.15.38:0/2504115720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ee00fe930 0x7f2ee019b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee5237640 1 -- 172.21.15.38:0/2504115720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ee00fe930 msgr2=0x7f2ee019b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee5237640 1 --2- 172.21.15.38:0/2504115720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ee00fe930 0x7f2ee019b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee5237640 1 -- 172.21.15.38:0/2504115720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc009560 con 0x7f2ee0104940 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.900+0000 7f2ee5237640 1 --2- 172.21.15.38:0/2504115720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0104940 0x7f2ee019bc20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000d6f0 tx=0x7f2ed000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.901+0000 7f2ed6ffd640 1 -- 172.21.15.38:0/2504115720 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ed0009a30 con 0x7f2ee0104940 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.901+0000 7f2ed6ffd640 1 -- 172.21.15.38:0/2504115720 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ed00054c0 con 0x7f2ee0104940 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.901+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2504115720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee0195c10 con 0x7f2ee0104940 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.901+0000 7f2ed6ffd640 1 -- 172.21.15.38:0/2504115720 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ed0004db0 con 0x7f2ee0104940 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.901+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2504115720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee0196170 con 0x7f2ee0104940 2024-09-13T18:41:01.906 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.902+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2504115720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee0100070 con 0x7f2ee0104940 2024-09-13T18:41:01.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.902+0000 7f2ed6ffd640 1 -- 172.21.15.38:0/2504115720 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2ed0004f10 con 0x7f2ee0104940 2024-09-13T18:41:01.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.903+0000 7f2ed6ffd640 1 --2- 172.21.15.38:0/2504115720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2ecc06cc50 0x7f2ecc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.903+0000 7f2ee5a38640 1 --2- 172.21.15.38:0/2504115720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2ecc06cc50 0x7f2ecc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.903+0000 7f2ed6ffd640 1 -- 172.21.15.38:0/2504115720 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f2ed008c0a0 con 0x7f2ee0104940 2024-09-13T18:41:01.907 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.903+0000 7f2ee5a38640 1 --2- 172.21.15.38:0/2504115720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2ecc06cc50 0x7f2ecc06f110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2edc005ab0 tx=0x7f2edc005a20 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.910 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:01.907+0000 7f2ed6ffd640 1 -- 172.21.15.38:0/2504115720 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2ed00560e0 con 0x7f2ee0104940 2024-09-13T18:41:02.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:01 smithi038 ceph-mon[91522]: pgmap v348: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:41:02.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:01 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1446361499' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T18:41:02.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:01 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2206017453' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T18:41:02.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:01 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3366514285' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T18:41:02.117 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.114+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2504115720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f2ee00fed90 con 0x7f2ee0104940 2024-09-13T18:41:02.118 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.115+0000 7f2ed6ffd640 1 -- 172.21.15.38:0/2504115720 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v37) v1 ==== 107+0+4830 (secure 0 0 0) 0x7f2ed0020090 con 0x7f2ee0104940 2024-09-13T18:41:02.118 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:02.119 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34318,"name":"cephfs.smithi038.ubvgaq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6827/2694903367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":2694903367},{"type":"v1","addr":"172.21.15.38:6827","nonce":2694903367}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44297,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/522640114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":522640114},{"type":"v1","addr":"172.21.15.149:6825","nonce":522640114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:21.675987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi038.dtnkqo","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.38:6829/1171569676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1171569676},{"type":"v1","addr":"172.21.15.38:6829","nonce":1171569676}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:02.119 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 22 2024-09-13T18:41:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.117+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2504115720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2ecc06cc50 msgr2=0x7f2ecc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.117+0000 7f2ee7c9c640 1 --2- 172.21.15.38:0/2504115720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2ecc06cc50 0x7f2ecc06f110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2edc005ab0 tx=0x7f2edc005a20 comp rx=0 tx=0).stop 2024-09-13T18:41:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.117+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2504115720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0104940 msgr2=0x7f2ee019bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.117+0000 7f2ee7c9c640 1 --2- 172.21.15.38:0/2504115720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0104940 0x7f2ee019bc20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000d6f0 tx=0x7f2ed000dbb0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.117+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2504115720 shutdown_connections 2024-09-13T18:41:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.117+0000 7f2ee7c9c640 1 --2- 172.21.15.38:0/2504115720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2ee0104940 0x7f2ee019bc20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.117+0000 7f2ee7c9c640 1 --2- 172.21.15.38:0/2504115720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f2ecc06cc50 0x7f2ecc06f110 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.117+0000 7f2ee7c9c640 1 --2- 172.21.15.38:0/2504115720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ee00fe930 0x7f2ee019b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.117+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2504115720 >> 172.21.15.38:0/2504115720 conn(0x7f2ee00fa5f0 msgr2=0x7f2ee00687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.117+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2504115720 shutdown_connections 2024-09-13T18:41:02.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.117+0000 7f2ee7c9c640 1 -- 172.21.15.38:0/2504115720 wait complete. 2024-09-13T18:41:02.131 DEBUG:tasks.fs:max_mds reduced in epoch 22 2024-09-13T18:41:02.131 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-13T18:41:02.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-09-13T18:41:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.231+0000 7fb4a335a640 1 -- 172.21.15.38:0/318575100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb49c104910 msgr2=0x7fb49c104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.231+0000 7fb4a335a640 1 --2- 172.21.15.38:0/318575100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb49c104910 0x7fb49c104cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb498009880 tx=0x7fb49802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.231+0000 7fb4a335a640 1 -- 172.21.15.38:0/318575100 shutdown_connections 2024-09-13T18:41:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.231+0000 7fb4a335a640 1 --2- 172.21.15.38:0/318575100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb49c0fe900 0x7fb49c0fed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.231+0000 7fb4a335a640 1 --2- 172.21.15.38:0/318575100 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb49c104910 0x7fb49c104cf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.236 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.231+0000 7fb4a335a640 1 -- 172.21.15.38:0/318575100 >> 172.21.15.38:0/318575100 conn(0x7fb49c075750 msgr2=0x7fb49c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.231+0000 7fb4a335a640 1 -- 172.21.15.38:0/318575100 shutdown_connections 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.231+0000 7fb4a335a640 1 -- 172.21.15.38:0/318575100 wait complete. 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.231+0000 7fb4a335a640 1 Processor -- start 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.231+0000 7fb4a335a640 1 -- start start 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a335a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb49c0fe900 0x7fb49c19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a335a640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb49c104910 0x7fb49c19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a335a640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c19c3a0 con 0x7fb49c104910 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a335a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c195920 con 0x7fb49c0fe900 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a08f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb49c104910 0x7fb49c19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a08f5640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb49c104910 0x7fb49c19bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47018/0 (socket says 172.21.15.38:47018) 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a08f5640 1 -- 172.21.15.38:0/3318255220 learned_addr learned my addr 172.21.15.38:0/3318255220 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a10f6640 1 --2- 172.21.15.38:0/3318255220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb49c0fe900 0x7fb49c19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:02.237 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a08f5640 1 -- 172.21.15.38:0/3318255220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb49c0fe900 msgr2=0x7fb49c19b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a08f5640 1 --2- 172.21.15.38:0/3318255220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb49c0fe900 0x7fb49c19b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a08f5640 1 -- 172.21.15.38:0/3318255220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb498009560 con 0x7fb49c104910 2024-09-13T18:41:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a10f6640 1 --2- 172.21.15.38:0/3318255220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb49c0fe900 0x7fb49c19b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a08f5640 1 --2- 172.21.15.38:0/3318255220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb49c104910 0x7fb49c19bd80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00b420 tx=0x7fb48c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4927fc640 1 -- 172.21.15.38:0/3318255220 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48c011800 con 0x7fb49c104910 2024-09-13T18:41:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4927fc640 1 -- 172.21.15.38:0/3318255220 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb48c011e00 con 0x7fb49c104910 2024-09-13T18:41:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a335a640 1 -- 172.21.15.38:0/3318255220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49c195c00 con 0x7fb49c104910 2024-09-13T18:41:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4927fc640 1 -- 172.21.15.38:0/3318255220 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48c00f2e0 con 0x7fb49c104910 2024-09-13T18:41:02.238 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.232+0000 7fb4a335a640 1 -- 172.21.15.38:0/3318255220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49c196160 con 0x7fb49c104910 2024-09-13T18:41:02.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.233+0000 7fb4a335a640 1 -- 172.21.15.38:0/3318255220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49c100040 con 0x7fb49c104910 2024-09-13T18:41:02.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.234+0000 7fb4927fc640 1 -- 172.21.15.38:0/3318255220 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb48c010380 con 0x7fb49c104910 2024-09-13T18:41:02.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.234+0000 7fb4927fc640 1 --2- 172.21.15.38:0/3318255220 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb48806cc50 0x7fb48806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:02.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.235+0000 7fb4a10f6640 1 --2- 172.21.15.38:0/3318255220 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb48806cc50 0x7fb48806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:02.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.235+0000 7fb4927fc640 1 -- 172.21.15.38:0/3318255220 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fb48c08c0b0 con 0x7fb49c104910 2024-09-13T18:41:02.239 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.235+0000 7fb4a10f6640 1 --2- 172.21.15.38:0/3318255220 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb48806cc50 0x7fb48806f110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb498006010 tx=0x7fb498005d50 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:02.242 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.239+0000 7fb4927fc640 1 -- 172.21.15.38:0/3318255220 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb48c055fd0 con 0x7fb49c104910 2024-09-13T18:41:02.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:01 smithi149 ceph-mon[76906]: pgmap v348: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:41:02.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:01 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1446361499' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-13T18:41:02.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:01 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2206017453' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T18:41:02.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:01 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3366514285' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T18:41:02.448 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.445+0000 7fb4a335a640 1 -- 172.21.15.38:0/3318255220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fb49c0fede0 con 0x7fb49c104910 2024-09-13T18:41:02.449 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.446+0000 7fb4927fc640 1 -- 172.21.15.38:0/3318255220 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v37) v1 ==== 107+0+4051 (secure 0 0 0) 0x7fb48c0595f0 con 0x7fb49c104910 2024-09-13T18:41:02.449 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:02.449 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44297,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/522640114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":522640114},{"type":"v1","addr":"172.21.15.149:6825","nonce":522640114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:21.675987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi038.dtnkqo","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.38:6829/1171569676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1171569676},{"type":"v1","addr":"172.21.15.38:6829","nonce":1171569676}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:02.450 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 23 2024-09-13T18:41:02.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.448+0000 7fb4a335a640 1 -- 172.21.15.38:0/3318255220 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb48806cc50 msgr2=0x7fb48806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.448+0000 7fb4a335a640 1 --2- 172.21.15.38:0/3318255220 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb48806cc50 0x7fb48806f110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb498006010 tx=0x7fb498005d50 comp rx=0 tx=0).stop 2024-09-13T18:41:02.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.448+0000 7fb4a335a640 1 -- 172.21.15.38:0/3318255220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb49c104910 msgr2=0x7fb49c19bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.448+0000 7fb4a335a640 1 --2- 172.21.15.38:0/3318255220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb49c104910 0x7fb49c19bd80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00b420 tx=0x7fb48c00b8e0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.451 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.448+0000 7fb4a335a640 1 -- 172.21.15.38:0/3318255220 shutdown_connections 2024-09-13T18:41:02.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.448+0000 7fb4a335a640 1 --2- 172.21.15.38:0/3318255220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb49c104910 0x7fb49c19bd80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.448+0000 7fb4a335a640 1 --2- 172.21.15.38:0/3318255220 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fb48806cc50 0x7fb48806f110 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.448+0000 7fb4a335a640 1 --2- 172.21.15.38:0/3318255220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb49c0fe900 0x7fb49c19b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.448+0000 7fb4a335a640 1 -- 172.21.15.38:0/3318255220 >> 172.21.15.38:0/3318255220 conn(0x7fb49c075750 msgr2=0x7fb49c0fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:02.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.448+0000 7fb4a335a640 1 -- 172.21.15.38:0/3318255220 shutdown_connections 2024-09-13T18:41:02.452 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.448+0000 7fb4a335a640 1 -- 172.21.15.38:0/3318255220 wait complete. 2024-09-13T18:41:02.462 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-09-13T18:41:02.462 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-13T18:41:02.462 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-09-13T18:41:02.567 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.562+0000 7fd523420640 1 -- 172.21.15.38:0/2502593854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd51c0fe8b0 msgr2=0x7fd51c0fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.562+0000 7fd523420640 1 --2- 172.21.15.38:0/2502593854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd51c0fe8b0 0x7fd51c0fed10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd510009880 tx=0x7fd51002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.562+0000 7fd523420640 1 -- 172.21.15.38:0/2502593854 shutdown_connections 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.562+0000 7fd523420640 1 --2- 172.21.15.38:0/2502593854 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd51c0fe8b0 0x7fd51c0fed10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.562+0000 7fd523420640 1 --2- 172.21.15.38:0/2502593854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd51c1048c0 0x7fd51c104ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.562+0000 7fd523420640 1 -- 172.21.15.38:0/2502593854 >> 172.21.15.38:0/2502593854 conn(0x7fd51c0fa570 msgr2=0x7fd51c0fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.562+0000 7fd523420640 1 -- 172.21.15.38:0/2502593854 shutdown_connections 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.562+0000 7fd523420640 1 -- 172.21.15.38:0/2502593854 wait complete. 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.563+0000 7fd523420640 1 Processor -- start 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.563+0000 7fd523420640 1 -- start start 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.563+0000 7fd523420640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd51c0fe8b0 0x7fd51c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.563+0000 7fd523420640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd51c1048c0 0x7fd51c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.563+0000 7fd523420640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c19b110 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.568 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.563+0000 7fd523420640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c194690 con 0x7fd51c1048c0 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.563+0000 7fd5211bc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd51c0fe8b0 0x7fd51c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.563+0000 7fd5211bc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd51c0fe8b0 0x7fd51c19a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47036/0 (socket says 172.21.15.38:47036) 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.563+0000 7fd5211bc640 1 -- 172.21.15.38:0/2361832476 learned_addr learned my addr 172.21.15.38:0/2361832476 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.563+0000 7fd5209bb640 1 --2- 172.21.15.38:0/2361832476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd51c1048c0 0x7fd51c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.564+0000 7fd5211bc640 1 -- 172.21.15.38:0/2361832476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd51c1048c0 msgr2=0x7fd51c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.564+0000 7fd5211bc640 1 --2- 172.21.15.38:0/2361832476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd51c1048c0 0x7fd51c19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.564+0000 7fd5211bc640 1 -- 172.21.15.38:0/2361832476 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd510009560 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.564+0000 7fd5209bb640 1 --2- 172.21.15.38:0/2361832476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd51c1048c0 0x7fd51c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.564+0000 7fd5211bc640 1 --2- 172.21.15.38:0/2361832476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd51c0fe8b0 0x7fd51c19a5b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd51800d6f0 tx=0x7fd51800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.564+0000 7fd50e7fc640 1 -- 172.21.15.38:0/2361832476 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd518009a30 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.564+0000 7fd523420640 1 -- 172.21.15.38:0/2361832476 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c194970 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.564+0000 7fd50e7fc640 1 -- 172.21.15.38:0/2361832476 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd5180054c0 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.564+0000 7fd50e7fc640 1 -- 172.21.15.38:0/2361832476 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd518004db0 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.569 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.564+0000 7fd523420640 1 -- 172.21.15.38:0/2361832476 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c194ed0 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.565+0000 7fd523420640 1 -- 172.21.15.38:0/2361832476 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51c0ffff0 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.565+0000 7fd50e7fc640 1 -- 172.21.15.38:0/2361832476 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd518004f30 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.566+0000 7fd50e7fc640 1 --2- 172.21.15.38:0/2361832476 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd50806cc00 0x7fd50806f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:02.570 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.566+0000 7fd5209bb640 1 --2- 172.21.15.38:0/2361832476 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd50806cc00 0x7fd50806f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:02.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.566+0000 7fd50e7fc640 1 -- 172.21.15.38:0/2361832476 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fd51808c170 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.571 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.567+0000 7fd5209bb640 1 --2- 172.21.15.38:0/2361832476 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd50806cc00 0x7fd50806f0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd510006010 tx=0x7fd510005d50 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:02.574 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.570+0000 7fd50e7fc640 1 -- 172.21.15.38:0/2361832476 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd518056130 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.783 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.780+0000 7fd523420640 1 -- 172.21.15.38:0/2361832476 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fd51c195bd0 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.784 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.781+0000 7fd50e7fc640 1 -- 172.21.15.38:0/2361832476 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v37) v1 ==== 107+0+4830 (secure 0 0 0) 0x7fd518059750 con 0x7fd51c0fe8b0 2024-09-13T18:41:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:02.784 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44297,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/522640114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":522640114},{"type":"v1","addr":"172.21.15.149:6825","nonce":522640114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:21.675987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi038.dtnkqo","rank":0,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.38:6829/1171569676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":1171569676},{"type":"v1","addr":"172.21.15.38:6829","nonce":1171569676}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:02.785 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 24 2024-09-13T18:41:02.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.783+0000 7fd523420640 1 -- 172.21.15.38:0/2361832476 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd50806cc00 msgr2=0x7fd50806f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.783+0000 7fd523420640 1 --2- 172.21.15.38:0/2361832476 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd50806cc00 0x7fd50806f0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd510006010 tx=0x7fd510005d50 comp rx=0 tx=0).stop 2024-09-13T18:41:02.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.783+0000 7fd523420640 1 -- 172.21.15.38:0/2361832476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd51c0fe8b0 msgr2=0x7fd51c19a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.783+0000 7fd523420640 1 --2- 172.21.15.38:0/2361832476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd51c0fe8b0 0x7fd51c19a5b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd51800d6f0 tx=0x7fd51800dbb0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.783+0000 7fd523420640 1 -- 172.21.15.38:0/2361832476 shutdown_connections 2024-09-13T18:41:02.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.783+0000 7fd523420640 1 --2- 172.21.15.38:0/2361832476 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd50806cc00 0x7fd50806f0c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.783+0000 7fd523420640 1 --2- 172.21.15.38:0/2361832476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd51c1048c0 0x7fd51c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.783+0000 7fd523420640 1 --2- 172.21.15.38:0/2361832476 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd51c0fe8b0 0x7fd51c19a5b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.783+0000 7fd523420640 1 -- 172.21.15.38:0/2361832476 >> 172.21.15.38:0/2361832476 conn(0x7fd51c0fa570 msgr2=0x7fd51c0fb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:02.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.783+0000 7fd523420640 1 -- 172.21.15.38:0/2361832476 shutdown_connections 2024-09-13T18:41:02.787 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.783+0000 7fd523420640 1 -- 172.21.15.38:0/2361832476 wait complete. 2024-09-13T18:41:02.797 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-09-13T18:41:02.847 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-13T18:41:02.847 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-09-13T18:41:02.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.948+0000 7f6ead079640 1 -- 172.21.15.38:0/2490389958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ea80fe4c0 msgr2=0x7f6ea80fe900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.948+0000 7f6ead079640 1 --2- 172.21.15.38:0/2490389958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ea80fe4c0 0x7f6ea80fe900 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0098b0 tx=0x7f6e9c02a4d0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.948+0000 7f6ead079640 1 -- 172.21.15.38:0/2490389958 shutdown_connections 2024-09-13T18:41:02.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.948+0000 7f6ead079640 1 --2- 172.21.15.38:0/2490389958 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ea80fe4c0 0x7f6ea80fe900 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.948+0000 7f6ead079640 1 --2- 172.21.15.38:0/2490389958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ea8100b80 0x7f6ea80fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.948+0000 7f6ead079640 1 -- 172.21.15.38:0/2490389958 >> 172.21.15.38:0/2490389958 conn(0x7f6ea80f9db0 msgr2=0x7f6ea80fc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:02.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.948+0000 7f6ead079640 1 -- 172.21.15.38:0/2490389958 shutdown_connections 2024-09-13T18:41:02.952 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.948+0000 7f6ead079640 1 -- 172.21.15.38:0/2490389958 wait complete. 2024-09-13T18:41:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.949+0000 7f6ead079640 1 Processor -- start 2024-09-13T18:41:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.949+0000 7f6ead079640 1 -- start start 2024-09-13T18:41:02.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.949+0000 7f6ead079640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ea80fe4c0 0x7f6ea8197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.949+0000 7f6ead079640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ea8100b80 0x7f6ea8198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.949+0000 7f6ead079640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea81989c0 con 0x7f6ea80fe4c0 2024-09-13T18:41:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.949+0000 7f6ead079640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea819c720 con 0x7f6ea8100b80 2024-09-13T18:41:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6ea6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ea80fe4c0 0x7f6ea8197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6ea6d9d640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ea80fe4c0 0x7f6ea8197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47060/0 (socket says 172.21.15.38:47060) 2024-09-13T18:41:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6ea6d9d640 1 -- 172.21.15.38:0/2350752908 learned_addr learned my addr 172.21.15.38:0/2350752908 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6ea659c640 1 --2- 172.21.15.38:0/2350752908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ea8100b80 0x7f6ea8198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6ea6d9d640 1 -- 172.21.15.38:0/2350752908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ea8100b80 msgr2=0x7f6ea8198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6ea6d9d640 1 --2- 172.21.15.38:0/2350752908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ea8100b80 0x7f6ea8198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6ea6d9d640 1 -- 172.21.15.38:0/2350752908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c009560 con 0x7f6ea80fe4c0 2024-09-13T18:41:02.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6ea6d9d640 1 --2- 172.21.15.38:0/2350752908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ea80fe4c0 0x7f6ea8197df0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800e970 tx=0x7f6e9800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:02.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6e8ffff640 1 -- 172.21.15.38:0/2350752908 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e9800cc90 con 0x7f6ea80fe4c0 2024-09-13T18:41:02.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6e8ffff640 1 -- 172.21.15.38:0/2350752908 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e9800cdf0 con 0x7f6ea80fe4c0 2024-09-13T18:41:02.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6ead079640 1 -- 172.21.15.38:0/2350752908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea819ca00 con 0x7f6ea80fe4c0 2024-09-13T18:41:02.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6e8ffff640 1 -- 172.21.15.38:0/2350752908 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e98010430 con 0x7f6ea80fe4c0 2024-09-13T18:41:02.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.950+0000 7f6ead079640 1 -- 172.21.15.38:0/2350752908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea819cf30 con 0x7f6ea80fe4c0 2024-09-13T18:41:02.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.951+0000 7f6ead079640 1 -- 172.21.15.38:0/2350752908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea80ff230 con 0x7f6ea80fe4c0 2024-09-13T18:41:02.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.952+0000 7f6e8ffff640 1 -- 172.21.15.38:0/2350752908 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6e980046c0 con 0x7f6ea80fe4c0 2024-09-13T18:41:02.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.952+0000 7f6e8ffff640 1 --2- 172.21.15.38:0/2350752908 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6e9006cc50 0x7f6e9006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:02.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.952+0000 7f6e8ffff640 1 -- 172.21.15.38:0/2350752908 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f6e98014070 con 0x7f6ea80fe4c0 2024-09-13T18:41:02.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.952+0000 7f6ea659c640 1 --2- 172.21.15.38:0/2350752908 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6e9006cc50 0x7f6e9006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:02.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.953+0000 7f6ea659c640 1 --2- 172.21.15.38:0/2350752908 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6e9006cc50 0x7f6e9006f110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c000c00 tx=0x7f6e9c005a20 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:02.959 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:02.956+0000 7f6e8ffff640 1 -- 172.21.15.38:0/2350752908 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6e98056bd0 con 0x7f6ea80fe4c0 2024-09-13T18:41:03.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:02 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2504115720' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T18:41:03.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:02 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3318255220' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T18:41:03.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:02 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2361832476' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T18:41:03.167 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.164+0000 7f6ead079640 1 -- 172.21.15.38:0/2350752908 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f6ea80fe900 con 0x7f6ea80fe4c0 2024-09-13T18:41:03.168 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.164+0000 7f6e8ffff640 1 -- 172.21.15.38:0/2350752908 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v37) v1 ==== 107+0+4041 (secure 0 0 0) 0x7f6e9805a1f0 con 0x7f6ea80fe4c0 2024-09-13T18:41:03.168 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:03.168 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44297,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/522640114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":522640114},{"type":"v1","addr":"172.21.15.149:6825","nonce":522640114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:50.314495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:03.169 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 25 2024-09-13T18:41:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.167+0000 7f6ead079640 1 -- 172.21.15.38:0/2350752908 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6e9006cc50 msgr2=0x7f6e9006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.170 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.167+0000 7f6ead079640 1 --2- 172.21.15.38:0/2350752908 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6e9006cc50 0x7f6e9006f110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c000c00 tx=0x7f6e9c005a20 comp rx=0 tx=0).stop 2024-09-13T18:41:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.167+0000 7f6ead079640 1 -- 172.21.15.38:0/2350752908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ea80fe4c0 msgr2=0x7f6ea8197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.167+0000 7f6ead079640 1 --2- 172.21.15.38:0/2350752908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ea80fe4c0 0x7f6ea8197df0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800e970 tx=0x7f6e9800ed70 comp rx=0 tx=0).stop 2024-09-13T18:41:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.167+0000 7f6ead079640 1 -- 172.21.15.38:0/2350752908 shutdown_connections 2024-09-13T18:41:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.167+0000 7f6ead079640 1 --2- 172.21.15.38:0/2350752908 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6e9006cc50 0x7f6e9006f110 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.167+0000 7f6ead079640 1 --2- 172.21.15.38:0/2350752908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ea8100b80 0x7f6ea8198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.167+0000 7f6ead079640 1 --2- 172.21.15.38:0/2350752908 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ea80fe4c0 0x7f6ea8197df0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.167+0000 7f6ead079640 1 -- 172.21.15.38:0/2350752908 >> 172.21.15.38:0/2350752908 conn(0x7f6ea80f9db0 msgr2=0x7f6ea80faf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.167+0000 7f6ead079640 1 -- 172.21.15.38:0/2350752908 shutdown_connections 2024-09-13T18:41:03.171 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.167+0000 7f6ead079640 1 -- 172.21.15.38:0/2350752908 wait complete. 2024-09-13T18:41:03.181 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-09-13T18:41:03.181 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-13T18:41:03.181 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-09-13T18:41:03.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:02 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2504115720' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T18:41:03.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:02 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3318255220' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T18:41:03.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:02 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2361832476' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T18:41:03.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.281+0000 7f2567241640 1 -- 172.21.15.38:0/3766972983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2560100c00 msgr2=0x7f2560100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.281+0000 7f2567241640 1 --2- 172.21.15.38:0/3766972983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2560100c00 0x7f2560100fe0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2554009880 tx=0x7f255402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.281+0000 7f2567241640 1 -- 172.21.15.38:0/3766972983 shutdown_connections 2024-09-13T18:41:03.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.281+0000 7f2567241640 1 --2- 172.21.15.38:0/3766972983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2560101520 0x7f2560109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.281+0000 7f2567241640 1 --2- 172.21.15.38:0/3766972983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2560100c00 0x7f2560100fe0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.281+0000 7f2567241640 1 -- 172.21.15.38:0/3766972983 >> 172.21.15.38:0/3766972983 conn(0x7f25600fa5f0 msgr2=0x7f25600fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:03.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.281+0000 7f2567241640 1 -- 172.21.15.38:0/3766972983 shutdown_connections 2024-09-13T18:41:03.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.281+0000 7f2567241640 1 -- 172.21.15.38:0/3766972983 wait complete. 2024-09-13T18:41:03.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.282+0000 7f2567241640 1 Processor -- start 2024-09-13T18:41:03.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.282+0000 7f2567241640 1 -- start start 2024-09-13T18:41:03.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.282+0000 7f2567241640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2560100c00 0x7f256019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.282+0000 7f2567241640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2560101520 0x7f256019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.282+0000 7f2567241640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256019c3c0 con 0x7f2560100c00 2024-09-13T18:41:03.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.282+0000 7f2567241640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2560195940 con 0x7f2560101520 2024-09-13T18:41:03.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.282+0000 7f2564fdd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2560100c00 0x7f256019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.282+0000 7f2564fdd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2560100c00 0x7f256019b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47088/0 (socket says 172.21.15.38:47088) 2024-09-13T18:41:03.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.282+0000 7f2564fdd640 1 -- 172.21.15.38:0/2546100838 learned_addr learned my addr 172.21.15.38:0/2546100838 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:03.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.282+0000 7f255ffff640 1 --2- 172.21.15.38:0/2546100838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2560101520 0x7f256019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.282+0000 7f2564fdd640 1 -- 172.21.15.38:0/2546100838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2560101520 msgr2=0x7f256019bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.290 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.282+0000 7f2564fdd640 1 --2- 172.21.15.38:0/2546100838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2560101520 0x7f256019bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.283+0000 7f2564fdd640 1 -- 172.21.15.38:0/2546100838 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554009560 con 0x7f2560100c00 2024-09-13T18:41:03.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.283+0000 7f255ffff640 1 --2- 172.21.15.38:0/2546100838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2560101520 0x7f256019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:03.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.283+0000 7f2564fdd640 1 --2- 172.21.15.38:0/2546100838 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2560100c00 0x7f256019b860 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2554006010 tx=0x7f2554004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:03.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.283+0000 7f255dffb640 1 -- 172.21.15.38:0/2546100838 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2554005330 con 0x7f2560100c00 2024-09-13T18:41:03.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.283+0000 7f255dffb640 1 -- 172.21.15.38:0/2546100838 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2554005490 con 0x7f2560100c00 2024-09-13T18:41:03.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.283+0000 7f2567241640 1 -- 172.21.15.38:0/2546100838 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2560195bc0 con 0x7f2560100c00 2024-09-13T18:41:03.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.283+0000 7f255dffb640 1 -- 172.21.15.38:0/2546100838 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2554031990 con 0x7f2560100c00 2024-09-13T18:41:03.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.283+0000 7f2567241640 1 -- 172.21.15.38:0/2546100838 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25601960c0 con 0x7f2560100c00 2024-09-13T18:41:03.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.284+0000 7f2567241640 1 -- 172.21.15.38:0/2546100838 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25600688b0 con 0x7f2560100c00 2024-09-13T18:41:03.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.285+0000 7f255dffb640 1 -- 172.21.15.38:0/2546100838 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2554003c00 con 0x7f2560100c00 2024-09-13T18:41:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.285+0000 7f255dffb640 1 --2- 172.21.15.38:0/2546100838 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f255006cc50 0x7f255006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.285+0000 7f255dffb640 1 -- 172.21.15.38:0/2546100838 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f25540ad860 con 0x7f2560100c00 2024-09-13T18:41:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.285+0000 7f255ffff640 1 --2- 172.21.15.38:0/2546100838 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f255006cc50 0x7f255006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.285+0000 7f255ffff640 1 --2- 172.21.15.38:0/2546100838 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f255006cc50 0x7f255006f110 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f254c006fd0 tx=0x7f254c008040 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:03.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.289+0000 7f255dffb640 1 -- 172.21.15.38:0/2546100838 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2554077820 con 0x7f2560100c00 2024-09-13T18:41:03.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.500+0000 7f2567241640 1 -- 172.21.15.38:0/2546100838 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f2560104360 con 0x7f2560100c00 2024-09-13T18:41:03.504 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.501+0000 7f255dffb640 1 -- 172.21.15.38:0/2546100838 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v37) v1 ==== 107+0+4052 (secure 0 0 0) 0x7f255407ae40 con 0x7f2560100c00 2024-09-13T18:41:03.505 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:03.505 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44297,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/522640114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":522640114},{"type":"v1","addr":"172.21.15.149:6825","nonce":522640114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:50.322306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34352},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34352":{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:03.505 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 26 2024-09-13T18:41:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.503+0000 7f2567241640 1 -- 172.21.15.38:0/2546100838 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f255006cc50 msgr2=0x7f255006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.503+0000 7f2567241640 1 --2- 172.21.15.38:0/2546100838 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f255006cc50 0x7f255006f110 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f254c006fd0 tx=0x7f254c008040 comp rx=0 tx=0).stop 2024-09-13T18:41:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.503+0000 7f2567241640 1 -- 172.21.15.38:0/2546100838 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2560100c00 msgr2=0x7f256019b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.503+0000 7f2567241640 1 --2- 172.21.15.38:0/2546100838 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2560100c00 0x7f256019b860 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2554006010 tx=0x7f2554004cb0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.503+0000 7f2567241640 1 -- 172.21.15.38:0/2546100838 shutdown_connections 2024-09-13T18:41:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.503+0000 7f2567241640 1 --2- 172.21.15.38:0/2546100838 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f255006cc50 0x7f255006f110 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.503+0000 7f2567241640 1 --2- 172.21.15.38:0/2546100838 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2560101520 0x7f256019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.503+0000 7f2567241640 1 --2- 172.21.15.38:0/2546100838 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2560100c00 0x7f256019b860 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.507 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.503+0000 7f2567241640 1 -- 172.21.15.38:0/2546100838 >> 172.21.15.38:0/2546100838 conn(0x7f25600fa5f0 msgr2=0x7f2560101ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:03.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.503+0000 7f2567241640 1 -- 172.21.15.38:0/2546100838 shutdown_connections 2024-09-13T18:41:03.508 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.503+0000 7f2567241640 1 -- 172.21.15.38:0/2546100838 wait complete. 2024-09-13T18:41:03.518 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-09-13T18:41:03.518 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-13T18:41:03.518 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-09-13T18:41:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.617+0000 7f39ff79c640 1 -- 172.21.15.38:0/1310822772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39f80ffa30 msgr2=0x7f39f80ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.617+0000 7f39ff79c640 1 --2- 172.21.15.38:0/1310822772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39f80ffa30 0x7f39f80ffe90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009880 tx=0x7f39e802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.617+0000 7f39ff79c640 1 -- 172.21.15.38:0/1310822772 shutdown_connections 2024-09-13T18:41:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.617+0000 7f39ff79c640 1 --2- 172.21.15.38:0/1310822772 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39f80ffa30 0x7f39f80ffe90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.617+0000 7f39ff79c640 1 --2- 172.21.15.38:0/1310822772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39f8105a40 0x7f39f8105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.617+0000 7f39ff79c640 1 -- 172.21.15.38:0/1310822772 >> 172.21.15.38:0/1310822772 conn(0x7f39f80fb710 msgr2=0x7f39f80fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.617+0000 7f39ff79c640 1 -- 172.21.15.38:0/1310822772 shutdown_connections 2024-09-13T18:41:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.617+0000 7f39ff79c640 1 -- 172.21.15.38:0/1310822772 wait complete. 2024-09-13T18:41:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.618+0000 7f39ff79c640 1 Processor -- start 2024-09-13T18:41:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.618+0000 7f39ff79c640 1 -- start start 2024-09-13T18:41:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.618+0000 7f39ff79c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39f80ffa30 0x7f39f819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.618+0000 7f39ff79c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39f8105a40 0x7f39f819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.618+0000 7f39ff79c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f819c330 con 0x7f39f8105a40 2024-09-13T18:41:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.618+0000 7f39ff79c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f81958b0 con 0x7f39f80ffa30 2024-09-13T18:41:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.618+0000 7f39fcd37640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39f8105a40 0x7f39f819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.618+0000 7f39fcd37640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39f8105a40 0x7f39f819bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47112/0 (socket says 172.21.15.38:47112) 2024-09-13T18:41:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.618+0000 7f39fcd37640 1 -- 172.21.15.38:0/3052848499 learned_addr learned my addr 172.21.15.38:0/3052848499 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.618+0000 7f39fcd37640 1 -- 172.21.15.38:0/3052848499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39f80ffa30 msgr2=0x7f39f819b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.618+0000 7f39fcd37640 1 --2- 172.21.15.38:0/3052848499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39f80ffa30 0x7f39f819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.619+0000 7f39fcd37640 1 -- 172.21.15.38:0/3052848499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8009560 con 0x7f39f8105a40 2024-09-13T18:41:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.619+0000 7f39fcd37640 1 --2- 172.21.15.38:0/3052848499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39f8105a40 0x7f39f819bd10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f39e8006010 tx=0x7f39e80056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.619+0000 7f39ee7fc640 1 -- 172.21.15.38:0/3052848499 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e8004ba0 con 0x7f39f8105a40 2024-09-13T18:41:03.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.619+0000 7f39ee7fc640 1 -- 172.21.15.38:0/3052848499 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f39e8004d00 con 0x7f39f8105a40 2024-09-13T18:41:03.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.619+0000 7f39ff79c640 1 -- 172.21.15.38:0/3052848499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f8195b30 con 0x7f39f8105a40 2024-09-13T18:41:03.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.619+0000 7f39ee7fc640 1 -- 172.21.15.38:0/3052848499 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e8031910 con 0x7f39f8105a40 2024-09-13T18:41:03.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.619+0000 7f39ff79c640 1 -- 172.21.15.38:0/3052848499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f8196030 con 0x7f39f8105a40 2024-09-13T18:41:03.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.620+0000 7f39ff79c640 1 -- 172.21.15.38:0/3052848499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f8101170 con 0x7f39f8105a40 2024-09-13T18:41:03.626 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.620+0000 7f39ee7fc640 1 -- 172.21.15.38:0/3052848499 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f39e8031af0 con 0x7f39f8105a40 2024-09-13T18:41:03.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.621+0000 7f39ee7fc640 1 --2- 172.21.15.38:0/3052848499 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f39e406cc50 0x7f39e406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.621+0000 7f39ee7fc640 1 -- 172.21.15.38:0/3052848499 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f39e80ad790 con 0x7f39f8105a40 2024-09-13T18:41:03.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.621+0000 7f39fd538640 1 --2- 172.21.15.38:0/3052848499 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f39e406cc50 0x7f39e406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.627 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.621+0000 7f39fd538640 1 --2- 172.21.15.38:0/3052848499 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f39e406cc50 0x7f39e406f110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f39f4009710 tx=0x7f39f4006c90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:03.628 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.625+0000 7f39ee7fc640 1 -- 172.21.15.38:0/3052848499 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f39e80777d0 con 0x7f39f8105a40 2024-09-13T18:41:03.835 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.832+0000 7f39ff79c640 1 -- 172.21.15.38:0/3052848499 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f39f8107fc0 con 0x7f39f8105a40 2024-09-13T18:41:03.836 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.832+0000 7f39ee7fc640 1 -- 172.21.15.38:0/3052848499 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v37) v1 ==== 107+0+4055 (secure 0 0 0) 0x7f39e807adf0 con 0x7f39f8105a40 2024-09-13T18:41:03.836 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:03.836 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44297,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/522640114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":522640114},{"type":"v1","addr":"172.21.15.149:6825","nonce":522640114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:57.884353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34352},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34352":{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":26,"state":"up:reconnect","state_seq":6,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:03.836 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 27 2024-09-13T18:41:03.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.834+0000 7f39ff79c640 1 -- 172.21.15.38:0/3052848499 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f39e406cc50 msgr2=0x7f39e406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.834+0000 7f39ff79c640 1 --2- 172.21.15.38:0/3052848499 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f39e406cc50 0x7f39e406f110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f39f4009710 tx=0x7f39f4006c90 comp rx=0 tx=0).stop 2024-09-13T18:41:03.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.834+0000 7f39ff79c640 1 -- 172.21.15.38:0/3052848499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39f8105a40 msgr2=0x7f39f819bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.834+0000 7f39ff79c640 1 --2- 172.21.15.38:0/3052848499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39f8105a40 0x7f39f819bd10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f39e8006010 tx=0x7f39e80056e0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.834+0000 7f39ff79c640 1 -- 172.21.15.38:0/3052848499 shutdown_connections 2024-09-13T18:41:03.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.834+0000 7f39ff79c640 1 --2- 172.21.15.38:0/3052848499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f39f8105a40 0x7f39f819bd10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.834+0000 7f39ff79c640 1 --2- 172.21.15.38:0/3052848499 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f39e406cc50 0x7f39e406f110 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.834+0000 7f39ff79c640 1 --2- 172.21.15.38:0/3052848499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39f80ffa30 0x7f39f819b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.838 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.834+0000 7f39ff79c640 1 -- 172.21.15.38:0/3052848499 >> 172.21.15.38:0/3052848499 conn(0x7f39f80fb710 msgr2=0x7f39f80fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:03.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.834+0000 7f39ff79c640 1 -- 172.21.15.38:0/3052848499 shutdown_connections 2024-09-13T18:41:03.839 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.834+0000 7f39ff79c640 1 -- 172.21.15.38:0/3052848499 wait complete. 2024-09-13T18:41:03.849 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-09-13T18:41:03.849 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-13T18:41:03.849 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-09-13T18:41:03.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.949+0000 7fe207f25640 1 -- 172.21.15.38:0/260725091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2000ffa30 msgr2=0x7fe2000ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.949+0000 7fe207f25640 1 --2- 172.21.15.38:0/260725091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2000ffa30 0x7fe2000ffe90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009880 tx=0x7fe1f002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.949+0000 7fe207f25640 1 -- 172.21.15.38:0/260725091 shutdown_connections 2024-09-13T18:41:03.954 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.949+0000 7fe207f25640 1 --2- 172.21.15.38:0/260725091 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2000ffa30 0x7fe2000ffe90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.949+0000 7fe207f25640 1 --2- 172.21.15.38:0/260725091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe200105a40 0x7fe200105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.949+0000 7fe207f25640 1 -- 172.21.15.38:0/260725091 >> 172.21.15.38:0/260725091 conn(0x7fe2000fb710 msgr2=0x7fe2000fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.949+0000 7fe207f25640 1 -- 172.21.15.38:0/260725091 shutdown_connections 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.949+0000 7fe207f25640 1 -- 172.21.15.38:0/260725091 wait complete. 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe207f25640 1 Processor -- start 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe207f25640 1 -- start start 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe207f25640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2000ffa30 0x7fe20019b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe207f25640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe200105a40 0x7fe20019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe207f25640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2001957f0 con 0x7fe200105a40 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe207f25640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe200195960 con 0x7fe2000ffa30 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe2054c0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe200105a40 0x7fe20019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe2054c0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe200105a40 0x7fe20019bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47138/0 (socket says 172.21.15.38:47138) 2024-09-13T18:41:03.955 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe2054c0640 1 -- 172.21.15.38:0/1361030118 learned_addr learned my addr 172.21.15.38:0/1361030118 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe205cc1640 1 --2- 172.21.15.38:0/1361030118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2000ffa30 0x7fe20019b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe2054c0640 1 -- 172.21.15.38:0/1361030118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2000ffa30 msgr2=0x7fe20019b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe2054c0640 1 --2- 172.21.15.38:0/1361030118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2000ffa30 0x7fe20019b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe2054c0640 1 -- 172.21.15.38:0/1361030118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f0009560 con 0x7fe200105a40 2024-09-13T18:41:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.950+0000 7fe2054c0640 1 --2- 172.21.15.38:0/1361030118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe200105a40 0x7fe20019bc50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0006010 tx=0x7fe1f00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.951+0000 7fe1f6ffd640 1 -- 172.21.15.38:0/1361030118 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1f0004ba0 con 0x7fe200105a40 2024-09-13T18:41:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.951+0000 7fe1f6ffd640 1 -- 172.21.15.38:0/1361030118 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1f0004d00 con 0x7fe200105a40 2024-09-13T18:41:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.951+0000 7fe207f25640 1 -- 172.21.15.38:0/1361030118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe200195be0 con 0x7fe200105a40 2024-09-13T18:41:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.951+0000 7fe1f6ffd640 1 -- 172.21.15.38:0/1361030118 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1f0031910 con 0x7fe200105a40 2024-09-13T18:41:03.956 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.951+0000 7fe207f25640 1 -- 172.21.15.38:0/1361030118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2001960e0 con 0x7fe200105a40 2024-09-13T18:41:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.952+0000 7fe207f25640 1 -- 172.21.15.38:0/1361030118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe200101170 con 0x7fe200105a40 2024-09-13T18:41:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.952+0000 7fe1f6ffd640 1 -- 172.21.15.38:0/1361030118 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe1f0031af0 con 0x7fe200105a40 2024-09-13T18:41:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.953+0000 7fe1f6ffd640 1 --2- 172.21.15.38:0/1361030118 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe1ec06cc50 0x7fe1ec06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.953+0000 7fe1f6ffd640 1 -- 172.21.15.38:0/1361030118 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fe1f00ad7a0 con 0x7fe200105a40 2024-09-13T18:41:03.957 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.953+0000 7fe205cc1640 1 --2- 172.21.15.38:0/1361030118 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe1ec06cc50 0x7fe1ec06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.958 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.953+0000 7fe205cc1640 1 --2- 172.21.15.38:0/1361030118 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe1ec06cc50 0x7fe1ec06f110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc005c40 tx=0x7fe1fc00a780 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:03.960 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:03.957+0000 7fe1f6ffd640 1 -- 172.21.15.38:0/1361030118 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe1f00777e0 con 0x7fe200105a40 2024-09-13T18:41:04.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.170+0000 7fe207f25640 1 -- 172.21.15.38:0/1361030118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fe2000ffe90 con 0x7fe200105a40 2024-09-13T18:41:04.174 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.171+0000 7fe1f6ffd640 1 -- 172.21.15.38:0/1361030118 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v37) v1 ==== 107+0+4052 (secure 0 0 0) 0x7fe1f007ae00 con 0x7fe200105a40 2024-09-13T18:41:04.175 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:04.175 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44297,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/522640114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":522640114},{"type":"v1","addr":"172.21.15.149:6825","nonce":522640114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:58.886220+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34352},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34352":{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:04.175 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 28 2024-09-13T18:41:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.173+0000 7fe207f25640 1 -- 172.21.15.38:0/1361030118 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe1ec06cc50 msgr2=0x7fe1ec06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.173+0000 7fe207f25640 1 --2- 172.21.15.38:0/1361030118 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe1ec06cc50 0x7fe1ec06f110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc005c40 tx=0x7fe1fc00a780 comp rx=0 tx=0).stop 2024-09-13T18:41:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.173+0000 7fe207f25640 1 -- 172.21.15.38:0/1361030118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe200105a40 msgr2=0x7fe20019bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.173+0000 7fe207f25640 1 --2- 172.21.15.38:0/1361030118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe200105a40 0x7fe20019bc50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0006010 tx=0x7fe1f00056e0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.173+0000 7fe207f25640 1 -- 172.21.15.38:0/1361030118 shutdown_connections 2024-09-13T18:41:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.173+0000 7fe207f25640 1 --2- 172.21.15.38:0/1361030118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe200105a40 0x7fe20019bc50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.173+0000 7fe207f25640 1 --2- 172.21.15.38:0/1361030118 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fe1ec06cc50 0x7fe1ec06f110 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.173+0000 7fe207f25640 1 --2- 172.21.15.38:0/1361030118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe2000ffa30 0x7fe20019b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.173+0000 7fe207f25640 1 -- 172.21.15.38:0/1361030118 >> 172.21.15.38:0/1361030118 conn(0x7fe2000fb710 msgr2=0x7fe2000fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:04.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.173+0000 7fe207f25640 1 -- 172.21.15.38:0/1361030118 shutdown_connections 2024-09-13T18:41:04.178 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.173+0000 7fe207f25640 1 -- 172.21.15.38:0/1361030118 wait complete. 2024-09-13T18:41:04.186 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:03 smithi038 ceph-mon[91522]: pgmap v349: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:41:04.186 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:03 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2350752908' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T18:41:04.186 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:03 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2546100838' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T18:41:04.187 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:03 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3052848499' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T18:41:04.188 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-09-13T18:41:04.188 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-13T18:41:04.188 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-09-13T18:41:04.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:04 smithi149 ceph-mon[76906]: pgmap v349: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:41:04.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:04 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2350752908' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T18:41:04.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:04 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2546100838' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T18:41:04.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:04 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3052848499' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T18:41:04.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.288+0000 7f364874c640 1 -- 172.21.15.38:0/60765765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3640101520 msgr2=0x7f3640109a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.288+0000 7f364874c640 1 --2- 172.21.15.38:0/60765765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3640101520 0x7f3640109a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3630009880 tx=0x7f363002a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.288+0000 7f364874c640 1 -- 172.21.15.38:0/60765765 shutdown_connections 2024-09-13T18:41:04.293 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.288+0000 7f364874c640 1 --2- 172.21.15.38:0/60765765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3640101520 0x7f3640109a00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.288+0000 7f364874c640 1 --2- 172.21.15.38:0/60765765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3640100c00 0x7f3640100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.288+0000 7f364874c640 1 -- 172.21.15.38:0/60765765 >> 172.21.15.38:0/60765765 conn(0x7f36400fa5f0 msgr2=0x7f36400fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.288+0000 7f364874c640 1 -- 172.21.15.38:0/60765765 shutdown_connections 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.288+0000 7f364874c640 1 -- 172.21.15.38:0/60765765 wait complete. 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f364874c640 1 Processor -- start 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f364874c640 1 -- start start 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f364874c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3640100c00 0x7f36400fe850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f364874c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3640101520 0x7f36400fed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f364874c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36400ff2d0 con 0x7f3640100c00 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f364874c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36400ff440 con 0x7f3640101520 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f36464e8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3640100c00 0x7f36400fe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f36464e8640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3640100c00 0x7f36400fe850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47156/0 (socket says 172.21.15.38:47156) 2024-09-13T18:41:04.294 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f36464e8640 1 -- 172.21.15.38:0/1376117782 learned_addr learned my addr 172.21.15.38:0/1376117782 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:04.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f3645ce7640 1 --2- 172.21.15.38:0/1376117782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3640101520 0x7f36400fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f36464e8640 1 -- 172.21.15.38:0/1376117782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3640101520 msgr2=0x7f36400fed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f36464e8640 1 --2- 172.21.15.38:0/1376117782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3640101520 0x7f36400fed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.289+0000 7f36464e8640 1 -- 172.21.15.38:0/1376117782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630009560 con 0x7f3640100c00 2024-09-13T18:41:04.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.290+0000 7f36464e8640 1 --2- 172.21.15.38:0/1376117782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3640100c00 0x7f36400fe850 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f363c00c8f0 tx=0x7f363c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.290+0000 7f36377fe640 1 -- 172.21.15.38:0/1376117782 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f363c007b80 con 0x7f3640100c00 2024-09-13T18:41:04.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.290+0000 7f36377fe640 1 -- 172.21.15.38:0/1376117782 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f363c007ce0 con 0x7f3640100c00 2024-09-13T18:41:04.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.290+0000 7f364874c640 1 -- 172.21.15.38:0/1376117782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36401a1c00 con 0x7f3640100c00 2024-09-13T18:41:04.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.290+0000 7f36377fe640 1 -- 172.21.15.38:0/1376117782 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f363c00f450 con 0x7f3640100c00 2024-09-13T18:41:04.295 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.290+0000 7f364874c640 1 -- 172.21.15.38:0/1376117782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36401a1f70 con 0x7f3640100c00 2024-09-13T18:41:04.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.291+0000 7f364874c640 1 -- 172.21.15.38:0/1376117782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36400688b0 con 0x7f3640100c00 2024-09-13T18:41:04.296 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.291+0000 7f36377fe640 1 -- 172.21.15.38:0/1376117782 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f363c004f10 con 0x7f3640100c00 2024-09-13T18:41:04.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.292+0000 7f36377fe640 1 --2- 172.21.15.38:0/1376117782 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f362c06cc50 0x7f362c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.292+0000 7f36377fe640 1 -- 172.21.15.38:0/1376117782 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f363c08c310 con 0x7f3640100c00 2024-09-13T18:41:04.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.292+0000 7f3645ce7640 1 --2- 172.21.15.38:0/1376117782 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f362c06cc50 0x7f362c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.297 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.292+0000 7f3645ce7640 1 --2- 172.21.15.38:0/1376117782 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f362c06cc50 0x7f362c06f110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3630006010 tx=0x7f36300058d0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.299 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.296+0000 7f36377fe640 1 -- 172.21.15.38:0/1376117782 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f363c056400 con 0x7f3640100c00 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.508+0000 7f364874c640 1 -- 172.21.15.38:0/1376117782 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f3640100fe0 con 0x7f3640100c00 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.508+0000 7f36377fe640 1 -- 172.21.15.38:0/1376117782 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v37) v1 ==== 107+0+4052 (secure 0 0 0) 0x7f363c059a20 con 0x7f3640100c00 2024-09-13T18:41:04.512 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:04.512 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44297,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/522640114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":522640114},{"type":"v1","addr":"172.21.15.149:6825","nonce":522640114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:59.904752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34352},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34352":{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":26,"state":"up:active","state_seq":8,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:04.512 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 29 2024-09-13T18:41:04.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.511+0000 7f364874c640 1 -- 172.21.15.38:0/1376117782 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f362c06cc50 msgr2=0x7f362c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.511+0000 7f364874c640 1 --2- 172.21.15.38:0/1376117782 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f362c06cc50 0x7f362c06f110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3630006010 tx=0x7f36300058d0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.511+0000 7f364874c640 1 -- 172.21.15.38:0/1376117782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3640100c00 msgr2=0x7f36400fe850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.514 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.511+0000 7f364874c640 1 --2- 172.21.15.38:0/1376117782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3640100c00 0x7f36400fe850 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f363c00c8f0 tx=0x7f363c00cdb0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.511+0000 7f364874c640 1 -- 172.21.15.38:0/1376117782 shutdown_connections 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.511+0000 7f364874c640 1 --2- 172.21.15.38:0/1376117782 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f362c06cc50 0x7f362c06f110 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.511+0000 7f364874c640 1 --2- 172.21.15.38:0/1376117782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3640101520 0x7f36400fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.511+0000 7f364874c640 1 --2- 172.21.15.38:0/1376117782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3640100c00 0x7f36400fe850 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.511+0000 7f364874c640 1 -- 172.21.15.38:0/1376117782 >> 172.21.15.38:0/1376117782 conn(0x7f36400fa5f0 msgr2=0x7f3640101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.511+0000 7f364874c640 1 -- 172.21.15.38:0/1376117782 shutdown_connections 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.511+0000 7f364874c640 1 -- 172.21.15.38:0/1376117782 wait complete. 2024-09-13T18:41:04.525 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-09-13T18:41:04.525 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-13T18:41:04.525 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-09-13T18:41:04.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.630+0000 7f4ce1308640 1 -- 172.21.15.38:0/818300445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cdc104940 msgr2=0x7f4cdc104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.630+0000 7f4ce1308640 1 --2- 172.21.15.38:0/818300445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cdc104940 0x7f4cdc104d20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009880 tx=0x7f4ccc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.630+0000 7f4ce1308640 1 -- 172.21.15.38:0/818300445 shutdown_connections 2024-09-13T18:41:04.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.630+0000 7f4ce1308640 1 --2- 172.21.15.38:0/818300445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cdc0fe930 0x7f4cdc0fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.630+0000 7f4ce1308640 1 --2- 172.21.15.38:0/818300445 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cdc104940 0x7f4cdc104d20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.634 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.630+0000 7f4ce1308640 1 -- 172.21.15.38:0/818300445 >> 172.21.15.38:0/818300445 conn(0x7f4cdc0fa5f0 msgr2=0x7f4cdc0fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:04.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.630+0000 7f4ce1308640 1 -- 172.21.15.38:0/818300445 shutdown_connections 2024-09-13T18:41:04.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.630+0000 7f4ce1308640 1 -- 172.21.15.38:0/818300445 wait complete. 2024-09-13T18:41:04.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.631+0000 7f4ce1308640 1 Processor -- start 2024-09-13T18:41:04.635 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.631+0000 7f4ce1308640 1 -- start start 2024-09-13T18:41:04.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.631+0000 7f4ce1308640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cdc0fe930 0x7f4cdc1968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.631+0000 7f4ce1308640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cdc104940 0x7f4cdc196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.631+0000 7f4ce1308640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc1973c0 con 0x7f4cdc0fe930 2024-09-13T18:41:04.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.631+0000 7f4ce1308640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc197530 con 0x7f4cdc104940 2024-09-13T18:41:04.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.631+0000 7f4cdaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cdc0fe930 0x7f4cdc1968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.631+0000 7f4cdaffd640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cdc0fe930 0x7f4cdc1968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47174/0 (socket says 172.21.15.38:47174) 2024-09-13T18:41:04.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.631+0000 7f4cdaffd640 1 -- 172.21.15.38:0/3523932077 learned_addr learned my addr 172.21.15.38:0/3523932077 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:04.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.631+0000 7f4cda7fc640 1 --2- 172.21.15.38:0/3523932077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cdc104940 0x7f4cdc196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.632+0000 7f4cdaffd640 1 -- 172.21.15.38:0/3523932077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cdc104940 msgr2=0x7f4cdc196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.632+0000 7f4cdaffd640 1 --2- 172.21.15.38:0/3523932077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cdc104940 0x7f4cdc196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.632+0000 7f4cdaffd640 1 -- 172.21.15.38:0/3523932077 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc009560 con 0x7f4cdc0fe930 2024-09-13T18:41:04.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.632+0000 7f4cdaffd640 1 --2- 172.21.15.38:0/3523932077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cdc0fe930 0x7f4cdc1968b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc02a9c0 tx=0x7f4ccc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.632+0000 7f4cc3fff640 1 -- 172.21.15.38:0/3523932077 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ccc004b60 con 0x7f4cdc0fe930 2024-09-13T18:41:04.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.632+0000 7f4cc3fff640 1 -- 172.21.15.38:0/3523932077 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4ccc004cc0 con 0x7f4cdc0fe930 2024-09-13T18:41:04.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.632+0000 7f4ce1308640 1 -- 172.21.15.38:0/3523932077 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cdc19f920 con 0x7f4cdc0fe930 2024-09-13T18:41:04.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.632+0000 7f4cc3fff640 1 -- 172.21.15.38:0/3523932077 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ccc031950 con 0x7f4cdc0fe930 2024-09-13T18:41:04.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.632+0000 7f4ce1308640 1 -- 172.21.15.38:0/3523932077 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cdc19fce0 con 0x7f4cdc0fe930 2024-09-13T18:41:04.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.633+0000 7f4ce1308640 1 -- 172.21.15.38:0/3523932077 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cdc100070 con 0x7f4cdc0fe930 2024-09-13T18:41:04.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.634+0000 7f4cc3fff640 1 -- 172.21.15.38:0/3523932077 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4ccc003c20 con 0x7f4cdc0fe930 2024-09-13T18:41:04.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.634+0000 7f4cc3fff640 1 --2- 172.21.15.38:0/3523932077 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4cc406cc50 0x7f4cc406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.634+0000 7f4cc3fff640 1 -- 172.21.15.38:0/3523932077 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f4ccc0ad610 con 0x7f4cdc0fe930 2024-09-13T18:41:04.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.634+0000 7f4cda7fc640 1 --2- 172.21.15.38:0/3523932077 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4cc406cc50 0x7f4cc406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.635+0000 7f4cda7fc640 1 --2- 172.21.15.38:0/3523932077 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4cc406cc50 0x7f4cc406f110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc068830 tx=0x7f4cd000b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.638+0000 7f4cc3fff640 1 -- 172.21.15.38:0/3523932077 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4ccc077700 con 0x7f4cdc0fe930 2024-09-13T18:41:04.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.851+0000 7f4ce1308640 1 -- 172.21.15.38:0/3523932077 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f4cdc0685e0 con 0x7f4cdc0fe930 2024-09-13T18:41:04.854 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.851+0000 7f4cc3fff640 1 -- 172.21.15.38:0/3523932077 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v37) v1 ==== 107+0+4831 (secure 0 0 0) 0x7f4ccc004e30 con 0x7f4cdc0fe930 2024-09-13T18:41:04.855 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:04.855 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi038.dtnkqo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6829/3278914810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3278914810},{"type":"v1","addr":"172.21.15.38:6829","nonce":3278914810}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44297,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/522640114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":522640114},{"type":"v1","addr":"172.21.15.149:6825","nonce":522640114}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:59.904752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34352},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34352":{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":26,"state":"up:active","state_seq":8,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:04.855 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 30 2024-09-13T18:41:04.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.853+0000 7f4ce1308640 1 -- 172.21.15.38:0/3523932077 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4cc406cc50 msgr2=0x7f4cc406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.853+0000 7f4ce1308640 1 --2- 172.21.15.38:0/3523932077 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4cc406cc50 0x7f4cc406f110 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc068830 tx=0x7f4cd000b390 comp rx=0 tx=0).stop 2024-09-13T18:41:04.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.853+0000 7f4ce1308640 1 -- 172.21.15.38:0/3523932077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cdc0fe930 msgr2=0x7f4cdc1968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.857 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.853+0000 7f4ce1308640 1 --2- 172.21.15.38:0/3523932077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cdc0fe930 0x7f4cdc1968b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc02a9c0 tx=0x7f4ccc0055a0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.853+0000 7f4ce1308640 1 -- 172.21.15.38:0/3523932077 shutdown_connections 2024-09-13T18:41:04.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.853+0000 7f4ce1308640 1 --2- 172.21.15.38:0/3523932077 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f4cc406cc50 0x7f4cc406f110 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.853+0000 7f4ce1308640 1 --2- 172.21.15.38:0/3523932077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cdc104940 0x7f4cdc196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.853+0000 7f4ce1308640 1 --2- 172.21.15.38:0/3523932077 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4cdc0fe930 0x7f4cdc1968b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.853+0000 7f4ce1308640 1 -- 172.21.15.38:0/3523932077 >> 172.21.15.38:0/3523932077 conn(0x7f4cdc0fa5f0 msgr2=0x7f4cdc0fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:04.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.854+0000 7f4ce1308640 1 -- 172.21.15.38:0/3523932077 shutdown_connections 2024-09-13T18:41:04.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.854+0000 7f4ce1308640 1 -- 172.21.15.38:0/3523932077 wait complete. 2024-09-13T18:41:04.867 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-09-13T18:41:04.868 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-13T18:41:04.868 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-09-13T18:41:04.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.967+0000 7fa20f08e640 1 -- 172.21.15.38:0/737228808 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa208105a40 msgr2=0x7fa208105e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.967+0000 7fa20f08e640 1 --2- 172.21.15.38:0/737228808 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa208105a40 0x7fa208105e20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009880 tx=0x7fa1f802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.967+0000 7fa20f08e640 1 -- 172.21.15.38:0/737228808 shutdown_connections 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.967+0000 7fa20f08e640 1 --2- 172.21.15.38:0/737228808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2080ffa30 0x7fa2080ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.967+0000 7fa20f08e640 1 --2- 172.21.15.38:0/737228808 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa208105a40 0x7fa208105e20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.967+0000 7fa20f08e640 1 -- 172.21.15.38:0/737228808 >> 172.21.15.38:0/737228808 conn(0x7fa2080fb710 msgr2=0x7fa2080fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.967+0000 7fa20f08e640 1 -- 172.21.15.38:0/737228808 shutdown_connections 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.967+0000 7fa20f08e640 1 -- 172.21.15.38:0/737228808 wait complete. 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.968+0000 7fa20f08e640 1 Processor -- start 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.968+0000 7fa20f08e640 1 -- start start 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.968+0000 7fa20f08e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2080ffa30 0x7fa208195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.968+0000 7fa20f08e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa208105a40 0x7fa208195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.968+0000 7fa20f08e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa208196630 con 0x7fa208105a40 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.968+0000 7fa20f08e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20819a370 con 0x7fa2080ffa30 2024-09-13T18:41:04.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.968+0000 7fa207fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa208105a40 0x7fa208195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.968+0000 7fa207fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa208105a40 0x7fa208195f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47190/0 (socket says 172.21.15.38:47190) 2024-09-13T18:41:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.968+0000 7fa207fff640 1 -- 172.21.15.38:0/3101496976 learned_addr learned my addr 172.21.15.38:0/3101496976 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.969+0000 7fa207fff640 1 -- 172.21.15.38:0/3101496976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2080ffa30 msgr2=0x7fa208195a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.969+0000 7fa20ce2a640 1 --2- 172.21.15.38:0/3101496976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2080ffa30 0x7fa208195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.969+0000 7fa207fff640 1 --2- 172.21.15.38:0/3101496976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2080ffa30 0x7fa208195a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.969+0000 7fa207fff640 1 -- 172.21.15.38:0/3101496976 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8009560 con 0x7fa208105a40 2024-09-13T18:41:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.969+0000 7fa207fff640 1 --2- 172.21.15.38:0/3101496976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa208105a40 0x7fa208195f50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00d6f0 tx=0x7fa1fc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.969+0000 7fa205ffb640 1 -- 172.21.15.38:0/3101496976 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1fc009a30 con 0x7fa208105a40 2024-09-13T18:41:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.969+0000 7fa205ffb640 1 -- 172.21.15.38:0/3101496976 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa1fc0054c0 con 0x7fa208105a40 2024-09-13T18:41:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.969+0000 7fa20f08e640 1 -- 172.21.15.38:0/3101496976 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20819a650 con 0x7fa208105a40 2024-09-13T18:41:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.969+0000 7fa205ffb640 1 -- 172.21.15.38:0/3101496976 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1fc004db0 con 0x7fa208105a40 2024-09-13T18:41:04.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.969+0000 7fa20f08e640 1 -- 172.21.15.38:0/3101496976 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20819abb0 con 0x7fa208105a40 2024-09-13T18:41:04.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.970+0000 7fa20f08e640 1 -- 172.21.15.38:0/3101496976 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa208101170 con 0x7fa208105a40 2024-09-13T18:41:04.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.970+0000 7fa205ffb640 1 -- 172.21.15.38:0/3101496976 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa1fc004f10 con 0x7fa208105a40 2024-09-13T18:41:04.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.971+0000 7fa205ffb640 1 --2- 172.21.15.38:0/3101496976 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa1f006cc50 0x7fa1f006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.971+0000 7fa205ffb640 1 -- 172.21.15.38:0/3101496976 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fa1fc08c0a0 con 0x7fa208105a40 2024-09-13T18:41:04.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.971+0000 7fa20ce2a640 1 --2- 172.21.15.38:0/3101496976 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa1f006cc50 0x7fa1f006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.971+0000 7fa20ce2a640 1 --2- 172.21.15.38:0/3101496976 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa1f006cc50 0x7fa1f006f110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8006010 tx=0x7fa1f8000bc0 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.978 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:04.975+0000 7fa205ffb640 1 -- 172.21.15.38:0/3101496976 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa1fc0560e0 con 0x7fa208105a40 2024-09-13T18:41:05.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.183+0000 7fa20f08e640 1 -- 172.21.15.38:0/3101496976 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fa208107fa0 con 0x7fa208105a40 2024-09-13T18:41:05.187 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.183+0000 7fa205ffb640 1 -- 172.21.15.38:0/3101496976 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v37) v1 ==== 107+0+4052 (secure 0 0 0) 0x7fa1fc020090 con 0x7fa208105a40 2024-09-13T18:41:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:05.187 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi038.dtnkqo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6829/3278914810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3278914810},{"type":"v1","addr":"172.21.15.38:6829","nonce":3278914810}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:59.904752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34352},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34352":{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":26,"state":"up:active","state_seq":8,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:05.187 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 31 2024-09-13T18:41:05.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.185+0000 7fa20f08e640 1 -- 172.21.15.38:0/3101496976 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa1f006cc50 msgr2=0x7fa1f006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.185+0000 7fa20f08e640 1 --2- 172.21.15.38:0/3101496976 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa1f006cc50 0x7fa1f006f110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8006010 tx=0x7fa1f8000bc0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.185+0000 7fa20f08e640 1 -- 172.21.15.38:0/3101496976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa208105a40 msgr2=0x7fa208195f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.185+0000 7fa20f08e640 1 --2- 172.21.15.38:0/3101496976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa208105a40 0x7fa208195f50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00d6f0 tx=0x7fa1fc00dbb0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.185+0000 7fa20f08e640 1 -- 172.21.15.38:0/3101496976 shutdown_connections 2024-09-13T18:41:05.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.185+0000 7fa20f08e640 1 --2- 172.21.15.38:0/3101496976 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa208105a40 0x7fa208195f50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.185+0000 7fa20f08e640 1 --2- 172.21.15.38:0/3101496976 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa1f006cc50 0x7fa1f006f110 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.185+0000 7fa20f08e640 1 --2- 172.21.15.38:0/3101496976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2080ffa30 0x7fa208195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.185+0000 7fa20f08e640 1 -- 172.21.15.38:0/3101496976 >> 172.21.15.38:0/3101496976 conn(0x7fa2080fb710 msgr2=0x7fa2080fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.186+0000 7fa20f08e640 1 -- 172.21.15.38:0/3101496976 shutdown_connections 2024-09-13T18:41:05.190 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.186+0000 7fa20f08e640 1 -- 172.21.15.38:0/3101496976 wait complete. 2024-09-13T18:41:05.198 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:05 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1361030118' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T18:41:05.198 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:05 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1376117782' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T18:41:05.199 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:05 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3523932077' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T18:41:05.200 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-09-13T18:41:05.200 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-13T18:41:05.200 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-09-13T18:41:05.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:05 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1361030118' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T18:41:05.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:05 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1376117782' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T18:41:05.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:05 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3523932077' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T18:41:05.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.299+0000 7f16b9879640 1 -- 172.21.15.38:0/3124743062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16b4101590 msgr2=0x7f16b4109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.299+0000 7f16b9879640 1 --2- 172.21.15.38:0/3124743062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16b4101590 0x7f16b4109a70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f169c009880 tx=0x7f169c02a530 comp rx=0 tx=0).stop 2024-09-13T18:41:05.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.299+0000 7f16b9879640 1 -- 172.21.15.38:0/3124743062 shutdown_connections 2024-09-13T18:41:05.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.299+0000 7f16b9879640 1 --2- 172.21.15.38:0/3124743062 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16b4101590 0x7f16b4109a70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.299+0000 7f16b9879640 1 --2- 172.21.15.38:0/3124743062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16b4100c70 0x7f16b4101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.299+0000 7f16b9879640 1 -- 172.21.15.38:0/3124743062 >> 172.21.15.38:0/3124743062 conn(0x7f16b4075750 msgr2=0x7f16b40fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:05.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.299+0000 7f16b9879640 1 -- 172.21.15.38:0/3124743062 shutdown_connections 2024-09-13T18:41:05.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.300+0000 7f16b9879640 1 -- 172.21.15.38:0/3124743062 wait complete. 2024-09-13T18:41:05.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.300+0000 7f16b9879640 1 Processor -- start 2024-09-13T18:41:05.304 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.300+0000 7f16b9879640 1 -- start start 2024-09-13T18:41:05.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.300+0000 7f16b9879640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16b4100c70 0x7f16b40fe8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.300+0000 7f16b9879640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16b4101590 0x7f16b40fee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.300+0000 7f16b9879640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b41008a0 con 0x7f16b4101590 2024-09-13T18:41:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.300+0000 7f16b9879640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40ff370 con 0x7f16b4100c70 2024-09-13T18:41:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.301+0000 7f16b27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16b4101590 0x7f16b40fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.301+0000 7f16b27fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16b4101590 0x7f16b40fee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47200/0 (socket says 172.21.15.38:47200) 2024-09-13T18:41:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.301+0000 7f16b27fc640 1 -- 172.21.15.38:0/357085503 learned_addr learned my addr 172.21.15.38:0/357085503 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.301+0000 7f16b27fc640 1 -- 172.21.15.38:0/357085503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16b4100c70 msgr2=0x7f16b40fe8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.301+0000 7f16b27fc640 1 --2- 172.21.15.38:0/357085503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16b4100c70 0x7f16b40fe8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.301+0000 7f16b27fc640 1 -- 172.21.15.38:0/357085503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c009560 con 0x7f16b4101590 2024-09-13T18:41:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.301+0000 7f16b27fc640 1 --2- 172.21.15.38:0/357085503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16b4101590 0x7f16b40fee00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f169c006010 tx=0x7f169c004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.301+0000 7f16b8877640 1 -- 172.21.15.38:0/357085503 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f169c005430 con 0x7f16b4101590 2024-09-13T18:41:05.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.301+0000 7f16b8877640 1 -- 172.21.15.38:0/357085503 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f169c005590 con 0x7f16b4101590 2024-09-13T18:41:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.301+0000 7f16b9879640 1 -- 172.21.15.38:0/357085503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b40ff5f0 con 0x7f16b4101590 2024-09-13T18:41:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.301+0000 7f16b8877640 1 -- 172.21.15.38:0/357085503 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f169c03c990 con 0x7f16b4101590 2024-09-13T18:41:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.301+0000 7f16b9879640 1 -- 172.21.15.38:0/357085503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b41a1d60 con 0x7f16b4101590 2024-09-13T18:41:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.302+0000 7f16b9879640 1 -- 172.21.15.38:0/357085503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b4067c90 con 0x7f16b4101590 2024-09-13T18:41:05.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.303+0000 7f16b8877640 1 -- 172.21.15.38:0/357085503 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f169c02ad50 con 0x7f16b4101590 2024-09-13T18:41:05.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.303+0000 7f16b8877640 1 --2- 172.21.15.38:0/357085503 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f16a006cc90 0x7f16a006f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.303+0000 7f16b8877640 1 -- 172.21.15.38:0/357085503 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f169c0ad630 con 0x7f16b4101590 2024-09-13T18:41:05.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.303+0000 7f16b2ffd640 1 --2- 172.21.15.38:0/357085503 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f16a006cc90 0x7f16a006f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.308 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.304+0000 7f16b2ffd640 1 --2- 172.21.15.38:0/357085503 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f16a006cc90 0x7f16a006f150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00a990 tx=0x7f16ac005c70 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:05.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.307+0000 7f16b8877640 1 -- 172.21.15.38:0/357085503 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f169c0775f0 con 0x7f16b4101590 2024-09-13T18:41:05.522 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.519+0000 7f16b9879640 1 -- 172.21.15.38:0/357085503 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f16b410cb70 con 0x7f16b4101590 2024-09-13T18:41:05.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.520+0000 7f16b8877640 1 -- 172.21.15.38:0/357085503 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v37) v1 ==== 107+0+4831 (secure 0 0 0) 0x7f169c07ac10 con 0x7f16b4101590 2024-09-13T18:41:05.523 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:05.523 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi038.dtnkqo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6829/3278914810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3278914810},{"type":"v1","addr":"172.21.15.38:6829","nonce":3278914810}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44263,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3061943000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3061943000},{"type":"v1","addr":"172.21.15.149:6827","nonce":3061943000}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44325,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/248866776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":248866776},{"type":"v1","addr":"172.21.15.149:6825","nonce":248866776}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:59.904752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34352},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34352":{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":26,"state":"up:active","state_seq":8,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:05.524 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 32 2024-09-13T18:41:05.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.522+0000 7f16b9879640 1 -- 172.21.15.38:0/357085503 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f16a006cc90 msgr2=0x7f16a006f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.522+0000 7f16b9879640 1 --2- 172.21.15.38:0/357085503 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f16a006cc90 0x7f16a006f150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00a990 tx=0x7f16ac005c70 comp rx=0 tx=0).stop 2024-09-13T18:41:05.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.522+0000 7f16b9879640 1 -- 172.21.15.38:0/357085503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16b4101590 msgr2=0x7f16b40fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.522+0000 7f16b9879640 1 --2- 172.21.15.38:0/357085503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16b4101590 0x7f16b40fee00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f169c006010 tx=0x7f169c004e30 comp rx=0 tx=0).stop 2024-09-13T18:41:05.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.522+0000 7f16b9879640 1 -- 172.21.15.38:0/357085503 shutdown_connections 2024-09-13T18:41:05.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.522+0000 7f16b9879640 1 --2- 172.21.15.38:0/357085503 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f16b4101590 0x7f16b40fee00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.522+0000 7f16b9879640 1 --2- 172.21.15.38:0/357085503 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f16a006cc90 0x7f16a006f150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.522+0000 7f16b9879640 1 --2- 172.21.15.38:0/357085503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16b4100c70 0x7f16b40fe8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.522+0000 7f16b9879640 1 -- 172.21.15.38:0/357085503 >> 172.21.15.38:0/357085503 conn(0x7f16b4075750 msgr2=0x7f16b4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:05.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.522+0000 7f16b9879640 1 -- 172.21.15.38:0/357085503 shutdown_connections 2024-09-13T18:41:05.526 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.522+0000 7f16b9879640 1 -- 172.21.15.38:0/357085503 wait complete. 2024-09-13T18:41:05.537 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-09-13T18:41:05.537 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-13T18:41:05.537 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-09-13T18:41:05.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.637+0000 7f375c5c7640 1 -- 172.21.15.38:0/4012236882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540fe940 msgr2=0x7f37540feda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.637+0000 7f375c5c7640 1 --2- 172.21.15.38:0/4012236882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540fe940 0x7f37540feda0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3744009880 tx=0x7f374402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.637+0000 7f375c5c7640 1 -- 172.21.15.38:0/4012236882 shutdown_connections 2024-09-13T18:41:05.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.637+0000 7f375c5c7640 1 --2- 172.21.15.38:0/4012236882 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540fe940 0x7f37540feda0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.637+0000 7f375c5c7640 1 --2- 172.21.15.38:0/4012236882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3754104950 0x7f3754104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.637+0000 7f375c5c7640 1 -- 172.21.15.38:0/4012236882 >> 172.21.15.38:0/4012236882 conn(0x7f37540fa620 msgr2=0x7f37540fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.637+0000 7f375c5c7640 1 -- 172.21.15.38:0/4012236882 shutdown_connections 2024-09-13T18:41:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.637+0000 7f375c5c7640 1 -- 172.21.15.38:0/4012236882 wait complete. 2024-09-13T18:41:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375c5c7640 1 Processor -- start 2024-09-13T18:41:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375c5c7640 1 -- start start 2024-09-13T18:41:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375c5c7640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540fe940 0x7f3754196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375c5c7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3754104950 0x7f3754196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375c5c7640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754197330 con 0x7f37540fe940 2024-09-13T18:41:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375c5c7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37541974a0 con 0x7f3754104950 2024-09-13T18:41:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375a363640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540fe940 0x7f3754196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.643 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375a363640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540fe940 0x7f3754196820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47206/0 (socket says 172.21.15.38:47206) 2024-09-13T18:41:05.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375a363640 1 -- 172.21.15.38:0/1314959387 learned_addr learned my addr 172.21.15.38:0/1314959387 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:05.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f3759b62640 1 --2- 172.21.15.38:0/1314959387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3754104950 0x7f3754196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375a363640 1 -- 172.21.15.38:0/1314959387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3754104950 msgr2=0x7f3754196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375a363640 1 --2- 172.21.15.38:0/1314959387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3754104950 0x7f3754196d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375a363640 1 -- 172.21.15.38:0/1314959387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3744009560 con 0x7f37540fe940 2024-09-13T18:41:05.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f3759b62640 1 --2- 172.21.15.38:0/1314959387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3754104950 0x7f3754196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:05.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f375a363640 1 --2- 172.21.15.38:0/1314959387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540fe940 0x7f3754196820 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f375000d6f0 tx=0x7f375000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:05.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.638+0000 7f374b7fe640 1 -- 172.21.15.38:0/1314959387 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3750009a30 con 0x7f37540fe940 2024-09-13T18:41:05.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.639+0000 7f374b7fe640 1 -- 172.21.15.38:0/1314959387 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f37500054c0 con 0x7f37540fe940 2024-09-13T18:41:05.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.639+0000 7f375c5c7640 1 -- 172.21.15.38:0/1314959387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375419f890 con 0x7f37540fe940 2024-09-13T18:41:05.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.639+0000 7f374b7fe640 1 -- 172.21.15.38:0/1314959387 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3750004db0 con 0x7f37540fe940 2024-09-13T18:41:05.644 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.639+0000 7f375c5c7640 1 -- 172.21.15.38:0/1314959387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375419fd10 con 0x7f37540fe940 2024-09-13T18:41:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.639+0000 7f375c5c7640 1 -- 172.21.15.38:0/1314959387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3754100080 con 0x7f37540fe940 2024-09-13T18:41:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.640+0000 7f374b7fe640 1 -- 172.21.15.38:0/1314959387 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3750004f10 con 0x7f37540fe940 2024-09-13T18:41:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.640+0000 7f374b7fe640 1 --2- 172.21.15.38:0/1314959387 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f374006cc50 0x7f374006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.641+0000 7f374b7fe640 1 -- 172.21.15.38:0/1314959387 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f375008c0c0 con 0x7f37540fe940 2024-09-13T18:41:05.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.641+0000 7f3759b62640 1 --2- 172.21.15.38:0/1314959387 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f374006cc50 0x7f374006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.646 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.641+0000 7f3759b62640 1 --2- 172.21.15.38:0/1314959387 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f374006cc50 0x7f374006f110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3744006010 tx=0x7f3744005d50 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:05.648 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.645+0000 7f374b7fe640 1 -- 172.21.15.38:0/1314959387 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3750056060 con 0x7f37540fe940 2024-09-13T18:41:05.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.851+0000 7f375c5c7640 1 -- 172.21.15.38:0/1314959387 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f37540feda0 con 0x7f37540fe940 2024-09-13T18:41:05.855 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.852+0000 7f374b7fe640 1 -- 172.21.15.38:0/1314959387 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v37) v1 ==== 107+0+4049 (secure 0 0 0) 0x7f3750020090 con 0x7f37540fe940 2024-09-13T18:41:05.856 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:05.856 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi038.dtnkqo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6829/3278914810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3278914810},{"type":"v1","addr":"172.21.15.38:6829","nonce":3278914810}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44325,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/248866776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":248866776},{"type":"v1","addr":"172.21.15.149:6825","nonce":248866776}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:59.904752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34352},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34352":{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":26,"state":"up:active","state_seq":8,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:05.856 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 33 2024-09-13T18:41:05.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.855+0000 7f375c5c7640 1 -- 172.21.15.38:0/1314959387 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f374006cc50 msgr2=0x7f374006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.855+0000 7f375c5c7640 1 --2- 172.21.15.38:0/1314959387 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f374006cc50 0x7f374006f110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3744006010 tx=0x7f3744005d50 comp rx=0 tx=0).stop 2024-09-13T18:41:05.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.855+0000 7f375c5c7640 1 -- 172.21.15.38:0/1314959387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540fe940 msgr2=0x7f3754196820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.855+0000 7f375c5c7640 1 --2- 172.21.15.38:0/1314959387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540fe940 0x7f3754196820 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f375000d6f0 tx=0x7f375000dbb0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.855+0000 7f375c5c7640 1 -- 172.21.15.38:0/1314959387 shutdown_connections 2024-09-13T18:41:05.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.855+0000 7f375c5c7640 1 --2- 172.21.15.38:0/1314959387 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f374006cc50 0x7f374006f110 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.855+0000 7f375c5c7640 1 --2- 172.21.15.38:0/1314959387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3754104950 0x7f3754196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.855+0000 7f375c5c7640 1 --2- 172.21.15.38:0/1314959387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37540fe940 0x7f3754196820 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.855+0000 7f375c5c7640 1 -- 172.21.15.38:0/1314959387 >> 172.21.15.38:0/1314959387 conn(0x7f37540fa620 msgr2=0x7f37540fb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:05.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.855+0000 7f375c5c7640 1 -- 172.21.15.38:0/1314959387 shutdown_connections 2024-09-13T18:41:05.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.855+0000 7f375c5c7640 1 -- 172.21.15.38:0/1314959387 wait complete. 2024-09-13T18:41:05.868 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-09-13T18:41:05.868 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-13T18:41:05.868 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-09-13T18:41:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.968+0000 7fc6ed219640 1 -- 172.21.15.38:0/2641700845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e80ffa10 msgr2=0x7fc6e80ffe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.968+0000 7fc6ed219640 1 --2- 172.21.15.38:0/2641700845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e80ffa10 0x7fc6e80ffe70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009880 tx=0x7fc6dc02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.968+0000 7fc6ed219640 1 -- 172.21.15.38:0/2641700845 shutdown_connections 2024-09-13T18:41:05.972 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.968+0000 7fc6ed219640 1 --2- 172.21.15.38:0/2641700845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e80ffa10 0x7fc6e80ffe70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.968+0000 7fc6ed219640 1 --2- 172.21.15.38:0/2641700845 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e8105a20 0x7fc6e8105e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.968+0000 7fc6ed219640 1 -- 172.21.15.38:0/2641700845 >> 172.21.15.38:0/2641700845 conn(0x7fc6e80fb710 msgr2=0x7fc6e80fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.968+0000 7fc6ed219640 1 -- 172.21.15.38:0/2641700845 shutdown_connections 2024-09-13T18:41:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.968+0000 7fc6ed219640 1 -- 172.21.15.38:0/2641700845 wait complete. 2024-09-13T18:41:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.969+0000 7fc6ed219640 1 Processor -- start 2024-09-13T18:41:05.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.969+0000 7fc6ed219640 1 -- start start 2024-09-13T18:41:05.974 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.969+0000 7fc6ed219640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e80ffa10 0x7fc6e819b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.969+0000 7fc6ed219640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e8105a20 0x7fc6e819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.969+0000 7fc6ed219640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e819c2a0 con 0x7fc6e8105a20 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.969+0000 7fc6ed219640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e81957f0 con 0x7fc6e80ffa10 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.970+0000 7fc6e659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e8105a20 0x7fc6e819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.970+0000 7fc6e659c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e8105a20 0x7fc6e819bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47226/0 (socket says 172.21.15.38:47226) 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.970+0000 7fc6e659c640 1 -- 172.21.15.38:0/3426277098 learned_addr learned my addr 172.21.15.38:0/3426277098 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.970+0000 7fc6e659c640 1 -- 172.21.15.38:0/3426277098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e80ffa10 msgr2=0x7fc6e819b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.970+0000 7fc6e659c640 1 --2- 172.21.15.38:0/3426277098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e80ffa10 0x7fc6e819b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.970+0000 7fc6e659c640 1 -- 172.21.15.38:0/3426277098 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc009560 con 0x7fc6e8105a20 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.970+0000 7fc6e659c640 1 --2- 172.21.15.38:0/3426277098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e8105a20 0x7fc6e819bc50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc006010 tx=0x7fc6dc0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.970+0000 7fc6cffff640 1 -- 172.21.15.38:0/3426277098 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6dc004ba0 con 0x7fc6e8105a20 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.970+0000 7fc6cffff640 1 -- 172.21.15.38:0/3426277098 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6dc004d00 con 0x7fc6e8105a20 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.970+0000 7fc6ed219640 1 -- 172.21.15.38:0/3426277098 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e8195a40 con 0x7fc6e8105a20 2024-09-13T18:41:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.970+0000 7fc6cffff640 1 -- 172.21.15.38:0/3426277098 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6dc031910 con 0x7fc6e8105a20 2024-09-13T18:41:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.970+0000 7fc6ed219640 1 -- 172.21.15.38:0/3426277098 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e8195f40 con 0x7fc6e8105a20 2024-09-13T18:41:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.971+0000 7fc6ed219640 1 -- 172.21.15.38:0/3426277098 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e8101150 con 0x7fc6e8105a20 2024-09-13T18:41:05.976 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.972+0000 7fc6cffff640 1 -- 172.21.15.38:0/3426277098 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc6dc031b80 con 0x7fc6e8105a20 2024-09-13T18:41:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.972+0000 7fc6cffff640 1 --2- 172.21.15.38:0/3426277098 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc6d006cc50 0x7fc6d006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.972+0000 7fc6cffff640 1 -- 172.21.15.38:0/3426277098 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fc6dc0ad880 con 0x7fc6e8105a20 2024-09-13T18:41:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.972+0000 7fc6e6d9d640 1 --2- 172.21.15.38:0/3426277098 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc6d006cc50 0x7fc6d006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.977 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.973+0000 7fc6e6d9d640 1 --2- 172.21.15.38:0/3426277098 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc6d006cc50 0x7fc6d006f110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800a990 tx=0x7fc6d8005c70 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:05.980 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:05.977+0000 7fc6cffff640 1 -- 172.21.15.38:0/3426277098 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc6dc077840 con 0x7fc6e8105a20 2024-09-13T18:41:06.185 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.182+0000 7fc6ed219640 1 -- 172.21.15.38:0/3426277098 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7fc6e80ffe70 con 0x7fc6e8105a20 2024-09-13T18:41:06.186 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.182+0000 7fc6cffff640 1 -- 172.21.15.38:0/3426277098 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v37) v1 ==== 107+0+4831 (secure 0 0 0) 0x7fc6dc07ae60 con 0x7fc6e8105a20 2024-09-13T18:41:06.186 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:06.186 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi038.dtnkqo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6829/3278914810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3278914810},{"type":"v1","addr":"172.21.15.38:6829","nonce":3278914810}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":44325,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/248866776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":248866776},{"type":"v1","addr":"172.21.15.149:6825","nonce":248866776}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":44353,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3248503653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3248503653},{"type":"v1","addr":"172.21.15.149:6827","nonce":3248503653}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:36:59.904752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34352},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34352":{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":26,"state":"up:active","state_seq":8,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:06.186 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 34 2024-09-13T18:41:06.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.185+0000 7fc6ed219640 1 -- 172.21.15.38:0/3426277098 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc6d006cc50 msgr2=0x7fc6d006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.185+0000 7fc6ed219640 1 --2- 172.21.15.38:0/3426277098 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc6d006cc50 0x7fc6d006f110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800a990 tx=0x7fc6d8005c70 comp rx=0 tx=0).stop 2024-09-13T18:41:06.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.185+0000 7fc6ed219640 1 -- 172.21.15.38:0/3426277098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e8105a20 msgr2=0x7fc6e819bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.185+0000 7fc6ed219640 1 --2- 172.21.15.38:0/3426277098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e8105a20 0x7fc6e819bc50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc006010 tx=0x7fc6dc0056e0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.185+0000 7fc6ed219640 1 -- 172.21.15.38:0/3426277098 shutdown_connections 2024-09-13T18:41:06.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.185+0000 7fc6ed219640 1 --2- 172.21.15.38:0/3426277098 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc6e8105a20 0x7fc6e819bc50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.188 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.185+0000 7fc6ed219640 1 --2- 172.21.15.38:0/3426277098 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fc6d006cc50 0x7fc6d006f110 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.185+0000 7fc6ed219640 1 --2- 172.21.15.38:0/3426277098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6e80ffa10 0x7fc6e819b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.185+0000 7fc6ed219640 1 -- 172.21.15.38:0/3426277098 >> 172.21.15.38:0/3426277098 conn(0x7fc6e80fb710 msgr2=0x7fc6e80fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.185+0000 7fc6ed219640 1 -- 172.21.15.38:0/3426277098 shutdown_connections 2024-09-13T18:41:06.189 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.185+0000 7fc6ed219640 1 -- 172.21.15.38:0/3426277098 wait complete. 2024-09-13T18:41:06.197 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:06 smithi038 ceph-mon[91522]: pgmap v350: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:41:06.198 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:06 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3101496976' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T18:41:06.198 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:06 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/357085503' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T18:41:06.198 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:06 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1314959387' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T18:41:06.199 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-09-13T18:41:06.199 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-13T18:41:06.199 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-09-13T18:41:06.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:06 smithi149 ceph-mon[76906]: pgmap v350: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:41:06.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:06 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3101496976' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T18:41:06.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:06 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/357085503' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T18:41:06.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:06 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1314959387' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T18:41:06.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.299+0000 7efdce725640 1 -- 172.21.15.38:0/2381295125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdc8100b60 msgr2=0x7efdc8100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.299+0000 7efdce725640 1 --2- 172.21.15.38:0/2381295125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdc8100b60 0x7efdc8100f40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009880 tx=0x7efdb802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.302 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.299+0000 7efdce725640 1 -- 172.21.15.38:0/2381295125 shutdown_connections 2024-09-13T18:41:06.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.299+0000 7efdce725640 1 --2- 172.21.15.38:0/2381295125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc8101510 0x7efdc81099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.299+0000 7efdce725640 1 --2- 172.21.15.38:0/2381295125 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdc8100b60 0x7efdc8100f40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.299+0000 7efdce725640 1 -- 172.21.15.38:0/2381295125 >> 172.21.15.38:0/2381295125 conn(0x7efdc80fa5e0 msgr2=0x7efdc80fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.299+0000 7efdce725640 1 -- 172.21.15.38:0/2381295125 shutdown_connections 2024-09-13T18:41:06.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.299+0000 7efdce725640 1 -- 172.21.15.38:0/2381295125 wait complete. 2024-09-13T18:41:06.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.300+0000 7efdce725640 1 Processor -- start 2024-09-13T18:41:06.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.300+0000 7efdce725640 1 -- start start 2024-09-13T18:41:06.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.300+0000 7efdce725640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc8100b60 0x7efdc80fe840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.300+0000 7efdce725640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdc8101510 0x7efdc80fed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.300+0000 7efdce725640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80ff2c0 con 0x7efdc8101510 2024-09-13T18:41:06.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.300+0000 7efdce725640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80ff430 con 0x7efdc8100b60 2024-09-13T18:41:06.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdc77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdc8101510 0x7efdc80fed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.305 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdc77fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdc8101510 0x7efdc80fed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47248/0 (socket says 172.21.15.38:47248) 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdc77fe640 1 -- 172.21.15.38:0/1360334238 learned_addr learned my addr 172.21.15.38:0/1360334238 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdc7fff640 1 --2- 172.21.15.38:0/1360334238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc8100b60 0x7efdc80fe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdc77fe640 1 -- 172.21.15.38:0/1360334238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc8100b60 msgr2=0x7efdc80fe840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdc77fe640 1 --2- 172.21.15.38:0/1360334238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc8100b60 0x7efdc80fe840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdc77fe640 1 -- 172.21.15.38:0/1360334238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb8009560 con 0x7efdc8101510 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdc7fff640 1 --2- 172.21.15.38:0/1360334238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc8100b60 0x7efdc80fe840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdc77fe640 1 --2- 172.21.15.38:0/1360334238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdc8101510 0x7efdc80fed80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00d6f0 tx=0x7efdbc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdc57fa640 1 -- 172.21.15.38:0/1360334238 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdbc009a30 con 0x7efdc8101510 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdc57fa640 1 -- 172.21.15.38:0/1360334238 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efdbc0054c0 con 0x7efdc8101510 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdce725640 1 -- 172.21.15.38:0/1360334238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc81a1b90 con 0x7efdc8101510 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdc57fa640 1 -- 172.21.15.38:0/1360334238 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdbc004db0 con 0x7efdc8101510 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.301+0000 7efdce725640 1 -- 172.21.15.38:0/1360334238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc81a1f00 con 0x7efdc8101510 2024-09-13T18:41:06.306 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.302+0000 7efdce725640 1 -- 172.21.15.38:0/1360334238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc80688d0 con 0x7efdc8101510 2024-09-13T18:41:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.303+0000 7efdc57fa640 1 -- 172.21.15.38:0/1360334238 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efdbc004f30 con 0x7efdc8101510 2024-09-13T18:41:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.303+0000 7efdc57fa640 1 --2- 172.21.15.38:0/1360334238 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7efdb006cc00 0x7efdb006f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.303+0000 7efdc57fa640 1 -- 172.21.15.38:0/1360334238 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7efdbc08c1e0 con 0x7efdc8101510 2024-09-13T18:41:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.303+0000 7efdc7fff640 1 --2- 172.21.15.38:0/1360334238 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7efdb006cc00 0x7efdb006f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.307 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.304+0000 7efdc7fff640 1 --2- 172.21.15.38:0/1360334238 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7efdb006cc00 0x7efdb006f0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efdb8006010 tx=0x7efdb8005d50 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.310 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.307+0000 7efdc57fa640 1 -- 172.21.15.38:0/1360334238 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efdbc0561a0 con 0x7efdc8101510 2024-09-13T18:41:06.515 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.513+0000 7efdce725640 1 -- 172.21.15.38:0/1360334238 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7efdc8100f40 con 0x7efdc8101510 2024-09-13T18:41:06.516 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.513+0000 7efdc57fa640 1 -- 172.21.15.38:0/1360334238 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v37) v1 ==== 107+0+4848 (secure 0 0 0) 0x7efdbc0597c0 con 0x7efdc8101510 2024-09-13T18:41:06.516 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:06.516 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44325,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/248866776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":248866776},{"type":"v1","addr":"172.21.15.149:6825","nonce":248866776}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":44353,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3248503653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3248503653},{"type":"v1","addr":"172.21.15.149:6827","nonce":3248503653}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:37:40.622276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34352,"mds_1":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34352":{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":26,"state":"up:active","state_seq":8,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34384":{"gid":34384,"name":"cephfs.smithi038.dtnkqo","rank":1,"incarnation":35,"state":"up:starting","state_seq":1,"addr":"172.21.15.38:6829/3278914810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3278914810},{"type":"v1","addr":"172.21.15.38:6829","nonce":3278914810}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:06.516 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 35 2024-09-13T18:41:06.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.515+0000 7efdce725640 1 -- 172.21.15.38:0/1360334238 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7efdb006cc00 msgr2=0x7efdb006f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.515+0000 7efdce725640 1 --2- 172.21.15.38:0/1360334238 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7efdb006cc00 0x7efdb006f0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efdb8006010 tx=0x7efdb8005d50 comp rx=0 tx=0).stop 2024-09-13T18:41:06.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.515+0000 7efdce725640 1 -- 172.21.15.38:0/1360334238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdc8101510 msgr2=0x7efdc80fed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.515+0000 7efdce725640 1 --2- 172.21.15.38:0/1360334238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdc8101510 0x7efdc80fed80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00d6f0 tx=0x7efdbc00dbb0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.515+0000 7efdce725640 1 -- 172.21.15.38:0/1360334238 shutdown_connections 2024-09-13T18:41:06.518 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.516+0000 7efdce725640 1 --2- 172.21.15.38:0/1360334238 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efdc8101510 0x7efdc80fed80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.516+0000 7efdce725640 1 --2- 172.21.15.38:0/1360334238 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7efdb006cc00 0x7efdb006f0c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.516+0000 7efdce725640 1 --2- 172.21.15.38:0/1360334238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdc8100b60 0x7efdc80fe840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.516+0000 7efdce725640 1 -- 172.21.15.38:0/1360334238 >> 172.21.15.38:0/1360334238 conn(0x7efdc80fa5e0 msgr2=0x7efdc8101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.516+0000 7efdce725640 1 -- 172.21.15.38:0/1360334238 shutdown_connections 2024-09-13T18:41:06.519 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.516+0000 7efdce725640 1 -- 172.21.15.38:0/1360334238 wait complete. 2024-09-13T18:41:06.529 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-13T18:41:06.530 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-09-13T18:41:06.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.634+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3964072938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30ec101530 msgr2=0x7f30ec109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.634+0000 7f30f1ee9640 1 --2- 172.21.15.38:0/3964072938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30ec101530 0x7f30ec109a10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009880 tx=0x7f30d402a530 comp rx=0 tx=0).stop 2024-09-13T18:41:06.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.634+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3964072938 shutdown_connections 2024-09-13T18:41:06.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.634+0000 7f30f1ee9640 1 --2- 172.21.15.38:0/3964072938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30ec101530 0x7f30ec109a10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.634+0000 7f30f1ee9640 1 --2- 172.21.15.38:0/3964072938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30ec100c10 0x7f30ec100ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.637 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.634+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3964072938 >> 172.21.15.38:0/3964072938 conn(0x7f30ec075750 msgr2=0x7f30ec0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.634+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3964072938 shutdown_connections 2024-09-13T18:41:06.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.634+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3964072938 wait complete. 2024-09-13T18:41:06.638 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.635+0000 7f30f1ee9640 1 Processor -- start 2024-09-13T18:41:06.639 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.635+0000 7f30f1ee9640 1 -- start start 2024-09-13T18:41:06.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.635+0000 7f30f1ee9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30ec100c10 0x7f30ec19b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.635+0000 7f30f1ee9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30ec101530 0x7f30ec19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.635+0000 7f30f1ee9640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec19c3e0 con 0x7f30ec100c10 2024-09-13T18:41:06.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.635+0000 7f30f1ee9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec195960 con 0x7f30ec101530 2024-09-13T18:41:06.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.635+0000 7f30eb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30ec100c10 0x7f30ec19b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30eb7fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30ec100c10 0x7f30ec19b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47260/0 (socket says 172.21.15.38:47260) 2024-09-13T18:41:06.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30eb7fe640 1 -- 172.21.15.38:0/3220539759 learned_addr learned my addr 172.21.15.38:0/3220539759 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:06.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30eaffd640 1 --2- 172.21.15.38:0/3220539759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30ec101530 0x7f30ec19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30eb7fe640 1 -- 172.21.15.38:0/3220539759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30ec101530 msgr2=0x7f30ec19bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.640 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30eb7fe640 1 --2- 172.21.15.38:0/3220539759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30ec101530 0x7f30ec19bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30eb7fe640 1 -- 172.21.15.38:0/3220539759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d4009560 con 0x7f30ec100c10 2024-09-13T18:41:06.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30eaffd640 1 --2- 172.21.15.38:0/3220539759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30ec101530 0x7f30ec19bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:06.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30eb7fe640 1 --2- 172.21.15.38:0/3220539759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30ec100c10 0x7f30ec19b880 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00ba50 tx=0x7f30dc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30e8ff9640 1 -- 172.21.15.38:0/3220539759 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30dc00cb30 con 0x7f30ec100c10 2024-09-13T18:41:06.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30e8ff9640 1 -- 172.21.15.38:0/3220539759 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f30dc00cc90 con 0x7f30ec100c10 2024-09-13T18:41:06.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3220539759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ec195c40 con 0x7f30ec100c10 2024-09-13T18:41:06.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30e8ff9640 1 -- 172.21.15.38:0/3220539759 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30dc007690 con 0x7f30ec100c10 2024-09-13T18:41:06.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.636+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3220539759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ec1961a0 con 0x7f30ec100c10 2024-09-13T18:41:06.641 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.637+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3220539759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ec067cf0 con 0x7f30ec100c10 2024-09-13T18:41:06.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.638+0000 7f30e8ff9640 1 -- 172.21.15.38:0/3220539759 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f30dc014ae0 con 0x7f30ec100c10 2024-09-13T18:41:06.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.638+0000 7f30e8ff9640 1 --2- 172.21.15.38:0/3220539759 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f30d806cc50 0x7f30d806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.638+0000 7f30e8ff9640 1 -- 172.21.15.38:0/3220539759 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f30dc08c000 con 0x7f30ec100c10 2024-09-13T18:41:06.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.638+0000 7f30eaffd640 1 --2- 172.21.15.38:0/3220539759 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f30d806cc50 0x7f30d806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.642 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.639+0000 7f30eaffd640 1 --2- 172.21.15.38:0/3220539759 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f30d806cc50 0x7f30d806f110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f30ec196dd0 tx=0x7f30d4005a20 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.645 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.642+0000 7f30e8ff9640 1 -- 172.21.15.38:0/3220539759 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f30dc059b00 con 0x7f30ec100c10 2024-09-13T18:41:06.858 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.855+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3220539759 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f30ec104430 con 0x7f30ec100c10 2024-09-13T18:41:06.859 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.856+0000 7f30e8ff9640 1 -- 172.21.15.38:0/3220539759 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v37) v1 ==== 107+0+4846 (secure 0 0 0) 0x7f30dc059690 con 0x7f30ec100c10 2024-09-13T18:41:06.859 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:06.859 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44325,"name":"cephfs.smithi149.doanhj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6825/248866776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":248866776},{"type":"v1","addr":"172.21.15.149:6825","nonce":248866776}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":44353,"name":"cephfs.smithi149.zdzwzb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6827/3248503653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":3248503653},{"type":"v1","addr":"172.21.15.149:6827","nonce":3248503653}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:27:43.711588+0000","modified":"2024-09-13T18:37:41.627300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34352,"mds_1":34384},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34352":{"gid":34352,"name":"cephfs.smithi038.ubvgaq","rank":0,"incarnation":26,"state":"up:active","state_seq":8,"addr":"172.21.15.38:6827/3497551055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":3497551055},{"type":"v1","addr":"172.21.15.38:6827","nonce":3497551055}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34384":{"gid":34384,"name":"cephfs.smithi038.dtnkqo","rank":1,"incarnation":35,"state":"up:active","state_seq":12,"addr":"172.21.15.38:6829/3278914810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":3278914810},{"type":"v1","addr":"172.21.15.38:6829","nonce":3278914810}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:41:06.859 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 36 2024-09-13T18:41:06.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.858+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3220539759 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f30d806cc50 msgr2=0x7f30d806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.858+0000 7f30f1ee9640 1 --2- 172.21.15.38:0/3220539759 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f30d806cc50 0x7f30d806f110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f30ec196dd0 tx=0x7f30d4005a20 comp rx=0 tx=0).stop 2024-09-13T18:41:06.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.858+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3220539759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30ec100c10 msgr2=0x7f30ec19b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.858+0000 7f30f1ee9640 1 --2- 172.21.15.38:0/3220539759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30ec100c10 0x7f30ec19b880 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00ba50 tx=0x7f30dc00bf10 comp rx=0 tx=0).stop 2024-09-13T18:41:06.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.859+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3220539759 shutdown_connections 2024-09-13T18:41:06.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.859+0000 7f30f1ee9640 1 --2- 172.21.15.38:0/3220539759 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f30d806cc50 0x7f30d806f110 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.861 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.859+0000 7f30f1ee9640 1 --2- 172.21.15.38:0/3220539759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30ec101530 0x7f30ec19bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.859+0000 7f30f1ee9640 1 --2- 172.21.15.38:0/3220539759 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f30ec100c10 0x7f30ec19b880 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.859+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3220539759 >> 172.21.15.38:0/3220539759 conn(0x7f30ec075750 msgr2=0x7f30ec101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.859+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3220539759 shutdown_connections 2024-09-13T18:41:06.862 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:06.859+0000 7f30f1ee9640 1 -- 172.21.15.38:0/3220539759 wait complete. 2024-09-13T18:41:06.874 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T18:41:06.884 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T18:41:06.884 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:41:06.884 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:06.903 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-09-13T18:41:06.903 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:06.962 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:07.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.103+0000 7fa9af75e640 1 -- 172.21.15.38:0/2245922003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9a80ffa30 msgr2=0x7fa9a80ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.103+0000 7fa9af75e640 1 --2- 172.21.15.38:0/2245922003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9a80ffa30 0x7fa9a80ffe90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009880 tx=0x7fa99c02a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.103+0000 7fa9af75e640 1 -- 172.21.15.38:0/2245922003 shutdown_connections 2024-09-13T18:41:07.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.103+0000 7fa9af75e640 1 --2- 172.21.15.38:0/2245922003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9a80ffa30 0x7fa9a80ffe90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.108 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.103+0000 7fa9af75e640 1 --2- 172.21.15.38:0/2245922003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9a8105a40 0x7fa9a8105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.103+0000 7fa9af75e640 1 -- 172.21.15.38:0/2245922003 >> 172.21.15.38:0/2245922003 conn(0x7fa9a80fb710 msgr2=0x7fa9a80fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.104+0000 7fa9af75e640 1 -- 172.21.15.38:0/2245922003 shutdown_connections 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.104+0000 7fa9af75e640 1 -- 172.21.15.38:0/2245922003 wait complete. 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.104+0000 7fa9af75e640 1 Processor -- start 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.104+0000 7fa9af75e640 1 -- start start 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.104+0000 7fa9af75e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9a80ffa30 0x7fa9a819b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.104+0000 7fa9af75e640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9a8105a40 0x7fa9a819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.104+0000 7fa9af75e640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a81957b0 con 0x7fa9a8105a40 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.104+0000 7fa9af75e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a8195920 con 0x7fa9a80ffa30 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9accf9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9a8105a40 0x7fa9a819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9accf9640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9a8105a40 0x7fa9a819bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47278/0 (socket says 172.21.15.38:47278) 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9accf9640 1 -- 172.21.15.38:0/2460320827 learned_addr learned my addr 172.21.15.38:0/2460320827 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9ad4fa640 1 --2- 172.21.15.38:0/2460320827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9a80ffa30 0x7fa9a819b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9accf9640 1 -- 172.21.15.38:0/2460320827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9a80ffa30 msgr2=0x7fa9a819b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9accf9640 1 --2- 172.21.15.38:0/2460320827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9a80ffa30 0x7fa9a819b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9accf9640 1 -- 172.21.15.38:0/2460320827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c009560 con 0x7fa9a8105a40 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9accf9640 1 --2- 172.21.15.38:0/2460320827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9a8105a40 0x7fa9a819bc10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa99c02a9c0 tx=0x7fa99c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9a67fc640 1 -- 172.21.15.38:0/2460320827 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa99c004b60 con 0x7fa9a8105a40 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9a67fc640 1 -- 172.21.15.38:0/2460320827 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa99c004cc0 con 0x7fa9a8105a40 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9af75e640 1 -- 172.21.15.38:0/2460320827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a8195ba0 con 0x7fa9a8105a40 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9a67fc640 1 -- 172.21.15.38:0/2460320827 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa99c031950 con 0x7fa9a8105a40 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.105+0000 7fa9af75e640 1 -- 172.21.15.38:0/2460320827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a81960a0 con 0x7fa9a8105a40 2024-09-13T18:41:07.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.106+0000 7fa9af75e640 1 -- 172.21.15.38:0/2460320827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a8101170 con 0x7fa9a8105a40 2024-09-13T18:41:07.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.107+0000 7fa9a67fc640 1 -- 172.21.15.38:0/2460320827 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa99c003c20 con 0x7fa9a8105a40 2024-09-13T18:41:07.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.107+0000 7fa9a67fc640 1 --2- 172.21.15.38:0/2460320827 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa99006cc50 0x7fa99006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.107+0000 7fa9a67fc640 1 -- 172.21.15.38:0/2460320827 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fa99c0ad6c0 con 0x7fa9a8105a40 2024-09-13T18:41:07.111 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.107+0000 7fa9ad4fa640 1 --2- 172.21.15.38:0/2460320827 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa99006cc50 0x7fa99006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.112 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.108+0000 7fa9ad4fa640 1 --2- 172.21.15.38:0/2460320827 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa99006cc50 0x7fa99006f110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa998005fd0 tx=0x7fa998009870 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:07.113 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.111+0000 7fa9a67fc640 1 -- 172.21.15.38:0/2460320827 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa99c077700 con 0x7fa9a8105a40 2024-09-13T18:41:07.288 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.286+0000 7fa9af75e640 1 -- 172.21.15.38:0/2460320827 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9a80ffe90 con 0x7fa9a8105a40 2024-09-13T18:41:07.289 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.287+0000 7fa9a67fc640 1 -- 172.21.15.38:0/2460320827 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16598 (secure 0 0 0) 0x7fa99c004e30 con 0x7fa9a8105a40 2024-09-13T18:41:07.289 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:07.289 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":97,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","created":"2024-09-13T18:20:45.975848+0000","modified":"2024-09-13T18:37:28.933737+0000","last_up_change":"2024-09-13T18:35:58.959011+0000","last_in_change":"2024-09-13T18:26:05.887130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:25:13.672723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-09-13T18:27:42.648350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-09-13T18:27:43.137400+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8245ff4-3301-430c-a290-6000dfd0807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":59,"up_thru":92,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3683619056},{"type":"v1","addr":"172.21.15.38:6803","nonce":3683619056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3683619056},{"type":"v1","addr":"172.21.15.38:6805","nonce":3683619056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3683619056},{"type":"v1","addr":"172.21.15.38:6809","nonce":3683619056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3683619056},{"type":"v1","addr":"172.21.15.38:6807","nonce":3683619056}]},"public_addr":"172.21.15.38:6803/3683619056","cluster_addr":"172.21.15.38:6805/3683619056","heartbeat_back_addr":"172.21.15.38:6809/3683619056","heartbeat_front_addr":"172.21.15.38:6807/3683619056","state":["exists","up"]},{"osd":1,"uuid":"1518b6f4-6e5f-445f-b0cd-2ebaecb3c203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":68,"up_from":72,"up_thru":92,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3218305916},{"type":"v1","addr":"172.21.15.38:6811","nonce":3218305916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3218305916},{"type":"v1","addr":"172.21.15.38:6813","nonce":3218305916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":3218305916},{"type":"v1","addr":"172.21.15.38:6817","nonce":3218305916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3218305916},{"type":"v1","addr":"172.21.15.38:6815","nonce":3218305916}]},"public_addr":"172.21.15.38:6811/3218305916","cluster_addr":"172.21.15.38:6813/3218305916","heartbeat_back_addr":"172.21.15.38:6817/3218305916","heartbeat_front_addr":"172.21.15.38:6815/3218305916","state":["exists","up"]},{"osd":2,"uuid":"43ebe637-fa97-4ac6-b85e-01440f6ca6eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":73,"up_from":77,"up_thru":92,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1124081148},{"type":"v1","addr":"172.21.15.38:6819","nonce":1124081148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1124081148},{"type":"v1","addr":"172.21.15.38:6821","nonce":1124081148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1124081148},{"type":"v1","addr":"172.21.15.38:6825","nonce":1124081148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1124081148},{"type":"v1","addr":"172.21.15.38:6823","nonce":1124081148}]},"public_addr":"172.21.15.38:6819/1124081148","cluster_addr":"172.21.15.38:6821/1124081148","heartbeat_back_addr":"172.21.15.38:6825/1124081148","heartbeat_front_addr":"172.21.15.38:6823/1124081148","state":["exists","up"]},{"osd":3,"uuid":"5ffdedaf-95c7-45b3-9af6-36b5a74d60f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":78,"up_from":82,"up_thru":92,"down_at":79,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3674321522},{"type":"v1","addr":"172.21.15.149:6801","nonce":3674321522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3674321522},{"type":"v1","addr":"172.21.15.149:6803","nonce":3674321522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3674321522},{"type":"v1","addr":"172.21.15.149:6807","nonce":3674321522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3674321522},{"type":"v1","addr":"172.21.15.149:6805","nonce":3674321522}]},"public_addr":"172.21.15.149:6801/3674321522","cluster_addr":"172.21.15.149:6803/3674321522","heartbeat_back_addr":"172.21.15.149:6807/3674321522","heartbeat_front_addr":"172.21.15.149:6805/3674321522","state":["exists","up"]},{"osd":4,"uuid":"e91e0c22-0686-45ef-a8b3-a356ab76eb88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":83,"up_from":87,"up_thru":92,"down_at":84,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":275970326},{"type":"v1","addr":"172.21.15.149:6809","nonce":275970326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":275970326},{"type":"v1","addr":"172.21.15.149:6811","nonce":275970326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":275970326},{"type":"v1","addr":"172.21.15.149:6815","nonce":275970326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":275970326},{"type":"v1","addr":"172.21.15.149:6813","nonce":275970326}]},"public_addr":"172.21.15.149:6809/275970326","cluster_addr":"172.21.15.149:6811/275970326","heartbeat_back_addr":"172.21.15.149:6815/275970326","heartbeat_front_addr":"172.21.15.149:6813/275970326","state":["exists","up"]},{"osd":5,"uuid":"ad710f6e-dbff-455c-8a67-7aca4ab8a56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":88,"up_from":92,"up_thru":92,"down_at":89,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3302600515},{"type":"v1","addr":"172.21.15.149:6817","nonce":3302600515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":3302600515},{"type":"v1","addr":"172.21.15.149:6819","nonce":3302600515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":3302600515},{"type":"v1","addr":"172.21.15.149:6823","nonce":3302600515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3302600515},{"type":"v1","addr":"172.21.15.149:6821","nonce":3302600515}]},"public_addr":"172.21.15.149:6817/3302600515","cluster_addr":"172.21.15.149:6819/3302600515","heartbeat_back_addr":"172.21.15.149:6823/3302600515","heartbeat_front_addr":"172.21.15.149:6821/3302600515","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:11.540858+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.374275+0000","dead_epoch":68},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:10.472792+0000","dead_epoch":73},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:33.374560+0000","dead_epoch":78},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:58.381692+0000","dead_epoch":83},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:22.772809+0000","dead_epoch":88}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":3,"to":0}]},{"pgid":"2.12","mappings":[{"from":3,"to":2}]},{"pgid":"2.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.9","mappings":[{"from":4,"to":0}]},{"pgid":"3.a","mappings":[{"from":3,"to":0}]},{"pgid":"3.14","mappings":[{"from":4,"to":0}]},{"pgid":"3.16","mappings":[{"from":1,"to":0}]},{"pgid":"3.19","mappings":[{"from":1,"to":0}]},{"pgid":"3.1b","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6829/1171569676":"2024-09-14T18:36:50.313844+0000","172.21.15.38:6828/1171569676":"2024-09-14T18:36:50.313844+0000","172.21.15.38:0/1704785391":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6827/1032191718":"2024-09-14T18:27:59.313642+0000","172.21.15.38:0/2217216874":"2024-09-14T18:30:00.433046+0000","172.21.15.38:6826/1032191718":"2024-09-14T18:27:59.313642+0000","172.21.15.38:6800/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.38:6801/2302807265":"2024-09-14T18:30:00.433046+0000","172.21.15.149:0/1027981355":"2024-09-14T18:31:06.334407+0000","172.21.15.38:6801/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:0/3449425844":"2024-09-14T18:30:00.433046+0000","172.21.15.149:0/3464598559":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/1699958329":"2024-09-14T18:21:45.526804+0000","172.21.15.149:6829/2070517292":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/2793935378":"2024-09-14T18:21:07.813395+0000","172.21.15.149:0/3013293122":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/1884863821":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/2254155782":"2024-09-14T18:30:00.433046+0000","172.21.15.38:0/954446429":"2024-09-14T18:30:00.433046+0000","172.21.15.38:0/1436289281":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6800/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6800/1869434741":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/3719380288":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/1458254215":"2024-09-14T18:21:45.526804+0000","172.21.15.149:6828/2070517292":"2024-09-14T18:31:06.334407+0000","172.21.15.38:6801/1869434741":"2024-09-14T18:22:55.167215+0000","172.21.15.149:0/957353854":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/3421440666":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6801/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.149:0/3965866":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/133472565":"2024-09-14T18:21:45.526804+0000","172.21.15.149:0/3877995726":"2024-09-14T18:31:06.334407+0000","172.21.15.38:6800/2302807265":"2024-09-14T18:30:00.433046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:07.291 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.289+0000 7fa9af75e640 1 -- 172.21.15.38:0/2460320827 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa99006cc50 msgr2=0x7fa99006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.289+0000 7fa9af75e640 1 --2- 172.21.15.38:0/2460320827 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa99006cc50 0x7fa99006f110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa998005fd0 tx=0x7fa998009870 comp rx=0 tx=0).stop 2024-09-13T18:41:07.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.289+0000 7fa9af75e640 1 -- 172.21.15.38:0/2460320827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9a8105a40 msgr2=0x7fa9a819bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.289+0000 7fa9af75e640 1 --2- 172.21.15.38:0/2460320827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9a8105a40 0x7fa9a819bc10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa99c02a9c0 tx=0x7fa99c0055a0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.289+0000 7fa9af75e640 1 -- 172.21.15.38:0/2460320827 shutdown_connections 2024-09-13T18:41:07.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.289+0000 7fa9af75e640 1 --2- 172.21.15.38:0/2460320827 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa9a8105a40 0x7fa9a819bc10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.289+0000 7fa9af75e640 1 --2- 172.21.15.38:0/2460320827 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa99006cc50 0x7fa99006f110 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.289+0000 7fa9af75e640 1 --2- 172.21.15.38:0/2460320827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9a80ffa30 0x7fa9a819b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.289+0000 7fa9af75e640 1 -- 172.21.15.38:0/2460320827 >> 172.21.15.38:0/2460320827 conn(0x7fa9a80fb710 msgr2=0x7fa9a80fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:07.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.289+0000 7fa9af75e640 1 -- 172.21.15.38:0/2460320827 shutdown_connections 2024-09-13T18:41:07.292 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.289+0000 7fa9af75e640 1 -- 172.21.15.38:0/2460320827 wait complete. 2024-09-13T18:41:07.301 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:07 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3426277098' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T18:41:07.301 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:41:07.301 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:07 smithi038 ceph-mon[91522]: pgmap v351: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:41:07.301 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:07 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1360334238' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T18:41:07.301 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:41:07.301 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:07 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3220539759' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T18:41:07.301 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:41:07.301 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:41:07.301 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:07 smithi038 ceph-mon[91522]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:41:07.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:25:13.672723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-09-13T18:27:42.648350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-09-13T18:27:43.137400+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:41:07.303 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:41:07.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.409+0000 7f5abed9c640 1 -- 172.21.15.38:0/3123802518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ab80ffa00 msgr2=0x7f5ab80ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.409+0000 7f5abed9c640 1 --2- 172.21.15.38:0/3123802518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ab80ffa00 0x7f5ab80ffe60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009880 tx=0x7f5aa402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.409+0000 7f5abed9c640 1 -- 172.21.15.38:0/3123802518 shutdown_connections 2024-09-13T18:41:07.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.409+0000 7f5abed9c640 1 --2- 172.21.15.38:0/3123802518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ab80ffa00 0x7f5ab80ffe60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.409+0000 7f5abed9c640 1 --2- 172.21.15.38:0/3123802518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ab8105a10 0x7f5ab8105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.409+0000 7f5abed9c640 1 -- 172.21.15.38:0/3123802518 >> 172.21.15.38:0/3123802518 conn(0x7f5ab80fb6e0 msgr2=0x7f5ab80fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:07.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.409+0000 7f5abed9c640 1 -- 172.21.15.38:0/3123802518 shutdown_connections 2024-09-13T18:41:07.412 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.409+0000 7f5abed9c640 1 -- 172.21.15.38:0/3123802518 wait complete. 2024-09-13T18:41:07.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5abed9c640 1 Processor -- start 2024-09-13T18:41:07.413 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5abed9c640 1 -- start start 2024-09-13T18:41:07.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5abed9c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ab80ffa00 0x7f5ab819b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5abed9c640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ab8105a10 0x7f5ab819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5abed9c640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab81957c0 con 0x7f5ab8105a10 2024-09-13T18:41:07.414 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5abed9c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8195930 con 0x7f5ab80ffa00 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5ab7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ab8105a10 0x7f5ab819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5ab7fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ab8105a10 0x7f5ab819bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47290/0 (socket says 172.21.15.38:47290) 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5ab7fff640 1 -- 172.21.15.38:0/3239632792 learned_addr learned my addr 172.21.15.38:0/3239632792 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5abcb38640 1 --2- 172.21.15.38:0/3239632792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ab80ffa00 0x7f5ab819b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5ab7fff640 1 -- 172.21.15.38:0/3239632792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ab80ffa00 msgr2=0x7f5ab819b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5ab7fff640 1 --2- 172.21.15.38:0/3239632792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ab80ffa00 0x7f5ab819b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.410+0000 7f5ab7fff640 1 -- 172.21.15.38:0/3239632792 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa4009560 con 0x7f5ab8105a10 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.411+0000 7f5ab7fff640 1 --2- 172.21.15.38:0/3239632792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ab8105a10 0x7f5ab819bc20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5aa402a9c0 tx=0x7f5aa40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.411+0000 7f5ab5ffb640 1 -- 172.21.15.38:0/3239632792 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa4004b60 con 0x7f5ab8105a10 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.411+0000 7f5abed9c640 1 -- 172.21.15.38:0/3239632792 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab8195bb0 con 0x7f5ab8105a10 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.411+0000 7f5ab5ffb640 1 -- 172.21.15.38:0/3239632792 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5aa4004cc0 con 0x7f5ab8105a10 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.411+0000 7f5ab5ffb640 1 -- 172.21.15.38:0/3239632792 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa4031950 con 0x7f5ab8105a10 2024-09-13T18:41:07.415 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.411+0000 7f5abed9c640 1 -- 172.21.15.38:0/3239632792 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab81960b0 con 0x7f5ab8105a10 2024-09-13T18:41:07.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.412+0000 7f5abed9c640 1 -- 172.21.15.38:0/3239632792 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab8101140 con 0x7f5ab8105a10 2024-09-13T18:41:07.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.413+0000 7f5ab5ffb640 1 -- 172.21.15.38:0/3239632792 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5aa4003c20 con 0x7f5ab8105a10 2024-09-13T18:41:07.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.413+0000 7f5ab5ffb640 1 --2- 172.21.15.38:0/3239632792 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5aa806cc50 0x7f5aa806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.416 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.413+0000 7f5ab5ffb640 1 -- 172.21.15.38:0/3239632792 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f5aa40ad6e0 con 0x7f5ab8105a10 2024-09-13T18:41:07.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.413+0000 7f5abcb38640 1 --2- 172.21.15.38:0/3239632792 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5aa806cc50 0x7f5aa806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.417 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.414+0000 7f5abcb38640 1 --2- 172.21.15.38:0/3239632792 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5aa806cc50 0x7f5aa806f110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00bbe0 tx=0x7f5aac00b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:07.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.421+0000 7f5ab5ffb640 1 -- 172.21.15.38:0/3239632792 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5aa4077750 con 0x7f5ab8105a10 2024-09-13T18:41:07.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:07 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3426277098' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T18:41:07.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:41:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:07 smithi149 ceph-mon[76906]: pgmap v351: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T18:41:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:07 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1360334238' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T18:41:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T18:41:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:07 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3220539759' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T18:41:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:41:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:41:07.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:07 smithi149 ceph-mon[76906]: from='mgr.14726 172.21.15.38:0/3741941537' entity='mgr.smithi038.jeygoq' 2024-09-13T18:41:07.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.592+0000 7f5abed9c640 1 -- 172.21.15.38:0/3239632792 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ab8196cd0 con 0x7f5ab8105a10 2024-09-13T18:41:07.595 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.593+0000 7f5ab5ffb640 1 -- 172.21.15.38:0/3239632792 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5aa407ad70 con 0x7f5ab8105a10 2024-09-13T18:41:07.596 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-09-13T18:41:07.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.595+0000 7f5abed9c640 1 -- 172.21.15.38:0/3239632792 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5aa806cc50 msgr2=0x7f5aa806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.595+0000 7f5abed9c640 1 --2- 172.21.15.38:0/3239632792 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5aa806cc50 0x7f5aa806f110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00bbe0 tx=0x7f5aac00b390 comp rx=0 tx=0).stop 2024-09-13T18:41:07.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.595+0000 7f5abed9c640 1 -- 172.21.15.38:0/3239632792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ab8105a10 msgr2=0x7f5ab819bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.595+0000 7f5abed9c640 1 --2- 172.21.15.38:0/3239632792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ab8105a10 0x7f5ab819bc20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5aa402a9c0 tx=0x7f5aa40055a0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.595+0000 7f5abed9c640 1 -- 172.21.15.38:0/3239632792 shutdown_connections 2024-09-13T18:41:07.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.595+0000 7f5abed9c640 1 --2- 172.21.15.38:0/3239632792 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5ab8105a10 0x7f5ab819bc20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.595+0000 7f5abed9c640 1 --2- 172.21.15.38:0/3239632792 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f5aa806cc50 0x7f5aa806f110 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.595+0000 7f5abed9c640 1 --2- 172.21.15.38:0/3239632792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ab80ffa00 0x7f5ab819b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.595+0000 7f5abed9c640 1 -- 172.21.15.38:0/3239632792 >> 172.21.15.38:0/3239632792 conn(0x7f5ab80fb6e0 msgr2=0x7f5ab80fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:07.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.595+0000 7f5abed9c640 1 -- 172.21.15.38:0/3239632792 shutdown_connections 2024-09-13T18:41:07.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.595+0000 7f5abed9c640 1 -- 172.21.15.38:0/3239632792 wait complete. 2024-09-13T18:41:07.608 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-09-13T18:41:07.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.713+0000 7fbba6595640 1 -- 172.21.15.38:0/2919524168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba0100be0 msgr2=0x7fbba0100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.713+0000 7fbba6595640 1 --2- 172.21.15.38:0/2919524168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba0100be0 0x7fbba0100fc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbb90009880 tx=0x7fbb9002a530 comp rx=0 tx=0).stop 2024-09-13T18:41:07.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.713+0000 7fbba6595640 1 -- 172.21.15.38:0/2919524168 shutdown_connections 2024-09-13T18:41:07.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.713+0000 7fbba6595640 1 --2- 172.21.15.38:0/2919524168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbba0101500 0x7fbba01099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.713+0000 7fbba6595640 1 --2- 172.21.15.38:0/2919524168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba0100be0 0x7fbba0100fc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.713+0000 7fbba6595640 1 -- 172.21.15.38:0/2919524168 >> 172.21.15.38:0/2919524168 conn(0x7fbba00757b0 msgr2=0x7fbba00fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:07.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.713+0000 7fbba6595640 1 -- 172.21.15.38:0/2919524168 shutdown_connections 2024-09-13T18:41:07.716 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.713+0000 7fbba6595640 1 -- 172.21.15.38:0/2919524168 wait complete. 2024-09-13T18:41:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.714+0000 7fbba6595640 1 Processor -- start 2024-09-13T18:41:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.714+0000 7fbba6595640 1 -- start start 2024-09-13T18:41:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.714+0000 7fbba6595640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba0100be0 0x7fbba019b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.714+0000 7fbba6595640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbba0101500 0x7fbba019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.714+0000 7fbba6595640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba01957d0 con 0x7fbba0100be0 2024-09-13T18:41:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.714+0000 7fbba6595640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba0195940 con 0x7fbba0101500 2024-09-13T18:41:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.714+0000 7fbb9ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba0100be0 0x7fbba019b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.714+0000 7fbb9ffff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba0100be0 0x7fbba019b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47296/0 (socket says 172.21.15.38:47296) 2024-09-13T18:41:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.714+0000 7fbb9ffff640 1 -- 172.21.15.38:0/1466693120 learned_addr learned my addr 172.21.15.38:0/1466693120 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.714+0000 7fbb9f7fe640 1 --2- 172.21.15.38:0/1466693120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbba0101500 0x7fbba019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.715+0000 7fbb9ffff640 1 -- 172.21.15.38:0/1466693120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbba0101500 msgr2=0x7fbba019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.715+0000 7fbb9ffff640 1 --2- 172.21.15.38:0/1466693120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbba0101500 0x7fbba019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.715+0000 7fbb9ffff640 1 -- 172.21.15.38:0/1466693120 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90009560 con 0x7fbba0100be0 2024-09-13T18:41:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.715+0000 7fbb9f7fe640 1 --2- 172.21.15.38:0/1466693120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbba0101500 0x7fbba019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.715+0000 7fbb9ffff640 1 --2- 172.21.15.38:0/1466693120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba0100be0 0x7fbba019b6f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbb9002aa50 tx=0x7fbb900055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.715+0000 7fbb9d7fa640 1 -- 172.21.15.38:0/1466693120 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb90004aa0 con 0x7fbba0100be0 2024-09-13T18:41:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.715+0000 7fbba6595640 1 -- 172.21.15.38:0/1466693120 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba0195bc0 con 0x7fbba0100be0 2024-09-13T18:41:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.715+0000 7fbb9d7fa640 1 -- 172.21.15.38:0/1466693120 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb90004c00 con 0x7fbba0100be0 2024-09-13T18:41:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.715+0000 7fbb9d7fa640 1 -- 172.21.15.38:0/1466693120 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb90031750 con 0x7fbba0100be0 2024-09-13T18:41:07.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.715+0000 7fbba6595640 1 -- 172.21.15.38:0/1466693120 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba01960c0 con 0x7fbba0100be0 2024-09-13T18:41:07.720 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.716+0000 7fbba6595640 1 -- 172.21.15.38:0/1466693120 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba0067d30 con 0x7fbba0100be0 2024-09-13T18:41:07.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.717+0000 7fbb9d7fa640 1 -- 172.21.15.38:0/1466693120 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbb9002ad50 con 0x7fbba0100be0 2024-09-13T18:41:07.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.717+0000 7fbb9d7fa640 1 --2- 172.21.15.38:0/1466693120 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbb8806cc60 0x7fbb8806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.717+0000 7fbb9d7fa640 1 -- 172.21.15.38:0/1466693120 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fbb900ad3e0 con 0x7fbba0100be0 2024-09-13T18:41:07.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.717+0000 7fbb9f7fe640 1 --2- 172.21.15.38:0/1466693120 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbb8806cc60 0x7fbb8806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.718+0000 7fbb9f7fe640 1 --2- 172.21.15.38:0/1466693120 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbb8806cc60 0x7fbb8806f120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbba0196c40 tx=0x7fbb94005f90 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:07.724 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.722+0000 7fbb9d7fa640 1 -- 172.21.15.38:0/1466693120 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbb900773a0 con 0x7fbba0100be0 2024-09-13T18:41:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.912+0000 7fbba6595640 1 -- 172.21.15.38:0/1466693120 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fbba0104370 con 0x7fbba0100be0 2024-09-13T18:41:07.915 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.913+0000 7fbb9d7fa640 1 -- 172.21.15.38:0/1466693120 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v97) v1 ==== 107+0+11 (secure 0 0 0) 0x7fbb9007a9c0 con 0x7fbba0100be0 2024-09-13T18:41:07.915 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-13T18:41:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.914+0000 7fbba6595640 1 -- 172.21.15.38:0/1466693120 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbb8806cc60 msgr2=0x7fbb8806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.914+0000 7fbba6595640 1 --2- 172.21.15.38:0/1466693120 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbb8806cc60 0x7fbb8806f120 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbba0196c40 tx=0x7fbb94005f90 comp rx=0 tx=0).stop 2024-09-13T18:41:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.914+0000 7fbba6595640 1 -- 172.21.15.38:0/1466693120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba0100be0 msgr2=0x7fbba019b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.914+0000 7fbba6595640 1 --2- 172.21.15.38:0/1466693120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba0100be0 0x7fbba019b6f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbb9002aa50 tx=0x7fbb900055a0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.917 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.915+0000 7fbba6595640 1 -- 172.21.15.38:0/1466693120 shutdown_connections 2024-09-13T18:41:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.915+0000 7fbba6595640 1 --2- 172.21.15.38:0/1466693120 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fbb8806cc60 0x7fbb8806f120 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.915+0000 7fbba6595640 1 --2- 172.21.15.38:0/1466693120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbba0101500 0x7fbba019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.915+0000 7fbba6595640 1 --2- 172.21.15.38:0/1466693120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbba0100be0 0x7fbba019b6f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.915+0000 7fbba6595640 1 -- 172.21.15.38:0/1466693120 >> 172.21.15.38:0/1466693120 conn(0x7fbba00757b0 msgr2=0x7fbba0101ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.915+0000 7fbba6595640 1 -- 172.21.15.38:0/1466693120 shutdown_connections 2024-09-13T18:41:07.918 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:07.915+0000 7fbba6595640 1 -- 172.21.15.38:0/1466693120 wait complete. 2024-09-13T18:41:07.929 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-09-13T18:41:08.038 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.034+0000 7f6c08ad0640 1 -- 172.21.15.38:0/2560023390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c040fe910 msgr2=0x7f6c040fed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.034+0000 7f6c08ad0640 1 --2- 172.21.15.38:0/2560023390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c040fe910 0x7f6c040fed70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009880 tx=0x7f6bf802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.035+0000 7f6c08ad0640 1 -- 172.21.15.38:0/2560023390 shutdown_connections 2024-09-13T18:41:08.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.035+0000 7f6c08ad0640 1 --2- 172.21.15.38:0/2560023390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c040fe910 0x7f6c040fed70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.035+0000 7f6c08ad0640 1 --2- 172.21.15.38:0/2560023390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c04104920 0x7f6c04104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.035+0000 7f6c08ad0640 1 -- 172.21.15.38:0/2560023390 >> 172.21.15.38:0/2560023390 conn(0x7f6c040757b0 msgr2=0x7f6c040fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:08.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.035+0000 7f6c08ad0640 1 -- 172.21.15.38:0/2560023390 shutdown_connections 2024-09-13T18:41:08.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.035+0000 7f6c08ad0640 1 -- 172.21.15.38:0/2560023390 wait complete. 2024-09-13T18:41:08.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.035+0000 7f6c08ad0640 1 Processor -- start 2024-09-13T18:41:08.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.035+0000 7f6c08ad0640 1 -- start start 2024-09-13T18:41:08.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6c08ad0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c040fe910 0x7f6c04196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.039 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6c08ad0640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c04104920 0x7f6c04196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6c08ad0640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04197340 con 0x7f6c04104920 2024-09-13T18:41:08.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6c08ad0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c041974b0 con 0x7f6c040fe910 2024-09-13T18:41:08.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6c01d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c04104920 0x7f6c04196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6c01d9b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c04104920 0x7f6c04196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47322/0 (socket says 172.21.15.38:47322) 2024-09-13T18:41:08.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6c01d9b640 1 -- 172.21.15.38:0/201200687 learned_addr learned my addr 172.21.15.38:0/201200687 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:08.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6c0259c640 1 --2- 172.21.15.38:0/201200687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c040fe910 0x7f6c04196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6c01d9b640 1 -- 172.21.15.38:0/201200687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c040fe910 msgr2=0x7f6c04196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6c01d9b640 1 --2- 172.21.15.38:0/201200687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c040fe910 0x7f6c04196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6c01d9b640 1 -- 172.21.15.38:0/201200687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf8009560 con 0x7f6c04104920 2024-09-13T18:41:08.040 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6c01d9b640 1 --2- 172.21.15.38:0/201200687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c04104920 0x7f6c04196d70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6bf802a9c0 tx=0x7f6bf80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:08.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.036+0000 7f6bf37fe640 1 -- 172.21.15.38:0/201200687 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf8004b60 con 0x7f6c04104920 2024-09-13T18:41:08.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.037+0000 7f6bf37fe640 1 -- 172.21.15.38:0/201200687 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6bf8004cc0 con 0x7f6c04104920 2024-09-13T18:41:08.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.037+0000 7f6c08ad0640 1 -- 172.21.15.38:0/201200687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0419f8a0 con 0x7f6c04104920 2024-09-13T18:41:08.043 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.037+0000 7f6bf37fe640 1 -- 172.21.15.38:0/201200687 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf8031950 con 0x7f6c04104920 2024-09-13T18:41:08.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.037+0000 7f6c08ad0640 1 -- 172.21.15.38:0/201200687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0419fc60 con 0x7f6c04104920 2024-09-13T18:41:08.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.038+0000 7f6c08ad0640 1 -- 172.21.15.38:0/201200687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c04100050 con 0x7f6c04104920 2024-09-13T18:41:08.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.039+0000 7f6bf37fe640 1 -- 172.21.15.38:0/201200687 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6bf8003c20 con 0x7f6c04104920 2024-09-13T18:41:08.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.039+0000 7f6bf37fe640 1 --2- 172.21.15.38:0/201200687 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6bec06cc60 0x7f6bec06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.039+0000 7f6bf37fe640 1 -- 172.21.15.38:0/201200687 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f6bf80add00 con 0x7f6c04104920 2024-09-13T18:41:08.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.039+0000 7f6c0259c640 1 --2- 172.21.15.38:0/201200687 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6bec06cc60 0x7f6bec06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.044 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.040+0000 7f6c0259c640 1 --2- 172.21.15.38:0/201200687 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6bec06cc60 0x7f6bec06f120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4005fd0 tx=0x7f6bf400b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:08.045 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.043+0000 7f6bf37fe640 1 -- 172.21.15.38:0/201200687 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6bf8077df0 con 0x7f6c04104920 2024-09-13T18:41:08.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.213+0000 7f6c08ad0640 1 -- 172.21.15.38:0/201200687 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f6c04106f40 con 0x7f6c04104920 2024-09-13T18:41:08.216 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.213+0000 7f6bf37fe640 1 -- 172.21.15.38:0/201200687 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v97) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6bf8040020 con 0x7f6c04104920 2024-09-13T18:41:08.216 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-13T18:41:08.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.216+0000 7f6c08ad0640 1 -- 172.21.15.38:0/201200687 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6bec06cc60 msgr2=0x7f6bec06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.216+0000 7f6c08ad0640 1 --2- 172.21.15.38:0/201200687 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6bec06cc60 0x7f6bec06f120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4005fd0 tx=0x7f6bf400b390 comp rx=0 tx=0).stop 2024-09-13T18:41:08.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.216+0000 7f6c08ad0640 1 -- 172.21.15.38:0/201200687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c04104920 msgr2=0x7f6c04196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.216+0000 7f6c08ad0640 1 --2- 172.21.15.38:0/201200687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c04104920 0x7f6c04196d70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6bf802a9c0 tx=0x7f6bf80055a0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.216+0000 7f6c08ad0640 1 -- 172.21.15.38:0/201200687 shutdown_connections 2024-09-13T18:41:08.218 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.216+0000 7f6c08ad0640 1 --2- 172.21.15.38:0/201200687 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c04104920 0x7f6c04196d70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.216+0000 7f6c08ad0640 1 --2- 172.21.15.38:0/201200687 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f6bec06cc60 0x7f6bec06f120 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.216+0000 7f6c08ad0640 1 --2- 172.21.15.38:0/201200687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c040fe910 0x7f6c04196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.216+0000 7f6c08ad0640 1 -- 172.21.15.38:0/201200687 >> 172.21.15.38:0/201200687 conn(0x7f6c040757b0 msgr2=0x7f6c040fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.216+0000 7f6c08ad0640 1 -- 172.21.15.38:0/201200687 shutdown_connections 2024-09-13T18:41:08.219 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.216+0000 7f6c08ad0640 1 -- 172.21.15.38:0/201200687 wait complete. 2024-09-13T18:41:08.228 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:08 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2460320827' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:41:08.228 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:08 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3239632792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:41:08.228 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:08 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1466693120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T18:41:08.229 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:41:08.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:08 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2460320827' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:41:08.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:08 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3239632792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:41:08.270 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:08 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1466693120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T18:41:08.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.330+0000 7f1604620640 1 -- 172.21.15.38:0/4200490278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15fc104920 msgr2=0x7f15fc104d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.330+0000 7f1604620640 1 --2- 172.21.15.38:0/4200490278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15fc104920 0x7f15fc104d00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009880 tx=0x7f15f802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.330+0000 7f1604620640 1 -- 172.21.15.38:0/4200490278 shutdown_connections 2024-09-13T18:41:08.333 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.330+0000 7f1604620640 1 --2- 172.21.15.38:0/4200490278 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15fc0fe910 0x7f15fc0fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.330+0000 7f1604620640 1 --2- 172.21.15.38:0/4200490278 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15fc104920 0x7f15fc104d00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.330+0000 7f1604620640 1 -- 172.21.15.38:0/4200490278 >> 172.21.15.38:0/4200490278 conn(0x7f15fc0757b0 msgr2=0x7f15fc0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:08.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.331+0000 7f1604620640 1 -- 172.21.15.38:0/4200490278 shutdown_connections 2024-09-13T18:41:08.334 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.331+0000 7f1604620640 1 -- 172.21.15.38:0/4200490278 wait complete. 2024-09-13T18:41:08.335 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.331+0000 7f1604620640 1 Processor -- start 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.331+0000 7f1604620640 1 -- start start 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f1604620640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15fc0fe910 0x7f15fc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f1604620640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15fc104920 0x7f15fc19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f1604620640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc19b110 con 0x7f15fc0fe910 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f1604620640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc194690 con 0x7f15fc104920 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f16023bc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15fc0fe910 0x7f15fc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f16023bc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15fc0fe910 0x7f15fc19a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47344/0 (socket says 172.21.15.38:47344) 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f16023bc640 1 -- 172.21.15.38:0/3851571720 learned_addr learned my addr 172.21.15.38:0/3851571720 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f1601bbb640 1 --2- 172.21.15.38:0/3851571720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15fc104920 0x7f15fc19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f16023bc640 1 -- 172.21.15.38:0/3851571720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15fc104920 msgr2=0x7f15fc19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f16023bc640 1 --2- 172.21.15.38:0/3851571720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15fc104920 0x7f15fc19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f16023bc640 1 -- 172.21.15.38:0/3851571720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f8009560 con 0x7f15fc0fe910 2024-09-13T18:41:08.336 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f16023bc640 1 --2- 172.21.15.38:0/3851571720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15fc0fe910 0x7f15fc19a5b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f15f802a9c0 tx=0x7f15f80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:08.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f15f37fe640 1 -- 172.21.15.38:0/3851571720 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15f8004b60 con 0x7f15fc0fe910 2024-09-13T18:41:08.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f15f37fe640 1 -- 172.21.15.38:0/3851571720 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f15f8004cc0 con 0x7f15fc0fe910 2024-09-13T18:41:08.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f1604620640 1 -- 172.21.15.38:0/3851571720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15fc194910 con 0x7f15fc0fe910 2024-09-13T18:41:08.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.332+0000 7f15f37fe640 1 -- 172.21.15.38:0/3851571720 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15f8031950 con 0x7f15fc0fe910 2024-09-13T18:41:08.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.333+0000 7f1604620640 1 -- 172.21.15.38:0/3851571720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15fc194e10 con 0x7f15fc0fe910 2024-09-13T18:41:08.337 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.333+0000 7f1604620640 1 -- 172.21.15.38:0/3851571720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15fc100050 con 0x7f15fc0fe910 2024-09-13T18:41:08.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.334+0000 7f15f37fe640 1 -- 172.21.15.38:0/3851571720 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f15f8003c20 con 0x7f15fc0fe910 2024-09-13T18:41:08.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.335+0000 7f15f37fe640 1 --2- 172.21.15.38:0/3851571720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f15e806cc50 0x7f15e806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.335+0000 7f15f37fe640 1 -- 172.21.15.38:0/3851571720 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f15f80ad610 con 0x7f15fc0fe910 2024-09-13T18:41:08.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.335+0000 7f1601bbb640 1 --2- 172.21.15.38:0/3851571720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f15e806cc50 0x7f15e806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.338 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.335+0000 7f1601bbb640 1 --2- 172.21.15.38:0/3851571720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f15e806cc50 0x7f15e806f110 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f15fc195b00 tx=0x7f15ec00b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:08.341 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.339+0000 7f15f37fe640 1 -- 172.21.15.38:0/3851571720 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f15f8077700 con 0x7f15fc0fe910 2024-09-13T18:41:08.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.520+0000 7f1604620640 1 -- 172.21.15.38:0/3851571720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f15fc195c00 con 0x7f15fc0fe910 2024-09-13T18:41:08.523 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.521+0000 7f15f37fe640 1 -- 172.21.15.38:0/3851571720 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 33 entries v97) v1 ==== 81+0+1956 (secure 0 0 0) 0x7f15f8004e30 con 0x7f15fc0fe910 2024-09-13T18:41:08.523 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6829/1171569676 2024-09-14T18:36:50.313844+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6828/1171569676 2024-09-14T18:36:50.313844+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1704785391 2024-09-14T18:22:55.167215+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6827/1032191718 2024-09-14T18:27:59.313642+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2217216874 2024-09-14T18:30:00.433046+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6826/1032191718 2024-09-14T18:27:59.313642+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/3745740953 2024-09-14T18:21:07.813395+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/2302807265 2024-09-14T18:30:00.433046+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:0/1027981355 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/818807657 2024-09-14T18:21:45.526804+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3449425844 2024-09-14T18:30:00.433046+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:0/3464598559 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1699958329 2024-09-14T18:21:45.526804+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:6829/2070517292 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:08.524 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2793935378 2024-09-14T18:21:07.813395+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:0/3013293122 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1884863821 2024-09-14T18:21:07.813395+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2254155782 2024-09-14T18:30:00.433046+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/954446429 2024-09-14T18:30:00.433046+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1436289281 2024-09-14T18:22:55.167215+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/818807657 2024-09-14T18:21:45.526804+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/1869434741 2024-09-14T18:22:55.167215+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3719380288 2024-09-14T18:21:07.813395+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1458254215 2024-09-14T18:21:45.526804+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:6828/2070517292 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/1869434741 2024-09-14T18:22:55.167215+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:0/957353854 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3421440666 2024-09-14T18:22:55.167215+0000 2024-09-13T18:41:08.525 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/3745740953 2024-09-14T18:21:07.813395+0000 2024-09-13T18:41:08.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:0/3965866 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:08.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/133472565 2024-09-14T18:21:45.526804+0000 2024-09-13T18:41:08.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:0/3877995726 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:08.526 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/2302807265 2024-09-14T18:30:00.433046+0000 2024-09-13T18:41:08.527 INFO:teuthology.orchestra.run.smithi038.stderr:listed 33 entries 2024-09-13T18:41:08.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.523+0000 7f1604620640 1 -- 172.21.15.38:0/3851571720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f15e806cc50 msgr2=0x7f15e806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.523+0000 7f1604620640 1 --2- 172.21.15.38:0/3851571720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f15e806cc50 0x7f15e806f110 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f15fc195b00 tx=0x7f15ec00b390 comp rx=0 tx=0).stop 2024-09-13T18:41:08.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.523+0000 7f1604620640 1 -- 172.21.15.38:0/3851571720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15fc0fe910 msgr2=0x7f15fc19a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.523+0000 7f1604620640 1 --2- 172.21.15.38:0/3851571720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15fc0fe910 0x7f15fc19a5b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f15f802a9c0 tx=0x7f15f80055a0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.523+0000 7f1604620640 1 -- 172.21.15.38:0/3851571720 shutdown_connections 2024-09-13T18:41:08.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.523+0000 7f1604620640 1 --2- 172.21.15.38:0/3851571720 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f15e806cc50 0x7f15e806f110 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.523+0000 7f1604620640 1 --2- 172.21.15.38:0/3851571720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15fc104920 0x7f15fc19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.523+0000 7f1604620640 1 --2- 172.21.15.38:0/3851571720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f15fc0fe910 0x7f15fc19a5b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.523+0000 7f1604620640 1 -- 172.21.15.38:0/3851571720 >> 172.21.15.38:0/3851571720 conn(0x7f15fc0757b0 msgr2=0x7f15fc102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:08.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.523+0000 7f1604620640 1 -- 172.21.15.38:0/3851571720 shutdown_connections 2024-09-13T18:41:08.527 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.523+0000 7f1604620640 1 -- 172.21.15.38:0/3851571720 wait complete. 2024-09-13T18:41:08.536 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:41:08.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:08.536 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:41:08.564 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:41:08.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:08.564 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:41:08.632 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:41:08.632 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:08.653 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-13T18:41:08.653 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:08.712 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.813+0000 7fd48d82b640 1 -- 172.21.15.38:0/4018256388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd488105a50 msgr2=0x7fd488105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.813+0000 7fd48d82b640 1 --2- 172.21.15.38:0/4018256388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd488105a50 0x7fd488105e30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd478009880 tx=0x7fd47802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.813+0000 7fd48d82b640 1 -- 172.21.15.38:0/4018256388 shutdown_connections 2024-09-13T18:41:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.813+0000 7fd48d82b640 1 --2- 172.21.15.38:0/4018256388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4880ffa40 0x7fd4880ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.813+0000 7fd48d82b640 1 --2- 172.21.15.38:0/4018256388 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd488105a50 0x7fd488105e30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.813+0000 7fd48d82b640 1 -- 172.21.15.38:0/4018256388 >> 172.21.15.38:0/4018256388 conn(0x7fd4880fb740 msgr2=0x7fd4880fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.813+0000 7fd48d82b640 1 -- 172.21.15.38:0/4018256388 shutdown_connections 2024-09-13T18:41:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.813+0000 7fd48d82b640 1 -- 172.21.15.38:0/4018256388 wait complete. 2024-09-13T18:41:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.814+0000 7fd48d82b640 1 Processor -- start 2024-09-13T18:41:08.817 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.814+0000 7fd48d82b640 1 -- start start 2024-09-13T18:41:08.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.814+0000 7fd48d82b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4880ffa40 0x7fd48819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.814+0000 7fd48d82b640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd488105a50 0x7fd48819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.814+0000 7fd48d82b640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4881957e0 con 0x7fd488105a50 2024-09-13T18:41:08.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.814+0000 7fd48d82b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd488195950 con 0x7fd4880ffa40 2024-09-13T18:41:08.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.814+0000 7fd4867fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd488105a50 0x7fd48819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd4867fc640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd488105a50 0x7fd48819bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47360/0 (socket says 172.21.15.38:47360) 2024-09-13T18:41:08.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd4867fc640 1 -- 172.21.15.38:0/870443634 learned_addr learned my addr 172.21.15.38:0/870443634 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:08.819 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd486ffd640 1 --2- 172.21.15.38:0/870443634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4880ffa40 0x7fd48819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd4867fc640 1 -- 172.21.15.38:0/870443634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4880ffa40 msgr2=0x7fd48819b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd4867fc640 1 --2- 172.21.15.38:0/870443634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4880ffa40 0x7fd48819b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd4867fc640 1 -- 172.21.15.38:0/870443634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd478009560 con 0x7fd488105a50 2024-09-13T18:41:08.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd486ffd640 1 --2- 172.21.15.38:0/870443634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4880ffa40 0x7fd48819b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:08.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd4867fc640 1 --2- 172.21.15.38:0/870443634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd488105a50 0x7fd48819bc40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00d6f0 tx=0x7fd47c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:08.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd48c829640 1 -- 172.21.15.38:0/870443634 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd47c009a30 con 0x7fd488105a50 2024-09-13T18:41:08.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd48c829640 1 -- 172.21.15.38:0/870443634 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd47c0054c0 con 0x7fd488105a50 2024-09-13T18:41:08.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd48d82b640 1 -- 172.21.15.38:0/870443634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd488195c30 con 0x7fd488105a50 2024-09-13T18:41:08.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd48c829640 1 -- 172.21.15.38:0/870443634 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd47c004db0 con 0x7fd488105a50 2024-09-13T18:41:08.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.815+0000 7fd48d82b640 1 -- 172.21.15.38:0/870443634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd488196190 con 0x7fd488105a50 2024-09-13T18:41:08.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.816+0000 7fd48d82b640 1 -- 172.21.15.38:0/870443634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd488101180 con 0x7fd488105a50 2024-09-13T18:41:08.820 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.817+0000 7fd48c829640 1 -- 172.21.15.38:0/870443634 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd47c004f10 con 0x7fd488105a50 2024-09-13T18:41:08.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.817+0000 7fd48c829640 1 --2- 172.21.15.38:0/870443634 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd47006cc50 0x7fd47006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.817+0000 7fd48c829640 1 -- 172.21.15.38:0/870443634 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fd47c08c0a0 con 0x7fd488105a50 2024-09-13T18:41:08.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.817+0000 7fd486ffd640 1 --2- 172.21.15.38:0/870443634 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd47006cc50 0x7fd47006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.821 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.818+0000 7fd486ffd640 1 --2- 172.21.15.38:0/870443634 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd47006cc50 0x7fd47006f110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd478006010 tx=0x7fd478005d50 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:08.824 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.821+0000 7fd48c829640 1 -- 172.21.15.38:0/870443634 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd47c0560e0 con 0x7fd488105a50 2024-09-13T18:41:08.997 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.994+0000 7fd48d82b640 1 -- 172.21.15.38:0/870443634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4880ffea0 con 0x7fd488105a50 2024-09-13T18:41:08.998 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.995+0000 7fd48c829640 1 -- 172.21.15.38:0/870443634 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16598 (secure 0 0 0) 0x7fd47c020090 con 0x7fd488105a50 2024-09-13T18:41:08.998 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-09-13T18:41:08.999 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":97,"fsid":"ccb73e88-71fc-11ef-bceb-c7b262605968","created":"2024-09-13T18:20:45.975848+0000","modified":"2024-09-13T18:37:28.933737+0000","last_up_change":"2024-09-13T18:35:58.959011+0000","last_in_change":"2024-09-13T18:26:05.887130+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:25:13.672723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-09-13T18:27:42.648350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-09-13T18:27:43.137400+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8245ff4-3301-430c-a290-6000dfd0807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":59,"up_thru":92,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":3683619056},{"type":"v1","addr":"172.21.15.38:6803","nonce":3683619056}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":3683619056},{"type":"v1","addr":"172.21.15.38:6805","nonce":3683619056}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":3683619056},{"type":"v1","addr":"172.21.15.38:6809","nonce":3683619056}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":3683619056},{"type":"v1","addr":"172.21.15.38:6807","nonce":3683619056}]},"public_addr":"172.21.15.38:6803/3683619056","cluster_addr":"172.21.15.38:6805/3683619056","heartbeat_back_addr":"172.21.15.38:6809/3683619056","heartbeat_front_addr":"172.21.15.38:6807/3683619056","state":["exists","up"]},{"osd":1,"uuid":"1518b6f4-6e5f-445f-b0cd-2ebaecb3c203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":68,"up_from":72,"up_thru":92,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":3218305916},{"type":"v1","addr":"172.21.15.38:6811","nonce":3218305916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":3218305916},{"type":"v1","addr":"172.21.15.38:6813","nonce":3218305916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":3218305916},{"type":"v1","addr":"172.21.15.38:6817","nonce":3218305916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":3218305916},{"type":"v1","addr":"172.21.15.38:6815","nonce":3218305916}]},"public_addr":"172.21.15.38:6811/3218305916","cluster_addr":"172.21.15.38:6813/3218305916","heartbeat_back_addr":"172.21.15.38:6817/3218305916","heartbeat_front_addr":"172.21.15.38:6815/3218305916","state":["exists","up"]},{"osd":2,"uuid":"43ebe637-fa97-4ac6-b85e-01440f6ca6eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":73,"up_from":77,"up_thru":92,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6818","nonce":1124081148},{"type":"v1","addr":"172.21.15.38:6819","nonce":1124081148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":1124081148},{"type":"v1","addr":"172.21.15.38:6821","nonce":1124081148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":1124081148},{"type":"v1","addr":"172.21.15.38:6825","nonce":1124081148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6822","nonce":1124081148},{"type":"v1","addr":"172.21.15.38:6823","nonce":1124081148}]},"public_addr":"172.21.15.38:6819/1124081148","cluster_addr":"172.21.15.38:6821/1124081148","heartbeat_back_addr":"172.21.15.38:6825/1124081148","heartbeat_front_addr":"172.21.15.38:6823/1124081148","state":["exists","up"]},{"osd":3,"uuid":"5ffdedaf-95c7-45b3-9af6-36b5a74d60f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":78,"up_from":82,"up_thru":92,"down_at":79,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3674321522},{"type":"v1","addr":"172.21.15.149:6801","nonce":3674321522}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":3674321522},{"type":"v1","addr":"172.21.15.149:6803","nonce":3674321522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":3674321522},{"type":"v1","addr":"172.21.15.149:6807","nonce":3674321522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":3674321522},{"type":"v1","addr":"172.21.15.149:6805","nonce":3674321522}]},"public_addr":"172.21.15.149:6801/3674321522","cluster_addr":"172.21.15.149:6803/3674321522","heartbeat_back_addr":"172.21.15.149:6807/3674321522","heartbeat_front_addr":"172.21.15.149:6805/3674321522","state":["exists","up"]},{"osd":4,"uuid":"e91e0c22-0686-45ef-a8b3-a356ab76eb88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":83,"up_from":87,"up_thru":92,"down_at":84,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":275970326},{"type":"v1","addr":"172.21.15.149:6809","nonce":275970326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":275970326},{"type":"v1","addr":"172.21.15.149:6811","nonce":275970326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":275970326},{"type":"v1","addr":"172.21.15.149:6815","nonce":275970326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":275970326},{"type":"v1","addr":"172.21.15.149:6813","nonce":275970326}]},"public_addr":"172.21.15.149:6809/275970326","cluster_addr":"172.21.15.149:6811/275970326","heartbeat_back_addr":"172.21.15.149:6815/275970326","heartbeat_front_addr":"172.21.15.149:6813/275970326","state":["exists","up"]},{"osd":5,"uuid":"ad710f6e-dbff-455c-8a67-7aca4ab8a56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":88,"up_from":92,"up_thru":92,"down_at":89,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":3302600515},{"type":"v1","addr":"172.21.15.149:6817","nonce":3302600515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":3302600515},{"type":"v1","addr":"172.21.15.149:6819","nonce":3302600515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":3302600515},{"type":"v1","addr":"172.21.15.149:6823","nonce":3302600515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":3302600515},{"type":"v1","addr":"172.21.15.149:6821","nonce":3302600515}]},"public_addr":"172.21.15.149:6817/3302600515","cluster_addr":"172.21.15.149:6819/3302600515","heartbeat_back_addr":"172.21.15.149:6823/3302600515","heartbeat_front_addr":"172.21.15.149:6821/3302600515","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:11.540858+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:24:41.374275+0000","dead_epoch":68},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:10.472792+0000","dead_epoch":73},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:33.374560+0000","dead_epoch":78},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:25:58.381692+0000","dead_epoch":83},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:26:22.772809+0000","dead_epoch":88}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":3,"to":0}]},{"pgid":"2.12","mappings":[{"from":3,"to":2}]},{"pgid":"2.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.9","mappings":[{"from":4,"to":0}]},{"pgid":"3.a","mappings":[{"from":3,"to":0}]},{"pgid":"3.14","mappings":[{"from":4,"to":0}]},{"pgid":"3.16","mappings":[{"from":1,"to":0}]},{"pgid":"3.19","mappings":[{"from":1,"to":0}]},{"pgid":"3.1b","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.38:6829/1171569676":"2024-09-14T18:36:50.313844+0000","172.21.15.38:6828/1171569676":"2024-09-14T18:36:50.313844+0000","172.21.15.38:0/1704785391":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6827/1032191718":"2024-09-14T18:27:59.313642+0000","172.21.15.38:0/2217216874":"2024-09-14T18:30:00.433046+0000","172.21.15.38:6826/1032191718":"2024-09-14T18:27:59.313642+0000","172.21.15.38:6800/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.38:6801/2302807265":"2024-09-14T18:30:00.433046+0000","172.21.15.149:0/1027981355":"2024-09-14T18:31:06.334407+0000","172.21.15.38:6801/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:0/3449425844":"2024-09-14T18:30:00.433046+0000","172.21.15.149:0/3464598559":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/1699958329":"2024-09-14T18:21:45.526804+0000","172.21.15.149:6829/2070517292":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/2793935378":"2024-09-14T18:21:07.813395+0000","172.21.15.149:0/3013293122":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/1884863821":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/2254155782":"2024-09-14T18:30:00.433046+0000","172.21.15.38:0/954446429":"2024-09-14T18:30:00.433046+0000","172.21.15.38:0/1436289281":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6800/818807657":"2024-09-14T18:21:45.526804+0000","172.21.15.38:6800/1869434741":"2024-09-14T18:22:55.167215+0000","172.21.15.38:0/3719380288":"2024-09-14T18:21:07.813395+0000","172.21.15.38:0/1458254215":"2024-09-14T18:21:45.526804+0000","172.21.15.149:6828/2070517292":"2024-09-14T18:31:06.334407+0000","172.21.15.38:6801/1869434741":"2024-09-14T18:22:55.167215+0000","172.21.15.149:0/957353854":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/3421440666":"2024-09-14T18:22:55.167215+0000","172.21.15.38:6801/3745740953":"2024-09-14T18:21:07.813395+0000","172.21.15.149:0/3965866":"2024-09-14T18:31:06.334407+0000","172.21.15.38:0/133472565":"2024-09-14T18:21:45.526804+0000","172.21.15.149:0/3877995726":"2024-09-14T18:31:06.334407+0000","172.21.15.38:6800/2302807265":"2024-09-14T18:30:00.433046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:09.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.997+0000 7fd48d82b640 1 -- 172.21.15.38:0/870443634 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd47006cc50 msgr2=0x7fd47006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.997+0000 7fd48d82b640 1 --2- 172.21.15.38:0/870443634 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd47006cc50 0x7fd47006f110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd478006010 tx=0x7fd478005d50 comp rx=0 tx=0).stop 2024-09-13T18:41:09.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.997+0000 7fd48d82b640 1 -- 172.21.15.38:0/870443634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd488105a50 msgr2=0x7fd48819bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.000 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.997+0000 7fd48d82b640 1 --2- 172.21.15.38:0/870443634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd488105a50 0x7fd48819bc40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00d6f0 tx=0x7fd47c00dbb0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.997+0000 7fd48d82b640 1 -- 172.21.15.38:0/870443634 shutdown_connections 2024-09-13T18:41:09.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.997+0000 7fd48d82b640 1 --2- 172.21.15.38:0/870443634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd488105a50 0x7fd48819bc40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.997+0000 7fd48d82b640 1 --2- 172.21.15.38:0/870443634 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fd47006cc50 0x7fd47006f110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.997+0000 7fd48d82b640 1 --2- 172.21.15.38:0/870443634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4880ffa40 0x7fd48819b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.997+0000 7fd48d82b640 1 -- 172.21.15.38:0/870443634 >> 172.21.15.38:0/870443634 conn(0x7fd4880fb740 msgr2=0x7fd4880fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:09.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.998+0000 7fd48d82b640 1 -- 172.21.15.38:0/870443634 shutdown_connections 2024-09-13T18:41:09.001 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:08.998+0000 7fd48d82b640 1 -- 172.21.15.38:0/870443634 wait complete. 2024-09-13T18:41:09.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:25:13.672723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-09-13T18:27:42.648350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-09-13T18:27:43.137400+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:41:09.012 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:41:09.119 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.115+0000 7f93946aa640 1 -- 172.21.15.38:0/3486048855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f938c104a80 msgr2=0x7f938c104e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.115+0000 7f93946aa640 1 --2- 172.21.15.38:0/3486048855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f938c104a80 0x7f938c104e60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9388009880 tx=0x7f938802a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.115+0000 7f93946aa640 1 -- 172.21.15.38:0/3486048855 shutdown_connections 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.115+0000 7f93946aa640 1 --2- 172.21.15.38:0/3486048855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f938c0fde90 0x7f938c0fe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.115+0000 7f93946aa640 1 --2- 172.21.15.38:0/3486048855 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f938c104a80 0x7f938c104e60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.115+0000 7f93946aa640 1 -- 172.21.15.38:0/3486048855 >> 172.21.15.38:0/3486048855 conn(0x7f938c0f9d80 msgr2=0x7f938c0fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.115+0000 7f93946aa640 1 -- 172.21.15.38:0/3486048855 shutdown_connections 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.115+0000 7f93946aa640 1 -- 172.21.15.38:0/3486048855 wait complete. 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.116+0000 7f93946aa640 1 Processor -- start 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.116+0000 7f93946aa640 1 -- start start 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.116+0000 7f93946aa640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f938c0fde90 0x7f938c19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.116+0000 7f93946aa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f938c104a80 0x7f938c19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.116+0000 7f93946aa640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c19c2f0 con 0x7f938c0fde90 2024-09-13T18:41:09.120 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.116+0000 7f93946aa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c195870 con 0x7f938c104a80 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.116+0000 7f9392446640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f938c0fde90 0x7f938c19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.116+0000 7f9392446640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f938c0fde90 0x7f938c19b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47378/0 (socket says 172.21.15.38:47378) 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.116+0000 7f9392446640 1 -- 172.21.15.38:0/4157145750 learned_addr learned my addr 172.21.15.38:0/4157145750 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.116+0000 7f9391c45640 1 --2- 172.21.15.38:0/4157145750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f938c104a80 0x7f938c19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.117+0000 7f9392446640 1 -- 172.21.15.38:0/4157145750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f938c104a80 msgr2=0x7f938c19bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.117+0000 7f9392446640 1 --2- 172.21.15.38:0/4157145750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f938c104a80 0x7f938c19bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.117+0000 7f9392446640 1 -- 172.21.15.38:0/4157145750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9388009560 con 0x7f938c0fde90 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.117+0000 7f9392446640 1 --2- 172.21.15.38:0/4157145750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f938c0fde90 0x7f938c19b790 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f938802a9c0 tx=0x7f93880055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.117+0000 7f93837fe640 1 -- 172.21.15.38:0/4157145750 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9388004b60 con 0x7f938c0fde90 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.117+0000 7f93837fe640 1 -- 172.21.15.38:0/4157145750 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9388004cc0 con 0x7f938c0fde90 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.117+0000 7f93946aa640 1 -- 172.21.15.38:0/4157145750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c195af0 con 0x7f938c0fde90 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.117+0000 7f93837fe640 1 -- 172.21.15.38:0/4157145750 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9388031950 con 0x7f938c0fde90 2024-09-13T18:41:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.117+0000 7f93946aa640 1 -- 172.21.15.38:0/4157145750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c195ff0 con 0x7f938c0fde90 2024-09-13T18:41:09.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.118+0000 7f93946aa640 1 -- 172.21.15.38:0/4157145750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c1011b0 con 0x7f938c0fde90 2024-09-13T18:41:09.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.118+0000 7f93837fe640 1 -- 172.21.15.38:0/4157145750 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9388003c20 con 0x7f938c0fde90 2024-09-13T18:41:09.122 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.119+0000 7f93837fe640 1 --2- 172.21.15.38:0/4157145750 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f937806cc50 0x7f937806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.119+0000 7f9391c45640 1 --2- 172.21.15.38:0/4157145750 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f937806cc50 0x7f937806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.119+0000 7f93837fe640 1 -- 172.21.15.38:0/4157145750 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f93880ad610 con 0x7f938c0fde90 2024-09-13T18:41:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.119+0000 7f9391c45640 1 --2- 172.21.15.38:0/4157145750 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f937806cc50 0x7f937806f110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f938c196ce0 tx=0x7f937c00b390 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.123+0000 7f93837fe640 1 -- 172.21.15.38:0/4157145750 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9388077700 con 0x7f938c0fde90 2024-09-13T18:41:09.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.298+0000 7f93946aa640 1 -- 172.21.15.38:0/4157145750 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f938c107fb0 con 0x7f938c0fde90 2024-09-13T18:41:09.300 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.298+0000 7f93837fe640 1 -- 172.21.15.38:0/4157145750 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9388004e30 con 0x7f938c0fde90 2024-09-13T18:41:09.301 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-09-13T18:41:09.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.300+0000 7f93946aa640 1 -- 172.21.15.38:0/4157145750 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f937806cc50 msgr2=0x7f937806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.300+0000 7f93946aa640 1 --2- 172.21.15.38:0/4157145750 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f937806cc50 0x7f937806f110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f938c196ce0 tx=0x7f937c00b390 comp rx=0 tx=0).stop 2024-09-13T18:41:09.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.300+0000 7f93946aa640 1 -- 172.21.15.38:0/4157145750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f938c0fde90 msgr2=0x7f938c19b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.300+0000 7f93946aa640 1 --2- 172.21.15.38:0/4157145750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f938c0fde90 0x7f938c19b790 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f938802a9c0 tx=0x7f93880055a0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.300+0000 7f93946aa640 1 -- 172.21.15.38:0/4157145750 shutdown_connections 2024-09-13T18:41:09.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.300+0000 7f93946aa640 1 --2- 172.21.15.38:0/4157145750 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f937806cc50 0x7f937806f110 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.300+0000 7f93946aa640 1 --2- 172.21.15.38:0/4157145750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f938c104a80 0x7f938c19bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.300+0000 7f93946aa640 1 --2- 172.21.15.38:0/4157145750 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f938c0fde90 0x7f938c19b790 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.300+0000 7f93946aa640 1 -- 172.21.15.38:0/4157145750 >> 172.21.15.38:0/4157145750 conn(0x7f938c0f9d80 msgr2=0x7f938c0faf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:09.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.300+0000 7f93946aa640 1 -- 172.21.15.38:0/4157145750 shutdown_connections 2024-09-13T18:41:09.303 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.300+0000 7f93946aa640 1 -- 172.21.15.38:0/4157145750 wait complete. 2024-09-13T18:41:09.312 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:09 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/201200687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T18:41:09.313 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:09 smithi038 ceph-mon[91522]: pgmap v352: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:41:09.313 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:09 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/3851571720' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T18:41:09.313 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:09 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/870443634' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:41:09.314 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-09-13T18:41:09.420 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.416+0000 7f0440153640 1 -- 172.21.15.38:0/1991090623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0438100c10 msgr2=0x7f0438100ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.416+0000 7f0440153640 1 --2- 172.21.15.38:0/1991090623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0438100c10 0x7f0438100ff0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0434009880 tx=0x7f043402a530 comp rx=0 tx=0).stop 2024-09-13T18:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.416+0000 7f0440153640 1 -- 172.21.15.38:0/1991090623 shutdown_connections 2024-09-13T18:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.416+0000 7f0440153640 1 --2- 172.21.15.38:0/1991090623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0438101530 0x7f0438109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.416+0000 7f0440153640 1 --2- 172.21.15.38:0/1991090623 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0438100c10 0x7f0438100ff0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.416+0000 7f0440153640 1 -- 172.21.15.38:0/1991090623 >> 172.21.15.38:0/1991090623 conn(0x7f04380fa620 msgr2=0x7f04380fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.417+0000 7f0440153640 1 -- 172.21.15.38:0/1991090623 shutdown_connections 2024-09-13T18:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.417+0000 7f0440153640 1 -- 172.21.15.38:0/1991090623 wait complete. 2024-09-13T18:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.417+0000 7f0440153640 1 Processor -- start 2024-09-13T18:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.417+0000 7f0440153640 1 -- start start 2024-09-13T18:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.417+0000 7f0440153640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0438100c10 0x7f043819b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.421 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.417+0000 7f0440153640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0438101530 0x7f043819bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.417+0000 7f0440153640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04381957a0 con 0x7f0438101530 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.417+0000 7f0440153640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0438195910 con 0x7f0438100c10 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.417+0000 7f043d6ee640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0438101530 0x7f043819bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.417+0000 7f043d6ee640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0438101530 0x7f043819bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47396/0 (socket says 172.21.15.38:47396) 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.417+0000 7f043d6ee640 1 -- 172.21.15.38:0/858490729 learned_addr learned my addr 172.21.15.38:0/858490729 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.418+0000 7f043deef640 1 --2- 172.21.15.38:0/858490729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0438100c10 0x7f043819b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.418+0000 7f043d6ee640 1 -- 172.21.15.38:0/858490729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0438100c10 msgr2=0x7f043819b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.418+0000 7f043d6ee640 1 --2- 172.21.15.38:0/858490729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0438100c10 0x7f043819b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.418+0000 7f043d6ee640 1 -- 172.21.15.38:0/858490729 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0434009560 con 0x7f0438101530 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.418+0000 7f043d6ee640 1 --2- 172.21.15.38:0/858490729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0438101530 0x7f043819bc00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f042800d8d0 tx=0x7f042800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.418+0000 7f042effd640 1 -- 172.21.15.38:0/858490729 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0428009a30 con 0x7f0438101530 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.418+0000 7f042effd640 1 -- 172.21.15.38:0/858490729 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f04280044c0 con 0x7f0438101530 2024-09-13T18:41:09.422 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.418+0000 7f0440153640 1 -- 172.21.15.38:0/858490729 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0438195bf0 con 0x7f0438101530 2024-09-13T18:41:09.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.418+0000 7f042effd640 1 -- 172.21.15.38:0/858490729 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04280049d0 con 0x7f0438101530 2024-09-13T18:41:09.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.418+0000 7f0440153640 1 -- 172.21.15.38:0/858490729 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0438196150 con 0x7f0438101530 2024-09-13T18:41:09.423 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.419+0000 7f0440153640 1 -- 172.21.15.38:0/858490729 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04380688b0 con 0x7f0438101530 2024-09-13T18:41:09.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.420+0000 7f042effd640 1 -- 172.21.15.38:0/858490729 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0428009b90 con 0x7f0438101530 2024-09-13T18:41:09.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.420+0000 7f042effd640 1 --2- 172.21.15.38:0/858490729 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f042406cc60 0x7f042406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.420+0000 7f042effd640 1 -- 172.21.15.38:0/858490729 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f042808c1a0 con 0x7f0438101530 2024-09-13T18:41:09.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.420+0000 7f043deef640 1 --2- 172.21.15.38:0/858490729 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f042406cc60 0x7f042406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.424 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.421+0000 7f043deef640 1 --2- 172.21.15.38:0/858490729 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f042406cc60 0x7f042406f120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0434000c00 tx=0x7f0434004120 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:09.426 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.424+0000 7f042effd640 1 -- 172.21.15.38:0/858490729 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f04280561e0 con 0x7f0438101530 2024-09-13T18:41:09.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:09 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/201200687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T18:41:09.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:09 smithi149 ceph-mon[76906]: pgmap v352: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T18:41:09.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:09 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/3851571720' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T18:41:09.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:09 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/870443634' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:41:09.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.593+0000 7f0440153640 1 -- 172.21.15.38:0/858490729 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f0438100ff0 con 0x7f0438101530 2024-09-13T18:41:09.596 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.594+0000 7f042effd640 1 -- 172.21.15.38:0/858490729 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v97) v1 ==== 107+0+11 (secure 0 0 0) 0x7f0428059800 con 0x7f0438101530 2024-09-13T18:41:09.596 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-13T18:41:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.595+0000 7f0440153640 1 -- 172.21.15.38:0/858490729 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f042406cc60 msgr2=0x7f042406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.595+0000 7f0440153640 1 --2- 172.21.15.38:0/858490729 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f042406cc60 0x7f042406f120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0434000c00 tx=0x7f0434004120 comp rx=0 tx=0).stop 2024-09-13T18:41:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.595+0000 7f0440153640 1 -- 172.21.15.38:0/858490729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0438101530 msgr2=0x7f043819bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.595+0000 7f0440153640 1 --2- 172.21.15.38:0/858490729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0438101530 0x7f043819bc00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f042800d8d0 tx=0x7f042800dd90 comp rx=0 tx=0).stop 2024-09-13T18:41:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.595+0000 7f0440153640 1 -- 172.21.15.38:0/858490729 shutdown_connections 2024-09-13T18:41:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.595+0000 7f0440153640 1 --2- 172.21.15.38:0/858490729 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0438101530 0x7f043819bc00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.598 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.595+0000 7f0440153640 1 --2- 172.21.15.38:0/858490729 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f042406cc60 0x7f042406f120 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.595+0000 7f0440153640 1 --2- 172.21.15.38:0/858490729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0438100c10 0x7f043819b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.595+0000 7f0440153640 1 -- 172.21.15.38:0/858490729 >> 172.21.15.38:0/858490729 conn(0x7f04380fa620 msgr2=0x7f0438101ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.596+0000 7f0440153640 1 -- 172.21.15.38:0/858490729 shutdown_connections 2024-09-13T18:41:09.599 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.596+0000 7f0440153640 1 -- 172.21.15.38:0/858490729 wait complete. 2024-09-13T18:41:09.609 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-09-13T18:41:09.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.711+0000 7f35ea918640 1 -- 172.21.15.38:0/3914473247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35e4104940 msgr2=0x7f35e4104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.711+0000 7f35ea918640 1 --2- 172.21.15.38:0/3914473247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35e4104940 0x7f35e4104d20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009880 tx=0x7f35d402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.711+0000 7f35ea918640 1 -- 172.21.15.38:0/3914473247 shutdown_connections 2024-09-13T18:41:09.714 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.711+0000 7f35ea918640 1 --2- 172.21.15.38:0/3914473247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35e40fe930 0x7f35e40fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.711+0000 7f35ea918640 1 --2- 172.21.15.38:0/3914473247 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35e4104940 0x7f35e4104d20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.711+0000 7f35ea918640 1 -- 172.21.15.38:0/3914473247 >> 172.21.15.38:0/3914473247 conn(0x7f35e40fa610 msgr2=0x7f35e40fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.711+0000 7f35ea918640 1 -- 172.21.15.38:0/3914473247 shutdown_connections 2024-09-13T18:41:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.711+0000 7f35ea918640 1 -- 172.21.15.38:0/3914473247 wait complete. 2024-09-13T18:41:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.711+0000 7f35ea918640 1 Processor -- start 2024-09-13T18:41:09.715 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.712+0000 7f35ea918640 1 -- start start 2024-09-13T18:41:09.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.712+0000 7f35ea918640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35e40fe930 0x7f35e419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.712+0000 7f35ea918640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35e4104940 0x7f35e419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.712+0000 7f35ea918640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e419c310 con 0x7f35e4104940 2024-09-13T18:41:09.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.712+0000 7f35ea918640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e4195890 con 0x7f35e40fe930 2024-09-13T18:41:09.717 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.712+0000 7f35e37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35e4104940 0x7f35e419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.712+0000 7f35e37fe640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35e4104940 0x7f35e419bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47416/0 (socket says 172.21.15.38:47416) 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.712+0000 7f35e37fe640 1 -- 172.21.15.38:0/2725785114 learned_addr learned my addr 172.21.15.38:0/2725785114 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.712+0000 7f35e3fff640 1 --2- 172.21.15.38:0/2725785114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35e40fe930 0x7f35e419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.712+0000 7f35e37fe640 1 -- 172.21.15.38:0/2725785114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35e40fe930 msgr2=0x7f35e419b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.712+0000 7f35e37fe640 1 --2- 172.21.15.38:0/2725785114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35e40fe930 0x7f35e419b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.712+0000 7f35e37fe640 1 -- 172.21.15.38:0/2725785114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d4009560 con 0x7f35e4104940 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.713+0000 7f35e37fe640 1 --2- 172.21.15.38:0/2725785114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35e4104940 0x7f35e419bcf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f35d800b420 tx=0x7f35d800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.713+0000 7f35e17fa640 1 -- 172.21.15.38:0/2725785114 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d8011800 con 0x7f35e4104940 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.713+0000 7f35e17fa640 1 -- 172.21.15.38:0/2725785114 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f35d8011e00 con 0x7f35e4104940 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.713+0000 7f35ea918640 1 -- 172.21.15.38:0/2725785114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e4195b70 con 0x7f35e4104940 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.713+0000 7f35e17fa640 1 -- 172.21.15.38:0/2725785114 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d800f2e0 con 0x7f35e4104940 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.713+0000 7f35ea918640 1 -- 172.21.15.38:0/2725785114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e41960d0 con 0x7f35e4104940 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.714+0000 7f35ea918640 1 -- 172.21.15.38:0/2725785114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e4100070 con 0x7f35e4104940 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.714+0000 7f35e17fa640 1 -- 172.21.15.38:0/2725785114 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f35d8010380 con 0x7f35e4104940 2024-09-13T18:41:09.718 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.715+0000 7f35e17fa640 1 --2- 172.21.15.38:0/2725785114 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f35cc06cc60 0x7f35cc06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.715+0000 7f35e17fa640 1 -- 172.21.15.38:0/2725785114 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7f35d808c010 con 0x7f35e4104940 2024-09-13T18:41:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.715+0000 7f35e3fff640 1 --2- 172.21.15.38:0/2725785114 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f35cc06cc60 0x7f35cc06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.719 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.715+0000 7f35e3fff640 1 --2- 172.21.15.38:0/2725785114 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f35cc06cc60 0x7f35cc06f120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f35d4005ab0 tx=0x7f35d4005a20 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:09.721 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.719+0000 7f35e17fa640 1 -- 172.21.15.38:0/2725785114 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f35d8055fd0 con 0x7f35e4104940 2024-09-13T18:41:09.892 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.890+0000 7f35ea918640 1 -- 172.21.15.38:0/2725785114 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f35e40fee10 con 0x7f35e4104940 2024-09-13T18:41:09.893 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.890+0000 7f35e17fa640 1 -- 172.21.15.38:0/2725785114 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v97) v1 ==== 107+0+11 (secure 0 0 0) 0x7f35d80595f0 con 0x7f35e4104940 2024-09-13T18:41:09.893 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-09-13T18:41:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.892+0000 7f35ea918640 1 -- 172.21.15.38:0/2725785114 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f35cc06cc60 msgr2=0x7f35cc06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.892+0000 7f35ea918640 1 --2- 172.21.15.38:0/2725785114 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f35cc06cc60 0x7f35cc06f120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f35d4005ab0 tx=0x7f35d4005a20 comp rx=0 tx=0).stop 2024-09-13T18:41:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.892+0000 7f35ea918640 1 -- 172.21.15.38:0/2725785114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35e4104940 msgr2=0x7f35e419bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.892+0000 7f35ea918640 1 --2- 172.21.15.38:0/2725785114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35e4104940 0x7f35e419bcf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f35d800b420 tx=0x7f35d800b8e0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.892+0000 7f35ea918640 1 -- 172.21.15.38:0/2725785114 shutdown_connections 2024-09-13T18:41:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.892+0000 7f35ea918640 1 --2- 172.21.15.38:0/2725785114 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f35e4104940 0x7f35e419bcf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.892+0000 7f35ea918640 1 --2- 172.21.15.38:0/2725785114 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7f35cc06cc60 0x7f35cc06f120 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.892+0000 7f35ea918640 1 --2- 172.21.15.38:0/2725785114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f35e40fe930 0x7f35e419b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.892+0000 7f35ea918640 1 -- 172.21.15.38:0/2725785114 >> 172.21.15.38:0/2725785114 conn(0x7f35e40fa610 msgr2=0x7f35e40fb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.892+0000 7f35ea918640 1 -- 172.21.15.38:0/2725785114 shutdown_connections 2024-09-13T18:41:09.895 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:09.892+0000 7f35ea918640 1 -- 172.21.15.38:0/2725785114 wait complete. 2024-09-13T18:41:09.905 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:41:10.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.006+0000 7fa0f1c72640 1 -- 172.21.15.38:0/3889017966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0ec0ffa30 msgr2=0x7fa0ec0ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:10.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.006+0000 7fa0f1c72640 1 --2- 172.21.15.38:0/3889017966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0ec0ffa30 0x7fa0ec0ffe90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009880 tx=0x7fa0d402a4a0 comp rx=0 tx=0).stop 2024-09-13T18:41:10.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.006+0000 7fa0f1c72640 1 -- 172.21.15.38:0/3889017966 shutdown_connections 2024-09-13T18:41:10.011 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.006+0000 7fa0f1c72640 1 --2- 172.21.15.38:0/3889017966 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0ec0ffa30 0x7fa0ec0ffe90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.006+0000 7fa0f1c72640 1 --2- 172.21.15.38:0/3889017966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0ec105a40 0x7fa0ec105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.006+0000 7fa0f1c72640 1 -- 172.21.15.38:0/3889017966 >> 172.21.15.38:0/3889017966 conn(0x7fa0ec0fb710 msgr2=0x7fa0ec0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.006+0000 7fa0f1c72640 1 -- 172.21.15.38:0/3889017966 shutdown_connections 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.006+0000 7fa0f1c72640 1 -- 172.21.15.38:0/3889017966 wait complete. 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0f1c72640 1 Processor -- start 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0f1c72640 1 -- start start 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0f1c72640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0ec0ffa30 0x7fa0ec19b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0f1c72640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0ec105a40 0x7fa0ec19bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0f1c72640 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec195790 con 0x7fa0ec105a40 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0f1c72640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec195900 con 0x7fa0ec0ffa30 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0e3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0ec105a40 0x7fa0ec19bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0e3fff640 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0ec105a40 0x7fa0ec19bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47426/0 (socket says 172.21.15.38:47426) 2024-09-13T18:41:10.012 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0e3fff640 1 -- 172.21.15.38:0/1954305118 learned_addr learned my addr 172.21.15.38:0/1954305118 (peer_addr_for_me v2:172.21.15.38:0/0) 2024-09-13T18:41:10.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0eb7fe640 1 --2- 172.21.15.38:0/1954305118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0ec0ffa30 0x7fa0ec19b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:10.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0e3fff640 1 -- 172.21.15.38:0/1954305118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0ec0ffa30 msgr2=0x7fa0ec19b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:10.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0e3fff640 1 --2- 172.21.15.38:0/1954305118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0ec0ffa30 0x7fa0ec19b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:10.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.007+0000 7fa0e3fff640 1 -- 172.21.15.38:0/1954305118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d4009560 con 0x7fa0ec105a40 2024-09-13T18:41:10.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.008+0000 7fa0e3fff640 1 --2- 172.21.15.38:0/1954305118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0ec105a40 0x7fa0ec19bbf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4006010 tx=0x7fa0d40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:10.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.008+0000 7fa0e97fa640 1 -- 172.21.15.38:0/1954305118 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0d4004ba0 con 0x7fa0ec105a40 2024-09-13T18:41:10.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.008+0000 7fa0e97fa640 1 -- 172.21.15.38:0/1954305118 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa0d4004d00 con 0x7fa0ec105a40 2024-09-13T18:41:10.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.008+0000 7fa0f1c72640 1 -- 172.21.15.38:0/1954305118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ec195b80 con 0x7fa0ec105a40 2024-09-13T18:41:10.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.008+0000 7fa0e97fa640 1 -- 172.21.15.38:0/1954305118 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0d4031910 con 0x7fa0ec105a40 2024-09-13T18:41:10.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.008+0000 7fa0f1c72640 1 -- 172.21.15.38:0/1954305118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ec196080 con 0x7fa0ec105a40 2024-09-13T18:41:10.013 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.009+0000 7fa0f1c72640 1 -- 172.21.15.38:0/1954305118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ec101170 con 0x7fa0ec105a40 2024-09-13T18:41:10.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.009+0000 7fa0e97fa640 1 -- 172.21.15.38:0/1954305118 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 32) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa0d4031af0 con 0x7fa0ec105a40 2024-09-13T18:41:10.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.010+0000 7fa0e97fa640 1 --2- 172.21.15.38:0/1954305118 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa0d806cc50 0x7fa0d806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:10.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.010+0000 7fa0e97fa640 1 -- 172.21.15.38:0/1954305118 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6503+0+0 (secure 0 0 0) 0x7fa0d40ad790 con 0x7fa0ec105a40 2024-09-13T18:41:10.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.010+0000 7fa0eb7fe640 1 --2- 172.21.15.38:0/1954305118 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa0d806cc50 0x7fa0d806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:10.014 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.010+0000 7fa0eb7fe640 1 --2- 172.21.15.38:0/1954305118 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa0d806cc50 0x7fa0d806f110 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc005fd0 tx=0x7fa0dc005e20 comp rx=0 tx=0).ready entity=mgr.14726 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:10.016 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.014+0000 7fa0e97fa640 1 -- 172.21.15.38:0/1954305118 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa0d40777d0 con 0x7fa0ec105a40 2024-09-13T18:41:10.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.197+0000 7fa0f1c72640 1 -- 172.21.15.38:0/1954305118 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa0ec0ffe90 con 0x7fa0ec105a40 2024-09-13T18:41:10.200 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.198+0000 7fa0e97fa640 1 -- 172.21.15.38:0/1954305118 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 33 entries v97) v1 ==== 81+0+1956 (secure 0 0 0) 0x7fa0d407adf0 con 0x7fa0ec105a40 2024-09-13T18:41:10.201 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6829/1171569676 2024-09-14T18:36:50.313844+0000 2024-09-13T18:41:10.201 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6828/1171569676 2024-09-14T18:36:50.313844+0000 2024-09-13T18:41:10.201 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1704785391 2024-09-14T18:22:55.167215+0000 2024-09-13T18:41:10.201 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6827/1032191718 2024-09-14T18:27:59.313642+0000 2024-09-13T18:41:10.201 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2217216874 2024-09-14T18:30:00.433046+0000 2024-09-13T18:41:10.201 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6826/1032191718 2024-09-14T18:27:59.313642+0000 2024-09-13T18:41:10.201 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/3745740953 2024-09-14T18:21:07.813395+0000 2024-09-13T18:41:10.201 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/2302807265 2024-09-14T18:30:00.433046+0000 2024-09-13T18:41:10.201 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:0/1027981355 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:10.201 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/818807657 2024-09-14T18:21:45.526804+0000 2024-09-13T18:41:10.201 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3449425844 2024-09-14T18:30:00.433046+0000 2024-09-13T18:41:10.201 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:0/3464598559 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1699958329 2024-09-14T18:21:45.526804+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:6829/2070517292 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2793935378 2024-09-14T18:21:07.813395+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:0/3013293122 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1884863821 2024-09-14T18:21:07.813395+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/2254155782 2024-09-14T18:30:00.433046+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/954446429 2024-09-14T18:30:00.433046+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1436289281 2024-09-14T18:22:55.167215+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/818807657 2024-09-14T18:21:45.526804+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/1869434741 2024-09-14T18:22:55.167215+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3719380288 2024-09-14T18:21:07.813395+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/1458254215 2024-09-14T18:21:45.526804+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:6828/2070517292 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:10.202 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/1869434741 2024-09-14T18:22:55.167215+0000 2024-09-13T18:41:10.203 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:0/957353854 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:10.203 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/3421440666 2024-09-14T18:22:55.167215+0000 2024-09-13T18:41:10.203 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6801/3745740953 2024-09-14T18:21:07.813395+0000 2024-09-13T18:41:10.203 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:0/3965866 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:10.203 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:0/133472565 2024-09-14T18:21:45.526804+0000 2024-09-13T18:41:10.203 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.149:0/3877995726 2024-09-14T18:31:06.334407+0000 2024-09-13T18:41:10.203 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38:6800/2302807265 2024-09-14T18:30:00.433046+0000 2024-09-13T18:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:listed 33 entries 2024-09-13T18:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.200+0000 7fa0f1c72640 1 -- 172.21.15.38:0/1954305118 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa0d806cc50 msgr2=0x7fa0d806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.200+0000 7fa0f1c72640 1 --2- 172.21.15.38:0/1954305118 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa0d806cc50 0x7fa0d806f110 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc005fd0 tx=0x7fa0dc005e20 comp rx=0 tx=0).stop 2024-09-13T18:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.200+0000 7fa0f1c72640 1 -- 172.21.15.38:0/1954305118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0ec105a40 msgr2=0x7fa0ec19bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.200+0000 7fa0f1c72640 1 --2- 172.21.15.38:0/1954305118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0ec105a40 0x7fa0ec19bbf0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4006010 tx=0x7fa0d40056e0 comp rx=0 tx=0).stop 2024-09-13T18:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.200+0000 7fa0f1c72640 1 -- 172.21.15.38:0/1954305118 shutdown_connections 2024-09-13T18:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.200+0000 7fa0f1c72640 1 --2- 172.21.15.38:0/1954305118 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa0ec105a40 0x7fa0ec19bbf0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.200+0000 7fa0f1c72640 1 --2- 172.21.15.38:0/1954305118 >> [v2:172.21.15.38:6800/2361475536,v1:172.21.15.38:6801/2361475536] conn(0x7fa0d806cc50 0x7fa0d806f110 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.200+0000 7fa0f1c72640 1 --2- 172.21.15.38:0/1954305118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0ec0ffa30 0x7fa0ec19b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:10.204 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.200+0000 7fa0f1c72640 1 -- 172.21.15.38:0/1954305118 >> 172.21.15.38:0/1954305118 conn(0x7fa0ec0fb710 msgr2=0x7fa0ec0fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:10.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.200+0000 7fa0f1c72640 1 -- 172.21.15.38:0/1954305118 shutdown_connections 2024-09-13T18:41:10.205 INFO:teuthology.orchestra.run.smithi038.stderr:2024-09-13T18:41:10.200+0000 7fa0f1c72640 1 -- 172.21.15.38:0/1954305118 wait complete. 2024-09-13T18:41:10.212 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:10 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/4157145750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:41:10.212 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:10 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/858490729' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T18:41:10.212 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:10 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/2725785114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T18:41:10.213 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:41:10.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:10.213 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:41:10.248 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-13T18:41:10.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:10.249 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:41:10.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:10.330 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-09-13T18:41:10.346 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:41:10.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:10.347 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:41:10.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:10.413 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2024-09-13T18:41:10.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:10.499 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-13T18:41:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:41:10.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:10.518 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:41:10.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:10 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/4157145750' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:41:10.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:10 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/858490729' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-09-13T18:41:10.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:10 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/2725785114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-09-13T18:41:10.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:10.549 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-13T18:41:10.653 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T18:41:10.664 INFO:tasks.cephadm:Teardown begin 2024-09-13T18:41:10.664 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:41:10.692 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:41:10.719 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T18:41:10.719 DEBUG:teuthology.orchestra.run.smithi038:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T18:41:10.748 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T18:41:10.775 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T18:41:10.775 INFO:tasks.cephadm.mon.smithi038:Stopping mon.smithi038... 2024-09-13T18:41:10.775 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi038 2024-09-13T18:41:11.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:10 smithi038 systemd[1]: Stopping Ceph mon.smithi038 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:41:11.081 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:11 smithi038 ceph-mon[91522]: from='client.? 172.21.15.38:0/1954305118' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T18:41:11.082 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:11 smithi038 ceph-mon[91522]: pgmap v353: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:41:11.385 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:11 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038[91518]: 2024-09-13T18:41:11.098+0000 7ff3cfd49640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi038 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:41:11.385 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:11 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038[91518]: 2024-09-13T18:41:11.098+0000 7ff3cfd49640 -1 mon.smithi038@0(leader) e2 *** Got Signal Terminated *** 2024-09-13T18:41:11.385 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:11 smithi038 podman[151533]: 2024-09-13 18:41:11.119560294 +0000 UTC m=+0.132826404 container died e7c5577a18c9f10bfd49e24e92aa2300b96e44b0190c0b1f827972a3dd5afae4 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0) 2024-09-13T18:41:11.519 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:11 smithi149 ceph-mon[76906]: from='client.? 172.21.15.38:0/1954305118' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T18:41:11.520 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:11 smithi149 ceph-mon[76906]: pgmap v353: 65 pgs: 65 active+clean; 206 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T18:41:11.720 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:11 smithi038 podman[151533]: 2024-09-13 18:41:11.481707782 +0000 UTC m=+0.494973883 container cleanup e7c5577a18c9f10bfd49e24e92aa2300b96e44b0190c0b1f827972a3dd5afae4 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:41:11.720 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:11 smithi038 bash[151533]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038 2024-09-13T18:41:12.052 INFO:journalctl@ceph.mon.smithi038.smithi038.stdout:Sep 13 18:41:11 smithi038 podman[151545]: 2024-09-13 18:41:11.891986816 +0000 UTC m=+0.766515728 container remove e7c5577a18c9f10bfd49e24e92aa2300b96e44b0190c0b1f827972a3dd5afae4 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi038, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T18:41:12.071 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi038.service' 2024-09-13T18:41:12.121 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:41:12.122 INFO:tasks.cephadm.mon.smithi038:Stopped mon.smithi038 2024-09-13T18:41:12.122 INFO:tasks.cephadm.mon.smithi149:Stopping mon.smithi149... 2024-09-13T18:41:12.122 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi149 2024-09-13T18:41:12.324 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:12 smithi149 systemd[1]: Stopping Ceph mon.smithi149 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:41:12.643 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:12 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149[76902]: 2024-09-13T18:41:12.467+0000 7fdebf06c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi149 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:41:12.644 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:12 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149[76902]: 2024-09-13T18:41:12.467+0000 7fdebf06c640 -1 mon.smithi149@1(peon) e2 *** Got Signal Terminated *** 2024-09-13T18:41:12.928 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:12 smithi149 podman[115708]: 2024-09-13 18:41:12.64158635 +0000 UTC m=+0.292968108 container died 66ddd3b3914176146d35baecab1d3d4b743ee11a27550d94b0e64b5f85f5a3e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:41:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:13 smithi149 podman[115708]: 2024-09-13 18:41:13.075992411 +0000 UTC m=+0.727374169 container cleanup 66ddd3b3914176146d35baecab1d3d4b743ee11a27550d94b0e64b5f85f5a3e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-13T18:41:13.269 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:13 smithi149 bash[115708]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149 2024-09-13T18:41:13.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi149.service' 2024-09-13T18:41:13.570 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:13 smithi149 podman[115729]: 2024-09-13 18:41:13.302576171 +0000 UTC m=+0.654747942 container remove 66ddd3b3914176146d35baecab1d3d4b743ee11a27550d94b0e64b5f85f5a3e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-mon-smithi149, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T18:41:13.570 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:13 smithi149 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi149.service: Deactivated successfully. 2024-09-13T18:41:13.570 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:13 smithi149 systemd[1]: Stopped Ceph mon.smithi149 for ccb73e88-71fc-11ef-bceb-c7b262605968. 2024-09-13T18:41:13.570 INFO:journalctl@ceph.mon.smithi149.smithi149.stdout:Sep 13 18:41:13 smithi149 systemd[1]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@mon.smithi149.service: Consumed 5.183s CPU time. 2024-09-13T18:41:13.602 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:41:13.602 INFO:tasks.cephadm.mon.smithi149:Stopped mon.smithi149 2024-09-13T18:41:13.603 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T18:41:13.603 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.0 2024-09-13T18:41:13.930 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:13 smithi038 systemd[1]: Stopping Ceph osd.0 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:41:14.331 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:13 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0[101080]: 2024-09-13T18:41:13.928+0000 7f287b52f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:41:14.331 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:13 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0[101080]: 2024-09-13T18:41:13.928+0000 7f287b52f640 -1 osd.0 97 *** Got signal Terminated *** 2024-09-13T18:41:14.332 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:13 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0[101080]: 2024-09-13T18:41:13.928+0000 7f287b52f640 -1 osd.0 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:41:19.581 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:19 smithi038 podman[151667]: 2024-09-13 18:41:19.311002723 +0000 UTC m=+5.498437165 container died 741f349e9433855b71157f2a9778be2be492abf280097950cf76577a9ed1257a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:41:19.940 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:19 smithi038 podman[151667]: 2024-09-13 18:41:19.695362721 +0000 UTC m=+5.882797147 container cleanup 741f349e9433855b71157f2a9778be2be492abf280097950cf76577a9ed1257a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-13T18:41:19.940 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:19 smithi038 bash[151667]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0 2024-09-13T18:41:20.276 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:19 smithi038 podman[151685]: 2024-09-13 18:41:19.938449102 +0000 UTC m=+0.623347673 container remove 741f349e9433855b71157f2a9778be2be492abf280097950cf76577a9ed1257a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T18:41:20.538 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:20 smithi038 podman[151771]: 2024-09-13 18:41:20.177864229 +0000 UTC m=+0.016318355 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:41:20.538 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:20 smithi038 podman[151771]: 2024-09-13 18:41:20.314465581 +0000 UTC m=+0.152919701 container create c6cd2f8eb373e8e4831f3b2c0c7c704196016ca6d470b8fb014395d2dc383345 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:41:20.831 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:20 smithi038 podman[151771]: 2024-09-13 18:41:20.542744533 +0000 UTC m=+0.381198662 container init c6cd2f8eb373e8e4831f3b2c0c7c704196016ca6d470b8fb014395d2dc383345 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T18:41:20.832 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:20 smithi038 podman[151771]: 2024-09-13 18:41:20.546357258 +0000 UTC m=+0.384811385 container start c6cd2f8eb373e8e4831f3b2c0c7c704196016ca6d470b8fb014395d2dc383345 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T18:41:20.832 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:20 smithi038 podman[151771]: 2024-09-13 18:41:20.667758123 +0000 UTC m=+0.506212240 container attach c6cd2f8eb373e8e4831f3b2c0c7c704196016ca6d470b8fb014395d2dc383345 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T18:41:20.832 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:20 smithi038 podman[151771]: 2024-09-13 18:41:20.737166174 +0000 UTC m=+0.575620295 container died c6cd2f8eb373e8e4831f3b2c0c7c704196016ca6d470b8fb014395d2dc383345 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-13T18:41:21.292 INFO:journalctl@ceph.osd.0.smithi038.stdout:Sep 13 18:41:21 smithi038 podman[151794]: 2024-09-13 18:41:21.288224211 +0000 UTC m=+0.541396882 container remove c6cd2f8eb373e8e4831f3b2c0c7c704196016ca6d470b8fb014395d2dc383345 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:41:21.308 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T18:41:21.349 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:41:21.350 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T18:41:21.350 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T18:41:21.350 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.1 2024-09-13T18:41:21.563 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:21 smithi038 systemd[1]: Stopping Ceph osd.1 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:41:21.831 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:21 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1[106415]: 2024-09-13T18:41:21.708+0000 7efd1c34b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:41:21.831 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:21 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1[106415]: 2024-09-13T18:41:21.708+0000 7efd1c34b640 -1 osd.1 97 *** Got signal Terminated *** 2024-09-13T18:41:21.831 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:21 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1[106415]: 2024-09-13T18:41:21.708+0000 7efd1c34b640 -1 osd.1 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:41:27.330 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:27 smithi038 podman[151874]: 2024-09-13 18:41:27.044049975 +0000 UTC m=+5.457297069 container died b2f99a2919b92ac33d06fe2ae40b3701d2da5c7f0faf0e9f981ca90365dc5e4d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T18:41:27.581 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:27 smithi038 podman[151874]: 2024-09-13 18:41:27.433911442 +0000 UTC m=+5.847158538 container cleanup b2f99a2919b92ac33d06fe2ae40b3701d2da5c7f0faf0e9f981ca90365dc5e4d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T18:41:27.581 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:27 smithi038 bash[151874]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1 2024-09-13T18:41:28.070 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:27 smithi038 podman[151900]: 2024-09-13 18:41:27.693541621 +0000 UTC m=+0.639843039 container remove b2f99a2919b92ac33d06fe2ae40b3701d2da5c7f0faf0e9f981ca90365dc5e4d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:41:28.331 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:28 smithi038 podman[151992]: 2024-09-13 18:41:27.971406873 +0000 UTC m=+0.016411448 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:41:28.331 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:28 smithi038 podman[151992]: 2024-09-13 18:41:28.077766861 +0000 UTC m=+0.122771420 container create 672180f0934646b33fb4b72ea8f717766ca9b7c4827586c7f19a0157c89ef618 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T18:41:28.331 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:28 smithi038 podman[151992]: 2024-09-13 18:41:28.28028474 +0000 UTC m=+0.325289298 container init 672180f0934646b33fb4b72ea8f717766ca9b7c4827586c7f19a0157c89ef618 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:41:28.331 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:28 smithi038 podman[151992]: 2024-09-13 18:41:28.283627343 +0000 UTC m=+0.328631901 container start 672180f0934646b33fb4b72ea8f717766ca9b7c4827586c7f19a0157c89ef618 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:41:28.778 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:28 smithi038 podman[151992]: 2024-09-13 18:41:28.355288806 +0000 UTC m=+0.400293377 container attach 672180f0934646b33fb4b72ea8f717766ca9b7c4827586c7f19a0157c89ef618 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-13T18:41:28.778 INFO:journalctl@ceph.osd.1.smithi038.stdout:Sep 13 18:41:28 smithi038 podman[151992]: 2024-09-13 18:41:28.472754282 +0000 UTC m=+0.517758842 container died 672180f0934646b33fb4b72ea8f717766ca9b7c4827586c7f19a0157c89ef618 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T18:41:29.061 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T18:41:29.105 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:41:29.105 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T18:41:29.105 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T18:41:29.105 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.2 2024-09-13T18:41:29.331 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:29 smithi038 systemd[1]: Stopping Ceph osd.2 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:41:29.831 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:29 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2[112205]: 2024-09-13T18:41:29.420+0000 7f529b701640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:41:29.831 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:29 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2[112205]: 2024-09-13T18:41:29.420+0000 7f529b701640 -1 osd.2 97 *** Got signal Terminated *** 2024-09-13T18:41:29.831 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:29 smithi038 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2[112205]: 2024-09-13T18:41:29.420+0000 7f529b701640 -1 osd.2 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:41:35.323 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:34 smithi038 podman[152094]: 2024-09-13 18:41:34.908663789 +0000 UTC m=+5.575732755 container died 090af670cd3d34d0799f3933d9820953cca0d2a8da8789f7c1102de47dd2240a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T18:41:35.323 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:35 smithi038 podman[152094]: 2024-09-13 18:41:35.32096074 +0000 UTC m=+5.988029704 container cleanup 090af670cd3d34d0799f3933d9820953cca0d2a8da8789f7c1102de47dd2240a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T18:41:35.581 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:35 smithi038 bash[152094]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2 2024-09-13T18:41:35.581 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:35 smithi038 podman[152109]: 2024-09-13 18:41:35.489154983 +0000 UTC m=+0.579153963 container remove 090af670cd3d34d0799f3933d9820953cca0d2a8da8789f7c1102de47dd2240a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:41:36.244 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:35 smithi038 podman[152202]: 2024-09-13 18:41:35.849381394 +0000 UTC m=+0.016494837 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:41:36.244 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:35 smithi038 podman[152202]: 2024-09-13 18:41:35.96541184 +0000 UTC m=+0.132525328 container create d9b9f7311e4016617f9c847b36f3dd9418e568baafa56ffe2f1affb43357a39a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T18:41:36.245 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:36 smithi038 podman[152202]: 2024-09-13 18:41:36.167886126 +0000 UTC m=+0.334999572 container init d9b9f7311e4016617f9c847b36f3dd9418e568baafa56ffe2f1affb43357a39a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T18:41:36.245 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:36 smithi038 podman[152202]: 2024-09-13 18:41:36.171347204 +0000 UTC m=+0.338460653 container start d9b9f7311e4016617f9c847b36f3dd9418e568baafa56ffe2f1affb43357a39a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T18:41:36.245 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:36 smithi038 podman[152202]: 2024-09-13 18:41:36.242830163 +0000 UTC m=+0.409943626 container attach d9b9f7311e4016617f9c847b36f3dd9418e568baafa56ffe2f1affb43357a39a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:41:36.563 INFO:journalctl@ceph.osd.2.smithi038.stdout:Sep 13 18:41:36 smithi038 podman[152202]: 2024-09-13 18:41:36.365691892 +0000 UTC m=+0.532805338 container died d9b9f7311e4016617f9c847b36f3dd9418e568baafa56ffe2f1affb43357a39a (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T18:41:37.064 DEBUG:teuthology.orchestra.run.smithi038:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T18:41:37.110 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:41:37.110 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T18:41:37.110 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T18:41:37.110 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.3 2024-09-13T18:41:37.519 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:37 smithi149 systemd[1]: Stopping Ceph osd.3 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:41:38.019 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:37 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[85197]: 2024-09-13T18:41:37.712+0000 7f8e2e6ba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:41:38.020 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:37 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[85197]: 2024-09-13T18:41:37.712+0000 7f8e2e6ba640 -1 osd.3 97 *** Got signal Terminated *** 2024-09-13T18:41:38.020 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:37 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3[85197]: 2024-09-13T18:41:37.712+0000 7f8e2e6ba640 -1 osd.3 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:41:40.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:39 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:39.893+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:41.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:40 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:40.914+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:42.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:41 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:41.930+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:43.258 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:42 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:42.948+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:43.509 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:43 smithi149 podman[115852]: 2024-09-13 18:41:43.256580769 +0000 UTC m=+5.952171200 container died e4321b085347c98d8a2b8b42dcf0b1637af4ee932684b712bd3141db0003fdd2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T18:41:43.769 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:43 smithi149 podman[115852]: 2024-09-13 18:41:43.595942214 +0000 UTC m=+6.291532652 container cleanup e4321b085347c98d8a2b8b42dcf0b1637af4ee932684b712bd3141db0003fdd2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux ) 2024-09-13T18:41:43.769 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:43 smithi149 bash[115852]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3 2024-09-13T18:41:43.770 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:43 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:43.506+0000 7f0009e91640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.644617+0000 front 2024-09-13T18:41:18.644636+0000 (oldest deadline 2024-09-13T18:41:43.344511+0000) 2024-09-13T18:41:44.204 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:43 smithi149 podman[115868]: 2024-09-13 18:41:43.772114163 +0000 UTC m=+0.512759212 container remove e4321b085347c98d8a2b8b42dcf0b1637af4ee932684b712bd3141db0003fdd2 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T18:41:44.204 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:43 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:43.920+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:44.460 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:44 smithi149 podman[115956]: 2024-09-13 18:41:44.104956887 +0000 UTC m=+0.016053836 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:41:44.460 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:44 smithi149 podman[115956]: 2024-09-13 18:41:44.223086713 +0000 UTC m=+0.134183652 container create 261a7e5426f356c98e0cc0e904bbda7f8166adc5b9bc5a76309b628f0f420c18 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T18:41:44.460 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:44 smithi149 podman[115956]: 2024-09-13 18:41:44.458716097 +0000 UTC m=+0.369813036 container init 261a7e5426f356c98e0cc0e904bbda7f8166adc5b9bc5a76309b628f0f420c18 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:41:44.769 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:44 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:44.517+0000 7f0009e91640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.644617+0000 front 2024-09-13T18:41:18.644636+0000 (oldest deadline 2024-09-13T18:41:43.344511+0000) 2024-09-13T18:41:44.770 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:44 smithi149 podman[115956]: 2024-09-13 18:41:44.462116666 +0000 UTC m=+0.373213608 container start 261a7e5426f356c98e0cc0e904bbda7f8166adc5b9bc5a76309b628f0f420c18 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:41:44.770 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:44 smithi149 podman[115956]: 2024-09-13 18:41:44.550547107 +0000 UTC m=+0.461644059 container attach 261a7e5426f356c98e0cc0e904bbda7f8166adc5b9bc5a76309b628f0f420c18 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:41:44.770 INFO:journalctl@ceph.osd.3.smithi149.stdout:Sep 13 18:41:44 smithi149 podman[115956]: 2024-09-13 18:41:44.655803992 +0000 UTC m=+0.566900935 container died 261a7e5426f356c98e0cc0e904bbda7f8166adc5b9bc5a76309b628f0f420c18 (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:41:45.264 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:44 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:44.945+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:45.283 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T18:41:45.323 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:41:45.323 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T18:41:45.323 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T18:41:45.323 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.4 2024-09-13T18:41:45.519 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:45 smithi149 systemd[1]: Stopping Ceph osd.4 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:41:45.519 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:45 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:45.500+0000 7f0009e91640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.644617+0000 front 2024-09-13T18:41:18.644636+0000 (oldest deadline 2024-09-13T18:41:43.344511+0000) 2024-09-13T18:41:45.921 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:45 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:45.640+0000 7f000d08d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:41:45.921 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:45 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:45.640+0000 7f000d08d640 -1 osd.4 97 *** Got signal Terminated *** 2024-09-13T18:41:45.921 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:45 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:45.640+0000 7f000d08d640 -1 osd.4 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:41:46.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:45 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:45.918+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:46.769 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:46 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:46.477+0000 7f0009e91640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.644617+0000 front 2024-09-13T18:41:18.644636+0000 (oldest deadline 2024-09-13T18:41:43.344511+0000) 2024-09-13T18:41:47.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:46 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:46.901+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:47.769 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:47 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:47.474+0000 7f0009e91640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.644617+0000 front 2024-09-13T18:41:18.644636+0000 (oldest deadline 2024-09-13T18:41:43.344511+0000) 2024-09-13T18:41:47.770 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:47 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:47.474+0000 7f0009e91640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:25.045399+0000 front 2024-09-13T18:41:25.045386+0000 (oldest deadline 2024-09-13T18:41:47.245688+0000) 2024-09-13T18:41:48.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:47 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:47.893+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:48.270 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:47 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:47.893+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:26.586446+0000 front 2024-09-13T18:41:26.586415+0000 (oldest deadline 2024-09-13T18:41:47.086280+0000) 2024-09-13T18:41:48.769 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:48 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:48.447+0000 7f0009e91640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.644617+0000 front 2024-09-13T18:41:18.644636+0000 (oldest deadline 2024-09-13T18:41:43.344511+0000) 2024-09-13T18:41:48.770 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:48 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:48.447+0000 7f0009e91640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:25.045399+0000 front 2024-09-13T18:41:25.045386+0000 (oldest deadline 2024-09-13T18:41:47.245688+0000) 2024-09-13T18:41:49.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:48 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:48.851+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:49.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:48 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:48.851+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:26.586446+0000 front 2024-09-13T18:41:26.586415+0000 (oldest deadline 2024-09-13T18:41:47.086280+0000) 2024-09-13T18:41:49.769 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:49 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:49.437+0000 7f0009e91640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.644617+0000 front 2024-09-13T18:41:18.644636+0000 (oldest deadline 2024-09-13T18:41:43.344511+0000) 2024-09-13T18:41:49.769 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:49 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:49.437+0000 7f0009e91640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:25.045399+0000 front 2024-09-13T18:41:25.045386+0000 (oldest deadline 2024-09-13T18:41:47.245688+0000) 2024-09-13T18:41:50.274 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:49 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:49.879+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:50.274 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:49 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:49.879+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:26.586446+0000 front 2024-09-13T18:41:26.586415+0000 (oldest deadline 2024-09-13T18:41:47.086280+0000) 2024-09-13T18:41:50.770 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:50 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:50.484+0000 7f0009e91640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.644617+0000 front 2024-09-13T18:41:18.644636+0000 (oldest deadline 2024-09-13T18:41:43.344511+0000) 2024-09-13T18:41:50.770 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:50 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4[90231]: 2024-09-13T18:41:50.484+0000 7f0009e91640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:25.045399+0000 front 2024-09-13T18:41:25.045386+0000 (oldest deadline 2024-09-13T18:41:47.245688+0000) 2024-09-13T18:41:51.269 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:51 smithi149 podman[116058]: 2024-09-13 18:41:51.115007896 +0000 UTC m=+5.565533641 container died c6ec97a4d9ff15851d3401caf1c5b00c20968676b20c79fdf983e3a24ce45f6b (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T18:41:51.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:50 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:50.888+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:51.270 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:50 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:50.888+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:26.586446+0000 front 2024-09-13T18:41:26.586415+0000 (oldest deadline 2024-09-13T18:41:47.086280+0000) 2024-09-13T18:41:51.769 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:51 smithi149 podman[116058]: 2024-09-13 18:41:51.457275339 +0000 UTC m=+5.907801087 container cleanup c6ec97a4d9ff15851d3401caf1c5b00c20968676b20c79fdf983e3a24ce45f6b (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T18:41:51.770 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:51 smithi149 bash[116058]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4 2024-09-13T18:41:51.770 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:51 smithi149 podman[116073]: 2024-09-13 18:41:51.633311727 +0000 UTC m=+0.513026754 container remove c6ec97a4d9ff15851d3401caf1c5b00c20968676b20c79fdf983e3a24ce45f6b (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T18:41:52.222 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:51 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:51.928+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:52.223 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:51 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:51.928+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:26.586446+0000 front 2024-09-13T18:41:26.586415+0000 (oldest deadline 2024-09-13T18:41:47.086280+0000) 2024-09-13T18:41:52.223 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:52 smithi149 podman[116163]: 2024-09-13 18:41:51.969253954 +0000 UTC m=+0.015991665 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:41:52.223 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:52 smithi149 podman[116163]: 2024-09-13 18:41:52.09281403 +0000 UTC m=+0.139551773 container create 8233af6e93036bd66e45ed6b342851840388d2860864b79de80e18213f2968ab (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T18:41:52.521 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:52 smithi149 podman[116163]: 2024-09-13 18:41:52.320128484 +0000 UTC m=+0.366866182 container init 8233af6e93036bd66e45ed6b342851840388d2860864b79de80e18213f2968ab (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T18:41:52.521 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:52 smithi149 podman[116163]: 2024-09-13 18:41:52.32347907 +0000 UTC m=+0.370216768 container start 8233af6e93036bd66e45ed6b342851840388d2860864b79de80e18213f2968ab (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T18:41:52.521 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:52 smithi149 podman[116163]: 2024-09-13 18:41:52.395092268 +0000 UTC m=+0.441829967 container attach 8233af6e93036bd66e45ed6b342851840388d2860864b79de80e18213f2968ab (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T18:41:52.899 INFO:journalctl@ceph.osd.4.smithi149.stdout:Sep 13 18:41:52 smithi149 podman[116163]: 2024-09-13 18:41:52.518882602 +0000 UTC m=+0.565620310 container died 8233af6e93036bd66e45ed6b342851840388d2860864b79de80e18213f2968ab (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-13T18:41:53.062 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T18:41:53.101 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:41:53.101 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T18:41:53.101 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T18:41:53.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.5 2024-09-13T18:41:53.162 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:52 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:52.896+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:53.163 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:52 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:52.896+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:26.586446+0000 front 2024-09-13T18:41:26.586415+0000 (oldest deadline 2024-09-13T18:41:47.086280+0000) 2024-09-13T18:41:53.420 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:53 smithi149 systemd[1]: Stopping Ceph osd.5 for ccb73e88-71fc-11ef-bceb-c7b262605968... 2024-09-13T18:41:53.769 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:53 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:53.418+0000 7f9b7f642640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:41:53.769 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:53 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:53.418+0000 7f9b7f642640 -1 osd.5 97 *** Got signal Terminated *** 2024-09-13T18:41:53.769 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:53 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:53.418+0000 7f9b7f642640 -1 osd.5 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:41:54.279 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:53 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:53.907+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:54.279 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:53 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:53.907+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:26.586446+0000 front 2024-09-13T18:41:26.586415+0000 (oldest deadline 2024-09-13T18:41:47.086280+0000) 2024-09-13T18:41:55.019 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:54 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:54.859+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:55.019 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:54 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:54.859+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:26.586446+0000 front 2024-09-13T18:41:26.586415+0000 (oldest deadline 2024-09-13T18:41:47.086280+0000) 2024-09-13T18:41:56.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:55 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:55.865+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:56.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:55 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:55.865+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:26.586446+0000 front 2024-09-13T18:41:26.586415+0000 (oldest deadline 2024-09-13T18:41:47.086280+0000) 2024-09-13T18:41:57.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:56 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:56.891+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:57.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:56 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:56.891+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:26.586446+0000 front 2024-09-13T18:41:26.586415+0000 (oldest deadline 2024-09-13T18:41:47.086280+0000) 2024-09-13T18:41:58.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:57 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:57.843+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6806 osd.0 since back 2024-09-13T18:41:18.485277+0000 front 2024-09-13T18:41:18.485289+0000 (oldest deadline 2024-09-13T18:41:39.585090+0000) 2024-09-13T18:41:58.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:57 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:57.843+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6814 osd.1 since back 2024-09-13T18:41:26.586446+0000 front 2024-09-13T18:41:26.586415+0000 (oldest deadline 2024-09-13T18:41:47.086280+0000) 2024-09-13T18:41:58.269 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:57 smithi149 ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5[95220]: 2024-09-13T18:41:57.843+0000 7f9b7c446640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.38:6822 osd.2 since back 2024-09-13T18:41:32.387246+0000 front 2024-09-13T18:41:32.387260+0000 (oldest deadline 2024-09-13T18:41:57.087143+0000) 2024-09-13T18:41:59.170 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:58 smithi149 podman[116264]: 2024-09-13 18:41:58.911598181 +0000 UTC m=+5.593975193 container died 6faab71ae8a99b9dc6b17761d9400713563e0d0448912eef615ca3a901cdaacd (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T18:41:59.438 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:59 smithi149 podman[116264]: 2024-09-13 18:41:59.268093913 +0000 UTC m=+5.950470923 container cleanup 6faab71ae8a99b9dc6b17761d9400713563e0d0448912eef615ca3a901cdaacd (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:41:59.438 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:59 smithi149 bash[116264]: ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5 2024-09-13T18:41:59.734 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:59 smithi149 podman[116280]: 2024-09-13 18:41:59.435950781 +0000 UTC m=+0.526415048 container remove 6faab71ae8a99b9dc6b17761d9400713563e0d0448912eef615ca3a901cdaacd (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-13T18:41:59.991 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:59 smithi149 podman[116369]: 2024-09-13 18:41:59.735461663 +0000 UTC m=+0.016228788 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:41:59.991 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:41:59 smithi149 podman[116369]: 2024-09-13 18:41:59.853729037 +0000 UTC m=+0.134496203 container create 542fc743c26e7ce9b90df3731fc53e8cbcfee984f03fe03727495a96db51355d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T18:42:00.519 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:42:00 smithi149 podman[116369]: 2024-09-13 18:42:00.089295494 +0000 UTC m=+0.370062618 container init 542fc743c26e7ce9b90df3731fc53e8cbcfee984f03fe03727495a96db51355d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:42:00.520 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:42:00 smithi149 podman[116369]: 2024-09-13 18:42:00.092587914 +0000 UTC m=+0.373355041 container start 542fc743c26e7ce9b90df3731fc53e8cbcfee984f03fe03727495a96db51355d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T18:42:00.520 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:42:00 smithi149 podman[116369]: 2024-09-13 18:42:00.172521366 +0000 UTC m=+0.453288498 container attach 542fc743c26e7ce9b90df3731fc53e8cbcfee984f03fe03727495a96db51355d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True) 2024-09-13T18:42:00.520 INFO:journalctl@ceph.osd.5.smithi149.stdout:Sep 13 18:42:00 smithi149 podman[116369]: 2024-09-13 18:42:00.280764412 +0000 UTC m=+0.561531536 container died 542fc743c26e7ce9b90df3731fc53e8cbcfee984f03fe03727495a96db51355d (image=quay.ceph.io/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-ccb73e88-71fc-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T18:42:00.893 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ccb73e88-71fc-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T18:42:00.974 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:42:00.974 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T18:42:00.975 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T18:42:01.138 INFO:teuthology.orchestra.run.smithi038.stdout:Deleting cluster with fsid: ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:42:27.195 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T18:42:27.350 INFO:teuthology.orchestra.run.smithi149.stdout:Deleting cluster with fsid: ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:42:39.512 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:42:39.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:42:39.574 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T18:42:39.584 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903974/remote/smithi038/crash 2024-09-13T18:42:39.584 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/crash -- . 2024-09-13T18:42:39.616 INFO:teuthology.orchestra.run.smithi038.stderr:tar: /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T18:42:39.616 INFO:teuthology.orchestra.run.smithi038.stderr:tar: Error is not recoverable: exiting now 2024-09-13T18:42:39.618 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903974/remote/smithi149/crash 2024-09-13T18:42:39.619 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/crash -- . 2024-09-13T18:42:39.643 INFO:teuthology.orchestra.run.smithi149.stderr:tar: /var/lib/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T18:42:39.643 INFO:teuthology.orchestra.run.smithi149.stderr:tar: Error is not recoverable: exiting now 2024-09-13T18:42:39.644 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T18:42:39.644 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T18:42:39.691 INFO:teuthology.orchestra.run.smithi038.stderr:grep: /var/log/ceph/ccb73e88-71fc-11ef-bceb-c7b262605968/ceph.log: No such file or directory 2024-09-13T18:42:39.696 INFO:tasks.cephadm:Compressing logs... 2024-09-13T18:42:39.696 DEBUG:teuthology.orchestra.run.smithi038:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:42:39.740 DEBUG:teuthology.orchestra.run.smithi149:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:42:39.766 INFO:teuthology.orchestra.run.smithi038.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T18:42:39.766 INFO:teuthology.orchestra.run.smithi149.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T18:45:10.377 INFO:tasks.cephadm:Archiving logs... 2024-09-13T18:45:10.378 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903974/remote/smithi038/log 2024-09-13T18:45:10.379 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:45:27.182 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903974/remote/smithi149/log 2024-09-13T18:45:27.279 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:45:30.496 INFO:tasks.cephadm:Removing cluster... 2024-09-13T18:45:30.496 DEBUG:teuthology.orchestra.run.smithi038:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 --force 2024-09-13T18:45:30.656 INFO:teuthology.orchestra.run.smithi038.stdout:Deleting cluster with fsid: ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:45:31.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ccb73e88-71fc-11ef-bceb-c7b262605968 --force 2024-09-13T18:45:31.222 INFO:teuthology.orchestra.run.smithi149.stdout:Deleting cluster with fsid: ccb73e88-71fc-11ef-bceb-c7b262605968 2024-09-13T18:45:31.575 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T18:45:31.575 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T18:45:31.593 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T18:45:31.610 INFO:tasks.cephadm:Teardown complete 2024-09-13T18:45:31.610 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T18:45:31.623 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T18:45:31.623 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:45:31.636 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:45:31.744 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T18:45:31.757 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T18:45:31.757 DEBUG:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:45:31.760 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:45:31.774 INFO:teuthology.orchestra.run.smithi038.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:45:31.775 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:45:31.779 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:45:31.780 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-13T18:45:31.780 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 -1148us[-1142us] +/- 63ms 2024-09-13T18:45:31.780 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 +3109us[+3109us] +/- 81ms 2024-09-13T18:45:31.780 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 -1351us[-1351us] +/- 65ms 2024-09-13T18:45:31.780 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:45:31.780 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:45:31.780 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-09-13T18:45:31.780 INFO:teuthology.orchestra.run.smithi038.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 -1162us[-1174us] +/- 63ms 2024-09-13T18:45:31.780 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 29 +3084us[+3073us] +/- 81ms 2024-09-13T18:45:31.780 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 -1378us[-1389us] +/- 65ms 2024-09-13T18:45:31.781 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:45:31.781 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T18:45:31.791 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T18:45:31.792 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T18:45:31.803 DEBUG:teuthology.orchestra.run.smithi038:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:45:31.908 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:45:31.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:45:32.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:45:32.014 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:45:32.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:45:32.043 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T18:45:32.053 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T18:45:32.064 INFO:teuthology.task.internal:Duration was 1884.046740 seconds 2024-09-13T18:45:32.065 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T18:45:32.078 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T18:45:32.078 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:45:32.081 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:45:32.120 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:45:32.122 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:45:32.372 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T18:45:32.372 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi038.front.sepia.ceph.com 2024-09-13T18:45:32.372 DEBUG:teuthology.orchestra.run.smithi038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:45:32.434 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-09-13T18:45:32.434 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:45:32.458 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T18:45:32.459 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:45:32.477 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:45:32.525 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T18:45:32.526 DEBUG:teuthology.orchestra.run.smithi038:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:45:32.543 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:45:33.189 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T18:45:33.201 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T18:45:33.201 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:45:33.227 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:45:33.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T18:45:33.265 DEBUG:teuthology.orchestra.run.smithi038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:45:33.269 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:45:33.291 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = core 2024-09-13T18:45:33.317 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-09-13T18:45:33.331 DEBUG:teuthology.orchestra.run.smithi038:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:45:33.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:45:33.361 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:45:33.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:45:33.386 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T18:45:33.399 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T18:45:33.401 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903974/remote/smithi038 2024-09-13T18:45:33.402 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:45:33.453 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903974/remote/smithi149 2024-09-13T18:45:33.454 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:45:33.492 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T18:45:33.493 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:45:33.495 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:45:33.542 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T18:45:33.556 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T18:45:33.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T18:45:33.631 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T18:45:33.632 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:45:33.634 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:45:33.647 INFO:teuthology.orchestra.run.smithi038.stdout: 265861 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:45 /home/ubuntu/cephtest 2024-09-13T18:45:33.649 INFO:teuthology.orchestra.run.smithi149.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:45 /home/ubuntu/cephtest 2024-09-13T18:45:33.650 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T18:45:33.662 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T18:45:33.716 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1884.0467398166656 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T18:45:33.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:45:33.820 INFO:teuthology.run:pass